Matthew Groff’s Post

View profile for Matthew Groff, graphic

Principal AI Engineer @ Umbrage, part of Bain & Company | AI Capability Lead

💡 OpenAI’s New o1 Models: Powerful, but Expensive – Use with Care! OpenAI has just introduced two new models, o1-preview and o1-mini. While these models seem impressive, they come with a hefty price tag that may not fit every use case. 🔍 Pricing Breakdown: o1-preview $15.00 / 1M input tokens $60.00 / 1M output tokens o1-mini (more cost-efficient but still pricey!) $3.00 / 1M input tokens $12.00 / 1M output tokens ⚠️ My POV: These models are likely expensive for a reason and could be worth the cost in high-value scenarios. But that doesn’t mean it’s time to start replacing every model in your stack with o1-preview just yet. If your organization relies on LLMs to make decisions in high ROI situations, then these models might justify their price. However, for everyday tasks like intent recognition or LLM routing, swapping out your current models for o1-preview could lead to massive overhead without the proportional benefit. It’s all about choosing the right tool for the job! 💰🔍 The new models have great potential, but before making the leap, evaluate the cost-effectiveness carefully. Let’s not fall into the trap of using the latest tech where it’s not needed. Curious to hear if anyone else is planning to adopt these models—what’s your strategy?

View organization page for OpenAI, graphic

6,174,226 followers

We're releasing a preview of OpenAI o1—a new series of AI models designed to spend more time thinking before they respond. This new series of AI models can reason through complex tasks and solve harder problems than previous models in science, coding, and math. Rolling out today in ChatGPT to all Plus and Team users, and in the API for developers on tier 5.    More here: www.openai.com/o1

Matthew Groff

Principal AI Engineer @ Umbrage, part of Bain & Company | AI Capability Lead

3mo

The team behind Devin ran some tests for performance for agents: https://x.com/cognition_labs/status/1834292718174077014

Like
Reply

To view or add a comment, sign in

Explore topics