OpenAI’s o1-preview is the first model to substantially push the frontier of language model intelligence since the original GPT-4 over 18 months ago
Since @OpenAI GPT-4’s March 2023 launch, we’ve seen dozens of companies scramble to catch up with OpenAI. But until o1, we haven’t seen the next leap forward for intelligence.
Our independent evaluations on o1-preview confirm that o1 achieves the most substantial leap in Artificial Analysis Intelligence Index since GPT-4. We continue to believe that o1 is generally unsuitable for the majority of production use-cases today due to speed and cost trade-offs (links below to previous detailed coverage), but the significance of OpenAI taking back the intelligence lead should not be understated.
Our Frontier Language Models Over Time chart below tracks the Artificial Analysis Intelligence Index scores of the leading frontier-class model from OpenAI, Anthropic, Google, Mistral and Meta.
Sep 25, 2024 · 2:55 PM UTC
11
66
396

