60% of AI Usage Is Now Cheap Open Source?!
60% of AI Usage Is Now Cheap Open Source?!
Description
AI users are shifting toward cost-effective open-source models for everyday tasks over frontier models
Key Takeaways
- 1Approximately 55% to 60% of recent AI token usage has transitioned to lower-cost open-source model providers.
- 2Frontier models from developers like OpenAI and Anthropic currently maintain a 4 to 5-month lead in terms of raw intelligence and capabilities.
- 3Developers are increasingly opting for smaller, distilled open-source models because they are sufficient for handling standard daily tasks.
- 4The surge in open-source adoption challenges the pricing models of major frontier AI labs as users prioritize cost efficiency.
Transcript
When you look at that chart that shows that, you know, 55 60% of token usage over the last couple months was with the lower cost open source, you know, providers, what interpretation do you actually take from that in terms of what it means for an Anthropic or Open AI? Yeah, I think um essentially what we're saying is that there is as what we can expect there's just more people using AI. And I think um at some points early this year or last year, late last year early this year, we were starting to see open source catch up to frontier essentially. And when um frontier releases a model the amount of time it was taking for open source to get pretty close was starting to shrink over time and they would they came up with like very interesting ways to distill the models and, I know, Anthropic reported and open air reported and then models have been distilled pretty fast by China and all of that. But more recently since the newest models have been released, it seems like open source has been lagging behind by quite a number of months now, so over almost 4 or 5 months now where you can still see the the the massive difference in the intelligence that they're producing. Um, but I think also generally because there is a lot more usage, people are realizing that they don't need frontier for a lot of things that they're doing, and this just means that people can just dedicate uh, way cheaper tokens to do, because of how good they've become now, to do a lot of um, everyday task before now.

