According to the most recent Angus-Reid polling, two thirds of Canadians want their provincial government to place restrictions on the data-centre buildout.
Shrinking demand for LLMs? What planet are you living on?
If you look at OpenRouter’s history back a year you can see the massive explosion in inference tokens consumed.
https://openrouter.ai/rankings?view=month#top-models
Obviously that’s not a perfect representation of the entire market given that the major companies also provide their own inference, but it’s the largest public view of usage and is likely extremely representative of what’s going on behind the scenes.
The only thing holding more organizations back from using even more inference is cost, so any sort of “pop” is just going to immediately be eaten up by increased usage at slightly lower prices.
Will a bunch of investors lose their shirts? Absolutely, but there is no lack of demand for datacenters right now.
The cost is increasing as providers are incredibly far off from the profit promises they gave investors. An estimated 6 trillion in productivity is required for the investments to break even, and the reality is things are way off the mark.
Shrinking demand for LLMs? What planet are you living on?
If you look at OpenRouter’s history back a year you can see the massive explosion in inference tokens consumed. https://openrouter.ai/rankings?view=month#top-models Obviously that’s not a perfect representation of the entire market given that the major companies also provide their own inference, but it’s the largest public view of usage and is likely extremely representative of what’s going on behind the scenes.
The only thing holding more organizations back from using even more inference is cost, so any sort of “pop” is just going to immediately be eaten up by increased usage at slightly lower prices.
Will a bunch of investors lose their shirts? Absolutely, but there is no lack of demand for datacenters right now.
The cost is increasing as providers are incredibly far off from the profit promises they gave investors. An estimated 6 trillion in productivity is required for the investments to break even, and the reality is things are way off the mark.
https://futurism.com/future-society/data-centers-trillion-capital-time-bomb-bain
Add to that serious problems measuring ROI, public backlash, CEO cynicism.
That planet.
That’s not shrinking demand. That’s stupid investors. Those are not the same thing.
Ceos are turning sour as ability measure ROI has proven elusive. Also, the above implies a slow increase to prices which is already happening.