If the bubble pops (meaning these massive compute costs never turn into actual profits and the VC money dries up) what does the tech landscape look like?
A lot of us use Copilot, Claude, or ChatGPT daily for coding and docs. If the subsidized cheap access vanishes because these companies can't eat the losses anymore, do the tools just disappear? Because if a tool like Claude Code (or any other LLM) suddenly cost $1,000 a month to reflect what it actually costs to run, would people keep paying for it out of pocket? Would their companies?
I’m especially curious to hear from anyone who lived through 2000 or 2008. Does a postbubble world mean we just abandon the tech entirely or is it a move toward expensive solutions?
Comments
Give it a try.
To get started: https://simonwillison.net/2024/Nov/12/qwen25-coder/
or https://simonwillison.net/2024/Dec/9/llama-33-70b/
https://ollama.com/library/glm-4.7-flash
When the AI/LLM bubble pops, LLMs will still exist and be used. They just won't be hyped and pushed everywhere.
As you correctly state, the cost of AI as a Service (AIaaS) will increase for end users, but this isn't necessarily a bad thing. It will allow the "real" users to continue having access to it and sieve out the ones who are just playing around. Prices for RAM, GPUs, SSDs will normalize a lot and more people will move towards local models.
Similarly to what happened with the dot-com bubble (I saw it happening), it doesn't mean that everything will disappear, but that it will change/adapt. All of us AI realists are currently being treated like technophobes when we say things like that ;-)
The LLM companies are profitable on the current gen models. Inference is profitable, rather than subsidized.
They are raising the biggest chunk of capital to buy data center compute that will come online ~2 years from now and be an order of magnitude larger.
The bear case for the labs is that they're Cisco, not Pets.com.
If the AI tool companies increase their rates 2x, 5x, 10x, is it worth it? They aren't going to lower prices.
Consumer AI tool usage isn't going to get a lot of adopters that will pay, people outside of a work environment will see it as a fun toy, much like social media and will be fine with being served ads and letting their loss of privacy be the cost.
I work in consulting and I would have had to scope projects with myself as the lead and at least a couple of juniors to do the grunt work while I do some of the work myself and do the tech lead type work. Now I can do it all myself.
> if a tool like Claude Code (or any other LLM) suddenly cost $1,000 a month to reflect what it actually costs to run, would people keep paying for it out of pocket? Would their companies?
Probably. If you're not gaining at least $1000 a month in productivity now, then you're doing it wrong. I suspect however they may become an enterprise only offering, with limited availability to "normies"
> I’m especially curious to hear from anyone who lived through 2000 or 2008. Does a postbubble world mean we just abandon the tech entirely or is it a move toward expensive solutions?
In the late 90s you could get 100k a year for being able to spell HTML, and then the bubble pop pushed all the grifters back to whatever they were doing before. Those with real skill stuck around, even though it did suppress salaries for a while.
I think once the dust settles n next 2-5 years, few clear winners will remain who will figure out a way to become cash positive.
I wouldn't find it hard to personally justify $200/month or $300/month for the single best LLM tool available to me. Right now I have $100/month spread out over a few different tools and it's a bargain.
I'm curious why do you keep many subscriptions around? Asking because I do too though don't have a good reason to keep anything other than Anthropic/Claude.
Personally:
Perplexity has replaced Google searches for me – basically looking things up
ChatGPT/Claude is what I use for generating code (I'm not a programmer but I like scripting tasks at work)
Claude I think is better at writing than ChatGPT
MidJourney is $10 and I like it best for image generation which I do for work and like to keep it around.