It’d be so funny if research hits a breakthrough that absolutely collapses the cost of inference, allowing anyone to self host frontier models, eliminating the ability for all the main AI companies to ever recoup their costs.
Well, except where everyone’s data gets sold at bottom dollar in liquidation. Actually, that’d be pretty funny too.
I don’t know if that’ll happen to frontier models, but I definitely see it happening with models that work well enough for the vast majority of personal use.
It’d be so funny if research hits a breakthrough that absolutely collapses the cost of inference, allowing anyone to self host frontier models, eliminating the ability for all the main AI companies to ever recoup their costs.
Well, except where everyone’s data gets sold at bottom dollar in liquidation. Actually, that’d be pretty funny too.
Self host on what? The way we’re going 16GB of RAM to run the models will be a capital investment…
I don’t know if that’ll happen to frontier models, but I definitely see it happening with models that work well enough for the vast majority of personal use.