Though that’s quite a different kind of model. I suspect a model with even 3bil active parameter (let alone 560M like deepseek ocr) being as capable as gpt-5-pro. even if they did go towards a mixture of model route it’s likely each model is a sparse MoE quite a bit larger than 3bil active params

I agree with the latter but I assumed gpt 5 is also a sparse MOE. Like having a small dense of this capability sounds not feasible.

Quite impressed by your ability to keep a conversation in good faith.

Are you implying that 5-pro isn’t a very sparse MoE?

Yeah that’s a problem for them. Google was profitable within 2-3 years of founding (IIRC). Openai is sitting on a large user base with a small portion paying for it. I guess that’s why large hiring from meta and Instacart product head to figure out monetization strategy.

OpenAI’s total investment is about what 60 bil. They spend 5 bil a year. Googles 2024 ad revenue was about 240 billion. OpenAI has 800 mil weekly active users that they can find ways to monetize (ads? Shopping?) so as large as these numbers seem ad revenue makes the world goes round I guess

God knows. At least Google has the cash flow to keep going further. So as long as the other players gets private investment backing, on it goes. Or some market segmentation or significant model capability plateauing. Whichever comes first.

Research + training new models

The inference business is profitable for them (so the cost of serving models is less than money they make through api fees) Though they keep spending more and more on research cause if they don’t google, oai, xai or number of Chinese competitors might start taking up their api business.

olickel.com/everything-...

I’m pretty sure there used to be an auto option a few weeks back. They seem to have removed it.