rvachev.orgEN / RU / πŸ€–
← Back to essays
Β· Essay Β· 2 min

Held the Seventh Lecture Club Call on Stanford MS&E 435

Held the seventh Lecture Club call on Stanford MS&E 435: Economics of the AI Supercycle. Discussed the economics of inference and the macro picture.

πŸŽ™ We held the seventh Lecture Club call on Stanford MS&E 435: Economics of the AI Supercycle.

Lecture 7 β€” Tuhin Srivastava (Baseten). The topic was the economics of inference: open-weight vs. open source, renting GPUs vs. owning, heterogeneous compute. The group agreed that the value of the lecture was not in the guest's pitch but in the macro picture β€” and quickly shifted the discussion there.

Some thoughts from the discussion:

β€’ Nikita (me, led the call) β€” clarified terminology: open-weight β‰  open source (pre-trained weights are available, but how they were trained is not). The main unasked question: whatever you fine-tune on secret data, the next frontier generation will outdo your model with generalization, and open weights are already lagging by ~3 months. The advantage of open weights is self-hosting: cheaper and more secure for corporations that fear giving data to OpenAI/Anthropic.

β€’ Stepan (ML product, GigaChat) β€” the lecture was "passable": the points about 3 months and "inference 90% cheaper" are shaky, the frontier sells the API wrapper, not just the model. The real recipe is not one-time fine-tuning but a constant pipeline "data β†’ evals β†’ new pretrain" (that's how Alisa AI and Cursor grew). He doesn't believe in the disappearance of open source; he won't go to work in the USA β€” frontier labs and Palantir work with the Pentagon.

β€’ Jean (futurist) β€” the lecture was about industry problems, not the guest's pitch: "open source" is about emission, not money; big players can break the rules and distill others' models, small ones cannot. The main issue is two monopolists and the state, which can ban a model "for national security" overnight. In Russia, infrastructure is lacking: you can't set up a rack in a data center, can't buy hardware.

β€’ Mars (Power of Silicon) β€” saw a business opportunity: clouds are already renting AI clusters as a service (Turbo Cloud by Rostelecom), and the next layer is helping clients run models in a closed environment. There will be demand: corporations don't want to give data to public models.

β€’ Anna (enterprise, Germany) β€” the guest's idea about energy and modular data centers rhymes with modular nuclear power plants: bringing power closer to the client for streaming tasks. In enterprise β€” a major restructuring and currently no clear strategy.

β€’ Pavel (Telegram bots, agents) β€” "3 months" is based on benchmarks, far from reality. Chinese open weights are a way to capture the market and collect data, monetized by subscription (GLM raised prices, new models are first tested internally). Advice: reread AI 2027 β€” more and more is coming true.

β€’ Dmitry β€” on Apple: three years of "corporate games" around AI strategy, changed the director of the direction β€” Apple still has a move due to control over hardware.

β€’ Nikita (closing) β€” a separate trend: free models for advertising (Anthropic already has ad cabinets, Google has integration in Chrome/mail/search). And Chamath's thesis: unlike SaaS, in AI, each new user exponentially increases costs β€” there is no more zero marginal cost.

πŸ“Ί Recording of the call:
https://youtu.be/SQguPHH0UmE

Held the Seventh Lecture Club Call on Stanford MS&E 435 β€” illustration