Modal CEO:GPU市场仍是荒野,沙盒与推理各占营收三分之一Modal CEO: GPU Market Still the Wild West, Sandboxes and Inference Each a Third of Revenue
The Takeaway:真正持久的优势不在单纯卖token,而在提供完整多产品平台,让工程师快速迭代。
Modal创始人兼CEO Eric(曾在Spotify等超大规模公司工作)分享了公司从2021年起步到如今突破10亿美元年化营收的历程。早期他们专注无服务器计算原语,并自建文件系统、容器运行时和调度器(几乎不用Kubernetes或Docker),只为追求极致冷启动速度和开发体验。ChatGPT和Stable Diffusion爆发后,他们靠托管Stable Diffusion应用起飞,随后在2023年推出Sandbox产品——当时只是低成本非对称押注,却在模型写代码能力变强后于2025年爆发,如今沙盒约占营收三分之一,年化已达3亿美元规模。
DeepSeek时刻让他们全面进入LLM推理,现在推理也占营收三分之一。GPU获取仍像“露天毒品市场”,通过WhatsApp群和酒店大堂交易,与25家云厂商合作,靠聚合需求与自动故障切换实现可靠容量。Eric认为单纯推理会走向商品化,真正差异化来自沙盒、训练、批处理、强化学习等整套原语。“客户不想买只会一招的小马,他们想买一套多产品工具。”他同时看好低延迟语音/视频CDN式推理、中型模型训练以及完整操作系统支持等方向。关于NeoCloud,他称其本质是资本密集型融资工具,长期将受制于高资本成本,部分NeoLab可能因GPU承诺而转向转售算力。
“我们构建了一些疯狂的东西,现在正在收获多年投资的红利。”
Modal创始人兼CEO Eric(曾在Spotify等超大规模公司工作)分享了公司从2021年起步到如今突破10亿美元年化营收的历程。早期他们专注无服务器计算原语,并自建文件系统、容器运行时和调度器(几乎不用Kubernetes或Docker),只为追求极致冷启动速度和开发体验。ChatGPT和Stable Diffusion爆发后,他们靠托管Stable Diffusion应用起飞,随后在2023年推出Sandbox产品——当时只是低成本非对称押注,却在模型写代码能力变强后于2025年爆发,如今沙盒约占营收三分之一,年化已达3亿美元规模。
DeepSeek时刻让他们全面进入LLM推理,现在推理也占营收三分之一。GPU获取仍像“露天毒品市场”,通过WhatsApp群和酒店大堂交易,与25家云厂商合作,靠聚合需求与自动故障切换实现可靠容量。Eric认为单纯推理会走向商品化,真正差异化来自沙盒、训练、批处理、强化学习等整套原语。“客户不想买只会一招的小马,他们想买一套多产品工具。”他同时看好低延迟语音/视频CDN式推理、中型模型训练以及完整操作系统支持等方向。关于NeoCloud,他称其本质是资本密集型融资工具,长期将受制于高资本成本,部分NeoLab可能因GPU承诺而转向转售算力。
“我们构建了一些疯狂的东西,现在正在收获多年投资的红利。”
The Takeaway: Durable advantage is not pure token serving but a full multi-product platform that lets engineers iterate fast.
Modal founder and CEO Eric (ex-Spotify hyperscale veteran) recounts the journey from 2021 serverless primitives to crossing $1B run-rate. They built their own filesystem, container runtime and scheduler almost from scratch for extreme cold starts and developer experience. After ChatGPT and Stable Diffusion, Stable Diffusion hosting fueled early growth; the 2023 Sandbox bet (initially a low-cost asymmetric side project) exploded in 2025 once models got good at code, now ~1/3 of revenue and a $300M run-rate business on its own. The DeepSeek moment pushed them into dedicated LLM inference, now another third of revenue.
GPU procurement remains “an open-air drug market” of WhatsApp groups and hotel-lobby deals across 25+ clouds. Aggregation plus automatic failover is their reliability edge. Pure inference is racing to the bottom and being commoditized by routers; the durable moat is the full suite—sandboxes, training, batch, RL, multi-modal. “Customers don’t want single-trick ponies. They want a multiproduct set of tools.” He is bullish on low-latency voice/video CDN-style inference, mid-size model training, and full OS support (Mac/Windows/Android). On NeoClouds he sees capital-intensive financing vehicles that will struggle with high cost of capital; some NeoLabs may pivot to reselling locked-in GPUs.
“We built some crazy stuff, and now we’re reaping the dividends of those investments.”
查看原文 →
Modal founder and CEO Eric (ex-Spotify hyperscale veteran) recounts the journey from 2021 serverless primitives to crossing $1B run-rate. They built their own filesystem, container runtime and scheduler almost from scratch for extreme cold starts and developer experience. After ChatGPT and Stable Diffusion, Stable Diffusion hosting fueled early growth; the 2023 Sandbox bet (initially a low-cost asymmetric side project) exploded in 2025 once models got good at code, now ~1/3 of revenue and a $300M run-rate business on its own. The DeepSeek moment pushed them into dedicated LLM inference, now another third of revenue.
GPU procurement remains “an open-air drug market” of WhatsApp groups and hotel-lobby deals across 25+ clouds. Aggregation plus automatic failover is their reliability edge. Pure inference is racing to the bottom and being commoditized by routers; the durable moat is the full suite—sandboxes, training, batch, RL, multi-modal. “Customers don’t want single-trick ponies. They want a multiproduct set of tools.” He is bullish on low-latency voice/video CDN-style inference, mid-size model training, and full OS support (Mac/Windows/Android). On NeoClouds he sees capital-intensive financing vehicles that will struggle with high cost of capital; some NeoLabs may pivot to reselling locked-in GPUs.
“We built some crazy stuff, and now we’re reaping the dividends of those investments.”