Modal Labs
Modal is a cloud/AI infrastructure platform designed to let developers run inference, training, batch workloads, notebooks and isolated sandboxes without managing conventional server infrastructure themselves.
The company's central engineering thesis is that AI workloads need a different infrastructure layer: elastic compute, fast startup, programmatic deployment, GPU scheduling, secure isolation and usage-based economics. Modal says it built substantial infrastructure of its own—including a custom filesystem, container runtime, scheduler and image builder—to deliver that experience. citeturn0search1turn0search2
Company Snapshot
The $300M+ annualized-revenue figure is company-reported, not independently audited in the public source. The Series C valuation and funding are company-reported. citeturn1search1
1. Company Overview
| Field | Verified information |
|---|---|
| Company | Modal Labs, Inc. / Modal |
| Industry | Cloud computing; AI/ML infrastructure |
| Category | AI cloud, serverless compute, GPU infrastructure |
| Founded | 2021 |
| Headquarters | New York City, United States |
| Founders | Erik Bernhardsson and Akshat Bubna |
| CEO | Erik Bernhardsson |
| CTO | Akshat Bubna |
| Official website | modal.com |
| Company status | Private, active |
| Business model | Usage-based cloud/compute pricing plus enterprise offerings |
Modal's own company page says its goal is to make it easier to iterate and ship applications for data, AI and machine learning, while its documentation describes serverless execution with per-second usage pricing. citeturn0search1turn0search2
2. Founders & Creators
The supplied second URL is a biography webpage rather than a direct image file, so it is integrated as a clickable founder profile card instead of using the webpage URL as an image source.
Erik Bernhardsson
Co-FounderCEOTechnical leader
Bernhardsson studied physics at KTH Royal Institute of Technology and holds an M.Sc. in Physics. His public professional profile records work at Spotify, Better.com and Modal, and highlights competitive-programming achievements including an IOI gold medal. citeturn2search0turn4view0
Before Modal, he spent years in data and machine learning at Spotify, including work associated with music recommendation systems, and later served as CTO at Better.com. He also helped create Luigi, Spotify's open-source workflow system, and worked on Annoy, an approximate-nearest-neighbor library. citeturn4view0
Modal's own company page identifies him and Akshat Bubna as founders and says the founders built deep infrastructure—including a filesystem, container runtime, scheduler and image builder—to create the developer experience they wanted. citeturn0search1
Akshat Bubna
Co-FounderCTO
Bubna studied mathematics and computer science at MIT and was an early engineer at Scale AI. Secondary biographical research also records his International Olympiad in Informatics gold medal. The current Modal company page identifies him as a founder and the company's CTO. citeturn0search1turn2search1
Important classification: this report does not label either founder the sole “inventor” of Modal's infrastructure. Modal is a team-built system; specific components should be attributed to the engineers who developed them unless a source explicitly assigns individual authorship.
3. Founder Story & Origin
Modal began before the current generative-AI boom. Bernhardsson's experience operating data and ML systems at Spotify and a large engineering organization at Better exposed a recurring problem: cloud infrastructure was powerful but often required too much operational glue for data and ML teams.
Modal's official history says the founders wanted to make it easier to iterate and ship applications for data, AI and machine learning. Instead of building a thin wrapper around existing services, they went deep into the infrastructure stack. citeturn0search1
Secondary research describes an early period in which the team spent substantial time building foundational infrastructure before broad customer traction. Stable Diffusion and the explosion of generative AI then created a much larger demand for elastic GPU inference, helping accelerate product-market fit. This historical interpretation is secondary research and should not be treated as an audited company account. citeturn2search1
4. What Is Modal?
Beginner explanation
Think of Modal as a programmable cloud where you give the platform code and say what CPU, memory or GPU the job needs. Modal starts the compute, runs the code, scales it when demand changes and bills for usage.
Developer explanation
Modal turns ordinary Python functions into cloud functions and lets developers define container environments and hardware configuration in code rather than assembling a large YAML/Kubernetes deployment stack. Its current documentation also exposes JavaScript and Go SDK paths for several resources. citeturn0search2turn0search0
AI/ML engineer explanation
Modal provides elastic execution primitives for inference, distributed/batch computation, fine-tuning, GPU-backed notebooks and isolated execution environments. GPU selection currently includes NVIDIA T4, L4, A10, L40S, A100, H100, H200, B200 and B300 families, with availability and pricing subject to change. citeturn0search3
5. Core Technology & Architecture
| Layer | What it does |
|---|---|
| SDK / code-defined infrastructure | Defines functions, images, resources, GPUs, volumes, secrets and deployments programmatically. |
| Container/image system | Creates reproducible execution environments for arbitrary ML and data dependencies. |
| Custom runtime | Modal says it built its own container runtime as part of its infrastructure stack. |
| Scheduler | Allocates workloads to available compute and handles elastic execution. |
| GPU layer | Provides a range of NVIDIA accelerators and supports multiple GPUs per container for supported hardware. |
| Autoscaling | Scales functions and workloads with demand; the platform emphasizes scale-to-zero/serverless economics. |
| Storage | Volumes and other storage primitives keep model weights and data accessible to compute. |
| Networking | Tunnels expose live TCP ports; region pinning can place latency-sensitive workloads near external systems. |
Modal's 2026 serverless-GPU engineering post describes the platform as an AI-oriented cloud stack built to reduce startup latency and make GPU capacity more elastic. citeturn1search10
6. Products & Services
| Product / primitive | Purpose | Target users | Current evidence |
|---|---|---|---|
| Inference / Functions | Serve AI models and arbitrary cloud functions. | AI developers, startups, enterprises | Low-latency inference, autoscaling and custom models. citeturn0search2 |
| Training / fine-tuning | Run training and post-training workloads on GPUs. | ML teams, AI labs | Multi-GPU single-node training; multi-node training listed as private beta in current GPU docs. citeturn0search3 |
| Batch | Fan out large numbers of jobs reliably. | Data/ML teams | Launched May 2025; designed for up to 1M pending inputs and large fan-out. citeturn1search5 |
| Sandboxes | Isolated execution for arbitrary or AI-generated code. | Agent builders, security-sensitive workloads | Secure containers, resource limits, optional GPUs. citeturn0search7turn0search0 |
| Notebooks | Collaborative GPU-backed interactive computing. | Researchers, ML engineers | GA since Sept. 2025; cold start to ready in under 5 seconds is a company-reported product claim. citeturn1search7 |
| Volumes | Persistent distributed storage for model/data artifacts. | AI/ML teams | Used in documented customer workflows, including Physical Intelligence. citeturn1search0 |
| Secrets / networking | Application integration and secure configuration. | Developers / enterprises | Part of Modal's broader platform primitives. citeturn0search2 |
7. Modal Sandboxes
A Modal Sandbox is an isolated execution environment that can run arbitrary code. Modal specifically positions Sandboxes for code generated by language models, untrusted code, coding agents and reinforcement-learning environments. citeturn0search7
Current resource controls allow CPU and memory requests plus hard limits, and GPU Sandboxes are available subject to GPU scheduling/preemption constraints. citeturn0search0
Modal's next-generation Sandbox backend is currently documented as beta and is recommended for workloads above 20 sandbox creations per second or more than 10,000 concurrent sandboxes. citeturn0search13
8. GPU Infrastructure
Modal's current GPU documentation lists T4, L4, A10, L40S, A100, H100, H200, B200 and B300 options, with support for multiple GPUs per container on several of the listed families. citeturn0search3
Modal also runs containers across multiple clouds and lets users specify regions for latency-sensitive workloads. citeturn0search14
Functions are preemptible by default; long-running workloads should tolerate interruption. Non-preemptible functions can be requested for CPU/memory, but the current documentation says that option is not supported for GPU Functions. citeturn0search15
9. Pricing & Business Model
Modal's core model is usage-based: the platform hosts the infrastructure and charges by usage rather than requiring users to manage servers. The public product pages advertise $30/month of free compute for new users. citeturn1search8
| Area | Pricing approach | Publicly verified example |
|---|---|---|
| CPU / memory | Usage-based, per-second resource billing. | Sandbox CPU: $0.00003942 per physical core-second; memory: $0.00000667 per GiB-second. citeturn0search4 |
| GPU | Usage-based by GPU type and time. | Current GPU rates vary by accelerator; see official pricing. |
| Sandboxes | Pay for requested/actual resource usage, whichever is higher, subject to documented rules. | Current Sandbox pricing docs. citeturn0search0 |
| Enterprise | Sales-led enterprise arrangements and controls. | Exact contract pricing is not publicly disclosed. |
10. Funding History
| Date | Round | Amount | Valuation | Investor information |
|---|---|---|---|---|
| Apr. 2022 | Seed | $7M | Not publicly disclosed | Public startup databases report the seed round. |
| Oct. 2023 | Series A | $16M | Not publicly disclosed | Led by Redpoint Ventures; Amplify Partners, Lux Capital, Definition Capital and others participated. citeturn0search10 |
| Sept. 2025 | Series B | $87M | $1.1B post-money | Led by Lux Capital; total funding reached $111M. citeturn0search12 |
| May 2026 | Series C | $355M | $4.65B post-money | Led by General Catalyst and Redpoint; Menlo, Bain Capital Ventures and Accel joined as new investors; existing major investors participated. citeturn1search1 |
11. Customer Case Studies
Thousands of GPUs and four months of launch time
Suno uses Modal for inference and batch preprocessing. Modal says Suno was able to bring a state-of-the-art music-generation model to market four months earlier than it otherwise would have, avoiding the need to hire a dedicated infrastructure team. Suno's GPU usage scales to thousands of GPUs, with demand spikes around holidays. citeturn1search3
Real-time remote robot inference
Physical Intelligence uses Modal for real-time inference for robotic control. Modal reports approximately 10–15 ms of network overhead, checkpoint loading in under 30 seconds, and the ability to pin inference deployments near robot locations. citeturn1search0
Production in under 30 days
Runway chose Modal for real-time inference for Runway Characters. Modal reports that Runway moved from proof of concept to production in under 30 days. The architecture uses multi-GPU inference and RDMA networking, with Modal distributing workloads across regions. citeturn1search2
10× batch-processing speedup
When Modal introduced Batch, it reported that Harvey observed a 10× speed-up in its data-processing pipeline by fanning document inputs across 1,000 containers. Harvey had previously used open-source orchestrators such as Argo and Airflow and had to manage worker count, instance size and parallelization. citeturn1search5
Scaling scientific workloads
Modal says Chai Discovery uses its infrastructure to scale drug-discovery pipelines, including protein embeddings and antibody-design workloads. Modal's May 2026 company update cites Chai alongside Suno and Physical Intelligence as examples of different workload shapes using the same underlying infrastructure primitives. citeturn1search1
Hundreds of GPUs in parallel
Modal's 2023 GA announcement quoted Substack's head of data saying the team chose Modal because it made it easy to write code that ran on hundreds of GPUs in parallel for podcast transcription. citeturn1search15
Protein folding
Modal's GA announcement said Sphinx was using Modal to run protein-folding models on behalf of drug discoverers and scientific researchers. citeturn1search15
RL infrastructure + production inference
Modal's current customer materials quote Cognition's CEO describing Modal as infrastructure for both reinforcement learning and production inference, with millions of sandboxes on one side and real-time serving on the other. citeturn1search6
Background coding agents
Modal's customer page highlights Ramp's use of Modal for a full-context background coding agent. The page confirms the use case but does not provide a detailed independent benchmark in the cited material. citeturn1search6
12. AI Use Cases
13. Technical Innovations
| Innovation | Problem | Why it matters |
|---|---|---|
| Code-defined infrastructure | Cloud deployments traditionally require many configuration layers. | Moves infrastructure configuration into normal application code. |
| Custom runtime / filesystem / scheduler | Generic container stacks were not designed around AI startup and scaling patterns. | Lets Modal optimize startup, execution and scheduling around its workloads. citeturn0search1 |
| Elastic GPU execution | GPU capacity is expensive and often highly variable. | Allows workloads to scale with demand rather than requiring permanent capacity. citeturn1search10 |
| Modal Batch | Millions of jobs are operationally difficult with generic orchestrators. | Durable queue + massive fan-out simplifies batch execution. citeturn1search5 |
| Sandboxes | Agents need to execute potentially untrusted code. | Provides isolated runtime environments and resource controls. citeturn0search7turn0search0 |
| Multi-cloud regional execution | Latency and GPU availability vary by geography/provider. | Lets applications select regions and use a unified compute layer. citeturn0search14 |
14. Modal vs Competitors
| Platform | Primary strength | Where Modal differs |
|---|---|---|
| AWS / GCP / Azure | Broad cloud services and global infrastructure. | Modal is narrower and more opinionated around programmable AI/compute workloads. |
| RunPod | Accessible GPU cloud. | Modal emphasizes serverless execution, code-defined infrastructure, orchestration and broader workload primitives. |
| Replicate | Model discovery and hosted model APIs. | Modal is more infrastructure-oriented: customers can own/deploy custom models, control compute and run training/batch/agent workloads. |
| Together AI | Open-model inference and training services. | Modal emphasizes general-purpose programmable compute rather than primarily a model/API platform. |
| Baseten | Model inference and serving. | Modal spans inference plus training, batch, notebooks and sandboxes. |
| CoreWeave | Large-scale GPU cloud. | CoreWeave is more infrastructure-capacity oriented; Modal emphasizes developer abstraction and elastic execution. |
| Hugging Face | Model ecosystem and ML community. | Modal is a compute/runtime platform rather than a model hub/community first. |
These are positioning comparisons, not claims that each competitor was directly evaluated by every Modal customer.
15. Modal vs Replicate — When Should a Developer Choose Modal?
| Need | Likely better fit | Reason |
|---|---|---|
| Pick a public model and call it quickly | Replicate | Strong model catalogue and API-first discovery. |
| Deploy and control your own model stack | Modal | Code-defined containers, GPU choice and infrastructure primitives. |
| Training / fine-tuning | Modal | Broad compute platform with GPU training workflows. |
| Massive batch processing | Modal | Modal Batch is designed around large fan-out jobs. |
| Agent code execution | Modal | Sandboxes are a first-class product. |
| Model marketplace / experimentation | Replicate | Replicate's model ecosystem is a central product surface. |
| General AI cloud primitives | Modal | Inference, training, batch, notebooks, storage and sandboxes share one platform. |
16. Security & Compliance
Modal publicly advertises team controls, isolation, SOC 2, HIPAA and data-residency controls. Its Sandbox documentation also emphasizes isolated execution and resource limits for potentially untrusted code. citeturn1search8turn0search7turn0search0
For GPU Sandboxes and long-running GPU functions, preemption and availability constraints remain operational considerations. Organizations with strict regulatory or data-location requirements should verify the exact current region, retention and contractual controls applicable to their workload rather than relying on general product claims. citeturn0search15turn0search14
17. Developer Experience
- Python-first workflow and code-defined infrastructure.
- No-YAML positioning for core application deployment. citeturn0search2
- GPU selection through simple code configuration.
- Serverless execution with automatic scaling.
- CLI, SDKs and examples for common AI workloads.
- Notebooks, Batch and Sandboxes extend the same compute model beyond inference.
The core product philosophy is to let developers write the application and treat infrastructure as a programmable substrate rather than a separate operations project.
18. Company Timeline
19. Financial & Growth Information
| Metric | Status |
|---|---|
| Revenue / annualized revenue | Company reported: more than $300M annualized revenue in May 2026. citeturn1search1 |
| ARR | Not independently verified. TechCrunch reported approximately $50M ARR during February 2026 fundraising discussions, before the Series C. citeturn2search3 |
| Valuation | $4.65B post-money in May 2026, company reported. citeturn1search1 |
| Total funding | $111M after Series B; Series C subsequently added $355M. citeturn0search12turn1search1 |
| Employees | Not publicly verified in current primary sources reviewed. |
| Profit/loss | Not publicly available. |
20. Challenges & Limitations
- GPU availability: AI infrastructure depends on scarce accelerator capacity and regional supply.
- Preemption: default preemptibility means long-running jobs must be designed for interruption tolerance. citeturn0search15
- Cold starts: AI workloads often require large model weights; reducing startup latency is a continuing infrastructure problem.
- Cost: elastic serverless economics can reduce idle capacity but sustained GPU workloads still produce significant compute bills.
- Multi-node complexity: large-model inference/training requires high-bandwidth networking and careful distributed execution.
- Cloud competition: Modal competes with hyperscalers, GPU clouds and specialized inference platforms.
- Platform dependency: customers outsourcing infrastructure gain speed but accept dependency on Modal's availability, pricing and product roadmap.
Controversies: No major legal or public controversy was identified in the authoritative Modal sources reviewed for this profile. That is not evidence that no criticism exists anywhere; it means no material controversy was substantiated in the source set used here.
21. SWOT Analysis
| Strengths | Weaknesses |
|---|---|
| Deep infrastructure ownership; strong developer experience; elastic GPU model; broad AI workload coverage; growing enterprise customer base. | Private-company financial opacity; compute economics remain expensive; customers depend on platform availability and pricing; some advanced features remain beta/private beta. |
| Opportunities | Threats |
| AI agents, post-training/RL, robotics, scientific AI, custom inference, enterprise AI and the shift toward open-weight model ownership. | AWS/GCP/Azure, specialized GPU clouds, model providers moving down-stack, GPU shortages, margin pressure and rapid changes in inference technology. |
22. Future Outlook
Confirmed direction
Modal's 2026 communications emphasize low-latency elastic inference, dynamic agent runtimes, reinforcement learning, batch workloads and safe isolated execution. The Series C announcement explicitly frames the company as a broader AI cloud rather than a single-purpose GPU provider. citeturn1search1
Evidence-based analysis
The most important strategic opportunity is to become the infrastructure layer for companies that increasingly own their own models and post-training loops. Modal's customer examples already span model serving, RL, robotics, biology, media and agents, suggesting the platform is deliberately broadening beyond conventional inference. citeturn1search1turn1search0
Prediction, not confirmed fact: if agentic applications continue to grow, Sandboxes, batch execution, RL environments and low-latency model serving could converge into a unified “agent compute” platform. The main risk is that hyperscalers and specialized AI clouds may replicate these primitives quickly.
23. 50 Important Facts
- Modal's legal name is Modal Labs, Inc.
- Modal was founded in 2021.
- Erik Bernhardsson is a co-founder.
- Akshat Bubna is a co-founder.
- Bernhardsson is CEO.
- Bubna is CTO.
- Modal is headquartered in New York City.
- The company focuses on AI, ML and data infrastructure.
- Modal uses serverless execution.
- Pricing is usage-based.
- Modal supports CPU workloads.
- Modal supports GPU workloads.
- Current GPU docs list H100.
- Current GPU docs list H200.
- Current GPU docs list B200.
- Current GPU docs list B300.
- Modal supports multiple GPUs per container on supported hardware.
- Modal supports training.
- Modal supports fine-tuning.
- Modal supports inference.
- Modal supports batch processing.
- Modal supports notebooks.
- Modal supports Sandboxes.
- Sandboxes can execute AI-generated code.
- Sandboxes have CPU/memory limits.
- GPU Sandboxes can be preempted.
- Modal supports region selection.
- Modal runs containers across multiple clouds.
- Modal has its own container runtime.
- Modal has its own scheduler.
- Modal has its own filesystem.
- Modal has its own image builder.
- Modal emphasizes code-defined infrastructure.
- Modal's docs explicitly market a no-YAML experience.
- Modal Batch launched in 2025.
- Modal Batch was designed for large fan-out workloads.
- Harvey reported a 10× speedup using Modal Batch.
- Suno reported four months saved on launch timing.
- Suno uses thousands of GPUs on Modal.
- Physical Intelligence reported about 10–15 ms network overhead.
- Runway reported moving from proof of concept to production in under 30 days.
- Modal raised $16M Series A in 2023.
- Modal raised $87M Series B in 2025.
- Series B valuation was $1.1B post-money.
- Modal raised $355M Series C in 2026.
- Series C valuation was $4.65B post-money.
- Modal reported more than $300M annualized revenue in May 2026.
- Modal's customer examples span AI, biotech, robotics and media.
- Modal's current strategy emphasizes AI-native infrastructure rather than a single model API.
24. Lessons for Entrepreneurs & CTOs
- Build around a painful workflow, not a fashionable model. Modal started with developer infrastructure pain before generative AI became mainstream.
- Own the hard layer when abstraction quality is the product. Modal built core infrastructure rather than merely wrapping a cloud API.
- Serverless economics are especially useful for spiky AI workloads. Suno's holiday demand is a clear example. citeturn1search3
- Developer experience can be a moat. Code-defined infrastructure reduces the distance between prototype and production.
- AI infrastructure should cover the lifecycle. Inference alone is increasingly insufficient; training, batch, notebooks and agents all interact.
- Security becomes a product feature when agents execute code. Sandboxes are infrastructure for safe execution, not just developer convenience.
- Latency is application-dependent. Robotics and real-time video need different infrastructure from offline batch processing.
- Infrastructure companies need broad primitives but clear interfaces. Modal's strategy is to expose a small developer-facing surface while operating complex infrastructure underneath.
25. Final Verdict
| Question | Answer |
|---|---|
| What is Modal? | An AI-focused cloud infrastructure platform for inference, training, batch, notebooks and secure sandboxes. |
| Who founded it? | Erik Bernhardsson and Akshat Bubna. |
| Why was it created? | To make cloud development for data/ML/AI workloads easier and more elastic. |
| What problem does it solve? | Infrastructure complexity around containers, GPUs, scaling, scheduling, deployment and compute capacity. |
| How does it work? | Developers define code, environment and resource requirements; Modal schedules and executes workloads on elastic infrastructure. |
| How does it make money? | Primarily usage-based compute/infrastructure pricing, with enterprise offerings. |
| Who uses it? | Companies including Suno, Runway, Physical Intelligence, Harvey, Substack, Chai Discovery, Cognition and others documented by Modal. |
| What differentiates it? | A broad AI cloud with deep infrastructure ownership and a developer-first, code-defined interface. |
| Biggest risks? | GPU economics, competition from hyperscalers and specialized clouds, platform dependency and rapidly changing AI workloads. |
| Future potential? | A broader AI-native cloud layer spanning model serving, post-training, agent execution, scientific computing and elastic GPU workloads. |
Sources & Verification
- Modal — Company
- Modal — Documentation
- Modal — GPU acceleration
- Modal — Sandboxes
- Modal — Sandbox resources and pricing
- Modal — Series B
- Modal — Series C
- Modal — General availability and Series A
- Modal — Suno case study
- Modal — Physical Intelligence case study
- Modal — Runway case study
- Modal — Batch launch and customer examples
- Modal — Customers
- Modal — Serverless GPUs technical post
- Modal — Notebooks
- AI Files — Erik Bernhardsson profile
- TechCrunch — February 2026 funding discussions
- Contrary Research — Modal founding history