Modal Documentation

Modal provides a serverless cloud for engineers and researchers who want to build compute-intensive applications without thinking about infrastructure.

Run generative AI models, large-scale batch workflows, job queues, and more, all faster than ever before.

Get Started

Guide

Everything you need to know to run code on Modal. Dive deep into all of our features and best practices.

Examples

Powerful applications built with Modal. Explore guided starting points for your use case.

Reference

Technical information about the Modal API. Quickly refer to basic descriptions of various programming functionalities.

Playground

Interactive tutorials to learn how to start using Modal. Run serverless cloud functions from your browser.

Guide

Everything you need to know to run code on Modal. Dive deep into all of our features and best practices.

Examples

Powerful applications built with Modal. Explore guided starting points for your use case.

Reference

Technical information about the Modal API. Quickly refer to basic descriptions of various programming functionalities.

Playground

Interactive tutorials to learn how to start using Modal. Run serverless cloud functions from your browser.

Featured Examples

All examples

Deploy an OpenAI-compatible LLM service

Run large language models with a drop-in replacement for the OpenAI API

Optimize tokens per second

Maximize throughput in batch LLM processing

Deploy OpenCode agents

Run coding agents at scale in secure Sandboxes

Design protein binders with ESMFold2

Propose and evaluate thousands of binders in parallel

Transcribe speech in batches with Whisper

Turn audio bytes into text at scale

Voice chat with LLMs

Build an interactive voice chat app

Deploy vibe coding at scale

Build an AI coding platform for thousands of users

Custom pet art from Flux with Hugging Face and Gradio

Fine-tune an image generation model on pictures of your pet

Deploy really big language models

Serve models with hundreds of billions of parameters

Edit images with Flux Kontext

Transform images with SotA diffusion models

Fold proteins with Boltz-2

Predict molecular structures and binding affinities from sequences with SotA open source models

Serverless WebRTC

Stream YOLO detections on webcam footage in real time

Sandbox a LangGraph agent's code

Run an LLM coding agent that runs its own language models

Serve diffusion models

Serve Flux on Modal with optimizations for blazingly fast inference

Low latency SGLang

Run interactive language model applications

Transcribe speech with Kyutai STT

Stream transcripts at the speed of speech

Star in custom music videos

Fine-tune a Wan2.1 video model on your face and run it in parallel

Make music

Turn prompts into music with ACE-Step

RAG Chat with PDFs

Use ColBERT-style, multimodal embeddings with a Vision-Language Model to answer questions about documents

Bring images to life

Prompt a generative video model to animate an image

Build a protein folding dashboard

Serve a web UI for a protein model with ESM3, Molstar, and Gradio

Deploy a Hacker News Slackbot

Periodically post new Hacker News posts to Slack

Fold proteins with Chai-1

Predict molecular structures from sequences with SotA open source models

Retrieval-Augmented Generation (RAG) for Q&A

Build a question-answering Web Function that can cite its sources

Document OCR job queue

Use Modal as an infinitely scalable job queue that can service async tasks from a web app

Parallel processing of Parquet files on S3

Analyze data from the Taxi and Limousine Commission of NYC in parallel