Thanks to visit codestin.com
Credit goes to docs.sglang.ai

Skip to main content

Ctrl+K

Get Started

Install SGLang

Basic Usage

Sending Requests
OpenAI-Compatible APIs
Offline Engine API
SGLang Native APIs
Sampling Parameters
DeepSeek Usage
DeepSeek V3.2 Usage
GPT OSS Usage
Llama4 Usage
Qwen3-Next Usage
Qwen3-VL Usage

Advanced Features

Server Arguments
Hyperparameter Tuning
Attention Backend
Speculative Decoding
Structured Outputs
Structured Outputs For Reasoning Models
Tool Parser
Reasoning Parser
Quantization
LoRA Serving
PD Disaggregation
Hierarchical KV Caching (HiCache)
PD Multiplexing
Query Vision Language Model
SGLang Model Gateway (formerly SGLang Router)
Deterministic Inference
Observability
Checkpoint Engine Integration

Supported Models

Large Language Models
Multimodal Language Models
Embedding Models
Reward Models
Rerank Models
How to Support New Models
Transformers fallback in SGLang
Use Models From ModelScope

Hardware Platforms

AMD GPUs
CPU Servers
TPU
NVIDIA Jetson Orin
Ascend NPUs
XPU

Developer Guide

Contribution Guide
Development Guide Using Docker
Benchmark and Profiling
Bench Serving Guide

References

Troubleshooting and Frequently Asked Questions
Environment Variables
Production Metrics
Setup Guide
Multi-Node Deployment
Custom Chat Template
Frontend Language
Learn more

Repository
Show source
Suggest edit
Open issue

.rst

OpenAI-Compatible APIs

OpenAI-Compatible APIs#

OpenAI APIs - Completions
OpenAI APIs - Vision
OpenAI APIs - Embedding

previous

Sending Requests

next

OpenAI APIs - Completions

By SGLang Team

© Copyright 2023-2025, SGLang.

Last updated on Nov 15, 2025.