LLM
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
Structured and typehinted GPT responses in Python
Interact with your documents using the power of GPT, 100% privately, no data leaks
👻 Experimental library for scraping websites using OpenAI's GPT API.
Easily migrate your codebase from one framework or language to another.
Python bindings for the Transformer models implemented in C/C++ using GGML library.
A guidance language for controlling large language models.
A high-throughput and memory-efficient inference and serving engine for LLMs
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
SGLang is a fast serving framework for large language models and vision language models.