Stars
An open protocol enabling communication and interoperability between opaque agentic applications.
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr…
A library for prompt engineering and optimization (SAMMO = Structure-aware Multi-Objective Metaprompt Optimization)
Rich is a Python library for rich text and beautiful formatting in the terminal.
The repository contains Terraform configurations for integrating OpenAI services with Azure API Management (APIM). The configuration also includes the setup of private endpoints for secure communic…
Smart load balancing for Azure OpenAI endpoints
Sample demonstrating how to load balance requests between multiple Azure OpenAI Services using Azure API Management.
Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.
A high-throughput and memory-efficient inference and serving engine for LLMs
An Autonomous LLM Agent for Complex Task Solving
Mistral: A strong, northwesterly wind: Framework for transparent and accessible large-scale language model training, built with Hugging Face 🤗 Transformers.
FrugalGPT: better quality and lower cost for LLM applications
The home of the CUE language! Validate and define text-based and dynamic configuration
A reverse proxy that provides authentication with Google, Azure, OpenID Connect and many more identity providers.
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
An awesome & curated list of best LLMOps tools for developers
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
Instruct-tune LLaMA on consumer hardware
[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
🦜🔗 The platform for reliable agents.
🏆 📚 A list of awesome MkDocs projects and plugins.
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.