Open Source LLM proxy that transparently captures and logs all interactions with LLM API

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

This is the repo for the paper Shepherd -- A Critic for Language Model Generation

Robust recipes to align language models with human and AI preferences

llama3 implementation one matrix multiplication at a time

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

Run PyTorch LLMs locally on servers, desktop and mobile