LEAKED SYSTEM PROMPTS FOR CHATGPT, GEMINI, GROK, CLAUDE, PERPLEXITY, CURSOR, DEVIN, REPLIT, AND MORE! - AI SYSTEMS TRANSPARENCY FOR ALL! 👐

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

San Francisco housing construction history and associated data

Browser automation system that uses AI-driven planning to navigate web pages and perform goals.

A modular SQL linter and auto-formatter with support for multiple dialects and templated code.

A code-searching tool similar to ack, but faster.

Asynchronous HTTP client/server framework for asyncio and Python

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

The LLM Evaluation Framework

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information retrieval with generative models to provide accurate and cont…

🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data

Contrastive Fact Verification

Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".

List of papers on hallucination detection in LLMs.

Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.

AI Observability & Evaluation

a simple website for sharing table data - with an API

Tips and tricks for working with Large Language Models like OpenAI's GPT-4.

aider is AI pair programming in your terminal

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector retrieval to their ML stack.

Run & debug workflows for AI agents running Dockerized tools in VSCode

Examples of integrating the OpenRouter API

Supercharge Your LLM Application Evaluations 🚀

🐢 Open-Source Evaluation & Testing library for LLM Agents