LLM inference in C/C++

A library for mechanistic interpretability of GPT-style language models

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Automate browser-based workflows with LLMs and Computer Vision

Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"

Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"

Functional Benchmarks and the Reasoning Gap

Official Implementation of NeurIPS 2024 paper "G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answering""

Community showcase and examples of Actix Web ecosystem usage.

Actor framework for Rust.

Actix Web is a powerful, pragmatic, and extremely fast web framework for Rust.

BCC - Tools for BPF-based Linux IO analysis, networking, monitoring, and more

Go/gRPC service designed to enable generic rate limit scenarios from different types of applications.

protoc plugin library for efficient proto-based code generation

[READ ONLY MIRROR] Envoy REST/proto API definitions and documentation.

Cloud-native high-performance edge/middle/service proxy

Wangle is a framework providing a set of common client/server abstractions for building services in a consistent, modular, and composable way.