Stars
Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 17+ clouds, or on-prem).
Enable decision-making based on simulations
Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.
Security scanner detecting Python Pickle files performing suspicious actions
Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"
Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.
An authorization library that supports access control models like ACL, RBAC, ABAC in Golang: https://discord.gg/S5UjpzGZjN
NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
TypeChat is a library that makes it easy to build natural language interfaces using types.
A framework for few-shot evaluation of language models.
Modern observability platform: 10x easier, 140x lower storage cost, petabyte scale. Open-source alternative to Elasticsearch/Splunk/Datadog for logs, metrics, traces, RUM, and more.
A library that allows you to easily mock out tests based on AWS infrastructure.
AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data…
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
Code and documentation to train Stanford's Alpaca models, and generate the data.
🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.
The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable,…
A set of modules for (mis)using python features
Algorithms for outlier, adversarial and drift detection
The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many mo…
Backup and migrate Kubernetes applications and their persistent volumes