LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

Instant, controllable, local pre-trained AI models in Rust

Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.

​AI-Powered open-source deepwiki generator​ built with Rust – Transform your codebase into professional architecture documentation in minutes

User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!

Rust client for Mistral AI API.

FastLLM - Blazingly Fast Rust based LLM Inference API 🚀

Yet another `llama.cpp` Rust wrapper

Generic persona (Ollama discord bot) but in Rust.

Unified API for LLM providers and simple agent library in JS, Rust, and Go

Simple large language model playground app

Rust implementation of the Mistral Tekken tokenizer

ChatFlameBackend is an innovative backend solution for chat applications, leveraging the power of the Candle AI framework with a focus on the Mistral model

lsp-agent is a language server that serves as a backend for AI-powered functionality in your favorite code editors. It offers features like in-editor chatting with LLMs and code completions.

rust api wrapper for llm-inference chatllm.cpp

Simple Rust CLI chat with Mistral AI

Desktop app that allows you to chat with AI

Dartion is a CLI server for running the Danbooru Tags Tranformer models

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

AI-based coding helper CLI tool