Starred repositories
100 % FREE, Private (No Internet) DeepSeek’s Advanced RAG: Boost Your RAG Chatbot: Hybrid Retrieval (BM25 + FAISS) + Neural Reranking + HyDe🚀
🌐 The Internet Computer! Free, Open-Source, and Self-Hostable.
[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools lik…
HTTP SQLite scale-to-zero database on the edge built on Cloudflare Durable Objects.
An app that brings language models directly to your phone.
Effortlessly run LLM backends, APIs, frontends, and services with one command.
Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Su…
An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organiz…
AIWintermuteAI / esp32-llm
Forked from DaveBben/esp32-llmRunning a LLM on the ESP32
This repository provides tutorials and implementations for various Generative AI Agent techniques, from basic to advanced. It serves as a comprehensive guide for building intelligent, interactive A…
A simple experiment on letting two local LLM have a conversation about anything!
Code execution utilities for Open WebUI & Ollama
The official API server for Exllama. OAI compatible, lightweight, and fast.
Open-Sourcing the integration engine our platform runs on
A simple and beautiful Vue chat component backend agnostic, fully customisable and extendable.
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
🚀🎉📚 SaaS Boilerplate built with Next.js + Tailwind CSS + Shadcn UI + TypeScript. ⚡️ Full-stack React application with Auth, Multi-tenancy, Roles & Permissions, i18n, Landing Page, DB, Logging, Testing
Use AI to Scan Your Code from the Command Line for security and code smells. Bring your own keys. Supports OpenAI and Gemini
Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activelo…
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama mode…
Accessible large language models via k-bit quantization for PyTorch.