Thanks to visit codestin.com
Credit goes to lib.rs

Lib.rs

› Keywords #llm #artificial-intelligence #gguf #json-schema #ggml #hugging-face

#llama-cpp

  1. llama-cpp-2

    llama.cpp bindings for Rust

    v0.1.132 26K #llama-cpp #llm #mimic #date #safe

  2. gbnf

    working with GBNF

    v0.2.6 5.8K #json-schema #artificial-intelligence #llama-cpp #grammar #system

  3. gguf-utils

    handling gguf files

    v0.4.1 600 #gguf #llama-cpp #ggml

  4. deepthought

    Functional wrapper around Llama.cpp with Rust Dynamic datatypes and Vector store support for creating RAG applications

    v0.1.9 #llama-cpp #rag #embedding #vector #vecstore

  5. tenere

    TUI interface for LLMs written in Rust

    v0.11.3 500 #tui #chatgpt #llama-cpp #ollama #llm #chat-interface #llm-interface #text-interface #clipboard #config-toml

  6. llama-cpp-sys-2

    Low Level Bindings to llama.cpp

    v0.1.132 26K #llama-cpp #low-level #cuda

  7. helios-engine

    A powerful and flexible Rust framework for building LLM-powered agents with tool support, both locally and online

    v0.5.5 #llm-agent #candle #llm #llama-cpp

  8. toktrie_hf_tokenizers

    HuggingFace tokenizers library support for toktrie and llguidance

    v1.4.0 30K #structured-output #tokenize #llguidance #toktrie #model #hugging-face #json-schema #context-free-grammar #llama-cpp

  9. ggus

    GGUF in Rust🦀

    v0.5.1 650 #gguf #llama-cpp #ggml

  10. llm_client

    easiest Rust interface for local LLMs

    v0.0.7 330 #gguf #llama-cpp #openai #anthropic #llm

  11. ggufy

    Unified GGUF wrapper for llama.cpp and Ollama

    v0.2.0 #gguf #llama #ollama #llama-cpp #model #cache-directory

  12. kalosm-streams

    A set of streams for pretrained models in Kalosm

    v0.4.0 500 #whisper #ai-model #pre-trained-models #kalosm #llama #llama-cpp #artificial-intelligence #llm #mistral #transcription

  13. paddler

    Open-source LLMOps platform for hosting and scaling AI in your own infrastructure

    v2.1.1 #artificial-intelligence #inference #llama-cpp #hosting #load-balancing #admin-panel #llm #scaling #llm-inference #model-inference

  14. llama-cpp-4

    llama.cpp bindings for Rust

    v0.1.94 950 #llama-cpp #sampler #safe #llama-cpp-bindings

  15. rower

    Stateful load balancer custom-tailored for llama.cpp and focused on simplicity, forked from distantmagic/paddler

    v2.0.1 #llama-cpp #load-balancing #agent #slot #statsd #dashboard #statsd-metrics #upstream #focused-on-simplicity

  16. llama_cpp

    High-level bindings to llama.cpp with a focus on just being really, really easy to use

    v0.3.2 1.2K #llama #llama-model #model-context #token #high-level-bindings

  17. ggml-quants

    GGml defined quantized data types and their quant/dequant algorithm

    v0.1.0 650 #gguf #ggml #llama-cpp

  18. epistemology

    clear way of hosting llama.cpp as a private HTTP API

    v0.6.0 2.4K #llama-cpp #web-api #json-schema #web-server #local-server #embedding #grammar

  19. toktrie_hf_downloader

    HuggingFace Hub download library support for toktrie and llguidance

    v1.4.0 #structured-output #llguidance #tokenize #openai #hugging-face #context-free-grammar #json-schema #llama #toktrie #llama-cpp

  20. drama_llama

    language modeling and text generation

    v0.5.2 1.6K #llama-cpp #language-modeling #text-generation #generative-ai #drama #artificial-intelligence #chat

  21. toktrie_tiktoken

    HuggingFace tokenizers library support for toktrie and llguidance

    v1.4.0 #tokenize #structured-output #llguidance #openai #json-schema #hugging-face #context-free-grammar #toktrie #llama #llama-cpp

  22. shimmy-llama-cpp-2

    llama.cpp bindings for Rust with MoE CPU offloading support

    v0.1.123 410 #llama-cpp #llm #moe #offloading #cpu #date #powering

  23. fellhorn-llama-cpp-2

    llama.cpp bindings for Rust

    v0.1.124 #llama-cpp #llm #date #mimic #powering #coupled

  24. kalosm-common

    Helpers for kalosm downloads and candle utilities

    v0.4.0 500 #ai-model #kalosm #pre-trained-models #whisper #llama #candle #llama-cpp #accelerator #artificial-intelligence #mistral

  25. lmcpp

    Rust bindings for llama.cpp's server with managed toolchain, typed endpoints, and UDS/HTTP support

    v0.1.1 #artificial-intelligence #llama-cpp #inference #llama #llm

  26. llama-cpp-sys-4

    Low Level Bindings to llama.cpp

    v0.1.94 1.3K #llama-cpp #sampler #low-level #cuda #safe-api

  27. lsp-ai

    open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them

    v0.7.0 #artificial-intelligence #language-server #language-server-protocol #assist #back-end #empower #mistral #llm #llama-cpp #development-tools

  28. hayride-llama-rs-sys

    Hayride llama.cpp rust bindings

    v0.0.5 480 #llama-cpp #macos #llama-cpp-bindings #target #system-bindings #generate-bindings

  29. kproc-llm

    Knowledge Processing library, using LLMs

    v0.6.1 #llama-cpp #llm #kproc #ollama #processing #knowledge-graph

  30. fellhorn-llama-cpp-sys-2

    Low Level Bindings to llama.cpp

    v0.1.124 #llama-cpp #bindings #low-level #cuda #safe-api #llama-cpp-2

  31. rmistral

    interface for Mistral models

    v0.1.0 #whisper #llama #ai-model #kalosm #inference #mistral #pre-trained-models #mistral-ai #llama-cpp #artificial-intelligence

  32. shimmy-llama-cpp-sys-2

    Low Level Bindings to llama.cpp with MoE CPU offloading support

    v0.1.123 410 #llama-cpp #bindings #low-level #cuda #moe #offloading #safe-api #llama-cpp-2

  33. simple_llama

    run llama.cpp in Rust. based on llama-cpp-2

    v0.1.3-b 110 #llama #llama-cpp #llama-cpp-2 #model #prompt

  34. rs-llama-cpp

    Automated Rust bindings generation for LLaMA.cpp

    v0.1.67 490 #llama-cpp #llama #llm #bindings

  35. llama-cpp-sys-3

    llama.cpp bindings

    v0.5.10 600 #llama-cpp #build #llama-cpp-bindings #github

  36. thalamus

    A deep learning mesh node server platform for linux/mac/unix

    v0.0.11 #deep-learning #unix #linux #mesh-node #platform #whisper #llama #llama-cpp

  37. crabml

    core package

    v0.1.0 #package #artificial-intelligence #llama #inference-engine #llama-cpp #web-gpu #simd-accelerated #web-server #desktop #objectives

  38. icebreaker

    A local AI chat app powered by 🦀Rust, 🧊iced, 🤗Hugging Face, and 🦙llama.cpp

    v0.1.0 110 #artificial-intelligence #llama-cpp #hugging-face #iced #local

  39. crabml-cli

    crabml cli

    v0.1.0 #model-inference #cli #llama #inference-engine #artificial-intelligence #llama-cpp #web-gpu #simd-accelerated

  40. llm_devices

    Device management and build system for LLM inference

    v0.0.3 250 #inference #build-system #logging #devices #llama #ram #llm-interface #devices-management #llm-client #llama-cpp

    41. Try searching with DuckDuckGo.

  41. babichjacob-llama-cpp-2

    llama.cpp bindings for Rust

    v0.1.85 #llama-cpp #llama-cpp-bindings #llm #date #powering #coupled

  42. llm_interface

    backend for the llm_client crate

    v0.0.3 230 #artificial-intelligence #llm-client #openai #llama-cpp #back-end

  43. localllm

    qwen2 model lib by llama.cpp

    v0.2.0 #llama #llama-cpp #model #api-bindings

  44. babichjacob-llama-cpp-sys-2

    Low Level Bindings to llama.cpp

    v0.1.85 340 #llama-cpp #low-level #cuda #safe-api

  45. htmx_llamacpp_server

    server for the htmx_llamacpp project

    v0.1.3 #llama-cpp #htmx #server #port #host

  46. llama_link

    A llama.cpp server interface

    v0.2.1 110 #llama #llama-cpp #link #server #prompt

  47. llm-neox

    GPT-NeoX for the llm ecosystem

    v0.1.1 270 #ggml #llm #ecosystem #model-language #llm-inference #llama-cpp

  48. llm-bloom

    BLOOM (BigScience Large Open-science Open-access Multilingual Language Model) for the llm ecosystem

    v0.1.1 390 #large-language-model #ggml #llm #llama-cpp #ecosystem #llm-cli #multilingual #llm-inference #open-access #hugging-face

  49. llm-gpt2

    GPT-2 for the llm ecosystem

    v0.1.1 390 #gpt-2 #ggml #llm #ecosystem #model-language #llm-cli #model-inference #llama-cpp

  50. llm-gptj

    GPT-J for the llm ecosystem

    v0.1.1 270 #ggml #llm #model-language #ecosystem #llama-cpp #llm-cli #llm-inference

  51. llm-base

    The base for llm; provides common structure for model implementations. Not intended for use by end-users.

    v0.1.1 500 #ggml #llm #inference #llama #llama-cpp #ml-model

  52. llama-sys

    bindings for llama.cpp

    v0.1.2 #llama-cpp #bindings

  53. utils-tree-sitter

    Utils for working with splitter-tree-sitter

    v0.1.0 #artificial-intelligence #language-server #splitter-tree-sitter #openai #llama-cpp #lsp #ide #auto-completion #self-hosted #development-tools

  54. llm-cli

    A CLI for running inference on supported Large Language Models. Powered by the llm library.

    v0.1.1 170 #large-language-model #inference #llama #ggml #model-inference #llm-inference #cli-for-running #llama-cpp

  55. infa-gguf

    A minimal rust machine learning library in wip

    v0.0.1 #infa #machine-learning #llama #llama-cpp

  56. infa

    A minimal rust machine learning library in wip

    v0.0.1 #machine-learning #llama #llama-cpp #micro-architecture #pytorch #cu-blas

  57. infa-core

    A minimal rust machine learning library in wip

    v0.0.1 #machine-learning #llama #llama-cpp

  58. infa-impl

    A minimal rust machine learning library in wip

    v0.0.1 #machine-learning #llama #llama-cpp