Thanks to visit codestin.com
Credit goes to lib.rs

Lib.rs

› Search #artificial-intelligence #serialization #openai #incremental-parser #tui

  1. toon-format

    Token-Oriented Object Notation (TOON) - a token-efficient JSON alternative for LLM prompts

    v0.4.1 7.0K #toon #serialization #llm #llm-token #format

  2. error-toon

    Compress verbose browser errors for LLM consumption. Save 70-90% tokens.

    v1.1.5 #llm #token #compression #error #cli

  3. kalosm-sample

    A common interface for token sampling and helpers for structered llm sampling

    v0.4.1 500 #artificial-intelligence #llama #nlp #mistral #llm

  4. infiniloom

    High-performance repository context generator for LLMs - Claude, GPT-4, Gemini optimized

    v0.6.2 #llm-context #llm #repository #context

  5. mxp

    MXP (Mesh eXchange Protocol) - High-performance protocol for agent-to-agent communication

    v0.3.0 #artificial-intelligence #ai-agents #transport

  6. hedl-core

    Core parser and data model for HEDL format

    v1.0.0 #data-model #model-parser #convert-json #reference #incremental-parser #input-validation #lexical-analysis #model-format #consumption #hierarchical

  7. clay-cli

    An AI-powered developer assistant and TUI to streamline your git and project workflows

    v1.1.16 #tui #artificial-intelligence #git #dev-tools

  8. unifictl

    CLI for UniFi Site Manager (API v1/EA)

    v5.2.0 #unifi #ubiquiti #networking #api

  9. mdstream

    Streaming-first Markdown middleware for LLM output (committed + pending blocks, render-agnostic)

    v0.2.0 #streaming-parser #markdown #incremental-parser #llm #parser

  10. toon

    Token-Oriented Object Notation – a token-efficient JSON alternative for LLM prompts

    v0.1.2 11K #llm #json #serialization

  11. chace

    CHamal's AutoComplete Engine - An LLM based code completion engine

    v0.2.0 #llm #engine #code-completion #autocomplete #cursor-position #artificial-intelligence #llm-token #breaking-change

  12. iron_cli

    Command-line interface for Iron Cage agent management

    v0.4.0 #api-token #command-line-interface #agent

  13. regexr

    A high-performance regex engine built from scratch with JIT compilation and SIMD acceleration

    v0.1.0-beta.5 #simd #regex #pattern-matching

  14. toktrie

    LLM Token Trie library

    v1.4.0 35K #llm-token #recognizer #trie #prefix-tree #stack

  15. lnmp-llb

    LNMP-LLM Bridge Layer - Optimization layer for LLM prompt visibility and token efficiency

    v0.5.16 #lnmp #serialization #protocols #llm #serialization-protocols

  16. toon-rust

    Token-Oriented Object Notation (TOON) - JSON for LLM prompts at half the tokens. Rust implementation.

    v0.1.3 260 #serialization #llm-token #llm

  17. flyllm

    unifying LLM backends as an abstraction layer with load balancing

    v0.4.1 #load-balancing #openai #llm #anthropic

  18. bundle_repo

    Pack a local or remote Git Repository to XML for LLM Consumption

    v0.6.0 440 #git #llm #tokenizer

  19. ort-rs

    Object Record Table - a CSV like structured data format with native object and array support

    v1.1.0 #csv #structured-data #object #record #native #llm

  20. toktop

    A terminal-based LLM cost and usage monitor

    v0.1.5 #llm #monitor #tui #cost #usage

  21. llm-samplers

    Token samplers for large language models

    v0.0.7 2.0K #sampler #machine-learning #deep-learning #machine-learning-ml

  22. zed_llm_client

    A client for interacting with the Zed LLM API

    v0.8.7 250 #zed #llm #llm-client #api-client

  23. pyscription

    Token-efficient README generator that parses Python APIs and docstrings

    v0.1.0 #artificial-intelligence #python #readme

  24. loctok

    Count LOC (lines of code) & TOK (LLM tokens), fast

    v0.2.0 #loc #llm #tiktoken #lines-of-code #token

  25. toktrie_hf_downloader

    HuggingFace Hub download library support for toktrie and llguidance

    v1.4.0 #structured-output #llguidance #tokenize #openai #hugging-face #context-free-grammar #json-schema #llama #toktrie #llama-cpp

  26. zeta-salience

    Salience analysis engine for intelligent token prioritization in LLM inference

    v0.1.0 #llm-inference #llm #attention #salience #prioritization

  27. quicktok

    Minimal, fast, multi-threaded implementation of the Byte Pair Encoding (BPE) for LLM tokenization

    v0.2.0 #byte-pair #tokenize #bpe #multi-threading #llm

  28. asterai

    client library for asterai

    v0.2.1 150 #client #client-for-asterai #artificial-intelligence #client-for-querying #applications

  29. llm-weaver

    Manage long conversations with any LLM

    v0.2.1 1.4K #chat-bot #llm #framework #api-bindings

  30. llm_prompt

    Low Level Prompt System for API LLMs and local LLMs

    v0.0.3 330 #gguf #llm-token #prompt-tokens #low-level #llm-client #llm-interface

  31. language-barrier-core

    providing abstractions for Large Language Models

    v0.1.9 490 #openai #llm #chat-completion #llm-token #anthropic #provider-agnostic #mistral #type-safe #multimodal #chat-model

  32. alith-prompt

    LLM Prompting

    v0.4.3 #llm-prompt #prompting #openai #prompt-tokens #prompt-generation #llm-token #hash-map #gguf #artificial-intelligence #model-context

  33. llm-observatory-core

    Core types, traits, and utilities for LLM Observatory

    v0.1.1 160 #observability #tracing-monitoring #open-telemetry #llm #tracing

  34. rtoon

    Token-Oriented Object Notation - A compact, human-readable format for LLM data with 30-60% fewer tokens than JSON

    v0.2.1 #llm #serialization #tokens

    35. Try searching with DuckDuckGo or on crates.io.

  35. agent-chain-core

    Core library for agent-chain crate

    v0.0.3 #artificial-intelligence #chat-model #llm #prompt

  36. catgrad-llm

    Tools for LLMs built with catgrad

    v0.1.1 #llm #tokenize #catgrad #model #kv-cache #remote-host #interpreter #packaging

  37. llm-sentinel-core

    Core types, error handling, and configuration for LLM-Sentinel anomaly detection system

    v0.1.0 #observability #anomaly-detection #telemetry #llm #monitoring-observability

  38. gpt4

    a cli to interact with the openai gpt4 api

    v0.1.3 #openai #interact #llm #python-version #cli #chatgpt #dummy #lowkey

  39. wordchuck

    LLM Tokenizer Library

    v0.0.1 #tokenize #nanochat #training #llm #python-bindings #first-class #bpe-tokenizer