Thanks to visit codestin.com
Credit goes to lib.rs

Lib.rs

› Asynchronous
#gguf #openai #anthropic #llm #api-bindings

alith-client

The Easiest Rust Interface for Local LLMs, and an Interface for Deterministic Signals from Probabilistic LLM Vibes

by nora-coder-dot, Gmetisl2

1 unstable release

Uses new Rust 2024

0.4.3 Mar 18, 2025

#2650 in Asynchronous

Codestin Search App Codestin Search App Codestin Search App Codestin Search App Codestin Search App Codestin Search App Codestin Search App Codestin Search App Codestin Search App Codestin Search App Codestin Search App Codestin Search App Codestin Search App Codestin Search App Codestin Search App Codestin Search App Codestin Search App

101 downloads per month
Used in 6 crates (3 directly)

Apache-2.0

7MB
14K SLoC

The Easiest Rust Interface for Local LLMs

This a fork of llm_client.

Dependencies

~38–75MB
~1M SLoC