LLM inference in C/C++

Python bindings for llama.cpp

Real-time processing and delivery of sentences from a continuous stream of characters or text chunks.

ALSA wrappers for Python

Faster Whisper transcription with CTranslate2

Simple chat interface for local AI using llama-cpp-python and llama-cpp-agent

The universal GraphQL API and CSPM tool for AWS, Azure, GCP, K8s, and tencent.

Creating the Blokus game using VueJS.