A versatile CLI and Python wrapper for Groq AI's breakthrough LPU Inference Engine. Streamline the creation of chatbots and generate dynamic text with speeds of up to 800 tokens/sec.
-
Updated
Sep 12, 2024 - Python
A versatile CLI and Python wrapper for Groq AI's breakthrough LPU Inference Engine. Streamline the creation of chatbots and generate dynamic text with speeds of up to 800 tokens/sec.
Add a description, image, and links to the lpu-inference-engine topic page so that developers can more easily learn about it.
To associate your repository with the lpu-inference-engine topic, visit your repo's landing page and select "manage topics."