Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure. Learn more →
Top 23 Python generative-ai Projects
-
Langflow: https://www.langflow.org/
-
InfluxDB
InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
-
-
NeMo
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
git clone https://github.com/NVIDIA/NeMo.git nemo
-
`outlines` (https://github.com/dottxt-ai/outlines) is very good and supported by vLLM as a backend structured output provider (https://docs.vllm.ai/en/v0.8.2/features/structured_outputs.h...) for both local and remote LLMs. vLLM is probably the best open source tooling for the inference side right now.
-
krita-ai-diffusion
Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.
-
BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Project mention: My personal favorite MCP server which has became part of my life | dev.to | 2025-05-27 -
agent-squad
Flexible and powerful framework for managing multiple AI agents and handling complex conversations
Project mention: Orchestrating Multi-Agents: Unifying Fragmented Tools into Coordinated Workflows | dev.to | 2025-06-29AWS Agent Squad (GitHub)
-
Stream
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
-
For monitoring, there are separate full-fledged monitoring solutions like Opik, PostHog, Langfuse or OpenLLMetry, maybe will try some next time.
-
-
Project mention: Introducing Potpie's Slack Integration: Bring Your Custom AI Agents to Where You Work | dev.to | 2025-04-24
Potpie is an open-source platform that allows you to build and deploy custom AI agents tailored to your specific codebase. These agents can handle a wide range of tasks including debugging, code reviewing, code generation, onboarding, etc.
-
h2o-llmstudio
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
-
cognita
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
Project mention: Lists of open-source frameworks for building RAG applications | dev.to | 2025-01-02Ideal For: Enterprises seeking a robust framework for large-scale AI applications. GitHub Repository
-
Project mention: Jupyter AI & .NET Aspire: Building an LLM-Enabled Jupyter Environment | dev.to | 2025-02-17
Jupyter AI GitHub
-
-
-
Wan2GP
A fast AI Video Generator for the GPU Poor. Supports Wan 2.1/2.2, Qwen Image, Hunyuan Video, LTX Video and Flux.
If you want to play with this, as in really play, with over a dozen variant models with acceleration loras and a vibrant community, ya gotta check out:
https://github.com/deepbeepmeep/Wan2GP
And the discord community: https://discord.gg/g7efUW9jGV
"Wan2GP" is AI video and images "for the GPU poor", get all this operating with as little as 6GB VRAM, Nvidia only.
-
PyRIT
The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.
-
Project mention: Skywork-OR1: new SOTA 32B thinking model with open weight | news.ycombinator.com | 2025-04-13
-
agent-starter-pack
A collection of production-ready Generative AI Agent templates built for Google Cloud. It accelerates development by providing a holistic, production-ready solution, addressing common challenges (Deployment & Operations, Evaluation, Customization, Observability) in building and deploying GenAI agents.
-
hallucination-leaderboard
Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents
Project mention: The AI-Native GraphDB + GraphRAG + Graph Memory Landscape & Market Catalog | dev.to | 2025-10-26Vectara - vectara.com/
-
mcp-context-forge
A Model Context Protocol (MCP) Gateway & Registry. Serves as a central management point for tools, resources, and prompts that can be accessed by MCP-compatible LLM applications. Converts REST API endpoints to MCP, composes virtual MCP servers with added security and observability, and converts between protocols (stdio, SSE, Streamable HTTP).
Project mention: Unify Your AI Stack: Meet the Universal Gateway That Tames REST, MCP, and More | dev.to | 2025-10-11View the Project on GitHub
-
xTuring
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python generative-ai discussion
Python generative-ai related posts
-
Building Custom Components in Langflow 🛠️
-
Implementing Token Count Optimization in repo-contextr
-
AI assistants misrepresent news content 45% of the time
-
Amazon Bedrock Guardrails Automated Reasoning Checks: Minimiza las Alucinaciones en IA con Verificación Matemática
-
OpenAI and Stripe Create Agentic Commerce Protocol
-
Pyrit: Microsoft's GenAI Red Teaming Tool
-
docling VS spacy-layout - a user suggested alternative
2 projects | 24 Sep 2025 -
A note from our sponsor - Stream
getstream.io | 16 Nov 2025
Index
What are some of the best open-source generative-ai projects in Python? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | langflow | 138,041 |
| 2 | serve | 21,778 |
| 3 | NeMo | 16,065 |
| 4 | outlines | 12,821 |
| 5 | krita-ai-diffusion | 9,340 |
| 6 | BentoML | 8,193 |
| 7 | agent-squad | 7,050 |
| 8 | openllmetry | 6,582 |
| 9 | TaskingAI | 5,346 |
| 10 | potpie | 5,004 |
| 11 | h2o-llmstudio | 4,715 |
| 12 | cognita | 4,277 |
| 13 | jupyter-ai | 3,965 |
| 14 | AdalFlow | 3,870 |
| 15 | SDV | 3,298 |
| 16 | Wan2GP | 3,168 |
| 17 | PyRIT | 3,063 |
| 18 | semantic-router | 2,882 |
| 19 | agent-starter-pack | 2,857 |
| 20 | hallucination-leaderboard | 2,809 |
| 21 | mcp-context-forge | 2,790 |
| 22 | xTuring | 2,662 |
| 23 | dbrx | 2,573 |
Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com