MinerU-HTML: An SLM-powered HTML main content extractor that outputs clean HTML bodies. Perfect for Deep Research Agents, RAG applications, and training data generation.
-
Updated
Dec 25, 2025 - HTML
#
trafilatura
Here are 21 public repositories matching this topic...
pebkac Chrome Nonautomation - A Local LLM-Driven Web Co-Browser using Smolagents, Zendriver, Trafilatura.
chrome automation ai openai webscraping atlas claude llms claude-ai trafilatura nodriver ai-browser-automation smolagents ai-browser-control aibrowser zendriver ai-browser pebkac
-
Updated
Feb 5, 2026 - Python
web Scrapper In Python
-
Updated
Sep 6, 2023 - Python
Telegram Mini App that saves internet articles to read them later
-
Updated
Feb 19, 2026 - Python
Lean Python tool for extracting clean, LLM-optimized markdown from web pages. Handles dynamic content with Playwright + Trafilatura for maximum information extraction efficiency.
-
Updated
Jul 6, 2025 - HTML
An immature port of the Trafilatura to Rust.
-
Updated
Jan 11, 2026 - HTML
ChatGPT AI Clone
python dart websockets gemini web-scraping flutter fastapi sentence-transformers flutter-web-app trafilatura tavily ai-clones
-
Updated
Jul 4, 2025 - Dart
Real-time AI search and chat backend with WebSocket streaming, powered by Tavily web search and Google Gemini for Flutter apps.
-
Updated
Aug 2, 2025 - Python
Tools for LLMs to anonymously search and browse the web
mcp selenium tor duckduckgo selenium-webdriver tor-network geckodriver tor-hidden-services trafilatura mcp-server fastmcp ddgs tbselenium
-
Updated
Feb 20, 2026 - Python
🕷️ Clean, chunked documentation crawler optimized for RAG & AnythingLLM. Dockerized.
-
Updated
Jan 13, 2026 - Python
A web scraper with an LLM-powered document suggestion system that combines web crawling, data extraction, and advanced AI capabilities to recommend relevant documents.
-
Updated
May 10, 2025 - Python
Trafilatura API for html content info extract
python nlp docker flask rest-api text-extraction web-scraping content-extraction metadata-extraction news-scraper article-extraction trafilatura
-
Updated
Dec 2, 2025 - Python
This project is a Python-based web scraping tool that uses the Trafilatura library to extract and save text content from a list of specified websites. The program is designed to process multiple URLs, extract their main content, and save each website's content to a separate .txt file.
-
Updated
Nov 1, 2024 - Jupyter Notebook
Agente simples que busca notícias em RSS, extrai o conteúdo das páginas, gera um resumo em HTML usando `Gemini` e envia por email via SMTP. Ideal para um boletim diário de tecnologia.
-
Updated
Dec 4, 2025 - Python
Free MCP server with web search, website reader & YouTube transcript tools. Zero API keys required.
python mcp duckduckgo free webscraping ai-agents web-search youtube-transcript ai-tools no-api-key llm-tools trafilatura mcp-server
-
Updated
Feb 21, 2026 - Python
🤖 Collection of AI agents for web search, RAG, and multi-agent collaboration. Features phi-agent + Groq integration, Ollama support, DuckDuckGo/Google search, web scraping, and local knowledge base querying with vector embeddings.
duckduckgo web-scraping knowledge-base semantic-search google-search multi-agent-systems ai-agents conversational-ai rag groq vector-database sentence-transformers llm retrieval-augmented-generation lancedb trafilatura ollama crawl4ai phi-agent
-
Updated
Jun 7, 2025 - Python
🕷️ Ingest clean documentation into LLM pipelines effortlessly, filtering out noise for better data quality and improved insights.
-
Updated
Feb 22, 2026 - Python
Summarize articles using NLTK, Gemini and Trafilatura
-
Updated
Apr 9, 2025 - Python
Improve this page
Add a description, image, and links to the trafilatura topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the trafilatura topic, visit your repo's landing page and select "manage topics."