Web Content Extracting packages

Showing projects tagged as Text Processing and Web Content Extracting

  • trafilatura

    7.6 6.8 Python
    Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
  • sumy

    7.3 0.0 L5 Python
    Module for automatic summarization of text documents and HTML pages.
  • python-readability

    6.8 7.2 Python
    fast python port of arc90's readability tool, updated to match latest readability.js!
  • selectolax

    5.0 9.3 Cython
    Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
  • Goose3

    4.4 6.4 HTML
    A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
  • opengraph

    3.0 0.0 L5 Python
    A python module to parse the Open Graph Protocol
  • inscriptis -- HTML to text conversion library, command line client and Web service

    3.0 8.0 Python
    A python based HTML to text conversion library, command line client and Web service.
  • htmldate

    2.3 3.6 Python
    Fast and robust date extraction from web pages, with Python or on the command-line
  • JSONPATH

    1.2 7.5 Python
    A query expression for extracting data from JSON.
  • Data Extractor

    1.1 7.2 Python
    Combine XPath, CSS Selectors and JSONPath for Web data extracting.