DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-w…

An declarative and easy to use web crawler and scraper in C#

A package that helps you to scrap web pages. It shows you a lot of information about the page.

A command-line based web crawler

Tool to crawl .onion websites. Console & Web UI

Experimenting with Google Forms pages, extracting the page data programmatically and submitting to the rest endpoints..

Liefert den Median einer ebay-Kleinanzeigen-Suche.

Pequeno exemplo de uma extração de dados web utilizando o Selenium Framework

A general-purpose smart web crawler that recursively extracts website content using BFS, preserves full URL-based directory structure, and saves files locally. Supports PDF/Word/Excel/PowerPoint also media extraction, customizable crawl depth, domain restriction, CSS-based content targeting, and duplicate prevention using hashing.

A fluent Lib to wrap selenium and other utilities for a web crawler.

Web scraping api exmaple in C# and .net framework to add urls, start scraping job, check job status and download the web scraping result using Agenty API.

Web Crawler written in C# that parses all urls from a specific page then recursively visits them while parsing all links available on that webpage

A Pokédex project build as an android app (Xamarin.Android, C#) with image recognition (azure) & webscraping (python) for the 'We are in IT together'-conference.