Web scraper for AI/ML training
A booking.com Web Scraper for Data Mining/Harvesting and Automation
Ricgraph - Research in context graph
Various experiments automating user analytics via low-resource web beacons.
Arduino Excel is a powerful interface between Arduino and MS Excel that supports realtime data exchanging in both directions.
The generation of a kmers dataset that is associated with multiple gene sequences and the further manipulation of this generated dataset are the main contents of the current project.
StealthScrape is a powerful and efficient file-scraping tool designed to extract specific file types from websites with ease. It automates the process of collecting PDFs, XLS, XML, HTML, PHP, JS, CSS, and more from a given domain. The tool operates through a simple command-line interface, prompting users for necessary inputs like the target domain
🧠Discover and connect with reachable Minecraft servers using this multi-threaded, proxy-friendly tool. Access a polished GUI or run headless.
A web scraping project using Python's "Requests" and "BeautifulSoup" libraries to extract structured data from one or more websites. This project involves sending HTTP requests to the target website(s), retrieving the HTML content of the website(s), and parsing this content to extract the desired data in a usable format.
Master's Thesis repository. Code to extract data from two digital newspapers by web scraping techniches. Also code to clean the data, perform visualizations and text analysis.
This project leverages the Spotify API to conduct sentiment analysis, uncovering the emotional trends within music selections.
want to find a good data harvesting program, start here
This project utilises the features of the YouTube Data API to retrieve data from YouTube channels, playlists, videos, and comments and store it in a data lake. It also interacts with a PostgreSQL database to store the retrieved data.
"Scraping Glassdoor: A GraphQL Journey" is an advanced data harvesting tool leveraging GraphQL and an API-first strategy to extract and analyze Glassdoor data for business intelligence and predictive analytics.
Minecraft Server Finder is a small toolkit which helps in finding Minecraft servers and tracking players using the "sample" parameter.
Enterprise-grade headless web intelligence API built with Next.js, TypeScript, & Puppeteer, featuring SLA-governed Chromium orchestration, DOM-level SEO metadata extraction, adaptive user-agent spoofing, deterministic timeout control, fault-tolerant execution, & schema-validated JSON endpoint for scalable automation, growth analytics, intelligence.
A service which connects to Discord and stores message metadata in a database.
Scrape HTML content from URLs quickly
Final version - Crawl test project. Crawling and parsing data from Kenya law site
Add a description, image, and links to the data-harvesting topic page so that developers can more easily learn about it.
To associate your repository with the data-harvesting topic, visit your repo's landing page and select "manage topics."