Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Daily automated pipeline that scrapes food prices from major Slovak retailers and stores them in a database for further processing.

Notifications You must be signed in to change notification settings

bui-tomas/food-tracker

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Food Price Scraper

This repository is part of broader Food Tracker ecosystem

A daily automated pipeline that scrapes food prices from major Slovak retailers and stores them in a PostgreSQL database for price tracking and analysis.

Features

  • Automated Daily Scraping: Runs automatically every day at 7:15 AM CET/CEST on a local machine
  • Parallel Processing: Async scraping with retry logic for reliability
  • Data preprocessing: Data is processed before being uploaded to DB
  • Database connection: Uploads data to Supabase DB
  • Telegram Notifier: Sends outcome message to Telegram

Data Source

The scraper collects data from cenyslovensko.sk, Slovakia's government-backed price comparison portal which was launched in June 2025.

Installation

  1. Clone the repository

    git clone https://github.com/bui-tomas/food-scraper.git
    cd food-scraper
  2. Create virtual environment

    python -m venv env
    source env/bin/activate  
  3. Install dependencies

    pip install -r requirements.txt
    playwright install chromium
  4. Configure environment

    Create a .env file in the project root:

    DATABASE_URL=postgresql://user:password@host:port/database

About

Daily automated pipeline that scrapes food prices from major Slovak retailers and stores them in a database for further processing.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages