News article collection infrastructure

Periodically check if there are any new items in news RSS feeds.
If there are, store new article URL.
Download articles, store automated extraction of news stories as well as the full HTML.

Cronjob example

*/5 * * * * cd ~/news-article-collection/; python3 collect.py
*/30 * * * * cd ~/news-article-collection/; python3 progress.py

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
README.md		README.md
collect.py		collect.py
database.py		database.py
process.py		process.py
requirements.txt		requirements.txt