Thanks to visit codestin.com
Credit goes to Github.com

Skip to content

yashpokar/twitter-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

twitter-crawler

Twitter scrapy project

seriously twitter has no throttling strategy. Don't know why. May be at least someone is accessing twitter.

change your mongodb setting,

put MONGO_URI = 'your mongo uri' and MONGO_DATABASE = 'your database name' in settings.py

then in your terminal following command, scrapy crawl users

About

Twitter scrapy project

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages