Thanks to visit codestin.com
Credit goes to github.com

Skip to content

This is a web scraper for a dutch webshop, the scraper get's all programming books with the name, price and description.

Notifications You must be signed in to change notification settings

mikethreels/web_scraper_ruby

Repository files navigation

Project Name

  • A scraper developed in Ruby

screenshot

Project description

It checks if the URL which is given is still up to date and it will return an error and exit the code if it's not. When the URL has been checked and is correct the program will scrape the new arrived developer books from a webpage called 'Bol.com'. After getting the information it will look for the articles on the page and if there are more pages with results. It will get all the articles and return them requesting the user how they would like to view them.

Built With

  • Ruby
  • Nokogiri Gem
  • Awesome_print gem

Getting Started

To get a local copy up and running follow these simple example steps

  • fork the repository and create a local one on your computer
  • move to the repository inside the command line using cd and the path to the file
  • run bundle install
  • to run the file enter bin/main.rb from inside the main folder in the repository
  • the file will pull the data from the url and return it as an array of hashes
  • you can select several options on how you would like to see the data returned by following the instructions

Run tests

  • test have been created to run them enter rspec in the command line
  • inside the "spec" folder in the file "process_spec.rb" test can be added if needed

future version

In the future versions the program will be expanded so the user can enter a custom url and get the data from the search results.

Author

👤 Michael Threels

🤝 Contributing

Contributions, issues and feature requests are welcome!

Feel free to check the issues page.

Show your support

Give a ⭐️ if you like this project!

Acknowledgments

  • Hat tip to anyone whose code was used
  • Inspiration
  • etc

About

This is a web scraper for a dutch webshop, the scraper get's all programming books with the name, price and description.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages