- A scraper developed in Ruby
It checks if the URL which is given is still up to date and it will return an error and exit the code if it's not. When the URL has been checked and is correct the program will scrape the new arrived developer books from a webpage called 'Bol.com'. After getting the information it will look for the articles on the page and if there are more pages with results. It will get all the articles and return them requesting the user how they would like to view them.
- Ruby
- Nokogiri Gem
- Awesome_print gem
To get a local copy up and running follow these simple example steps
- fork the repository and create a local one on your computer
- move to the repository inside the command line using
cdand the path to the file - run
bundle install - to run the file enter
bin/main.rbfrom inside the main folder in the repository - the file will pull the data from the url and return it as an array of hashes
- you can select several options on how you would like to see the data returned by following the instructions
- test have been created to run them enter
rspecin the command line - inside the "spec" folder in the file "process_spec.rb" test can be added if needed
In the future versions the program will be expanded so the user can enter a custom url and get the data from the search results.
👤 Michael Threels
- Github: @githubhandle
- Twitter: @twitterhandle
- LinkedIn :@linkedinhandle
Contributions, issues and feature requests are welcome!
Feel free to check the issues page.
Give a ⭐️ if you like this project!
- Hat tip to anyone whose code was used
- Inspiration
- etc
