OpenWebSpider is an Open Source multi-threaded Web Spider (robot, crawler) and search engine with a lot of interesting features!
Project Samples
License
MIT License
You Might Also Like
Full Control for Complex IT - Try PRTG Now
As an IT monitoring expert, you need more than basic alerts - you need actionable data and full transparency. PRTG gives your team a single pane of glass for all systems, devices, and applications, with customizable dashboards and granular user management. Detect issues before they escalate, automate reporting, and ensure compliance with SLAs. PRTG’s scalable engine and advanced analytics help you optimize resources, reduce manual effort, and keep your organization running smoothly. Take control of your IT landscape and make smarter decisions with real-time, enterprise-grade monitoring.
Rate This Project
Login To Rate This Project
User Reviews
-
Congratulations, very complete search tool! Guy, please, how to configure the login/password for proxy client/server?
-
as with a lot of these projects, they don't run on windows without errors such as 'node' is not recognized as an internal or external command popping up. But I can't complain, it's free, but the average person will have to spend a few hours figuring out how to get it to work or reconfiguring windows to run scripts.
-
Well done
-
Nice work ! Great project.