Tags: grafst/crawler
Tags
Upgrade spatie/browsershot to 5.0 (spatie#478) Co-authored-by: hasansoyalan <[email protected]> Co-authored-by: Freek Van der Herten <[email protected]>
Merge pull request spatie#477 from pascalbaljet/php-84 Add support for PHP 8.4
Fix setParsableMimeTypes() (spatie#470) * Do not continue rest of crawl if no body * Remove erroneous ->only --------- Co-authored-by: David Racovan <[email protected]>
Check original URL against depth tree when visited link is a redirect (… …spatie#467) * Check original URL against depth tree when visited link is a redirect * Fix link to $originalUrl * Fix link to $originalUrl on linkurlparser * Add max depth + redirects test * Move new parameter to end of signature * Fix method calls --------- Co-authored-by: David Racovan <[email protected]>
Add Laravel/Illuminate 11 Support (spatie#461) * Add Laravel 11 Support * Show Illuminate version in matrix * Allow dev versions * Exclude Laravel 11 on PHP 8.1 * Update nicmart/tree to ^0.8
feat: custom link parser (spatie#458) * feat: allow custom url parsers Previously named LinkAdder * fix: removed incorrect type check * feat: added sitemap url parser * tests: added sitemap url parsing test * chore: added readme documentation for custom url parsers * Update README.md * tests: added more consistent tests with sitemapindex and sitemap childs * Fix styling * chore: added documentation for the built-in SitemapUrlParser --------- Co-authored-by: Freek Van der Herten <[email protected]> Co-authored-by: Velka-DEV <[email protected]>
PreviousNext