Thanks to visit codestin.com
Credit goes to Github.com

Skip to content

Conversation

@lingdor
Copy link

@lingdor lingdor commented Sep 17, 2023

more scene, we don't want stop runing in a page request faild, so we can use onerror log or add retry queue and continue the spider.

@WGH-
Copy link
Collaborator

WGH- commented Oct 16, 2023

What's the expected use case? Abort further processing and retry the request if you notice something's wrongin one of the OnResponse handlers (e.g. error page) ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants