[Bug]: mean_delay does not work with CrawlerRunConfig #1584
Description
crawl4ai version
0.7.6
Expected Behavior
When i set mean_delay, it should be delayed between requests
Current Behavior
It ignores mean_delay config
Is this reproducible?
Yes
Inputs Causing the Bug
Steps to Reproduce
Code snippets
await crawler.arun_many(
urls=[
"https://docs.crawl4ai.com/core/examples/",
"https://docs.crawl4ai.com/core/quickstart/",
],
config=CrawlerRunConfig(
stream=False, mean_delay=10.0, max_range=5.0, semaphore_count=1
)
)OS
macOs
Python version
3.13
Browser
Chrome
Browser version
No response
Error logs & Screenshots (if applicable)
Config:
config=CrawlerRunConfig(
stream=False, mean_delay=10.0, max_range=5.0, semaphore_count=1
)
Result:
[INIT].... → Crawl4AI 0.7.6
[FETCH]... ↓ https://docs.crawl4ai.com/core/examples/ | ✓ |
⏱: 3.63s
[SCRAPE].. ◆ https://docs.crawl4ai.com/core/examples/ | ✓ |
⏱: 0.03s
[COMPLETE] ● https://docs.crawl4ai.com/core/examples/ | ✓ |
⏱: 3.66s
[FETCH]... ↓ https://docs.crawl4ai.com/core/quickstart/ | ✓ |
⏱: 1.63s
[SCRAPE].. ◆ https://docs.crawl4ai.com/core/quickstart/ | ✓ |
⏱: 0.02s
[COMPLETE] ● https://docs.crawl4ai.com/core/quickstart/ | ✓ |
⏱: 1.65s
Elapsed time: 3.70 seconds
https://docs.crawl4ai.com/core/examples/ crawled OK!
https://docs.crawl4ai.com/core/quickstart/ crawled OK!