Thanks to visit codestin.com
Credit goes to github.com

Skip to content

While using mode parallel the settings specified while switching on the celery workers is used to perform sync #36

@ankitchiplunkar

Description

@ankitchiplunkar

Describe the bug
While using mode parallel the settings specified while switching on the celery workers is used to perform sync. This is not a desired behaviour since this might cause several errors.

Either use a common configuration file or stop scraping if the settings varibles beteen the two processes are not same.

To Reproduce
Steps to reproduce the behavior:
Start celery with default settings

ether_sql celery start -c2

Start the scraping with non default settings
ether_sql --settings=PersonalSettings scrape_block_range --end_block_number=100 --mode=parallel

The scraping will be performed using the default settings and not the setting specified during second command.

Expected behavior
We expect the same setting to be used for both celery and scraping

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions