Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Fix inconsistent behaviour between local and remote scraper searches#8316

Merged
nabobalis merged 3 commits into
sunpy:mainfrom
samaloney:bugfix-scraper-local
Aug 22, 2025
Merged

Fix inconsistent behaviour between local and remote scraper searches#8316
nabobalis merged 3 commits into
sunpy:mainfrom
samaloney:bugfix-scraper-local

Conversation

@samaloney
Copy link
Copy Markdown
Member

PR Description

  • Local searches crash and exit early if an expected directory does not exist
  • Remote searches handle these kind of error and continue
  • This PR adds the same functionality to local searches

Closes #8315

* Local searches crash and exit early if an expected directory does not exist
* Remote searches handle these kind of error and continue
* This PR adds the same functionality to local searches
@samaloney samaloney force-pushed the bugfix-scraper-local branch from ea118a3 to f429683 Compare August 8, 2025 10:15
Comment thread pytest.ini Outdated
@nabobalis nabobalis added Minor Change PR only needs one approval to merge. backport 7.0 on-merge: backport to 7.0 net Affects the net submodule labels Aug 8, 2025
Comment thread changelog/8316.bugfix.rst Outdated
Comment thread sunpy/net/scraper.py
if self._check_timerange(fullpath, timerange):
filepaths.append(fullpath)
except FileNotFoundError:
log.debug(f"Local directory not found: {directory}.")
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should this be level info so it doesn't fail quietly? or is that going to lead to spamming loads?

Copy link
Copy Markdown
Member Author

@samaloney samaloney Aug 22, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I took the same approach as in the other clients with debug messages so if we were to change it here should probably change in the other clients too?

@nabobalis nabobalis merged commit 6e0b503 into sunpy:main Aug 22, 2025
26 of 30 checks passed
meeseeksmachine pushed a commit to meeseeksmachine/sunpy that referenced this pull request Aug 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport 7.0 on-merge: backport to 7.0 Minor Change PR only needs one approval to merge. net Affects the net submodule

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Inconsistent behaviour between remote (http/ftp) and local searches with scraper

3 participants