-
Couldn't load subscription status.
- Fork 88
Ensure consolidate_metadata and batch_mode are well integrated
#530
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This looks good, but wonder, should batch mode be false by default? It looks like it is set to False on line 89 of client.py. But, then on 124 it looks like it's True by default.
It might just be the diffs are hard to read, but I thought I'd mention it.
|
Oh yes! Thanks for pointing it out. Originally, I was setting it to be |
…r discovery
The following Pull Request:
concat_dimparameter to the session header, and ensure correct ordering of variables that appears in the dap url.on a local environment.
Example downloading MERRA-2 data
Uses the CMR to only access the granules from Jan/1/2023 --- Jan/31/2023
(1 month, 31 granules, each granule has hourly data)
Using Hyrax to subset before download: all lons,
-80 < lats < -45The CE:
dap4.ce=SLP[0:1:23][0:1:89][0:1:575];T2M[0:1:23][0:1:89][0:1:575];U2M[0:1:23][0:1:89][0:1:575];V2M[0:1:23][0:1:89][0:1:575]&dap4.checksum=trueshows that indeed Hyrax got the request to slice all arrays in the latitude dimension (
[0:1:89]), and that the cached URL contains all variables in it (as opposed to, before, a single dap url per variable)without batch=True
The last step takes 1min 30 second