Thanks to visit codestin.com
Credit goes to github.com

Skip to content

feat: add cached dataset wrapper#148

Merged
NOBLES5E merged 69 commits into
masterfrom
cached-dataset
Aug 24, 2021
Merged

feat: add cached dataset wrapper#148
NOBLES5E merged 69 commits into
masterfrom
cached-dataset

Conversation

@wangraying
Copy link
Copy Markdown
Member

@wangraying wangraying commented Jul 28, 2021

No description provided.

Comment thread bagua/torch_api/contrib/cached_dataset.py Outdated
@todo
Copy link
Copy Markdown

todo Bot commented Aug 4, 2021

cleanup automatically

# TODO: cleanup automatically
self.store.shutdown()
class BatchFetcher:
def __init__(self, store, batch_reads, batch_writes):


This comment was generated by todo based on a TODO comment in 6c6ab3d in #148. cc @BaguaSys.

Comment thread bagua/torch_api/contrib/utils/redis_store.py Outdated
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Comment thread bagua/torch_api/contrib/cache_dataset.py Outdated
Comment thread bagua/torch_api/contrib/cache_dataset.py Outdated
Comment thread bagua/torch_api/contrib/cache_dataset.py Outdated
Comment thread bagua/torch_api/contrib/cache_dataset.py Outdated
Comment thread bagua/torch_api/contrib/cache_dataset.py Outdated
Comment thread bagua/torch_api/contrib/cache_dataset.py Outdated
Comment thread bagua/torch_api/contrib/utils/redis_store.py Outdated
wangraying and others added 2 commits August 11, 2021 23:26
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Comment thread bagua/torch_api/contrib/cache_dataset.py Outdated
Comment thread bagua/torch_api/contrib/cache_dataset.py Outdated
Comment thread bagua/torch_api/contrib/utils/redis_store.py Outdated
Comment thread bagua/torch_api/contrib/utils/redis_store.py Outdated
Comment thread bagua/torch_api/contrib/utils/redis_store.py Outdated
Comment thread bagua/torch_api/contrib/utils/redis_store.py
Comment thread bagua/torch_api/contrib/utils/store.py Outdated
Comment thread bagua/torch_api/contrib/utils/store.py Outdated
Comment thread bagua/torch_api/contrib/utils/store.py Outdated
Comment thread bagua/torch_api/contrib/utils/store.py Outdated
Comment thread bagua/torch_api/contrib/utils/store.py Outdated
Copy link
Copy Markdown
Contributor

@NOBLES5E NOBLES5E left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

see comments

Comment thread bagua/torch_api/contrib/utils/redis_store.py Outdated
Comment thread bagua/torch_api/contrib/cached_dataset.py Outdated
Comment thread bagua/torch_api/contrib/cached_dataset.py Outdated
Comment thread bagua/torch_api/contrib/utils/store.py Outdated
Copy link
Copy Markdown
Contributor

@NOBLES5E NOBLES5E left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

see comments

@wangraying wangraying requested a review from NOBLES5E August 24, 2021 03:11
@NOBLES5E NOBLES5E merged commit 7ded776 into master Aug 24, 2021
@NOBLES5E NOBLES5E deleted the cached-dataset branch August 24, 2021 04:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants