Thanks to visit codestin.com
Credit goes to github.com

Skip to content
This repository was archived by the owner on Nov 17, 2023. It is now read-only.

[v1.4.x] Add pin_device_id option to Gluon DataLoader (#14136)#14771

Merged
szha merged 1 commit into
apache:v1.4.xfrom
yuxihu:dataloader_14x
Apr 23, 2019
Merged

[v1.4.x] Add pin_device_id option to Gluon DataLoader (#14136)#14771
szha merged 1 commit into
apache:v1.4.xfrom
yuxihu:dataloader_14x

Conversation

@yuxihu
Copy link
Copy Markdown
Member

@yuxihu yuxihu commented Apr 22, 2019

Cherry-pick the change that fixes out of memory error when using Gluon DataLoader with CPUPinned memory during distributed training on multiple GPUs with MXNet + Horovod to v1.4.x branch.

* add pin_device_id option to DataLoader

* add unit test to check output context

* trigger CI
@yuxihu yuxihu requested a review from szha as a code owner April 22, 2019 23:20
@yuxihu
Copy link
Copy Markdown
Member Author

yuxihu commented Apr 22, 2019

@junrushao1994 @szha Please help review and merge. Thanks.

@szha szha requested a review from zhreshold April 23, 2019 01:05
@szha szha merged commit b7372d3 into apache:v1.4.x Apr 23, 2019
@yuxihu yuxihu deleted the dataloader_14x branch April 23, 2019 13:20
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants