Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Conversation

@sebffischer
Copy link
Member

@sebffischer sebffischer commented Dec 5, 2024

Solves #131

Open Questions:

  • Do we want special handling of lazy_tensors (data augmentation). This would require annotating the preprocessing operators with whether they are stochastic or not. If a lazy_tensor is stochastic, we should not allow using the tensor_dataset parameter

    Answer: I think it is better to implement something like po("materialize_lazy_tensor"), which takes in a Task with one or more lazy tensors and converts them internally to a tensor_dataset, which will make the dataloading efficient.

TODOs:

  • allow to select which ingress operators to convert into a tensor_dataset

@sebffischer sebffischer closed this Feb 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants