Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[BUG] SAC Loss reshapes tensordict causing loss of time dimension #2338

@matteobettini

Description

@matteobettini

I am trying to use the SAC loss with a memory model.

The memory model expects data leading with batch dimension [B,T]

I pass data with this shape to the loss,
but here it gets reshaped

tensordict_reshape = tensordict.reshape(-1)

causing the loss of the dimension T, which I cannot retrieve in my model.

Would it be possible to remove the reshaping of the data from the loss?

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions