Thanks to visit codestin.com
Credit goes to github.com

Skip to content

T2v or i2v support #628

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
KintCark opened this issue Mar 12, 2025 · 3 comments
Open

T2v or i2v support #628

KintCark opened this issue Mar 12, 2025 · 3 comments

Comments

@KintCark
Copy link

Can we please get animatediff or hunyuan , ltxv, cogvideo,sana ,skyreels support?

@ImKyra
Copy link

ImKyra commented Mar 15, 2025

I'm actually building a tool using Imgui/SDL3/stablediffusioncpp and video models (especially wan2.1) support a feature I would love to add but I don't know much about 'around models' programming. Does someone knows if it's doable with the actual ggml library? If so I may try in a near future.

@stduhpf
Copy link
Contributor

stduhpf commented Mar 15, 2025

I'm actually building a tool using Imgui/SDL3/stablediffusioncpp and video models (especially wan2.1) support a feature I would love to add but I don't know much about 'around models' programming. Does someone knows if it's doable with the actual ggml library? If so I may try in a near future.

It's harder than it should be because most video models use 5D tensors at some point, and GGML only supports up to 4D tensors. I don't think it's undoable, but it's definitely tricky to work around this limitation. I gave up implementing LTX because of that.

@ImKyra
Copy link

ImKyra commented Mar 15, 2025

Thanks for your insight.
Yeah that seem to be a hard things to work around without patching the lib itself which seems also to be pretty hard.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants