Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Update multimodal.md #14122

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jun 13, 2025
Merged

Update multimodal.md #14122

merged 2 commits into from
Jun 13, 2025

Conversation

ddpasa
Copy link
Contributor

@ddpasa ddpasa commented Jun 11, 2025

I am not too sure what to do with this. I saw people in Reddit complain about difficulties with model discovery, and made this doc change. Maybe it helps?

At the same time, most of this should be rather obvious.

@ddpasa
Copy link
Contributor Author

ddpasa commented Jun 11, 2025

maybe @ngxson has some insights?

@github-actions github-actions bot added the documentation Improvements or additions to documentation label Jun 11, 2025
Comment on lines 115 to 119
Below are several popular models maintained by the community that should work with llama.cpp:
- Joy Caption Beta 1: https://huggingface.co/concedo/llama-joycaption-beta-one-hf-llava-mmproj-gguf/tree/main
- Bakllava: https://huggingface.co/AI-Engine/BakLLaVA1-MistralLLaVA-7B-GGUF/tree/main
- MiMo: https://huggingface.co/unsloth/MiMo-VL-7B-RL-GGUF
- Cosmos-Reason1: https://huggingface.co/unsloth/Cosmos-Reason1-7B-GGUF
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we should include this part, it's just too hard to maintain in the long term. The link above should be enough

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

removed them.

it's a shame though, joy caption in particular is a very powerful model.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

powerful or not is subjective - we cannot bias toward particular model(s) in the docs

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

powerful or not is subjective - we cannot bias toward particular model(s) in the docs

true, but still sad nonetheless. it's a great model :)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I started a helper doc here: https://github.com/ddpasa/cool_links/blob/main/llama.cpp.md

According to the internet (reddit, hackernews) llama.cpp has a huge model discovery problem. I hope it helps a little.

@ngxson ngxson merged commit 26ff368 into ggml-org:master Jun 13, 2025
2 checks passed
@ddpasa ddpasa deleted the patch-3 branch June 15, 2025 11:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants