Thanks to visit codestin.com
Credit goes to github.com

Skip to content

unknown model architecture: 'gemma-embedding' #2065

@mariocannistra

Description

@mariocannistra

I am running llama-cpp-python Version: 0.3.16

Trying to load the recently released model embeddinggemma-300M I get the following error message:

llama_model_load: error loading model: error loading model architecture: unknown model architecture: 'gemma-embedding'

Support for this model architecture has been added to llama.cpp in this build: https://github.com/ggml-org/llama.cpp/releases/tag/b6384

Could you please align llama-cpp-python to reflect this addition ?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions