Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Parameters changed for "ggml_flash_attn_ext" #384

Open
@paulocoutinhox

Description

@paulocoutinhox

Hi,

Im getting this error with latest GGML:

/Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/stable-diffusion/ggml_extend.hpp:744:15: error: no matching function for call to 'ggml_flash_attn_ext'
        kqv = ggml_flash_attn_ext(ctx, q, k, v, mask, scale, 0);
              ^~~~~~~~~~~~~~~~~~~
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/stable-diffusion/util.cpp:13:
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/stable-diffusion/preprocessing.hpp:4:
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/stable-diffusion/ggml_extend.hpp:23:
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/ggml/include/ggml-alloc.h:3:
/Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/ggml/include/ggml.h:1803:35: note: candidate function not viable: requires 8 arguments, but 7 were provided
    GGML_API struct ggml_tensor * ggml_flash_attn_ext(

Thanks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions