Thanks to visit codestin.com
Credit goes to github.com

Skip to content

compile llama with qmkl6 support #22

@zoldaten

Description

@zoldaten

hi!

i have installed privatechatgpt (https://docs.privategpt.dev/installation) on raspberry pi 4b Bookworm and qmkl6 also.
and looking how to speed it up a bit.
may be there is any flags to compile like follows :
CMAKE_ARGS="-DNEON=on" pip install --force-reinstall --no-cache-dir llama-cpp-python
to use qmlkl6 ?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions