Thanks to visit codestin.com
Credit goes to github.com

Skip to content

LLaMA.cpp returns just some weirdo texts with any model size #291

Closed
@gotzmann

Description

@gotzmann

I'm grokking with LLaMA.cpp on M1 laptop with 32GB RAM. Somehow the inference is broken for me.

Like I'm expecting something reasonable for simple prompt I've got from original LLaMA examples:

SQL code to create a table, that will keep CD albums data, such as album name and track\n\\begin{code}\n

And LLaMA.cpp returns just some weirdo texts with any model size (7B, 13B, 30B quantised down to 4bit).

What's the reason here?

Metadata

Metadata

Assignees

No one assigned

    Labels

    generation qualityQuality of model outputneed more infoThe OP should provide more details about the issue

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions