Thanks to visit codestin.com
Credit goes to github.com

Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

feat: Cortex pull from HF can select quantization #1006

@louis-menlo

Description

@louis-menlo

Describe the bug
When pulling a model from HF, I could not select the model quantization, it downloads the first one by default (lowest quality)

To Reproduce
Steps to reproduce the behavior:

  1. run cortex
  2. pull any models on HF E.g. TheBlock/Tiny
  3. it pulls Q2 by default
  4. see error

Expected behavior
It should prompt users to select the quantization they want to pull

Metadata

Metadata

Assignees

Type

No type

Projects

Status

Completed

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions