Allows to convert gguf-ed LMMs to llamafile and upload them to public HF repo You can do that from your local machine and from GitHub Actions

• Convert gguf model to llamafile and upload to huggingface using docker
• GitHub actions for convert gguf model to llamafile and upload to huggingface
• GitHub actions for convert raw model to llamafile and upload to huggingface

1. Create HF repo
2. Create Access Key with write permission and save it somewhere

1. Create .env file and set there corresponding vars:

cp .env.example .env

2. Up container

docker compose up -d olmo

3. Copy gguf-ed model

docker cp OLMo-1.7-7B-hf.Q8_0.gguf llfiler-olmo-1:/app/

4. Connect to container shell

docker exec -it llfiler-olmo-1 /bin/bash

5. Convert ggufed model to llamafile:

llamafile-0.8.6/bin/llamafile-convert OLMo-1.7-7B-hf.Q8_0.gguf

6. Upload to HF:

huggingface-cli upload "$HF_REPO" "$HF_REPO_FILE"

1. Copy .github/workflows/main.yml workflow to your repo
2. Add secret HF_TOKEN to your repo secrets
3. Input HF_REPO, HF_REPO_FILE, REMOTE_GGUF_MODEL, LLAMAFILE_RELEASE on workflow start