Thanks to visit codestin.com
Credit goes to Github.com

Skip to content

kroggen/tokenformer-minimal

Repository files navigation

TokenFormer - Minimal

Minimal implementation of TokenFormer for inference and learning

The pytorch version is on this branch. Check the tinygrad implementation here

Install

pip install -r requirements.txt

Running

  1. Download one of the models on the original repo

  2. Run on the terminal:

python3 tokenformer_minimal.py --config config/150M_eval.yml --model pytorch_model.bin --prompt "Hello, how are you?"

About

Minimal implementation of TokenFormer for inference and learning

Resources

Stars

Watchers

Forks

Languages