Minimal implementation of TokenFormer for inference and learning
The pytorch version is on this branch. Check the tinygrad implementation here
pip install -r requirements.txt
-
Download one of the models on the original repo
-
Run on the terminal:
python3 tokenformer_minimal.py --config config/150M_eval.yml --model pytorch_model.bin --prompt "Hello, how are you?"