CMSC472 Final Project

CMSC472 Intro to Deep Learning final project exploring low-bit (1-bit, 1.58-bit) quantization for Vision Transformers

Trained Quantized ViT Checkpoints

Name		Name	Last commit message	Last commit date
Latest commit History 110 Commits
img		img
models		models
plots		plots
submit_scripts		submit_scripts
training_output		training_output
utils		utils
.gitignore		.gitignore
CMSC472_Final_Paper.pdf		CMSC472_Final_Paper.pdf
CMSC472_Final_Poster.pdf		CMSC472_Final_Poster.pdf
CMSC472_Project_Proposal.pdf		CMSC472_Project_Proposal.pdf
LICENSE		LICENSE
README.md		README.md
ViT_README.md		ViT_README.md
evaluation.ipynb		evaluation.ipynb
imagenet_test.ipynb		imagenet_test.ipynb
imagenet_zeroshot.ipynb		imagenet_zeroshot.ipynb
n_bit_test.ipynb		n_bit_test.ipynb
plots.ipynb		plots.ipynb
requirements.txt		requirements.txt
train.sh		train.sh
train_158_bit.py		train_158_bit.py
train_1_bit.py		train_1_bit.py
train_full_precision.py		train_full_precision.py
train_n_bit.py		train_n_bit.py
visualize_attention_map.ipynb		visualize_attention_map.ipynb