Stars
Pixio: a capable vision encoder dedicated to dense prediction, simply by pixel reconstruction
NeurIPS 2025 Spotlight; ICLR2024 Spotlight; CVPR 2024; EMNLP 2024
An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up processing, and attention (consensus between columns), for emerg…
Fully featured implementation of Routing Transformer
Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
PyTorch implemented C3D, R3D, R2Plus1D models for video activity recognition.
Vector (and Scalar) Quantization, in Pytorch
PyTorch package for the discrete VAE used for DALL·E.
Vision Transformer (ViT) in PyTorch
Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)
Learning Spatiotemporal Features via Video and Text Pair Discrimination
Visualizing the sum of all human knowledge
An implementation of Performer, a linear attention-based transformer, in Pytorch
An implementation of local windowed attention for language modeling
Implementation of Bottleneck Transformer in Pytorch
Implementation of Pixel-level Contrastive Learning, proposed in the paper "Propagate Yourself", in Pytorch
Implementation of the Point Transformer layer, in Pytorch
Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification
Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch
Implementation of Nyström Self-attention, from the paper Nyströmformer
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch