Popular repositories Loading
-
heinsen_routing
heinsen_routing PublicReference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All Domains" (Heinsen, 2019), for composing deep neural networks.
-
heinsen_sequence
heinsen_sequence PublicCode implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)
-
sata_attention
sata_attention PublicReference implementation of "Self-Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation" (Heinsen and Kozachkov, 2026)
-
heinsen_attention
heinsen_attention PublicReference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
-
torch_parallel_scan
torch_parallel_scan PublicSimple and fast parallel scan over sequences of tensors, with any binary associative function you specify, for PyTorch (Franz A. Heinsen, 2024)
Repositories
- sata_attention Public
Reference implementation of "Self-Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation" (Heinsen and Kozachkov, 2026)
glassroom/sata_attention’s past year of commit activity - selective_resetting Public archive
Reference implementation of selective resetting for parallel prefix scans, as proposed in "Generalized Orders of Magnitude for Scalable, Parallel, High-Dynamic-Range Computation" (Heinsen and Kozachkov, 2025).
glassroom/selective_resetting’s past year of commit activity - goom_ssm_rnn Public archive
Reference implementation of the deep RNN described in "Generalized Orders of Magnitude for Scalable, Parallel, High-Dynamic-Range Computation" (Heinsen and Kozachkov, 2025).
glassroom/goom_ssm_rnn’s past year of commit activity - parallel_lyapunov_exponents Public archive
Reference implementation of parallel methods for estimating Lyapunov exponents, orders-of-magnitude faster than with previous methods, as proposed in "Generalized Orders of Magnitude for Scalable, Parallel, High-Dynamic-Range Computation" (Heinsen and Kozachkov, 2025).
glassroom/parallel_lyapunov_exponents’s past year of commit activity - generalized_orders_of_magnitude Public archive
Reference implementation of generalized orders of magnitude, as proposed in "Generalized Orders of Magnitude for Scalable, Parallel, High-Dynamic-Range Computation" (Heinsen and Kozachkov, 2025).
glassroom/generalized_orders_of_magnitude’s past year of commit activity - torch_parallel_scan Public
Simple and fast parallel scan over sequences of tensors, with any binary associative function you specify, for PyTorch (Franz A. Heinsen, 2024)
glassroom/torch_parallel_scan’s past year of commit activity - heinsen_sequence Public
Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)
glassroom/heinsen_sequence’s past year of commit activity - heinsen_position_embeddings Public
Reference implementation of "Encoding Position by Decaying and Updating Different Exponentiated States Differently," as proposed by Franz A. Heinsen in March 2024
glassroom/heinsen_position_embeddings’s past year of commit activity - heinsen_attention Public
Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
glassroom/heinsen_attention’s past year of commit activity - heinsen_routing_2022_paper Public archive
Instructions for replicating the results in "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022).
glassroom/heinsen_routing_2022_paper’s past year of commit activity
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…