Thanks to visit codestin.com
Credit goes to github.com

Skip to content
View mathispink's full-sized avatar

Highlights

  • Pro

Block or report mathispink

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don't include any personal information such as legal names or email addresses. Markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Pinned Loading

  1. attention-saver attention-saver Public

    Attention Saver lets you extract entire attention matrices or row-wise statistics (e.g. entropy) from any HuggingFace causal LLM layer for ultra-long context when using flash-attention without runn…

    Python

  2. BatchEntropyRegularization BatchEntropyRegularization Public

    A Tensorflow implementation of Batch Entropy Regularization (Peer et al 2022).

    Python