Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 28, 2025

• update readme to direct to the new repo. (#162)

  Show description for 1abaa17
  

  haruhi55

  and

  lcy.seso

  authored
  1abaa17

  Copy full SHA for 1abaa17

Commits on Nov 18, 2024

• re-implement shared tile iterator. (#159)

  haruhi55

  authored
  8e72632

  Copy full SHA for 8e72632

Commits on Nov 13, 2024

• fix(cell): Delete unnecessary codes. (#157)

  haruhi55

  authored
  5e20c32

  Copy full SHA for 5e20c32

Commits on Nov 7, 2024

• feat(bench): Add benchmark between tiledcuda and cublas in fused gemm. (#154)

  Show description for 62cfc6a
  KuangjuX

  authored
  62cfc6a

  Copy full SHA for 62cfc6a

Commits on Nov 5, 2024

• refactor(cell): re-implement how data is stored on shared memory to avoid bank conflicts. (#152)

  Show description for 50d5a4d
  

  haruhi55

  and

  KuangjuX

  authored
  50d5a4d

  Copy full SHA for 50d5a4d

Commits on Oct 15, 2024

• fix(examples): bug fix for timing GEMM. (#151)

  haruhi55

  authored
  21c813d

  Copy full SHA for 21c813d

Commits on Oct 9, 2024

• fix(cell): store row-major tiles to shared memory without bank-conflicts. (#149)

  Show description for 60e71a0
  haruhi55

  authored
  60e71a0

  Copy full SHA for 60e71a0

Commits on Oct 4, 2024

• chore: minor refinement of the codes. (#148)

  haruhi55

  authored
  b3409eb

  Copy full SHA for b3409eb

Commits on Oct 2, 2024

• feat(examples): An example of GEMM leveraging CUDA's three memory hierarchies. (#147)

  Show description for 65dbc9c
  haruhi55

  authored
  65dbc9c

  Copy full SHA for 65dbc9c

Commits on Oct 1, 2024

• fix(scripts): if glog is not installed locally, build it from source. (#146)

  Show description for aa60719
  haruhi55

  authored
  aa60719

  Copy full SHA for aa60719

Commits on Sep 30, 2024

• fix(cell): Reduce bank conflicts when accessing shared memory tiles with float data type (#145)

  Show description for 13e789a
  haruhi55

  authored
  13e789a

  Copy full SHA for 13e789a

Commits on Sep 24, 2024

• feat(cell): Implement shared to global store for single precision floating point elements. (#138)

  Show description for af4ca2e
  haruhi55

  authored
  af4ca2e

  Copy full SHA for af4ca2e

• Minor refinement to code organization by placing the kernel in a separate file. (#143)

  haruhi55

  authored
  7dd8928

  Copy full SHA for 7dd8928

Commits on Sep 10, 2024

• refactor(cell): refactor the register to shared storer. (#137)

  Show description for 43de49e
  haruhi55

  authored
  43de49e

  Copy full SHA for 43de49e

Commits on Sep 6, 2024

• fix(examples): small bug fix. (#136)

  Show description for ff4e874
  haruhi55

  authored
  ff4e874

  Copy full SHA for ff4e874

• feat(examples): Add a python gemm example. (#135)

  Show description for 37fbcbb
  haruhi55

  authored
  37fbcbb

  Copy full SHA for 37fbcbb

Commits on Sep 2, 2024

• chore: Add `TiledFlashAttention` to improve usage and fix `CMakeLists` to add all examples automatically. (#132)

  Show description for e99074f
  KuangjuX

  authored
  e99074f

  Copy full SHA for e99074f

Commits on Sep 1, 2024

• Add Lastest News in README. (#131)

  Show description for 02275b2
  KuangjuX

  authored
  02275b2

  Copy full SHA for 02275b2

Commits on Aug 31, 2024

• feat(util): Add helper functions to print RegTile. (#130)

  Show description for 43789a1
  KuangjuX

  authored
  43789a1

  Copy full SHA for 43789a1

Commits on Aug 30, 2024

• feat(kernel): Add a pytorch bind for flashattention. (#128)

  Show description for cbb4d20
  KuangjuX

  authored
  cbb4d20

  Copy full SHA for cbb4d20

Commits on Aug 26, 2024

• fix(cell): bug fix for global to shared memory data loader. (#126)

  Show description for 7050dce
  haruhi55

  authored
  7050dce

  Copy full SHA for 7050dce

Commits on Aug 21, 2024

• feat(examples): Add the Host side implementation of FlashAttention and pass Single Traversel FlashAttention correctness in CUDA side. (#125)

  Show description for 3e3016a
  KuangjuX

  authored
  3e3016a

  Copy full SHA for 3e3016a

Commits on Aug 20, 2024

• feat(examples): Add a simple FlashAttention Implementation. (#123)

  Show description for 7751573
  KuangjuX

  authored
  7751573

  Copy full SHA for 7751573

Commits on Aug 16, 2024

• feat(examples): Improve the implementations of fused two gemms. (#124)

  Show description for 1fed207
  haruhi55

  authored
  1fed207

  Copy full SHA for 1fed207

Commits on Aug 13, 2024

• Add a Simple Back2Back GEMM example based on `BaseTile`. (#121)

  Show description for b28d585
  KuangjuX

  authored
  b28d585

  Copy full SHA for b28d585

• feat(cell): Implement swizzled column-major shared memory layout. (#119)

  Show description for e85482f
  haruhi55

  authored
  e85482f

  Copy full SHA for e85482f

Commits on Aug 11, 2024

• fix(cell): Make shared memory swizzling correctly work with TileIterator. (#115)

  Show description for c9144a9
  haruhi55

  authored
  c9144a9

  Copy full SHA for c9144a9

Commits on Aug 10, 2024

• fix(unittest): the gemm unittest. (#113)

  Show description for 3b661af
  haruhi55

  authored
  3b661af

  Copy full SHA for 3b661af

Commits on Aug 9, 2024

• debug fix for swizzled shared memory layout. (#112)

  haruhi55

  authored
  7ae9cf8

  Copy full SHA for 7ae9cf8

• feat(cell): Add related element-wise/unary/copy implementation for flash-attn(phase 2) (#111)

  Show description for 6e23bdc
  KuangjuX

  authored
  6e23bdc

  Copy full SHA for 6e23bdc

• refactor(cell): Refactor global to shared Tile transfer on basis of `BaseTile` (#110)

  Show description for 7e29514
  haruhi55

  authored
  7e29514

  Copy full SHA for 7e29514

Commits on Aug 8, 2024

• feat(cell): Add related element-wise/unary/copy implementation for flash-attn(phase 1) (#109)

  Show description for a66d683
  KuangjuX

  authored
  a66d683

  Copy full SHA for a66d683

• feat(cell): Add a simple `Broadcast` implementation between `RegTile` and reduce tile. (#108)

  Show description for 5c825e7
  KuangjuX

  authored
  5c825e7

  Copy full SHA for 5c825e7

Commits on Aug 2, 2024

• feat(cell): Add a Column-Major reduce implementation. (#105)

  Show description for 98e2cfe
  KuangjuX

  authored
  98e2cfe

  Copy full SHA for 98e2cfe

Commits on Aug 1, 2024

• feat(cell): Add a row major softmax implementation in a single warp. (#102)

  Show description for e0f47d6
  KuangjuX

  authored
  e0f47d6

  Copy full SHA for e0f47d6

Pagination

Previous

Next