Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[BUG] Autotune failed in tilelang==0.1.7 #69

@RMLYC

Description

@RMLYC

The test_autotune test fails due to tilelang version upgrade.

Traceback (most recent call last):
  File "/home/lyc/Project/TileOPs/tests/test_autotune.py", line 25, in <module>
    test_mha_kernel_autotune(args.batch, args.seq_len, args.heads, args.dim, args.causal,
  File "/home/lyc/Project/TileOPs/tests/test_autotune.py", line 8, in test_mha_kernel_autotune
    op = mha_fwd(B, H, S, D, causal, dtype, tune=True)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/lyc/Project/TileOPs/top/ops/mha.py", line 33, in __init__
    self.kernel = self.kernel_map["mha_fwd_kernel"](
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/lyc/Project/TileOPs/top/kernels/flash_attn/fwd.py", line 365, in __init__
    self.init_config(config, tune)
  File "/home/lyc/Project/TileOPs/top/kernels/kernel.py", line 24, in init_config
    self.autotune()
  File "/home/lyc/Project/TileOPs/top/kernels/kernel.py", line 63, in autotune
    tuned_kernel = autotuned_kernel_fn()
                   ^^^^^^^^^^^^^^^^^^^^^
  File "/home/lyc/miniconda3/envs/tileops-release/lib/python3.11/site-packages/tilelang/autotuner/tuner.py", line 680, in __call__
    artifact = autotuner.run()
               ^^^^^^^^^^^^^^^
  File "/home/lyc/miniconda3/envs/tileops-release/lib/python3.11/site-packages/tilelang/autotuner/tuner.py", line 318, in run
    assert isinstance(cell.cell_contents, (int, float, str, bool, type(None))), \
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Cell contents [8, 1024, 32, 128] is not serializable: <class 'list'>

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions