Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[Feature]: Mega MOE v1: dispatch + gemm1, gemm2 + combine #626

@coderfeli

Description

@coderfeli

Suggestion Description

Fuse into ~3 kernels: dispatch + gemm1, gemm2 + combine

Operating System

No response

GPU

No response

ROCm Component

No response

Metadata

Metadata

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions