Search results

Question: Does R-KV support KV compression during the prefill stage?

Status: Open.

#21 In Zefan-Cai/R-KV;

· ZeitHaum opened on Oct 27, 2025

Only support batch size = 1?

Status: Open.

#20 In Zefan-Cai/R-KV;

· LiaoMengqi opened on Oct 21, 2025

R-KV sampling

Status: Open.

#19 In Zefan-Cai/R-KV;

· aldinash opened on Oct 16, 2025

A questionable definition of compression ratio

Status: Open.

#16 In Zefan-Cai/R-KV;

· anonymous23151 opened on Sep 12, 2025

Repeated generation issues when using R-KV and SnapKV.

Status: Open.

#14 In Zefan-Cai/R-KV;

· DW934 opened on Aug 21, 2025

Question about attention computation

Status: Open.

#13 In Zefan-Cai/R-KV;

· 1190303125 opened on Aug 18, 2025

It's very difficult to set an appropriate budget

Status: Open.

#11 In Zefan-Cai/R-KV;

· dingjingzhen opened on Aug 14, 2025

Some naive tests show an unexpected result

Status: Open.

#10 In Zefan-Cai/R-KV;

· Foxyrep opened on Jul 25, 2025

a single request test did not accelerate

Status: Open.

#8 In Zefan-Cai/R-KV;

· dingjingzhen opened on Jul 17, 2025

Experiment setup and reproduce

Status: Open.

#7 In Zefan-Cai/R-KV;

· DestroyGPU opened on Jul 16, 2025

Question about experimental setup

Status: Open.

#5 In Zefan-Cai/R-KV;

· JulietChoo opened on Jul 2, 2025

Can I use VLLM with this method?

Status: Open.

#3 In Zefan-Cai/R-KV;

· hidinginthebush opened on Jun 18, 2025