Thanks to visit codestin.com
Credit goes to github.com

Skip to content

quant_analysis.py未适配最新代码,import失败 #439

@sweetlove12

Description

@sweetlove12

问题描述

tools/quant_analysis.py未适配最新代码,import不到BaseTokenizer等包。

执行的代码或指令

python /llmc/tools/quant_analysis.py \
  --dataset_name wikitext2 \
  --data_path /data/wikitext2 \
  --model_type Qwen2VL \
  --model_path /qwenVL/qwen2.5-VL-3B-Instruct \
  --t_model_path /qwenVL/qwen2.5-VL-3B-Instruct-AWQ \
  --wbit 4 --abit 16 \
  --wgra per_channel --agra per_token \
  --prof_gra per_channel \
  --save_path /outliers/outlier_analysis \
  --log_dir /outliers/outlier_qwen.log \
  --draw

运行环境

  • 操作系统:Linux
  • Python版本:3.10

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions