Skip to content

name 'position_ids' is not defined #16

@LMX-xin

Description

@LMX-xin

when I run Baichuan2-7B-base model ,meet the issue that "position_ids" is not defined. And I checked the code and did not find the declaration of position_ids in the code

pt-p26l37d2-worker-0 logs:    File ''/root/home/AutoSmoothQuant/autosmoothquant/models/baichuan.py", line 146, in forward
pt-p26l37d2-worker-0 logs:     query_states, key_states = apply_rotary_pos_emb(query_states, key_states, cos, sin, position_ids)
pt-p26l37d2-worker-0 logs: NameError: name 'position_ids' is not defined

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions