-
Notifications
You must be signed in to change notification settings - Fork 9
Open
Description
when I run Baichuan2-7B-base model ,meet the issue that "position_ids" is not defined. And I checked the code and did not find the declaration of position_ids in the code
pt-p26l37d2-worker-0 logs: File ''/root/home/AutoSmoothQuant/autosmoothquant/models/baichuan.py", line 146, in forward
pt-p26l37d2-worker-0 logs: query_states, key_states = apply_rotary_pos_emb(query_states, key_states, cos, sin, position_ids)
pt-p26l37d2-worker-0 logs: NameError: name 'position_ids' is not defined
Metadata
Metadata
Assignees
Labels
No labels