Skip to content

Commit 329954f

Browse files
authored
Merge pull request #1 from ROCmSoftwarePlatform/vllm_dllehr_graphx
Fix graph typo
2 parents dad4220 + dad1cca commit 329954f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/models/llama.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -178,7 +178,7 @@ def forward(
178178
attn_output = self.attn(positions, q, k, v, k_cache, v_cache,
179179
input_metadata, cache_event)
180180
if input_metadata.num_generation_tokens > 0:
181-
output, _ = self.o_proj(attn_output, grpahx=self.graphx)#,call_hipblaslt=hacks.get('decode_oproj_call_hipblaslt',0),
181+
output, _ = self.o_proj(attn_output, graphx=self.graphx)#,call_hipblaslt=hacks.get('decode_oproj_call_hipblaslt',0),
182182
#splitm=hacks.get('decode_oproj_splitm',1),
183183
#splitk=hacks.get('decode_oproj_splitk',1),
184184
#splits=hacks.get('decode_oproj_splits',None),

0 commit comments

Comments
 (0)