Skip to content

Commit 04cfb78

Browse files
fix
Signed-off-by: Brian Dellabetta <[email protected]>
1 parent a8c6982 commit 04cfb78

File tree

3 files changed

+3
-3
lines changed

3 files changed

+3
-3
lines changed

tests/lmeval/configs/vl_fp8_dynamic_per_token.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,4 +14,4 @@ lmeval:
1414
batch_size: 8
1515
# dense model achieves 0.9 accuracy
1616
metrics:
17-
acc,none: 0.8333
17+
acc,none: 0.8667

tests/lmeval/configs/vl_w4a16_actorder_weight.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,6 +15,6 @@ lmeval:
1515
num_fewshot: 0
1616
use_stderr_atol: True
1717
batch_size: 8
18-
# dense model achieves 0.9 accuracy with stderr .0557
18+
# dense model achieves 0.9
1919
metrics:
20-
acc,none: 0.8667
20+
acc,none: 0.8333

0 commit comments

Comments
 (0)