Skip to content

Commit 9fd5e6b

Browse files
authored
[deepspeed] fix typo, adjust config name (#16597)
1 parent 367558b commit 9fd5e6b

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/transformers/deepspeed.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -250,7 +250,7 @@ def trainer_config_process(self, args):
250250
self.fill_match("bf16.enabled", (args.bf16 or args.bf16_full_eval), "bf16|bf16_full_eval")
251251

252252
# deepspeed's default mode is fp16 unless there is a config that says differently
253-
if self.is_true("bfoat16.enabled"):
253+
if self.is_true("bf16.enabled"):
254254
self._dtype = torch.bfloat16
255255
elif self.is_false("fp16.enabled"):
256256
self._dtype = torch.float32

0 commit comments

Comments
 (0)