Skip to content

Commit da5f8f2

Browse files
committed
wsd config
1 parent 336b000 commit da5f8f2

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

olmocr/train/configs/qwen25_vl_b100_x1_day3_json_wsd.yaml

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22

33
# Project metadata
44
project_name: olmocr-qwen-vl-training
5-
run_name: qwen2.5-vl-7b-finetune-day3-json
5+
run_name: qwen2.5-vl-7b-finetune-day3-json-wsd
66

77
# Model configuration
88
model:
@@ -74,7 +74,8 @@ training:
7474
learning_rate: 2e-5
7575
lr_scheduler_type: warmup_stable_decay
7676
lr_scheduler_kwargs:
77-
num_stable_steps: 4000
77+
num_warmup_steps: 1000
78+
num_decay_steps: 2000
7879
warmup_ratio: 0.1
7980

8081
# Optimization

0 commit comments

Comments
 (0)