Skip to content

Commit 43c94fe

Browse files
committed
Bencharmk update
1 parent b1e064f commit 43c94fe

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

scripts/run_benchmark.sh

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -153,9 +153,11 @@ experiment_spec = ExperimentSpec(
153153
experiment = b.experiment.create(spec=experiment_spec, workspace="ai2/olmocr")
154154
print(f"Created benchmark experiment: {experiment.id}")
155155
print(f"View at: https://beaker.org/ex/{experiment.id}")
156+
print("-------")
157+
print("")
156158
157159
# Second experiment: Performance test job
158-
perf_pipeline_cmd = "python -m olmocr.pipeline ./localworkspace --markdown --pdfs s3://ai2-oe-data/jakep/olmocr/olmOCR-mix-0225/benchmark_set/"
160+
perf_pipeline_cmd = "python -m olmocr.pipeline ./localworkspace --markdown --pdfs s3://ai2-oe-data/jakep/olmocr/olmOCR-mix-0225/benchmark_set/*.pdf"
159161
if model:
160162
perf_pipeline_cmd += f" --model {model}"
161163

0 commit comments

Comments
 (0)