Skip to content

Conversation

aman-17
Copy link
Member

@aman-17 aman-17 commented Sep 26, 2025

  1. Added DotsOCR results of olmOCR-bench.
Final Summary with 95% Confidence Intervals:
dotsocr              : Average Score: 69.3% ± 1.1% (average of per-JSONL scores)
    absent  : 79.6% average pass rate over 823 tests
    baseline: 97.7% average pass rate over 1403 tests
    math    : 65.8% average pass rate over 3385 tests
    order   : 65.6% average pass rate over 1061 tests
    present : 41.3% average pass rate over 721 tests
    table   : 84.8% average pass rate over 1020 tests
    Results by JSONL file:
        arxiv_math.jsonl              : 65.2% (1909/2927 tests)
        baseline                      : 97.8% (1363/1394 tests)
        headers_footers.jsonl         : 79.5% (604/760 tests)
        long_tiny_text.jsonl          : 46.2% (204/442 tests)
        multi_column.jsonl            : 72.9% (644/884 tests)
        old_scans.jsonl               : 38.6% (203/526 tests)
        old_scans_math.jsonl          : 69.7% (319/458 tests)
        table_tests.jsonl             : 84.8% (867/1022 tests)

@aman-17 aman-17 self-assigned this Sep 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant