Skip to content

ranpox/openreview-visualization

Repository files navigation

OpenReview Visualization

This repository contains tools for downloading, parsing, and visualizing OpenReview submission data for various academic conferences, including ICLR 2024 and ICLR 2025. The data is downloaded using the OpenReview API.

Supported Conferences

Conference Nomic Visualization Gradio Review Table Word Cloud
ICLR 2025 Link
ICLR 2024 Link Link Link

Data

For each supported conference, we provide the following data:

  • Raw paper list data (JSON format)
  • Raw paper reviews data (JSONL format)
  • Parsed paper data (CSV format) containing:
    • ID
    • Title
    • Abstract
    • Primary area
    • Keywords
    • TLDR
  • Parsed review data (CSV format) containing:
    • ID
    • Title
    • Average Score
    • Standard Deviation
    • Individual Scores

Visualizations

Interactive Visualization

Explore submissions using an interactive visualization powered by Nomic Atlas:

ICLR 2024 Visualization ICLR 2025 Visualization

ICLR 2024 Submissions

Rating Table

We provide a Gradio demo for exploring the rating table of submissions:

ICLR 2024 Rating Table

Gradio Demo

Statistical Visualizations

For each conference, we generate:

  • Average Score Distribution
  • Average Score Cumulative Distribution
  • Top 50 Keywords Bar Chart
  • Top 50 Keywords Word Cloud

Example visualizations:

Average Score Distribution Top 50 Keywords Word Cloud

Usage

Install

pip install -e .

Download Data

python scripts/download_papers.py

Generate Word Cloud

python scripts/visualize_wordcloud.py

Generate Nomic Atlas Visualization

python scripts/visualize_nomic.py

About

OpenReivew Submission Visualization (ICLR 2024/2025)

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages