Reasonzoo

[epsilondylan]

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily get feedback. If you do not understand some items, don't worry, just make the pull request and seek help from maintainers.

Motivation

This PR integrates ReasonZoo, a comprehensive benchmark for evaluating reasoning capabilities in large language models. ReasonZoo provides standardized evaluation across multiple reasoning tasks with various prompting strategies, enabling more thorough assessment of models' logical reasoning, mathematical problem-solving, and inference abilities.
For more information, please check https://huggingface.co/datasets/opencompass/ReasonZoo

Modification

The PR adds:

• Complete ReasonZoo dataset implementation with evaluation utilities
• Multiple evaluation configurations (0-shot, LLM judge, generic LLM eval)
• Dataset registration in OpenCompass index
• Example script for running ReasonZoo evaluations
• Support for both rule-based and LLM-based judging methodologies

The implementation follows OpenCompass's modular design patterns and integrates seamlessly with existing evaluation workflows while providing specialized evaluation metrics for reasoning tasks.

Checklist

Before PR:

• [√] Pre-commit or other linting tools are used to fix the potential lint issues.
• [√] Bug fixes are fully covered by unit tests, the case that causes the bug should be added in the unit tests.
• [√] The modification is covered by complete unit tests. If not, please add more unit test to ensure the correctness.
• [√] The documentation has been modified accordingly, like docstring or example tutorials.

After PR:

• If the modification has potential influence on downstream or other related projects, this PR should be tested with those projects.
• CLA has been signed and all committers have signed the CLA in this PR.