MiCEval: Unveiling Multimodal Chain of Thought's Quality via Image Description and Reasoning

The MiCEval dataset is stored in dataset/MiCEval_hard.jsonl and dataset/MiCEval_Normal.jsonl.

The images of the MiCEval dataset are stored in the dataset/image folder.

To reproduce the results of the verifier experiment, please run scripts/verifier_zeroshot.sh and scripts/verifier_fewshot.sh.

The code for the evaluator experiment will be updated soon.

Name		Name	Last commit message	Last commit date
Latest commit History 11 Commits
dataset		dataset
scripts		scripts
README.md		README.md
eval.py		eval.py
help_function.py		help_function.py
model_eval.py		model_eval.py

Provide feedback