Skip to content

Can I use the smaller docker images for evaluating SWE-Bench provided by Epoch AI? #10568

@XuanofXXX

Description

@XuanofXXX

Too Big to use official images for evaluating
I found an article which tells the smaller docker images for evaluating SWE-Bench. How can I use it? Are there some env variables can I use or any other approaches?

By the way, the name of official images is different from EpochAI images. Is that matters?
like:

official: swebench/sweb.eval.x86_64.astropy_1776_astropy-12907:latest
epoch ai: ghcr.io/epoch-research/swe-bench.eval.x86_64.astropy__astropy-12907:latest

Thanks for answering!!!

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions