Skip to content

Benchmarks should expose their options #31083

@BridgeAR

Description

@BridgeAR

Our benchmark files currently have no way to print the return the possible options to the user. If we'd implement such feature, we would not have to worry about our benchmark tests anymore that they might fail due to changes in any benchmark options. We could just go ahead and read the benchmarks specific options first and then run the test with the specific subset of options that are suitable.

I opened this issue as a kind of feature request in case someone else would like to open a PR to implement this and also to get feedback from others about it.

// cc @Trott I guess you might be interested in something like this.

Metadata

Metadata

Assignees

No one assigned

    Labels

    benchmarkIssues and PRs related to the benchmark subsystem.testIssues and PRs related to the tests.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions