Skip to content

Add performance testing to llm_relay #75

@PaliC

Description

@PaliC

On top of testing for correctness (as we do here . We should also add a test for performance. This ends up being important (and likely expanded on) as once we get a correct kernel it is very important to make the kernel faster as well. Currently, correctness should be saturated (as all pytorch kernels are in an llms training data), however, performance is not, and it is really what we care about.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions