Skip to content

Whisper Model moved to CoreML #9

@scosman

Description

@scosman

CPU usage is quite high on current whisper model. It's functional for evaluation, but the battery usage isn't shipable. Moving the model to CoreML would help a ton, offloading work from CPU and improving efficiency. Accelerate framework is using GPU/ATX/SIMD but not ANE.

This project has some work, but doesn't appear complete: https://github.com/vade/OpenAI-Whisper-CoreML

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions