Skip to content

Port precise kv-cache scorer code to inference-scheduler repo? #336

@elevran

Description

@elevran

move code packages solely used by the scorer to the inference-scheduler.

Metadata

Metadata

Assignees

Labels

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions