Could you come up with an inference method that saves video memory, such as multi-card parallelism or others? Currently, it requires 63G #52

Open

Open

Could you come up with an inference method that saves video memory, such as multi-card parallelism or others? Currently, it requires 63G#52

opened

可以出一个不用很多显存就能推理的方法吗～比如多卡并行或其他的

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests