-
Notifications
You must be signed in to change notification settings - Fork 507
Open
Labels
questionFurther information is requestedFurther information is requested
Description
Required prerequisites
- I have read the documentation https://github.com/baichuan-inc/baichuan-7B/blob/HEAD/README.md.
- I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
- Consider asking first in a Discussion.
Questions
基于上述的几个优化技术,我们在千卡 A800 显卡上达到了 7B 模型 182 TFLOPS 的吞吐,GPU 峰值算力利用率高达 58.3%。
吞吐Throughput 应该指的是训练速度,eg. 3000 token/s/gpu
Checklist
- I have provided all relevant and necessary information above.
- I have chosen a suitable title for this issue.
Metadata
Metadata
Assignees
Labels
questionFurther information is requestedFurther information is requested