Repository navigation
Replies: 1 comment
|
以量化模型为例:如果你不在意速度,那就主要看你的内存能不能装下量化的模型,7B需要5G+,13B需要9G+可用内存。 |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
最低可用的性能要求是多少?
All reactions