刚搜到的：If the 7B MistralMakise-Merged-13B-GGUF model is what you're after, you gotta think about hardware in two ways. First, for the GPTQ version, you'll want a decent GPU with at least 6GB VRAM. The GTX 1660 or 2060, AMD 5700 XT, or RTX 3050 or 3060 would all work nicely. But for the GGML / GGUF format, it's more about having enough RAM. You'll need around 4 gigs free to run that one smoothly.
Пікірлер: 5
Patreon已上线，欢迎加入：www.patreon.com/newtype_ai newtype是我创建的社群。之前开通了知识星球，面向国内小伙伴，已经运营三个月。现在有了Patreon，海外的小伙伴也可以加入讨论了。
KZread: huangyihe 微信视频号：黄益贺 视频是主要内容形式，文字来自视频脚本。 KZread是主阵地，国内平台不值得投入，顺手一发。 欢迎关注！
大佬，请问本地运行大模型（以Mistral 7B为例），对PC机器配置最低要求是多少？
@huanyihe777
6 ай бұрын
刚搜到的：If the 7B MistralMakise-Merged-13B-GGUF model is what you're after, you gotta think about hardware in two ways. First, for the GPTQ version, you'll want a decent GPU with at least 6GB VRAM. The GTX 1660 or 2060, AMD 5700 XT, or RTX 3050 or 3060 would all work nicely. But for the GGML / GGUF format, it's more about having enough RAM. You'll need around 4 gigs free to run that one smoothly.
@user-ey8ou5kb8q
6 ай бұрын
安卓可以跑这个大模型吗@@huanyihe777