personal-agentPOST
在 12GB 以下硬件上找个人助理大脑
作者吐槽小显存 1-bit 量化模型只能当聊天机器人,正在下载 Qwen 27B 蒸馏版继续寻找能跑本地个人助理的模型。
GooGZ AI
@PaulGugAI13 天前收录原推发布于 2026.10.14
GooGZ AI @PaulGugAI原推发布于 2026.10.14
I'm yet to see a 1-bit quant (for the sub 12GB range) worth its salt for anything more than a chatbot, and 0xSero's previous 1-bit recommendations (like original Bonsai 1-bit prior) were underwhelming. But.. I appreciate the updated listings, and I'll never turn down an interesting new Qwen 27B distillation for testing. My search for the ultimate personal agent brain (on sub 12GB hardware) continues... Underdog Saluki 27B 1.0, now downloading...
这条是引用着另一条写的:「按显存分档的本地模型推荐清单」
x.com/paulgugai/status/2110238167911809275采集于 2026.10.15 10:57