Unsloth 发布 Qwen3.8-27B 的 Dynamic GGUF 量化版本,4-bit 量化可在 17-19GB 内存设备上本地运行,并同时上传 NVFP4 量化。
原文给出了本地运行的具体内存门槛、量化版本和硬件对照表,读者可以据此判断能否在自己的设备上跑通这个 27B 模型。
Qwen3.8-27B 现在可以在本地运行了!✨
通过 Unsloth Dynamic GGUF,可在 17GB RAM 上运行。
Qwen3.8-27B 是迄今为止同规模中最强的模型。我们还上传了 NVFP4 量化版本。
GGUF:https://huggingface.co/unsloth/Qwen3.8-27B-GGUF
指南:https://unsloth.ai/docs/models/qwen3.8
我们承诺过开源 Qwen3.8 的模型权重。现在,是时候见面了!🎉 ⚡ Qwen3.8-27B: - 一款原生多模态稠密模型。仅凭 27B 参数,综合表现超越 Qwen3.7-Plus,在真实世界的编码与办公工作流中尤为亮眼。 - 原生支持 262K 上下文,可通过 YaRN 轻松扩展至 1M tokens。 - 为开发者而生。高效、高质量,并采用 Apache 2.0 许可证。 🚀 Qwen3.8-2.4T-A95B(Max 级别)的开放权重也已于近日发布。 无论你是想用 Qwen3.8-27B 在本地部署轻量级应用,还是用 Qwen3.8-2.4T-A95B 构建智能体,它们现在都属于你了! 下载、部署,去构建我们尚未想象到的东西吧。👀👇 - Hugging Face: https://huggingface.co/collections/Qwen/qwen38 - ModelScope: https://www.modelscope.cn/collections/Qwen/Qwen38
原文
We promised open weights for Qwen3.8. Now, time to meet them! 🎉 ⚡ Qwen3.8-27B: - A native multimodal dense model. With just 27B parameters, it outperforms Qwen3.7-Plus overall and shines in real-world coding & office workflows. - 262K native context, easily extendable to 1M tokens via YaRN. - Built for builders. Highly efficient, high-quality, and licensed under Apache 2.0. 🚀 The open weights for Qwen3.8-2.4T-A95B (Max-level) have also been released recently. Whether you're shipping lightweight applications with Qwen3.8-27B locally or building agents with Qwen3.8-2.4T-A95B, they're yours now! Download, deploy, and build something we haven't imagined yet. 👀👇 - Hugging Face: https://huggingface.co/collections/Qwen/qwen38 - ModelScope: https://www.modelscope.cn/collections/Qwen/Qwen38
来源:Unsloth AI · x.com