Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF
SC117/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF
- 作者
- SC117
- 任务
- 多模态
- 下载量
- 3,487,734
- 点赞数
- 650
- 趋势分
- 139
- 许可证
- apache-2.0
- 收录时间
- 2026/11/4
base_model: ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF base_model_relation: quantized license: apache-2.0 library_name: gguf pipeline_tag: image-text-to-text language:
- en
- zh tags:
- gguf
- llama-cpp
- abliterated
- uncensored
- quantization
- tensor-transplant
- gsq
- rco
- moe
- mixture-of-experts
- qwen3.8
- flash-next
- long-context
- reasoning
- red-teaming
llama-mtmd-cli -m IQ3_S/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-IQ3_S-00001-of-00002.gguf
--mmproj mmproj-Qwen3.8-Flash-Next-BF16.gguf -lm mmap --lazy-mode on
--image photo.jpg -p "Describe this image."Speculative decoding with the MTP draft headllama-cli -m IQ3_S/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-IQ3_S-00001-of-00002.gguf
-md mtp-Qwen3.8-Flash-Next-Q4_0.gguf --draft-max 4 -lm mmap --lazy-mode on -ngl 99-lm mmap --lazy-mode on keeps the n-gram table memory-mapped on disk: it is 28.8 GB and one row is read per token. Shard 1 wants to be resident (VRAM or RAM); shard 2 is fine on an SSD. The vision projector is a standard clip GGUF shared with the upstream tiers, 0.91 GB. Native context is 262,144 tokens and the KV cache grows with it, so start at -c 32768 and work up.
内容来源：Hugging Face 模型卡
在 Hugging Face 查看