DeepSeek-V4.1-Flash-1017-GGUF

unsloth/DeepSeek-V4.1-Flash-1017-GGUF

作者
unsloth
任务
多模态
下载量
596,039
点赞数
327
趋势分
157
许可证
mit
收录时间
2026/11/4

license: mit pipeline_tag: image-text-to-text base_model:

  • deepseek-ai/DeepSeek-V4.1-Flash-1017 tags:
  • deepseek
  • deepseek_v41
  • unsloth

Read our How to Run DeepSeek-V4.1 Flash Guide!

Quantization analysis, KLD plots and other analysis is here. To swap the engram (MXFP8 to Q6_K / Q5_K / IQ4_NL, see this guide)


DeepSeek-V4.1-Flash-1017

Introduction

DeepSeek-V4.1-Flash-1017 is a minor update to DeepSeek-V4.1-Flash, delivering substantial improvements across reasoning, coding, agentic tasks, and visual benchmarks. Alongside these gains, the model reduces task execution time and output length, enabling users to complete tasks faster and at lower cost and advancing the performance–cost Pareto frontier across multiple agent harnesses.

BenchmarkDS-V4.1-Flash-1017DS-V4.1-FlashK3GLM-5.3GPT-5.6 SolOpus 5
HLE w/o tools42.6 (44.0†)36.8 (39.1†)43.542.0†44.556.3
Terminal-Bench 4.042.331.212.637.939.951.8
DeepSWE v1.177.074.267.566.973.074.0
ProgramBench29.120.317.519.023.037.0
NL2Repo-Bench68.265.458.058.056.875.3
Automation-Bench v1.0.660.554.846.748.845.850.3
Agents’ Last Exam35.431.827.628.526.728.6
Apex Bench v1.172.164.647.856.654.365.8
Chartography (w/tools)83.078.968.1—79.984.0
BabyVision (w/tools)92.589.685.7—88.994.1
ZeroBench-main (w/tools)51.049.041.0—53.052.0

† denotes the text-only subset of HLE. We use the Claude Code harness for Terminal-Bench 4.0 and the Mini-SWE-V2 harness for DeepSWE v1.1.

Prompt Encoding

This release does not include a Jinja-format chat template. The encoding folder contains a self-contained Python reference implementation (encoding.py) with test cases for multi-turn conversations, tool calling, thinking mode, numeric reasoning effort, mid-conversation system messages, and interleaved image content.

For production use, we additionally release deepseek-recipe, a set of Rust libraries with Python bindings that provides the same prompt format as a maintained, protocol-aware toolkit. It converts Messages, Chat Completions, and Responses API requests into the Conversation format, encodes them into DeepSeek V4 and V4.1 prompts or token IDs, and parses model output back into complete or streamed responses — covering thinking, tool calls, images, and generation settings. Model inference, tool execution, and HTTP transport are left to the caller.

Minimal Inference

Please refer to the inference folder for instructions on weight conversion and running inference locally.

Recommended sampling parameters:

ParameterValue
temperature1.0
top_p1.0
context_window1M tokens
max_tokens≥ 256K

License

This repository and the model weights are licensed under the MIT License.

Citation

@misc{deepseekai2026deepseekv41flash,
      title={DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression},
      author={DeepSeek-AI},
      year={2026},
}

Contact

If you have any questions, please raise an issue or contact us at service@deepseek.com.

内容来源:Hugging Face 模型卡

在 Hugging Face 查看