Axion-1.0-35B

Axion1-0/Axion-1.0-35B

作者
Axion1-0
任务
多模态
下载量
33
点赞数
35
趋势分
35
许可证
apache-2.0
收录时间
2026/11/5

license: apache-2.0 library_name: transformers pipeline_tag: text-generation datasets:

  • Axion1-0/axion-training-data tags:
  • reproduction
  • agent
  • tool-use
  • scientific-reasoning
  • moe
  • arxiv:2611.03233

Axion 1.0-35B — Reproduction

Paper · Project · Code · Training Data

This repository provides a reproduction checkpoint of Axion 1.0-35B, following the recipe described in Axion 1.0: Open Agent Foundation Models, Simplified. The model is designed for scientific reasoning, information seeking, and tool-augmented problem solving.

Model Overview

PropertyDetails
ModelAxion 1.0-35B
ReleaseReproduction checkpoint
ArchitectureMixture of Experts (MoE)
ParametersApproximately 35B total, 3B active
Weight precisionBF16

The training recipe combines approximately 18K SFT examples with three stages:

  1. Learn to reason: supervised fine-tuning on challenging, self-contained scientific problems constructed with model-aware feedback.
  2. Learn to investigate: supervised fine-tuning on verifiable tasks requiring external information and tool use.
  3. Learn through interaction: reinforcement learning over agent trajectories to refine reasoning and interaction with tools.

Performance

The table compares paper-reported results with the results of the reproduction checkpoint released in this repository. All scores are percentages; higher is better.

ModelHLEBMBSEAL‑0HiPhOFS OlympiadFS Research
Agents-A147.6—56.446.479.040.0
Kimi-K2.654.0—50.541.173.017.9
DeepSeek-V4-Pro (Preview)48.2—55.038.776.013.3
Apodex 1.1 (ReAct)53.223.5———55.0
Apodex 1.1 (Agent Team)56.135.3———63.3
GPT-5.552.2—42.343.378.026.7
GPT-5.6 Sol—47.153.242.979.063.3
GPT-6 Astra57.2—————
Muse-Spark-1.058.0————38.0
Gemini 3.1 Pro51.435.353.238.585.026.7
Claude Opus 563.649.4————
Claude Fable 563.846.1————
Axion 1.0-35B (Paper)52.235.362.245.786.056.7
Axion 1.0-35B (Reproduction)52.835.360.445.985.055.0

HLE denotes the full Humanity's Last Exam benchmark; BMB uses the human-difficult BioMysteryBench subset. FS denotes FrontierScience. A dash indicates an unreported result. Bold highlights the reproduction checkpoint released in this repository.

Usage

Following the repository's inference guide, serve the released checkpoint with vLLM:

vllm serve Axion1-0/Axion-1.0-35B \
  --served-model-name axion-35b \
  --host 127.0.0.1 --port 8000 \
  --tensor-parallel-size 8 --dtype bfloat16 \
  --max-model-len 131072 \
  --reasoning-parser qwen3 \
  --enable-auto-tool-choice --tool-call-parser qwen3_coder

This example uses eight GPUs. Adjust tensor parallelism and context capacity to fit your GPU memory.

Call the OpenAI-compatible endpoint:

curl --fail-with-body http://127.0.0.1:8000/v1/chat/completions \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "axion-35b",
    "messages": [
      {"role": "user", "content": "What is 2 + 3?"}
    ],
    "max_tokens": 1024
  }'

Tool-using agent evaluation additionally requires a harness that executes tool calls. See the inference guide for details.

License

This model is released under the Apache License 2.0. See LICENSE for details.

Citation

@misc{jia2026axion,
  title         = {Axion 1.0: Open Agent Foundation Models, Simplified},
  author        = {Yuqi Jia and Yunjie Tian and Jiayu Zheng and Yijun Liang and Jingchen Sun and Mengyu Zhao and Di Fu},
  year          = {2026},
  eprint        = {2611.03233},
  archivePrefix = {arXiv},
  primaryClass  = {cs.AI},
  url           = {https://arxiv.org/abs/2611.03233}
}

内容来源:Hugging Face 模型卡

在 Hugging Face 查看