fluid-speech-pro

FluidVoice-Labs/fluid-speech-pro

作者
FluidVoice-Labs
任务
语音识别
下载量
8,633
点赞数
12
趋势分
10
许可证
cc-by-4.0
收录时间
2026/11/14

license: cc-by-4.0 language:

  • en
  • bg
  • hr
  • cs
  • da
  • nl
  • et
  • fi
  • fr
  • de
  • el
  • hu
  • it
  • lv
  • lt
  • mt
  • pl
  • pt
  • ro
  • sk
  • sl
  • es
  • sv
  • ru
  • uk library_name: transformers pipeline_tag: automatic-speech-recognition base_model:
  • nvidia/parakeet-tdt-0.6b-v3
  • moondream/parakeet-ultra tags:
  • speech-recognition
  • automatic-speech-recognition
  • parakeet
  • tdt
  • fastconformer
  • transformers
  • nemo

🎙️ Fluid Speech Pro: Fast Multilingual Speech-to-Text

Model architecture | Model size | Language | License

Description

Fluid Speech Pro is a 0.63-billion-parameter speech recognition model for fast, accurate speech-to-text, from the team behind FluidVoice. It is built on NVIDIA's Parakeet TDT 0.6B v3 and keeps its 25 European languages. It detects the language on its own, with no prompt needed.

It is the #2 open model on the Open ASR Leaderboard, with a 6.06 average word error rate. It is the most accurate open model under 1B parameters, #2 among open models on noisy speech, and it runs at about 3,700× real time on one GPU.

This model is ready for commercial and non-commercial use.

Key features

  • Accurate: #2 open model on the Open ASR Leaderboard (6.06 average WER)
  • Best under 1B: 10% fewer errors than the next open model under 1B parameters
  • Strong in noise: #2 open model on URGENT 2024, the leaderboard's noisy-speech set (9.83 WER)
  • Fast: about 3,700× real time on one GPU, so an hour of audio takes about a second
  • Punctuation and capitalization included
  • Word- and segment-level timestamps (NeMo)
  • Clean mode (optional): edited text without repeated words and filler words (NeMo, ONNX and MLX)
  • 25 European languages, detected automatically
  • Five versions: NeMo and 🤗 Transformers, ONNX, MLX, GGUF and Core ML
  • Permissive license: CC BY 4.0

Performance

Accuracy against size for open models on the Open ASR Leaderboard

Figure 1: Average word error rate (up is better) against model size for open models on the Open ASR Leaderboard. Fluid Speech Pro is the only top-5 open model under 1B parameters.

The most accurate open model under 1B parameters

Figure 2: The best open models at 1B parameters and under, ranked by average word error rate (lower is better).

Second among open models on noisy speech

Figure 3: Word error rate on URGENT 2024, the leaderboard's noisy-speech set (lower is better).

Use case

For developers, researchers and companies building anything that turns speech into text: dictation, meeting notes, captions and subtitles, voice assistants, call and media analytics, and transcription services.

Release date

Hugging Face, November 2026.

Model architecture

Architecture type: FastConformer-TDT

Network architecture:

  • A FastConformer encoder and a TDT (token-and-duration transducer) decoder, as in Parakeet TDT 0.6B v3
  • One small extra block between the encoder's subsampling and its first Conformer layer
  • 0.63 billion parameters

Input

  • Input type: audio, 16 kHz, mono
  • Input format: .wav, .flac and other formats your audio loader reads

Output

  • Output type: text, with punctuation and capitalization
  • Optional: word and segment timestamps (NeMo)

All versions

VersionBest forClean mode
NeMo + 🤗 Transformers (this one)NVIDIA GPUs and servers; the reference modelYes (NeMo)
ONNXCPUs, with onnx-asr or sherpa-onnxYes
MLXApple Silicon Macs, with parakeet-mlxYes
GGUFC++ with parakeet.cpp, CPU or GPU, no PythonNo
Core MLApple apps in Swift, on the Neural Engine, with FluidAudioNot yet

How to use this model

🤗 Transformers

Needs Transformers 5.22 or newer:

pip install -U transformers
from transformers import pipeline

asr = pipeline("automatic-speech-recognition", model="FluidVoice-Labs/fluid-speech-pro")
print(asr("audio.wav")["text"])

The Transformers weights leave out the model's one small extra block and decode greedily. In our tests they give nearly the same results as the NeMo model.

NVIDIA NeMo

The NeMo checkpoint is the reference model and adds timestamps and clean mode. It loads through fluid_speech.py from this repository:

pip install "nemo_toolkit[asr]"
hf download FluidVoice-Labs/fluid-speech-pro fluid_speech.py --local-dir .
import fluid_speech

model = fluid_speech.load("FluidVoice-Labs/fluid-speech-pro", map_location="cuda")

# Transcribe
print(model.transcribe(["audio.wav"])[0].text)

# With word and segment timestamps
out = model.transcribe(["audio.wav"], timestamps=True)[0]
for word in out.timestamp["word"]:
    print(f"{word['start']:.2f}s - {word['end']:.2f}s: {word['word']}")

Clean mode

By default the model writes exactly what was said. Clean mode gives edited text instead: it drops repeated words ("I I think") and filler words ("um", "uh"). Use it for notes, captions and dictation, and leave it off when you need a word-for-word record.

clean = fluid_speech.load("FluidVoice-Labs/fluid-speech-pro", map_location="cuda", clean_mode=True)
print(clean.transcribe(["audio.wav"])[0].text)

Decoding: greedy or beam search

The model decodes greedily by default (beam 1). The leaderboard numbers use beam search with 4 beams, which makes about 0.6% fewer errors on average. On a GPU with batching, 1, 2 and 4 beams run at about the same speed; greedy does the least work per clip and is a little better on very noisy audio.

BeamsErrors vs greedySpeed on a batched GPU
1 (default)baselinebaseline
20.3% fewerabout the same
40.6% fewerabout the same

To decode like the leaderboard:

model.cfg.decoding.strategy = "malsd_batch"
model.cfg.decoding.beam.beam_size = 4
model.change_decoding_strategy(model.cfg.decoding)

Software integration

  • Runtimes: 🤗 Transformers, NVIDIA NeMo, ONNX Runtime (onnx-asr, sherpa-onnx), MLX (parakeet-mlx), parakeet.cpp (GGUF), Core ML (FluidAudio)
  • Hardware: NVIDIA GPUs for full speed; it also runs on CPU and Apple Silicon
  • Operating systems: Linux, macOS, Windows

Model version

Fluid Speech Pro 1.0

Evaluation datasets

The Open ASR Leaderboard's public test sets: AMI (cleaned), Earnings-22 (cleaned, chunked), GigaSpeech (cleaned), SPGISpeech, URGENT 2024 (noisy speech), Voice Arena Monsoon (Indian English) and VoxPopuli (cleaned).

Results

Open ASR Leaderboard

Open models on the Open ASR Leaderboard: average word error rate over its seven public and two private test sets (lower is better):

ModelParametersAverage WER
Musci-ASR2B5.70
Fluid Speech Pro0.63B6.06
NVIDIA Nemotron 3.5 Transcribe30B6.13
Qwen3-ASR1.7B6.15
IBM Granite Speech 5.02B6.68
Cohere Transcribe2B6.72
NVIDIA Parakeet TDT 0.6B v20.6B6.93
NVIDIA Parakeet TDT 0.6B v30.6B7.04
Fermion Research Phonon-20.6B7.86

Results by test set

Word error rate (%) on the leaderboard's seven public test sets:

ModelPublic averageAMIEarnings-22GigaSpeechSPGISpeechURGENT 2024MonsoonVoxPopuli
Musci-ASR5.156.535.836.411.8610.493.441.47
Fluid Speech Pro5.437.555.427.512.31*9.833.711.70
NVIDIA Nemotron 3.5 Transcribe5.517.785.257.181.9110.943.631.89
Qwen3-ASR5.758.315.847.222.579.933.502.85
IBM Granite Speech 5.06.056.966.228.143.3610.223.943.52
Cohere Transcribe6.267.027.887.882.749.503.445.38
NVIDIA Parakeet TDT 0.6B v26.439.096.768.151.9411.423.893.78
NVIDIA Parakeet TDT 0.6B v36.519.425.857.993.6311.524.143.05
Fermion Research Phonon-27.239.326.968.353.7014.904.912.46

* In clean mode, which matches SPGISpeech's edited references; the leaderboard allows one transcription mode per test set.

Other languages

Fluid Speech Pro supports 25 languages. On the Open ASR Leaderboard's multilingual track it makes 12% fewer errors than Parakeet TDT 0.6B v3, and it is better in all seven of the track's languages:

LanguageParakeet TDT 0.6B v3Fluid Speech ProFewer errors
German4.123.769%
French5.405.106%
Italian4.734.1612%
Spanish3.713.389%
Portuguese6.084.8820%
Dutch7.536.829%
English7.046.0614%
Average5.524.8812%

Word error rate (%) on the Open ASR Leaderboard's multilingual track, lower is better.

It also got better than Parakeet TDT 0.6B v3 in every one of the 24 languages beyond English. On FLEURS, scored the way the leaderboard scores its multilingual track, it makes nearly 20% fewer errors on average.

Better than Parakeet TDT 0.6B v3 in all 24 other languages

Figure 4: Word error rate on FLEURS for Parakeet TDT 0.6B v3 (grey) and Fluid Speech Pro (blue), lower is better.

LanguageParakeet TDT 0.6B v3Fluid Speech ProFewer errors
Estonian13.289.5128%
Latvian21.7616.3925%
Italian2.481.9123%
Lithuanian21.0416.2123%
Maltese19.2315.0522%
Hungarian13.5810.6522%
Slovak9.187.2022%
Finnish11.198.8221%
Czech11.068.8320%
Portuguese4.473.5720%
Slovenian22.4817.9720%
Ukrainian5.954.7720%
Greek21.1617.1019%
Romanian11.389.2818%
Spanish3.222.6617%
Swedish13.3911.1017%
Polish6.845.7017%
German4.183.5216%
Danish17.2014.5715%
Bulgarian11.9410.1915%
Croatian11.409.7315%
Dutch6.395.5114%
Russian4.924.3512%
French4.754.652%
Average of all 2411.359.1320%

Word error rate (%) on FLEURS test sets, greedy decoding. A future version will be trained on more multilingual data.

Limitations

  • Please check the model on your own audio, accents and languages before you rely on it.
  • Like every speech model, it makes more mistakes on heavy noise, overlapping speakers, strong accents it has rarely heard, and rare names and terms.
  • Clean mode edits the text. Don't use it where you need an exact record.

License

CC BY 4.0. If you use the model, please credit it as Fluid Speech Pro by FluidVoice.

Built on NVIDIA Parakeet TDT 0.6B v3 and Moondream Parakeet Ultra, both CC BY 4.0.

Citation

@misc{fluidspeechpro2026,
  title  = {Fluid Speech Pro},
  author = {{FluidVoice}},
  year   = {2026},
  url    = {https://huggingface.co/FluidVoice-Labs/fluid-speech-pro}
}

References

  1. Parakeet TDT 0.6B v3, NVIDIA
  2. Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognition
  3. Efficient Sequence Transduction by Jointly Predicting Tokens and Durations
  4. Open ASR Leaderboard, Hugging Face

内容来源:Hugging Face 模型卡

在 Hugging Face 查看