MLX Community · First MLX build 8 Mar 2024

whisper-small

MLX Audio

A speech recognition model, with 5 MLX builds, from 4-bit to fp32.

Hugging Face
Parameters
—
Not published
Quantisation
Unstated
whisper-small-mlx
Memory needed
— GB
Estimate, unified memory
Download
—
Weights, estimated
Downloads
194K
This build, last 30 days
Task
Speech recognition
Audio
MLX builds
5
On mlx-community
Devices
Mac
Apple silicon

Memory

Hugging Face does not list a weights size for this build, so there is no memory estimate.

Estimated from the size of the weights, plus a fifth for context and working memory and 2 GB for macOS and your apps. Long contexts need more.

Run it

Terminal · Hugging Face CLI
$ pip install -U huggingface_hub
$ hf download mlx-community/whisper-small-mlx

MLX builds

5 on mlx-community
Click a column to sort. Smallest size and most downloads are highlighted.
whisper-small-mlx Unstated — — 194K
whisper-small-mlx-q4 4-bit — — 2.2K
whisper-small-mlx-4bit 4-bit — — 1.3K
whisper-small-mlx-8bit 8-bit — — 285
whisper-small-mlx-fp32 fp32 — — 50

Sizes are estimated from Hugging Face’s parameter counts and the quantisation. Downloads are for the last 30 days.