MLX Community · First MLX build 5 Jan 2024

whisper-tiny

MLX Audio

A 23M parameter speech recognition model, with 6 MLX builds, from 4-bit to fp32.

Hugging Face
Parameters
23M
From Hugging Face
Quantisation
Unstated
whisper-tiny
Memory needed
— GB
Estimate, unified memory
Download
—
Weights, estimated
Downloads
24K
This build, last 30 days
Task
Speech recognition
Audio
MLX builds
6
On mlx-community
Devices
Mac
Apple silicon

Memory

Hugging Face does not list a weights size for this build, so there is no memory estimate.

Estimated from the size of the weights, plus a fifth for context and working memory and 2 GB for macOS and your apps. Long contexts need more.

Run it

Terminal · Hugging Face CLI
$ pip install -U huggingface_hub
$ hf download mlx-community/whisper-tiny

MLX builds

6 on mlx-community
Click a column to sort. Smallest size and most downloads are highlighted.
whisper-tiny-mlx-4bit 4-bit 44 MB 3 GB 153
whisper-tiny Unstated — — 24K
whisper-tiny-mlx Unstated — — 8.4K
whisper-tiny-mlx-q4 4-bit — — 163
whisper-tiny-mlx-8bit 8-bit — — 39
whisper-tiny-mlx-fp32 fp32 — — 37

Sizes are estimated from Hugging Face’s parameter counts and the quantisation. Downloads are for the last 30 days.