Microsoft · First MLX build 1 May 2025

Phi-4-reasoning

MLX Text mit

A 15B parameter text generation model from Microsoft, with 4 MLX builds, from 4-bit to bf16.

Hugging Face
Parameters
15B
From Hugging Face
Quantisation
4-bit
Phi-4-reasoning-4bit
Memory needed
12 GB
Estimate, unified memory
Download
8.2 GB
Weights, estimated
Downloads
73
This build, last 30 days
Task
Text generation
Text
MLX builds
4
On mlx-community
Devices
Mac
Apple silicon

Memory

Estimated from the size of the weights, plus a fifth for context and working memory and 2 GB for macOS and your apps. Long contexts need more.

Run it

Terminal · mlx-lm
$ pip install -U mlx-lm
$ mlx_lm.generate --model mlx-community/Phi-4-reasoning-4bit --prompt "Hello"

MLX builds

4 on mlx-community
Click a column to sort. Smallest size and most downloads are highlighted.
Phi-4-reasoning-4bit 4-bit 8.2 GB 12 GB 73
Phi-4-reasoning-6bit 6-bit 11.9 GB 16 GB 35
Phi-4-reasoning-8bit 8-bit 15.6 GB 20 GB 41
Phi-4-reasoning-bf16 bf16 29.3 GB 35 GB 29

Sizes are estimated from Hugging Face’s parameter counts and the quantisation. Downloads are for the last 30 days.