Google · First MLX build 2 Apr 2026

gemma-4-31B-it

MLX TextVision apache-2.0

A 31B parameter vision and text model from Google, with 10 MLX builds, from 6-bit to bf16.

Hugging Face
Parameters
31B
From Hugging Face
Quantisation
4-bit
gemma-4-31b-it-4bit
Memory needed
23 GB
Estimate, unified memory
Download
18.4 GB
Weights, estimated
Downloads
8.1K
This build, last 30 days
Task
Vision and text
Text, Vision
MLX builds
10
On mlx-community
Devices
Mac
Apple silicon

Memory

Estimated from the size of the weights, plus a fifth for context and working memory and 2 GB for macOS and your apps. Long contexts need more.

Run it

Terminal · mlx-vlm
$ pip install -U mlx-vlm
$ python -m mlx_vlm.generate --model mlx-community/gemma-4-31b-it-4bit --image photo.jpg --prompt "Describe this image"

MLX builds

10 on mlx-community
Click a column to sort. Smallest size and most downloads are highlighted.
gemma-4-31B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking-4.6bit-msq 6-bit 6.5 GB 10 GB 101
gemma-4-31b-it-4bit 4-bit 18.4 GB 23 GB 8.1K
gemma-4-31b-it-mxfp4 MXFP4 18.4 GB 23 GB 290
gemma-4-31b-it-nvfp4 4-bit 18.4 GB 23 GB 196
gemma-4-31B-it-OptiQ-4bit 4-bit 18.4 GB 23 GB 756
gemma-4-31b-it-5bit 5-bit 22.2 GB 27 GB 167
gemma-4-31b-it-6bit 6-bit 26.1 GB 32 GB 701
gemma-4-31b-it-8bit 8-bit 33.8 GB 40 GB 3.2K
gemma-4-31b-it-mxfp8 MXFP8 33.8 GB 40 GB 178
gemma-4-31b-it-bf16 bf16 62.5 GB 72 GB 1.6K

Sizes are estimated from Hugging Face’s parameter counts and the quantisation. Downloads are for the last 30 days.