MLX Community · First MLX build 6 Apr 2025

meta-llama-Llama-4-Scout-17B-16E-Instruct

MLX

A model, with one MLX build at 6-bit.

Hugging Face
Parameters
—
Not published
Quantisation
6-bit
meta-llama-Llama-4-Scout-17B-16E-Instruct-6bit
Memory needed
— GB
Estimate, unified memory
Download
—
Weights, estimated
Downloads
0
This build, last 30 days
Task
—
MLX builds
1
On mlx-community
Devices
Mac
Apple silicon

Memory

Hugging Face does not list a weights size for this build, so there is no memory estimate.

Estimated from the size of the weights, plus a fifth for context and working memory and 2 GB for macOS and your apps. Long contexts need more.

Run it

Terminal · Hugging Face CLI
$ pip install -U huggingface_hub
$ hf download mlx-community/meta-llama-Llama-4-Scout-17B-16E-Instruct-6bit

MLX builds

1 on mlx-community
Click a column to sort. Smallest size and most downloads are highlighted.
meta-llama-Llama-4-Scout-17B-16E-Instruct-6bit 6-bit — — 0

Sizes are estimated from Hugging Face’s parameter counts and the quantisation. Downloads are for the last 30 days.