Goekdeniz-Guelmez · First MLX build 12 Jan 2026

JOSIE-IT1-Qwen3-0.6B

MLX Text

A 596M parameter text generation model from Goekdeniz-Guelmez, with 4 MLX builds, from 4-bit to 8-bit.

Hugging Face
Parameters
596M
From Hugging Face
Quantisation
4-bit
JOSIE-IT1-Qwen3-0.6B-4bit
Memory needed
3 GB
Estimate, unified memory
Download
335 MB
Weights, estimated
Downloads
29
This build, last 30 days
Task
Text generation
Text
MLX builds
4
On mlx-community
Devices
Mac
Apple silicon

Memory

Estimated from the size of the weights, plus a fifth for context and working memory and 2 GB for macOS and your apps. Long contexts need more.

Run it

Terminal · mlx-lm
$ pip install -U mlx-lm
$ mlx_lm.generate --model mlx-community/JOSIE-IT1-Qwen3-0.6B-4bit --prompt "Hello"

MLX builds

4 on mlx-community
Click a column to sort. Smallest size and most downloads are highlighted.
JOSIE-IT1-Qwen3-0.6B-4bit 4-bit 335 MB 3 GB 29
JOSIE-IT1-Qwen3-0.6B-6bit 6-bit 484 MB 3 GB 14
JOSIE-IT1-Qwen3-0.6B-8bit 8-bit 633 MB 3 GB 14
JOSIE-IT1-Qwen3-0.6B-bfloat16 Unstated 1.2 GB 4 GB 21

Sizes are estimated from Hugging Face’s parameter counts and the quantisation. Downloads are for the last 30 days.