Models with MLX builds on mlx-community, ready to run on a Mac with Apple’s MLX framework.
karakuri-lm-8x7b-instruct-v0.1
Downloads, 30 days
109
Memory needed (est.)
32 GB
Quantisation
4-bit, 8-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
apache-2.0Added 11 Oct 2024
Llama-3-70B-Instruct-Gradient-262k
Downloads, 30 days
109
Memory needed (est.)
27 GB
Quantisation
2-bit, 4-bit, 8-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
llama3Added 3 May 2024
Llama-3-8B-Instruct-Gradient-1048k
Downloads, 30 days
109
Memory needed (est.)
5 GB
Quantisation
2-bit, 4-bit, 8-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
llama3Added 5 May 2024
Llama-3-Swallow-8B-v0.1
Downloads, 30 days
109
Memory needed (est.)
12 GB
Quantisation
8-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
llama3Added 6 Sept 2024
Llama-3-8B-Instruct-Gradient-4194k
Downloads, 30 days
108
Memory needed (est.)
8 GB
Quantisation
4-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
llama3Added 18 Nov 2024
InternVL3-9B
Downloads, 30 days
108
Memory needed (est.)
8 GB
Quantisation
4-bit, 6-bit, 8-bit +1
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
apache-2.0Added 30 Apr 2025
PaddleOCR-VL-bfloat16
Downloads, 30 days
108
Memory needed (est.)
5 GB
Quantisation
—
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
apache-2.0Added 19 Jan 2026
Athene-V2-Chat
Downloads, 30 days
108
Memory needed (est.)
48 GB
Quantisation
4-bit, 8-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
otherAdded 16 Nov 2024
Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct
Downloads, 30 days
108
Memory needed (est.)
8 GB
Quantisation
4-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
cc-by-nc-4.0Added 17 Apr 2025
Nova-Tempus-70B-v0.1
Downloads, 30 days
108
Memory needed (est.)
37 GB
Quantisation
3-bit, 4-bit, 6-bit +1
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
llama3.3Added 26 Jan 2025
Inkling-NVFP4
Downloads, 30 days
108
Memory needed (est.)
652 GB
Quantisation
4-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
apache-2.0Added 15 Jul 2026
Arcee-Blitz
Downloads, 30 days
107
Memory needed (est.)
17 GB
Quantisation
4-bit, 6-bit, 8-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
apache-2.0Added 20 Feb 2025
Jan-nano-128k
Downloads, 30 days
107
Memory needed (est.)
5 GB
Quantisation
4-bit, 8-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
apache-2.0Added 26 Jun 2025
llava-interleave-qwen-0.5b
Downloads, 30 days
107
Memory needed (est.)
4 GB
Quantisation
4-bit, 6-bit, 8-bit +1
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
tongyi-qianwen-researchAdded 5 Oct 2024
llava-interleave-qwen-7b
Downloads, 30 days
107
Memory needed (est.)
8 GB
Quantisation
4-bit, 6-bit, 8-bit +1
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
tongyi-qianwen-researchAdded 6 Oct 2024
Nanbeige4-3B-Thinking-2511-gabliterated
Downloads, 30 days
106
Memory needed (est.)
5 GB
Quantisation
4-bit, 6-bit, 8-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
Licence not statedAdded 12 Jan 2026
Qwen3.6-35B-A3B-AntiLoop
Downloads, 30 days
106
Memory needed (est.)
26 GB
Quantisation
—
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
apache-2.0Added 10 Jul 2026
Falcon3-1B-Instruct-1.58bit
Downloads, 30 days
106
Memory needed (est.)
3 GB
Quantisation
58-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
falcon-llm-licenseAdded 10 Jun 2025
SuperNova-Medius
Downloads, 30 days
105
Memory needed (est.)
12 GB
Quantisation
4-bit, 8-bit, bf16
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
apache-2.0Added 11 Oct 2024
CodeFormulaV2
Downloads, 30 days
105
Memory needed (est.)
3 GB
Quantisation
8-bit, bf16
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
cdla-permissive-2.0Added 16 May 2026
Josiefied-Olmo-3-7B-Instruct-abliterated-v1
Downloads, 30 days
105
Memory needed (est.)
7 GB
Quantisation
4-bit, 6-bit, 8-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
Licence not statedAdded 25 Nov 2025
gemma2-9b-cpt-sahabatai-v1-instruct
Downloads, 30 days
105
Memory needed (est.)
8 GB
Quantisation
4-bit, 8-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
gemmaAdded 3 Jun 2026
Mellum-4b-sft-kotlin
Downloads, 30 days
105
Memory needed (est.)
5 GB
Quantisation
4-bit, 8-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
apache-2.0Added 28 Jun 2025
Deductive-Reasoning-Qwen-32B
Downloads, 30 days
105
Memory needed (est.)
23 GB
Quantisation
4-bit, 6-bit, 8-bit
Devices
Runs on: Mac
Fits in unified memory
8
16
24
32
64
128
mitAdded 11 Mar 2025
Load more models Showing 1,008 of 1,549 · Previous page