MLX Community · First MLX build 4 Jan 2024

Nous-Hermes-2-SOLAR-10.7B

MLX apache-2.0

A model, with one MLX build.

Hugging Face
Parameters
—
Not published
Quantisation
Unstated
Nous-Hermes-2-SOLAR-10.7B-mlx
Memory needed
— GB
Estimate, unified memory
Download
—
Weights, estimated
Downloads
28
This build, last 30 days
Task
—
MLX builds
1
On mlx-community
Devices
Mac
Apple silicon

Memory

Hugging Face does not list a weights size for this build, so there is no memory estimate.

Estimated from the size of the weights, plus a fifth for context and working memory and 2 GB for macOS and your apps. Long contexts need more.

Run it

Terminal · Hugging Face CLI
$ pip install -U huggingface_hub
$ hf download mlx-community/Nous-Hermes-2-SOLAR-10.7B-mlx

MLX builds

1 on mlx-community
Click a column to sort. Smallest size and most downloads are highlighted.
Nous-Hermes-2-SOLAR-10.7B-mlx Unstated — — 28

Sizes are estimated from Hugging Face’s parameter counts and the quantisation. Downloads are for the last 30 days.