Meta Releases Muse Spark Open, an Over 800 Billion Parameter Model That Can Run Locally on Multiple M5 Ultra Mac Studios
Meta just released the weights for Muse Spark Open, a multimodal large language model with a mixture-of-experts architecture. It has over 800 billion parameters in total, with 40 billion active per token, and it can run on the latest Mac Studios.
Meta worked closely with Apple to make that happen specifically on the M5 Ultra Mac Studio with the support of MLX, the Apple-led, open-source machine-learning framework. The result is a frontier-class model that can be run locally on desktop hardware.
Apple’s Machine Learning Research blog put the M5 Ultra through its paces standalone and connected…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.