|||

March 6, 2025 Link Blog

Run LLMs on macOS using llm-mlx and Apple’s MLX framework

You can use the TOPS on your M Series Mac to run LLMs!

llm-mlx is a brand new plugin for my LLM Python Library and CLI utility which builds on top of Apple’s excellent MLX array framework library and mlx-lm package. If you’re a terminal user or Python developer with a Mac this may be the new easiest way to start exploring local Large Language Models.

By way of simonwillison.net

Up next How North Korea pulled off a $1.5 billion crypto heist—the biggest in history The cryptocurrency industry and those responsible for securing it are still in shock following Friday’s heist, likely by North Korea, that drained Massive new energy source could be hiding in Earth’s mountains In the scramble for clean energy that could help us transition away from fossil fuels, scientists may have found a new power source — and it could

Latest posts THIS Mental Habit Fuels Depression - The Cognitive Distortion of Discounting the Positive Robot-driven Maserati MC20 sets new world speed record Natural alternative to Ozempic brings results without side effects Millennials Aren’t Killing Businesses. Private Equity Is. What Really Happened With the DDoS Attacks That Took Down X Hoping to revive mammoths, scientists create ‘woolly mice’ Digg is Coming Back The Dude Whose Brain Turned to Glass Kennedy and influencers bash seed oils, baffling nutrition scientists WEBB TELESCOPE’S LARGEST STUDY OF UNIVERSE EXPANSION CONFIRMS CHALLENGE TO COSMIC THEORY OMG IT IS SO CUTE Massive new energy source could be hiding in Earth’s mountains Run LLMs on macOS using llm-mlx and Apple’s MLX framework How North Korea pulled off a $1.5 billion crypto heist—the biggest in history Grok blocked results saying Musk and Trump ‘spread misinformation’ Robot with 1,000 muscles twitches like human while dangling from ceiling Embrace the Coming AI Revolution with Safe Local AI! The Delirious, Violent, Impossible True Story of the Zizians Apples C1 modem is the first step towards ‘a platform for generations,’ executives say The IPv6 transition How to Build an LLM Chat App: The New Litmus Test for Junior Devs Microsoft’s Majorana 1 chip carves new path for quantum computing Elon’s email demand is being met with WITH ‘very rude’ flood of spam. THE MAINE SHIP CAPTAIN WHO INVENTED THE MODERN DONUT AI slop is coming for Reddit Humane’s showing how not to treat early adopters. The best #tor distribution setup nowadays FBI Says Backup Now—Confirms Dangerous Attacks Underway The continuing enshitification of everything.. healthcare edition Microsoft Study Finds Relying on AI Kills Your Critical Thinking Skills As Internet enshittification marches on, here are some of the worst offenders