|||

March 6, 2025 Link Blog

Run LLMs on macOS using llm-mlx and Apple’s MLX framework

You can use the TOPS on your M Series Mac to run LLMs!

llm-mlx is a brand new plugin for my LLM Python Library and CLI utility which builds on top of Apple’s excellent MLX array framework library and mlx-lm package. If you’re a terminal user or Python developer with a Mac this may be the new easiest way to start exploring local Large Language Models.

By way of simonwillison.net

Up next How North Korea pulled off a $1.5 billion crypto heist—the biggest in history The cryptocurrency industry and those responsible for securing it are still in shock following Friday’s heist, likely by North Korea, that drained Massive new energy source could be hiding in Earth’s mountains In the scramble for clean energy that could help us transition away from fossil fuels, scientists may have found a new power source — and it could

Latest posts OMG IT IS SO CUTE Massive new energy source could be hiding in Earth’s mountains Run LLMs on macOS using llm-mlx and Apple’s MLX framework How North Korea pulled off a $1.5 billion crypto heist—the biggest in history Grok blocked results saying Musk and Trump ‘spread misinformation’ Robot with 1,000 muscles twitches like human while dangling from ceiling Embrace the Coming AI Revolution with Safe Local AI! The Delirious, Violent, Impossible True Story of the Zizians Apples C1 modem is the first step towards ‘a platform for generations,’ executives say The IPv6 transition How to Build an LLM Chat App: The New Litmus Test for Junior Devs Microsoft’s Majorana 1 chip carves new path for quantum computing Elon’s email demand is being met with WITH ‘very rude’ flood of spam. THE MAINE SHIP CAPTAIN WHO INVENTED THE MODERN DONUT AI slop is coming for Reddit Humane’s showing how not to treat early adopters. The best #tor distribution setup nowadays FBI Says Backup Now—Confirms Dangerous Attacks Underway The continuing enshitification of everything.. healthcare edition Microsoft Study Finds Relying on AI Kills Your Critical Thinking Skills As Internet enshittification marches on, here are some of the worst offenders From 900 miles away, the US government recorded audio of the Titan sub implosion Thousands of people protest across the U.S. on Presidents Day Scientists capture extremely rare footage of a black seadevil The Anthropic Economic Index ICED COFFEE FOREVER The Anti-SNARF Manifesto Extremely rare ‘Einstein ring’ discovered close to Earth Why 2,000 Ancient PCs Mysteriously Appeared on eBay DOGE’s .gov site lampooned as coders quickly realize it can be edited by anyone You are using Cursor AI incorrectly…