Nativ: Run AI models locally on your Mac
Prince Canuma is the developer behind the excellent MLX-VLM Python library for running vision-LLMs using MLX on a Mac.I'm really excited about his new project, which wraps MLX in a full macOS desktop application. It's similar in shape to LM Studio, providing both a chat interface and a localhost API server for accessing models.
The app picked up MLX models I had already tried that were present in my Hugging Face cache directory, which was a nice touch.
Via Hacker News
Tags: macos, python, ai, generative-ai, local-llms, llms, mlx, prince-canuma