AI - MLX

MLX is a NumPy-like array framework designed for efficient and flexible machine learning on Apple silicon.

On this page

Arrays in MLX live in shared memory. Operations on MLX arrays can be performed on any of the supported device types without performing data copies.

Terminal window
uv tool install mlx
uv tool install mlx-lm
Terminal window
mlx_lm.generate --model mlx-community/Qwen3-4B-Instruct-2507-4bit --prompt "hello"
mlx-community/Qwen3-Coder-32B-A3B-4bit

Opencode

mlx_lm.server