oMLX — LLM inference, optimized for your Mac

oMLX is a native macOS inference server built on MLX, offering features like paged SSD KV caching, continuous batching, and drop-in API compatibility with tools such as Claude Code, OpenClaw, and Cursor.

Saved by 1 person