gitpulse

jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

23,663 stars2,139 forksPythonApache-2.0pushed 2026-11-16

View on GitHub →

Star momentum

Today+13 (+0.1%)
This week+185 (+0.8%)
This month+785 (+3.4%)

Topics

apple-siliconinference-serverllmmacosmlxopenai-api