SOURCE RECORD · github
omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
SOURCE RECORD · github
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar