SOURCE RECORD · github

omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Category: llm · Language: Python

Open canonical source ↗

Research paper status → · Book status →

📰 Research Paper
Loading…
⏳ Fetching content…