SOURCE RECORD · github

FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.

Category: llm · Language: Python

Open canonical source ↗

Research paper status → · Book status →

📰 Research Paper
Loading…
⏳ Fetching content…