INNER CODE UNIT · Python
generate_text
ai-infra-curriculum/ai-infra-engineer-learning · projects/project-103-llm-deployment/src/api/main.py:274
async def generate_text(
request: GenerateRequest,
api_key: str = Depends(verify_api_key),
llm: LLMServer = Depends(get_llm_server)
):
"""
Generate text completion.
Args:
request: Generation request
api_key: API key from dependency
llm: LLM server from dependency
Returns:
Generated text response
TODO: Implement text generation:
1. Validate request parameters