INNER CODE UNIT · Python

chat_completion

ai-infra-curriculum/ai-infra-engineer-learning · projects/project-103-llm-deployment/src/api/main.py:431

async def chat_completion(
    request: dict,  # TODO: Use proper ChatRequest model
    api_key: str = Depends(verify_api_key),
    llm: ChatLLMServer = Depends(get_llm_server)
):
    """
    OpenAI-compatible chat completion endpoint.

    Args:
        request: Chat request with messages
        api_key: API key
        llm: Chat LLM server

    Returns:
        Chat completion response

    TODO: Implement chat completion:
    1. Parse OpenAI-format request

View source record →