INNER CODE UNIT · Python

HealthCheck

awslabs/awsome-distributed-ai · architectures/sagemaker-hyperpod-eks/nvidia-cloud-functions/nvcf/sample-function/server.py:16

class HealthCheck(BaseModel):
    """Health check response model."""

    status: str = "OK"


class EchoRequest(BaseModel):
    """Echo request model."""

    message: str
    delay: float = 0.0
    repeats: int = 1
    stream: bool = False


# ---------------------------------------------------------------------------
# Health endpoint (required by NVCF)
# Must return HTTP 200 when the container is ready for inference.

View source record →

📰 Research Paper
Loading…
⏳ Fetching content…