INNER CODE UNIT · Python

predict

CerebriumAI/examples · 1-getting-started/1-first-cortex-deployment/main.py:20

def predict(prompt, your_optional_param):
    params = Item(prompt=prompt, your_optional_param=your_optional_param)
    # This code is run on every inference request.

    # Access the parameters from your inference request
    prompt = params.prompt
    logger.info(f"Received a prompt of: `{prompt}`")

    if params.your_optional_param is not None:
        logger.info(f"You sent an optional param of: {params.your_optional_param}")

    # ADD YOUR CODE HERE

    return {
        "your_prompt": params.prompt,
        "your_other_return": "success",
    }  # return your results

View source record →