INNER CODE UNIT · Python

Item

CerebriumAI/examples · 1-getting-started/3-cpu-only/main.py:7

class Item(BaseModel):
    # Add your input parameters here
    prompt: str
    your_optional_param: Optional[str] = None  # an example optional parameter


# Set up your model here.
"""
This code will be run once when your replica starts. 
Load your model, setup datasets, pull in secrets, etc. here
"""


def predict(prompt):
    params = Item(prompt=prompt)
    # This code is run on every inference request.

    # Access the parameters from your inference request

View source record →