INNER CODE UNIT · Python
Item
CerebriumAI/examples · 1-getting-started/1-first-cortex-deployment/main.py:7
class Item(BaseModel):
# Add your input parameters here
prompt: str
your_optional_param: Optional[str] = None # an example optional parameter
# Set up your model here.
"""
This code will be run once when your replica starts.
Load your model, setup datasets, pull in secrets, etc. here
"""
def predict(prompt, your_optional_param):
params = Item(prompt=prompt, your_optional_param=your_optional_param)
# This code is run on every inference request.
# Access the parameters from your inference request