INNER CODE UNIT · Python

PromptInput

invergent-ai/surogate · surogate/serve/tools/reference/qwen3_5_moe/cli.py:25

class PromptInput:
    token_ids: list[int]
    batch: MultimodalBatch | None
    rendered: str | None
    source: str


@dataclass(frozen=True, slots=True)
class Timings:
    load: float
    preprocess: float
    vision: float
    prepare: float
    prefill: float
    decode: float


def parse_ids(text: str) -> list[int]:

View source record →