INNER CODE UNIT · Python

vision_seconds

invergent-ai/surogate · surogate/serve/tools/reference/qwen3_5/cli.py:330

            vision_seconds = time.perf_counter() - vision_started
            vision_stats = vision_output.stats

        sampler = None
        generated: list[int] = []
        prepare_seconds = 0.0
        prefill_seconds = 0.0
        decode_seconds = 0.0
        if args.decode > 0:
            try:
                sampler = Sampler(
                    _sampling_config(frontend, args),
                    model.config.token_domain,
                    model.device,
                )
            except ValueError as exc:
                parser.error(str(exc))
            prepare_started = time.perf_counter()

View source record →