INNER CODE UNIT · Python

skill_path

wgpsec/AboutSecurity · scripts/bench-skill.py:571

            skill_path = REPO_ROOT / skill_path
        if not (skill_path / "SKILL.md").exists():
            print(f"Error: No SKILL.md in {skill_path}")
            sys.exit(1)
        if not (skill_path / "evals" / "evals.json").exists():
            print(f"Error: No evals/evals.json in {skill_path}")
            print("Create eval scenarios first. See CONTRIBUTING.md for format.")
            sys.exit(1)

        run_skill_benchmark(
            skill_path,
            runs_per_config=args.runs,
            model=args.model,
            timeout=args.timeout,
            grade_only=args.grade_only,
            verbose=not args.quiet,
        )

View source record →

📰 Research Paper
Loading…
⏳ Fetching content…