INNER CODE UNIT · Python

TestCase

valqore/valqore · blog/01-fine-tuning/eval_example.py:10

class TestCase:
    id: str
    category: str
    prompt: str
    checks: list[tuple[str, str]]  # (check_name, substring_to_find)


# Example test cases (simplified from our 25-test suite)
TEST_CASES = [
    TestCase(
        id="rule-001",
        category="rule_knowledge",
        prompt="Explain rule SP-006 and its severity.",
        checks=[
            ("mentions_root", "root"),
            ("mentions_severity", "critical"),
            ("has_fix", "runAsNonRoot"),
        ],

View source record →