INNER CODE UNIT · Python

matches

cmu-sei/GHOSTS · experimental/grms/grms/main.py:142

        matches = sum(1 for t in known.action_types if t in predicted_types)
        action_type_score = matches / len(known.action_types)
        dimensions.append(ScoreDimension(
            dimension="action_types",
            predicted=predicted_types,
            actual=known.action_types,
            score=action_type_score,
            note=f"{matches}/{len(known.action_types)} matched",
        ))

    tone_score = None
    if known.tone:
        predicted_tone = lr.verbal_response.tone
        tone_score = 1.0 if predicted_tone == known.tone else 0.0
        dimensions.append(ScoreDimension(
            dimension="tone",
            predicted=predicted_tone,
            actual=known.tone,

View source record →

📰 Research Paper
Loading…
⏳ Fetching content…