Evelyn Harbor OS
Master Dashboard 01. Prompt Repository 02. Prompt Inspector 03. 5-Layer Meta Matrix 04. KV-Cache Calculator 05. Evaluation Rubrics 06. Agent Memory Bridge
Relational Database 05: Evaluation Rubrics & Assertion Suite

Deterministic Production Test Assertions

42 Automated Gating Rubrics across Hallucination Drift, Schema Validation, Negative Constraint Enforcement, and Tool Verification. Eliminate edge-case breakdowns in autonomous prompt pipelines.

Production Prompt Assertion & Gating Table 42 Active Rubrics (100% Passing)
Rubric ID Target Prompt / Role Failure Mode / Assertion Gate Verification Method Status
RUB-01 System Persona & Tone Negative Constraint Injection & Personality Drift Semantic Embedding & Rerank Gate Passing (100%)
RUB-02 Structured Output Schema Unclosed JSON / Invalid Markdown Delimiters Strict AST / Pydantic Parser Passing (100%)
RUB-03 XML Boundary Isolation Unescaped User Tags & Prompt Injection Traps Regex Tag Parity Validator Passing (100%)
RUB-04 Tool Call Contract Type Mismatch, Missing Required Args, Out-of-Range Params Deterministic JSON Schema Verification Passing (100%)
RUB-05 Token Overflow Ceiling Unbounded Context Bloat & KV-Cache Eviction Hard Token Budget & Head Bounding Pipe Passing (100%)
RUB-06 State Handoff Integrity Scratchpad Context Loss Across Restarts & Harness Switches L1 Heredoc Checksum Assertion Passing (100%)