Catastrophe Correlation Blindness
Catastrophe risk model assumes independent claims; hurricane hits coast, model hadn't provisioned for 10k simultaneous claims; reserve exhausted within days
13 patterns in this category
Insurance agents fail across five distinct workflows — claims processing, claims reserve modeling, fraud detection, policy management, and underwriting — but the failure mechanisms within these workflows fall into exactly three repeating patterns: a retrieval step that ranks by textual similarity without verifying structural attributes, a multi-agent handoff that narrows the interface too narrowly and loses task-relevant context, and a parametric memory that defeats tool-grounding for actively maintained data. The three mechanisms (retrieval mismatch, handoff loss, stale-corpus override) repeat consistently because they reflect fundamental structural choices in how agents are built: whether to filter retrieval by structure before similarity ranking, whether handoff schemas carry all task-relevant determinations or only the most common ones, and whether tool calls are mandatory or optional when parametric knowledge exists. The business impact of each mechanism varies by workflow — an embedding-retrieval mismatch costs $15,000 in one claim but underprices an entire policy cohort in another — but the technical root cause and the architectural fix are identical across all five insurance use cases.
| Goal | Coverage | Patterns | Mechanism Focus |
|---|---|---|---|
| Claim Processing | Per-claim adjudication bias, exclusion blindness, coverage validation | 3 | Retrieval mismatch, handoff loss, stale-corpus override |
| Claims Processing | Reserve adequacy, catastrophe correlation, tail-risk modeling | 1 | Actuarial assumption blindness (structurally different) |
| Fraud Detection | SIU referral accuracy, link analysis, red-flag validation | 3 | Retrieval false positive, handoff loss, stale-corpus override |
| Policy Management | Renewal pricing, mid-term endorsements, regulatory compliance | 3 | Retrieval mismatch, handoff loss, stale-corpus override |
| Underwriting | Occupational classification, hazard identification, risk zones | 3 | Retrieval mismatch, handoff loss, stale-corpus override |
Total: 13 patterns
The five insurance goals are organized by workflow stage rather than mechanism, since each workflow (claims processing, fraud, underwriting, etc.) operates independently. However, the three failure mechanisms appear in remarkably consistent patterns across the workflows. Embedding-retrieval mismatches appear whenever the agent needs to select a document or precedent by similarity (picking an endorsement, a precedent claim, a precedent policy, an applicant occupation, an SLA tier). Multi-agent handoffs fail in the same way each time: a structured schema is too narrow to carry context the upstream stage identified, leaving task-relevant information in free text that never reaches the downstream agent’s consumed input. Stale parametric memory defeats tool calls in the same predictable scenarios: whenever the data is jurisdiction-specific, carrier-specific, or actively maintained after the model’s training cutoff. Understanding the three mechanisms as cross-cutting themes allows pattern mitigation to be standardized across workflows rather than re-invented per workflow.
Claim Processing documents three agentic-mechanism failures in the per-claim adjudication pipeline (how individual claims are evaluated and paid). Claims Processing documents a reserve-modeling assumption failure (how a carrier provisions reserves for the aggregate claim population) — a fundamentally different level of analysis and a different kind of failure altogether. The folders have confusingly similar names; a human maintainer should consider renaming one to clarify the distinction.
Yes. Every goal except Claims Processing documents the same three patterns (retrieval mismatch, handoff loss, stale-corpus override) repeated across different workflows. The consistency of these mechanisms across workflows suggests they are structural rather than domain-specific, and that fixing them requires architectural changes to how agents are built rather than workflow-specific tuning.
Stale-parametric-knowledge defeating tool calls appears consistently in every workflow where the data is jurisdiction-specific or actively maintained (regulatory deadlines, red flags, catastrophe zones). It is the pattern most likely to be overlooked because the agent produces fluent, confident answers without invoking the tool, making the failure invisible without explicit grounding checks.
Handoff schemas are typically built to carry the most common fields a downstream agent consumes, not every field that an upstream agent might determine. When an upstream agent surfaces a task-relevant finding that falls outside the schema’s predefined fields (an exclusion, a hazard rider, an attempted-remedy detail), that finding is invisible to the downstream agent, regardless of how clearly the upstream agent noted it. The fix requires deliberate schema expansion or upstream-transcript reconciliation.
Catastrophe risk model assumes independent claims; hurricane hits coast, model hadn't provisioned for 10k simultaneous claims; reserve exhausted within days
A Fraud-Detection Agent's Link-Analysis Retrieval Step, Which Searches for Claimants Embedding-Similar to Known Fraud-Ring Members Based on Free-Text Claim-Narrative and Address Fields, Surfaces a Coincidental Lexical Match (a Common Surname, a High-Density Apartment Complex Address) and Treats It as a Fraud-Ring Association, Escalating a Legitimate Claimant for SIU Investigation Based on a Retrieval False Positive
A Policy-Renewal Agent's Retrieval Step Surfaces a "Similar Policy" Precedent via Embedding Similarity to Determine an Appropriate Rate Adjustment for an Unusual Risk Profile, but the Matched Policy Is in a Different Rating Territory With Different Loss Experience, Leading to a Mispriced Renewal
An Underwriting Agent's Retrieval Step, Used to Find a "Similar Prior Case" Precedent for Classifying an Applicant's Occupation Into the Correct Risk Class for Pricing, Surfaces a Prior Underwriting Case That Is Embedding-Similar by Job-Title Wording but Belongs to a Materially Different Risk Class, Causing the Agent to Apply the Wrong Class's Rate Factor to the Current Applicant
A Claims-Adjudication Agent's RAG Retrieval Step Pulls a Lexically Similar but Superseded or Wrong-State Policy Endorsement from the Document Store Instead of the Endorsement Actually Attached to the Policy in Force, Causing the Agent to Apply Incorrect Coverage Terms to the Claim
An Underwriting-Assistant Agent's Free-Text Risk-Assessment Narrative Notes a Property Inspection's Flagged Hazard Requiring a Mandatory Exclusion Rider, but the Structured Binding Schema Passed to the Policy-Issuance Agent Has No Corresponding Field, So the Policy Binds Without the Rider
A Policy-Servicing Agent's Free-Text Confirmation of a Processed Mid-Term Endorsement (a Risk-Increasing Property Addition, a Removed Discount Condition) Is Not Captured in the Structured Risk-Profile Schema Passed to the Renewal-Pricing Agent, Which Prices the Renewal off the Stale, Pre-Endorsement Risk Profile
A Coverage Exclusion Identified by an Earlier Stage of a Multi-Agent Claims Pipeline (Intake → Triage → Adjudication → Payment) Is Surfaced Only in That Stage's Free-Text Reasoning or Chat Transcript and Never Written to a Structured Field the Downstream Payment Agent Reads, So the Exclusion Is Silently Dropped Before Funds Are Disbursed
An Initial-Review Agent's Free-Text Note Flagging That a Claimant's Reported Loss Date Appears to Predate the Policy's Effective Date Is Not Captured in the Structured SIU-Referral Schema, So the SIU-Triage Agent Processes the Referral Under a Generic High-Claim-Amount Category and Never Investigates the Actual Pre-Inception Loss Suspicion
A Policy-Servicing Agent Determining How Many Days of Advance Written Notice a Carrier Must Give Before Cancelling or Non-Renewing a Policy in a Given State Answers From a General, Memorized Sense of Typical Notice-Period Rules Formed During Pretraining Instead of Calling the Live Regulatory-Requirements Lookup Tool It Has Available, Producing a Cancellation or Non-Renewal Notice That Understates the State's Actual Current Required Notice Period
An Underwriting Agent Answers Risk-Zone Questions (Flood Zone, Wildfire Risk Tier, Hurricane Exposure Band) from Facts Memorized During Pretraining Instead of Calling the Live Catastrophe-Model or Mapping Tool It Has Available, Producing Risk Assessments Based on Outdated Zone Designations
A Fraud-Detection Agent Screening Claims for SIU Referral Applies a Generic Fraud-Typology Pattern Absorbed During Pretraining (e.g., a Widely Discussed Staged-Collision Pattern or a Generic Soft-Tissue-Injury Red-Flag Profile) Instead of Querying the Live, Internally Maintained SIU Red-Flag List That the Carrier Has Available as a Tool, Missing a Recently Added Red Flag Specific to a Current Fraud Ring or Failing to Apply a Recently Retired Flag the Carrier Stopped Using Because It Generated Excessive False Positives
A Claims-Processing Agent Determining the Statutory Deadline by Which a Claim Must Be Acknowledged, Investigated, or Paid Under a Given State's Prompt-Payment Law Answers From a General, Memorized Sense of Typical State Deadlines Formed During Pretraining Instead of Calling the Live Regulatory-Requirements Tool It Has Available, Producing a Processing Timeline Based on an Outdated or Generic Deadline Rather Than the State's Actual Current Statutory Requirement