Cost Optimization

18 patterns for this goal

Agentic planning, learning, and architecture-level cost waste — distinct from Cost Efficiency’s execution-level patterns (batching, retries, model routing). This goal covers failures where a known cost-optimization technique (plan reuse, prompt caching, adaptive ensembling, negative caching, compression) exists but isn’t applied, or is applied incorrectly.

Failure Patterns

Pattern
Unnecessary Planning Step
No Preplanned Workflow for Frequent Operations
Non-Generalized Plan Template
Under-Planning Costly Rework
Repeated Regeneration of Known-Incorrect Answer
Redundant Self-Reflection Passes
Unbounded Context Growth Across Turns
Prompt Caching Underutilization
Multi-Agent Context Broadcast Waste
Unnecessary Ensemble Voting Overhead
Full Reprocessing on Incremental Change
Prompt Compression Not Applied
Missing Task Specialization

Total: 13 patterns

Embedding Retrieval Applies Wrong Workload's Cost Playbook by Tag Similarity

Frequency: Occasional
Category: Devops

A Cost-Optimization Agent That Selects a Cost-Reduction Playbook for a Flagged Resource by Semantic Similarity Over Its Tags, Name, and Description Pulls a Playbook Written for a Fault-Tolerant Batch Workload -- Recommending Migration to Spot/Preemptible Instances -- and Applies It to a Latency-Sensitive, Interruption-Intolerant Workload That Shares Overlapping Tag Vocabulary but Cannot Tolerate the Same Risk

Missing Task Specialization

Frequency: Common
Category: Operations

Agent stays on generic frontier-model prompting for a high-volume, narrow, repetitive task long after fine-tuning or distillation would outperform it on both cost and quality.

Multi-Agent Handoff Drops "Do Not Resize" Safety Constraint

Frequency: Occasional
Category: Devops

A Cost-Analysis Agent Identifies an Underutilized Instance as a Rightsizing Candidate but Notes in Its Free-Text Reasoning That the Instance Is Excluded Because of an Active Maintenance Freeze or Production-Critical Designation, and a Downstream Execution Agent That Acts on a Structured Candidate List Never Sees the Exclusion Note, Resizing the Protected Instance Anyway

Non-Generalized Plan Template

Frequency: Common
Category: Operations

Agent's "Reused" Plans Are Not Actually Parameterized, So Near-Identical Requests Still Trigger Full Re-Planning Instead of a Template Substitution

Prompt Caching Underutilization

Frequency: Very Common
Category: Operations

A Stable Prompt Prefix (System Prompt, Tool Schemas, Few-Shot Examples) Is Retransmitted and Rebilled at Full Price on Every Call Instead of Using Available Prompt-Caching

Prompt Compression Not Applied

Frequency: Common
Category: Operations

Verbose but Relevant Prompt Content Is Sent Uncompressed at Full Token Cost When Established Compression Techniques Would Preserve Meaning at a Fraction of the Length

Stale Billing Export Treated as Current Spend

Frequency: Occasional
Category: Devops

A Cost-Optimization Agent Calls a Cloud-Provider Billing/Cost-Export Tool to Decide Whether to Autonomously Resize or Terminate Underutilized Resources, the Tool Returns a Cached or Delayed Billing Export That Predates a Recent Spend Spike or Recent Manual Remediation, and the Agent Acts on Spend Data That No Longer Reflects Current Reality