3D Reasoning Collapse
Model Cannot Reason About 3D Structure from Single 2D Image
Computer vision AI failures — image and vision-model mistakes in agentic systems
43 patterns
Computer vision AI failures — image and vision-model mistakes in agentic systems. We've tracked 43 distinct Computer Vision AI patterns across production AI agent deployments — most commonly in Vision and Images systems. One recurring example: 3D Reasoning Collapse — Model Cannot Reason About 3D Structure from Single 2D Image
Each pattern below documents the specific failure mode, why it happens, and how teams have mitigated it in practice — use this page as a reference when building guardrails, writing evals, or debugging an agent that's already misbehaving in this way.
Model Cannot Reason About 3D Structure from Single 2D Image
Model Misclassifies Images Modified by Small Adversarial Perturbations (Imperceptible to Human)
Repeated Generation/Regeneration of Same Content Introduces Synthetic Artifacts
Vision Model Detects Incorrect Attributes of Existing Objects
Inaccurate Object Localization; Bounding Boxes Don't Match Actual Object Boundaries
Model Fails When Images Compressed (JPEG Artifacts); Accuracy Sensitive to Compression Quality
Model Confidence Doesn't Match Hallucination Probability
Generated Images Lack Consistency Across Multiple Generations (Same Subject, Different Outputs)
Model Fails to Properly Aggregate Context from Multiple Images; Makes Decisions Based on Incomplete Context
Model Fails to Match or Reference Objects Across Different Images
Monocular Depth Estimation Wrong; 3D Positioning Fails
Vision models fail to accurately estimate depth from single images; hallucinate depth cues when monographic features (shadows, perspective, texture) are ambiguous or misleading
Model Fails to Detect Logical Contradictions Across Multiple Images
Model Highly Sensitive to Lighting Conditions and Color Changes; Fails Under Different Illumination
Model Performance Collapses on Low-Resolution Images; Cannot Recognize Objects When Downsampled
Generator Produces Repetitive, Low-Diversity Outputs (Mode Collapse)
Information from Multiple Frames/Views Not Properly Combined; Fusion Produces Worse Results Than Single Frame
When given multiple images of same scene/object from different angles, vision models produce inconsistent spatial reasoning; 3D reconstruction conflicts across views; same object described differently depending on which image model processes first
Vision-language model hallucinates detail in image description; downstream reasoning steps amplify and compound hallucination, reaching absurd conclusions despite initial hallucination being small
Vision Model Detects Objects Not Present in Image
Model Cannot Maintain Consistent Object Track Across Multiple Frames; Loses or Confuses Identities
Model Fails to Reason About Occluded (Partially Hidden) Objects
Vision models fail to correctly reason about occluded objects; assume objects have properties they can't see (like internal structure, color, or continuation behind occluding object)
Model Cannot Detect When Input Is Out-of-Distribution; Makes Confident Predictions on Unknown Objects/Scenes
A vision model recognizes objects from frontal views but fails on the same objects rotated, tilted, or viewed from unusual angles. Training data skews heavily toward canonical frontal views, so accuracy drops sharply — sometimes by more than half — the further an object's actual orientation strays from that norm.
Vision models misinterpret perspective distortion; assume objects are deformed when they're actually normally-shaped but viewed from non-frontal angles; or fail to account for perspective when estimating actual object dimensions
Generated Image Quality Degrades Over Multiple Generation Iterations or Long Sequences
Model Detects Rare/Uncommon Objects Not Present in Image
Model Misunderstands Spatial Relationships Between Objects
Model Fails When Images Are Rotated or Viewed from Different Perspectives; Not Rotationally Invariant
Model Generates Unsafe Content Despite Safety Filters (Bypasses Moderation)
Model Overemphasizes Visually Salient Features, Ignoring Context
Model Fails to Distinguish Objects of Different Scales; Confuses Small/Large Versions
Vision Model Detects Entire Scenes or Complex Contexts Not Present in Image
Generated Images Slowly Diverge from Original Prompt Intent Over Iterations
Vision models correctly identify objects but estimate their absolute size (mm, cm, meters) incorrectly; errors range 2x-10x when no reference object is visible; relative sizing also fails when all objects are unfamiliar
Model Fixates on Image Center or Edges; Misses Objects in Peripheral Regions
Vision models fail to correctly reason about 3D spatial relationships (above/below, left/right, inside/outside, containment) from single or multiple images; errors increase with scene complexity and ambiguous viewing angles
Model Fails to Track Object Identity or State Changes Across Frames
Truncated Prompts/Conditions Lead to Artifacts When Input Exceeds Token Limit
Model Hallucinates Training Data Artifacts, Overfitting to Dataset Biases
Vision-language models fail to accurately count grid cells in low-resolution or small-cell images; state-of-the-art models hallucinate counts at specific cell sizes
Vision-language models misinterpret visual boundaries because patch tokenization (dividing images into 14×14 or 16×16 pixel blocks) misaligns with semantic boundaries; objects split across patches create corrupted representations