occams-razor

name: occams-razor description: Choose simpler explanations over complex ones when both explain the evidence equally well, avoiding unnecessary assumptions

Occam's Razor

Overview

Occam's Razor (Principle of Parsimony) states: when choosing between competing explanations that make equally accurate predictions, prefer the one requiring fewer assumptions. Named after 14th-century philosopher William of Ockham, it's a foundational heuristic in science and problem-solving. The key: this applies ONLY when explanations have equal explanatory power - it's not about oversimplifying, but avoiding unnecessary complexity.

When to Use

• Debugging systems when multiple theories could explain a failure
• Evaluating competing scientific theories or hypotheses
• Medical diagnosis with multiple possible conditions
• Choosing between architectural designs with similar capabilities
• Deciding between simple vs. complex solutions to a problem
• Avoiding conspiracy theories or over-complicated explanations

The Process

Step 1: Identify Competing Explanations

List all plausible explanations for the phenomenon you're investigating. For a production outage: network failure, database corruption, memory leak, DDoS attack, configuration error, hardware failure.

Example: Your website is down. Possible causes: DNS misconfiguration, server crash, code deployment bug, cyber attack, hosting provider outage.

Step 2: Evaluate Explanatory Power

Assess whether each explanation actually accounts for the observed evidence. Eliminate theories that don't match the facts. If your logs show successful requests until exactly 2 PM deployment, theories involving hardware failure (gradual) don't fit.

Step 3: Count Assumptions Required

For explanations that fit the evidence equally well, list the assumptions each requires. Simple explanation: "deployment introduced a bug" (assumes: code changed, bug wasn't caught in testing). Complex: "coordinated attack timed with deployment" (assumes: attackers knew deployment time, bypassed security, timed perfectly, left no attack signatures).

Step 4: Choose Fewer Assumptions

Select the explanation requiring the fewest additional assumptions. This doesn't guarantee correctness - it identifies the most likely explanation to investigate first. Save complex theories for when simpler ones fail.

Example: Website went down at deployment time → investigate the deployment first (1-2 assumptions) before investigating coordinated cyber attacks (5+ assumptions).

Step 5: Test and Iterate

Verify your chosen explanation through testing. If the simple explanation is wrong, move to the next-simplest theory. Occam's Razor is a heuristic for prioritizing investigation, not a guarantee of truth.

Example Application

Situation: In medicine, a patient presents with fatigue, weight loss, and fever. Multiple diseases could explain this: common viral infection, rare tropical disease, cancer, autoimmune disorder, chronic fatigue syndrome.

Application: Doctors apply "when you hear hoofbeats, think horses, not zebras" (medical version of Occam's Razor). Test for common conditions first (viral infection - requires few assumptions: patient exposed to virus). Only pursue rare diseases (tropical parasites - requires assumptions: recent travel, exposure to specific vectors) if common explanations fail.

Outcome: 95%+ of cases resolve with simple explanations. Testing for rare diseases first wastes time/money and delays treatment. But when simple tests fail, doctors DO pursue complex diagnoses - Occam's Razor prioritizes, doesn't eliminate.

Anti-Patterns

• Using Occam's Razor to dismiss complexity when evidence actually requires it (oversimplifying)
• Applying it when explanations don't have equal predictive power (choosing "simple but wrong" over "complex but accurate")
• Confusing "fewer assumptions" with "easier to understand" (quantum mechanics is simpler than hidden variables, but harder to grasp)
• Using it to avoid investigating when simple explanation already failed tests
• Treating it as proof rather than a heuristic for prioritizing investigation

Real-World Business Examples

Startup Failure Analysis Company loses 50% of users in one month. Possible causes:

• Simple: Major competitor launched, pricing change upset users, critical bug
• Complex: Coordinated sabotage, algorithm conspiracy, market manipulation Start with data on competitor launches and product changes before complex theories.

Software Performance Application slows down after update:

• Simple: New code has inefficient query, memory leak, cache not warming
• Complex: Hardware degradation + cosmic rays + database index corruption + network interference Investigate code changes first - they have highest prior probability.

Bayesian Foundation

Occam's Razor emerges naturally from Bayesian probability theory:

• Simpler hypotheses have fewer free parameters
• Fewer parameters = higher prior probability (less specific claim)
• Same fit to data + higher prior = higher posterior probability
• Mathematical formalization: Minimum Description Length (MDL) principle

This explains WHY simpler is better: not philosophical preference, but mathematical consequence of probability theory.

Common Pitfalls

• Oversimplification: Ignoring evidence that demands complexity
• Premature conclusion: Accepting simple explanation without testing
• Confusing simple with familiar: Choosing comfortable over genuinely parsimonious
• Avoiding necessary complexity: World is sometimes complex - embrace when warranted
• Using as proof: Razor prioritizes investigation, doesn't prove correctness

Historical Evolution

14th Century: William of Ockham formulates "Entities should not be multiplied beyond necessity" 17th-18th Century: Becomes central to scientific method 20th Century: Formalized in information theory (Solomonoff, Kolmogorov complexity) 21st Century: Applied to machine learning (regularization, model selection)

Success Metrics

• Faster time to correct diagnosis (start with high-probability causes)
• Fewer wasted resources on unlikely scenarios
• More testable hypotheses (simpler = easier to falsify)
• Better decision quality under uncertainty
• Reduced analysis paralysis

Relationship to Other Frameworks

• Hanlon's Razor: Specific application (prefer incompetence over malice)
• Hitchens's Razor: Applied to claims (dismiss unfounded assertions)
• KISS Principle: Design philosophy (Keep It Simple, Stupid)
• Minimum Viable Product: Start simple, add complexity only as needed
• First Principles Thinking: Strip to essentials, rebuild from simplicity

Key Insight

Occam's Razor is not a statement about reality (claiming the world is simple), but a rational strategy for investigation: simpler hypotheses have higher prior probability, are easier to test, and should be checked first. Complexity should be adopted only when evidence demands it.

Primary Sources: William of Ockham (14th century), Bayesian statistics, Solomonoff induction Practitioner: Science, medicine, engineering, debugging, business analysis Complexity: Low - concept simple, application requires judgment Estimated Learning: 20 minutes to understand, career to master judicious application