The Challenge
Zillow's "Zestimate" — their automated home valuation tool — was famous for predicting home prices. In 2018, Zillow launched "Zillow Offers" (iBuying): they would use the Zestimate to buy homes directly, renovate them, and resell them for profit.
The thesis: if our algorithm can predict home values accurately, we can be the most efficient home flipper in the world.
The Approach — Tools in Action
The Zestimate has a median error rate of ~2%. That sounds small, but on a $500,000 home, 2% is $10,000. When you're buying and selling thousands of homes, systematic errors in one direction become catastrophic. And the algorithm couldn't predict market shifts — it was trained on historical data.
What they needed — Cynefin Framework:Real estate markets are a complex system (not merely complicated). In complex systems:
- Cause and effect are only clear in retrospect
- Patterns emerge but can't be predicted precisely
- Small changes (interest rate shifts, sentiment changes) cascade unpredictably
Zillow treated it as a complicated system (predictable with the right algorithm). This was the fundamental error.
Pre-mortem would have identified the risk:"Imagine Zillow Offers has lost a billion dollars. Why?"
- The algorithm systematically overpaid because it couldn't predict market shifts
- We bought thousands of homes at peak prices, then the market softened
- Renovation costs exceeded estimates
- We couldn't sell fast enough, holding inventory in a declining market
- Each unsold home ties up capital and depreciates
All of these happened.
Connection Circles would have revealed the dangerous feedback loop:Buy homes → inventory grows → must sell to free capital → selling in a soft market depresses prices → algorithm still buying at old (higher) prices → losses mount → forced to sell faster → prices drop further → accelerating losses.
The Outcome
Zillow Offers was a financial disaster:
- Lost $881 million on the iBuying program
- Had to sell ~7,000 homes at a loss
- Laid off 2,000 employees (25% of workforce)
- The stock dropped over 70% from its peak
- Completely shut down the iBuying division in November 2021
- Their entire business was iBuying (focused resources)
- They had more conservative pricing algorithms
- They adjusted faster to market changes
Zillow treated iBuying as a "side bet" powered by an algorithm — without the operational discipline needed for a real estate business.
Key Takeaway
An algorithm that works for *estimating* values may not work for *acting* on those estimates at scale. Use the Cynefin Framework to classify your problem correctly: real estate markets are complex (emergent), not complicated (predictable). In complex systems, test small before committing big.
Tools Used in This Story
Confidence determines speed vs. quality
Decision MakingDetermine a trade-off between speed and quality when building products
Cynefin Framework
Decision MakingMake sense of different situations to choose an appropriate response
Pre-mortem
Decision MakingImagine failure before it happens to prevent it
Connection Circles
Systems ThinkingUnderstand relationships and identify feedback loops within systems