An old joke describes a man searching for his keys under a streetlight. When asked if he lost them there, he replies: "No, I lost them in the alley, but the light is better here."
This joke captures one of the most pervasive and costly biases in decision-making: the tendency to focus our attention, analysis, and resources on areas that are easy to examine rather than areas where the answer actually lies.
How the Streetlight Effect Distorts Decisions
The streetlight effect operates at every level of decision-making:
Individual level: We rely on easily available information rather than seeking out the hard-to-find data that would actually inform our choice. We check the sources we already know rather than venturing into unfamiliar territory where the real insights might be.
Organizational level: Companies invest in analyzing what their existing systems can measure rather than building new measurement capabilities for what actually matters. Marketing analytics get sophisticated attention while product-market fit questions -- harder to answer -- get ignored.
Research level: Scientists study questions that their available tools can answer rather than questions that most need answering. The decision-making scenarios illustrate how this bias leads entire fields astray.
Why This Bias Is So Persistent
Several forces make the streetlight effect especially resistant to correction:
Cognitive ease: Our brains prefer the path of least resistance. Searching where information is readily available feels productive, while searching in unexplored territory feels frustrating and uncertain.
Accountability pressure: In organizations, it is easier to justify decisions based on available data than to explain why you spent resources looking for data that might not exist. "We analyzed the numbers" is a defensible statement; "We followed a hunch into uncharted territory" is not.
Tooling bias: We naturally gravitate toward problems our existing tools can solve. If you have a hammer, everything looks like a nail. If you have a spreadsheet, every decision looks like a quantitative analysis.
Overcoming the Streetlight Effect
The core principles of good decision-making offer several strategies:
Ask "where would the answer actually be?": Before starting your search, explicitly identify where the most relevant information is likely to reside, regardless of how accessible it is. Then design your search to include those locations.
Allocate a "dark search" budget: Deliberately set aside time and resources for exploring areas that are difficult to examine. This forces you to look beyond the well-lit areas.
Seek disconfirming evidence: The streetlight effect biases us toward confirming information because confirming evidence is usually easier to find. Actively seeking disconfirming evidence pushes us into harder-to-search territory.
Consult outsiders: People from different backgrounds will have different streetlights. What is hard for you to see might be obvious to someone with different expertise or perspective. The decision masters consistently sought diverse viewpoints precisely to compensate for their own blind spots.
The Information Paradox
The streetlight effect creates a paradox: the information most likely to change your decision is usually the hardest to obtain. Easy information is easy precisely because everyone already has it, which means it is already priced into the conventional wisdom. The alpha -- the unique insight that leads to better decisions -- almost always lives in the dark.
This means that the difficulty of obtaining information is actually a positive signal. If a question is hard to answer, the answer is more likely to be valuable. If an area is hard to investigate, it is more likely to contain genuine insight.
Practical Application
Next time you face an important decision, try this exercise: list all the information sources you plan to consult. Then ask yourself: am I looking here because the answer is likely here, or because it is easy to look here? If the latter, deliberately expand your search into uncomfortable territory.
For more frameworks on overcoming cognitive biases in decision-making, explore the KeepRule blog and browse the FAQ for practical guidance.