Examine the Evidence
The fourth step in the ContextOS process — gathering and evaluating evidence.
The Core Argument
Evidence is the foundation of good judgment. Without evidence, decisions are based on assumptions, guesses, and wishful thinking.
Once we understand the situation, clarify the problem, and identify the friction, the next step is to examine the evidence. What do we know? What do we need to know? What evidence supports or challenges our assumptions?
This step is often rushed. People make decisions based on incomplete information. They assume they know more than they do. They confuse opinions with facts.
Evidence is what separates judgment from guesswork.
Types of Evidence
The different kinds of evidence that can inform decisions.
Quantitative evidence
Data, metrics, statistics, measurements. Evidence that can be counted, compared, and analysed.
Qualitative evidence
Stories, experiences, observations, interviews. Evidence that captures nuance and context.
Expert judgement
The knowledge and experience of people who have deep understanding of the domain.
Historical evidence
What has happened before? What can we learn from past experiences and outcomes?
The Acacia perspective:
No single type of evidence is sufficient. Good judgment requires triangulating across multiple types of evidence — quantitative, qualitative, expert, and historical.
How to Examine Evidence
A structured approach to gathering and evaluating evidence.
Identify what you know
What do you already know? What evidence do you have? What is the quality of that evidence?
Identify what you don't know
What are the gaps in your knowledge? What evidence do you need to gather?
Assess the quality of evidence
Is the evidence reliable? Is it relevant? Is it current? Is it representative? Not all evidence is created equal.
Synthesise and weigh
Bring the evidence together. What does it tell you? What is the weight of the evidence? What are the patterns and conclusions?
Key insight:
Examining evidence is not about proving you are right. It is about finding out what is true. This requires intellectual honesty and a willingness to be wrong.
The Tools
How ContextOS helps you examine evidence.
Evidence inventory
ContextOS provides a structured way to inventory evidence — what you have, what you need, and what is missing.
Evidence quality assessment
ContextOS provides frameworks for assessing the quality of evidence — reliability, relevance, currency, representativeness.
Synthesis templates
ContextOS provides templates for synthesising evidence — helping you bring together different types of evidence and identify patterns.
Assumption surfacing
ContextOS helps you surface and test assumptions — distinguishing between what is known and what is assumed.
The Acacia perspective:
Examining evidence is the discipline that separates good judgment from guesswork. ContextOS provides the tools to practice this discipline systematically.
The Practice
How to make evidence examination a habit.
Ask "What's the evidence?"
Make it a habit to ask "What's the evidence?" whenever you hear a claim or an assumption. This surfaces the basis of decisions.
Seek disconfirming evidence
Actively look for evidence that challenges your assumptions. This is how you avoid confirmation bias.
Document the evidence
Document the evidence that informs your decisions. This creates a record that can be reviewed and learned from.
Review and refine
As you gather more evidence, review and refine your understanding. Evidence is not static — it grows and changes.
Key insight:
Examining evidence is a practice, not an event. It is something you do continuously — not just when you are making a big decision.
Reading path: