Measurement & Evaluation

Rethinking the E Word

Broadening the definition of evidence can lead to more confident and informed philanthropic decisions.

The Value of Strategic Planning & Evaluation The Value of Strategic Planning & Evaluation In this ongoing series of essays, practitioners, consultants, and academics explore the value of strategy and evaluation, as well as the limits and downsides of these practices.

Evidence-based philanthropy. To some, that phrase offers the promise of long-overdue rigor. If the first principle of philanthropy and social impact is to do good, then evidence-based philanthropy ensures that we honor its corollary: Do no harm.

To others, that phrase represents all that is going wrong with philanthropy and social innovation—the rise of the ivory-tower theorists and technocrats whose logic models and fixation with metrics blind them to real-world knowledge and common sense.

It’s time to rethink that pesky E word: evidence.

Evidence = Observations

The problem is that “evidence” means different things to different people.

For a veteran program manager, evidence might mean 30 years of seeing what has and hasn’t helped the people her nonprofit serves. For an individual donor, evidence might be seeing a class of low-income students he has supported since kindergarten graduate and become the first in their families to attend college. For an epidemiologist, evidence might be the results of a randomized control trial study proving the causal link between use of insecticide-treated bed nets and reduction of deaths due to malaria.

We spend a lot of time arguing over what kind of evidence matters most. But those arguments miss the mark. Each of the examples above is a relevant and valid approach to evidence. They simply answer different questions.

Field experience provides answers to questions like, “Who in the community will make or break the program’s success?” Informed opinion answers questions such as, “What issues should we prioritize?” and “What conditions signal that now is the time to act?” Traditional academic research answers, “Did our activities make a difference, and are we sure it wasn’t just due to chance or some other factor?’

In all of these cases, “evidence” is the result of careful observation, providing answers that give people confidence that what they are doing is right and leading to the change they seek.

And if one role of philanthropy is to solve the tough problems—those that remain despite government and business efforts—we need all the answers we can get.

Broadening the Definition of Evidence: Three Circles

Here at the Center for High Impact Philanthropy, “evidence-based” has always meant accessing the best available information from three different sources, or circles of evidence:  

  1. Research or scientific evidence such as the results of randomized controlled trials (RCTs) and statistical models designed to link cause and effect.
  2. Field experience such as the practical knowledge of beneficiaries and program providers. These insights help explain how programs work in real-world conditions, when human behavior and implementation challenges come into play.
  3. Informed opinion such as the views of policymakers or other stakeholders whose perspectives provide context for evaluation results and field experience.

(Image courtesy of the Center for High Impact Philanthropy)

Each source of evidence has its strengths and limitations. For example, the results of a randomized control trial study may definitively show that use of a bed net reduces malaria or that a particular program increased graduation rates among a cohort of children at risk for dropping out. But it’s the observations of a village grandmother or community health worker that help us understand how to prevent people from using that bed net as a fishing net; it’s the insight of a great teacher or counselor that helps us recognize what a 9th-grade girl in East Palo Alto needs to succeed and how that might be different from what a 9th-grade boy in North Philly needs.

And while the beneficiaries themselves may not know the latest metrics, policy trends, or strategic planning behind a particular nonprofit or funder’s work, they are the ultimate authorities on whether a change created by a program represents a meaningful improvement in their lives.

So next time you see an argument about the E word, think of this: Rather than simply celebrating the advance of strategy and more rigorous evaluation in philanthropy, or defending the primacy of instinct and practical wisdom, let me propose a third way. Broaden what you mean by evidence. Because no matter what issue or cause you care about, the more each source of evidence—research, informed opinion, field experience—points to the same path, the more confident we can all feel that we’re headed in the right direction.

Tracker Pixel for Entry


  • lrjackson's avatar

    BY lrjackson

    ON March 6, 2014 06:52 AM

    I really appreciate your post and perspective.  I find far too often we rush to the “answer’ assuming it is somewhere in the ‘data’.  We don’t spend enough time to your point getting clarity on the question we are asking and therefore what is the best evidence to inform us.

  • BY Katherina M Rosqueta

    ON April 24, 2014 12:22 PM

    Belated thanks for your comment. I’m glad you found it helpful!

  • Angela Perez's avatar

    BY Angela Perez

    ON August 11, 2015 10:36 AM

    This is Angela Perez, from Bogota-COLOMIBA. I just read you article (August 11, 2015). It sounds very interesting the circles of evidence. I will try to apply them in a study I am doing about Swisscotact in Colombia, the case of TUMACO.

  • BY Katherina M Rosqueta

    ON August 15, 2015 06:22 AM

    That’s terrific, Angela. Let us know how it goes. Our team is always eager to learn how others are applying the 3 circles (especially given our previous work with Filantropia Transformadora in Colombia!)

  • Thank you Kat. I am now working on a program that will help improve school leadership in one of the provinces in the Philippines. This is a great help.

  • Kat, your are a genius! Something very simple and clear. It’s amazing few, if any, would think and share this

Leave a Comment


Please enter the word you see in the image below:


SSIR reserves the right to remove comments it deems offensive or inappropriate.