Though there was a time where critics of development economics could get away with throwing around terms like “neoliberal” and “Washington consensus” around in order to be heard by policy makers, it seems that nowadays, the views of development economists largely prevail in development policy. Part of that is most likely due to the overwhelming focus of development economists on answering narrower but answerable questions. That is, on questions like “Do deworming drugs improve educational outcomes?” rather than on questions like “Do structural adjustment programs foster economic growth?”
The focus on smaller questions has led to impact evaluation activities that are much more credible than they used to be. Whereas in the 1980s and 1990s one could get away with comparing outcomes pre- and post-intervention, today any impact evaluation worth its salt has to have a credible research design, i.e., one that allows credibly estimating the causal impacts of a given intervention.
So in the last few years, “impact evaluation” has become quite the buzzword, and everyone — from the greenest of students in Masters programs in development to the development NGOs, and from the big development agencies like USAID to philanthropies like the Gates Foundation — is obsessed with impact evaluation.
That’s a good thing, at least on the face of it: If we know what works, we can better target development interventions, and so development policy can more effectively lift people out of poverty.
Not in my Backyard?
But does everyone really want to be evaluated? I’ve long suspected that, for many actors in development policy, but specifically for NGOs, the answer is “No.” Indeed, many people work with NGOs because they are true believers in the mission of the NGO they work for. Oh, sure: they’ll talk about impact evaluation because the donors want to hear about it. But do they really want to be evaluated? On the one hand, there are true believers. On the other hand, there are those who think “Well, what if an impact evaluation finds no impact? In my heart of hearts I know what we do is right.”