Skip to content

Category: Impact Evaluation

The Sustainability Illusion

I had just finished my Masters in Economics at the Université de Montréal in December 2000 when the Québec Ministry of International Relations announced that it was funding an internship at the International Fund for Agricultural Development (IFAD), one of the three Rome-based development agencies of the United Nations.

Knowing I was going to start a PhD in agricultural and applied economics the following fall, I applied and eventually got the internship. But one thing that struck me from the beginning — from my initial interview with Ministry of International Relations officials, that is — was the emphasis on “sustainable” development.

Wikipedia defines sustainable development as

a pattern of economic growth in which resource use aims to meet human needs while preserving the environment so that these needs can be met not only in the present, but also for generations to come.

The adoption of sustainable development policies is a laudable goal, but given that we often have a hard time knowing whether specific development interventions actually “work,” I suspect it’s even more difficult to know whether specific development interventions (i) actually work and (ii) preserves the environment.

That Thing Called Causality

Any social scientist worth his or her salt knows how difficult it is to make causal statements, i.e., to test whether a variable D (e.g., some development intervention) causes increases in another variable Y (e.g., welfare).

The difficulty usually arises because of the presence of confounding variables. Some of those confounding variables can be measured, but it is almost always the case that some confounders go unmeasured, which compromises the identification of causal relationships.

To solve the identification problem, social scientists rely on experimental or quasi experimental research designs. That is, setups in which D is assigned randomly or in which some plausibly exogenous source of variation is used to make D as good as random.

Causality Squared

But even with an experimental or quasi experimental design, it can be difficult to identify whether an increase in X at time T causes a change in Y at time T+1. So how do we know whether (i) the same change will be maintained at, say, T+50 (i.e., whether the intervention still works) and (ii) both the increase in X and the change in Y have preserved the environment (i.e., whether it is sustainable).

In other words, it is difficult enough to know whether something works in a cross-section, how are we to know whether it will preserve the environment in the future? How distant of a future should we be considering, exactly? What assumptions should we make about the fundamentally unpredictable future? And how are we to rule out potential the kind of negative feedback that would undermine the environment in other ways?

There are likely many people working in development nowadays who “just know” that the interventions they propose or are working on are sustainable, much like there were many people working in development 10 or 15 years ago who “just knew” that the interventions they proposed or were working on “worked.”

In other words, the identification problem is about a hundred times worse when one starts considering the future, and my hunch is that “sustainable development” is just a buzzword. There is clearly a case for more T in experiments.

Update: Of course, this post says nothing about learning about sustainability from the past. The point of this post was ex ante — not ex post — sustainability.

The Third Pillar of Microfinance: Insurance for the Poor in Developing Countries

Over the last few years, index insurance has been receiving an increasing amount of attention from researchers and policy makers.

Whereas regular insurance pays out when a verifiable loss is incurred (e.g., flood insurance pays out when there has been a flood), whether an index insurance pays out depends on whether some index crosses a certain threshold. So for example, a rainfall index insurance for the agricultural producers in a given region would pay out when growing conditions in that region are too dry, i.e., when rainfall falls below a specific, predetermined threshold.

The beauty of index insurance is that it greatly reduces the scope for moral hazard. Indeed, if I insure your crop, you might well decide to neglect your field, do nothing for the entire season, and wait for me to give you a payout. Not so with index insurance, since the index (e.g., rainfall, temperature, etc.) is typically very difficult to manipulate.

LATE with Multiple Instrumental Variables

(If you are a new reader, this post is a bit more technical in nature and follows up on a three-part series published over the past few weeks. Click the following links for parts 1, 2, and 3.)

A colleague writes:

I have been enjoying your posts on the LATE. It got me thinking, as the number of instruments increases, does the LATE approach the ATE? Put another way, as the R2 of the instrumenting equation approaches 1, does the LATE converge to the ATE?