Skip to content

Category: Uncategorized

‘Metrics Monday: Statistical vs. Economic Significance

I had to address the topic of significance–broadly defined–at some point in this series of posts. With that said, this post is not about the seeming arbitrariness of the conventional levels of significance, i.e., of the 10, 5, and 1 percent levels of significance. First, because like Ellickson (1994), I believe that social norms emerge and evolve to minimize transactions costs, and the conventional levels of significance do just that by minimizing the amount of explanation producers of empirical findings have to provide for their findings and by minimizing the amount of thinking the consumers of empirical findings have to do in order to figure out just how (statistically) significant those findings are. In other words, the conventional levels of significance provide something for everyone to hang their hat on, and they are easy to explain to the general public.

And second, because as Noah Smith noted last summer, “[d]issing p-values in 2015 is a little like dissing macroeconomics in 2011–something that gives you a free pass to sound smart in certain circles … But like all hipster fads, I expect this one to fade.”

Rather, this post is about statistical vs. economic significance. Every so often, you run into a paper in which the authors have a good story, a good identification strategy, and robust, statistically significant findings, but in which there is little to no discussion of the findings’ economic significance.

What Are the Welfare Impacts of Fat Taxes and Thin Subsidies?

It’s not every day you come across a new paper and you think “This is the stuff graduate syllabi are made of.” From a fascinating new article by Jayson Lusk and coauthors in the Economic Journal:

We conducted an experiment to study the fiscal impacts of unhealthy food taxes and healthy food subsidies on very low and medium income women in France. The policies tend to be regressive and favor the higher income consumers. Unhealthy food taxes increase prices paid more for low than higher income women. Healthy food subsidies reduce the prices paid more for higher than lower income women. The effects arise because the pre-policy diets of the higher income women tend to be healthier but also because the choices of the higher income women are more responsive to price changes.

Concurrent with the publication of the article in the EJ, Jayson also had a post last week in which he discussed the article’s findings:

AJAE Virtual Special Issue on Development Economics

The American Journal of Agricultural Economics (AJAE), the top journal in the field of agricultural and applied economics, has a new virtual special issue (VSI) out on development economics. The introduction to the VSI begins as follows:

In his 1979 Nobel Prize Lecture, development economist Theodore W. Schultz observed: “Most of the people in the world are poor, so if we knew the economics of being poor, we would know much of the economics that really matters. Most of the world’s poor people earn their living from agriculture, so if we knew the economics of agriculture, we would know much of the economics of being poor.” The subsequent years have seen rapid urbanization in many countries, but the insight that agriculture is crucial to the economic lives of many of the world’s poor remains important to policy-makers and researchers alike. As a testament to the enduring validity of Schultz’s statement, agriculture has experienced a resurgence among development economists in the past decade.

This virtual issue of the American Journal of Agricultural Economics showcases ten recent articles that have pushed the frontiers of empirical development economics.

Among others, the VSI includes papers by Jean-François Maystadt and Olivier Ecker on extreme weather and civil war, by Jesse Tack and Jenny Aker on mobile phones and trader behavior, by Hope Michelson on supermarkets and smallholder farmers, by Klaus Deininger and Songqing Jin on sharecropping and investment behavior, by Erwin Bulte et al. on double blind randomized controlled trials, and by yours truly on food prices and social unrest. It is quite an honor to be in such distinguished company and to have one of the papers I have had the most fun writing be selected for this VSI.

ht: Paul Kelleher.