A few weeks ago, one of my doctoral advisees wrote to me asking me how she could test for a specific mechanism behind the causal effect she is trying to estimate in her job-market paper.<\/p>\n
Letting [math]y[\/math] be her outcome of interest,\u00a0[math]D[\/math] her treatment of interest,\u00a0[math]x[\/math] be a vector of control variables, and [math]\\epsilon[\/math] be an error term with mean zero, my student was estimating<\/p>\n
(1) [math]y = \\alpha_{0} + \\beta_{0}{x} + \\gamma_{0}{D}+\\epsilon[\/math],<\/p>\n
in which she was interested in\u00a0[math]\\gamma[\/math], or the causal impact of\u00a0[math]D[\/math] on\u00a0[math]y[\/math].<\/p>\n
But more importantly for the purposes of this post, she was also interested in whether\u00a0[math]M[\/math] is a mechanism through which\u00a0[math]D[\/math] causes\u00a0[math]y[\/math]. I suggested\u00a0the usual thing I often see done, which is to estimate<\/p>\n
(1′) [math]y = \\alpha_{1} + \\beta_{1}{x} + \\phi_{1}{M} + \\gamma_{1}{D}+\\nu[\/math],<\/p>\n
in which case if [math]\\gamma[\/math] dropped out of significance and [math]\\phi[\/math] was significant (and had the “right”) sign, then she could say that [math]M[\/math] was a mechanism through which [math]D[\/math] cause [math]y[\/math]. I also suggested maybe conducting a\u00a0Davidson-MacKinnon J-test for non-nested hypotheses<\/a>\u00a0to assess the robustness of her mechanism finding.<\/p>\n As it turns out, the standard method of testing for mechanisms show in in equation (1′) above is wrong. A few days after my student asked me how to test for her posited mechanism, my colleague Jason Kerwin<\/a> (if you don’t already know of his work, you should) commented in a different context at our Friday Trade and Development seminar that this was a mistaken way to do it, and talked about a recent paper by Acharya et al. (2016)<\/a> in the American Political Science Review<\/em>\u00a0in which the authors:<\/p>\n As if that weren’t important enough, Acharya et al.’s method allows doing one thing that social scientists often dream of doing, viz. ruling out all other possible mechanisms, beyond any reasonable (i.e., statistical) doubt.<\/p>\n That is, their method not only tells you whether [math]M[\/math] is a\u00a0mechanism through which [math]D[\/math] causes [math]y[\/math], it can also tell you whether there is any significant amount of statistical variation left in the causal relationship flowing from<\/em>\u00a0[math]D[\/math] through\u00a0<\/em>[math]y[\/math] after\u00a0<\/em>[math]M[\/math] is accounted for<\/em>. In my experience<\/a>, this really is the most powerful part of Acharya et al.’s contribution.<\/p>\n Acharya et al.’s paper should be read in its entirety, but briefly, their method consists in the following for the example above:<\/p>\n The coefficient of interest is still [math]D[\/math], but it now tells us what is the effect of the treatment variable after removing the effect of the mechanism. This means that if one fails to reject the null hypothesis that [math]\\kappa = 0[\/math], this means that the treatment itself has no effect on the dependent variable once the mechanism is taken into account.*<\/p>\n (The setup in steps 2 to 4 above relies on generated regressors, the whole procedure needs to be bootstrapped, which is why Acharya et al. provide R and Stata codes;\u00a0there are two typos in their Stata code; if you’d like to use it, As soon as I realized what\u00a0Acharya et al.’s method could do,\u00a0I had to try it out. In a paper I am working on with coauthors, we look at whether participation in contract farming provides partial insurance to growers by way of reducing income variability. Our preliminary findings suggest that yes, participation in contract farming does reduce income variability, and thus provide growers with a means of partially insuring against income fluctuations.<\/p>\n One of the theoretical predictions in our paper is that this happens via the presence in the data of fixed-price contracts–that is, contracts which guarantee a given price per unit. Using Acharya et al.’s method, I find that fixed-price contracts appear to be the only mechanism by which participation in contract farming provides partial insurance. More on this paper in a few months, when it is ready to circulate.<\/p>\n UPDATE: After receiving several emails asking me for it, here is the fixed up Stata code. Keeping the above notation, the following code (i) removes the semicolon on the last line, which prevented the code from running in my version of Stata, and (ii) multiplies\u00a0[math]\\hat{\\phi}[\/math] by\u00a0[math]M[\/math] when computing\u00a0[math]\\tilde{Y}[\/math]:<\/p>\n ___<\/p>\n * There is no way a blog post can render justice to a paper as rich and interesting as Acharya et al.’s, and their argument is more complicated. Again, the paper should be read in full to fully understand\u00a0the assumptions behind and the limitations of their method.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":" A few weeks ago, one of my doctoral advisees wrote to me asking me how she could test for a specific mechanism behind the causal<\/p>\n\n
\n
email me<\/del>\u00a0 see below.)<\/p>\ngen y_tilde=.\r\ncapture program drop deboot\r\nprogram define deboot, rclass\r\n#delimit ;\r\nregress y M D x_0 x_1;\r\nreplace y_tilde = y - _b[M]*M;\r\nregress y_tilde D x_0;\r\nreturn scalar deffect = _b[D];\r\n#delimit cr\r\nend\r\nbootstrap deffect = r(deffect), reps(500) seed(123456789): deboot<\/pre>\n