{"id":11349,"date":"2015-09-28T05:00:32","date_gmt":"2015-09-28T09:00:32","guid":{"rendered":"http:\/\/marcfbellemare.com\/wordpress\/?p=11349"},"modified":"2015-09-28T09:22:55","modified_gmt":"2015-09-28T13:22:55","slug":"metrics-monday-regressions-as-ecosystems","status":"publish","type":"post","link":"https:\/\/marcfbellemare.com\/wordpress\/11349","title":{"rendered":"&#8216;Metrics Monday: Regressions as Ecosystems"},"content":{"rendered":"<p>My teaching, service, and editorial responsibilities don&#8217;t leave me much time for research, much less for blogging these days, so I thought I would write up a quick observation about econometrics.<\/p>\n<p>An old friend (not an applied econometrician) writes (via Facebook, in case you wonder about the telegraphic style of the query):<\/p>\n<blockquote><p>Econometrics question &#8211; have a M.Sc. student doing a study on conservation agriculture (CA) and is developing instruments for CA component use. Any suggestions on appropriate instruments?<\/p><\/blockquote>\n<p>My (less-than-helpful) answer:<!--more--><\/p>\n<blockquote><p>What&#8217;s the outcome of interest Y? What&#8217;s the treatment variable\/variable of interest D? What controls X are included? All of those work as a kind of ecosystem&#8211;without knowing what are the component parts of it, I can&#8217;t come up with a good idea for an instrument Z.<\/p><\/blockquote>\n<p>It&#8217;s the regression-as-ecosystem comment that I wanted to discuss today. Indeed, if you are interested in causal effects&#8211;and who isn&#8217;t, these days?&#8211;you have to see any regression of interest as an ecosystem where things live or die as a function of other things in the system.<\/p>\n<p>This is especially the case if you don&#8217;t have an experiment or a quasi experiment, and you have to rely on an instrumental variable (IV) that is nonrandom. In the &#8220;cookbook econometrics&#8221; class I teach every other year to our doctoral students, I tell students that an IV lives and dies by the controls it is surrounded with, a point that is obvious once you start thinking about it, but which is made all too rarely. Indeed, here is something that I bet is taking place almost daily throughout the world in economics seminars:<\/p>\n<ol>\n<li>The presenter\u00a0is interested in the causal relationship flowing from some treatment D to some outcome Y.<\/li>\n<li>The presenter recognizes that Y and D are jointly determined, and is thus using an instrument Z to get at it.<\/li>\n<li>A clever member of the audience says: &#8220;Yes, but have you considered [channel through which Z violates the exclusion restriction]?&#8221;<\/li>\n<li>The presenter says: &#8220;You&#8217;re right&#8211;in principle. Because I have [specific variable] in my set of controls X, the exclusion restriction is still met.&#8221;<\/li>\n<li>Clever member of the audience: &#8220;Ok, okay.&#8221;<\/li>\n<\/ol>\n<p>Here is a real-life example: In my <a href=\"http:\/\/ajae.oxfordjournals.org\/content\/97\/1\/1.short\">food prices and food riots paper<\/a>, in which I was interested in the causal effect of food prices on the extent of social unrest worldwide, I used natural disasters worldwide as an IV for food prices. A few times in seminars, I was asked: &#8220;Yes, but you don&#8217;t control for the income of food consumers, and that&#8217;s an omitted variable.&#8221; Notwithstanding the fact that natural disasters are also orthogonal to income (and that <a href=\"http:\/\/marcfbellemare.com\/wordpress\/11057\">it is not clear that you want to include an obviously endogenous control<\/a> such as income in the regression I was estimating), my response was: &#8220;Yes, but I am regressing on the real&#8211;not nominal&#8211;price of food, which controls for the overall price level and thus, presumably, for wages,\u00a0which themselves determine most people&#8217;s income levels.&#8221;<\/p>\n<p><a href=\"http:\/\/marcfbellemare.com\/wordpress\/wp-content\/uploads\/2015\/09\/Lester.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-11354\" src=\"http:\/\/marcfbellemare.com\/wordpress\/wp-content\/uploads\/2015\/09\/Lester.jpg\" alt=\"Lester\" width=\"474\" height=\"348\" \/><\/a><\/p>\n<p>At any rate, I&#8217;m not sure I have much more of a point than &#8220;All the pieces matter,&#8221; to quote fictional detective Lester Freamon, and that when thinking about causality, you have to consider Y = f(D(Z,X), X) + e as a whole, and not just D(Z) or even Y = D(Z).<\/p>\n<p>If anything, that is where the use of <a href=\"https:\/\/en.wikipedia.org\/wiki\/Directed_acyclic_graph\">directed acyclic graphs<\/a> (DAGs) comes in handy, and why I advocate that our students (i) read (some of) Judea Pearl&#8217;s <em><a href=\"http:\/\/www.amazon.com\/gp\/product\/052189560X\/ref=as_li_tl?ie=UTF8&amp;camp=1789&amp;creative=9325&amp;creativeASIN=052189560X&amp;linkCode=as2&amp;tag=marfbel-20&amp;linkId=IWPEQH36K45KI5FZ\">Causality<\/a><\/em>, and (ii) use DAGs\u00a0when they start thinking about an empirical problem.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>My teaching, service, and editorial responsibilities don&#8217;t leave me much time for research, much less for blogging these days, so I thought I would write<\/p>\n<div class=\"more-link-wrapper\"><a class=\"more-link\" href=\"https:\/\/marcfbellemare.com\/wordpress\/11349\">Continue reading<span class=\"screen-reader-text\">&#8216;Metrics Monday: Regressions as Ecosystems<\/span><\/a><\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-11349","post","type-post","status-publish","format-standard","hentry","category-uncategorized","entry"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p1gPg8-2X3","_links":{"self":[{"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/posts\/11349","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/comments?post=11349"}],"version-history":[{"count":9,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/posts\/11349\/revisions"}],"predecessor-version":[{"id":11359,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/posts\/11349\/revisions\/11359"}],"wp:attachment":[{"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/media?parent=11349"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/categories?post=11349"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/tags?post=11349"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}