{"id":9482,"date":"2013-09-18T05:00:07","date_gmt":"2013-09-18T09:00:07","guid":{"rendered":"http:\/\/marcfbellemare.com\/wordpress\/?p=9482"},"modified":"2013-09-18T10:08:33","modified_gmt":"2013-09-18T14:08:33","slug":"ten-things-applied-econometricians-should-keep-in-mind","status":"publish","type":"post","link":"https:\/\/marcfbellemare.com\/wordpress\/9482","title":{"rendered":"Ten Things Applied Econometricians Should Keep in Mind"},"content":{"rendered":"<p>From a similarly titled\u00a0<a title=\"Ten Things for Applied Econometricians to Keep in Mind\" href=\"http:\/\/davegiles.blogspot.com\/2013\/09\/ten-things-for-applied-econometricians.html\" target=\"_blank\">post<\/a>\u00a0by Dave Giles:<\/p>\n<blockquote>\n<ol>\n<li>Always, but\u00a0<i>always<\/i>,\u00a0plot your data.<\/li>\n<li>Remember that data\u00a0<i>quality<\/i>\u00a0is at least as important as data\u00a0<i>quantity<\/i>.<\/li>\n<li>Always ask yourself, &#8220;Do these results make economic\/common sense&#8221;?<\/li>\n<li>Check whether your &#8220;statistically significant&#8221; results are also &#8220;numerically\/economically significant&#8221;.<\/li>\n<li>Be sure that you know exactly what assumptions are used\/needed to obtain the results relating to the properties of any estimator or test that you use.<!--more--><\/li>\n<li>Just because someone else has used a particular approach to analyse a problem that looks like, that doesn&#8217;t mean they were right!<\/li>\n<li>&#8220;Test, test, test&#8221;! (David Hendry). But don&#8217;t forget that &#8220;pre-testing&#8221; raises some important issues of its own.<\/li>\n<li><i>Don&#8217;t<\/i>\u00a0assume that the computer code that someone gives to you is relevant for your application, or that it even produces correct results.<\/li>\n<li>Keep in mind that published results will represent only a fraction of the results that the author obtained, but is not publishing.<\/li>\n<li>Don&#8217;t forget that &#8220;peer-reviewed&#8221; does NOT mean &#8220;correct results&#8221;, or even &#8220;best practices were followed&#8221;.<\/li>\n<\/ol>\n<\/blockquote>\n<p>All ten things are indeed important to keep in mind, but a variant of #6 particularly stands out as an early mistake of mine: in early versions of my <a title=\"Bellemare (Land Economics, 2012)\" href=\"http:\/\/ideas.repec.org\/a\/uwp\/landec\/v88y2012i1p155-180.html\" target=\"_blank\">job-market paper<\/a>, I was using the same instrumental variable as <a title=\"Ackerberg and Botticini (2002)\" href=\"http:\/\/www.jstor.org\/stable\/10.1086\/339712\" target=\"_blank\">Ackerberg and Botticini (2002)<\/a> to control for endogenous matching.<\/p>\n<p>The big difference was that Ackerberg and Botticini&#8217;s context is early Renaissance Tuscany (they indeed had historical data on the land tenancy contracts signed then and there), and mine was&#8230; 2004 rural Madagascar! Some of the rejections I got on my job-market paper <em>were<\/em> well-deserved, after all.<\/p>\n<p>By the way, if you do applied work for a living (and I suspect many of you do), you should follow Dave Giles&#8217; <a title=\"Dave Giles' Blog\" href=\"http:\/\/davegiles.blogspot.com\" target=\"_blank\">blog<\/a>,\u00a0which happens to be one of my one or three favorite economics blogs (the other ones being the <a title=\"Development Impact\" href=\"http:\/\/blogs.worldbank.org\/impactevaluations\/\" target=\"_blank\">Development Impact<\/a> blog and <a title=\"Jayson Lusk\" href=\"http:\/\/jaysonlusk.com\/\" target=\"_blank\">Jayson Lusk&#8217;s blog<\/a>), and which I discovered after it was recommended to me by my colleague Tim Beatty.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>From a similarly titled\u00a0post\u00a0by Dave Giles: Always, but\u00a0always,\u00a0plot your data. Remember that data\u00a0quality\u00a0is at least as important as data\u00a0quantity. Always ask yourself, &#8220;Do these results<\/p>\n<div class=\"more-link-wrapper\"><a class=\"more-link\" href=\"https:\/\/marcfbellemare.com\/wordpress\/9482\">Continue reading<span class=\"screen-reader-text\">Ten Things Applied Econometricians Should Keep in Mind<\/span><\/a><\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-9482","post","type-post","status-publish","format-standard","hentry","category-uncategorized","entry"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p1gPg8-2sW","_links":{"self":[{"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/posts\/9482","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/comments?post=9482"}],"version-history":[{"count":5,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/posts\/9482\/revisions"}],"predecessor-version":[{"id":9490,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/posts\/9482\/revisions\/9490"}],"wp:attachment":[{"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/media?parent=9482"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/categories?post=9482"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/tags?post=9482"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}