{"id":11264,"date":"2015-08-24T05:00:05","date_gmt":"2015-08-24T09:00:05","guid":{"rendered":"http:\/\/marcfbellemare.com\/wordpress\/?p=11264"},"modified":"2015-08-24T10:27:49","modified_gmt":"2015-08-24T14:27:49","slug":"metrics-monday-statistical-literacy","status":"publish","type":"post","link":"https:\/\/marcfbellemare.com\/wordpress\/11264","title":{"rendered":"&#8216;Metrics Monday: Statistical Literacy"},"content":{"rendered":"<figure id=\"attachment_11268\" aria-describedby=\"caption-attachment-11268\" style=\"width: 580px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/marcfbellemare.com\/wordpress\/wp-content\/uploads\/2015\/08\/Galleria.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-11268\" src=\"http:\/\/marcfbellemare.com\/wordpress\/wp-content\/uploads\/2015\/08\/Galleria-580x435.jpg\" alt=\"Galleria Vittorio Emanuele II, Milan. (Photo Credit: Marc F. Bellemare.)\" width=\"580\" height=\"435\" srcset=\"https:\/\/marcfbellemare.com\/wordpress\/wp-content\/uploads\/2015\/08\/Galleria-580x435.jpg 580w, https:\/\/marcfbellemare.com\/wordpress\/wp-content\/uploads\/2015\/08\/Galleria-940x705.jpg 940w, https:\/\/marcfbellemare.com\/wordpress\/wp-content\/uploads\/2015\/08\/Galleria.jpg 2048w\" sizes=\"auto, (max-width: 580px) 100vw, 580px\" \/><\/a><figcaption id=\"caption-attachment-11268\" class=\"wp-caption-text\">Galleria Vittorio Emanuele II, Milan. (Photo Credit: Marc F. Bellemare.)<\/figcaption><\/figure>\n<p>(Back from two weeks in\u00a0Milan, where I attended the <a href=\"http:\/\/www.iaae-agecon.org\/\">2015 IAAE conference<\/a>,\u00a0visited Expo 2015, took some time off, and saw friends I had not seen in a long time. This week&#8217;s &#8216;Metrics Monday is a bit different in that it is not so much about econometrics, but about the consumers of results generated by econometrics, and the need for better statistical education at an early age.)<\/p>\n<p>In a conversation on <a href=\"https:\/\/www.facebook.com\/mbellema\">this blog&#8217;s Facebook page<\/a> a few weeks ago about a new working paper, a friend asked &#8220;Does this support [X]\u00a0or not?&#8221; Given that the paper under discussion looked at a\u00a0number of outcomes and presented a mixed bag of results, and given that the results were not causally identified, I responded: &#8220;There is no simple answer to that question. There is a little bit of everything for everyone here. Read the limitations section, too.&#8221; My friend then said she had done that\u00a0but\u00a0was still confused, and that &#8220;We all know it&#8217;s much easier to lie with statistics than tell the truth.&#8221;<\/p>\n<p>Is it? Or is it just much easier to <em>be misled by<\/em> statistics than it is to <em>lie with<\/em> them?<!--more--><\/p>\n<p>What I mean by this is that\u00a0we live in an age where we are increasingly being confronted with statistical data in the stories that we are told. When I worked as a reporter\u00a0in the mid 90s, no one had ever heard of <a href=\"https:\/\/en.wikipedia.org\/wiki\/Data-driven_journalism\">data-driven journalism<\/a>, yet that is increasingly what editors ask from reporters at respectable media outlets, and I sat\u00a0through job talks for a position focusing on exactly that area when I taught at a policy school. And\u00a0the phenomenon shows no sign of going away:\u00a0with the sharply decreasing costs of data collection and\u00a0the consequent rise of big data, more and more of the information we will be presented with daily will have some kind of statistical component.<\/p>\n<p>This means that education systems the world over will have to adjust in order to\u00a0teach statistical literacy earlier in their respective curricula. The first time I was exposed to the notion of probability, I was in the eighth grade. The first time I took an actual statistics course, I was in college. And the first time I actually\u00a0learned causal inference, I was an assistant professor&#8211;up until that point, my econometrics training had largely been about properly modeling data-generating processes, and whatever discussion of causation there was simply stated &#8220;Now remember, those parameters don&#8217;t\u00a0indicate causal relationships; correlation is not causation,&#8221; and stopped short of a discussion of what was required to identify causal relationships.<\/p>\n<p>I am convinced that it is possible to introduce these notions at an intuitive level (i.e., without the use of math) at an early age, by providing a number of examples. It should be relatively simple, for example, to adapt the Linda problem in order to teach its lesson to elementary school-aged children. If you&#8217;re not familiar with the Linda problem, it goes <a href=\"http:\/\/www.russellsage.org\/blog\/behavioral-economics-puzzles-kahneman-and-tverskys-experiments\">as follows<\/a>:<\/p>\n<blockquote><p>Linda is 31\u00a0years old, single, outspoken, and very bright. She majored in philosophy. As a student, she was deeply concerned with issues of discrimination and social justice, and also participated in anti-nuclear demonstrations &#8230; The respondents are asked to rank in order of likelihood various scenarios: Linda is (1) an elementary school teacher, (2) active in the feminist movement, (3) a bank teller, (4) an insurance salesperson, or (5) a bank teller also active in the feminist movement &#8230;\u00a0The remarkable finding is that (now generations of) respondents deem scenario (5) more likely than scenario (3), even though (5) is a special case of (3). The finding thus violates the most basic laws of probability theory. Not only do many students get the Linda problem wrong, but some object, sometimes passionately, after the correct answer is explained.<\/p><\/blockquote>\n<p>Likewise, it should be relatively simple to convince children that correlation is not causation, that in order to be reasonably certain that an estimated relationship is causal certain conditions have to be met, and to teach them that a lot of the relationships they are presented with should be confronted with the gold standard of a randomized experiment.<\/p>\n<p>Given that (i) the role of any education system should be to form responsible citizens, (ii) critical thinking skills are a prerequisite for\u00a0responsible citizenship, and (iii)\u00a0the ability not to be hoodwinked by the statistics one is presented with is a core component of critical thinking, education has to be reformed to teach those things earlier.<\/p>\n<p>Some people might say\u00a0that the state already does too much, and that we should not expect it to teach statistical literacy on top of everything else. Sadly, this is not one of those areas where we should just let people choose to educate themselves; how often do people actually willingly choose to learn some math-related skill on their own, in their spare time? I think there is a clear case to be made that statistical literacy generates a positive externality\u00a0(more responsible government via politicians who can less easily get away with fallacies and misleading statistics, for one), and so it is fully within the purview of the state to pay for it.<\/p>\n<p>In my statement of teaching philosophy, which I have used for various purposes over the years, I wrote:<\/p>\n<blockquote><p>The core of my teaching philosophy is my belief in the important role college plays in forming responsible citizens. &#8230;\u00a0I often tell my students that one the most important critical thinking skills&#8211;if not <em>the<\/em> most important such skill&#8211;is the ability to question the causal statements one is presented with. &#8230; We often hear it said that correlation is not causation, but my goal is to get students to understand that knowing whether X actually causes Y is difficult and requires a great deal of thinking.<\/p><\/blockquote>\n<p>The only thing I have changed my mind about in recent years is the age at which those things should be taught.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>(Back from two weeks in\u00a0Milan, where I attended the 2015 IAAE conference,\u00a0visited Expo 2015, took some time off, and saw friends I had not seen<\/p>\n<div class=\"more-link-wrapper\"><a class=\"more-link\" href=\"https:\/\/marcfbellemare.com\/wordpress\/11264\">Continue reading<span class=\"screen-reader-text\">&#8216;Metrics Monday: Statistical Literacy<\/span><\/a><\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[1],"tags":[],"class_list":["post-11264","post","type-post","status-publish","format-standard","hentry","category-uncategorized","entry"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p1gPg8-2VG","_links":{"self":[{"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/posts\/11264","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/comments?post=11264"}],"version-history":[{"count":13,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/posts\/11264\/revisions"}],"predecessor-version":[{"id":11279,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/posts\/11264\/revisions\/11279"}],"wp:attachment":[{"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/media?parent=11264"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/categories?post=11264"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/marcfbellemare.com\/wordpress\/wp-json\/wp\/v2\/tags?post=11264"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}