This month’s issue of Foreign Affairs has a great article (you’ll need to log in to read the whole thing, ufortunately) on the rise of big data, which Wikipedia defines as
a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications.
So far, so good. As a development economist, I have to make do with 500 observations more often than not (the largest dataset I have ever worked with had about 8,000 observations), so I obviously welcome ever larger datasets. Continue reading →