NOTE: This fun review of “big data” was inspired by a recent presentation I gave on behalf of Tableau Software at the Big Data Conference in Chicago. You can find the 1st part of this 3 part webcast here, “Performance to Cost Index & my personal history with “Big Data” and Part 2 here, “Big Data” in US History, Exploring the 1790 US Census. This part of the big data series is free, just subscribe or sign in below.
In this presentation, I share an example of working with big data stored on my laptop and the entire analysis happens without any type of connection to remote servers or databases. My analysis uses two tables of interest, the first has 216 million records, over ten years of airline ticket pricing in the US while the second table has 72 million records of US airlines performance data extracted from Hadoop. In the demonstration, which uses currently available technologies, we will quickly explore and analyze this data for interesting trends and patterns.