Top 5 Stories Worth Reading in
Data, Data Warehousing, Analytics & BI

January 26th, 2014
Stephen McDaniel
Chief Data Officer Advisor at Freakalytics, LLC

Finding it hard to make time to keep up with the rapidly changing world of data, data warehousing, analytics, data science, business intelligence and visual analytics? We understand! Each week, I read through hundreds of stories in this space and share the five most worthwhile articles with you. Each article includes a summary and link to the full story.

 

1-Netflix-analyticsHow Netflix Got Analytics Wrong, Then Right
Two entertaining and informative articles about Netflix illustrate how to be smart about using analytics. In one instance we see where Netflix went wrong, and in another we see Netflix doing the right thing.

Netflix launched a high-profile crowdsourcing project in 2006 to develop a better recommendation engine, offering a $1 million prize to any person or team who could improve Netflix recommendations by a modest 10 percent.

 

2-BI-dashboardSigns That Your BI Dashboard Needs a Comeback

Everyone loves a good comeback. Stories about celebrities like Robert Downey Jr. and Britney Spears climbing back to the top after falling so far capture our collective imagination. Movies like Rocky and Cinderella Man – about underdogs making a comeback – inspire us to think we ourselves can rebound from any setback.

Is your business intelligence dashboard the underdog at your organization? Dashboards have been around for decades, with some companies not putting the time and effort into updating them regularly to keep pace with the innovations in BI and the growing expectations of users.

 

3-analytics-movies“Pitch Perfect” And How Analytics Are Transforming Movie Marketing

When Universal released the cult musical film Pitch Perfect in 2012, they did what any self-respecting studio would do: They commissioned marketing reports and forecasted ticket sales for the Anna Kendrick-starring movie. Among them was an analysis by a company called Fizziology which data-mines social media to see how the film would play out with audiences.

Read more

Top News – Data, Data Warehousing, Analytics & BI

December 30th, 2013
Stephen McDaniel
Chief Data Officer Advisor at Freakalytics, LLC

Finding it hard to make time to keep up with the rapidly changing world of data, data warehousing, analytics, data science, business intelligence and visual analytics? We understand! Here’s our curated summary of relevant news that could help with your future data and analytic projects. We also add commentary on the topic, a summary of the article (in orange) and the link to read the full article.

There are four articles in this update:
Why Do Forecasters Keep Forecasting?
2014 BI Outlook: Who’s Hot, Who’s Not
Where do you sound like you’re from? (How Y’all, Youse and You Guys Talk)
Aided by Data Analytics, Internal Auditors Dig Deep
 
 
 
 
 
01-01Why Do Forecasters Keep Forecasting?

I found this article quite interesting, a wide range of investment advisors missed the forecast for the growth of the S&P stock market index in 2013, all of them by a huge amount (a range of being off by -53% to -109%)!  This shows how incredibly difficult forecasting even one year out can be, in spite of these companies having entire teams of experts constantly studying every machination of the underlying data that affects the stock market including economic factors, political climate   and more. In fact, if forecasters at many retailers were off by so much on their overall company sales growth forecasts, they would likely be sacked or at least pummeled with a bag of oranges in the garage one dark evening!

Why is this article so important? Because there has been tremendous hype around the power of predictive analytics to steer the business. The reality is that forecasting is an incredibly hard job, regardless of the overall intelligence, toolset, access to data and experience of the team. Does this mean we should give up on forecasting and using advanced methods to predict future outcomes and behaviors? No! However, it does imply that forecasting should be fluid and adjusted, sometimes rapidly, in response to changing external factors.

All of this begs the question, how can someone do this? In my opinion, it points back to visual analytics, dedicated teams of business analysts with clear missions and good data management and warehouse practices with an agile approach, so that major misses can be caught, reviewed and corrected mid-course.

01-02-Freakalytics-Bad-Forecasts-Investment-Firms

I created my own summary dashboard of the growth forecasts (image above.) Imagine if you were a client of these firms and you were told in late 2012 that stocks would lose money in 2013 (Wells Fargo and UBS), so you buried it all back into low-yield bonds! In the words of Warren Buffett, “Buy when everyone else is selling.”

Read more

2014 US growth forecasts of Business Intelligence vendors

There are many ways of measuring the growth of business intelligence vendors. One approach of interest in the era of self-service analytics is to measure the growth in web search volume. Derived from web search volume data from Google, the following analyses can serve as a useful reference to understand which companies/products are growing in popularity and which may be falling out of favor.

The estimates in all of the following analyses are based on simple web search volume indices from the United States through the end of November, 2013. Using historic search volume data, forecasts were built for each company/product and growth rates for 2014 were derived from these forecasts.

I would group these companies into three categories
fast growers- Tableau, PowerPivot, Qlikview, BIRST and GoodData;
the growers- Spotfire and Microstrategy,
and mature products- Oracle BI, SAS, Cognos, SPSS, SQL Server, Actuate and Business Objects.

Read more

Upcoming analytics courses, free webinars and articles
December 2013 newsletter

Thanks for your interest in our newsletter, please forward it to colleagues that may benefit from it. Please join us for our upcoming webinar next Monday on common analytic issues and mistakes in Tableau 8.

Eileen and I are excited to share our new courses on Tableau, Microstrategy Analytics Desktop (a free alternative for visual analytics and dashboards), SAS programming and data exploration and visualization are all available for on-site instruction.

We are booking engagements with clients for on-site training and strategic consulting projects throughout Q1 and into Q2 of 2014, please let us know if we can help you in 2014!

Data Management and Visual Analytics with Tableau (2 days)
January 28th-29th, 2014—Chicago, Illinois
Everyone can benefit from learning a reliable, flexible and repeatable method to analyze real-world data. Combine this with a solid grounding in the flow and core features of Tableau to achieve great returns with this course. In just two days, you will complete multiple real-world case studies with Tableau paired with supporting data management capabilities of Microsoft Excel and Microsoft Access.

Data Management and Visual Analytics with Microstrategy Analytics Desktop (2 days)
Microstrategy Analytics Desktop is an exciting new offering of Microstrategy, an established leader in business intelligence. Available as a free product for both personal and professional use, Freakalytics considers this new product a good alternative to other leading products in visual analytics and analytic dashboards. It is capable of working with local data sources such as Excel, text files and Access databases in addition to remote, big data sources such as SQL Server, Oracle, MySQL and Hadoop.

Read more

Eight common analytic issues and mistakes in Tableau 8

Understand them, avoid them and correct them December 23rd, 2013 — 11 AM Central, Noon Eastern, 9 AM Pacific, 5 PM London Click here to register Synopsis In this webinar, Stephen reviews common shortcomings and misunderstandings that can prevent effective use of Tableau. These issues can result in misleading or just plain wrong answers being … Read more

A spin-free explanation of data warehouse versus big data

It should be no surprise that many Hadoop (big data) systems sit side by side with data warehouses. These systems serve different purposes and complement one another.”
– Joint quote from CTO of cloudera and General Manager at Teradata

big-data-example-versus-data-warehouse

As you may have heard, big data is all the craze and at the top of the technology hype cycle! In my opinion, it is thoroughly confusing business execs, overwhelming IT teams and being used to market a massive range of new startups, sometimes justifiably. The reality is that big data will most likely NOT replace your data warehouse and the data scientist will most likely NOT replace your business analyst teams.

In a recent white paper,

Read more

Top News – Data, Data Warehousing, Analytics & BI

November 18th, 2013
Stephen McDaniel
Chief Data Officer Advisor at Freakalytics, LLC

Finding it hard to make time to keep up with the rapidly changing world of data, data warehousing, analytics, data science, business intelligence and visual analytics? We understand! Here’s our curated summary of relevant news that could help with your future data and analytic projects. We also add commentary on the topic, a summary of the article and the link to read the full article.

There are four articles in this update:
     Amazon wades into big data streams with Kinesis
     Top 10 Trends in Text Analytics
     Effective Customer Analytics Call for Data Integration, Culture Shifts
     Your Car Is a Data Platform, What Can It Tell About You?

Missed our last issue of Top News, November 15th? Stories included RapidMiner (free and premium data mining), big data not top CFO priority, the DATA Act passes Senate, SAS replacing PowerPoint and big data sources to consider at your company.
 
 
 
 
 
1_1Amazon wades into big data streams with Kinesis

Amazon adds another layer to data storage and streaming options-Kinesis. Kinesis is all about real-time data collection and aggregation in a hosted cloud-scalable from Megabytes to Terabytes per hour! As such, it is a service that keeps your data for a maximum of 24 hours, by which time you presumably used it or stored it in a data warehouse (like Amazon Redshift), Hadoop system (like Amazon Elastic Map Reduce), NoSQL system (like Amazon Dynamo DB) or file store (like Amazon S3!) Do you notice a trend here?

Read more

Top News – Data, Data Warehousing, Analytics & BI

November 15th, 2013
Stephen McDaniel
Chief Data Officer Advisor at Freakalytics, LLC

Finding it hard to make time to keep up with the rapidly changing world of data, data warehousing, analytics, data science, business intelligence and visual analytics?  We understand! Here’s our curated summary of relevant news that could help with your future data and analytic projects. We also add commentary on the topic, a summary of the article and the link to read the full article.

There are five articles in this update:
     Rapid-I data mining now RapidMiner, the Redhat of data mining?
     Integrating data and mobile trumps big data for many CFOs
     Bipartisan DATA Act unanimously approved by Senate Committee
     Can SAS Visual Analytics replace PowerPoint?
     Big data sources to consider for your company

Missed our last issue of Top News, November 11th? Stories included Big Data and Society, Data Mining Blues, 2014 INFORMS Conference, Facebook’s Free Big Data System for Analysts, Adaptive Data Preparation, How Trust Affects the Use of Analytics and Meeting a VAST Challenge
 
 
 
 
 
2Rapid-I data mining now RapidMiner,
the Redhat of data mining?

German predictive analytics, data mining and text mining company receives $5M in funding and announces a planned move of their headquarters to Boston from Dortmund, Germany. I would liken it to the Redhat of data mining, with a free community edition and paid corporate editions that adds support, more data sources and more capabilities. With over 3 million downloads, 20,000 deployments and 400 paid customers including eBay, Intel, PepsiCo and Kraft you may want to consider RapidMiner for your advanced analytics projects. The 2013 KDNuggets poll showed RapidMiner’s free edition ahead of every other advanced analytics choice including R.

Read more

Top News – Data, Data Warehousing, Analytics & BI

November 11th, 2013
Stephen McDaniel
Chief Data Officer Advisor at Freakalytics, LLC

i5_2Finding it hard to make time to keep up with the rapidly changing world of data, data warehousing, analytics, data science, business intelligence and visual analytics?  We understand! Here’s our curated summary of relevant news that could help with your future data and analytic projects. We also add commentary on the topic, a summary of the article and the link to read the full article.

There are seven articles in this update:
     How Big Data Is Changing Science (and Society)
     Big data blues: The dangers of data mining
     2014 INFORMS Conference on the Business of Big Data
     Facebook System for Massive Big Data (Hadoop FS) Offered Free to World
     Paxata Launches Industry’s First Adaptive Data Preparation Platform
     C-Suite and Trust Both Affect Financial Returns on Analytics, Big Data
     Meeting a VAST challenge – Lincoln Laboratory staff create winning visualization
 
 
 
 
 
i6How Big Data Is Changing Science (and Society)

Traditional statistical approaches that long dominated scientific research are being challenged and augmented by new approaches from the fields of big data and data science.

HOW CAN YOU PREDICT something without understanding it? Simple:

Read more

Data scientists & the data warehouse team-building success

Data-Scientist-Tech-200Whether you are a CIO, data architect, or a data management professional, it is imperative to understand the different approaches, attitudes and needs of the next generation of data warehouse consumers. Traditional data warehouse users include reporting teams, BI teams (who created reports for the rest of the company), statisticians and others. In the past few years, this has been rapidly changing with the new roles of data scientists, the rise of Data Enthusiasts and the burgeoning population of Accidental Analysts. In Part 1 of this series, we focus on successful collaboration between data scientists and data warehouse teams.

Data scientists have been with us for many years. However, the moniker “data scientist” is a recent change. The same role existed (and still exists) with titles such as statisticians, mathematicians, computer scientists or systems analysts; however, having one of these alternate titles doesn’t necessarily imply that one is a data scientist, although a wide range of techniques may be used by both groups.

Traditional training for people now in data science focused on

Read more