My Background in Data Warehousing
I have been involved in the creation, development, and maintenance of seven data warehouses through the years- one of them before I even knew about the term “data warehousing”! I have built them with SAS and Oracle, SAS alone, Informatica and Oracle, Oracle alone, and SQL Server.
I have also visited many companies as an adviser, consultant and user of their data warehouse. In these many visits, I have seen some successes and many failures. Often, the failures could have been prevented with some key guiding principles.
Data Warehousing or Enterprise Data Integration?
Data warehousing is now known by a new buzz word, Enterprise Data Integration. In fact, SAS recently renamed SAS ETL Studio as SAS Data Integration Studio (they also added some new features around the EDI area, one new feature was around continual data acquisition so that near real time data feeds are available in the data warehouse.) Another great part of SAS EDI is SAS Data Quality, this should be a consideration throughout the entire process, but I won’t directly comment about data quality in this post. Since most people still use the term data warehousing, so I will keep the popular terminology over the analysts and even SAS.
What Does it Take to Build a Successful Data Warehouse?