Nine Data Warehousing Trends for the CIO
Gartner has issued the following missive to CIOs: Familiarise yourself with key data warehousing trends and how they will impact the technology deployed to deliver business analytics during 2011 and 2012.
Thu, February 10, 2011
CIO Australia — Gartner has issued the following missive to CIOs: Familiarise yourself with key data warehousing trends and how they will impact the technology deployed to deliver business analytics during 2011 and 2012.
According to the analyst firm, the data warehouse is set to remain a critical component of IT infrastructure and, as the demand for business intelligence (BI) and business analytics increases, optimisation, flexible designs and alternative strategies will become more important.
"The data warehouse remains one of the largest -- if not the largest -- information repository in the enterprise," said research vice-president, Mark Beyer. "Only by being aware of the market trends and how emerging technology solutions will blend with proven practices can the CIO avoid budget waste through 'misdirection' by the data warehouse management and delivery team."
Read CIO Australia's in-depth analysis of in-memory computing.
Gartner has identified nine major trends in the data warehousing market for 2011 through 2012:
Advanced functionality for hardware management of input/output (I/O), disk storage and CPU/memory balancing are now included almost as a matter of course in data-warehouse-capable platforms. Some new entrants are focusing on optimisation as a differentiator and nearly every data warehouse vendor is now addressing the issue of optimising storage for the warehouse via compression and usage-based data placement strategies. Vendors are also expending great effort differentiating their products on performance claims and technology, in ways that are not necessarily significant to the use case.
Although there are many reasons why organisations consider buying an appliance, the main reason is simplicity. The vendor builds and certifies the configuration, balancing hardware, software and services for a predictable performance. The appliance is delivered complete and installs rapidly. If there are any problems, a single call to the appliance vendor is the first course of action. There is a secondary effect as well, in that appliances can speed delivery by avoiding time-consuming hardware balancing.
Most organisations understand the need to perform a proof of concept (POC) with a shortlist of vendors during the selection phase of the data warehouse database management system. Gartner recommends that POCs use as much real source-system extracted data from the operational systems as possible, while performing the POC with as many users as possible, creating a data warehouse workload that approaches that of the environment to be used in production.
There are six workloads that are delivered by the data warehouse platform: Bulk/batch load, basic reporting, basic online analytical processing (OLAP), real-time/continuous load, data mining and operational BI.