5 Big Data Technology Predictions for 2015

Big data technologies have evolved at a torrid pace that shows every sign of continuing in 2015. MapR CEO and co-founder John Schroeder predicts five major developments will dominate big data technology in the new year.

1 2 3 4 5 Page 4
Page 4 of 5

4. Hadoop Vendor Consolidation: New Business Models Evolve

big data consolidation Thinkstock

In early 2013, Intel made a splash with the introduction of its own Hadoop distribution, saying that it would differentiate itself by taking a ground-up approach in which Hadoop was baked directly into its silicon. But just a year later, Intel ditched its distribution and threw its weight behind Hadoop distribution vendor Cloudera instead.

At the time, Intel noted that customers were sitting on the sidelines to see how the Hadoop market would shake out. The number of Hadoop options were muddying the waters. Schroeder believes Hadoop vendor consolidation will continue in 2015 as the also-rans discontinue their distributions and focus elsewhere in the stack.

[Related: The CIO and CMO Perspective on Big Data]

"We're now 20 years into open source software (OSS) adoption that has provided tremendous value to the market," Schroeder says. "Technologies mature in phases. The technology lifecycle begins with innovation and the creation of highly differentiated products and ends when products are eventually commoditized. [Edgar F.] Codd created the relational database concept in 1969 with innovation leading to the Oracle IPO in 1986 and commoditization beginning with the first MySQL release in 1995. So historically, database platform technology maturity took 26 years of innovation prior to seeing any commoditization."

"Hadoop is early in the technology maturity lifecycle with only 10 years passing since the seminal MapReduce white papers were published by Google," he adds. "Hadoop adoption globally and at scale is far beyond any other data platform just 10 years after initial concept. Hadoop is in the innovation phase, so vendors mistakenly adopting "Red Hat for Hadoop" strategies are already exiting the market, most notably Intel and soon EMC Pivotal."

Schroeder believes 2015 will see the evolution of a new, more nuanced model of OSS that combines deep innovation with community development.

"The open source community is paramount for establishing standards and consensus," he says. "Competition is the accelerant transforming Hadoop from what started as a batch analytics processor to a full-featured data platform."

1 2 3 4 5 Page 4
Page 4 of 5
Survey says! Share your insights in our 19th annual State of the CIO study