Ease Big Data Hiring Pain With Cascading
Finding developers with the skills to create MapReduce jobs in Apache Hadoop is challenging, but you can ease that hiring pain with Cascading, an open source Java application framework for building enterprise Big Data applications on Hadoop.
Wed, June 06, 2012
CIO — Around the world and across industries, companies are investing in Big Data technologies, especially Apache Hadoop. But building Big Data applications on Apache Hadoop using Hadoop MapReduce is a challenging thing. Finding developers that can create MapReduce jobs for your Big Data projects is more challenging yet. Finding an API that allows Java developers to use their existing skills to query Big Data datasets? Priceless.
Almost every company (91 percent) is already using tools to manage and analyze data, according to an April 2012 survey by managed services provider Avanade. Avanade surveyed 569 C-level executives, business unit leaders and IT decision-makers in 18 countries in an effort to quantify attitudes and adoption trends surrounding Big Data.
Big Data at a Tipping Point
"Big data is reaching a tipping point where it is becoming much more mainstream," says Steve Palmer, Avanade's Business Intelligence Leader for North America. "In our survey, 95 percent of companies surveyed do not consider data analysts to be part of the IT staff anymore. Instead, they're distributing them into the line of business."
While data management and analysis have historically been considered IT jobs, the study found that 58 percent of respondents say data management is now embedded throughout their business operations, and 59 percent of global companies say more employees than ever before are involved in making decisions as a result of more widely available company data.
Palmer says the survey also found that companies are translating this changing perspective into Big Data technology investment. The most widely used technologies already in use are data storage, reporting, data integration and enterprise search. Seventy-five percent of survey respondents say their company will make additional investments to improve their capability to analyze data within the next 12 months, especially in Big Data technologies such as predictive analytics, mobile data access and management tools.
While the majority of executives (58 percent) believe finding the right technology is the biggest challenge their companies face in analyzing data, the majority (56 percent) of IT decision-makers charged with implementing Big Data programs believe finding the right staff is a bigger challenge than finding the right technology. And it should come as no surprise that 63 percent of stakeholders believe their company needs to develop new skills to turn data into business insights, especially math and statistics (17 percent), business operations and analysis (37 percent) and visual design and reporting (22 percent).