The latest version of the Hortonworks Data Platform distribution of Hadoop adds numerous features with a special focus on enterprise requirements around governance, security and operations. Hadoop specialist Hortonworks today announced that the newest version of its Hadoop distribution, Hortonworks Data Platform (HDP) 2.2, will become generally available in November. Jim Walker, director of product marketing for Hortonworks, says the release incorporates the last six months of innovation in the Apache Hadoop community, including more than 100 new features from Apache Hadoop and its related projects. Walker notes that Hortonworks strives to expand its distribution both horizontally and vertically. Vertically, Hortonworks is integrating the projects within its Hadoop distribution with YARN and HDFS to allow it to span workloads, whether batch, interactive or real-time. He notes that deep integration of both Apache Storm and Apache Spark in HDP 2.2 represents this approach. [ Related: Hortonworks Data Platform 2.1 Adds New Enterprise Features ] With more Hadoop projects going into production, the HDP 2.2 release also focuses horizontally on a slate of enterprise requirements. “This release represents the next major step forward for enterprise-readiness of Hadoop,” Walker says. “Hadoop needs to act like any of the other technologies you have in the data center, meeting requirements around governance, security and operations.” HDP 2.2 Now Supports Apache Argus, Ambari and Kafka; SQL Semantics, Too For instance, this release is the first to include Apache Argus, an Apache Incubator project based on the technology of security company XA Secure. Hortonworks acquired XA Secure in May and contributed its technology to the open source community via the Apache Software Foundation. “Argus allows you to administer a central policy for security across a cluster and then enforce that policy across all different engines,” Walker says. HDP 2.2 also introduces new innovations from the Apache Ambari project, providing improvements to managing and monitoring clusters. The Ambari Views Framework offers a systematic way to plug in UI capabilities to bring out custom visualization, management and monitoring features in the Ambari Web console — including the ability to allow third parties to plug in new resource types along with the APIs, providers and UI to support them. Meanwhile, Ambari Blueprints deliver a template approach to cluster deployment, allowing you to specify a stack, component layout and configuration for cluster instances without having to use the Ambari Cluster Install Wizard. To further support enterprise SQL at scale in Hadoop, HDP 2.2 delivers updated SQL semantics for Hive transactions for update and delete, and a cost-based optimizer that gives Hive a major performance increase, Walker says. To support the Internet of Things, it adds Apache Kafka, a high-scale, fault-tolerant publish-subscribe messaging system for Hadoop that’s often used with Storm or Spark to stream events into Hadoop in real time. [ More: Hortonworks Brings Hadoop 2.0 to Windows ] Finally, the new release provides support for rolling upgrades and an automated policy for cloud backup to Microsoft Azure or Amazon S3. Related content opinion Website spoofing: risks, threats, and mitigation strategies for CIOs In this article, we take a look at how CIOs can tackle website spoofing attacks and the best ways to prevent them. By Yash Mehta Dec 01, 2023 5 mins CIO Cyberattacks Security brandpost Sponsored by Catchpoint Systems Inc. Gain full visibility across the Internet Stack with IPM (Internet Performance Monitoring) Today’s IT systems have more points of failure than ever before. Internet Performance Monitoring provides visibility over external networks and services to mitigate outages. By Neal Weinberg Dec 01, 2023 3 mins IT Operations brandpost Sponsored by Zscaler How customers can save money during periods of economic uncertainty Now is the time to overcome the challenges of perimeter-based architectures and reduce costs with zero trust. By Zscaler Dec 01, 2023 4 mins Security feature LexisNexis rises to the generative AI challenge With generative AI, the legal information services giant faces its most formidable disruptor yet. That’s why CTO Jeff Reihl is embracing and enhancing the technology swiftly to keep in front of the competition. By Paula Rooney Dec 01, 2023 6 mins Generative AI Digital Transformation Cloud Computing Podcasts Videos Resources Events SUBSCRIBE TO OUR NEWSLETTER From our editors straight to your inbox Get started by entering your email address below. Please enter a valid email address Subscribe