Deep Learning Places New Demands on Data Center Architectures

A new white paper by Moor Insights & Strategy explores the data architectures required for machine and deep learning with scale-out enterprise storage.

shutterstock 784596430
Dell EMC

Machine and deep learning applications bring new workflows and challenges to enterprise data center architectures. One of the key challenges revolves around data and the storage solutions needed to store, manage, and deliver up to AI’s demands. Today’s intelligent applications require infrastructure that is very different from traditional analytics workloads, and an organization’s data architecture decisions will have a big impact on the success of its AI projects.

These are among the key takeaways from a new white paper by the research firm Moor Insights & Strategy.

“While discussions of machine learning and deep learning naturally gravitate towards compute, it’s clear that these solutions force new ways of thinking about data,” the firm notes in its “Enterprise Machine & Deep Learning with Intelligent Storage” paper. “Deep learning requires thinking differently about how data is managed, analyzed and stored.”

So, how do you think differently? One way is to think about a blissful dance between compute and storage, one in which both partners are continually in lockstep with each other. When a storage system is paired with a deep learning compute system, it should have the ability to access and serve up large data sets with extreme concurrency without causing the processing elements to stall while they wait for data.

“Deep learning requires large amounts of data to be fed into the processor without making the processors wait for that data,” Moor Insights & Strategy says. “Properly marrying compute with the right storage technology, such as the Dell EMC Isilon series, allows data to be fed into the machine learning pipeline at the speed of the processor.”

The critical takeaway here is that serving up data for machine learning and deep learning is very different from any other enterprise workload, the firm says. And here’s some of what you need under the hood, according to the firm: “Managing data for deep learning requires deploying solutions that are built for high concurrency and multi-dimensional performance at scale with tiering across a single namespace and simple management through a consistent set of tools.”

Dell EMC has it all covered

The solutions in the Dell EMC portfolio cover all the needs outlined in the Moor Insights & Strategy report. These innovative solutions include the Dell EMC Isilon storage system with the OneFS operating system, the Dell EMC PowerMax, and an expanding portfolio of Isilon based Ready Solutions and Reference Architectures built to simplify AI and deliver faster, deeper insights. By offering new ways to store, manage, protect and use data at scale, we can help you continue to evolve and pivot to squeeze out every last cent of value from your data.  

“The Dell EMC Isilon family provides a solid base from which to deliver storage capabilities in supporting the full life-cycle of enterprise deep learning,” Moor Insights & Strategy says. “This follows the workflow from training, learning, deployment and, ultimately, to long-term archival needs.”

To learn more

Copyright © 2019 IDG Communications, Inc.