Next-Gen Data Center Networking – Built for AI, Powered by AI

istock 985895696 2
iStock

Artificial Intelligence/Machine Learning (AI/ML) is creating new opportunities for businesses and consumers. Indeed, PwC, a major consultancy, expects AI to contribute over $15.7 trillion to the global economy by 2030 [1]. At the same time, within the data center, a move to micro-services-based software architectures, distributed storage, and Artificial Intelligence/Machine Learning (AI/ML) workloads are pushing east-west traffic to previously unseen heights.

Huawei’s Global Industry Vision (GIV) 2025 [2] predicts that the AI adoption rate will reach 86% by 2025. This will also have a big impact on the data center network, when AI/ML applications will drive the data center towards the AI era from the cloud era. Huawei is pleased to commission AvidThink, formerly SDxCentral research, to author a research brief covering the impact on data center networking by new workloads, including Artificial Intelligence (AI) and Machine Learning (ML). If you’re ready to get your hands on a copy of “Next-Gen Data Center Networking - Built for AI, Powered by AI,” you can download a free copy from here. The following are some highlights from the report, though we’d still recommend you download and read through the 9 pages of content.

Application Workload Trends with AI/ML

Consumer and business applications continue to evolve driving change in the data center. Video and media-rich content make up the bulk of traffic on the Internet today, taking up over three-quarters of all IP traffic. Streaming services as well as social and mobile applications embedding more interactive content will ensure the continued growth of media over north-south data lanes in data centers.

Meanwhile, the rise of 5G, IoT and web-based application consumption will drive a significant amount of API and transactional traffic over those same paths. These are also creating new challenges for data center networks, compounding high volumes of east-west traffic already generated by sources including media and streaming, data analytics and distributed storage.

New Requirements for data center networking

Data center networks need to reach new levels of performance for these new workloads and challenges.

First and foremost, to adequately support the scale and demand of these new workloads, DCNs are adopting new technologies including higher-speed connectivity switches (deployment of 400GbE) and HW NIC accelerator offloads. DCNs are also facilitating scale and manageability through software-defined networking (SDN), automation, and intent-based management and orchestration systems Simultaneously, we’re seeing early limited adoption of highly-programmable merchant silicon with support for programming constructs like P4.In addition, automated tools for fault detection and troubleshooting are starting to innovate and mature in the DCN space.

Huawei AI Fabric Intelligent and Lossless Data Center Network

Huawei’s AI Fabric Intelligent and Lossless Data Center Network provides zero packet loss, low latency and high throughput networkperformance that improvingperformance under AI and machine-learning workloads as well as distributed storage solutions.

AI Fabric utilizes remote direct memory access (RDMA) over converged Ethernet, also known as ROCE. By combining a high-speed fabric with more intelligent switch management, Huawei thinks that ethernet will be the foundation of future data centers powering AI/ML applications.

Huawei’s AI Fabric Solution supports customers by intelligently managing flows within their data center networks. The iLossless family of algorithms provides a dynamic congestion waterline and fast congestion feedback, identifies elephant and mice flows and indicates thresholds based on real-time workloads.

The AI Fabric solution has been validated by EANTC, an internationally recognized test center in Europe. The EANTC tests validated the network performance of the switches using RoCEv2. As a result, AI Fabric demonstrated a reduction in internode communications latency of up to 40% in the HPC test scenario and in the DFS tests, the fabric showed a 25% improvement in overall IOPS. This was completed without any packet loss and with high throughput.

Optimising the future with AI Fabric

As technology evolves, effective flow management will help mine intelligence from data. Huawei’s AI Fabric solution already reflect this future reality.

The AI Fabric solutions coupled with the recently announced CloudEngine 16800 embedded an AI chip automatically tune performance end-to-end across an entire leaf-spine data center network. It will automatically adapt to the data center’s specific needs, providing the best end-to-end zero-loss performance based on the customer’s workload. Customers will receive better data processing for less cost, unleashing the full power of AI/ML.

[1] PwC’s Global Artificial Intelligence Study: Exploiting the AI Revolution.

[2] For more information about Huawei GIV 2025: Unfolding the Industry Blueprint of an Intelligent World, visit.

Related:

Copyright © 2019 IDG Communications, Inc.