# WEKA Qualified Program Nitro Reference Design for NVIDIA HGX H200/B200/B300 Servers This Nitro reference design validates NeuralMesh with NVIDIA HGX H200, B200, and B300 servers for Cloud Partner storage. A scale-out parallel file system and low-latency networking serve large AI training and inference. **Type:** Reference Architecture This white paper presents a validated WEKA reference design for NVIDIA Cloud Partner high-performance storage deployments using NeuralMesh, WEKA-qualified storage servers, and NVIDIA HGX H200/B200/B300 servers. The design is built to meet NCP HPS requirements by combining a scale-out parallel file system, and low-latency networking to deliver the throughput, latency, and scalability needed for large AI training and inference environments. It emphasizes operational simplicity by running metadata and data services on each storage server, supporting a single namespace that scales from 8 servers to hundreds, while also providing enterprise features such as multitenancy, encryption, snapshots, tiering, backup, and QoS. The paper also includes qualified hardware specifications, networking and cabling guidance, and storage sizing recommendations ranging from 1,152 GPUs to 41,472 GPUs, positioning WEKA as a scalable, production-ready storage foundation for large NVIDIA AI cloud deployments. ## 1. Executive Summary NeuralMesh™ software, combined with class-leading storage hardware, provides a ready-to-use, purpose-built environment specifically designed for artificial intelligence (AI) applications. WEKA empowers hundreds of the world's leading enterprises and premier research organizations to overcome complex data challenges, enabling them to achieve discoveries, insights, and outcomes more rapidly. This includes 12 of the Fortune 50 companies that rely on WEKA to enhance their data-driven initiatives. This document outlines a validated reference design for NVIDIA® Cloud Partners (NCPs). The NCP Solution is tested with NeuralMesh, integrating the WEKA Storage Servers and WEKA Management Station (WMS) software, and NVIDIA HGX™ Servers in alignment with the NVIDIA NCP High-Performance Storage (HPS) tier requirements. With the completion of this NCP HPS Reference Design, WEKA and NVIDIA extend their deeper technical integration collaboration that includes development and certification with NVIDIA Magnum IO™ GPUDirect Storage® (GDS), NVIDIA DGX BasePODTM, NVIDIA DGX SuperPODTM, NVIDIA OVX™ systems, NVIDIA networking solutions including NVIDIA ConnectX® NICs, NVIDIA Quantum InfiniBand and Spectrum™ Ethernet Platforms, and NVIDIA BlueField®-3 DPU/SuperNICs. ## 2. NeuralMesh for NVIDIA Cloud Partners NVIDIA HGX™ Servers are engineered to deliver unparalleled performance for AI and machine learning (ML) workloads. These systems enable organizations to optimize their infrastructure for specific AI and data-intensive applications. The integration of NeuralMesh with NVIDIA HGX™ Servers elevates performance to new heights, providing NVIDIA Cloud Partners with an unmatched data processing and storage experience for AI and ML workloads. Starting with a base configuration of eight servers, NeuralMesh scales linearly and seamlessly to hundreds of servers, providing capacity, throughput, and IOPS expansion as needed. NeuralMesh delivers best-in-class read/write and mixed-workload performance, supporting both small and large files simultaneously, with mixed random and sequential I/O patterns. It achieves application-level 4kB I/O at sub-200 microsecond latency and tens of millions of IOPS, ensuring data is readily accessible for demanding AI workloads. Designed to complement the computational power of NVIDIA HGX™ Servers , NeuralMesh provides seamless, high-performance data access and storage with enterprise-grade features. The NCPs benefit from NeuralMesh's rich feature set, including local snapshots, automated tiering, dynamic cluster rebalancing, private cloud multitenancy, backup, encryption, authentication, key management, user groups, quotas, and more. By leveraging NeuralMesh on NVIDIA HGX™ Servers, enterprises can optimize their AI pipelines and accelerate time-to-insight across a wide range of use cases. This section describes the advanced features of NeuralMesh for NCPs. ### 2.1 NeuralMesh Architecture NeuralMesh's containerized microservices architecture is purpose-built to deliver high-performance file services leveraging NVMe flash in a single namespace for easy access and management. NeuralMesh's unique architecture is radically different from legacy storage systems, appliances, and hypervisor-based software-defined storage solutions because it not only overcomes traditional storage scaling and file sharing limitations but also allows parallel file access via POSIX, particularly using the Data Plane Development Kit (DPDK). The DPDK is a set of libraries and drivers for fast packet processing. Using DPDK, NeuralMesh can achieve high-speed data processing and low latency, making it ideal for performance-critical applications. This allows for efficient parallel file access, significantly enhancing the system's overall performance and scalability. It provides a rich enterprise feature set, including local snapshots and remote snapshots to the cloud, clones, automated tiering, cloud-bursting, dynamic cluster rebalancing, private cloud multitenancy, backup, encryption, authentication, key management, user groups, quotas with advisory, soft and hard parameters, and much more. NeuralMesh's patented data layout and virtual metadata servers distribute and parallelize all metadata and data across the cluster for incredibly low latency and high performance no matter the file size or number. At the core of NeuralMesh is WekaFS™, a distributed, parallel file system that eliminates the traditional block-volume layer managing underlying storage resources. WekaFS is an advanced file system designed to overcome the limitations of traditional storage solutions by offering superior performance, scalability, and data integrity. It features adaptive caching, which optimizes the use of local Linux data and metadata caches to significantly reduce latency and improve performance. WekaFS ensures full coherence and consistency across the shared storage cluster, automatically managing caching to eliminate the need for specific configurations or administrative interventions. This makes it an ideal choice for performance-critical applications, ensuring data integrity and ease of management. The WEKA core components, including the WekaFS unified namespace and other functions such as virtual metadata servers (MDSs), execute in user space in a Linux container (LXC), effectively eliminating time-sharing and other kernel-specific dependencies. The exception is the WEKA Virtual File System (VFS) kernel driver, which provides the POSIX filesystem interface to applications. Using the kernel driver provides significantly higher performance than what can be achieved using a FUSE user-space driver, and it allows applications that require full POSIX compatibility to run on a shared storage system. ### 2.2 NeuralMesh Performance-Optimized Networking (DPDK) To achieve optimum performance, NeuralMesh does not use standard kernel-based TCP/IP services but instead employs a proprietary networking stack based on DPDK maps the network device in the user space, allowing the network device to be used without context switches or copying data between kernels. Bypassing the kernel stack eliminates the consumption of kernel resources for networking operations and efficiently scales across multiple hosts. It applies to both backend and client hosts and enables the WEKA system to fully use 400 GbE links. Using DPDK provides operations with high throughput and extremely low latency. Low latency is achieved by bypassing the kernel and sending and receiving packets directly from the NIC. High throughput is achieved because multiple cores in the same host can work in parallel, eliminating common bottlenecks. ### 2.3 NeuralMesh Multitenancy, Security, and QoS A collection of capabilities provides multitenancy for NeuralMesh. Tenant isolation is both physical and logical, with each tenant being a self-contained NeuralMesh instance. Tenant creation is governed by the WEKA Kubernetes (K8s) Operator (“Operator”) through composable sets of resources—these composable clusters are deployed adjacently to each other in collections of physical servers. The fundamental resource allocation method for tenants is dedicated components and physical isolation, allowing for naturally gated performance and strong security boundaries without extensive management and QoS overhead. The tenants do not share flash drives, drive memory, processor cores, or main memory. Each tenant uses unique encryption keys and authentication credentials and is unaware of each other despite being adjacent. Encryption is set at the file system level upon creation of the file system, so file systems that are deemed critical can be encrypted while others are not. When files are encrypted, it means that even if cold blocks underlying the file are sent to an object store tier, the data will remain encrypted. NeuralMesh's encryption solution protects against physical media theft, low-level firmware hacking on the SSD, and packet eavesdropping on the network. File data is encrypted with the FIPS 140-3 Level 1 compliant encryption key XTS-AES using a 512-bit key length. Clients do encryption and decryption, with the native data structures in WEKA containing wrapped key material. The KMS configuration for the cluster enables a key for each file system, all file data, and sensitive file metadata such as the file name. The only thing not encrypted is the size of the file. For service providers, this is a departure from the traditional storage approach to multitenancy, leveraging hierarchical relationships and weaker process isolation with shared memory and contextual permissions by the tenant. While the Organizations feature of WEKA NeuralMesh also supports this model for trusted tenants and logical delegation hierarchies, dedicating resources allows for strong performance guarantees and security domain separation between tenants throughout the control and data paths, a necessary capability for service providers with untrusted tenants. Logical isolation includes the network, as it is the only shared part. It can be changed per tenant using virtual functions to control bandwidth consumption by cluster and QoS settings by client. Using the Operator, a cluster can be expanded incrementally to add drives, cores, or a combination of both. The multitenancy capability scales up to 150,000 total tenants. NeuralMesh deployments leverage templates with composable resource sets for achieving desired capacity and performance in a tenant. Every drive and core will produce a certain amount of performance, and the arithmetic is handled by the Operator. The mechanics are that the Operator allocates cores and memory in physical servers to K8s containers, which contain LXC containers used by NeuralMesh. Software inside the LXC containers forms a cluster and leverages all the previously mentioned performance mechanisms like DPDK. Next, the Operator adds drives to the tenant NeuralMesh creation is fast, with most tenant clusters, wall clock time to first I/O will be measured in single-digit minutes. Administrators can deploy both small and large sets of capacity with guaranteed performance as shown in Figure 1. ![WEKA multitenant cluster: Tenant 1–n GPU and APP clients over POSIX and S3 into color-coded composable clusters of cores and SSDs on storage servers meeting WEKA NCP RA standards](https://cdn.sanity.io/images/ult5g8gw/production/df438f015c9eb35b93228c5410476bf92f4a99d8-2500x1289.png) Figure 1. WEKA multitenant cluster architecture design ## 3. WEKA Storage Server Qualified Configuration The WEKApod appliance or any of the WEKA qualified platform from other vendors meeting the specification listed in Table 1 can be used as WEKA storage: ```json { "_key": "rp00091", "_type": "richTableBlock", "headerRows": 1, "markDefs": null, "rows": [ { "_key": "rp00062", "_type": "row", "cells": [ { "_key": "rp00056", "_type": "richTableCell", "colSpan": 2, "content": [ { "_key": "rp00058", "_type": "block", "children": [ { "_key": "rp00057", "_type": "span", "marks": [], "text": "Hardware Specifications" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00059", "_type": "richTableCell", "content": [ { "_key": "107e8b145e27", "_type": "block", "children": [ { "_key": "6d2f0af8841f", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true } ] }, { "_key": "rp00069", "_type": "row", "cells": [ { "_key": "rp00063", "_type": "richTableCell", "content": [ { "_key": "rp00065", "_type": "block", "children": [ { "_key": "rp00064", "_type": "span", "marks": [ "strong" ], "text": "Processor" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00066", "_type": "richTableCell", "content": [ { "_key": "rp00068", "_type": "block", "children": [ { "_key": "rp00067", "_type": "span", "marks": [], "text": "AMD EPYC 9534 64C 2.45GHz Processor" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00076", "_type": "row", "cells": [ { "_key": "rp00070", "_type": "richTableCell", "content": [ { "_key": "rp00072", "_type": "block", "children": [ { "_key": "rp00071", "_type": "span", "marks": [ "strong" ], "text": "Memory" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00073", "_type": "richTableCell", "content": [ { "_key": "rp00075", "_type": "block", "children": [ { "_key": "rp00074", "_type": "span", "marks": [], "text": "Min. 768 GB (1 DIMM per Memory Channel). DIMM is DDR5 RDIMM 4800MTs Dual Rank" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00083", "_type": "row", "cells": [ { "_key": "rp00077", "_type": "richTableCell", "content": [ { "_key": "rp00079", "_type": "block", "children": [ { "_key": "rp00078", "_type": "span", "marks": [ "strong" ], "text": "Storage" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00080", "_type": "richTableCell", "content": [ { "_key": "rp00082", "_type": "block", "children": [ { "_key": "rp00081", "_type": "span", "marks": [], "text": "14 or more E3.s Gen5 NVMe TLC SSD. A minimum of 40x PCIe 5.0 lanes to the drives" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00090", "_type": "row", "cells": [ { "_key": "rp00084", "_type": "richTableCell", "content": [ { "_key": "rp00086", "_type": "block", "children": [ { "_key": "rp00085", "_type": "span", "marks": [ "strong" ], "text": "Network" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00087", "_type": "richTableCell", "content": [ { "_key": "rp00089", "_type": "block", "children": [ { "_key": "rp00088", "_type": "span", "marks": [], "text": "2 x NVIDIA ConnectX-7 1P 400 Gb/s OSFP PCIe 5.0 (requires 2x PCIe 5 x16 I/O Slots)" } ], "markDefs": [], "style": "normal" } ] } ] } ] } ``` Table 1. WEKA storage server specifications used during NCP validation The WEKA storage server integrates WEKA's fully distributed parallel file server architecture and includes NeuralMesh software, as described in Section 1, providing a ready-to-use, purpose-built environment for AI applications. Each WEKA storage server runs both metadata and data services, simplifying NCP deployments. NeuralMesh interfaces with NVIDIA HGX™ Servers using DPDK, a highly efficient and low-latency packet processing technology, over ConnectX®-7 NICs. Each WEKA storage server provides two ConnectX-7 NICs to connect to the storage fabric. During the NCP Reference design validation, WEKA used and tested the WEKA Storage Server™ with specifications listed in Table 1. ### 3.1 NeuralMesh Management GUI WEKA provides three quick and easy ways to manage the WEKA file system, either through a Graphical User Interface (GUI), or a Command Line Interface (CLI), or a representational State Transfer API (REST). Reporting, visualization, and overall system management functions are accessible using the REST API, CLI, or the intuitive GUI-driven management console (see Figure 2 and Figure 3). Point-and-click simplicity allows users to rapidly provision new storage, create and expand file systems within a single namespace, establish tiering policy, data protection, encryption, authentication, permissions, NFS, SMB and S3 configuration, read-only or read-write snapshots, snapshot-to-objects, and quality of service policies, as well as monitor overall system health. ![WEKA management GUI dashboard showing cluster protection OK, 103.26 GB/s total throughput, capacity, core usage, and hardware counts](https://cdn.sanity.io/images/ult5g8gw/production/a19538386e9d7aa3e39fc7da1ca84b8f55093f6f-1010x516.jpg) Figure 2. WEKA management software user interface. Detailed event logging provides users with the ability to view system events and status over time or drill down into event details with point-in-time precision via the time-series graphing function. ![WEKA Statistics page with stacked time-series charts for read and write bytes, operations, and read latency](https://cdn.sanity.io/images/ult5g8gw/production/a05e138cd46c94796d16229486772a079445c10b-1299x663.png) Figure 3. Time-series charts for event monitoring. ## 4. WEKA Reference Design for NVIDIA NCP Deployments WEKA qualified Storage Servers deliver all the capabilities of NeuralMesh software in a predictable scale-out reference design that's easy to deploy. NeuralMesh offers an exceptional, highly performant data management foundation for NCP deployments. NeuralMesh also provides efficient write performance for AI model checkpointing, delivering superior training efficiency, scalability, enterprise-grade resiliency, and support for real-time applications. WEKA Storage Servers provide both metadata and data services, streamlining the design, deployment, and management of a cloud environment, offering predictable performance, capacity, and scalability. WEKA proposes the following recommended architectures for NCP deployments. ### 4.1 Recommended Storage Sizing The Table 2 details the recommended WEKA storage configuration to meet the standard performance level for each scalable unit increment as per NVIDIA's established guidelines, using WEKA Storage Servers ```json { "_key": "rp00439", "_type": "richTableBlock", "headerRows": 1, "markDefs": null, "rows": [ { "_key": "548a39f471ff", "_type": "row", "cells": [ { "_key": "e9a0d3845078", "_type": "richTableCell", "content": [ { "_key": "rp00116", "_type": "block", "children": [ { "_key": "rp00115", "_type": "span", "marks": [], "text": "Description" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "0cedd0327192", "_type": "richTableCell", "colSpan": 2, "content": [ { "_key": "501130a16c4f", "_type": "block", "children": [ { "_key": "4fff2d3d3c03", "_type": "span", "marks": [], "text": "Number of GPUs" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "1c040e55b87f", "_type": "richTableCell", "content": [ { "_key": "b8d8c2004288", "_type": "block", "children": [ { "_key": "732c9ddaed4d", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "e65568cad0d2", "_type": "richTableCell", "colSpan": 2, "content": [ { "_key": "b66075d9a3bb", "_type": "block", "children": [ { "_key": "ba9283a5eb50", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "12c2cfc7b416", "_type": "richTableCell", "content": [ { "_key": "f322a2f1757d", "_type": "block", "children": [ { "_key": "2f4b5bc0e7e7", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "ee93d6b862c7", "_type": "richTableCell", "content": [ { "_key": "584f542d4d43", "_type": "block", "children": [ { "_key": "e3e8d085298a", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "1a8e9782ff6b", "_type": "richTableCell", "colSpan": 2, "content": [ { "_key": "65c12ca673b3", "_type": "block", "children": [ { "_key": "8fe9fa9badc5", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "d82c615dc79b", "_type": "richTableCell", "content": [ { "_key": "916e3be00216", "_type": "block", "children": [ { "_key": "ce1e4b56cb08", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true } ] }, { "_key": "rp00138", "_type": "row", "cells": [ { "_key": "rp00114", "_type": "richTableCell", "content": [ { "_key": "6f1294b7d4e2", "_type": "block", "children": [ { "_key": "6365ae7274e4", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00117", "_type": "richTableCell", "content": [ { "_key": "rp00119", "_type": "block", "children": [ { "_key": "rp00118", "_type": "span", "marks": [], "text": "1,024" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00120", "_type": "richTableCell", "content": [ { "_key": "rp00122", "_type": "block", "children": [ { "_key": "rp00121", "_type": "span", "marks": [], "text": "2,304" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00123", "_type": "richTableCell", "content": [ { "_key": "rp00125", "_type": "block", "children": [ { "_key": "rp00124", "_type": "span", "marks": [], "text": "4,096" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00126", "_type": "richTableCell", "content": [ { "_key": "rp00128", "_type": "block", "children": [ { "_key": "rp00127", "_type": "span", "marks": [], "text": "8,192" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00129", "_type": "richTableCell", "content": [ { "_key": "rp00131", "_type": "block", "children": [ { "_key": "rp00130", "_type": "span", "marks": [], "text": "16,384" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00132", "_type": "richTableCell", "content": [ { "_key": "rp00134", "_type": "block", "children": [ { "_key": "rp00133", "_type": "span", "marks": [], "text": "29,952" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00135", "_type": "richTableCell", "content": [ { "_key": "rp00137", "_type": "block", "children": [ { "_key": "rp00136", "_type": "span", "marks": [], "text": "41,472" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00163", "_type": "row", "cells": [ { "_key": "rp00139", "_type": "richTableCell", "content": [ { "_key": "rp00141", "_type": "block", "children": [ { "_key": "rp00140", "_type": "span", "marks": [], "text": "Number of GPUs" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00142", "_type": "richTableCell", "content": [ { "_key": "rp00144", "_type": "block", "children": [ { "_key": "rp00143", "_type": "span", "marks": [], "text": "1,024" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00145", "_type": "richTableCell", "content": [ { "_key": "rp00147", "_type": "block", "children": [ { "_key": "rp00146", "_type": "span", "marks": [], "text": "2,304" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00148", "_type": "richTableCell", "content": [ { "_key": "rp00150", "_type": "block", "children": [ { "_key": "rp00149", "_type": "span", "marks": [], "text": "4,096" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00151", "_type": "richTableCell", "content": [ { "_key": "rp00153", "_type": "block", "children": [ { "_key": "rp00152", "_type": "span", "marks": [], "text": "8,192" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00154", "_type": "richTableCell", "content": [ { "_key": "rp00156", "_type": "block", "children": [ { "_key": "rp00155", "_type": "span", "marks": [], "text": "16,384" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00157", "_type": "richTableCell", "content": [ { "_key": "rp00159", "_type": "block", "children": [ { "_key": "rp00158", "_type": "span", "marks": [], "text": "29,952" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00160", "_type": "richTableCell", "content": [ { "_key": "rp00162", "_type": "block", "children": [ { "_key": "rp00161", "_type": "span", "marks": [], "text": "41,472" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00188", "_type": "row", "cells": [ { "_key": "rp00164", "_type": "richTableCell", "content": [ { "_key": "rp00166", "_type": "block", "children": [ { "_key": "rp00165", "_type": "span", "marks": [], "text": "Read throughput (GB/s)" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00167", "_type": "richTableCell", "content": [ { "_key": "rp00169", "_type": "block", "children": [ { "_key": "rp00168", "_type": "span", "marks": [], "text": "160" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00170", "_type": "richTableCell", "content": [ { "_key": "rp00172", "_type": "block", "children": [ { "_key": "rp00171", "_type": "span", "marks": [], "text": "360" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00173", "_type": "richTableCell", "content": [ { "_key": "rp00175", "_type": "block", "children": [ { "_key": "rp00174", "_type": "span", "marks": [], "text": "640" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00176", "_type": "richTableCell", "content": [ { "_key": "rp00178", "_type": "block", "children": [ { "_key": "rp00177", "_type": "span", "marks": [], "text": "1,280" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00179", "_type": "richTableCell", "content": [ { "_key": "rp00181", "_type": "block", "children": [ { "_key": "rp00180", "_type": "span", "marks": [], "text": "2,560" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00182", "_type": "richTableCell", "content": [ { "_key": "rp00184", "_type": "block", "children": [ { "_key": "rp00183", "_type": "span", "marks": [], "text": "4,680" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00185", "_type": "richTableCell", "content": [ { "_key": "rp00187", "_type": "block", "children": [ { "_key": "rp00186", "_type": "span", "marks": [], "text": "6,480" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00213", "_type": "row", "cells": [ { "_key": "rp00189", "_type": "richTableCell", "content": [ { "_key": "rp00191", "_type": "block", "children": [ { "_key": "rp00190", "_type": "span", "marks": [], "text": "Write throughput (GB/s)" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00192", "_type": "richTableCell", "content": [ { "_key": "rp00194", "_type": "block", "children": [ { "_key": "rp00193", "_type": "span", "marks": [], "text": "80" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00195", "_type": "richTableCell", "content": [ { "_key": "rp00197", "_type": "block", "children": [ { "_key": "rp00196", "_type": "span", "marks": [], "text": "180" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00198", "_type": "richTableCell", "content": [ { "_key": "rp00200", "_type": "block", "children": [ { "_key": "rp00199", "_type": "span", "marks": [], "text": "320" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00201", "_type": "richTableCell", "content": [ { "_key": "rp00203", "_type": "block", "children": [ { "_key": "rp00202", "_type": "span", "marks": [], "text": "640" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00204", "_type": "richTableCell", "content": [ { "_key": "rp00206", "_type": "block", "children": [ { "_key": "rp00205", "_type": "span", "marks": [], "text": "1,260" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00207", "_type": "richTableCell", "content": [ { "_key": "rp00209", "_type": "block", "children": [ { "_key": "rp00208", "_type": "span", "marks": [], "text": "2,340" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00210", "_type": "richTableCell", "content": [ { "_key": "rp00212", "_type": "block", "children": [ { "_key": "rp00211", "_type": "span", "marks": [], "text": "3,240" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00238", "_type": "row", "cells": [ { "_key": "rp00214", "_type": "richTableCell", "colSpan": 8, "content": [ { "_key": "rp00216", "_type": "block", "children": [ { "_key": "rp00215", "_type": "span", "marks": [ "strong" ], "text": "Storage Configuration" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00217", "_type": "richTableCell", "content": [ { "_key": "fdd54a9fc06f", "_type": "block", "children": [ { "_key": "b8e22763f340", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "rp00220", "_type": "richTableCell", "content": [ { "_key": "99b05de8a3a6", "_type": "block", "children": [ { "_key": "fddc7b7a8662", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "rp00223", "_type": "richTableCell", "content": [ { "_key": "0a90640256c7", "_type": "block", "children": [ { "_key": "195a7d3c9848", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "rp00226", "_type": "richTableCell", "content": [ { "_key": "8c6e8fcbf456", "_type": "block", "children": [ { "_key": "5ba94e4bcc9a", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "rp00229", "_type": "richTableCell", "content": [ { "_key": "fdf884aaf38a", "_type": "block", "children": [ { "_key": "ab307478940e", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "rp00232", "_type": "richTableCell", "content": [ { "_key": "25b5be106f6d", "_type": "block", "children": [ { "_key": "c58e2eabd431", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "rp00235", "_type": "richTableCell", "content": [ { "_key": "88fba232f6b8", "_type": "block", "children": [ { "_key": "97709b68c2f1", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true } ] }, { "_key": "rp00263", "_type": "row", "cells": [ { "_key": "rp00239", "_type": "richTableCell", "content": [ { "_key": "rp00241", "_type": "block", "children": [ { "_key": "rp00240", "_type": "span", "marks": [], "text": "Number of Storage Servers" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00242", "_type": "richTableCell", "content": [ { "_key": "rp00244", "_type": "block", "children": [ { "_key": "rp00243", "_type": "span", "marks": [], "text": "8" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00245", "_type": "richTableCell", "content": [ { "_key": "rp00247", "_type": "block", "children": [ { "_key": "rp00246", "_type": "span", "marks": [], "text": "8" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00248", "_type": "richTableCell", "content": [ { "_key": "rp00250", "_type": "block", "children": [ { "_key": "rp00249", "_type": "span", "marks": [], "text": "10" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00251", "_type": "richTableCell", "content": [ { "_key": "rp00253", "_type": "block", "children": [ { "_key": "rp00252", "_type": "span", "marks": [], "text": "19" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00254", "_type": "richTableCell", "content": [ { "_key": "rp00256", "_type": "block", "children": [ { "_key": "rp00255", "_type": "span", "marks": [], "text": "37" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00257", "_type": "richTableCell", "content": [ { "_key": "rp00259", "_type": "block", "children": [ { "_key": "rp00258", "_type": "span", "marks": [], "text": "67" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00260", "_type": "richTableCell", "content": [ { "_key": "rp00262", "_type": "block", "children": [ { "_key": "rp00261", "_type": "span", "marks": [], "text": "93" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00288", "_type": "row", "cells": [ { "_key": "rp00264", "_type": "richTableCell", "content": [ { "_key": "rp00266", "_type": "block", "children": [ { "_key": "rp00265", "_type": "span", "marks": [], "text": "Number of namespaces" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00267", "_type": "richTableCell", "content": [ { "_key": "rp00269", "_type": "block", "children": [ { "_key": "rp00268", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00270", "_type": "richTableCell", "content": [ { "_key": "rp00272", "_type": "block", "children": [ { "_key": "rp00271", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00273", "_type": "richTableCell", "content": [ { "_key": "rp00275", "_type": "block", "children": [ { "_key": "rp00274", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00276", "_type": "richTableCell", "content": [ { "_key": "rp00278", "_type": "block", "children": [ { "_key": "rp00277", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00279", "_type": "richTableCell", "content": [ { "_key": "rp00281", "_type": "block", "children": [ { "_key": "rp00280", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00282", "_type": "richTableCell", "content": [ { "_key": "rp00284", "_type": "block", "children": [ { "_key": "rp00283", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00285", "_type": "richTableCell", "content": [ { "_key": "rp00287", "_type": "block", "children": [ { "_key": "rp00286", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00313", "_type": "row", "cells": [ { "_key": "rp00289", "_type": "richTableCell", "content": [ { "_key": "rp00291", "_type": "block", "children": [ { "_key": "rp00290", "_type": "span", "marks": [], "text": "Number of 400G storage ports" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00292", "_type": "richTableCell", "content": [ { "_key": "rp00294", "_type": "block", "children": [ { "_key": "rp00293", "_type": "span", "marks": [], "text": "16" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00295", "_type": "richTableCell", "content": [ { "_key": "rp00297", "_type": "block", "children": [ { "_key": "rp00296", "_type": "span", "marks": [], "text": "16" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00298", "_type": "richTableCell", "content": [ { "_key": "rp00300", "_type": "block", "children": [ { "_key": "rp00299", "_type": "span", "marks": [], "text": "20" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00301", "_type": "richTableCell", "content": [ { "_key": "rp00303", "_type": "block", "children": [ { "_key": "rp00302", "_type": "span", "marks": [], "text": "38" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00304", "_type": "richTableCell", "content": [ { "_key": "rp00306", "_type": "block", "children": [ { "_key": "rp00305", "_type": "span", "marks": [], "text": "74" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00307", "_type": "richTableCell", "content": [ { "_key": "rp00309", "_type": "block", "children": [ { "_key": "rp00308", "_type": "span", "marks": [], "text": "134" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00310", "_type": "richTableCell", "content": [ { "_key": "rp00312", "_type": "block", "children": [ { "_key": "rp00311", "_type": "span", "marks": [], "text": "186" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00338", "_type": "row", "cells": [ { "_key": "rp00314", "_type": "richTableCell", "content": [ { "_key": "rp00316", "_type": "block", "children": [ { "_key": "rp00315", "_type": "span", "marks": [], "text": "Number of in-band management connections" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00317", "_type": "richTableCell", "content": [ { "_key": "rp00319", "_type": "block", "children": [ { "_key": "rp00318", "_type": "span", "marks": [], "text": "8" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00320", "_type": "richTableCell", "content": [ { "_key": "rp00322", "_type": "block", "children": [ { "_key": "rp00321", "_type": "span", "marks": [], "text": "8" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00323", "_type": "richTableCell", "content": [ { "_key": "rp00325", "_type": "block", "children": [ { "_key": "rp00324", "_type": "span", "marks": [], "text": "10" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00326", "_type": "richTableCell", "content": [ { "_key": "rp00328", "_type": "block", "children": [ { "_key": "rp00327", "_type": "span", "marks": [], "text": "19" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00329", "_type": "richTableCell", "content": [ { "_key": "rp00331", "_type": "block", "children": [ { "_key": "rp00330", "_type": "span", "marks": [], "text": "37" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00332", "_type": "richTableCell", "content": [ { "_key": "rp00334", "_type": "block", "children": [ { "_key": "rp00333", "_type": "span", "marks": [], "text": "67" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00335", "_type": "richTableCell", "content": [ { "_key": "rp00337", "_type": "block", "children": [ { "_key": "rp00336", "_type": "span", "marks": [], "text": "93" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00363", "_type": "row", "cells": [ { "_key": "rp00339", "_type": "richTableCell", "content": [ { "_key": "rp00341", "_type": "block", "children": [ { "_key": "rp00340", "_type": "span", "marks": [], "text": "Number of out-of-band management connections" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00342", "_type": "richTableCell", "content": [ { "_key": "rp00344", "_type": "block", "children": [ { "_key": "rp00343", "_type": "span", "marks": [], "text": "8" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00345", "_type": "richTableCell", "content": [ { "_key": "rp00347", "_type": "block", "children": [ { "_key": "rp00346", "_type": "span", "marks": [], "text": "8" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00348", "_type": "richTableCell", "content": [ { "_key": "rp00350", "_type": "block", "children": [ { "_key": "rp00349", "_type": "span", "marks": [], "text": "10" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00351", "_type": "richTableCell", "content": [ { "_key": "rp00353", "_type": "block", "children": [ { "_key": "rp00352", "_type": "span", "marks": [], "text": "19" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00354", "_type": "richTableCell", "content": [ { "_key": "rp00356", "_type": "block", "children": [ { "_key": "rp00355", "_type": "span", "marks": [], "text": "37" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00357", "_type": "richTableCell", "content": [ { "_key": "rp00359", "_type": "block", "children": [ { "_key": "rp00358", "_type": "span", "marks": [], "text": "67" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00360", "_type": "richTableCell", "content": [ { "_key": "rp00362", "_type": "block", "children": [ { "_key": "rp00361", "_type": "span", "marks": [], "text": "93" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00388", "_type": "row", "cells": [ { "_key": "rp00364", "_type": "richTableCell", "content": [ { "_key": "rp00366", "_type": "block", "children": [ { "_key": "rp00365", "_type": "span", "marks": [], "text": "Number of rack units" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00367", "_type": "richTableCell", "content": [ { "_key": "rp00369", "_type": "block", "children": [ { "_key": "rp00368", "_type": "span", "marks": [], "text": "9" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00370", "_type": "richTableCell", "content": [ { "_key": "rp00372", "_type": "block", "children": [ { "_key": "rp00371", "_type": "span", "marks": [], "text": "9" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00373", "_type": "richTableCell", "content": [ { "_key": "rp00375", "_type": "block", "children": [ { "_key": "rp00374", "_type": "span", "marks": [], "text": "11" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00376", "_type": "richTableCell", "content": [ { "_key": "rp00378", "_type": "block", "children": [ { "_key": "rp00377", "_type": "span", "marks": [], "text": "20" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00379", "_type": "richTableCell", "content": [ { "_key": "rp00381", "_type": "block", "children": [ { "_key": "rp00380", "_type": "span", "marks": [], "text": "38" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00382", "_type": "richTableCell", "content": [ { "_key": "rp00384", "_type": "block", "children": [ { "_key": "rp00383", "_type": "span", "marks": [], "text": "68" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00385", "_type": "richTableCell", "content": [ { "_key": "rp00387", "_type": "block", "children": [ { "_key": "rp00386", "_type": "span", "marks": [], "text": "94" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00413", "_type": "row", "cells": [ { "_key": "rp00389", "_type": "richTableCell", "content": [ { "_key": "rp00391", "_type": "block", "children": [ { "_key": "rp00390", "_type": "span", "marks": [], "text": "Power (KW)" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00392", "_type": "richTableCell", "content": [ { "_key": "rp00394", "_type": "block", "children": [ { "_key": "rp00393", "_type": "span", "marks": [], "text": "6.4" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00395", "_type": "richTableCell", "content": [ { "_key": "rp00397", "_type": "block", "children": [ { "_key": "rp00396", "_type": "span", "marks": [], "text": "6.4" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00398", "_type": "richTableCell", "content": [ { "_key": "rp00400", "_type": "block", "children": [ { "_key": "rp00399", "_type": "span", "marks": [], "text": "8" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00401", "_type": "richTableCell", "content": [ { "_key": "rp00403", "_type": "block", "children": [ { "_key": "rp00402", "_type": "span", "marks": [], "text": "15.2" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00404", "_type": "richTableCell", "content": [ { "_key": "rp00406", "_type": "block", "children": [ { "_key": "rp00405", "_type": "span", "marks": [], "text": "29.6" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00407", "_type": "richTableCell", "content": [ { "_key": "rp00409", "_type": "block", "children": [ { "_key": "rp00408", "_type": "span", "marks": [], "text": "53.6" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00410", "_type": "richTableCell", "content": [ { "_key": "rp00412", "_type": "block", "children": [ { "_key": "rp00411", "_type": "span", "marks": [], "text": "74.4" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00438", "_type": "row", "cells": [ { "_key": "rp00414", "_type": "richTableCell", "content": [ { "_key": "rp00416", "_type": "block", "children": [ { "_key": "rp00415", "_type": "span", "marks": [], "text": "Cooling (BTU/hr)" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00417", "_type": "richTableCell", "content": [ { "_key": "rp00419", "_type": "block", "children": [ { "_key": "rp00418", "_type": "span", "marks": [], "text": "22,000" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00420", "_type": "richTableCell", "content": [ { "_key": "rp00422", "_type": "block", "children": [ { "_key": "rp00421", "_type": "span", "marks": [], "text": "22,000" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00423", "_type": "richTableCell", "content": [ { "_key": "rp00425", "_type": "block", "children": [ { "_key": "rp00424", "_type": "span", "marks": [], "text": "27,500" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00426", "_type": "richTableCell", "content": [ { "_key": "rp00428", "_type": "block", "children": [ { "_key": "rp00427", "_type": "span", "marks": [], "text": "52,250" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00429", "_type": "richTableCell", "content": [ { "_key": "rp00431", "_type": "block", "children": [ { "_key": "rp00430", "_type": "span", "marks": [], "text": "101,750" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00432", "_type": "richTableCell", "content": [ { "_key": "rp00434", "_type": "block", "children": [ { "_key": "rp00433", "_type": "span", "marks": [], "text": "184,250" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00435", "_type": "richTableCell", "content": [ { "_key": "rp00437", "_type": "block", "children": [ { "_key": "rp00436", "_type": "span", "marks": [], "text": "255,750" } ], "markDefs": [], "style": "normal" } ] } ] } ] } ``` Table 2. Guidance for standard HPS aggregate storage performance ### 4.2 WEKA Storage Networking WEKA Storage Servers integrate seamlessly with NVIDIA Spectrum Ethernet SN5600/5610 leaf switches using 16 x 400 Gb connections per 8-node cluster. The platform fully supports DPDK to enable direct data transfers from storage to GPU memory, minimizing CPU overhead and maximizing bandwidth efficiency. ![Eight WEKA storage servers dual-homed to a pair of SN5600/5610 leaf switches over 400 Gb links](https://cdn.sanity.io/images/ult5g8gw/production/6702a007d9d7ac90c572b174f4e2843eaf639ce2-2048x1526.png) Figure 4. WEKA Storage Servers and SN5600/5610 Leaf switch connectivity overview ### 4.3 WEKA Storage Server Cabling with SN5600/5610 Switches An NVIDIA [MMS4X00-NS](https://docs.nvidia.com/networking/display/800gmms4x00ns) twin-port 2x400Gb/s OSFP transceiver is utilized with NVIDIA Spectrum Ethernet SN5600/5610 leaf switches to connect WEKA Storage Servers. Each WEKA storage server includes two NVIDIA ConnectX-7 NICs and employs NVIDIA [MMS4X00-NS400](https://docs.nvidia.com/networking/display/mms4x00ns400) transceivers to establish connections to a pair of switches in an active-active configuration. WEKA and NVIDIA have jointly validated the cables listed in Table 3 for connecting WEKA Storage Servers to NVIDIA Spectrum Ethernet SN5600/5610 switches. Using splitter cables optimizes switch port utilization. ![Two WEKA storage servers with ConnectX-7 NICs and OSFP transceivers cabled via splitter cables to a pair of SN5600/5610 leaf switches](https://cdn.sanity.io/images/ult5g8gw/production/e1c5d5c412767a398ab13b74121c9af59c61d783-2048x1166.png) Figure 5. Transceivers and cabling connecting WEKA Storage Servers and NVIDIA Spectrum Ethernet SN5600/5610 leaf switches ```json { "_key": "rp00492", "_type": "richTableBlock", "headerRows": 1, "markDefs": null, "rows": [ { "_key": "rp00477", "_type": "row", "cells": [ { "_key": "rp00468", "_type": "richTableCell", "content": [ { "_key": "rp00470", "_type": "block", "children": [ { "_key": "rp00469", "_type": "span", "marks": [], "text": "Processor" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00471", "_type": "richTableCell", "content": [ { "_key": "rp00473", "_type": "block", "children": [ { "_key": "rp00472", "_type": "span", "marks": [], "text": "Processor" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00474", "_type": "richTableCell", "content": [ { "_key": "rp00476", "_type": "block", "children": [ { "_key": "rp00475", "_type": "span", "marks": [], "text": "Description" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00484", "_type": "row", "cells": [ { "_key": "rp00478", "_type": "richTableCell", "content": [ { "_key": "rp00480", "_type": "block", "children": [ { "_key": "rp00479", "_type": "span", "marks": [], "text": "Direct Attach Copper" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00461", "_type": "richTableCell", "content": [ { "_key": "rp00463", "_type": "block", "children": [ { "_key": "rp00462", "_type": "span", "marks": [ "rp00460" ], "text": "MCP7Y00-Nxxx" } ], "markDefs": [ { "_key": "rp00460", "_type": "articleBodyLink", "actionType": "external", "externalUrl": "https://docs.nvidia.com/networking/display/mcp7y00nxxx800pub" } ], "style": "normal" } ] }, { "_key": "rp00481", "_type": "richTableCell", "content": [ { "_key": "rp00483", "_type": "block", "children": [ { "_key": "rp00482", "_type": "span", "marks": [], "text": "NVIDIA 800 Gb/s Twin-port OSFP to 2x400 Gb/s OSFP DAC Splitter Cable xxx indicates length in meters: 001, 01A, 002, 02A, 003" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00491", "_type": "row", "cells": [ { "_key": "rp00485", "_type": "richTableCell", "content": [ { "_key": "rp00487", "_type": "block", "children": [ { "_key": "rp00486", "_type": "span", "marks": [], "text": "Active Copper Cable" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00465", "_type": "richTableCell", "content": [ { "_key": "rp00467", "_type": "block", "children": [ { "_key": "rp00466", "_type": "span", "marks": [ "rp00464" ], "text": "MCA7J60-Nxxx" } ], "markDefs": [ { "_key": "rp00464", "_type": "articleBodyLink", "actionType": "external", "externalUrl": "https://docs.nvidia.com/networking/display/mca7j60nxxx800" } ], "style": "normal" } ] }, { "_key": "rp00488", "_type": "richTableCell", "content": [ { "_key": "rp00490", "_type": "block", "children": [ { "_key": "rp00489", "_type": "span", "marks": [], "text": "NVIDIA 800 Gb/s Twin-port OSFP to 2x400 Gb/s OSFP ACC Splitter xxx indicates the length in meters: 004, 005" } ], "markDefs": [], "style": "normal" } ] } ] } ] } ``` Table 3. DAC and ACC splitter cables Figure 6 illustrates the network connectivity of WEKA Storage Servers to a pair of NVIDIA Spectrum Ethernet SN5600/5610 leaf switches, establishing a high-throughput, non-blocking network architecture. ![Port mapping of eight WEKA storage servers to a SN5600/5610 leaf pair, with storage ports 1–32 in red and uplink ports 33–64 in orange](https://cdn.sanity.io/images/ult5g8gw/production/5cb58b237c2365ba10f900bf62b85a68fd50e645-2048x935.png) Figure 6. WEKA storage server port mapping to NVIDIA Spectrum Ethernet SN5600/5610 leaf pair Key points: - **WEKA Storage Servers: **Each server is equipped with 2x NVIDIA ConnectX-7 NICs - **Redundant Connectivity: **Each node connects to both SN5600/5610 switches, enabling an active-active configuration for redundancy and high availability. - **Storage Ports (highlighted in red): **The first half of each switch (ports 1–32) is allocated for connecting to storage nodes (WEKA Storage Servers). - **Uplink Ports (highlighted in orange): **The second half (ports 33–64) is reserved for uplinks to the leaf-spine network fabric, ensuring a non-blocking topology. - **Balanced Distribution: **The cabling is evenly distributed across both switches, ensuring each node's dual NICs are connected to separate switches for fault tolerance and optimal bandwidth utilization. - **Transceivers and Cabling: **The connections are established using NVIDIA MMS4X00-NS400 OSFP transceivers and splitter cables, maximizing port efficiency on the SN5600/5610 switches. - This setup ensures high-performance, resilient storage network connectivity for WEKA storage server systems in large-scale deployments. ### 4.4 NCP Deployments with 1,024 GPUs Figure 7 illustrates the WEKA storage architecture for NCP deployments with 1,024 GPUs, 8x WEKA Storage Servers and a WEKA Management Station (WMS).. Every WEKA storage server connects to the storage network with 2x 400GbE links using the appropriate cable type. The WMS connects to the WEKA Storage Servers over the 1GbE out-of-band management network. It does not require a connection to the 400GbE storage network. ![WEKA Management Station above two SN5600/5610 leaf switches connected to eight WEKA storage servers for a 1,024-GPU NCP design](https://cdn.sanity.io/images/ult5g8gw/production/557aa029e33ce5021bd987de27f5155fbeb6780f-2500x1590.png) Figure 7. WEKA Storage Servers Reference Design for NCP deployments with 1,024 GPUs. ### 4.5 NCP Deployments with 16,384 GPUs Figure 8 shows the WEKA storage system for NCP deployments with 16,384 GPUs , 37x WEKA Storage Servers, and a WEKA Management Station (WMS).. Every WEKA storage server connects to the storage network with 2x 400 GbE links using the appropriate cable type. The WMS connects to the WEKA Storage Servers over the 1GbE out-of-band management network. ![WEKA Management Station above four SN5600/5610 leaf switches feeding 19- and 18-server stacks for a 16,384-GPU NCP design](https://cdn.sanity.io/images/ult5g8gw/production/1edb0b89a6bb6970c1a92e5f9fa2d4865cab032d-1224x908.png) Figure 8. WEKA Storage Servers Reference Design for NCP deployments with 16,384 GPUs. ### 4.6 NCP Deployments with 41,472 GPUs Figure 9 shows the WEKA storage system for NCP deployments with 41,472 GPUs, 93x WEKA Storage Servers, and a WEKA Management Station (WMS). Every WEKA storage server connects to the storage network with 2x 400 GbE links using the appropriate cable type. The WMS connects to the WEKA Storage Servers over the 1GbE out-of-band management network. ![WEKA Management Station above eight SN5600/5610 leaf switches feeding four WEKA storage-server racks totaling 93 servers for 41,472 GPUs](https://cdn.sanity.io/images/ult5g8gw/production/172bdf3e61b13fdd955d37f2793023423a16979e-2500x1255.png) Figure 9. WEKA Storage Servers Reference Design for NCP deployments with 41,472 GPUs ## 5. Summary NeuralMesh is a pioneering architecture that not only delivers outstanding performance and scalability but also ensures operational efficiency and ease of use. This document presents a validated reference design for NeuralMesh, specifically adhering to the NCP RA specifications for HPS. With flexible configurations supporting over 40K GPUs in a single cluster, NCPs can confidently pair the NeuralMesh by WEKA with large-scale AI infrastructure deployments. The jointly validated NeuralMesh reference design, based on the NCP RA and featuring HGX Servers and NVIDIA networking, meets and exceeds the rigorous demands of AI, HPC, and other data-intensive applications. ## 6. Appendix A: Data Services & Unified Security Model NeuralMesh supports multi-protocol and data-sharing capabilities across various protocols, allowing diverse application types and users to share a single pool of data. Unlike other parallel file systems, WEKA does not require a gateway server infrastructure to offer this capability as shown in Figure 10. The currently supported protocols include: - Full POSIX for local file system support - NFS for Linux - SMB for Windows - S3 for Object access ![Multi-copy AI pipeline with a data-lake silo and high-perf storage versus NeuralMesh on a single transparent namespace over object store](https://cdn.sanity.io/images/ult5g8gw/production/7d6ff15909cac73da0133cc44ae347f8c74777af-2500x1901.png) Figure 10. WEKA NeuralMesh, providing data access to every stage of the AI pipeline By supporting POSIX and file/object protocols, NeuralMesh allows organizations to consolidate HPS (training data) and data lake (data collection and preprocessing) storage needs onto a single platform. This consolidation eliminates the need for data transfers between separate storage systems, thereby simplifying AI training, inference, and model serving processes. This integration enhances speed and reliability, streamlining the entire AI data lifecycle. Consequently, organizations can focus on innovation rather than dealing with intricate multi-copy storage architectures and burdensome data transfer operations. Furthermore, by unifying various storage systems into a single, cohesive data platform, WEKA empowers NVIDIA Cloud Partners to offer a highly differentiated solution that accelerates the entire AI pipeline. This capability enables NCPs to develop and deliver services to their customers more quickly and with reduced operational overhead, in contrast to traditional multi-copy architectures. ## 7. Appendix B: WEKA configuration for 1 GB/s per GPU of performance The High Performance Storage network in HGX Server deployments can easily handle up to 1 GB/s per GPU. The Table 7 details the sizing guidance for WEKA storage clusters to meet the NCP deployments with 1.0 GB/s of read per GPU requirement for respective scalable unit configurations. ```json { "_key": "rp00887", "_type": "richTableBlock", "headerRows": 1, "markDefs": null, "rows": [ { "_key": "rp00586", "_type": "row", "cells": [ { "_key": "rp00562", "_type": "richTableCell", "content": [ { "_key": "rp00564", "_type": "block", "children": [ { "_key": "rp00563", "_type": "span", "marks": [], "text": "Description" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00565", "_type": "richTableCell", "colSpan": 2, "content": [ { "_key": "rp00567", "_type": "block", "children": [ { "_key": "rp00566", "_type": "span", "marks": [], "text": "Number of GPUs" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00568", "_type": "richTableCell", "content": [ { "_key": "e61f764405d5", "_type": "block", "children": [ { "_key": "253b5d1a31f8", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "rp00571", "_type": "richTableCell", "content": [ { "_key": "51dc9d691312", "_type": "block", "children": [ { "_key": "302a0fee0436", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00574", "_type": "richTableCell", "content": [ { "_key": "277eba909ca4", "_type": "block", "children": [ { "_key": "8cd57d2ae21d", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00577", "_type": "richTableCell", "content": [ { "_key": "772bf450f053", "_type": "block", "children": [ { "_key": "aed696f8e441", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00580", "_type": "richTableCell", "content": [ { "_key": "536b7be9b047", "_type": "block", "children": [ { "_key": "4394eb38eb83", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00583", "_type": "richTableCell", "content": [ { "_key": "4b330555ff02", "_type": "block", "children": [ { "_key": "dcdf69d28453", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "9cb32d89474f", "_type": "row", "cells": [ { "_key": "96d4de6434b5", "_type": "richTableCell", "content": [ { "_key": "5f6e133631a7", "_type": "block", "children": [ { "_key": "fdf76fe6d4dd", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "8cd857f61931", "_type": "richTableCell", "content": [ { "_key": "rp00567", "_type": "block", "children": [ { "_key": "rp00566", "_type": "span", "marks": [], "text": "1,024" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "99a55eab2ea6", "_type": "richTableCell", "content": [ { "_key": "rp00570", "_type": "block", "children": [ { "_key": "rp00569", "_type": "span", "marks": [], "text": "2,304" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "1ddd042dbb0b", "_type": "richTableCell", "content": [ { "_key": "rp00573", "_type": "block", "children": [ { "_key": "rp00572", "_type": "span", "marks": [], "text": "4,096" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "a55d14dd7ea9", "_type": "richTableCell", "content": [ { "_key": "rp00576", "_type": "block", "children": [ { "_key": "rp00575", "_type": "span", "marks": [], "text": "8,192" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "cf058e6edce1", "_type": "richTableCell", "content": [ { "_key": "rp00579", "_type": "block", "children": [ { "_key": "rp00578", "_type": "span", "marks": [], "text": "16,384" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "814f6c0a99a4", "_type": "richTableCell", "content": [ { "_key": "rp00582", "_type": "block", "children": [ { "_key": "rp00581", "_type": "span", "marks": [], "text": "29,952" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "6f19e2464d04", "_type": "richTableCell", "content": [ { "_key": "rp00585", "_type": "block", "children": [ { "_key": "rp00584", "_type": "span", "marks": [], "text": "41,472" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00611", "_type": "row", "cells": [ { "_key": "rp00587", "_type": "richTableCell", "content": [ { "_key": "rp00589", "_type": "block", "children": [ { "_key": "rp00588", "_type": "span", "marks": [], "text": "Number of GPUs" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00590", "_type": "richTableCell", "content": [ { "_key": "rp00592", "_type": "block", "children": [ { "_key": "rp00591", "_type": "span", "marks": [], "text": "1,024" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00593", "_type": "richTableCell", "content": [ { "_key": "rp00595", "_type": "block", "children": [ { "_key": "rp00594", "_type": "span", "marks": [], "text": "2,304" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00596", "_type": "richTableCell", "content": [ { "_key": "rp00598", "_type": "block", "children": [ { "_key": "rp00597", "_type": "span", "marks": [], "text": "4,096" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00599", "_type": "richTableCell", "content": [ { "_key": "rp00601", "_type": "block", "children": [ { "_key": "rp00600", "_type": "span", "marks": [], "text": "8,192" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00602", "_type": "richTableCell", "content": [ { "_key": "rp00604", "_type": "block", "children": [ { "_key": "rp00603", "_type": "span", "marks": [], "text": "16,384" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00605", "_type": "richTableCell", "content": [ { "_key": "rp00607", "_type": "block", "children": [ { "_key": "rp00606", "_type": "span", "marks": [], "text": "29,952" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00608", "_type": "richTableCell", "content": [ { "_key": "rp00610", "_type": "block", "children": [ { "_key": "rp00609", "_type": "span", "marks": [], "text": "41,472" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00636", "_type": "row", "cells": [ { "_key": "rp00612", "_type": "richTableCell", "content": [ { "_key": "rp00614", "_type": "block", "children": [ { "_key": "rp00613", "_type": "span", "marks": [], "text": "Read throughput (GB/s)" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00615", "_type": "richTableCell", "content": [ { "_key": "rp00617", "_type": "block", "children": [ { "_key": "rp00616", "_type": "span", "marks": [], "text": "1,024" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00618", "_type": "richTableCell", "content": [ { "_key": "rp00620", "_type": "block", "children": [ { "_key": "rp00619", "_type": "span", "marks": [], "text": "2,304" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00621", "_type": "richTableCell", "content": [ { "_key": "rp00623", "_type": "block", "children": [ { "_key": "rp00622", "_type": "span", "marks": [], "text": "4,096" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00624", "_type": "richTableCell", "content": [ { "_key": "rp00626", "_type": "block", "children": [ { "_key": "rp00625", "_type": "span", "marks": [], "text": "8,192" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00627", "_type": "richTableCell", "content": [ { "_key": "rp00629", "_type": "block", "children": [ { "_key": "rp00628", "_type": "span", "marks": [], "text": "16,384" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00630", "_type": "richTableCell", "content": [ { "_key": "rp00632", "_type": "block", "children": [ { "_key": "rp00631", "_type": "span", "marks": [], "text": "29,952" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00633", "_type": "richTableCell", "content": [ { "_key": "rp00635", "_type": "block", "children": [ { "_key": "rp00634", "_type": "span", "marks": [], "text": "41,472" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00661", "_type": "row", "cells": [ { "_key": "rp00637", "_type": "richTableCell", "content": [ { "_key": "rp00639", "_type": "block", "children": [ { "_key": "rp00638", "_type": "span", "marks": [], "text": "Write throughput (GB/s)" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00640", "_type": "richTableCell", "content": [ { "_key": "rp00642", "_type": "block", "children": [ { "_key": "rp00641", "_type": "span", "marks": [], "text": "512" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00643", "_type": "richTableCell", "content": [ { "_key": "rp00645", "_type": "block", "children": [ { "_key": "rp00644", "_type": "span", "marks": [], "text": "1,152" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00646", "_type": "richTableCell", "content": [ { "_key": "rp00648", "_type": "block", "children": [ { "_key": "rp00647", "_type": "span", "marks": [], "text": "2,048" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00649", "_type": "richTableCell", "content": [ { "_key": "rp00651", "_type": "block", "children": [ { "_key": "rp00650", "_type": "span", "marks": [], "text": "4,096" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00652", "_type": "richTableCell", "content": [ { "_key": "rp00654", "_type": "block", "children": [ { "_key": "rp00653", "_type": "span", "marks": [], "text": "8,192" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00655", "_type": "richTableCell", "content": [ { "_key": "rp00657", "_type": "block", "children": [ { "_key": "rp00656", "_type": "span", "marks": [], "text": "14,976" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00658", "_type": "richTableCell", "content": [ { "_key": "rp00660", "_type": "block", "children": [ { "_key": "rp00659", "_type": "span", "marks": [], "text": "20,736" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00686", "_type": "row", "cells": [ { "_key": "rp00662", "_type": "richTableCell", "colSpan": 8, "content": [ { "_key": "rp00664", "_type": "block", "children": [ { "_key": "rp00663", "_type": "span", "marks": [ "strong" ], "text": "Storage Configuration" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00665", "_type": "richTableCell", "content": [ { "_key": "c234ea1afe7f", "_type": "block", "children": [ { "_key": "bb3b564894a4", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "rp00668", "_type": "richTableCell", "content": [ { "_key": "9b1255c134af", "_type": "block", "children": [ { "_key": "5ca938ccc137", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "rp00671", "_type": "richTableCell", "content": [ { "_key": "d6d9f9aaa481", "_type": "block", "children": [ { "_key": "959bc8c59f68", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "rp00674", "_type": "richTableCell", "content": [ { "_key": "30cddce6869c", "_type": "block", "children": [ { "_key": "4325371d71de", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "rp00677", "_type": "richTableCell", "content": [ { "_key": "d1f1d50a1512", "_type": "block", "children": [ { "_key": "a04aab24da17", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "rp00680", "_type": "richTableCell", "content": [ { "_key": "9bd29bc7bf2d", "_type": "block", "children": [ { "_key": "da22e3e6b9f6", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true }, { "_key": "rp00683", "_type": "richTableCell", "content": [ { "_key": "07c6e10516b8", "_type": "block", "children": [ { "_key": "bbabe29cc4e0", "_type": "span", "marks": [], "text": "" } ], "markDefs": [], "style": "normal" } ], "isCovered": true } ] }, { "_key": "rp00711", "_type": "row", "cells": [ { "_key": "rp00687", "_type": "richTableCell", "content": [ { "_key": "rp00689", "_type": "block", "children": [ { "_key": "rp00688", "_type": "span", "marks": [], "text": "Number of Storage Servers" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00690", "_type": "richTableCell", "content": [ { "_key": "rp00692", "_type": "block", "children": [ { "_key": "rp00691", "_type": "span", "marks": [], "text": "15" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00693", "_type": "richTableCell", "content": [ { "_key": "rp00695", "_type": "block", "children": [ { "_key": "rp00694", "_type": "span", "marks": [], "text": "33" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00696", "_type": "richTableCell", "content": [ { "_key": "rp00698", "_type": "block", "children": [ { "_key": "rp00697", "_type": "span", "marks": [], "text": "59" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00699", "_type": "richTableCell", "content": [ { "_key": "rp00701", "_type": "block", "children": [ { "_key": "rp00700", "_type": "span", "marks": [], "text": "118" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00702", "_type": "richTableCell", "content": [ { "_key": "rp00704", "_type": "block", "children": [ { "_key": "rp00703", "_type": "span", "marks": [], "text": "235" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00705", "_type": "richTableCell", "content": [ { "_key": "rp00707", "_type": "block", "children": [ { "_key": "rp00706", "_type": "span", "marks": [], "text": "428" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00708", "_type": "richTableCell", "content": [ { "_key": "rp00710", "_type": "block", "children": [ { "_key": "rp00709", "_type": "span", "marks": [], "text": "593" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00736", "_type": "row", "cells": [ { "_key": "rp00712", "_type": "richTableCell", "content": [ { "_key": "rp00714", "_type": "block", "children": [ { "_key": "rp00713", "_type": "span", "marks": [], "text": "Number of namespaces" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00715", "_type": "richTableCell", "content": [ { "_key": "rp00717", "_type": "block", "children": [ { "_key": "rp00716", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00718", "_type": "richTableCell", "content": [ { "_key": "rp00720", "_type": "block", "children": [ { "_key": "rp00719", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00721", "_type": "richTableCell", "content": [ { "_key": "rp00723", "_type": "block", "children": [ { "_key": "rp00722", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00724", "_type": "richTableCell", "content": [ { "_key": "rp00726", "_type": "block", "children": [ { "_key": "rp00725", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00727", "_type": "richTableCell", "content": [ { "_key": "rp00729", "_type": "block", "children": [ { "_key": "rp00728", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00730", "_type": "richTableCell", "content": [ { "_key": "rp00732", "_type": "block", "children": [ { "_key": "rp00731", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00733", "_type": "richTableCell", "content": [ { "_key": "rp00735", "_type": "block", "children": [ { "_key": "rp00734", "_type": "span", "marks": [], "text": "1" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00761", "_type": "row", "cells": [ { "_key": "rp00737", "_type": "richTableCell", "content": [ { "_key": "rp00739", "_type": "block", "children": [ { "_key": "rp00738", "_type": "span", "marks": [], "text": "Number of 400G storage ports" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00740", "_type": "richTableCell", "content": [ { "_key": "rp00742", "_type": "block", "children": [ { "_key": "rp00741", "_type": "span", "marks": [], "text": "30" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00743", "_type": "richTableCell", "content": [ { "_key": "rp00745", "_type": "block", "children": [ { "_key": "rp00744", "_type": "span", "marks": [], "text": "66" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00746", "_type": "richTableCell", "content": [ { "_key": "rp00748", "_type": "block", "children": [ { "_key": "rp00747", "_type": "span", "marks": [], "text": "118" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00749", "_type": "richTableCell", "content": [ { "_key": "rp00751", "_type": "block", "children": [ { "_key": "rp00750", "_type": "span", "marks": [], "text": "236" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00752", "_type": "richTableCell", "content": [ { "_key": "rp00754", "_type": "block", "children": [ { "_key": "rp00753", "_type": "span", "marks": [], "text": "470" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00755", "_type": "richTableCell", "content": [ { "_key": "rp00757", "_type": "block", "children": [ { "_key": "rp00756", "_type": "span", "marks": [], "text": "856" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00758", "_type": "richTableCell", "content": [ { "_key": "rp00760", "_type": "block", "children": [ { "_key": "rp00759", "_type": "span", "marks": [], "text": "1186" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00786", "_type": "row", "cells": [ { "_key": "rp00762", "_type": "richTableCell", "content": [ { "_key": "rp00764", "_type": "block", "children": [ { "_key": "rp00763", "_type": "span", "marks": [], "text": "Number of in-band management connections" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00765", "_type": "richTableCell", "content": [ { "_key": "rp00767", "_type": "block", "children": [ { "_key": "rp00766", "_type": "span", "marks": [], "text": "15" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00768", "_type": "richTableCell", "content": [ { "_key": "rp00770", "_type": "block", "children": [ { "_key": "rp00769", "_type": "span", "marks": [], "text": "33" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00771", "_type": "richTableCell", "content": [ { "_key": "rp00773", "_type": "block", "children": [ { "_key": "rp00772", "_type": "span", "marks": [], "text": "59" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00774", "_type": "richTableCell", "content": [ { "_key": "rp00776", "_type": "block", "children": [ { "_key": "rp00775", "_type": "span", "marks": [], "text": "118" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00777", "_type": "richTableCell", "content": [ { "_key": "rp00779", "_type": "block", "children": [ { "_key": "rp00778", "_type": "span", "marks": [], "text": "235" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00780", "_type": "richTableCell", "content": [ { "_key": "rp00782", "_type": "block", "children": [ { "_key": "rp00781", "_type": "span", "marks": [], "text": "428" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00783", "_type": "richTableCell", "content": [ { "_key": "rp00785", "_type": "block", "children": [ { "_key": "rp00784", "_type": "span", "marks": [], "text": "593" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00811", "_type": "row", "cells": [ { "_key": "rp00787", "_type": "richTableCell", "content": [ { "_key": "rp00789", "_type": "block", "children": [ { "_key": "rp00788", "_type": "span", "marks": [], "text": "Number of out-of-band management connections" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00790", "_type": "richTableCell", "content": [ { "_key": "rp00792", "_type": "block", "children": [ { "_key": "rp00791", "_type": "span", "marks": [], "text": "15" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00793", "_type": "richTableCell", "content": [ { "_key": "rp00795", "_type": "block", "children": [ { "_key": "rp00794", "_type": "span", "marks": [], "text": "33" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00796", "_type": "richTableCell", "content": [ { "_key": "rp00798", "_type": "block", "children": [ { "_key": "rp00797", "_type": "span", "marks": [], "text": "59" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00799", "_type": "richTableCell", "content": [ { "_key": "rp00801", "_type": "block", "children": [ { "_key": "rp00800", "_type": "span", "marks": [], "text": "118" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00802", "_type": "richTableCell", "content": [ { "_key": "rp00804", "_type": "block", "children": [ { "_key": "rp00803", "_type": "span", "marks": [], "text": "235" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00805", "_type": "richTableCell", "content": [ { "_key": "rp00807", "_type": "block", "children": [ { "_key": "rp00806", "_type": "span", "marks": [], "text": "428" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00808", "_type": "richTableCell", "content": [ { "_key": "rp00810", "_type": "block", "children": [ { "_key": "rp00809", "_type": "span", "marks": [], "text": "593" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00836", "_type": "row", "cells": [ { "_key": "rp00812", "_type": "richTableCell", "content": [ { "_key": "rp00814", "_type": "block", "children": [ { "_key": "rp00813", "_type": "span", "marks": [], "text": "Number of rack units" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00815", "_type": "richTableCell", "content": [ { "_key": "rp00817", "_type": "block", "children": [ { "_key": "rp00816", "_type": "span", "marks": [], "text": "16" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00818", "_type": "richTableCell", "content": [ { "_key": "rp00820", "_type": "block", "children": [ { "_key": "rp00819", "_type": "span", "marks": [], "text": "34" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00821", "_type": "richTableCell", "content": [ { "_key": "rp00823", "_type": "block", "children": [ { "_key": "rp00822", "_type": "span", "marks": [], "text": "60" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00824", "_type": "richTableCell", "content": [ { "_key": "rp00826", "_type": "block", "children": [ { "_key": "rp00825", "_type": "span", "marks": [], "text": "119" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00827", "_type": "richTableCell", "content": [ { "_key": "rp00829", "_type": "block", "children": [ { "_key": "rp00828", "_type": "span", "marks": [], "text": "236" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00830", "_type": "richTableCell", "content": [ { "_key": "rp00832", "_type": "block", "children": [ { "_key": "rp00831", "_type": "span", "marks": [], "text": "429" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00833", "_type": "richTableCell", "content": [ { "_key": "rp00835", "_type": "block", "children": [ { "_key": "rp00834", "_type": "span", "marks": [], "text": "594" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00861", "_type": "row", "cells": [ { "_key": "rp00837", "_type": "richTableCell", "content": [ { "_key": "rp00839", "_type": "block", "children": [ { "_key": "rp00838", "_type": "span", "marks": [], "text": "Power (KW)" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00840", "_type": "richTableCell", "content": [ { "_key": "rp00842", "_type": "block", "children": [ { "_key": "rp00841", "_type": "span", "marks": [], "text": "12.0" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00843", "_type": "richTableCell", "content": [ { "_key": "rp00845", "_type": "block", "children": [ { "_key": "rp00844", "_type": "span", "marks": [], "text": "26.4" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00846", "_type": "richTableCell", "content": [ { "_key": "rp00848", "_type": "block", "children": [ { "_key": "rp00847", "_type": "span", "marks": [], "text": "47.2" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00849", "_type": "richTableCell", "content": [ { "_key": "rp00851", "_type": "block", "children": [ { "_key": "rp00850", "_type": "span", "marks": [], "text": "94.4" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00852", "_type": "richTableCell", "content": [ { "_key": "rp00854", "_type": "block", "children": [ { "_key": "rp00853", "_type": "span", "marks": [], "text": "188.0" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00855", "_type": "richTableCell", "content": [ { "_key": "rp00857", "_type": "block", "children": [ { "_key": "rp00856", "_type": "span", "marks": [], "text": "342.4" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00858", "_type": "richTableCell", "content": [ { "_key": "rp00860", "_type": "block", "children": [ { "_key": "rp00859", "_type": "span", "marks": [], "text": "474.4" } ], "markDefs": [], "style": "normal" } ] } ] }, { "_key": "rp00886", "_type": "row", "cells": [ { "_key": "rp00862", "_type": "richTableCell", "content": [ { "_key": "rp00864", "_type": "block", "children": [ { "_key": "rp00863", "_type": "span", "marks": [], "text": "Cooling (BTU/hr)" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00865", "_type": "richTableCell", "content": [ { "_key": "rp00867", "_type": "block", "children": [ { "_key": "rp00866", "_type": "span", "marks": [], "text": "41,250" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00868", "_type": "richTableCell", "content": [ { "_key": "rp00870", "_type": "block", "children": [ { "_key": "rp00869", "_type": "span", "marks": [], "text": "90,750" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00871", "_type": "richTableCell", "content": [ { "_key": "rp00873", "_type": "block", "children": [ { "_key": "rp00872", "_type": "span", "marks": [], "text": "162,250" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00874", "_type": "richTableCell", "content": [ { "_key": "rp00876", "_type": "block", "children": [ { "_key": "rp00875", "_type": "span", "marks": [], "text": "324,500" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00877", "_type": "richTableCell", "content": [ { "_key": "rp00879", "_type": "block", "children": [ { "_key": "rp00878", "_type": "span", "marks": [], "text": "646,250" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00880", "_type": "richTableCell", "content": [ { "_key": "rp00882", "_type": "block", "children": [ { "_key": "rp00881", "_type": "span", "marks": [], "text": "1,177,000" } ], "markDefs": [], "style": "normal" } ] }, { "_key": "rp00883", "_type": "richTableCell", "content": [ { "_key": "rp00885", "_type": "block", "children": [ { "_key": "rp00884", "_type": "span", "marks": [], "text": "1,630,750" } ], "markDefs": [], "style": "normal" } ] } ] } ] } ``` Table 7. WEKA recommended storage sizing for NCP deployments with 1.0 GB/s of read per GPU [Download PDF](/api/resource-pdf?slug=nvidia-hgx-h100-h200-and-b200-reference-architecture-for-cloud-partners)