Combination delivers highest throughput, lowest latency data access for CPU and GPU intensive workloads in high performance computing
SAN JOSE, Calif. – Nov. 13, 2017 – WekaIO, a high-performance scalable storage software company, today announced support for Mellanox Technologies InfiniBand and Ethernet intelligent interconnect solutions for servers, storage and hyperconverged infrastructure. By utilizing WekaIO software over Mellanox interconnect solutions, high performance computing, machine learning and technical compute workloads can achieve higher performance, scalability and lower latency.
Mellanox is the leading supplier of performance interconnect for high performance GPU clusters used for deep learning workloads. WekaIO Matrix™ software coupled with ConnectX-series InfiniBand and Ethernet adapters enable performance improvements to data hungry workloads without customers needing to modify existing networks.
WekaIO has developed an optimized zero-copy network software stack based on PCIe virtualization and Data Plane Development Kit (DPDK) technologies providing a 10x boost in packet processing for low latency, high throughput applications utilizing Mellanox ConnectX Ethernet and InfiniBand networking technologies.
“The combination of WekaIO software and Mellanox Ethernet and InfiniBand adapters provides our mutual customers with a high-performance file system solution that can address a broad range of applications,” said Dror Goldenberg, vice president of architecture at Mellanox. “The WekaIO team has demonstrated performance improvements of 100 times compared to other file system options, leveraging the Mellanox interconnect technology and acceleration engines.”
The San Diego Supercomputer Center (SDSC) at the University of California San Diego is currently evaluating WekaIO’s high-performance storage technologies as part of its Advanced Technology Lab for use in the life sciences as well as other domains. The software is being evaluated on the Triton Shared Computing Cluster (TSCC), a “condo computing” program established in 2013 that has grown in popularity among campus-based researchers and external users. TSCC includes 30 labs/groups with more than 200 researcher-owned compute nodes.
“We are exploring the use of WekaIO technologies over InfiniBand to address the challenges of data analytics at extreme scale in the life sciences, particle physics, geosciences, and other fields,” said SDSC Director Michael Norman. “That process is still ongoing but to-date we’ve already achieved some promising results.”
“New compute intensive applications are generating diverse workloads that require a fundamental shift in the way storage systems are built to deliver on-demand performance at massive scale,” said Liran Zvibel, co-founder and Chief Technology Officer at WekaIO. “The WekaIO Matrix solution now supports a broad portfolio of Mellanox Ethernet and InfiniBand platforms, providing businesses with HPC class performance and cloudlike scalability, without the need for network gateways.”
A combined solution from WekaIO and Mellanox delivers all-flash performance and cloud scalability and economics.
Liran Zvibel will be presenting “Storage Strategies for AI Workloads,” at the Supercomputing ’17 conference, on Thursday, November 16, at 2:00 p.m., in the Mellanox booth #653.
WekaIO leapfrogs legacy infrastructures and improves IT agility by delivering software-centric data storage solutions that unlock the true promise of the cloud. WekaIO Matrix™ software is ideally suited for performance intensive workloads such as Web 2.0 application serving, financial modeling, life sciences research, media rendering, Big Data analytics, log management and government or university research.
WekaIO, WekaIO Matrix and the WekaIO logo are trademarks of WekaIO, Inc.