RDMA Enabling Storage Technology Revolution

Michael Kagan, Office of the CTO  
Office of the CTO, Storage

With the explosion of data over the past few years, data storage has become a hot topic among corporate decision makers. It is no longer sufficient to have adequate space for the massive quantities of data that must be stored; it is just as critical that stored data be accessible without any bottlenecks that impede the ability to process and analyze data in real time.


Traditionally, accessing hard disk storage took tens of milliseconds, and the corresponding network and protocol overheads were in the hundreds of microseconds, a negligible percentage of the overall access time.


At that time, networks ran on 1Gb/s bandwidth, and SCSI was the protocol used for accessing storage locally while iSCSI based on TCP was developed for remote access.


However, once storage technology improved and Solid-State Disks (SSD) became the norm, access time dropped by two orders of magnitude to the hundreds of microseconds. Unless network and protocol access times decreased by a similar factor, they would create a bottleneck that negated the gains made by the new media technology.


This meant that the network had to handle larger bandwidths, such as 40Gb/s and now even 100Gb/s driving faster data transfers. For remote access, iSCSI is still the protocol of choice; however, TCP was no longer efficient enough, such that RDMA (RoCE) became the transport of choice for data plane operation and iSER was developed as an enhancement of iSCSI.

SSD access was emulated under the SCSI layer to maintain compatibility to the existing ecosystem of block storage access, but it inherited all the overhead associated with SCSI. Recently, NVMe was invented for more efficient access to flash media, enabling higher concurrency and eliminating SCSI overhead. NVMe over Fabrics is defined as an RDMA-based protocol requiring RDMA as a basic foundation upon which the storage protocols required for advanced storage media technologies are built. RoCE is an industry standard protocol running on Ethernet/IP and InfiniBand networks and is the most efficient RDMA implementation available.


Mellanox is the world’s leader for RDMA solutions, with the most efficient implementation on the market. Mellanox also is the pace-setter for network performance improvements, becoming the first to offer end-to-end 100Gb/s solutions with sub-microsecond latency in 2015.


Now, storage media technology is on the verge of yet another 100-fold performance leap, and concepts such as Intel’s 3D Xpoint technology reinforce the idea that even more efficient networking will be required. Mellanox remains at the forefront of development of the networking roadmap and can be relied upon to provide the most efficient solutions for storage going forward.

Michael Kagan 090715 storage_technology-02

About Michael Kagan

As Chief Technology Officer and a co-founder of Mellanox Technologies, Michael Kagan is responsible for steering Mellanox's product roadmap. Prior to Mellanox, he held a number of architecture and design positions at Intel where he managed the Pentium MMX design, as well as the architecture team of the Basic PC product group. A 30-year veteran of the hi-tech industry, Michael is Mellanox’s focal point for all technological innovation, a hands-on mentor for new architects, and the spearhead for R&D excellence. To keep his finger on the pulse of industry trends, Michael frequently travels to meet partners and customers and attends conferences to present and further contour Mellanox's tech roadmap. Michael lives in a suburb of Haifa, Israel with his wife and is the proud father of 6 children. In his spare time, Michael is an avid biker and enjoys wilderness jeep trekking.

Comments are closed.