HiPower: A High-Performance RDMA Acceleration Solution for Distributed Transaction Processing - Network and Parallel Computing
Conference Papers Year : 2019

HiPower: A High-Performance RDMA Acceleration Solution for Distributed Transaction Processing

Abstract

The increasing complex tasks and growing size of data have necessitated the application of distributed transaction processing (DTP), which decouples tasks and data among multiple nodes for jointly processing. However, compared with the revolutionary development of computation power, the network capability falls relatively behind, leaving communication as a more distinct bottleneck. This paper focuses on the recent emerging RDMA technology, which can greatly improve communication performance but cannot be well exploited in many cases due to improper interactive design between the requester and responder. Our research finds that the typical implementation of confirming per work request (CPWR) triggers considerable CPU involvement, which further degrades the overall performance of RDMA communication. Targeting at this, we propose HiPower, which leverages a batched confirmation scheme with lower CPU utilization, to improve high-frequency communication efficiency. Our experiments show that, compared with CPWR, HiPower can improve the communication efficiency by up to 75% and reduce CPU cost by up to 79%, which speeds up the overall FCT (Flow Completion Time) by up to 14% on real workflow (Resnet-152).
Fichier principal
Vignette du fichier
486810_1_En_17_Chapter.pdf (930.5 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03770544 , version 1 (06-09-2022)

Licence

Identifiers

Cite

Runhua Zhang, Yang Cheng, Jinkun Geng, Shuai Wang, Kaihui Gao, et al.. HiPower: A High-Performance RDMA Acceleration Solution for Distributed Transaction Processing. 16th IFIP International Conference on Network and Parallel Computing (NPC), Aug 2019, Hohhot, China. pp.209-221, ⟨10.1007/978-3-030-30709-7_17⟩. ⟨hal-03770544⟩
24 View
86 Download

Altmetric

Share

More