TPL: A Novel Analysis and Optimization Model for RDMA P2P Communication - Network and Parallel Computing
Conference Papers Year : 2021

TPL: A Novel Analysis and Optimization Model for RDMA P2P Communication

Abstract

With increasing demand for networks with high throughput and low latency, RDMA is widely used because of its high performance. Because optimization for RDMA can fully exploit the performance potential of RDMA, methods for RDMA optimization is very important. Existing mainstream researches design optimization methods by constructing a more complete hardware view and exploring relation between software implementation and specific hardware behavior. However, the hardware architecture of NIC (like InfiniBand) is a “black box”, which limits development of this type of optimization. So existing methods leave unsolvable problems. Besides, with development of RDMA technology, new features are proposed constantly. So, analysis and optimization methods of RDMA communication performance should be advancing with the times. The contributions of this paper are as follows: 1) We propose a new RDMA point-to-point communication performance analysis and optimization model: TPL. This model provides a more comprehensive perspective on RDMA optimization. 2) Guided by TPL, we design corresponding optimization algorithms for an existing problem, like WQE cache miss and a new scenario, like DCT. 3) We implement a new RDMA communication library, named ORCL, to put our optimizations together. ORCL eliminates WQE cache miss in real-time. And we simulate the workload of the in-memory KV system. Compared with existing RDMA communication implement, ORCL increases throughput by 95% and reduces latency by 10%.
Fichier principal
Vignette du fichier
511910_1_En_34_Chapter.pdf (1.65 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03768727 , version 1 (04-09-2022)

Licence

Identifiers

Cite

Zhen Du, Zhongqi An, Jing Xing. TPL: A Novel Analysis and Optimization Model for RDMA P2P Communication. 17th IFIP International Conference on Network and Parallel Computing (NPC), Sep 2020, Zhengzhou, China. pp.395-406, ⟨10.1007/978-3-030-79478-1_34⟩. ⟨hal-03768727⟩
46 View
37 Download

Altmetric

Share

More