Shadow Data: A Method to Optimize Incremental Synchronization in Data Center - Network and Parallel Computing
Conference Papers Year : 2021

Shadow Data: A Method to Optimize Incremental Synchronization in Data Center

Abstract

With the continuous increase of data, the data center that plays the role of backup is facing the problem of energy hunger. In practice, to reduce the bandwidth, the local data is synchronized to the data center based on incremental synchronization. In this process, the data center will generate a huge CPU load. To solve this pressure of the data center, first, we analyze the process of the Rsync algorithm, the most commonly used in incremental synchronization, and CDC algorithms, another way of chunking algorithm. Then we propose a data structure called Shadow Data, which greatly reduces the CPU load of the data center by sacrificing part of the hard disk space in the local node.
Fichier principal
Vignette du fichier
511910_1_En_29_Chapter.pdf (1.15 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03768748 , version 1 (04-09-2022)

Licence

Identifiers

Cite

Changjian Zhang, Deyu Qi, Wenhao Huang. Shadow Data: A Method to Optimize Incremental Synchronization in Data Center. 17th IFIP International Conference on Network and Parallel Computing (NPC), Sep 2020, Zhengzhou, China. pp.339-348, ⟨10.1007/978-3-030-79478-1_29⟩. ⟨hal-03768748⟩
29 View
15 Download

Altmetric

Share

More