ASTracer: An Efficient Tracing Tool for HDFS with Adaptive Sampling - Network and Parallel Computing
Conference Papers Year : 2019

ASTracer: An Efficient Tracing Tool for HDFS with Adaptive Sampling

Yang Song
  • Function : Author
  • PersonId : 1161689
Yunchun Li
  • Function : Author
  • PersonId : 1053387
Shuhan Wu
  • Function : Author
  • PersonId : 1161690
Hailong Yang
  • Function : Author
  • PersonId : 1053390
Wei Li
  • Function : Author
  • PersonId : 1053391

Abstract

Existing distributed tracing tools such as HTrace use static probabilistic samplers to collect the function call trees for performance analysis, which may fail to capture important but less executed function call trees and thus miss the opportunities for performance optimization. To address the above problem, we propose ASTracer, a new distributed tracing tool with two adaptive samplers. The advantage of adaptive samplers is that they can adjust the sampling rate dynamically, which is able to capture comprehensive function call trees and in the meanwhile maintain the size of trace file acceptable. In addition, we propose an auto-tuning mechanism to search for the optimal parameter settings of the adaptive samplers in ASTracer. The experiment results demonstrate the adaptive samplers are more effective in tracing the function call trees compared to probabilistic sampler. Moreover, we provide several case studies to demonstrate the usage of ASTracer in identifying potential performance bottlenecks.
Fichier principal
Vignette du fichier
486810_1_En_9_Chapter.pdf (464.95 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03770561 , version 1 (06-09-2022)

Licence

Identifiers

Cite

Yang Song, Yunchun Li, Shuhan Wu, Hailong Yang, Wei Li. ASTracer: An Efficient Tracing Tool for HDFS with Adaptive Sampling. 16th IFIP International Conference on Network and Parallel Computing (NPC), Aug 2019, Hohhot, China. pp.107-119, ⟨10.1007/978-3-030-30709-7_9⟩. ⟨hal-03770561⟩
38 View
56 Download

Altmetric

Share

More