PRTSM: Hardware Data Arrangement Mechanisms for Convolutional Layer Computation on the Systolic Array - Network and Parallel Computing
Conference Papers Year : 2019

PRTSM: Hardware Data Arrangement Mechanisms for Convolutional Layer Computation on the Systolic Array

Abstract

The systolic array is an array of processing units which share the inner data flow. Since the 2D systolic array fits the operation of multiplication and accumulation (MAC) naturally, there are many groups which use the systolic array to accelerate the computation of DNN (Deep Neural Network). However, the performance of the systolic array is limited by the data bandwidth. Some groups solve this problem with the method of loop tiling and care little about the pixel reuse potential of the convolutional layer. In this paper, we propose a novel method of PRTSM (Pixels Reuse with Time and Spatial Multiplexing) which reuses the pixels of the input feature map with time and spatial multiplexing. With it, we can significantly reduce the pressure of bandwidth and save the time of data preparing for convolutional layers on the systolic array. We propose three algorithms for this method and implement the corresponding hardware mechanisms on Xilinx FPGA XCVU440. Experiments show that our hardware mechanisms can reduce at least $$72.03\%$$ of the off-chip traffic. The mechanisms proposed by this paper can reach a peak performance of 64.034 GOPS with a frequency of 167 MHz.
Fichier principal
Vignette du fichier
486810_1_En_6_Chapter.pdf (446.07 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03770552 , version 1 (06-09-2022)

Licence

Identifiers

Cite

Shuquan Wang, Lei Wang, Shiming Li, Tian Shuo, Shasha Guo, et al.. PRTSM: Hardware Data Arrangement Mechanisms for Convolutional Layer Computation on the Systolic Array. 16th IFIP International Conference on Network and Parallel Computing (NPC), Aug 2019, Hohhot, China. pp.69-81, ⟨10.1007/978-3-030-30709-7_6⟩. ⟨hal-03770552⟩
39 View
64 Download

Altmetric

Share

More