Assessing Layer Normalization with BraTS MRI Data in a Convolution Neural Net - Computational Intelligence in Data Science
Conference Papers Year : 2022

Assessing Layer Normalization with BraTS MRI Data in a Convolution Neural Net

Akhilesh Rawat
  • Function : Author
  • PersonId : 1332878
Rajeev Kumar
  • Function : Author
  • PersonId : 1332879

Abstract

Deep learning-based Convolutional Neural Network (CNN) architectures are commonly used in medical imaging. Medical imaging data is highly imbalanced. A deep learning architecture on its own is prone to overfit. As a result, we need a generalized model to mitigate total risk. This paper assesses a layer normalization (LN) technique in a CNN-based 3D U-Net for faster training and better generalization in medical imaging. Layer Normalization (LN) is mostly used in Natural Language Processing (NLP) tasks such as question-answering, handwriting sequence generation, etc. along with Recurrent Neural Network (RNN). The usage of LN is yet to be studied in case of medical imaging. In this context, we use brain MRI segmentation and train our model with LN and without normalization. We compare both models and our LN-based model gives $$32\%$$32% less validation loss over without normalization-based model. We achieve validation dice scores of unseen input data passes to LN based model of 0.90 ($$7.5\%$$7.5% higher than without normalization) for edema, 0.74 ($$12.5\%$$12.5% higher than without normalization) for non-enhancing tumor and 0.95 ($$1.5\% $$1.5%higher than without normalization) for enhancing tumor.
Embargoed file
Embargoed file
0 0 26
Year Month Jours
Avant la publication
Wednesday, January 1, 2025
Embargoed file
Wednesday, January 1, 2025
Please log in to request access to the document

Dates and versions

hal-04381305 , version 1 (09-01-2024)

Licence

Identifiers

Cite

Akhilesh Rawat, Rajeev Kumar. Assessing Layer Normalization with BraTS MRI Data in a Convolution Neural Net. 5th International Conference on Computational Intelligence in Data Science (ICCIDS), Mar 2022, Virtual, India. pp.124-135, ⟨10.1007/978-3-031-16364-7_10⟩. ⟨hal-04381305⟩
29 View
2 Download

Altmetric

Share

More