Improving Speech Emotion Recognition by Fusing Pre-trained and Acoustic Features Using Transformer and BiLSTM - Intelligent Information Processing XI Access content directly
Conference Papers Year : 2022

Improving Speech Emotion Recognition by Fusing Pre-trained and Acoustic Features Using Transformer and BiLSTM

Zheng Liu
  • Function : Author
  • PersonId : 1275187
Xin Kang
  • Function : Author
  • PersonId : 1275130
Fuji Ren
  • Function : Author
  • PersonId : 1275131

Abstract

With the emergence of machine learning and the deepening of human-computer interaction applications, the field of speech emotion recognition has attracted more and more attention. However, due to the high cost of speech emotion corpus construction, the speech emotion datasets are scarce. Therefore, how to obtain higher accuracy of recognition under the condition of limited corpus is one of the problems of speech emotion recognition. To solve the problem, we fused speech pre-trained features and acoustic features to enhance the generalization of speech features and proposed a novel feature fusion model based on Transformer and BiLSTM. We fused the speech pre-trained features extracted by Tera, Audio Albert, and Npc with the acoustic features of the voice, and conducted experiments on the CASIA Chinese voice emotion corpus. The results showed that our method and model achieved 94% accuracy in the Tera model.
Embargoed file
Embargoed file
0 7 12
Year Month Jours
Avant la publication
Wednesday, January 1, 2025
Embargoed file
Wednesday, January 1, 2025
Please log in to request access to the document

Dates and versions

hal-04178746 , version 1 (08-08-2023)

Licence

Attribution

Identifiers

Cite

Zheng Liu, Xin Kang, Fuji Ren. Improving Speech Emotion Recognition by Fusing Pre-trained and Acoustic Features Using Transformer and BiLSTM. 12th International Conference on Intelligent Information Processing (IIP), May 2022, Qingdao, China. pp.348-357, ⟨10.1007/978-3-031-03948-5_28⟩. ⟨hal-04178746⟩
12 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More