Using Multimodal Contextual Process Information for the Supervised Detection of Connector Lock Events - Artificial Intelligence Applications and Innovations
Conference Papers Year : 2020

Using Multimodal Contextual Process Information for the Supervised Detection of Connector Lock Events

David Bricher
  • Function : Author
  • PersonId : 1245228
Andreas Müller

Abstract

The field of sound event detection is a growing sector which has mainly focused on the identification of sound classes from daily life situations. In most cases these sound detection models are trained on publicly available sound databases, up to now, however, they do not include acoustic data from manufacturing environments. Within manufacturing industries, acoustic data can be exploited in order to evaluate the correct execution of assembling processes. As an example, in this paper the correct plugging of connectors is analyzed on the basis of multimodal contextual process information. The latter are the connector’s acoustic properties and visual information recorded in form of video files while executing connector locking processes.For the first time optical microphones are used for the acquisition and analysis of connector sound data in order to differentiate connector locking sounds from each other respectively from background noise and sound events with similar acoustic properties. Therefore, different types of feature representations as well as neural network architectures are investigated for this specific task.The results from the proposed analysis show, that multimodal approaches clearly outperform unimodal neural network architectures for the task of connector locking validation by reaching maximal accuracy levels close to 85$$\%$$. Since in many cases there are no additional validation methods applied for the detection of correctly locked connectors in manufacturing industries, it is concluded that the proposed connector lock event detection framework is a significant improvement for the qualitative validation of plugging operations.
Fichier principal
Vignette du fichier
500087_1_En_11_Chapter.pdf (946.94 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04060655 , version 1 (06-04-2023)

Licence

Identifiers

Cite

David Bricher, Andreas Müller. Using Multimodal Contextual Process Information for the Supervised Detection of Connector Lock Events. 16th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Jun 2020, Neos Marmaras, Greece. pp.123-134, ⟨10.1007/978-3-030-49186-4_11⟩. ⟨hal-04060655⟩
24 View
26 Download

Altmetric

Share

More