Captioning of Image Conceptually Using BI-LSTM Technique - Computational Intelligence in Data Science
Conference Papers Year : 2021

Captioning of Image Conceptually Using BI-LSTM Technique

Kanimozhi Soundararajan
  • Function : Author
  • PersonId : 1162781
T. Mala
  • Function : Author
K. Narmatha
  • Function : Author
  • PersonId : 1162782
G. Meena
  • Function : Author

Abstract

Due to the fact of increase in amount of video data each day, the need for auto generation of captioning them clearly is inevitable. Video captioning makes the video more accessible in numerous ways. It allows the deaf and hard of hearing individuals to watch videos, helps people to focus on and remember the information more easily, and lets people watch it in sound- sensitive environments. Video captioning refers to the task of generating a natural language sentence that explains the content of the input video clips. The events are temporally localized in the video with independent start and end times. At the same time, some events that might also occur concurrently and overlap in time. Classifying the events into present, past and future as well as separating them based on their start and end times will help in identifying the order of events. Hence the proposed work develops a captioning system that clearly explains each visual feature that is present in the image conceptually. The Blended-LSTM (Bl- LSTM) model with the help of Xception based Convolution Neural Network (CNN) with Fusion Visual Captioning (FVC) system achieves it with the BLEU score of 75.9%.
Fichier principal
Vignette du fichier
512058_1_En_7_Chapter.pdf (514.11 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03772934 , version 1 (08-09-2022)

Licence

Identifiers

Cite

Thaseena Sulthana, Kanimozhi Soundararajan, T. Mala, K. Narmatha, G. Meena. Captioning of Image Conceptually Using BI-LSTM Technique. 4th International Conference on Computational Intelligence in Data Science (ICCIDS), Mar 2021, Chennai, India. pp.71-77, ⟨10.1007/978-3-030-92600-7_7⟩. ⟨hal-03772934⟩
32 View
25 Download

Altmetric

Share

More