Joint Multi-object Detection and Segmentation from an Untrimmed Video - Artificial Intelligence Applications and Innovations
Conference Papers Year : 2020

Joint Multi-object Detection and Segmentation from an Untrimmed Video

Le Wang
  • Function : Author
  • PersonId : 1033453
Qilin Zhang
  • Function : Author
Gang Hua
  • Function : Author

Abstract

In this paper, we present a novel method for jointly detecting and segmenting multiple objects from an untrimmed video. Unlike most existing video object segmentation methods that can only handle a trimmed video in which all video frames contain the target objects, we address a more practical and difficult problem, i.e., joint multi-object detection and segmentation from an untrimmed video where the target objects do not always appear per frame. In particular, our method consists of two modules, i.e., object decision module and object segmentation module. The object decision module is used to detect the objects and decide which target objects need to be separated out from video. As there are usually two or more target objects and they do not always appear in the whole video, we introduce the data association into object decision module to identify their correspondences among frames. The object segmentation module aims to separate the target objects identified by object decision module. In order to extensively evaluate the proposed method, we introduce a new dataset named UNVOSeg dataset, in which $$7.2\%$$ of the video frames do not contain objects. Experimental results on four datasets demonstrate that our method outperforms most of the state-of-the-art approaches.
Fichier principal
Vignette du fichier
497040_1_En_27_Chapter.pdf (13.34 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04050585 , version 1 (29-03-2023)

Licence

Identifiers

Cite

Xinling Liu, Le Wang, Qilin Zhang, Nanning Zheng, Gang Hua. Joint Multi-object Detection and Segmentation from an Untrimmed Video. 16th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Jun 2020, Neos Marmaras, Greece. pp.317-329, ⟨10.1007/978-3-030-49161-1_27⟩. ⟨hal-04050585⟩
32 View
17 Download

Altmetric

Share

More