Title: Unsupervised scene detection and commentator building using multi-modal chains
Authors: Poulisse, Gert-Jan
Patsis, Yorgos
Moens, Marie-Francine # ×
Issue Date: 2014
Publisher: Kluwer Academic Publishers
Series Title: Multimedia Tools and Applications vol:70 issue:1 pages:159-175
Abstract: This paper presents a novel unsupervised method for identifying the semantic
structure in long semi-structured video streams. We identify chains, i.e., local clusters of repeated features from both the video stream and audio transcripts. Each chain serves as an indicator that the temporal interval it demarcates is part of the same semantic event. By layering all the chains over each other, dense regions emerge from the overlapping chains, from which we can identify the semantic structure of the video. We present two clustering strategies that accomplish this task, and compare them against a baseline Scene Transition Graph approach. We then develop a commentator that provides a semantic labeling of the resultant video segmentation.
ISSN: 1380-7501
Publication status: published
KU Leuven publication type: IT
Appears in Collections:Informatics Section
× corresponding author
# (joint) last author

Files in This Item:
File Description Status SizeFormat
PoulissePatsisMoensMTAP2012.pdfMain article Published 499KbAdobe PDFView/Open


All items in Lirias are protected by copyright, with all rights reserved.

© Web of science