Volltext-Downloads (blau) und Frontdoor-Views (grau)

Segmentation Strategies for Passage Retrieval from Internet Video using Speech Transcripts

  • We compare the effect of different segmentation strategies for passage retrieval of user generated internet video. We consider retrieval of passages for rather abstract and complex queries that go beyond finding a certain object or constellation of objects in the visual channel. Hence the retrieval methods have to rely heavily on the recognized speech. Passage retrieval has mainly been studied to improve document retrieval and to enable question answering. In these domains best results were obtained using passages defined by the paragraph structure of the source documents or by using arbitrary overlapping passages. For the retrieval of relevant passages in a video no author defined paragraph structure is available. We compare retrieval results from 5 different types of segments: segments defined by shot boundaries, prosodic segments, fixed length segments, a sliding window and semantically coherent segments based on speech transcripts. We evaluated the methods on the corpus of the MediaEval 2011 Rich Speech Retrieval task. Our main conclusions are (1) that fixed length and coherent segments are clearly superior to segments based on speaker turns or shot boundaries; (2) that the retrieval results highly depend on the right choice for the segment length; and (3) that results using the segmentation into semantically coherent parts depend much less on the segment length. Especially, the quality of fixed length and sliding window segmentation drops fast when the segment length increases, while quality of the semantically coherent segments is much more stable. Thus, if coherent segments are defined, longer segments can be used and consequently fewer segments have to be considered at retrieval time.

Download full text files

Export metadata

Additional Services

Search Google Scholar


Author:Christian WartenaORCiDGND
Parent Title (English):Journal of Digital Information Management
Document Type:Article
Year of Completion:2013
Publishing Institution:Hochschule Hannover
Release Date:2017/07/10
Tag:Multimedia Retrieval; Text Segmentation; User Generated Content; Video Segmentation
First Page:400
Last Page:408
Link to catalogue:175188256X
Institutes:Fakult├Ąt III - Medien, Information und Design
DDC classes:020 Bibliotheks- und Informationswissenschaft
Licence (German):License LogoUrheberrechtlich gesch├╝tzt