Title :
The Community and the Crowd: Multimedia Benchmark Dataset Development
Author :
Larson, Martha ; Soleymani, Mohammad ; Eskevich, Maria ; Serdyukov, Pavel ; Ordelman, Roeland ; Jones, Gareth
Author_Institution :
Delft Univ. of Technol., Delft, Netherlands
Abstract :
The MediaEval Multimedia Benchmark leveraged community cooperation and crowdsourcing to develop a large Internet video dataset for its Genre Tagging and Rich Speech Retrieval tasks.
Keywords :
Internet; benchmark testing; identification technology; information retrieval; multimedia computing; outsourcing; speech processing; video signal processing; Internet video dataset; MediaEval multimedia benchmark; community cooperation; crowdsourcing; genre tagging; multimedia benchmark dataset development; rich speech retrieval tasks; Algorithm design and analysis; Benchmark testing; Collaboration; Human factors; Internet; Large-scale systems; Multimedia communication; Outsourcing; Speech processing; Streaming media; benchmarking; crowdsourcing; ground truth; large-scale multimedia data; multimedia;
Journal_Title :
MultiMedia, IEEE
DOI :
10.1109/MMUL.2012.27
