ACM international conference on multimodal interaction - ICMI 2016, Date: 2016/11/12 - 2016/11/16, Location: Tokyo, Japan
Proceedings ICMI 2016
Author:
Keywords:
PSI_VISICS, PSI_SPEECH, Science & Technology, Technology, Computer Science, Artificial Intelligence, Computer Science, Theory & Methods, Computer Science, Active Speaker Detection, Audio-visual Co-training, RECOGNITION, PSI_4141
Abstract:
© 2016 ACM. In this work, we show how to co-Train a classifier for active speaker detection using audio-visual data. First, audio Voice Activity Detection (VAD) is used to train a personalized video-based active speaker classifier in a weakly supervised fashion. The video classifier is in turn used to train a voice model for each person. The individual voice models are then used to detect active speakers. There is no manual supervision -Audio weakly supervises video classification, and the co-Training loop is completed by using the trained video classifier to supervise the training of a personalized audio voice classifier.