Title: Cross-media alignment of names and faces
Authors: Pham, Phi The ×
Moens, Marie-Francine
Tuytelaars, Tinne #
Issue Date: Jan-2010
Publisher: Institute of Electrical and Electronics Engineers
Series Title: IEEE Transactions on Multimedia vol:12 issue:1 pages:13-27
Abstract: In this paper we report on our experiments on aligning names and faces as found in images and captions of online news websites. Developing accurate technologies for linking names and faces is valuable when retrieving or mining information from multimedia collections. We perform exhaustive
and systematic experiments exploiting the (a)symmetry between the visual and textual modalities. This leads to different schemes for assigning names to the faces, assigning faces to the names, and establishing name-face link pairs. On top of that, we investigate generic approaches to the use of textual and visual structural information to predict the presence of the corresponding entity in the other modality. The proposed methods are completely unsupervised and are inspired by methods for aligning phrases and words in texts of different languages developed for constructing dictionaries for machine translation. The results are competitive with state of the art performance on the ”Labeled Faces in the Wild” dataset in terms of recall values, now reported on the complete dataset, include excellent precision values, and show the value of text and image analysis for identifying the probability of being pictured or named in the alignment process.
Description: Pham P.T., Moens M.-F., Tuytelaars T., ''Cross-media alignment of names and faces'', IEEE transactions on multimedia, vol. 12, no. 1, pp. 13-27, January 2010.
ISSN: 1520-9210
Publication status: published
KU Leuven publication type: IT
Appears in Collections:Informatics Section
ESAT - PSI, Processing Speech and Images
× corresponding author
# (joint) last author

Files in This Item:
File Description Status SizeFormat
PhametalIEEETM.pdfMain article Published 1902KbAdobe PDFView/Open


All items in Lirias are protected by copyright, with all rights reserved.

© Web of science