Data and Documentation
Open Data Policy
FAQ
EN
DE
FR
Suchbegriff
Advanced search
Project
Back to overview
MULTI: Multimodal Interaction and Multimedia Data Mining
English title
MULTI: Multimodal Interaction and Multimedia Data Mining
Applicant
Bourlard Hervé
Number
113615
Funding scheme
Project funding (Div. I-III)
Research institution
IDIAP Institut de Recherche
Institution of higher education
Idiap Research Institute - IDIAP
Main discipline
Information Technology
Start/End
01.10.2006 - 30.09.2008
Approved amount
866'564.00
Show all
Keywords (7)
automatic speech and audio processing; computer vision; advanced human-computer interaction; machine learning; indexing of multimedia information systems; retrieval ofmultimedia information systems; information retrieval
Lay Summary (English)
Lead
Lay summary
MULTI : MULTImodal Interaction and MULTImedia Data Mining
As a unified research theme, the goal of the MULTI project is to carry out fundamental research in the field of multimodal interaction, mainly covering a wide range of critical activities and applications, including recognition and interpretation of spoken, written and gestural language, recognition and interpretation of visual scenes, and processing and indexing of multi-channel (e.g., audio-visual)data streams. Other key sub-themes of MULTI include the control of information access, typically through biometric user authentication techniques (including speaker and face verification). Mainly exploiting related technologies of statistical modeling and data mining, MULTI also investigates advanced approaches towards the structuring, retrieval and presentation of multimedia information (e.g., resulting of multimodal meeting or lecture recordings), which also represents a wide-ranging and important research area that includes not only the multimodal interaction aspects, but also multimedia document analysis, indexing, and information retrieval, thus involving complex computer vision and data fusion algorithms. The research areas addressed in MULTI thus cover 6 complementary research themes, namely: (1) machine learning, (2) speech and audio processing, (3) computer vision,(4) information retrieval, (5) biometric authentication, and (6) multimodal interaction.
Direct link to Lay Summary
Last update: 21.02.2013
Responsible applicant and co-applicants
Name
Institute
Bourlard Hervé
Idiap Research Institute Martigny
Barber David
IDIAP Institut de Recherche
Dines John
IDIAP Institut de Recherche
Bengio Samy
Google Inc
Wellner Pierre
IDIAP Institut de Recherche
Marcel Sébastien
Idiap Research Institute Martigny
Vinciarelli Alessandro
IDIAP Institut de Recherche
Odobez Jean-Marc
Idiap Research Institute Martigny
Vepa Jithendra
IDIAP Institut de Recherche
Employees
Name
Institute
Farrahi Katayoun
Berrada Ghita
Vepa Jithendra
IDIAP Institut de Recherche
Zhang Dong
Ketabdar Hamed
Grangier David
Favre Sarah
Tosic Tamara
Laboratoire de traitement des signaux 4 EPFL - STI - IEL - LTS4
Aradilla-Zapata Guillermo
Bala Venkatesh
Paiement Jean-François
Roy Anindya
Laboratoire de l'IDIAP EPFL - STI - IEL - LIDIAP
Mesot Bertrand
Negoescu Radu
Salamin Hugues
Jayagopi Dinesh Babu
Multicomp Lab USC Institute for Creative Technologies affiliated to University of South California
Ba Sileye
Garimella Sri
Associated projects
Number
Title
Start
Funding scheme
105470
MULTI: Multimodal Interaction and Multimedia Data Mining
01.10.2004
Project funding (Div. I-III)
122062
MULTI: Multimodal Interaction and Multimedia Data Mining
01.10.2008
Project funding (Div. I-III)
-