manifold learning; generative modelling; heterogeneous face recognition; biometrics; session variability
Pereira Tiago de Freitas, Anjos Andre, Marcel Sebastien (2019), Heterogeneous Face Recognition Using Domain Specific Units, in IEEE Transactions on Information Forensics and Security
Sequeira Ana F., Chen Lulu, Ferryman James, Wild Peter, Alonso-Fernandez Fernando, Bigun Josef, Raja Kiran B., Raghavendra R., Busch Christoph, de Freitas Pereira Tiago, Marcel Sebastien, Behera Sushree Sangeeta, Gour Mahesh, Kanhangad Vivek (2017), Cross-eyed 2017: Cross-spectral iris/periocular recognition competition, in 2017 IEEE International Joint Conference on Biometrics (IJCB)
, Denver, COIEEE, 2017.
Pereira Tiago de Freitas, Marcel Sebastien (2016), Heterogeneous Face Recognition Using Inter-Session Variability Modelling, in 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
, Las Vegas, NV, USAIEEE, 2016.
de Freitas Pereira Tiago, Marcel Sebastien (2015), Periocular biometrics in mobile environment, in 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS)
, Arlington, VA, USAIEEE, 2015.
Freitas Pereira Tiago de, Komulainen Jukka, Anjos André, De Martino José Mario, Hadid Abdenour, Pietikäinen Matti, Marcel Sébastien (2014), Face liveness detection using dynamic texture, in EURASIP Journal on Image and Video Processing
, 2014(1), 2-2.
Face recognition has existed as a field of research for more than 30 years and has been particularly active since the early 1990s. Researchers of many different fields (from psychology, pattern recognition, neuroscience, computer graphics and computer vision) have attempted to create and understand face recognition systems.One of the most challenging tasks in automated face recognition is the matching between face images acquired in heterogeneous environments. Use-cases can cover matching of faces in unconstrained scenarios (e.g. at a distance), with long time lapse between the probe and the gallery and faces sensed in different modalities, such as thermal infrared or near infrared images (NIR) against visible spectra images (VIS). Successful solutions to heterogeneous face recognition can extend the reach of these systems to covert scenarios, such as recognition at a distance or at nighttime, or even in situations where no face even exists (forensic sketch recognition).The key difficult in matching faces from heterogeneous conditions is that images of the same subject may differ in appearance due to changes in image modality (e.g. between VIS images and NIR images, between VIS images and sketches images) introducing high intra-class variations. With these variations, a direct comparison between samples generally results in poor matching accuracy. Heterogeneous face recognition algorithms must develop facial representations invariant to these changes. In this proposal, we present three strategies to cope with these challenges.We will start by investigating manifold learning techniques. The key idea of manifold learning is to learn a joint mapping that project images, of different modalities, into a subspace where these projections can be compared directly with a simple distance function.As a second step, we will investigate generative approaches for face recognition. Generative approaches compute the likelihood of an observation (face image) or a set of observations given the a statistical model of the subject. In this environment, cross-sensor or hetereogeneous matching can be regarded as a session variability information the model needs to cope with, compensating for them during the enrollment and probing.Finally, a combination of both techniques will be investigated. This combination can be carried out in two different ways. At first, we will investigate score level fusion between the joint map learned with manifold learning approaches and the generative approach. We will then investigate the possibility to provide face images projected with the manifold learning techniques as input the generative face recognition systems.