A2-LINK: Recognizing Disguised Faces via Active Learning and Adversarial Noise based Inter-Domain Knowledge

Face recognition in the unconstrained environment is an ongoing research challenge. Although several covariates of face recognition such as pose and low resolution have received significant attention“, disguise” is considered an onerous covariate of face recognition. One of the primary reasons for this is the scarcity of large and representative labeled databases, along with the lack of algorithms that work well for multiple covariates in such environments. In order to address the problem of face recognition in the presence of disguise, the paper proposes an active learning framework termed as A2-LINK. Starting with a face recognition machine-learning model, A2-LINK intelligently selects training samples from the target domain to be labeled and, using hybrid noises such as adversarial noise, fine-tunes a model that works well both in the presence and absence of disguise. Experimental results demonstrate the effectiveness and generalization of the proposed framework on the DFW and DFW2019 datasets with state-of-the-art deep learning featurization models such as LCSSE, ArcFace, and DenseNet.

PDF Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Heterogeneous Face Recognition Disguised Faces in the Wild A2-LINK GAR @0.1% FAR Impersonation 69.27 # 2
GAR @0.1% FAR Obfuscation 93.08 # 1
GAR @0.1% FAR Overall 93.01 # 1
GAR @1% FAR Impersonation 99.01 # 1
GAR @1% FAR Obfuscation 95.93 # 1
GAR @1% FAR Overall 95.99 # 1
Heterogeneous Face Recognition Disguised Faces in the Wild 2019 A2-LINK GAR @0.1% FAR Impersonation 79.2 # 1
GAR @0.1% FAR Obfuscation 99.00 # 1
GAR @0.1% FAR Plastic Surgery 98.80 # 1
GAR @0.1% FAR Overall 98.63 # 1
GAR @0.01% FAR Impersonation 54.40 # 1
GAR @0.01% FAR Obfuscation 97.20 # 1
GAR @0.01% FAR Plastic Surgery 96.00 # 1
GAR @0.01% FAR Overall 96.18 # 1
Heterogeneous Face Recognition Disguised Faces in the Wild 2019 A-LINK GAR @0.1% FAR Impersonation 76.40 # 2
GAR @0.1% FAR Obfuscation 96.84 # 2
GAR @0.1% FAR Plastic Surgery 95.20 # 2
GAR @0.1% FAR Overall 95.96 # 2
GAR @0.01% FAR Impersonation 52.80 # 2
GAR @0.01% FAR Obfuscation 94.02 # 2
GAR @0.01% FAR Plastic Surgery 92.00 # 2
GAR @0.01% FAR Overall 93.06 # 2

Methods