Fast and robust occluded face detection in ATM surveillance

Publication Type:
Journal Article
Pattern Recognition Letters, 2018, 107 pp. 33 - 40
Issue Date:
Filename Description Size
PRL_Zhang_ATM_20180118_article in press.pdfAccepted Manuscript Version953.33 kB
Adobe PDF
Full metadata record
© 2017 Elsevier B.V. Crimes with respect to ATMs (Automatic Teller Machines) have attracted more and more attention, where criminals deliberately cover their faces in order to avoid being identified. This paper proposes a fast and robust face occlusion detection algorithm for ATM surveillance, which is demonstrated to be effective and efficient to handle arbitrarily occluded faces. In this algorithm, we innovatively propose to make use of the Omega shape formed by the head and shoulder of the person for head localization to tackle severe face occlusion. For this purpose, we first construct a novel energy function for elliptical head contour detection. Then, we develop a fast and robust head tracking algorithm, which utilizes the gradient and shape cues in a Bayesian framework. Lastly, to verify whether a detected head is occluded or not, we propose to fuse information from both skin color and face structure using the AdaBoost algorithm. Experimental results on real world data show that our proposed algorithm can achieve 98.64% accuracy on face detection and 98.56% accuracy on face occlusion detection, even though there are severe occlusions in faces, at a speed of up to 12 frames per second.
Please use this identifier to cite or link to this item: