Seamless Payment System Using Face and Low-Energy Bluetooth

Yeongnam Chae, Kelvin Cheng, Pankaj Wasnik, Bjorn Stenger; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2020, pp. 816-817

Abstract


This paper introduces a multi-modal authentication approach for payments using a face image and the low energy Bluetooth (BLE) signal of a user's device. Devices of registered users transmit temporally changing one-time identifiers. During a payment request, the query face image is only matched with database entries corresponding to nearby users, thereby significantly reducing the complexity of the task. For cases in which a user does not carry their device, the system includes a fallback mechanism to PIN-based two-factor authentication. A classifier on depth data input is used to reduce vulnerability to presentation attacks. We conducted a user study of different payment methods and demonstrated our system at a public event with 951 users.

Related Material


[pdf]
[bibtex]
@InProceedings{Chae_2020_CVPR_Workshops,
author = {Chae, Yeongnam and Cheng, Kelvin and Wasnik, Pankaj and Stenger, Bjorn},
title = {Seamless Payment System Using Face and Low-Energy Bluetooth},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2020}
}