Video Based Measurement of Heart Rate and Heart Rate Variability Spectrogram From Estimated Hemoglobin Information

Munenori Fukunishi, Kouki Kurita, Shoji Yamamoto, Norimichi Tsumura; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2018, pp. 1324-1331

In this paper, we propose an accurate remote observation of the heart rate (HR) and heart rate variability (HRV) based on extracted hemoglobin information which is based on detail skin optics model. We perform experiments to measure subjects at rest and under cognitive stress with the proposed method putting a polarized filter in front of camera to evaluate the principal of the framework. From the results of the experiments, the proposed method shows a high correlation with the electrocardiograph (ECG) which is assumed as the ground truth. We also evaluated the robustness against illumination change in simulation. We confirmed that the proposed method could obtain accurate BVP detection compared with other conventional methods since the proposed method eliminates the shading component through the process of the extraction of hemoglobin component.