Simultaneous Tracking of Cardiorespiratory Signals for Multiple Persons Using a Machine Vision System With Noise Artifact Removal

IEEE J Transl Eng Health Med. 2017 Sep 29:5:1900510. doi: 10.1109/JTEHM.2017.2757485. eCollection 2017.

Abstract

Most existing non-contact monitoring systems are limited to detecting physiological signs from a single subject at a time. Still, another challenge facing these systems is that they are prone to noise artifacts resulting from motion of subjects, facial expressions, talking, skin tone, and illumination variations. This paper proposes an efficient non-contact system based on a digital camera to track the cardiorespiratory signal from a number of subjects (up to six persons) at the same time with a new method for noise artifact removal. The proposed system relied on the physiological and physical effects as a result of the activity of the cardiovascular and respiratory systems, such as skin color changes and head motion. Since these effects are imperceptible to the human eye and highly affected by the noise variations, we used advanced signal and video processing techniques, including developing video magnification technique, complete ensemble empirical mode decomposition with adaptive noise, and canonical correlation analysis to extract the heart rate and respiratory rate from multiple subjects under the noise artifact assumptions. The experimental results of the proposed system had a significant correlation (Pearson's correlation coefficient = 0.9994, Spearman correlation coefficient = 0.9987, and root mean square error = 0.32) when compared with the conventional contact methods (pulse oximeter and piezorespiratory belt), which makes the proposed system a promising candidate for novel applications.

Keywords: Cardiorespiratory signal; camera imaging-based methods; canonical correlation analysis; complete ensemble EMD with adaptive noise; graphical user interface; imaging photoplethysmography (iPPG); video magnification technique.

Grants and funding

This work was supported by the Defence Science and Technology Group’s Tyche Program on trusted autonomy.