Finger Gesture Recognition with PPG Sensor on Smartwatch

In this project, we present a novel gesture input technique for off-the-shelf smartwatches. Our technique is designed to detect 10 hand gestures on the hand wearing a smartwatch. The technique is enabled by analyzing features of the Photoplethysmography (PPG) signals that optical heart-rate sensors capture. In a study with 20 participants, we show that our system achieves 90.55% accuracy and 90.73% recall. Without requiring bespoke hardware, our system can be readily used on existing smartwatches.

This work appears in UbiComp 2018.

Tao Gu
Tao Gu
Distinguished Professor
IEEE Fellow
AAIA Fellow
AAIS Fellow
School of Computer Sicence, Shanghai Jiao Tong University

Address: Room 437, Building 3, SEIEE No. 800 Dongchuan Road Minhang District, Shanghai, China

Email: FirstName.LastName AT sjtu.edu.cn

My research interests include Internet of Things, Ubiquitous Computing, Mobile Computing, Embedded AI, Wireless Sensor Networks, and Big Data Analytics.