A Reservoir Computing Framework for Continuous Gesture Recognition

We present a novel gesture recognition system for the application of continuous gestures in mobile devices. We explain how meaningful gesture data can be extracted from the inertial measurement unit of a mobile phone and introduce a segmentation scheme to distinguish between different gesture classes. The continuous sequences are fed into an Echo State Network, which learns sequential data fast and with good performance. We evaluated our system on crucial network parameters and on our established metric to compute the number of successfully recognized gestures and the number of misclassifications. On a total of ten gesture classes, our framework achieved an average accuracy of 85%.

@InProceedings{TJW19, 
 	 author =  {Tietz, Stephan and Jirak, Doreen and Wermter, Stefan},  
 	 title = {A Reservoir Computing Framework for Continuous Gesture Recognition}, 
 	 booktitle = {Artificial Neural Networks and Machine Learning – ICANN 2019},
 	 editors = {},
 	 number = {},
 	 volume = {},
 	 pages = {7-18},
 	 year = {2019},
 	 month = {Sep},
 	 publisher = {Springer International Publishing},
 	 doi = {10.1007/978-3-030-30493-5_1}, 
 }