Exploring Educational Applicability of Virtual Touch System on Maker Space
2022 IEEE 5th International Conference on Knowledge Innovation and Invention (ICKII )(2022)
摘要
Interaction with gestures is more intuitive than traditional input with a keyboard and a mouse. It has gradually become the major technology for extended reality. However, for most users, gesture control is not familiar as other interactive devices, and most user interfaces of daily-use applications are currently not designed for gesture control. Thus, we propose a mid-air hand gesture control system, named vTouch to realize a touch device trained by deep learning with a convolutional neural network for image feature extraction, attention mechanisms for extracting time-series data features, and fully connected layer for classification. Besides, there is a customized driver in kernel mode which treats the vTouch system as a virtual multi-touch device. An experimental design is also proposed to evaluate the effectiveness of the training and the usability of the system.
更多查看译文
关键词
Human-computer interaction (HCI),Hand Key-point estimation,Gesture recognition,Deep learning,Windows driver
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要