Gesture-based Human-Computer Interaction using Wearable Devices
DOI:
https://doi.org/10.36676/jrps.2023-v14i4-020Keywords:
physical ability, gestures, productivity, communicateAbstract
For decades, traditional computer interfaces such as keyboards and mouse have been the major way of interaction. These interfaces, however, can be restricted, particularly in situations when hands-free or realistic contact is sought. Gesture-based interactions are made possible by the use of wearable devices such as smartwatches or motion-capture sensors, which allow people to communicate with computers through natural hand and body gestures.
Gesture-based Human-Computer Interaction (HCI) is the technique of transmitting orders or input to a computer system using physical gestures such as hand movements, body movements, or facial expressions rather than standard input devices such as keyboards or touchpads. Gestures are a natural and intrinsic means for humans to communicate with one another. When gesture-based HCI is combined with wearable devices, people may interact with computers in a more intuitive and human-like manner. This natural contact improves the user experience and shortens the learning curve for computer systems. Gesture-based HCI is an alternative interaction style that can considerably help those with a physical disability or mobility issues. It allows for hands-free control, making technology more accessible to a wider variety of people, independent of physical ability. Gesture-based interactions have the potential to improve the efficiency of specific jobs, such as presentations, design work, and managing IoT devices. Because users can execute tasks quickly using simple gestures, it can lead to increased productivity and efficiency.
References
Chakraborty, Biplab Ketan, et al. "Review of constraints on vision‐based gesture recognition for human–computer interaction." IET Computer Vision 12.1 (2018): 3-15. DOI: https://doi.org/10.1049/iet-cvi.2017.0052
Gamberini L, Orso V, Beretta A, Jacucci G, Spagnolli A, Rimondi R. Evaluating User Experience of Augmented Reality Eyeglasses. Stud Health Technol Inform. 2015;219:28-32.
Graichen L, Graichen M, Krems JF. Effects of Gesture-Based Interaction on Driving Behavior: A Driving Simulator Study Using the Projection-Based Vehicle-in-the-Loop. Hum Factors. 2022 Mar;64(2):324-342. doi: 10.1177/0018720820943284. Epub 2020 Aug 14. DOI: https://doi.org/10.1177/0018720820943284
Kim SK, Kirchner EA, Stefes A, Kirchner F. Intrinsic interactive reinforcement learning - Using error-related potentials for real world human-robot interaction. Sci Rep. 2017 Dec 14;7(1):17562. doi: 10.1038/s41598-017-17682-7. DOI: https://doi.org/10.1038/s41598-017-17682-7
Palacios JM, Sagüés C, Montijano E, Llorente S. Human-computer interaction based on hand gestures using RGB-D sensors. Sensors (Basel). 2013 Sep 6;13(9):11842-60. doi: 10.3390/s130911842. DOI: https://doi.org/10.3390/s130911842
Qi W, Yang Y, Zhou Z, Gong J, Chen P. [Research on performance optimization method of human-machine physical interaction system considering exoskeleton wearing comfort]. Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2023 Feb 25;40(1):118-124. Chinese. doi: 10.7507/1001-5515.202209022.
Sarma D, Bhuyan MK. Methods, Databases and Recent Advancement of Vision-Based Hand Gesture Recognition for HCI Systems: A Review. SN Comput Sci. 2021;2(6):436. doi: 10.1007/s42979-021-00827-x. Epub 2021 Aug 29. DOI: https://doi.org/10.1007/s42979-021-00827-x
Tellaeche Iglesias A, Fidalgo Astorquia I, Vázquez Gómez JI, Saikia S. Gesture-Based Human Machine Interaction Using RCNNs in Limited Computation Power Devices. Sensors (Basel). 2021 Dec 8;21(24):8202. doi: 10.3390/s21248202. DOI: https://doi.org/10.3390/s21248202
Werner C, Kardaris N, Koutras P, Zlatintsi A, Maragos P, Bauer JM, Hauer K. Improving gesture-based interaction between an assistive bathing robot and older adults via user training on the gestural commands. Arch Gerontol Geriatr. 2020 Mar-Apr;87:103996. doi: 10.1016/j.archger.2019.103996. DOI: https://doi.org/10.1016/j.archger.2019.103996
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Re-users must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use. This license allows for redistribution, commercial and non-commercial, as long as the original work is properly credited.