Real time hand gesture detection by using convolutional neural network for in-vehicle infortainment systems

Wan Mohd Yaakob Wan Bejuri, Siti Azira Asmai, Raja Rina Raja Ikram, Nur Raidah Rahim, Najwan Khambari, Mohd Sanusi Azmi, Yus Sholva

Abstract


Nowadays, a variety of technologies on autonomous vehicles have been extensively developed, including in-vehicle infotainment (IVI). It have been noted as one of the key services in the automobile industry. In the near future, people will be able to watch some virtual reality (VR) movies through the streaming service provided in the vehicle. However, a person sometime not tend to be joy while watching espcially when the remote controller or audio sensory controller lack of battery or too far from IVI panel. Thus, the purpose of this research is to design a scheme of real time hand gesture detection for in-vehicle infotainment system, in order to create human computer experience. In this research, the image of human palm hand will be taken by using camera for recognize the hand gesture action. This proposed scheme will recognize human gesture and convert to be computer intruction, that can be understood by IVI device. As a result, it show our proposed scheme can be the most consistent in term of accuracy and loss compared to others method. Overall, this research represents a significant step toward improving better user experience. Furthermore, the proposed scheme is anticipated to contribute significantly to the IVI field, benefiting both academia and societal outcomes.

Keywords


Convulutionl neural network; Hand gesture detection; Human computer interaction; In-vehicle infortainment; Virtual reality;

Full Text:

PDF


DOI: http://doi.org/10.11591/ijict.v14i1.pp42-49

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

The International Journal of Informatics and Communication Technology (IJ-ICT)
p-ISSN 2252-8776, e-ISSN 2722-2616
This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU).

Web Analytics View IJICT Stats