International Journal on Recent and Innovation Trends in Computing and Communication

Volume: 3 Issue: 2

ISSN: 2321-8169
338 341

_______________________________________________________________________________________________

Human Computer Interaction Using Hand Data Glove and Wii Remote
Prof. Humera N. Syed

Prof. M.S. Khatib

Deptt. Of Computer Science & Engineering

Anjuman College of Engineering & Technology
Nagpur, India
[email protected]

Deptt. Of Computer Science & Engineering

Anjuman College of Engineering & Technology
Nagpur, India
[email protected]

Prof. Kamlesh Kelwade

Prof. Abdul Razzaque

Deptt. Of Computer Science & Engineering

Anjuman College of Engineering & Technology
Nagpur, India
[email protected]

Deptt. Of Computer Science & Engineering

Anjuman College of Engineering & Technology
Nagpur, India
[email protected]

AbstractA real time Human Computer Interaction based on th e hand data glove for gesture recognition is proposed. The
proposed system can capture hand gesture through the use of hand data glove which is equipped with sensor that senses the
movement of hand and pass those movements to the computer through the use of Wii Remotes IR camera in the form of
continuous signals. Using Wii Remote we can calibrate the area to work with and plot the output almost on any platform by using
projector. Gestures are classified as clicking, double clicking, and dragging. Recognizing these gestures relevant actions are taken
such as drawing using paint, sending message and call dialing using GSM modem and GUI application to interact. The results
show that glove used for interaction is better than normal static keyboard and mouse as the interaction process is more accurate
and dynamic in natural environment
Keywords- Human Computer Interaction, Data Glove, Wi i Remote, IR camera, Virtual Reality, Hand Gesture Recognition.

__________________________________________________*****_________________________________________________

I.

INTRODUCTION

Virtual Reality [1] had made its way in increasing the power
of computers making it realistic and interactive. Virtual
Reality has replaced the traditional use of keyboard, mouse
and joystick in HCI environment. Data glove is one such
sensing device used in Virtual Reality for hand gesture
recognition [2] in HCI and it is based on sensor based approach.
Hand data glove [3] [4] is an electronic device which is equipped
with sensors sensing the movements of fingers, and passes
those movements to the computer in the form of signals
continuously. Hand data gloves are used in applications
including virtual reality [5], gaming [6], robotics [7], character
recognition and verification, shopping applications and the
most important use is in medical surgery where it is used for
practical purpose because it is highly accurate. Here Hand data
glove will be used to provide a user interface for painting, call
dialing, message sending and also for opening any icon from
the computer.
This paper represents a special interactive system which
consists of a Bluetooth enabled computer running a calibration
utility software, a projector connected to the computer, a GSM
modem connected to the computer for the call dialing and
message sending purpose, a whiteboard on which projection
can be done, a Hand data glove equipped with sensor,
Nintendos Wii Remote for capturing the signals sent by the
Hand data glove. Some recent works include i) Tarchanidis et
al. [8] developed a data glove based on force sensors that are
attached to each finger. This data glove was used to detect the
tactile sensation, but it had limitations of precise recognition.
ii) Johnny Chung Lee [9] described a classical IR pen or Stylus

(shown in fig.1) which was used for educational purpose, but

it had disadvantage of perceiving signals accurately from
different distances. Also because of the wrong placement of
the IR camera many blind spots were created on the
whiteboard affecting the reflection produced by the IR camera.
It had inconvenient button style for activating IR signals.
Moreover, the Stylus had an inappropriate design and is not
durable. With classical IR pen, many different reflection
signals are sent to the IR receiver, which may accept some or
all of these, because the IR LED is located on top of pen with
the LED facing towards the whiteboard. On the other hand the
LED in the Hand data glove is placed facing away from the
whiteboard, sending IR directly to the receiver with no
reflection. The IR LED of the Hand data glove is activated
when the user touches the whiteboard unlike the classical IR
pen which requires frequent pressing of the button to activate
the IR LED. The Bluetooth enabled computer runs calibration
utility software

Figure 1. Classical IR pen

338
IJRITCC | February 2015, Available @ http://www.ijritcc.org

_______________________________________________________________________________________

International Journal on Recent and Innovation Trends in Computing and Communication

Volume: 3 Issue: 2

ISSN: 2321-8169
338 341

_______________________________________________________________________________________________
II.

PROPOSED SYSTEM

A. Hand Data Glove

This is one of the sensor based device having touch
capability. Finger touch position can be detected accurately by
this data glove. Hand data glove is wireless and provides
Graphic User Interface [12]. Mouse has only 3 degrees of
freedom to move on the other hand human hands have 30
degrees of freedom [4] to move, due to this user get more
flexibility to perform the computer operations than a mouse
control. To recognize hand gesture accurately and successfully
data glove is used. Here, glove is used to capture current
position of the fingers. Operations like left click right click,
and drag and drop are possible. Moreover this, applications
like call dialing, message sending and drawing using paint is
also achieved through the use of Hand data glove (shown in
fig.2).
Figure 3. Nintendos Wii Remote

Figure 4. Wii Remotes IR camera

Figure 2. A typical Hand Data Glove

This Hand data glove is equipped with a switch and an IR

sensor which uses LED for transmitting signal to the Wii
Remote. Many materials are used for the glove, including
leather, cotton, and plastic. The leather gloves prove to be
efficient for this system, since the sensor is attached firmly and
the glove can easily be removed without destroying the sensors.
B. Nintendos Wii Remote
Nintendos Wii Remote [10] [11] contains an accelerometer, an
IR camera, a Bluetooth communication system. Wii Remote
model (shown in fig.3) used is RVL- CNT- 01-TR. Pressing
the sync button of the Wii Remote, the Wii Remote can be put
in to discovery mode and then the device Nintendo (RVLCNT- 01-TR) can be added. Here the passkey option should be
set to Do not use a passkey. Accelerometer [6] used in Wii
Remote is ADXL 330 based on MEMS (Micro Electro
Mechanical Systems) technology. It is 200 micrometers in
diameter. The IR camera (shown in fig.4) is located at the end
of the Wii Remote.
IR camera has a resolution of 1024 * 768 and has 45 degrees
horizontal field of view. In contrast a normal web cam has a
resolution of 640 * 480. For each point the reported X and Y
co-ordinates range from 0-1023 and 0-767 respectively and
Wii Remote can track up to four of these points at a frequency
of 100 Hz. This is a major advantage because a normal web
cam operates between 10 and 30 Hz.

This camera cannot be used to take a conventional picture

because the data is in the form of 0s and 1s. Thi s Wii
Remote has four LED displays on it which blink when the
battery is full. Wii Remote is able to send reports to the host
with maximum frequency of 100 points per second.
A property of Light Emitting Diodes (LEDs) (shown in
fig.5) is that they produce a certain wavelength of light when
an electric current is applied through a switch but they also
produce current when they are subjected to the same
wavelength light. Infrared light is not visible because its
wavelength is too long to be detected by the human eye

Figure 5. IR LED

III.

METHODOLOGY

The system process flow is shown in fig.6. The initial

hardware setup contains a projector connected to the
computer, a GSM modem connected to the computer for the
call dialing application, Hand data glove equipped with sensor,
Nintendos Wii Remote [13] [14]. The initial software setup
contains calibration utility software. Wii Remotes IR camera
has a resolution of 1024*768, which is a large working area.
Nowadays laptops have a screen resolution of 800*600. The
working area in the system should be according to the laptop
screen resolution. Therefore, the working area is specified by
339

IJRITCC | February 2015, Available @ http://www.ijritcc.org

_______________________________________________________________________________________

International Journal on Recent and Innovation Trends in Computing and Communication

Volume: 3 Issue: 2

ISSN: 2321-8169
338 341

_______________________________________________________________________________________________
means of calibration. Calibration [15] is also essential to make
the glove measurements unaffected by the differences in users
hands, finger length and thickness. This calibration is
performed by calibration utility software where the user have
to flex their hand four times.
Whenever a click event is being performed by the Hand data
glove, IR sensor [16] transmits signal to the Wii Remotes IR
camera. IR camera receives the signal and wherever the click
event is being performed, it changes the color of that particular
pixel to black and rest all the pixels are set to grey. IR camera
also finds out the X and Y co-ordinates of that particular pixel.
Nintendos Wii Remotes IR camera [17] [18] is capable of
providing accurate positional information. IR camera is
connected to the laptop via Bluetooth and sends the coordinate data to the Wii library or Wii drivers via Bluetooth.
Wii library or Wii drivers returns the calculated X and Y coordinates to the calibration utility software which is connected
to the Windows Operating System. The co-ordinate data is
then sent to the O.S. The O.S hence controls the mouse cursor
whose effects are seen in the form of output shown through the
use of a projector.

Figure 8. After clicking on the quick calibration

INITIAL HARWARE SETUP

INITIAL SOFTWAREWARE SETUP CALIBRATE

Figure 9. User clicking on the first, second, third and fourth calibration
points respectively and performing free hand drawing.

CLICK EVENT PERFORMED AND IR SENSOR

TRANSMITS SIGNAL TO IR CAMERA
IR CAMERA RECEIVES SIGNAL
IR CAMERA IS CONNECTED TO THE SYSTEM VIA
BLUETOOTH
SYSTEM RUNNING CALIBRATION UTILITY
SOFTWARE

CALIBRATION UTILITY SOFTWARE IS CONNECTED

TO THE O .S
CALIBRATION UTILITY SOFTWARE SENDS DATA TO
THE O.S

Figure 10. User running the call dialing application

CO-ORDINATES OF THE CLICK PERFORMED ARE
CONTROLLED BY O.S
O.S CONTROLS MOUSE CURSOR

Figure 6. System Process Flow

IV.

RESULTS

V.

In this paper an inexpensive interface approach is represented

through which almost any surface can be made interactive
using Nintendos Wii Remote and gesture recognition is
achieved through the use of Hand data glove.
This Hand data glove is capable of sending signals to the Wii
Remotes IR camera via IR sensor. Nintendos Wii Re mote is
capable of sending data to the PC through Bluetooth facility.
Nintendos Wii Remotes IR camera is capable of pro viding
accurate positional information.
Here the two applications, the call dialing application and the
paint application are performed through gesture recognition by
Hand data glove. It is found that human hands have greater
Degree Of Freedom than a keyboard and a mouse control,
providing better outputs in the field of virtualization, thus
limiting the use of mouse and keyboard.
VI.

Figure 7. Before clicking on the Quick Calibration

CONCLUSION

FUTURE WORK

In the future, the data glove can be used to type characters,

browse internet, making it completely independent of
340

IJRITCC | February 2015, Available @ http://www.ijritcc.org

_______________________________________________________________________________________

International Journal on Recent and Innovation Trends in Computing and Communication

Volume: 3 Issue: 2

ISSN: 2321-8169
338 341

_______________________________________________________________________________________________
keyboard and mouse. High dimensional applications could
also be tried running on this system and all the main controls
required for running the application can be achieved through
the use of Hand data glove. Using the Hand data glove, a
combination of two or more gestures can form a new complex
gesture for a complex task.
REFERENCES
[1] Dr. Manolya Kavakali and Dilshan Jayarathna, Virtu al Hand: An
Interface for Interactive Sketching in Virtual Reality, (CIMCAIAWTIC05),2005, IEEE
[2]

S. Mitra and T. Acharya, "Gesture Recognition: A Survey", IEEE

Transactions on Systems, Man and Cybernetics," vol. 37, no. 3, May
2007,pp. 311-324

[3] Hanan Teleb and George Chang, Data Glove Integrati on with 3D
Virtual Environments, International Conference on Systems and
Informatics, 2012, IEEE, 107-112.
[4] Chin-Shyurng Fahn and Herman Sun, Development of a Data Glove
With Reducing Sensors Based on Magnetic Induction, IEEE
Transactions on Industrial Electronics, vol. 52, no. 2, April, 2005, 585594.
[5] Tuukka M. Takala, Roberto Pugliese, Pivi Rauhamaa and Tapio Takala,
Reality-based User Interface System (RUIS) , IEEE Symposium on 3D
User Interfaces 2011, IEEE, 141-142.
[6] Shiratori and Hodgins, Accelerometer-based user in terfaces for the
control of a physically simulated character ACM Tr ansactions on
Graphics 27, 5, pp. 19. 2008.
[7] C. Lee, and Y. Xu, Interactive Learning of Gesture s for Human/Robot
Interfaces. In IEEE International Conf erence on Robotics and
Automation, pp. 2982-2987, 1996.
[8] K. N. Tarchanidis and J. N. Lygouras , "Data Glove with a Force Sensor,
" IEEE Transactions on Instrumentation and Measurement, vol. 52, no. 3,
June 2003, pp. 984-989.

[9] Johnny Chung Lee, "Hacking the Nintendo Wii Remote," Pervasive
computing, vol. 7, no. 3, 2008, pp. 39-45.
[10] D Balakrishna, PV Sailaja, RVV Prasad Rao, and Bipin Indurkhya, A
Novel Human Robot Interaction using the Wiimote , Proceedings of the.
2010 IEEE, International Conference on Robotics and Biomimetics,
December 14-18, 2010, Tianjin, China, 645-650
[11] Sven Olufs and Markus Vincze, A Simple Inexpensive Interface for
Robots using the Nintendo Wii Controller, The 2009 IEEE/RSJ
International Conference on Intelligent Robots and Systems October 1115, 473-479.
[12] Riyeth P. Tanyag, Marc Jordan G. Angco, Rowel O. Atienza, InCtrl
HD: Intuitive User Interface Control using Wii Remote for High
Definition Videoconferencing, 2009 International C onference on
Information and Multimedia Technology, 99-103.
[13] Luigi Gallo and Mario Ciampi, Wii Remote-enhanced Hand-Computer
IEEE Interaction for 3D Medical Image Analysis, 2009, IEEE.
[14] Leonidas Deligiannidis, and John Larkin, Navigatin g Inexpensively and
Wirelessly, May 25-27, 2008, IEEE.
[15] Sung-Yeol Kim, Woon Cho, Andreas Koschan, and Mongi A. Abidi,
Depth Data Calibration and Enhancement of Time-of- flight Videoplus-Depth Camera, 2011, IEEE.
[16] Ryan Connaughton and Matthew Modlin, A Modular and Extendable
Robotics Platform for Education, 39th A SEE/IEEE Frontiers in
Education Conference, 2009, IEEE, T2G-1 - T2G-4.
[17] Deliang Zhu, Zhiquan Feng, Bo Yang, Yan Jiang and Tiantian Yang,
The Design and Implementation of 3D Hand-based Hum an-Computer
Interaction Platform, 2010 International Conference on Computer
Application and System Modeling, IEEE, V2-485 - V2-489.
[18] Dan Ionescu, Gesture Control and the New and Intel ligent ManMachine Interface, 6th IEEE International Symposiu m on Applied
Computational Intelligence and Informatics May 19 21, 2011, IEEE.

341
IJRITCC | February 2015, Available @ http://www.ijritcc.org

_______________________________________________________________________________________