e-ISSN: 2582-5208

International Research Journal of Modernization in Engineering Technology and Science

( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:04/Issue:11/November-2022 Impact Factor- 6.752 www.irjmets.com

TOUCHLESS TOUCHSCREEN TECHNOLOGY USING GBUI

Khushi Mahajan*1, Shailesh Bendale*2
*1Student, Department Of Computer Engineering, NBN Sinhgad School Of Engineering
Pune Maharashtra India.
*2Professor And Head Of Department Computer Engineering, NBN Sinhgad School Of Engineering
Pune Maharashtra India.
DOI : https://www.doi.org/10.56726/IRJMETS31654
ABSTRACT
The initial source of the outbreak was touch screens. Gone are the days of fiddling with touch screens and
scratching them up. Touchscreen displays are commonplace all over the world. Frequent touching of a
touchscreen display with a pointing device such as a finger, or if there is any scratch caused by major problems,
can result in gradual de-sensitization of the touchscreen to input and, eventually, touchscreen malfunction. A
simple user interface for Touchless control of electrically operated equipment is being developed to avoid this.
Elliptic Labs' cutting-edge technology allows you to control your devices such as computers, MP3 players, and
mobile phones without touching them. Touchless control of electrically operated equipment via a simple user
interface. The touchscreen display gives the user more flexibility, but after a few years, the touchscreen display
becomes less sensitive, resulting in touch failure on the touchscreen display. Even when we use a screen
protector, there are still dirty marks on the display. To avoid this problem, a simple user interface for touchless
control of electrically operated equipment is being developed.
Keywords: Touch Screen Display, Less Sensitive, Failure Of Touch, And Touchless Control.
I. INTRODUCTION
Touchless touch screen technology employs finger motions without the use of a screen. It simply uses a hand
wave in one direction or a flick of the hand in one area. If the touchscreen display is cracked, we cannot operate
the device by simply touching the display. The goal of this touch-free technology is to make life easier and more
convenient. This system requires a sensor, but it is neither hand mounted nor visible on the screen. The sensor
can be placed on the table or near the screen. The hardware setup is so small that it can fit into a device like a
mobile phone or laptop screen. It can determine the position of an object from 5 different angles. Touchless
control of electrically operated equipment is accomplished through the use of a simple user interface. Unlike
other systems, sensor or sensor selection is determined by the distance of hand or finger motions, such as a
hand wave in one direction, a flick of the hand in one area, holding the hand in one area, or pointing with one
finger. The device detects hand motions and movements using optical pattern recognition and a solid-state
optical matrix sensor with a lens. The sensor in the matrix is then linked to a digital image processor, and the
results are output as signals to control fixtures. The demand for and adoption of standard touchscreens for
portable and useful electronics are being fueled by the popularity of smartphones, tablets, and many different
sorts of information appliances. Touchscreens are used in heavy industries, the medical field, automated teller
machines (ATMs), and kiosks like museum displays or room automation where keyboard and mouse
technologies do not allow a user to interact with the display's content in a way that is sufficiently intuitive,
quick, or accurate.
II. METHODOLOGY
WHAT IS A TOUCH SCREEN?
An essential source of input or output, the touch screen is typically overlaid over an electronic visual display. By
touching the screen, a user can control the information processing or provide input via single- or multi-touch
gestures.
Instead of employing a middle device, it enables the user to engage directly with what is displayed.
How Touch Screens Work?
Different devices are now easier to operate thanks to touch screens.

www.irjmets.com @International Research Journal of Modernization in Engineering, Technology and Science

[1647]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:04/Issue:11/November-2022 Impact Factor- 6.752 www.irjmets.com
All it takes is a quick tap or swipe to complete the necessary action.
Touchscreens with resistance
The resistive touch screen technology is one of the most fundamental systems in ATMs. Two electrically
conducting layers—one resistive and the other conductive—make up this structure. Spacers keep these two
layers apart until you touch them, separating them. The final component of the system is a scratch-resistant top.
At all times, an electrical current flow through the two layers.
The electrical current is altered where the two layers of the screen come into contact when you touch it. The
software calculates the change in the electrical field and its coordinates, then performs the function pertinent to
that location. Despite being robust and consistent, this system can only support one touch at a time. High-end
devices almost certainly have capacitive touch screens because of this.
Screens with capacitive touch
A layer that holds electric charge made of materials like copper or indium tin oxide is utilized in capacitive
systems. The configuration is completed with sensors in the corners and protective housing.
On every corner of the touch screen, a very little amount of voltage is applied.
So how does it function? A capacitor can be created by the human body.
It can conduct electricity, therefore. Therefore, some of the charges are transmitted to the user when the user
touches the screen with his or her finger. Every corner of the screen detects this. The electric current value at
each corner will change depending on the touch point. This relative difference enables the programmer to
pinpoint the precise location of the touch and do additional tasks pertaining to that location.
Displays with infrared touch
It is the less popular and accurate one. On the opposing sides of the screen, LEDs and Light-detecting photocells
are positioned. Infrared light from the LEDs is projected in front of the screen, resembling an invisible spider's
web. A user can stop two or more beams by touching the screen at a certain location. This makes it easier for
the controller to identify the precise spot where the touch occurred, and the related action is taken. Since the
beam is broken, infrared screens can be used with a finger, a stylus, or even while wearing gloves.
But because gloves don't transmit electricity, using a capacitive touch screen while wearing them will be
ineffective. The majority of eBook readers that utilize infrared touch screens are Sony and Amazon Kindle
models.
Surface Acoustic Wave (SAW) Touch Screen
Fingers are detected by surface acoustic waves utilizing sound rather than light.
Its surface reflects ultrasonic noises that are too high-pitched for humans to hear back and forth.
The user stops the sound beam when they contact the screen, and the position of the touch is then determined.
III. MODELING AND ANALYSIS
Wave Flow
Without ever placing your fingertips on the screen, the system can detect movements in three dimensions.
Sensors are positioned everywhere around the screen; motion is sensed and translated into onscreen
movements by interacting in the line of sight of these sensors. The system uses a solid-state optical matrix
sensor with a lens to detect hand gestures and is based on optical pattern recognition.
This sensor is then coupled with a digital image processor, which analyses the motion patterns and sends the
findings as signals to operate lights or any other electrically programmable device. Three infrared lasers are
used to scan a surface. It can determine an object's location up to five feet away.

www.irjmets.com @International Research Journal of Modernization in Engineering, Technology and Science

[1648]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:04/Issue:11/November-2022 Impact Factor- 6.752 www.irjmets.com

Figure 1: Wave Flow of Touchless Touch Screen

Gesture Based Graphical User Interface (GBUI)
Hand motions are converted into computer commands using a Leap motion controller. Initial studies were
performed to determine how the controller operated and to comprehend fundamental interaction. The
controller is used to test whether sign language can be recognized. The fingerspelling alphabet was chosen
because of the relatively straightforward nature of individual signs and the wide variety of motions that make
up the alphabet.

Figure 2: GBUI Symbols

These tests are intended to assess the controller's capacity and precision in identifying hand movements.

Figure 3: 3D Navigation of Hand Movements in Touchless Screen

www.irjmets.com @International Research Journal of Modernization in Engineering, Technology and Science
[1649]
 e-ISSN: 2582-5208
International Research Journal of Modernization in Engineering Technology and Science
( Peer-Reviewed, Open Access, Fully Refereed International Journal )
Volume:04/Issue:11/November-2022 Impact Factor- 6.752 www.irjmets.com
IV. RESULTS AND DISCUSSION
The development of touchless technology is ongoing. With several Future Aspects, our bodies could become
input devices in a few years. The Touchless touchscreen user interface works well with laptops, desktops,
webcams, and mobile devices. In a few years, it's possible that our bodies may be converted into input devices
like a virtual keyboard, mouse, or both. Although the gadget appears to have potential, the associated API is not
yet ready to translate all sign languages. The controller can currently be used to a large extent for basic sign
identification; nevertheless, it is inappropriate for complex signs, especially those that necessitate prolonged
face or body contact. The large rotation of the digits during discussion and the line-of-sight obstruction causes
indicators to become erroneous and indistinguishable, rendering the controller (at present) useless for
communication. However, if signs are treated as separate things, there is a chance that they may be
programmed into artificial neural networks.
Usually placed on top of a computer visual display, a touch screen is a crucial source of input or output.
Through single or multiple touchscreen movements, a user enters data or manages the processing of that data.
Instead of utilizing an intermediary device, it enables the user to interact directly with what is displayed.
Numerous products are now much simpler to use thanks to touch screens. It often serves as the resistive
touchscreen device in ATMs. Two electrically conducting layers are present, one of which is resistant and the
other is fresh. Spacers, which split these two layers, keep them apart until they may touch.
The two layers are constantly broken through by an automatic current. The two layers are snapped together
when it can touch the screen and the automated current changes just before contact. The software calculates
the change in the computer area and its coordinates before performing a function similar to that location.
Touchless technology is a subset of gesture control technology that aims to establish control between humans
and computers without the need for multiple points of physical contact or input. It is dependent on the analysis
of human evolutions, gestures, and behaviors using algorithms, just as all other structures of gesture control
technology.
V. CONCLUSION
This paper gives an overview of touch-free screen technology. The use of this technology provides the user with
the flexibility to use the system appropriately. The proposed touchless touchscreen technology is appropriate
for Android mobile phones, laptops, ATM machines, and other applications. The maintenance work of a
touchscreen display can be reduced by using this technology. Touchless touching Technology is constantly
evolving. Today's thoughts revolve once more around the user interface. Day in and day out, efforts are made to
improve technology. The touchless touchscreen user interface works well on computers, cell phones, webcams,
and laptops. Perhaps in a few years, our bodies will be transformed into virtual mice, virtual keyboards, and so
on.
VI. REFERENCES
[1] A.K. Jain, A. Ross, K. Nandakumar, Introduction to Biometrics, Springer, 2011.
[2] K. O'Hara et al., "Touchless interaction in surgery", Communications of the ACM, vol. 57, no. 1, pp. 70-
77, 2014.
[3] J. Wachs, H. Stern, Y. Edan, M. Gillam, C. Feied, M. Smith, J. Handler, "Real-Time Hand Gesture Interface
for Browsing Medical Images".
[4] P. Peltonen, E. Kurvinen, A. Salovaara, G. Jacucci, T. Ilmonen, J. Evans, A.Oulasvirta, P. Saarikko, "It's
mine don't touch!: interactions at a large multi-touch display in a city centre", CHI '08: Proceeding of
the twenty-sixth annual SIGCHI conference on Human factors in computing systems, ACM, pp. 1285-
1294, 2008.

www.irjmets.com @International Research Journal of Modernization in Engineering, Technology and Science

[1650]