LEAP MOTION TECHNOLOGY

Presented By
Ningamma.B.Kenchannavar
2MM15EC028

under the guidance

Prof. Sagarkumar. V. Budihal
CONTENTS:
 Introduction
 History of leap motion
 What is Leap Motion technology?
 Literature survey
 How does it work
 Applications
 Advantages Leap Motion
 Disadvantages
 How Leap will change the world
 Conclusion
 References
INTRODUCTION
 Leap is a breakthrough in computer interaction, using a patented
mathematical approach to 3D, touch free motion sensing and motion
control software.
 It was invented By Michael Buchwald and DavidHolz.
 Through this new technology we can say good bye to Mouse & Keyboard.
 Leap Motion is a start-up developing advanced motion sensing technology
for HCI
 Motion detection is a process of detecting changes in position of an object
relative to surrounding
 Leap Motion is computer hardware sensor device that supports hand and
finger motions as input, analogous to a Mouse, but requiring no hand
contact or touching.
 The device can track movements as small as 0.01 millimetres, this uses
intuitive gestures. it distinguishes individual fingers &objects, it is
affordable and more accurate than mouse and keyboards.
History of Leap Motion
 Leap Motion was founded by Michael Buckwald & David Holz in
2010 at san Francisco.
 The device started full scale shipping in July 2013. Leap Motion
publicly announced its first product, originally called the Leap.
 David Holz began development on the Leap Motion controller in
2008, and spent nearly five years developing the software and
cameras.
 He knew that technology had been helping him do things he
normally could not so he realized that the complexities of the
common computer controls such as mice and keyboards complicate
the process of creation when it should be as easy as using your
hands.
Leap Motion Technology
 The Leap Motion controller is a small USB peripheral device which
is designed to be placed on physical desktop, facing upward.
 Uses an array of infrared sensors.
 Using two monochromatic cameras and three infrared LEDs, the
device observe a roughly hemispherical area, to distance of about
1meter.
 The smaller observation area and higher resolution of the device
differentiates the product from the kinect.
 Leap Motion initially distrubuted thousands of units to developers
who are interested in creating applications for the device.
 The Leap is designed to sit right in front of your monitor or laptop
and sense movements with starting accuracy. 
Literature survey
1. Leap Motion Technology In Learning:In this paper author presents the Leap Motion
Technology is the dedicated software development environments, as well as some results in
using it for learning and training. The device is a great tool for experimentation and learning,
allowing the students to have natural 3D interactions in domains like sculpture, painting,
design, music, medicine, natural sciences, engineering[1].
2. Hand movement and gesture recognition using Leap Motion Controller:In this paper
author explain how the novel device Leap Motion Controller provides an informative
representation of hands. In this paper author utilize tracking data through the API of Leap
Motion Controller to recognize hand movement and gestures interaction between objects
require at least one object is set to be rigid body[2].
3. Implementations of the Leap Motion in sound synthesis, effects modulation and
assistive performance tools: In this paper the author proposes the use of motion has gained
increasing popularity in the audio industry, An extension of the Leap Motion is usage in
a project the author is developing called Instruments Sans Frontier’s(ISF). This paper has
demonstrated implementations that take advantage of the device’s non-invasive nature and its
many degrees of freedom[3].
4. System for touchless interaction with medical images in surgery using Leap Motion:In
this paper the author is explain During recent years, doctors and particularly surgeons have
become increasingly reliant on a range of digital imaging systems for navigation, reference,
diagnosis and documentation[4].
5. A Preliminary Evaluation of the Leap Motion Sensor as Controller of New Digital
Musical Instruments:With this paper the analysis of the device shows that it is a powerful
tool for recognizing hand gestures with great precision, In this paper, we perform a
preliminary study and evaluation of the Leap Motion sensor as a tool for building DMI
evaluation of the Leap Motion sensor as a tool for building DMIs[5].
Working and Design methodology

Fig: Leap Motion Controller

 Leap Motion Controller
• The Leap Motion Controller is a natural user interface for digital devices that
allows touch free control, using hands gestures as input. It is a small and simple
device, dedicated to hands and fingers tracking. It has three infrared LEDs which
emit light with wavelength of 850 nanometers (outside the visible spectrum) and
two cameras that capture the reflected light in this spectrum. The device is
compact, small (a few centimetres) and light (32 grams), making it easy to be used
and transported everywhere. Because of its simplicity, it is affordable, with the
price of 56 USD as we write. The distance monitored by the LMC starts from a few
centimetres up to almost one meter.
• The LMC uses a USB 2.0 connection to transfer data to the computer. The device
has a sensing space of near a quarter of a cubic meter with the form of an inverted
pyramid with the maximum working distance of 80 cm. The data takes the form of
a sequence of pairs of greyscale stereo images in the near infrared light spectrum
representing mainly the objects illuminated by the LMC IR LEDs, but also ghosts
produced by other sources of light in that spectrum.
 The captured data is processed by proprietary drivers supplied by vendor and
accessible through a dedicated API, making it just a HCI interface, not a global 3D
scanner. The LMC data is presented as a series of snapshots called frames. One
frame consists of objects like Hands, Fingers, Pintables (objects longer and thinner
than fingers) and additional information, like frame timestamp, rotation,
translation, scaling and other data.
Design methodology

Fig: gesture representing

Input gesture is acquired using a Leap Motion sensor. It tracks hands and fingers
movements in 3-D digital format. It gives a mapping of the gesture in terms of feature
points. The extracted fingertip positions of each gesture are stored in the database.
The distance between them is used as feature vector. While testing, again gestures are
captured and the positions of the finger points are extracted
Data Acquisition
The Leap Motion yields a series of frame by tracking motion of hands and fingers
within its view field. The frame data represents a set of tracking data for hands and
fingers detected in a single frame. The acquired data through the Leap sensor consists
of array of objects to store the physical characteristics of a detected finger such as
fingertips. The gestures captured by the Leap controller yields a few key points
corresponding to each hand gesture.
. Feature Extraction
Leap Motion returns a set of relevant hand points and some hand pose features.
Above Figure highlights the features extracted for recognition. The extracted key
points are coordinates of finger positions from the input gesture.
. Gesture Classification
Feature points corresponding to each gesture are stored in the database file. During
testing, a current gesture is captured and key points are extracted from that gesture. At
the run time, distances are calculated from the extracted feature points
 
Applications
 GAMING
o More intuitive compared to mouse or even touch screen.
o Great accuracy and responsiveness
 ROBOTICS
o Self Navigate
o Mimic human movement
 MUSIC AND VIDEO
o Electronic Music
o Playing and learning instruments
o Organic Feel
o Efficient
o Flexible to Create and Edit videos
 Health Care
o For Surgeons to contactless visualization,
o Manipulating screens
o Viewing reports
o To remotely monitor patients as they undergo rehab
 ART AND DESIGN
Offers better ergonomics compared to mouse, More intuitive 3D
interface, Greater accuracy and responsiveness, Easy to use with
simple form Relatively cheaper than competitors. the Leap Motion
Controller can bring a little magic to interactive exhibits.

 
Advantages
 Leap is more accurate, cheaper and high resolution. The tiny oblong
device may look like any old USB stick but in actual fact it contains
the power to change how we interact with computers for ever.
 Most easiest method in computer interaction. The leap motion offers
a lot of potential to many professions particularly the creative kind.
 It is portable so we can use it any situation with 3D interaction.
 Plug and play via USB, The device is tiny device so we can carry and
connect through USB, Leap device is used in gaming we can plug it
anywhere and play the games uninterruptedly
 Low CPU usage and low power consumption, we can interact
directly with digital content on Windows PCs using your bare hands
Disadvantages
 Specific h/w and special programs required to obtain and process the
data
 The real life performance may not translate on to the computer model
as expected
 Accurately tracking of even the most basic of signs is difficult as this
requires inferring the position of fingers that have an indirect or
obscured line of sight for the Leap Motion controller.
 Limited no of apps available in airspace.
How Leap will change the world
 The Leap technology is already changing the landscape of how we
use our computers, but it has the potential for so much more due to
its development around human-computer interaction. With its
detection of movement around the computer, users may experience a
feeling of being in an artificially intelligent environment.
 The reactions to hand movements are so precise, it provides the user
with the feeling of actually being able to reach into the screen. The
device also gives users the power to interact with virtual reality (VR)
hardware such as the Oculus Rift - a VR headset for 3-D gaming.
You can mount the Leap device directly onto the front of the headset
and interact with the objects you see in the virtual reality
environment in front of you
 As the device develops further, it has the potential to add remote
capabilities in various fields such as Healthcare and Engineering. For
example, remote surgery and tele-robotics are possible with a more
mature version of this device. The Leap Motion Controller has
opened the door to a much more robust ‘virtual’ world at the control
of your fingertips, and it’s just getting started!
Conclusion
The device is a great tool for experimentation and learning, allowing
the students to have natural 3D interactions in domains like sculpture,
painting, design, music, medicine, natural sciences, engineering, etc
The leap motion controller can be integrated with kinect camera to
achieve recognition of all body gestures for different sign language.
Leap motion is packed with an extreme amount of power. The sensors
located within the sensor are incredibly fast and accurate, allowing the
user to navigate his or her own computer with as much freedom as he
or she wants.
 
 
 
 
 
 References
1. Bujor Pavaloiu Polytechnic University of Bucharest “Leap Motion
Technology In Learning” Conference Paper · May 2017DOI:
10.15405/epsbs.2017.05.02.126
2. Gordon Wetzstein and Robert Konrad “Hand movement and gesture
recognition using Leap Motion Controller” Lin Shao_Stanford EE 267,
Virtual Reality,Course Report
3. Lamtharn Hantrakul, Konrad Kaczmarek Department of Music, Yale
University “Implementations of the Leap Motion in sound synthesis,
effects modulation and assistive performance tools” A. Georgaki and G.
Kouroupetroglou (Eds.), Proceedings ICMC|SMC|2014, 14-20 September
2014
4. Agata Manolova Radiocommunications and Videotechnologies
Department Faculty of Telecommunications, Technical University of Sofia
“ System for touchless interaction with medical images in surgery using
Leap Motion”
5. Eduardo S. Silva, Jader Anderson O. de Abreu, Janiel Henrique P. de
Almeida, Veronica Teichrieb1, Geber L. Ramalho1 “ A Preliminary
Evaluation of the Leap Motion Sensor as Controller of New Digital
Musical Instruments” Centro de Informática – Universidade Federal de
Pernambuco (UFPE) Caixa Postal 50.740-560- Recife – PE – Brasil
THANK YOU