Sixth Sense Technology as a Tool Integrates Digital With the Real World

Abstract

Sixth sense is the invention has given the Invention Award in the last year it seems to be the
Technology that will Change the World. The report will explain

Overview
The idea for the sixthsense project came to Mistry about six months ago. “It came as a crazy idea
of thinking of the term head mountain projector! He just started thinking of actually making real
head mountain projectors that would truly connect to people’s physical world!”

Mistry initially implemented his inspiration as a projector helmet where the camera tracked what
the wearer did with his or her hand. Further modifications resulted in a cap with a smaller
projector, and, finally, into a small device containing a projector and a camera.

Mistry initially called the device “WUW” as in “wear ur world.” But when it was introduced,
sixthsense was judged to be a better title.

Introduction:

Pranav has invented Mouseless - an invisible computer mouse; intelligent sticky notes that can
be searched, located and can send reminders and messages; a pen that can draw in 3D; and a
public map that can act as Google of physical world.

It is called sixth sense which gives you the ability to receive information about anything and
anyone you encounter, anywhere, and at all times The system is constantly trying to figure out
what's around you, and what you're trying to do. It has to recognize the images you see, track
your gestures, and then relate it all to relevant information at the same time."

It consists of a small camera and projector combination (about the size of a cigarette pack) worn
around the neck of the user. An accompanying smartphone runs the SixthSense software, and
handles the connection to the internet.

Sixth Sense was awarded the 2009 Invention Award by Popular Science
Inventor
Pranav Mistry (b. 1981 in Palanpur, India) is one of the inventors of SixthSense[1]. He is a
research assistant and a PhD candidate at MIT Media Lab.
Pranav won Young Innovator Award TR35 by Technology Review.
In 2010, he was named to Creativity Magazine's Creativity 50

What does it do

which is a wearable gestural , user friendly interface which links the physical world around us
with digital information and uses hand gestures to interact with them. The device sees what we
see but it lets out information that we want to know while viewing the object. It can project
information on any surface, be it a wall, table or any other object and uses hand / arm movements
to help us interact with the projected information. The device brings us closer to reality and
assists us in making right decisions by providing the relevant information, thereby, making the
entire world a computer

Consist of

The Sixth Sense prototype consists of a pocket projector, mirror and a camera. The device is
pendant shaped like mobile wearing devices. Both the projector and the camera are connected to
the mobile computing device in the user’s pocket. The projector projects visual information
enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera
recognizes and tracks user’s hand gestures and physical objects using computer-vision based
techniques. The software program processes the video stream data captured by the camera and
tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user’s
fingers using simple computer-vision techniques. It also supports multi touch and multi user
interaction.

applications

The device has a huge number of applications. Some of the more practical uses are:

reading a newspaper. Imagine reading a newspaper and viewing videos instead of the photos in
the paper. Or live sports updates while reading the newspaper.

The device can also tell you arrival, departure or delay time of your air plane on your tickets.
For book lovers it is nothing less than a blessing. Open any book and you will find the Amazon
ratings of the book. To add to it, pick any page and the device gives additional information on
the text, comments and lot more add on features.

To know the time, all one has to do is to just gesture drawing circle on the wrist and there
appears a wrist watch.

.Imagine being able to check your email on any blank wall, The projector can even project a
keyboard for you to type your emails on, simply by drawing an @ sign in the air with your finger

You want to take a digital photograph? Just put your thumbs and forefingers together to make a
picture frame

You can compare prices between goods in the supermarket” and check which ones are green
products

He also says that brick and mortar bookstores might decide to provide their own information to
the device, which would mean that a customer would not have to necessarily go online to find
more information

Advanteges
Sixth sense device is portable and easily to carry as you can wear it in your neck
The drawing application lets user draw on any surface by observing the movement of index
finger. Mapping can also be done anywhere with the features of zooming in or zooming out.

The camera also helps user to take pictures of the scene he is viewing and later he can arrange
them on any surface

The unique thing about this technological invention is that rather than just moving forward in the
digital world, he has tried to bridge the gap between the technical world and the world that has
existed for several centuries already- the physical world.

future

Pranav Mistry sees some commercial applications for the system in the near future. For
example, he wants to develop a sign language application that would "speak out" a translation
while someone was signing.
He also sees potential for SixthSense in the field of gaming. Unlike the Nintendo Wii, which
keeps you in front of the television, the SixthSense system might "allow a kid to go outside, and
be able to get a real tennis lesson on a real tennis court."

At this year's Computer-Human Interaction (CHI) conference in Boston, the Fluid Interfaces
Group at MIT's Media Lab unveiled the latest prototype of SixthSense, a wearable, gesture-
driven computing platform that can continually augment the physical world with digital
information.

“sixth sense” consists of a camera (it captures the movement of hands), the projector (it produces
the image on any surface), the mobile phone (it is in your pocket and need only to communicate
with the abstract database server) and four fingers on which to detect movements, wearing
colorful caps, perceived by the camera.

Currently the prototype of the device costs around $350 to build. Still more work is being done
on the device and when fully developed, it will definitely revolutionize the world

The camera, in a sense, acts as a digital eye, seeing what the user sees. It also tracks the
movements of the thumbs and index fingers of both of the user's hands.
You can turn any surface around you into an interactive surface

No one involved in the SixthSense project feels that their platform will replace laptops and
smartphones.
"If I'm doing something like CAD, I'm not going to choose the SixthSense interface," says Liyan
Chang, an MIT undergraduate working on the project.
"But in certain instances, it can do something that a desktop or laptop can't do, which is quickly
put information right where I want it to be, right on a wall or a newspaper in front of me."
The sixth sense: Technology May Change the World

Sixth Sense Technology will Revolutionize the World

SixthSense blurs digital and the real

INVENTION AWARDS: THE WORLD AS A WEB INTERFACE

integrating information with the real world