Scribd Logo
Upload

Welcome to Scribd!

  • 138 views

    Pranav Mistry

    Uploaded by

    Gaurav Monga
    Pranav Mistry is an inventor and PhD candidate at MIT who created SixthSense, a wearable technology that allows users to interact with digital information overlaid on the physical world using hand gestures. SixthSense projects information onto surfaces using a camera and projector worn around the neck and tracks hand movements to control the interface without touching a screen. Some key applications include using gestures to interact with maps, draw on surfaces, take photos, and access information about physical objects.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as DOCX, PDF, TXT or read online from Scribd

    Pranav Mistry

    Uploaded by

    Gaurav Monga
    138 views2 pages
    Pranav Mistry is an inventor and PhD candidate at MIT who created SixthSense, a wearable technology that allows users to interact with digital information overlaid on the physical world using hand gestures. SixthSense projects information onto surfaces using a camera and projector worn around the neck and tracks hand movements to control the interface without touching a screen. Some key applications include using gestures to interact with maps, draw on surfaces, take photos, and access information about physical objects.

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    DOCX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Pranav Mistry is an inventor and PhD candidate at MIT who created SixthSense, a wearable technology that allows users to interact with digital information overlaid on the physical world using hand gestures. SixthSense projects information onto surfaces using a camera and projector worn around the neck and tracks hand movements to control the interface without touching a screen. Some key applications include using gestures to interact with maps, draw on surfaces, take photos, and access information about physical objects.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as DOCX, PDF, TXT or read online from Scribd
    Download as docx, pdf, or txt
    138 views2 pages

    Pranav Mistry

    Uploaded by

    Gaurav Monga
    Pranav Mistry is an inventor and PhD candidate at MIT who created SixthSense, a wearable technology that allows users to interact with digital information overlaid on the physical world using hand gestures. SixthSense projects information onto surfaces using a camera and projector worn around the neck and tracks hand movements to control the interface without touching a screen. Some key applications include using gestures to interact with maps, draw on surfaces, take photos, and access information about physical objects.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as DOCX, PDF, TXT or read online from Scribd
    Download as docx, pdf, or txt
    of 2

    Pranav Mistry 

    (b. 1981 in Palanpur, India) is one of the inventors of SixthSense[1]. He is a research assistant and a PhD


    candidate at MIT Media Lab. SixthSense has recently attracted global attention[2][3]. Among some of his previous work,
    Pranav has invented Mouseless - an invisible computer mouse; intelligent sticky notes that can be searched, located and can
    send reminders and messages; a pen that can draw in 3D; and a public map that can act as Google of physical world.
    Pranav holds a Master in Media Arts and Sciences from MIT and Master of Design from Industrial Design Center, IIT
    Bombaybesides his Bachelor degree in Computer Engineering from Nirma Institute Of Technology, Ahmedabad. Pranav’s
    research interests include Ubiquitous computing, Gestural and Tangible Interaction, AI, Augmented reality, Machine
    vision, Collective intelligence and Robotics.

    Sixth Sense has been awarded 2009 Invention Award by Popular Science[4]. Pranav also won Young Innovator Award TR35
    by Technology Review[5]. In 2010, he was named to Creativity Magazine's Creativity 50.[6] Mistry has been called "one of the
    two or three, best inventors in the world right now"[7] byChris Anderson.

    'SixthSense' is a wearable gestural interface that augments the physical world around us
    with digital information and lets us use natural hand gestures to interact with that
    information. By using a camera and a tiny projector mounted in a pendant like wearable
    device, 'SixthSense' sees what you see and visually augments any surfaces or objects we
    are interacting with. It projects information onto surfaces, walls, and physical objects
    around us, and lets us interact with the projected information through natural hand
    gestures, arm movements, or our interaction with the object itself. 'SixthSense' attempts
    to free information from its confines by seamlessly integrating it with reality, and thus
    making the entire world your computer.

    'SixthSense' is a wearable gestural interface that augments the physical world around us with digital
    information and lets us use natural hand gestures to interact with that information.

    We've evolved over millions of years to sense the world around us. When we encounter something, someone or
    some place, we use our five natural senses to perceive information about it; that information helps us make
    decisions and chose the right actions to take. But arguably the most useful information that can help us make the
    right decision is not naturally perceivable with our five senses, namely the data, information and knowledge that
    mankind has accumulated about everything and which is increasingly all available online. Although the
    miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually
    connected to the digital world, there is no link between our digital devices and our interactions with the physical
    world. Information is confined traditionally on paper or digitally on a screen. SixthSense bridges this gap, bringing
    intangible, digital information out into the tangible world, and allowing us to interact with this information via
    natural hand gestures. ‘SixthSense’ frees information from its confines by seamlessly integrating it with
    reality, and thus making the entire world your computer. 

    The SixthSense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components
    are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the
    mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls
    and physical objects around us to be used as interfaces; while the camera recognizes and tracks user's hand
    gestures and physical objects using computer-vision based techniques. The software program processes the
    video stream data captured by the camera and tracks the locations of the colored markers (visual tracking
    fiducials) at the tip of the user’s fingers using simple computer-vision techniques. The movements and
    arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected
    application interfaces. The maximum number of tracked fingers is only constrained by the number of
    unique fiducials, thus SixthSense also supports multi-touch and multi-user interaction.  

    The SixthSense prototype implements several applications that demonstrate the usefulness, viability and flexibility
    of the system. The map application lets the user navigate a map displayed on a nearby surface using hand
    gestures, similar to gestures supported by Multi-Touch based systems, letting the user zoom in, zoom out or pan
    using intuitive hand movements. The drawing application lets the user draw on any surface by tracking the
    fingertip movements of the user’s index finger. SixthSense also recognizes user’s freehand gestures (postures).
    For example, the SixthSense system implements a gestural camera that takes photos of the scene the user is
    looking at by detecting the ‘framing’ gesture. The user can stop by any surface or wall and flick through the
    photos he/she has taken. SixthSense also lets the user draw icons or symbols in the air using the movement of
    the index finger and recognizes those symbols as interaction instructions. For example, drawing a magnifying
    glass symbol takes the user to the map application or drawing an ‘@’ symbol lets the user check his mail. The
    SixthSense system also augments physical objects the user is interacting with by projecting more information
    about these objects projected on them. For example, a newspaper can show live video news or dynamic
    information can be provided on a regular piece of paper. The gesture of drawing a circle on the user’s wrist
    projects an analog watch. 

    The current prototype system costs approximate $350 to build. Instructions on how to make your own prototype
    device can be found here (coming soon).

    Senses are the physiological capacities within organisms that provide inputs for perception. The senses and their operation,
    classification, and theory are overlapping topics studied by a variety of fields, most notably neuroscience, cognitive
    psychology (or cognitive science), and philosophy of perception. The nervous system has a specific sensory system or
    organ, dedicated to each sense.

    You might also like