Scribd Logo
Upload

Welcome to Scribd!

  • 14 views

    Ssss

    Uploaded by

    cskdingonsi
    SixthSense is a wearable device developed by Pranav Mistry that allows users to interact with digital information using natural hand gestures. It consists of a pocket projector, mirror, and camera connected to a mobile device that projects interfaces onto surfaces and recognizes hand gestures through computer vision. The SixthSense prototype can be used to navigate maps, draw on surfaces, take photos with gesture controls, recognize symbols as commands, and augment physical objects with additional projected information through interactions. It demonstrates the potential of a gestural interface system that can integrate digital and physical worlds.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as DOCX, PDF, TXT or read online from Scribd

    Ssss

    Uploaded by

    cskdingonsi
    14 views1 page
    SixthSense is a wearable device developed by Pranav Mistry that allows users to interact with digital information using natural hand gestures. It consists of a pocket projector, mirror, and camera connected to a mobile device that projects interfaces onto surfaces and recognizes hand gestures through computer vision. The SixthSense prototype can be used to navigate maps, draw on surfaces, take photos with gesture controls, recognize symbols as commands, and augment physical objects with additional projected information through interactions. It demonstrates the potential of a gestural interface system that can integrate digital and physical worlds.

    Original Title

    ssss

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    DOCX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    SixthSense is a wearable device developed by Pranav Mistry that allows users to interact with digital information using natural hand gestures. It consists of a pocket projector, mirror, and camera connected to a mobile device that projects interfaces onto surfaces and recognizes hand gestures through computer vision. The SixthSense prototype can be used to navigate maps, draw on surfaces, take photos with gesture controls, recognize symbols as commands, and augment physical objects with additional projected information through interactions. It demonstrates the potential of a gestural interface system that can integrate digital and physical worlds.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as DOCX, PDF, TXT or read online from Scribd
    Download as docx, pdf, or txt
    14 views1 page

    Ssss

    Uploaded by

    cskdingonsi
    SixthSense is a wearable device developed by Pranav Mistry that allows users to interact with digital information using natural hand gestures. It consists of a pocket projector, mirror, and camera connected to a mobile device that projects interfaces onto surfaces and recognizes hand gestures through computer vision. The SixthSense prototype can be used to navigate maps, draw on surfaces, take photos with gesture controls, recognize symbols as commands, and augment physical objects with additional projected information through interactions. It demonstrates the potential of a gestural interface system that can integrate digital and physical worlds.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as DOCX, PDF, TXT or read online from Scribd
    Download as docx, pdf, or txt
    of 1

    SixthSense

    From Wikipedia, the free encyclopedia

    Jump to: navigation, search

    SixthSense is a wearable gestural interface device that augments the physical world with digital
    information and lets people use natural hand gestures to interact with that information. It was
    developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT Media Lab.

    The SixthSense prototype is composed of a pocket projector, a mirror and a camera. The
    hardware components are coupled in a pendant-like mobile wearable device. Both the projector
    and the camera are connected to the mobile computing device in the user’s pocket. The device
    projects visual information, enabling surfaces, walls and physical objects around the wearer to be
    used as interfaces; while the camera recognizes and tracks the user's hand gestures and physical
    objects using computer-vision based techniques. The software program processes the video
    stream data captured by the camera and tracks the locations of the colored markers (visual
    tracking fiducials) at the tip of the user’s fingers using simple computer-vision techniques. The
    movements and arrangements of these fiducials are interpreted into gestures that act as
    interaction instructions for the projected application interfaces. The maximum number of tracked
    fingers is only constrained by the number of unique fiducials, thus SixthSense also supports
    multi-touch and multi-user interaction.

    The SixthSense prototype implements several applications that demonstrate the usefulness,
    viability and flexibility of the system. The map application lets the user navigate a map displayed
    on a nearby surface using hand gestures, similar to gestures supported by multi-touch based
    systems, letting the user zoom in, zoom out or pan using intuitive hand movements. The drawing
    application lets the user draw on any surface by tracking the fingertip movements of the user’s
    index finger. SixthSense also recognizes user’s freehand gestures (postures). For example, it
    implements a gestural camera that takes photos of the scene the user is looking at by detecting
    the ‘framing’ gesture. The user can stop by any surface or wall and flick through the photos
    he/she has taken. SixthSense also lets the user draw icons or symbols in the air using the
    movement of the index finger and recognizes those symbols as interaction instructions. For
    example, drawing a magnifying glass symbol takes the user to the map application or drawing an
    ‘@’ symbol lets the user check his mail. The SixthSense system also augments physical objects
    the user is interacting with by projecting more information about these objects projected on
    them. For example, a newspaper can show live video news or dynamic information can be
    provided on a regular piece of paper. The gesture of drawing a circle on the user’s wrist projects
    an analog watch.The current prototype system costs approximately $350 to build.[

    You might also like