Google Translate Blog: Google Goggles

Google Translate Blog

The official source for news on Google's translation technologies

Translate the real world with Google Goggles

Monday, May 10, 2010

(This was posted on the Google Mobile Blog on 5/6/2010)Google Gogglesmonoglots

Point your phone at a word or phrase. Use the region of interest button to draw a box around specific words

Press the shutter button

If Goggles recognizes the text, it will give you the option to translate

Press the translate button to select the source and destination languages

Google Goggles in action (click images to see large version)

The first Goggles translation prototype was unveiled earlier this year at the Mobile World Congress in Barcelona and could only recognize German text. Today Goggles can read English, French, Italian, German and Spanish and can translate to many more languages. We are hard at work extending our recognition capabilities to other Latin-based languages. Our goal is to eventually read non-Latin languages (such as Chinese, Hindi and Arabic) as well.

Every new release of Google Goggles contains at least one new feature and a large number of improvements to our existing functionality. In addition to translation, Goggles v1.1 features improved barcode recognition, a larger corpus of artwork, recognition of many more products and logos, an improved user interface, and the ability to initiate visual searches using images in your phone’s photo gallery.

Computer vision is a hard problem. While we are excited about Goggles v1.1, we know that there are many images that we cannot yet recognize. The Google Goggles team is working on solving the technical challenges required to make computers see. We hope you are as excited as we are about the possibilities of visual search.

Google Goggles v1.1 is available on devices running Android 1.6 and higher. To download, please scan the QR code below or go to the Android Market app on your phone and search for “Google Goggles”. See our help center for more information.

Posted by Alessandro Bissacco, Software Engineer

Google

Labels: Android , Google Goggles , Mobile , Translate Blog

Integrating translation into Google Goggles

Wednesday, February 17, 2010

Yesterday, at the Mobile World Congress in Barcelona, Eric Schmidt and I demonstrated a prototype version of Google Goggles that showcases the potential of integrating Google's machine translation and image recognition technologies. In the video below, you'll see how we use Goggles to take a picture of a German menu and instantly translate the text into English:

You may wonder what's happening in the background. On the simplest level, this prototype connects the phone's camera to an optical character recognition (OCR) engine, recognizes the image as text and then translates that text into English with Google Translate.
Right now this technology only works for German-to-English translations and it's not yet ready for prime time. However, it shows a lot of promise for what the future might hold. Soon your phone will be able to translate signs, posters and other foreign text instantly into your language. Eventually, we're hoping to build a version of Google Goggles that can translate between all of the 52 languages currently supported by Google Translate — bringing even more information to you on the go.Posted by Hartmut Neven, Scientist