Posted:


(Cross-posted on the Google Cloud Platform Blog)

We’ve had a great time giving you our predictions for the World Cup (check out our post before the quarter-finals and semi-finals). So far, we’ve gotten 13 of 14 games correct. But this isn't about us picking winners in World Cup soccer - it’s about what you can do with Google Cloud Platform. Now, we are open-sourcing our prediction model and packaging it up so you can do your own analysis and predictions.

We used Google Cloud Dataflow to ingest raw, touch-by-touch gameplay day from Opta for thousands of soccer matches. This data goes back to the 2006 World Cup, three years of English Barclays Premier League, two seasons of Spanish La Liga, and two seasons of U.S. MLS. We then polished the raw data into predictive statistics using Google BigQuery.

You can see BigQuery engineer Jordan Tigani (+JordanTigani) and developer advocate Felipe Hoffa (@felipehoffa) talk about how we did it in this video from Google I/O.

Our prediction for the final
It’s a narrow call, but Germany has the edge: our model gives them a 55% chance of defeating Argentina due to a number of factors. Thus far in the tournament, they’ve had better passing in the attacking half of their field, a higher number of shots (64 vs. 61) and a higher number of goals scored (17 vs. 8).

But, 55% is only a small edge. And, although we've been trumpeting our 13 of 14 record, picking winners isn't exactly the same as predicting outcomes. If you'd asked us which scenario was more likely, a 7 to 1 win for Germany against Brazil or a 0 to 1 defeat of Germany by Brazil, we wouldn't have gotten that one quite right.

(Oh, and we think Brazil has a tiny advantage in the third place game. They may have had a disappointing defeat on Tuesday, but the numbers still look good.)

But don’t take our word for it...
Now it’s your turn to take a stab at predicting. We have provided an IPython notebook that shows exactly how we built our model and used it to predict matches. We had to aggregate the data that we used, so you can't compute additional statistics from the raw data. However, for the real data geeks, you could try to see how well neural networks can predict the same data or try advanced techniques like principal components analysis. Alternatively, you can try adding your own features like player salaries or team travel distance. We've only scratched the surface, and there are lots of other approaches you can take.

You might also try simulating how the USA would have done if they had beat Belgium. Or how Germany in 2014 would fare against the unstoppable Spanish team of 2010. Or you could figure out whether the USA team is getting better by simulating the 2006 team against the 2010 and 2014 teams.

Here’s how you can do it
We’ve put everything on GitHub. You’ll find the IPython notebook containing all of the code (using pandas and statsmodels) to build the same machine learning models that we've used to predict the games so far. We've packaged it all up in a Docker container so that you can run your own Google Compute Engine instance to crunch the data. For the most up-to-date step-by-step instructions, check out the readme on GitHub.

Posted:


(Cross-posted on the Google Cloud Platform Blog)

Kubernetes is an open source manager for Docker containers, based on Google’s years of experience using containers at Internet scale. Today, Microsoft, RedHat, IBM, Docker, Mesospehere, CoreOS and SaltStack are joining the Kubernetes community and will actively contribute to the project. Each company brings unique strengths, and together we will ensure that Kubernetes is a strong and open container management framework for any application and in any environment - whether in a private, public or hybrid cloud.

Our shared goal is to allow a broad range of developers to take advantage of container technologies. Kubernetes was built from the ground up as a lean, extensible and portable framework for managing Docker workloads. It lets customers manage their applications the way that Google manages hyper-scale applications like Search and Gmail.

Containers offer tremendous advantages for developers. Predictable deployments and simple scalability are possible because Docker packages all of a workload’s dependencies with the application. This allows for ultimate portability; you can avoid vendor lock-in and run containers in the cloud of your choice. It is just as important that the management framework has the same properties of portability and scalability, and that is what the community will bring to Kubernetes.

We look forward to the contributions of the expanded Kubernetes community:

  • Microsoft is working to ensure that Kubernetes works great in Linux environments in Azure VMs. Scott Guthrie, Executive Vice President of the Cloud and Enterprise group at Microsoft told us, “Microsoft will help contribute code to Kubernetes to enable customers to easily manage containers that can run anywhere. This will make it easier to build multi-cloud solutions including targeting Microsoft Azure.”
  • Red Hat is working to bring Kubernetes to the open hybrid cloud. Paul Cormier, President, Products and Technologies at Red Hat, told us, “Red Hat has a rich history of contributing to and maturing innovative, open source projects. Through this collaboration with Google on Kubernetes, we are contributing to the evolution of cloud computing and helping deliver the promises that container technologies offer to the open hybrid cloud.”
  • IBM is contributing code to Kubernetes and the broader Docker ecosystem to ensure that containers are enterprise-grade, and is working with the community to create an open governance model around the project.
  • Docker is delivering the full container stack that Kubernetes schedules into, and is looking to move critical capabilities upstream and align the Kubernetes framework with Libswarm.
  • CoreOS is working to ensure that Kubernetes can work seamlessly with the suite of CoreOS technologies that support cloud-native application development on any cloud.
  • Mesosphere is actively integrating Kubernetes with Mesos, making the advanced scheduling and management capabilities available to Kubernetes customers.
  • SaltStack is working to make Kubernetes a portable container automation framework that is designed for the reality of the platform-agnostic, multi-cloud world.

You can view the source and documentation for Kubernetes on GitHub. We look forward to the contributions of these companies alongside the already vibrant open source community.

Posted:


Google I/O, our annual developer conference, kicked off this morning in San Francisco with more than 6,000 developers in person and millions more on the livestream. This year, 41 percent of live attendees represent companies that develop business-to-business (B2B) applications, which validates what we’ve known for a while: there’s great demand for better apps in the workplace. People want to work the way they live and use the apps and tools they love, whether they’re at home or in the office.

This drives so much of what we’re doing to bring the best of Google to our users at home to work. For those who missed it, earlier today Sundar Pichai, SVP of Android, Chrome & Apps and Urs Hölzle, SVP of Technical Infrastructure, announced and showed off a lineup of new products and features for Apps, Android, Chromebooks and Cloud Platform. Here are some of the highlights:

Introducing Google Drive for Work and updates to Google Docs
  • Already, 190 million people actively use Drive at home, school or work, while companies like Crate & Barrel, HP, Jaguar Land Rover, Seagate and Tory Burch and rely on it to work faster and to connect employees and customers. Now, we’re making Drive even better for business with Google Drive for Work — a new premium offering for businesses that includes unlimited storage, advanced audit reporting and new security controls for $10/user/month.
  • As of today, all files uploaded to Google Drive will be encrypted, not only from your device to Google and in transit between Google data centers, but also at rest on Google servers.
  • Quickoffice is now full integrated into Docs, Sheets and Slides, so you can open and edit those documents in Office Compatibility Mode directly on Android, your Chrome browser and coming soon to iOS. This means you can open, edit, save and send Microsoft Word, Excel® and PowerPoint® files from your favorite device. You no longer have to buy additional software — it just works.
Reimagining developer productivity and data analytics in the cloud with Google Cloud Platform
  • Google Cloud Dataflow, a managed service designed to help developers and companies process large datasets quickly and efficiently, was introduced today at Google I/O. Based on ten years of internal research and development, Cloud Dataflow is designed to let you focus on getting actionable insights from your data, while leaving the management, tuning, sweat and tears to Google.
  • To enhance application management and operations in production, we’re launching Google Cloud Monitoring, built on the technology of Stackdriver, a company that recently joined Google, and introducing new tracing and debugging tools to increase developer productivity.
  • We’re making it easier for mobile developers to build on our platform with a new version of Google Cloud Save and improved integrations in Android studio.
Today we also announced new features that are slated to launch in the next Android release — “L” — that are intended for enterprises. These features will make the transition for users from work to play more seamless, and provide IT administrators with more options to keep their employees' data secure and easy to access. Businesses will also be able buy apps in bulk on Google Play and make them available to employees — great for admins, great for developers. You can also read more about some of the updates coming to schools here.

Today has been exhilarating, but it’s still just the beginning. Google I/O continues through the end of tomorrow, so tune in at google.com/io for more news and check back here for more updates and news throughout the week.

Posted:


(Cross-posted on the Google Cloud Platform Blog)

Editor's note: Today's guest post is from Daniel Viveiros, Head of Technology at CI&T, a Google Cloud Platform Partner of the Year LATAM 2013. In this post, Daniel describes how CI&T in partnership with Coca-Cola built the ‘Happiness Flag’ for the Coca-Cola 2014 FIFA World Cup™ campaign in Brazil. To learn more about the Happiness flag visit this website.


As part of the ‘The World’s Cup’ campaign, Coca-Cola wanted to do something that would visually illustrate soccer’s global reach. Coca-Cola invited fans around the world to share their photos to create the Happiness Flag -- the world’s largest mosaic flag crafted from thousands of crowdsourced images submitted by people in more than 200 countries. The flag, 3,015 square meters in size, was unveiled during the opening ceremony of the 2014 FIFA World Cup™.
A project of this scale calls for high performing and reliable technology, so when we started working with Coca-Cola to build the infrastructure for the Happiness Flag campaign, we knew we had to use Google Cloud Platform. By using Google Cloud Platform, we turned a big, innovative idea into reality on a global scale.

To create the Happiness Flag, we leveraged the whole Google Cloud Platform stack as shown below:
Google App Engine enabled us to handle the computing workload, capable of handling millions of images via Twitter, Facebook, Instagram and email, to the searches for images and view requests. The architecture was scalable to meet this kind of transaction demand and the fluctuations in traffic. We stored all the images in Google Cloud Storage, where integrated edge caching support and image services made it an ideal choice for serving the images. Meanwhile, Google Compute Engine gave us the capability for long-running processes, such as the Twitter integration and advanced image transformations. We were able to show how powerful the creation of hybrid environments can be, using both Platform-as-a-Service (Google App Engine) and raw virtual machines (Google Compute Engine) in the cloud.

We used other out-of-the-box Google Cloud Platform technologies like Memcache, Datastore and Task Queues to ensure outstanding levels of performance and scalability. We know that many fans will be viewing the Happiness Flag on their mobile devices, so we needed a platform that would offer different capacities of computational power. The system provides amazing user experience with high performance and low latency, regardless of the device and its location. Using Google Cloud Platform, the campaign runs smoothly 24/7 and includes redundancy, failover techniques, backups and state-of-the-art monitoring. Plus, it’s affordable.

After the physical flag was unveiled before the opening match, the digital mosaic was made available with a Google map-like zoom in and out with eleven levels of detail. Anyone who submitted an image can now search for themselves on the virtual flag and the search results will show up as pins in the mosaic, like locations found in a Google map. By clicking on the pin, their photos open up in an overlay and they are taken to the maximum level of zoom in to see the "neighborhood" around their image in the flag. After the match, a link to the Happiness Flag site was sent to each participant as a souvenir.

Our goal was to help Coca-Cola create a project that would celebrate the 2014 FIFA World Cup™ by enabling fans from all over the world to express their creativity in a show of unity and art. What better way to open the games than by displaying the Happiness Flag, which is a symbol of the spirit of the game and its fans.



Posted:


(Cross-posted on the Google Cloud Platform Blog)

Editor's note: Today’s guest post is from Jeff Trom, CTO at Webfilings, a Software-as-a-Service provider that develops cloud-based solutions for business reporting.

At Webfilings, we’re reinventing complex business reporting. Wdesk, our flagship product, is an enterprise solution that is transforming how companies manage and report complex business data. It’s a collective workspace for teams to come together to build documents and reports without having to go to IT for assistance. Using Wdesk, financial teams have quickly become accustomed to how the cloud has simplified collaboration, provided global accessibility and eliminated the replication of data and documents.

What started as an idea to automate SEC reporting has now grown to a robust offering that supports more than 60% of the Fortune 500 in just 4 years since launch. We’ve been able to build a great company and culture where rapid innovation and best-in-class customer service are key.

We rely on Google Cloud Platform to make a formerly onerous process seem easy. Cloud Platform replicates our terabytes of data across multiple datacenters seamlessly and allows our developers to focus on innovation, not infrastructure. We deploy updates daily and leverage Google App Engine’s ability to simultaneously serve traffic from multiple versions to test new features with a few customers before releasing them to everyone. This helps ensure that our customers have the best experience possible each time they log in to Wdesk. Check out the video below to learn more about how we’re using Cloud Platform.

In our product space, the data-in-motion architecture we’ve chosen is what sets us apart. It requires:

  1. Dynamically scalable application servers to handle variable traffic patterns
  2. Replicated storage that’s scalable and provides reliable performance under load
  3. Enterprise-grade reliability to ensure 24 x 7 access for our customers

We love learning about how our customers innovate with Wdesk inside their own companies, and are constantly impressed by the solutions they produce. The possibilities seem endless.

Posted:


Many of the world’s most successful new companies, from Angry Birds creator Rovio to photo messaging service Snapchat, have built their businesses on Google Cloud Platform. We want developers in the Asia-Pacific region to also experience the speed and scale of Google’s infrastructure, so starting today, we are expanding Google Cloud Platform support to include Asia Pacific zones and adding local language tools.

Google Cloud Platform is a set of compute, storage and big data products that allow developers to build on top of the same infrastructure and technology that powers Google. The expansion means that local developers across Asia Pacific can now experience better performance and lower latency. Developers around the world will also have access to a broader global network of servers.

Japanese game maker Applibot is an early adopter of Cloud Platform in the region and have already used it to build and deploy mobile games globally. With millions of downloads on Google Play and iTunes, the company says Cloud Platform has been critical to their success. Applibot does not need to worry about server maintenance or provisioning new hardware to serve millions of potential users when they ship the latest game. Google Cloud Platform scales smoothly so that the company can focus on what they do best — creating great games.

The expansion of Cloud Platform support to Asia is our latest investment we’re making to help businesses work better with cloud based tools as part of Google’s Enterprise business. In addition to local product availability, the Google Cloud Platform website and the developer console will also be available in Japanese and Traditional Chinese.

Developers interested in learning more about Google Cloud Platform can join one of the Google Cloud Platform Global Roadshow events coming up in Tokyo, Taipei, Seoul or Hong Kong. For more technical details, head over to the Cloud Platform blog.

Posted:


(Cross-posted on the Google Cloud Platform Blog)

Editor's note: Tune in to Google Cloud Platform Live for more information about our announcements. And join us during our 27-city Google Cloud Platform Roadshow which kicks off in Paris on April 7.

Today, at Google Cloud Platform Live we’re introducing the next set of improvements to Cloud Platform: lower and simpler pricing, cloud-based DevOps tooling, Managed Virtual Machines (VM) for App Engine, real-time Big Data analytics with Google BigQuery, and more.

Industry-leading, simplified pricing
The original promise of cloud computing was simple: virtualize hardware, pay only for what you use, with no upfront capital expenditures and lower prices than on-premise solutions. But pricing hasn’t followed Moore's Law: over the past five years, hardware costs improved by 20-30% annually but public cloud prices fell at just 8% per year.

We think cloud pricing should track Moore’s Law, so we’re simplifying and reducing prices for our various on-demand, pay-as-you-go services by 30-85%:

  • Compute Engine reduced by 32% across all sizes, regions, and classes.
  • App Engine pricing simplified, with significant reductions in database operations and front-end compute instances.
  • Cloud Storage is now priced at a consistent 2.6 cents per GB. That’s roughly 68% less for most customers.
  • Google BigQuery on-demand prices reduced by 85%.

Sustained-Use discounts
In addition to lower on-demand prices, you’ll save even more money with Sustained-Use Discounts for steady-state workloads. Discounts start automatically when you use a VM for over 25% of the month. When you use a VM for an entire month, you save an additional 30% over the new on-demand prices, for a total reduction of 53% over our original prices.
Sustained-Use Discounts automatically reward users who run VMs for over 25% of any calendar month 
With our new pricing and sustained use discounts, you get the best performance at the lowest price in the industry. No upfront payments, no lock-in, and no need to predict future use.

Making developers more productive in the cloud
We’re also introducing features that make development more productive:

  • Build, test, and release in the cloud, with minimal setup or changes to your workflow. Simply commit a change with git and we’ll run a clean build and all unit tests.
  • Aggregated logs across all your instances, with filtering and search tools.
  • Detailed stack traces for bugs, with one-click access to the exact version of the code that caused the issue. You can even make small code changes right in the browser.

We’re working on even more features to ensure that our platform is the most productive place for developers. Stay tuned.

Introducing Managed Virtual Machines
You shouldn't have to choose between the flexibility of VMs and the auto-management and scaling provided by App Engine. Managed VMs let you run any binary inside a VM and turn it into a part of your App Engine app with just a few lines of code. App Engine will automatically manage these VMs for you.

Expanded Compute Engine operating system support
We now support Windows Server 2008 R2 on Compute Engine in limited preview and Red Hat Enterprise Linux and SUSE Linux Enterprise Server are now available to everyone.

Real-Time Big Data
BigQuery lets you run interactive SQL queries against datasets of any size in seconds using a fully managed service, with no setup and no configuration. Starting today, with BigQuery Streaming, you can ingest 100,000 records per second per table with near-instant updates, so you can analyze massive data streams in real time. Yet, BigQuery is very affordable: on-demand queries now only cost $5 per TB and 5 GB/sec reserved query capacity starts at $20,000/month, 75% lower than other providers.

Conclusion
This is an exciting time to be a developer and build apps for a global audience. Today we’ve focused a lot on productivity, making it easier to build and test in the cloud, using the tools you’re already familiar with. Managed VMs give you the freedom to combine flexible VMs with the auto-management of App Engine. BigQuery allows big data analysis to just work, at any scale.

And on top of all of that, we’re making it more affordable than it’s ever been before, reintroducing Moore’s Law to the cloud: the cost of virtualized hardware should fall in line with the cost of the underlying real hardware. And you automatically get discounts for sustained use with no long-term contracts, no lock-in, and no upfront costs, so you get the best price and the best performance without needing a PhD in Finance.

We’ve made a lot of progress this first quarter and you’ll hear even more at Google I/O in June.

Posted:


(Cross-posted from the Google Cloud Platform Blog.)

Editor's note: This week we’re featuring news, stories and updates about our vibrant partner community as we host more than 700 partners for our second annual Global Partner Summit.Keep an eye on this blog, our Google+ page and visit our program site for more information on the Google Apps Reseller Program.

As part of our continued investment in Google Cloud Platform, we have worked hard to build a great community of partners. These organizations provide everything from hands-on deployment and technical support to customized application development. Since its inception, we have welcomed 161 partners into the Partner Program.

Today, we are expanding our Partner Program in order to recognize our top service and technology partners and provide the means for any company to qualify as a Registered Company. The Partner Program’s three tiers are highlighted below:

  • Premier Partner - all the benefits of the core partner program and access to premier level services. 
  • Authorized Partner - core partner program with branding, relationship management and access to online resources and training.
  • Registered Company - entry level status with access to online resources and training.

    These tiers are the first steps of many to further develop our partner community so we can provide the best possible experiences for everyone out there while working hand in hand with those companies that make it possible.

    If you're ready to join our community and help bring Google Cloud Platform to everyone please learn more and apply here.

    If you’re looking for technology or services partners with experience with Google Cloud Platform, check out our partner directory where you can find partners who can help you move to the cloud.

    Posted:


    (Cross-posted on the Google Cloud Platform Blog)

    Editor's note: Our guest blog post today comes from James Donkin, General Manager Ocado Technology at Ocado, the only dedicated online supermarket in the UK and the world’s largest online grocery retailer

    Ocado is the world's largest online-only grocery retailer, reaching over 70% of British households, shipping over 150,000 orders a week or 1.1M items a day.

    Ocado doesn’t operate out of physical stores. Instead, our customers place their orders online via our webshop and mobile applications. These orders are then picked and packed in huge automated Customer Fulfilment Centres (CFCs), the largest of their kind in the world. They are then delivered to customers’ kitchens in one hour delivery slots by our own delivery fleet.

    Technology is at the core of almost everything Ocado does. We consider ourselves a technology company that also does retail. Our culture and make-up is much closer to that of Google than it is a bricks and mortar retailer. We started shipping orders in 2002 and over the past 12 years we have been engaged in a continual process of rapid innovation. Our solution is as unique as our business model and the fact that we own almost every line of source code in this solution means we can evolve it, optimise it and exploit it.

    We have a unique business model that is considered highly disruptive within the retail sector, due in part to the scale of automation that we employ.

    From the customer’s perspective it’s all about delivering the highest levels of service, quality and choice at a compelling price that all flow from our level of automation - it’s also about providing a customer experience that is irresistible in terms of its convenience and simplicity.

    However under the surface, that simplicity does not come easily and is achieved by a huge level of complexity in terms of the processes, automation, software, algorithms, optimisations and data that make it happen. We rely on Google Cloud Platform to do the heavy lifting on data processing and integration so we can focus on what we do best: getting quality groceries to customers in the quickest time possible.

    Six months ago, we were ready to make the shift to the cloud and researched Cloud Platform. We were familiar with Google's offerings since we've used Google Apps since 2010. We wanted to evaluate App Engine so we ran a series of intern development projects on this platform and found that the service is easy to use, offers security features like auditing and integrates nicely with other Cloud Platform products including Google Compute Engine and Google Cloud Storage, which increases the productivity and performance of the overall platform. App Engine also scales on demand automatically so that we don’t have to overprovision up front. We can get something live very quickly by just adding a small amount of code and pushing it out, compared to other cloud services where we would have had to build the whole stack from scratch.
    big-data-architecture_v01.png
    We use Compute Engine to run a big data processing pipeline based on Hadoop and process a terabyte of data per week in order to build better experiences for our customers. Compute Engine is flexible, has a great API, works well with App Engine and has high quality, consistent performance, particularly when starting new instances. We’re moving from more traditional relational database technologies to distributed processing, and with Compute Engine, we can try new technologies quickly and be more agile, rather than having to provision and install additional physical machines. We also use Google Cloud Datastore, which scales easily on demand to handle massive amounts of data.

    We use Cloud Storage for secure storage of all data we send to and receive from third-parties and partners. It automatically backs up the data and has a good REST API. Meanwhile, we are experimenting with Google Cloud SQL and are finding it makes it easier to port existing applications to the cloud, and supports immediate atomic consistency, an important feature for some solutions. We don’t have anything in production at the moment but are excited about Cloud SQL’s recent general availability.

    Cloud Platform is constantly developing and releasing new products and features that allow us to do even more with our data and applications. The data processing features and web analytics capabilities enable us to optimize our site to provide our customers with the best online experience. The ease, integration and scalability that Google offers with Cloud Platform allow us to offer the simplest, fastest and best online grocery shopping around, which is why customers choose to shop with us.

    Posted:
    Posted by Matthew O’Connor, Product Manager

    (Cross-posted on the Google Cloud Platform blog)

    When you’re building a healthcare-related application, not only do you need the right code and a reliable user experience, sometimes it feels like you need to be a lawyer too. Often, there are several additional steps to take to into consideration. In particular, some healthcare-related applications and services in the United States are required to comply with the Health Insurance Portability and Accountability Act (HIPAA) regulations. HIPAA establishes standards around privacy, security, and breach notification to protect individually identifiable health information. When building in the cloud, it can be challenging to ensure that you’re complying with these regulations.

    To serve developers who want to build these applications on Google's infrastructure, we're announcing support for Business Associates Agreements (BAAs) for our customers. A BAA is the contract between a Covered Entity (you, the developer) and their Business Associate (Google) covering the handling of HIPAA-protected information.

    Today’s news joins our other compliance efforts across Cloud Platform and Google Enterprise:

    • ISO 27001: ISO 27001 is one of the most widely recognized, internationally accepted independent security standards. After earning ISO 27001 for Google Apps in 2012, we renewed our certification again last year for Google Apps and received the certification for Google Cloud Platform.
    • SOC2, SSAE 16 & ISAE 3402: Companies use the SOC2, SSAE 16 Type II audit, and its international counterpart ISAE 3402 Type II audit, to document and verify the data protections in place for their services. We’ve successfully completed these audits for Google Apps every year since 2008 (when the audits were known by their previous incarnation, SAS 70) and we did so again last year for Google Apps and Google Cloud Platform.
    • HIPAA: Late last year, we started entering into BAAs to allow Google Apps customers to support HIPAA regulated data. This year we have begun entering into BAAs with our Google Cloud Platform customers.

    We’re looking forward to supporting customers who are subject to HIPAA regulations on Google Cloud Platform. If you are a Covered Entity under HIPAA and would like more information, please contact our team.

    Posted:


    (Cross-posted on the Google Cloud Platform Blog)

    Editor's note: Today’s guest blog comes from Dan Mesh, Vice President of Technology at Evite, the pioneer in online invitations and social planning. Evite has over 30 million registered users and sends more than 250 million party invitations annually.

    In the past year, we’ve introduced a couple of exciting new products at Evite: our Postmark service offers premium online invitations and announcements for milestone events like weddings and births, and Evite Ink lets our users design custom paper invitations that we print and mail for a small fee. We couldn’t have launched these products without Google Compute Engine and Google App Engine, which gave us the infrastructure needed to scale our services to high demands and analyze large volumes of data they generate.

    Evite has been around since 1998, but behind this well-known online brand is a small and lean team. Migrating to the cloud has allowed us to focus our time, energy and financial resources on development of new products and services, free from worries of server management, capacity planning and hardware costs.
    We chose Google Cloud Platform because the combination of App Engine and Compute Engine truly delivers on the cloud’s promise of scalable and elastic computing. App Engine’s autoscaling means that as long as our applications are developed in line with the platform API’s and architecture guidelines, scalability comes for free. This is a huge benefit since we no longer worry about scaling our services to meet heavy demands and are also free from the difficulties and risks inherent in capacity planning.

    Most online businesses have very consistent daily, weekly and seasonal traffic patterns, and in Evite’s case, these patterns are even more pronounced. In the past, we used to provision resources to meet peak demand allowing for a healthy margin of error and future growth. Naturally, this resulted in a lot of wasted capital and engineering resources. Now that most of our systems are running on Google Cloud Platform, we see significant savings as application servers expand and shrink elastically in accordance with our web traffic.

    For example, in the past Evite was hesitant to roll out major application releases in Q4, typically the busiest time of the year for us. During this time, we reach our peak traffic, and operational focus was on making sure nothing went wrong. Any significant releases represented unwanted risk. Cloud Platform greatly simplifies the release process and provides built-in traffic splitting. This has made it possible for Evite product teams to test new features and release products more frequently and with reduced risks, even during the busiest times of year.

    As we add new products and services, Compute Engine plays a key role in our application infrastructure. We use it to closely monitor and analyze the performance of our products and services. All application data and log files generated by applications running on App Engine flow through a cluster of Compute Engine instances running extract, transform, load (ETL) processes, which feed this data into the data warehouse. There we analyze the collected data to detect errors and usage patterns helping us improve the design of our products and maintain performance levels.

    Compute Engine gets high marks for interoperability with App Engine and other cloud vendors. We use AWS Redshift as our data warehouse so interoperability is very important. Equally impressive are predictable, high I/O performance and fast instance startup times. For our data processing workloads these two metrics are critical to success.

    With App Engine powering all of our customer-facing services and Compute Engine helping us monitor and understand application performance, Evite is in great shape to create and release new products. We look forward to many new releases in 2014 knowing we can count on Cloud Platform to make these launches trouble-free.

    Posted:


    (Cross-posted on the Google Cloud Platform Blog and Google Developers Blog)

    Google Cloud Platform gives developers the flexibility to architect applications with both managed and unmanaged services that run on Google’s infrastructure. We’ve been working to improve the developer experience across our services to meet the standards our own engineers would expect here at Google.

    Today, Google Compute Engine is Generally Available (GA), offering virtual machines that are performant, scalable, reliable, and offer industry-leading security features like encryption of data at rest. Compute Engine is available with 24/7 support and a 99.95% monthly SLA for your mission-critical workloads. We are also introducing several new features and lower prices for persistent disks and popular compute instances.

    Expanded operating system support
    During Preview, Compute Engine supported two of the most popular Linux distributions, Debian and Centos, customized with a Google-built kernel. This gave developers a familiar environment to build on, but some software that required specific kernels or loadable modules (e.g. some file systems) were not supported. Now you can run any out-of-the-box Linux distribution (including SELinux and CoreOS) as well as any kernel or software you like, including Docker, FOG, xfs and aufs. We’re also announcing support for SUSE and Red Hat Enterprise Linux (in Limited Preview) and FreeBSD.

    Transparent maintenance with live migration and automatic restart
    At Google, we have found that regular maintenance of hardware and software infrastructure is critical to operating with a high level of reliability, security and performance. We’re introducing transparent maintenance that combines software and data center innovations with live migration technology to perform proactive maintenance while your virtual machines keep running. You now get all the benefits of regular updates and proactive maintenance without the downtime and reboots typically required. Furthermore, in the event of a failure, we automatically restart your VMs and get them back online in minutes. We’ve already rolled out this feature to our US zones, with others to follow in the coming months.

    New 16-core instances
    Developers have asked for instances with even greater computational power and memory for applications that range from silicon simulation to running high-scale NoSQL databases. To serve their needs, we’re launching three new instance types in Limited Preview with up to 16 cores and 104 gigabytes of RAM. They are available in the familiar standard, high-memory and high-CPU shapes.

    Faster, cheaper Persistent Disks
    Building highly scalable and reliable applications starts with using the right storage. Our Persistent Disk service offers you strong, consistent performance along with much higher durability than local disks. Today we’re lowering the price of Persistent Disk by 60% per Gigabyte and dropping I/O charges so that you get a predictable, low price for your block storage device. I/O available to a volume scales linearly with size, and the largest Persistent Disk volumes have up to 700% higher peak I/O capability. You can read more about the improvements to Persistent Disk in our previous blog post.

    10% Lower Prices for Standard Instances
    We’re also lowering prices on our most popular standard Compute Engine instances by 10% in all regions.

    Customers and partners using Compute Engine
    In the past few months, customers like Snapchat, Cooladata, Mendelics, Evite and Wix have built complex systems on Compute Engine and partners like SaltStack, Wowza, Rightscale, Qubole, Red Hat, SUSE, and Scalr have joined our Cloud Platform Partner Program, with new integrations with Compute Engine.
    “We find that Compute Engine scales quickly, allowing us to easily meet the flow of new sequencing requests… Compute Engine has helped us scale with our demands and has been a key component to helping our physicians diagnose and cure genetic diseases in Brazil and around the world.”
    - David Schlesinger, CEO of Mendelics
    "Google Cloud Platform provides the most consistent performance we’ve ever seen. Every VM, every disk, performs exactly as we expect it to and gave us the ability to build fast, low-latency applications."
    - Sebastian Stadil, CEO of Scalr
    We’re looking forward to this next step for Google Cloud Platform as we continue to help developers and businesses everywhere benefit from Google’s technical and operational expertise. Below is a short video that explains today’s launch in more detail.

    Posted:
    (Cross-posted on the Google Cloud Platform blog)

    Editor's note: Today we hear from Daniel Hasselberg, co-founder and chief executive officer of mobile game development company, MAG Interactive, based in Stockholm, Sweden. MAG Interactive produces some of the most popular games in the world, including Ruzzle, which has more than 45 million players in 142 different countries.

    When we launched our word game Ruzzle in 2012, we had no idea it would become an international sensation almost overnight. We initially promoted the game only to our family and friends, but within two weeks of our launch, Ruzzle was the No.1 game on the Swedish App Store.

    I believe if we hadn’t used Google App Engine to build the backend of Ruzzle, we wouldn’t have been able to scale fast enough with our own servers, which would have killed the app in the marketplace. There were about a million downloads of Ruzzle per month in the Nordic region, Holland, Spain and Italy through 2012. As we refined the game’s social integration through channels like Facebook and Twitter, we grew rapidly in Italy and the United States. In 2013, Ruzzle became the No. 1 game download on Google Play and the App Store in Italy, Sweden, the United States and many other countries.

    Things were especially crazy at the end of last year. We were seeing about 700,000 new players each day from December 2012 through January 2013. We added 20 million users in a single month! It was incredible to see App Engine scale – and just keep on working – as we grew from about 5 million players to 25 million players in just a few weeks.

    Our decision to use App Engine as the platform for Ruzzle and our new game, QuizCross, was strategic. Some of us at MAG Interactive helped develop the server platform for one of the most popular music download services in the Nordic region, so we knew about the challenges of having to scale quickly. While we didn’t anticipate Ruzzle’s popularity, we did recognize even before creating the game that we could face scaling problems if we were successful. So we decided from day one to use a cloud solution.

    We looked at Amazon’s platform but preferred Google’s approach to cloud solutions. Google’s scalability was an important factor in our decision, but we also appreciated the company’s transparent pricing. The more efficient we became with App Engine, the less we paid.

    The Google Cloud Platform team has been great to work with, as well. They are very supportive and appreciate our feedback. The technical support experts at Google are amazing, too – very hands-on. They know the platform extremely well and can help us work through any challenge.

    We’re also using Google BigQuery for business intelligence. We track millions of events in the game every day so we know what users are doing – or not doing – and how we should improve the experience. We really like that we can throw enormous amounts of data at BigQuery, and it still performs. It only takes a few seconds to get results, and there are no scaling issues. It’s also easy to use. We have just one data analyst doing all the work with BigQuery but could probably use more people. If there are a few brilliant data mining experts out there who can imagine a future in Stockholm, please give us a call!

    One thing we’ve learned from our BigQuery analysis is that the more users play Ruzzle, the more they improve their skills. New players typically find about 18 words in the two-minute time frame they’re given. After they play 100 games, they can find about 50 words, on average. I think that tracking player improvement is what keeps people playing and has helped to make Ruzzle so popular.

    BigQuery offers our company a lot of insight into the use of our games and how we can improve them. We’re looking forward to expanding our relationship with Google as App Engine and Cloud Platform evolves.

    Posted:


    Earlier this month, I delivered a keynote at Gartner’s annual symposium and published a blog post about the rapidly evolving landscape of business technology. The rise of cloud computing and ubiquitous, powerful mobile devices means that organizations can reduce their IT bills significantly while boosting employees’ productivity and collaboration. Moving to the cloud is no longer a questionable proposition — it’s inevitable.

    This led some of the organizations I work with to ask: “That all makes sense, but how do we actually get started?”

    Good question. Here are five concrete steps you can take to get started:
    1. Start by setting up a Google Apps account for your organization. This will allow you to move your standard productivity and communications work to the cloud: you’ll use Gmail for your email (with your own domain, like [email protected]); Google Calendar for your calendars; Google Drive to store files; Google Docs to create and edit documents, spreadsheets and presentations; and Hangouts to send instant messages and hold video calls. This will free your staff from spending time maintaining servers and installing upgrades. Google Apps is free to schools and non-profits, and costs $50/person per year for businesses and government agencies.
    2. Move your other standard business applications to cloud-based equivalents. Popular apps include Workday (HR), Salesforce (CRM), Zendesk (customer service), Netsuite (Financials), and Wix or Weebly (websites). More companies are creating and launching cloud-based business applications every day — check out the Chrome Web Store for more.
    3. Move your custom applications to a cloud infrastructure. Many organizations have built their own custom applications or need to be able to do very specialized programming. Most people use Amazon Web Services, Google Cloud Platform or Microsoft Azure. Choose between the first two.
    4. Standardize on a modern browser, ideally Chrome. Chrome is built for speed, simplicity and security — and of course it’s free. To make sure that you're protected from the latest threats, Chrome automatically updates whenever a new version of the browser is available. You can also use Chrome on all the major desktop and mobile platforms, including Android and iOS, and sync your tabs and bookmarks between different devices. Chrome for Business includes a cloud-based management console, which lets you customize policies and preferences for your employees easily from the web, including which apps and extensions they receive, across their devices.
    5. For hardware, you can now move to a flexible, “bring your own device” policy. Without servers, the only real hardware you need are computers and phones — and a true cloud architecture works well with any operating system: Windows, Mac, Chrome OS, Android, iOS. People can choose the device that suits them, and you can then reimburse their purchases and/or their own personal cell phone and internet bills. If you do decide to supply your staff with computers, consider Chromebooks: they boot up in seconds, have built-in virus protection and are dead simple to deploy and manage.

    *    *    *

    Lots of companies have already moved to the cloud successfully, from local coffee shops to major corporations with 200,000 employees. For small and mid-size companies, the transition can be made in a matter of days or weeks. For larger companies, who often have custom legacy systems built over many years, the migration may take a few months. In these cases, consider working with experts that specialize in helping companies move to the cloud using all the tools I’ve mentioned.

    The world is moving to the cloud. Now’s the time for you to move, too.

    Posted:


    When it’s raining out, do people’s shopping habits change? Those are the kind of questions the team at Interactions Marketing, working with Tableau Software, think about when analyzing massive data sets on behalf of retailers. In a highly competitive market, retailers need the edge they can gain from business data – and with the analysis they can generate using Google BigQuery. By analyzing these data sets, you can find what Interactions Marketing calls “unexpected insights,” which help businesses make predictions that can improve sales. For example, they look at how external factors like the weather will affect retail sales.

    Find out more about the value of Big Data and unexpected insights for retailers – and how Google BigQuery supports these analytics projects – in our Hangout On Air on Thursday, September 26, at 9 a.m. PT. Giovanni DeMeo, Vice President of Global Marketing and Analytics for Interactions Marketing; Paul Lilford, Global Director for Technology Partners at Tableau Software; and Daniel Powers, Director of Sales for Google Cloud Platform will explain how retailers can understand their businesses better and boost success:

    • How can unexpected insights help retailers attract and keep customers?
    • What are the pressures on retailers to glean insights from their data?
    • How does cloud storage make Big Data analysis possible?
    • How can you make it easier to visualize and understand your data?

    If you missed our previous Hangout On Air with Speedway Motors, the world’s largest manufacturer of specialty hot-rodding and racing products, you can catch up on the recording here.

    RSVP for the Interactions Marketing/Tableau Software Hangout On Air, and participate in the Q&A by posting your questions on Google+ or Twitter using the hashtag #GoneGoogle.

    Posted:


    (Cross-posted on the Google Cloud Platform Blog)

    Editor's note: Today’s guest post is from Ben Kamens, Lead Developer at Khan Academy, a not-for-profit that provides a free education available for anyone. See what other organizations that have gone Google have to say.

    Khan Academy has an audacious mission: to provide a free world class education to anyone anywhere. With less than fifty full-time employees at the company, our small team has to take special care to work on whatever’s most critical. So we’re building a culture that relentlessly focuses on shipping code that improves students’ lives. Our team of developers relies on three simple principles that guide all the work we do:
    1. Shipping beats perfection.
    2. Be open. Share your work.
    3. Anybody can fix anything.
    4.  
      Google Cloud Platform provides a flexible and reliable environment to put these principles into practice. With Google App Engine in particular, we get a big, enormous, whopper of a benefit — consistent Datastore performance no matter how big the product gets. Even if we have a query that returns 10 items from a set of 10,000, we can relax. We know that as our company grows over time, we’ll get the exact same speed when pulling 10 items from a set of 10,000,000,000. 
      Lots of people ask, “How will you know if Khan Academy is really successful?” My answer is always the same: we of course care about data, analytics, and metrics that demonstrate provable, real learning. But in the back of my mind I’m most persuaded by the personal stories that people send us literally every day. Those stories of real lives being changed for the better are the reason why we believe a free educational resource like Khan Academy simply must exist.

    Posted:
    Philip Talamas, CIO oMinyanville Media, Inc

    (Cross-posted on the Cloud Platform blog)

    Editor's note: Today’s post is from Philip Talamas, CIO of Minyanville Media, Inc., a New York based financial media company. In this post, Philip looks at the benefits his company received from switching from a major public cloud provider to Google Cloud Platform.

    At Minyanville Media, our goal is to create branded business content that informs, entertains, and educates all generations about the worlds of business and finance. We designed our premium Buzz & Banter app app to serve this need. The Buzz ran on a competing cloud platform that presented increasing technical challenges as we expanded our customer base and feature set. We wanted a higher performing platform offering a more flexible and deeper feature set; we wanted to be certain we were serving our longtime clients as best as we could.

    We consulted our strategic technology partner MediaAgility, and the company advised us to move to Google Cloud Platform. There were two obvious benefits to switching to Google Cloud Platform from our old provider: better reliability and automatic demand-based scaling of the application.

    Every day, thousands of investors access our system globally, everywhere from Syracuse to Switzerland. They turn to us for reliable market intelligence and investing ideas. Today's economic uncertainty, coupled with high frequency trading, keeps us on our toes. When a central bank unexpectedly cuts interest rates or a hacked tweet sends markets into a tailspin, seconds matter. We are timely, or we are out of business. It’s as simple as that. Additionally, we serve two major online brokerage firms, which have very high standards for performance and reliability.

    Hence, we decided to move Buzz and Banter to the Google Cloud Platform. The improvement and increase in operational speed was drastic. New Buzz, running on Google App Engine, updates content instantaneously -- even before our content management system refreshes to confirm publication. The icing on the cake is that our operating costs are significantly lower than what they were under our old provider.

    It’s rare that everyone wins in a technology transition, but that’s exactly what’s been accomplished in our move to Google App Engine. With a better customer experience, lower operating costs, and fewer technological headaches, we only wish that we’d made the switch sooner.