Google Cloud Platform Blog: July 2014

Reducing ranking latency from one hour to five seconds using Cloud Datastore

Thursday, July 31, 2014

We recently published a case study, Fast and Reliable Ranking in Datastore, that describes how we helped one of our Google App Engine customers shorten their ranking latency from one hour to five seconds. They applied unique design patterns such as job aggregation to achieve over 300 updates per second with strong consistency on Cloud Datastore. The following are highlights from the article.The problem of rankingApplibot

Tomoaki Suzuki, App Engine lead engineer at Applibot, Inc. and their game Legend of Criptids (#1 ranked game in the Apple App Store North America gaming category in October 2012)

Your game has hundreds of thousands (or more!) players.

Whenever a player fights enemies (or performs other activities), their score changes.

You want to show the latest ranking for the player on a web portal page.

SELECT count(key) FROM Players WHERE Score > YourScore

The easiest way: scan all players

MemcacheLooking for an O(log n) Algorithmplatinum support contracttree algorithmsGoogle Code Jam Ranking Library

Getting the rank of a score in a tertiary tree with google Code Jam Ranking Library

Concurrent Updates Limit Scalabilityentity groupBalancing Strong and Eventual Consistency with Google Cloud Datastoreone transaction per secondDatastore Team's Solution: Job AggregationMegastoreVoltDbRedisProposed Solution Runs at 300 Updates per Second Sustainedpull queueTask Queue

Performance graph of the solution

one hour to five secondsNotes

Fastly uses Brightcove’s Zencoder service on Google Cloud Platform for reliable live video streaming

Wednesday, July 30, 2014

Today’s guest blog comes from Casey Wilms, product lead for cloud media services provider Brightcove, and Lee Chen, head of product at content delivery network Fastly. Fastly leverages Brightcove's Zencoder cloud-based encoding service, which runs on Google compute, to offer a powerful Live video streaming solution. Background on Brightcove and FastlyFunny or DieSmugMugHow the Brightcove/Fastly Integration Works

Why Brightcove Chose Google Cloud PlatformFaster Streaming, Happier Customers

U.S. Cellular reveals true impact of digital media on sales with Google Analytics Premium

Friday, July 25, 2014

Cross-posted from the Google Analytics BlogU.S. CellularGoogle BigQueryGoogle Cloud Platformfull case study

CloudLock provides cloud security for 5 million cloud app users

Wednesday, July 23, 2014

Editor’s note: Today’s guest blog comes from Ron Zalkind, co-founder and CTO of Waltham, Massachusetts-based CloudLock, a leading cloud security provider. The largest organizations in the world trust CloudLock to secure their data in the cloud, increase collaboration, and reduce their risk.cloud security applicationsGoogle App EngineGoogle BigQueryGoogle Cloud Storagenterprise-class cloud security

Introducing a new online course for Google App Engine

Tuesday, July 22, 2014

Developing Scalable Apps with Google App Engine
magnus pizza boxes 5-cropped.png

gives the backgroundGoogle Cloud Platform
just the sandwich 3.png

Google Cloud Endpoints

www.udacity.com/course/ud859www.udacity.com/google

Introducing Google Cloud Monitoring Read API

Thursday, July 17, 2014

Google Cloud Monitoring

Google Compute Engine - 13 metrics

Google Cloud SQL - 12 metrics

Google Cloud Pub/Sub - 14 metrics

a full list of supported metricsgetting started pageclick hereExample: getting CPU usage time series data GET \ https://www.googleapis.com/cloudmonitoring/v2beta1/ \ # Access API projects/YOUR_PROJECT_NAME/ \ # For YOUR_PROJECT_NAME timeseries/ \ # get time series of points compute.googleapis.com%2Finstance%2Fcpu%2Fusage_time?\ # of CPU usage youngest=2014-07-11T10%3A29%3A53.108Z& \ # with this latest timestamp key={YOUR_API_KEY} # using this API key Your feedback is important!cloud-monitoring-feedback@googlegroups.com

Google Cloud Platform brings Allthecooks to all the kitchens

Wednesday, July 16, 2014

Today’s guest blog comes from Rafael Sanches, engineer at Allthecooks, a social media platform for people who love cooking. Allthecooks is available on Android, iPhone, Windows Phone, Google Glass and Android Wear, and is a top recipe app on Google Play.Google Cloud PlatformGoogle App EngineGoogle Cloud DatastoreGoogle Compute Engine

Click to Deploy Apache Cassandra on Google Compute Engine

Monday, July 14, 2014

Cassandra hitting 1 million writes per second on Google Compute Engine,virtual machine typespersistent disksGoogle Compute EngineApache Cassandradedicated Apache Cassandra cluster

Configured with the GoogleCloudSnitch for Google Cloud Platform awareness

Writes tuned for Google Persistent Disk

JVM tuned to perform on Google Compute Engine instances

Click to Deploy help pagehttps://developers.google.com/cloud/cassandraCassandra, is registered trademarks of Apache, Inc. All other trademarks cited here are the property of their respective owners.

We think Germany will win. But don’t take our word for it...

Friday, July 11, 2014

quarter-finalssemi-finalsGoogle Cloud DataflowOptaGoogle BigQuery+JordanTigani@felipehoffathis video from Google I/OOur prediction for the finalwe wouldn't have gotten that one quite rightBut don’t take our word for it...IPython notebookHere’s how you can do it We’ve put everything on GitHubIPython notebookGoogle Compute Enginereadme on GitHub

Red Hat Enterprise Linux Atomic Host expands to Google Compute Engine

Thursday, July 10, 2014

Today’s guest blog comes from Jim Totton, Vice President and General Manager, Platform Business Unit at Red HatRed Hat Enterprise Linux 7 Atomic special interest groupannounced our visionEarlier today on our blog Red Hat is embracing the Google Kubernetes project and plans to work to enable it with container management capabilities in our products and offerings. This will enable Red Hat customers to take advantage of cluster management capabilities in Kubernetes, to orchestrate Docker containers across multiple hosts, running on-premise, on Google Cloud Platform or in other public or private clouds. As part of this collaboration, Red Hat will become core committers to the Kubernetes project. This supports Red Hat’s open hybrid cloud strategy that uses open source to enable application portability across on-premise datacenters, private clouds and public cloud environments. chain of trustlaunched in March 2014Red Hat Enterprise Linux Blog

Welcome Microsoft, RedHat, IBM, Docker and more to the Kubernetes community

Thursday, July 10, 2014

Kubernetes

Microsoft is working to ensure that Kubernetes works great in Linux environments in Azure VMs. Scott Guthrie, Executive Vice President of the Cloud and Enterprise group at Microsoft told us, “Microsoft will help contribute code to Kubernetes to enable customers to easily manage containers that can run anywhere. This will make it easier to build multi-cloud solutions including targeting Microsoft Azure.”

Red Hat is working to bring Kubernetes to the open hybrid cloud. Paul Cormier, President, Products and Technologies at Red Hat, told us, “Red Hat has a rich history of contributing to and maturing innovative, open source projects. Through this collaboration with Google on Kubernetes, we are contributing to the evolution of cloud computing and helping deliver the promises that container technologies offer to the open hybrid cloud.”

IBM is contributing code to Kubernetes and the broader Docker ecosystem to ensure that containers are enterprise-grade, and is working with the community to create an open governance model around the project.

Docker is delivering the full container stack that Kubernetes schedules into, and is looking to move critical capabilities upstream and align the Kubernetes framework with Libswarm.

CoreOS is working to ensure that Kubernetes can work seamlessly with the suite of CoreOS technologies that support cloud-native application development on any cloud.

Mesosphere is actively integrating Kubernetes with Mesos, making the advanced scheduling and management capabilities available to Kubernetes customers.

SaltStack is working to make Kubernetes a portable container automation framework that is designed for the reality of the platform-agnostic, multi-cloud world.

Go source and documentation for Kubernetes on GitHub

SMART amp frees students and teachers to collaborate, with help from Google App Engine

Wednesday, July 9, 2014

Today’s guest blog comes from David LaBine, director of education software for SMART Technologies. SMART Technologies creates interactive displays that encourage collaboration in business and education. The company recently launched SMART amp, a cloud-based collaborative learning tool for classrooms.

Google Cloud Platform is 11 for 12 in World Cup predictions

Monday, July 7, 2014

going 8 for 8 in predicting the Round of 16Cloud DataflowBigQueryCompute EngineGary Linekerthe Germans always winWhy did we get Germany - France wrong?about as often as he sees his barberh/t CortanaWhat about the semi-finals?

Brazil vs. Germany: Germany (59%)

Netherlands vs. Argentina: Argentina (61%)

out of the tournament with a back injury

Webydo moves to Google Cloud Platform to keep up with growing demand

Thursday, July 3, 2014

WebydoGoogle Cloud Platformhere

Google Cloud Platform goes 8 for 8 in World Cup predictions

Wednesday, July 2, 2014

Google Cloud PlatformPaul the Octopus@felipehoffa+JordanTiganiminute 25OptaGoogle Cloud DataflowGoogle BigQueryiPythonPandasGoogle Compute Enginepoisson regression

Brazil vs. Colombia: Brazil (71%)

France vs. Germany: France (69%)

Netherlands vs. Costa Rica: Netherlands (68%)

Argentina vs. Belgium: Argentina (81%)

In case you missed it in June: Big news about Containers, Big Data, Mobile, Disks, and more

Tuesday, July 1, 2014

May was busyDocker Containers in App Engine and Kubernetesefforts to make Containers first class citizensManaged VMsThe source and documentation for Kubernetes are hosted on GitHubSSD Persistent Disks and global load balancingSSD persistent disksglobal HTTP load balancingDiscussing the evolution of computing at Googleevolution of computing at GoogleOne-Click Rabbit MQ and MongoDBRabbit MQMongoDBcommand-line tool in the Google Cloud SDKImporting data to Google Cloud Storage is faster than everCloud Storage Online Cloud ImportCloud Platform documentation is better than everdevelopers.google.com/cloudGoogle I/Oseveral new products & features at Google I/Oyou can watch here

Cloud Trace and Cloud Debugger for Diagnosing Systems in Production: Cloud Trace and Cloud Debugger allow you to understand, diagnose, and improve systems in production. If you want to see Cloud Debugger in action, you can check out our demo during the I/O Keynote beginning at the 2 hour mark, or read more about it on our blog.

Analyze Huge Datasets with Cloud Dataflow: We demonstrated Cloud Dataflow, a managed service for creating data pipelines that ingest, transform and analyze data in both batch and streaming modes. You can see us analyze World Cup results using Dataflow. We also released a preview of Cloud Pub/Sub, helping you connect apps and devices that send data into processing pipelines.

Mobile Developers: Save User Data to the Cloud without Backend Code: We introduced a number of new features that make it easier to build mobile applications, including a new version of Google Cloud Save, which gives you a simple API for saving, retrieving, and synchronizing user data to the cloud and across devices without the need for backend code. We also put new tooling in Android Studio that simplifies the process of adding an App Engine backend to your mobile app. You can read more about these new features here.

Rising Star on ABC, Secret, and Coca-Colawith real-time, interactive voting powered by Cloud PlatformI/O keynoteCI&TGoogle Cloud Platform-powered Coca-Cola “Happiness Flag,”Connect with our team in a city near youNorth American Cloud Platform Developers roadshow