Google Cloud Platform Blog
Product updates, customer stories, and tips and tricks on Google Cloud Platform
Automated Compute Engine and Docker Image Builds with Jenkins, Packer, and Kubernetes
Wednesday, May 27, 2015
Everyone loves portability and speed, especially when it comes to cloud. Today we’re excited to introduce
a new technical paper
and open source reference implementation that will help your
Google Compute Engine
virtual machines boot even faster, and allow you to build portable images for Docker along with your Compute Engine images.
When you run an application on a Compute Engine instance, you first have to deploy one or more Virtual Machines and configure them so your application works. This configuration usually involves installing the application and its dependencies, then setting up any other configuration your application requires, such as database connection strings or API keys.
You could do this manually by connecting to each instance after it boots and configuring each element, but that is a slow and error-prone process that creates unique, inconsistent “snowflake” instances. Running configuration scripts automatically at startup is a better solution as it’s repeatable and scalable - but it requires a lot of up-front work and is still subject to human error. Additionally, if a package you’re installing is temporarily unavailable, your instances just won’t boot and if the packages you’re installing are large or need to be compiled, boot times gets slower and your ability to auto scale is affected.
Building custom images before you launch instances is a great way to reduce boot times and increase reliability. Today we’re introducing a
solution paper
and
open source reference implementation
that describes in detail how to
Automate Image Builds
with
Jenkins
,
Packer
, and
Kubernetes
. You’ll learn how to use popular open source technologies to continuously build images for your Compute Engine or Docker-based applications. You’ll build the images in a central project, share them with other projects in your organization, and integrate the image build as a step in your continuous integration (CI) pipeline.
The diagram below shows the Jenkins image builder serving as a hub that builds Compute Engine and Docker images for other projects in your organization:
Figure 1: Jenkins building images for other projects in your account.
In addition to creating a secure and scalable image building pipeline, you’ll learn how to run a reliable Jenkins installation on Kubernetes, including how to backup/restore Jenkins and scale your worker nodes.
Head on over to the
Automated Image Builds solution page
for all the details on using
Jenkins
,
Packer
, and
Kubernetes
with Google Cloud Platform to increase the speed and reliability of your instance and container launches. After that, go deploy the infrastructure yourself by following
the tutorial in the reference implementation
. We love feedback:
GitHub pull requests
or
issues
for suggestions on the tutorial, comment here, or
@evandbrown
on Twitter to let me know how you’re using Google Cloud Platform!
-Posted by Evan Brown, Solutions Architect
Free Trial
GCP Blogs
Big Data & Machine Learning
Kubernetes
GCP Japan Blog
Firebase Blog
Apigee Blog
Popular Posts
Understanding Cloud Pricing
World's largest event dataset now publicly available in BigQuery
A look inside Google’s Data Center Networks
Enter the Andromeda zone - Google Cloud Platform’s latest networking stack
New in Google Cloud Storage: auto-delete, regional buckets and faster uploads
Labels
Announcements
193
Big Data & Machine Learning
134
Compute
271
Containers & Kubernetes
92
CRE
27
Customers
107
Developer Tools & Insights
151
Events
38
Infrastructure
44
Management Tools
87
Networking
43
Open
1
Open Source
135
Partners
102
Pricing
28
Security & Identity
85
Solutions
24
Stackdriver
24
Storage & Databases
164
Weekly Roundups
20
Feed
Subscribe by email
Demonstrate your proficiency to design, build and manage solutions on Google Cloud Platform.
Learn More
Technical questions? Check us out on
Stack Overflow
.
Subscribe to
our monthly newsletter
.
Google
on
Follow @googlecloud
Follow
Follow
Follow