Around IT In 256 Seconds By Tomasz Nurkiewicz

Podcast for developers, testers, SREs… and their managers. I explain complex and convoluted technologies in a clear way, avoiding buzzwords and hype. Never longer than 4 minutes and 16 seconds.

Subscribe in Apple PodcastsGoogle PodcastsSpotifyRSS

11 August 2020

#12: Continuous integration, delivery and deployment

by Tomasz Nurkiewicz

Typically, more than one developer is working on the same codebase. How do they share their work? The simplest approach is a common Dropbox folder. This has several drawbacks, mainly we risk breaking other’s work with our half-done features. So we come up with version control systems. There we only commit code when all changes are done.

The problem

Some developers take it to the extreme. They work on their branch for weeks or even months, without showing the results of their work. This is quite common. A developer hides in the closet for weeks, making tons of changes that only he/she sees. After a month or two changes are merged, wreaking havoc. Large refactorings, reorganized code structure, changed database schema. You name it. Suddenly a huge feature appears out of the blue in the master. This is problematic for two reasons:

Simply put: conflicts and broken production.

Merge more often

The solution seems simple: merge more often. Continuous integration basically means merging your changes several times a day back to master. So how’s it different to simply working on master all the time? Well, continuous integration comes with some discipline. First of all, our version control needs to be capable of atomic commits and easy branching/merging. Secondly, every commit needs to be built and tested automatically. Otherwise it’s too easy to merge code that doesn’t compile or with failing tests. Other quality gates are a bonus.

This way whenever you branch of off master, you are guaranteed to have very recent codebase. Without continuous integration you might be working on a version that’s very outdated. Also, long-living branches that you are not aware of, may contain valuable changes. Refactorings, performance optimizations, documentation updates. Things that were needed for a particular feature, but everyone can benefit from them.

Continuous delivery

All right, so it seems you can integrate your changes to master multiple times a day. You even have mechanisms to prevent broken code and regressions. When’s the right time to deploy to production? Always! Any time you or your manager wants. Moreover, it should be so simple that even your manager can deploy to production! Every new feature or bugfix, if it’s on master, may be deployed at any time. This encourages frequent deployments. However, the deployment process must be fully automated and bullet-proof. Building, applying configuration, avoiding downtime. The last one is especially interesting, but easy to implement. When deploying a new version, just keep the old one running, until the new version warms up. Stacks like Kubernetes do this by default. Typically, such an automated pipeline is orchestrated using tools like Jenkins or Bamboo. There is still space for some manual verification. But in general anyone can simply deploy with a single click.

Continuous deployment

Continuous deployment takes this idea to the extreme once again. If everything on master branch can be deployed at any time, why not deploy it immediately? You hear it right, every commit to master is deployed to production straight away. Obviously, there are unit, integration and end-to-end tests. There are automated sanity checks. There are A/B tests, canary deployments, etc. But in principle, if something managed to get into master, it’s automatically deployed to production. Maybe several times a day. Many organisations fear deployments on Friday or during peak season. Smarter companies understand that bugfixes or new features are especially wanted during Black Friday. Why wait if we have something great that passed all the tests?

More materials

Be the first to listen to new episodes!

To get exclusive content:

tags: CI - CD - canary-deployment - ab-testing