ChaosKube

ChaosKube is similar to Netflix’s chaos monkey for Kubernetes clusters. It schedules randomly killing of pods in order to test fault tolerance of a highly available system.

Why

As a part of our charts development we needed a way to test the fault tolerance of our deployments.

How

Using chaoskube is a manual step we do after our weekly demos. The intended use case of chaoskube is to kill pods randomly at random times during a working day to test the ability to recover. The way we use it is a bit different, we manually launch chaoskube in debug mode and manually identify the weak points of our deployment.

Later, we intend to integrate it into our CI pipeline, so whenever new changes are rolled out we have a chaoskube run for that release.

Usage

The deploy_chaoskube.sh installs and unleashes chaoskube by scheduling a run 10m after installing chaoskube by default. It also sets up the needed service account and role if RBAC is enabled.

After you clone the charts repository, to install and unleash chaoskube, run:

scripts/deploy_chaoskube.sh up

Configuration

ChaosKube can be configured by editing the scripts/chaoskube-resources/values.yaml file. For more info read the official chaoskube docs.

You can also configure the deployment with flags on the script. To find all available options, run:

scripts/deploy_chaoskube.sh -h

Visit the README’s values section for a full list of options to pass via --set arguments.