Docker Compose on K8s

Docker Compose is currently used by millions of developers and with over 650,000 Compose files on GitHub, Compose has been widely embraced by developers because it is a simple cloud and platform-agnostic way of defining multi-container based applications. Problem statement Today docker-compose is used on local development environments and in integration tests on physical Jenkins nodes. Moving almost everything to Kubernetes means that either we must make docker-compose work without hassle on the Kubernetes platform or agree upon another preferred way of working. Important to take into consideration are: Testability: Support for Ephemeral deploys. Simplicity: Hide complex and technical implementation details for developers behind a simple to use api with a lot of sensible default values. Because developers should focus on business logic and not build and deploy scaffolding. Because with an api as an abstraction layer on top we can be flexible and replace underlying implementations like Jenkins, docker-compose and kubernetes without developers having to make a change. Reproducibility: Make different environments as similar as possible to each other. Delivery speed: Provide a smooth and quick process from code commit to production. [Read More]
Docker  K8s 

Docker on K8s

Traditional docker engine in K8s is kaput, gone. We need to build docker images another way.

Different ways of building your docker containers in K8s without docker engine

Description Note
BuildKit DOCKER_BUILDKIT=1 docker build . -
Buildah and Podman Docker Compose in the K8s cloud developed by RedHat
kaniko Build container images from a Dockerfile, inside a container or Kubernetes cluster -
k3c Docker for Kubernetes (to use with k3s) -
Bazel Google’s generic build system. rules_docker can build Docker images, but equivalent of RUN instruction is intentionally omitted due to poor reproducibility no Dockerfile needed

Which one is the best?

  • Current recommendation is BuildKit or Kaniko.
Docker  K8s 

Development with K8s locally

Different ways to run “lightweight” K8s locally, and a basic measurement of how resource heavy it is. Kind kind creates local multi-node Kubernetes clusters using Docker container nodes. brew install kind kind create cluster kind delete cluster minikube brew install minikube minikube start minikube pause minikube delete k3d (k3s) krd is k3s in docker. k3s is the lightweight Kubernetes distribution by Rancher: rancher/k3s. brew install k3d k3d cluster create test k3d cluster delete Resource usage Resource usage when using docker and K8s. Docker settings: CPU 4, mem 4 GB, swap 1 GB image + (pod) CPU % Memory GB docker - 4 4,7 - 6.8 * redis 7 * * redis+mongo 9 * docker-desktop with K8s ca 20 k8s_XXX + (1 redis) 37 * * ca 20 k8s_XXX + (10 redis) 42 * * ca 20 k8s_XXX + (100 redis) 71 * docker with minikube + (1 redis) 50 (80 after one hour) * * gcr. [Read More]
Docker  K8s