Proxmox VE 7 replace zfs boot disk

Introduction Everything dies, even enterprise hardware. This is why having a failover is a good thing. I am running my Proxmox VE 7 servers with a mirrored ZFS root pool, so I can protect myself against a single drive dying and taking down a proxmox server. Today I received 8 SATADOM’s that I wanted to use for my boot drives intead of my SATA disks that were tiny and slow.
Read More…

Kubernetes simplified backup

Introduction Backup is important unless you like to spend a lot of time recreating what was lost - if possible. My kubernetes cluster is mostly stateless, with any state stored outside of the cluster on dedicated storage. So to facilitate backup of the cluster I initially started doing full machine backups of all nodes, but that seemed silly since I can recreate a node in 5-10 minutes with my PXE setup that boots and installs Rocky Linux plus all the required prequisites to allow the machine to work as a kubernetes node.
Read More…

Migrate VMWare ESXi Virtual machine to Proxmox VE 7.1

Introduction Migrating virtual machines between platforms can be a pain in the ass to put it mildly. I have recently decided to migrate from ESXi to Proxmox VE, simply because it allows me downscale my lab from several “BIG” machines into a single machine. I am well aware that this makes my lab more fragile and prone to failures, but that is a price I am willing to take - at least for now.
Read More…

Anacron email setup on CentOS 8/Rocky Linux 8

Introduction When you have a cron job that runs, then sometimes you want the cron process to send an email, in case something goes wrong or if you have set your cronjob to produce output. This happens automatically if your system is configured correctly, but if you like me just install a vanilla CentOS or Rocky and expect stuff like this to work, you have a couple of small extra tasks to perform.
Read More…

Proxmox Backup client on CentOS 8/Rocky Linux 8

Proxmox Backup Client Having recently installed Proxmox VE in my lab and also Proxmox Backup Server then I want to use it to backup as many machines as possible. This is easy for virtual machines running inside Proxmox VE, since its already integrated. But I also have physical machines running Rocky Linux & Centos 8, so this is a simple cook book to get it running on those two linux variants, since Proxmox does not provide pre-built packages.
Read More…

Exposing services outside of kubernetes with MetalLB load balancer

Introduction When you want whatever you host inside a kubernetes cluster to be accessible from the outside - that being either on the LAN or on the internet, then you need a way for traffic to flow into the cluster, hit the correct pods and preferably all in a nice HA way. There are several options you can use out of the box when you want to host services in a kubernetes cluster.
Read More…

Kubernetes installation on Rocky Linux 8.5 with Helm and Rancher

Prequisites Swap Swap when running containers is bad, since it can expose data from one container to another. So kubernetes refuses to run with it. So turn it off by doing: swapoff -a Edit /etc/fstab And comment out any swap partition so it looks like: #UUID=3d0751dd-102b-4941-9174-3c104ccc16c9 none swap defaults 0 0 Then run systemctl daemon-reload And reboot. Sometimes uncommenting the entry in fstab is not enough - and you need to actually delete the swap partition as well - otherwise “magic” in the kernel seems to detect a swap partition and mount it.
Read More…

Random static ip address in kickstart Rocky Linux 8.5

Reasoning DHCP is great if you really don’t care about the ip addresses you get for a given host - but if you want to modify the host to use a static ip address afterwards and you always do that after a kickstart installation, then its easier to just assign a “random” static ip address up front. The reason for this is that the network configuration when you run with DHCP is much simpler and when you want to switch to a static configuration you have to add a whole lot of options to the network configuration.
Read More…

Rancher cluster installation on Rocky Linux 8.5 on Dell Wyse 5070

Introduction After having struggled with getting docker+rancher to work properly - I finally have a range of docker machines running - and a single rancher cluster controller node running. Now comes the cluster installation which basically means joining all my wyse machines into the cluster, so they can be managed in a single place. Right now I just have a bunch of machines with a working docker installation, which is nice, but quite a management issue.
Read More…

Docker+Racher installation on Rocky Linux 8.5 on Dell Wyse 5070

Docker installation First we need to add the docker repository, so its possible to install docker packages. This is done by adding the repository via the command sudo dnf config-manager --add-repo=https://download.docker.com/linux/centos/docker-ce.repo sudo dnf update Then its possible to install the docker packages required: sudo dnf install containerd.io docker-ce docker-ce-cli When the installation has completed, then docker needs to be enabled by: sudo systemctl enable docker Kernel options It seems like when you install docker it also installs selinux - even though I explicitly deselected the package when installing Rocky Linux via my kickstart file.
Read More…