Using *acme-dns.io* is incredibly cumbersome. Since each unique subdomain requires its own set of credentials, the `acme-dns.json` file has to be updated every time a new certificate is added. This effectively precludes creating certificates via Ingress annotations. As Cloudflare's DNS service is free and anonymous as well, I thought I would try it out as an alternative to *acme-dns.io*. It seems to work well so far. One potential issue, though, is Cloudflare seems to have several nameservers, with multiple IP addresses each. This may require adding quite a few exceptions to the no-outbound-DNS rule on the firewall. I tried using the "recursive servers only" mode of *cert-manager*, however, as expected, the recursive servers all cache too aggressively. Since the negative cache TTL value in the SOA record for Cloudflare DNS zones is set to 1 hour and cannot be configured, ACME challenges can take at least that long in this mode. Thus, querying the authoritative servers directly is indeed the best option, even though it violates the no-outbound-DNS rule. |
||
---|---|---|
authelia | ||
autoscaler | ||
cert-manager | ||
docker-distribution | ||
dynk8s-provisioner | ||
hudctrl | ||
ingress | ||
jenkins | ||
kitchen | ||
metrics | ||
ntfy | ||
paperless-ngx | ||
phpipam | ||
prometheus_speedtest | ||
scanservjs | ||
setup | ||
storage | ||
README.md |
README.md
Dustin's Kubernetes Cluster
This repository contains resources for deploying and managing my on-premises Kubernetes cluster
Cluster Setup
The cluster primarily consists of libvirt/QEMU+KVM virtual machines. The Control Plane nodes are VMs, as are the x86_64 worker nodes. Eventually, I would like to add Raspberry Pi or Pine64 machines as aarch64 nodes.
All machines run Fedora, using only Fedora builds of the Kubernetes components
(kubeadm
, kubectl
, and kubeadm
).
See Cluster Setup for details.
Jenkins Agents
One of the main use cases for the Kubernetes cluster is to provide dynamic agents for Jenkins. Using the Kubernetes Plugin, Jenkins will automatically launch worker nodes as Kubernetes pods.
See Jenkins Kubernetes Integration for details.
Persistent Storage
Persistent storage for pods is provided by Longhorn. Longhorn runs within the cluster and provisions storage on worker nodes to make available to pods over iSCSI.
See Persistent Storage Using Longorn for details.