Improved monitoring for Kubernetes backups
We use Velero for automated backups of Kubernetes resources. Although we were scraping backup-related metrics into Prometheus, we hadn’t defined any automated alerts in case of backup failures.
More …Concourse upgraded to v6.6.0
We have upgraded our Concourse setups to the latest version 6.6.0 (from version 6.5.1).
More …Vault upgraded to 1.5.4
We have updated our Kubernetes based Vault setups to the latest version 1.5.4 in the past days.
Use the Vertical Pod Autoscaler to make your life easier and optimise cluster costs
As of today we offer the Vertical Pod Autoscaler as an optional component to your clusters.
More …Bugfix - Concourse workers out of disk space and crashing
We have identified a problem where our Concourse workers went unavailable. It turned out that the root EBS volume was filling up with logs too fast for the logrotation to take care of the archiving.
More …Kubernetes events now available in Loki
Next to your container logs, we now also ship Kubernetes events (kubectl get events -n <namespace>) to Grafana Loki. You can query these via {app="eventrouter", namespace="<mynamespace>"}.
Updated Teleport to version 4.3.5
We’ve updated all Teleport clusters and nodes to version 4.3.5. This is a major release, which includes a brand new UI. This should make Teleport in general easier to use, but more importantly the Audit Log is now also fully exposed through the UI.
More …Grafana main dashboard updated
We’ve added a Grafana dashboard called Overview with a new dashboard that contains all relevant info from your cluster. We’ve made this dashboard the default for Grafana to replace the default home page of Grafana. This change will be rolled out during the next release.
Concourse upgraded to v6.5.1
We have upgraded our Concourse setups to the latest version 6.5.1 (from version 6.4.0).
More …Vault upgraded to 1.5.3
We have updated our Kubernetes based Vault setups to the latest version 1.5.3.
Feature: NodeLocal DNSCache
We’re happy to announce we now support NodeLocal DNSCache on our managed clusters for those that need the performance improvements it provides. This also resolves issues around conntrack tables filling up on some cluster’s nodes.
More …Upgraded several cluster components
As part of our regular upgrade cycle, the following Kubernetes cluster components have been updated. We’ve already rolled these out to all staging clusters. Production clusters will follow in the coming days.
More …Monitoring for External-DNS
We have enabled the ServiceMonitor for External-DNS and added new alerts for it. You can find these alerts here.
Disable Nginx server token
As part of our ongoing security audits we noticed Nginx ingress’s server token of our Kubernetes clusters is enabled (which is the default configuration). This leads to exposing Nginx version in the HTTP headers. We have decided to disable it as recommended, no further actions are required from your side, we went ahead and already disabled it for all of the staging clusters, and production clusters will follow by the beginning of next week.
Updates for addons
We have updated the following components on our Kubernetes clusters:
More …Concourse upgraded to v6.4.0
We have upgraded our Concourse setups to the latest version 6.4.0 (from version 6.2.0).
More …Vault upgraded to 1.5.0
We have updated our Kubernetes based Vault setups from 1.4.2 to the latest version 1.5.0.
Upgrade EKS to 1.17
With the major K8s 1.16 from last month just behind us, we now have updated our EKS control planes and nodes to the latest supported version: 1.17. This brings EKS on K8s v1.17.6.
Support Loki log-based alerting and metrics in Grafana
It’s now possible to use Loki log metrics in standard Grafana panels (i.e. gauges, simple graphs, bar graphs, etc.). Additionally, you can also create alerts based on those graphs, with the built-in alerting system in Grafana.
More …Updated docker images
We have updated the docker images that we internally use. We have made the following changes:
More …