Spot termination alerts on Slack

We have updated the alert routing from k8s-spot-termination-handler to notify in our shared Slack channel to increase visibility. We’ve rolled this change out to all our clusters during the last couple of days.

The k8s-spot-termination-handler is used on clusters where spot instances are used for workers. Spot instances on EC2 come with significant cost savings, but with the burden of instance being terminated if the market price goes higher than the maximum price you have configured. The termination handler watches the AWS Metadata API for termination requests and starts draining the node so that it can be terminated safely.

You can get more information about our infrastructure monitoring and alerting in the documentation repository.