[ACTION REQUIRED] Upgraded cluster add-ons

The following updates have been rolled out to all clusters. As usual there’s improvements across various add-ons, ensuring enhanced performance and security. There’s possibly some actions required on your side regarding Grafana, so please read the entire post.

Actions to take

Grafana Prometheus datasource UID change

Due to an update how we provision Grafana datasources, it is possible that you will see error messages on your custom dashboards regarding the datasource not being found. If that is the case, you were most likely referencing the Prometheus datasource by UID. To fix this, make sure to change the datasource reference by name: Prometheus. In the json model of a dashboard, you can do this by replacing all instances of:

{
  "datasource": {
    "type": "prometheus",
    "uid": "A-LONG-STRING"
  }
}

with:

{
  "datasource": {
    "type": "prometheus",
    "name": "Prometheus"
  }
}

Grafana AngularJS deprecation (final call)

This is the last version of Grafana 11 we will deploy, planning to upgrade to Grafana 12 next month. As previously communicated, support for dashboardss using AngularJS based plugins will be removed in Grafana 12. As a result you can see warning messages in Grafana dashboards, helping you to identify which panels are using AngularJS plugins.

Grafana AngularJS dashboard warning

Many of our customers deploy their own custom dashboards, so we recommend you to check these for AngularJS plugin warnings and update them accordingly. For more information on how to do this, you can refer to the Grafana pages on this topic:

Often, you can just click the Try migration button in the warning and Grafana will auto-migrate your dashboard. After verifying the results, you can save your updated dashboard:

The most commonly used core plugins to change are Graph (old), Singlestat, Table (old), and Worldmap. While these can be auto-migrated, you can also update them to the newer versions, for example:

Some old custom plugins also have found there way as core plugins. For example you can replace grafana-piechart-panel with the build-in Pie Chart.

[!NOTE] While we have updated our own custom dashboards to use newer plugin versions, unfortunately there are a handfull of leftover dashboards, included in the upstream kube-prometheus-stack that we deploy and have not yet been updated. You can safely ignore the warnings for these dashboards for now. Affected dashboards are:

  • Alertmanager / Overview
  • Grafana / Overview