Skip to main content

Grafana Alerts

Alerts can be created from the org’s Grafana instance. Refer to these instructions on how to create a Grafana managed alert.

Built-in Alert Rules

The Grafana instance accessed from the Metrics link of your workload includes several automatically provisioned objects, including built-in alert rules. These rules can send notifications to one or more preferred contact points, such as email. By default, notifications for these alerts are disabled. To receive notifications, add a contact point. For details, see the Grafana contact point documentation. You can find the built-in alert rules in your Grafana instance under Alerts > Alert rules:
  • container-restarts
    • This alert triggers if any of your workloads restart repeatedly. Specifically, it activates if the Control Plane custom metric container_restarts exceeds 1 within a 5 minute period.
  • stuck-deployments
    • This alert triggers if any of your deployments are stuck.
    • It checks for multiple container restarts within specific groups (GVC and workload). If any group exceeds one restart in the last 15 minutes, it triggers an alert.
To edit or create new alerts, go to the Alerts > Alert rules section in your Grafana instance. If you edit built-in alerts, your changes will be saved. However, if you delete any built-in alerts, they will be recreated automatically the next time you log in to Grafana. To disable built-in alerts, edit the corresponding alert rule and turn on the Pause evaluation toggle in the alert editing view.

Tags

Most Control Plane resources can be labeled with multiple key-value pairs called tags. Tags can be used throughout the UI and by other resources to query, filter, and select resources based on tag keys and values. Most resources include a Query option that opens a modal allowing you to filter the resources shown. Groups and policies can use queries to assign members and target resources dynamically, matching on tags, properties, or relations. The Match Tags By selector values are: To filter resources based on their tags:
  1. Click the Query button
  2. Select the match tag selector
  3. Enter a tag name, equality operator, and value. Click Add.
  4. Enter any additional tags
  5. Click Apply to display the filtered resources.
To remove the filter, click the Query button again and click Clear.