mirror of
https://github.com/bitnami/charts.git
synced 2026-03-06 23:47:48 +08:00
[bitnami/thanos] Add Configurability for runbookUrl Parameter (#21628)
* Override runbook_url Signed-off-by: Kaio Cunha <kaiohsdc@gmail.com> * Update absent_rules.yml Signed-off-by: Kaio Cunha <kaiohsdc@gmail.com> Signed-off-by: kaio-cunha <kaio.cunha@hp.com> * Update values.yaml Signed-off-by: Kaio Cunha <kaiohsdc@gmail.com> Signed-off-by: kaio-cunha <kaio.cunha@hp.com> * runbookUrl parameter Signed-off-by: kaio-cunha <kaio.cunha@hp.com> * runbookUrl parameter Signed-off-by: kaio-cunha <kaio.cunha@hp.com> * update Signed-off-by: kaio-cunha <kaio.cunha@hp.com> * updated readme Signed-off-by: kaio-cunha <kaio.cunha@hp.com> * Update README.md with readme-generator-for-helm Signed-off-by: Bitnami Containers <bitnami-bot@vmware.com> Signed-off-by: kaio-cunha <kaio.cunha@hp.com> * updated readme Signed-off-by: kaio-cunha <kaio.cunha@hp.com> * Update README.md with readme-generator-for-helm Signed-off-by: Bitnami Containers <bitnami-bot@vmware.com> Signed-off-by: kaio-cunha <kaio.cunha@hp.com> * updated templates Signed-off-by: kaio-cunha <kaio.cunha@hp.com> --------- Signed-off-by: Kaio Cunha <kaiohsdc@gmail.com> Signed-off-by: kaio-cunha <kaio.cunha@hp.com> Signed-off-by: Bitnami Containers <bitnami-bot@vmware.com> Signed-off-by: Fran de Paz Galán <fran.de-paz@broadcom.com> Co-authored-by: kaio-cunha <kaio.cunha@hp.com> Co-authored-by: Bitnami Containers <bitnami-bot@vmware.com> Co-authored-by: Fran de Paz Galán <fran.de-paz@broadcom.com>
This commit is contained in:
@@ -35,4 +35,4 @@ maintainers:
|
||||
name: thanos
|
||||
sources:
|
||||
- https://github.com/bitnami/charts/tree/main/bitnami/thanos
|
||||
version: 12.19.1
|
||||
version: 12.20.0
|
||||
@@ -1134,80 +1134,81 @@ Check the section [Integrate Thanos with Prometheus and Alertmanager](#integrate
|
||||
|
||||
### Metrics parameters
|
||||
|
||||
| Name | Description | Value |
|
||||
| --------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------- | -------------------- |
|
||||
| `metrics.enabled` | Enable the export of Prometheus metrics | `false` |
|
||||
| `metrics.serviceMonitor.enabled` | Specify if a ServiceMonitor will be deployed for Prometheus Operator | `false` |
|
||||
| `metrics.serviceMonitor.namespace` | Namespace in which Prometheus is running | `""` |
|
||||
| `metrics.serviceMonitor.labels` | Extra labels for the ServiceMonitor | `{}` |
|
||||
| `metrics.serviceMonitor.jobLabel` | The name of the label on the target service to use as the job name in Prometheus | `""` |
|
||||
| `metrics.serviceMonitor.interval` | How frequently to scrape metrics | `""` |
|
||||
| `metrics.serviceMonitor.scrapeTimeout` | Timeout after which the scrape is ended | `""` |
|
||||
| `metrics.serviceMonitor.metricRelabelings` | Specify additional relabeling of metrics | `[]` |
|
||||
| `metrics.serviceMonitor.relabelings` | Specify general relabeling | `[]` |
|
||||
| `metrics.serviceMonitor.selector` | Prometheus instance selector labels | `{}` |
|
||||
| `metrics.serviceMonitor.extraParameters` | Any extra parameter to be added to the endpoint configured in the ServiceMonitor | `{}` |
|
||||
| `metrics.prometheusRule.enabled` | If `true`, creates a Prometheus Operator PrometheusRule (also requires `metrics.enabled` to be `true`) | `false` |
|
||||
| `metrics.prometheusRule.default.absent_rules` | Enable absent_rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.compaction` | Enable compaction rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.query` | Enable query when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.receive` | Enable receive rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.replicate` | Enable replicate rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.ruler` | Enable ruler rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.sidecar` | Enable sidecar rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.sidecarJobRegex` | Allows the customization of the thanos-sidecar job name to use in the sidecar prometheus alerts | `.*thanos-sidecar.*` |
|
||||
| `metrics.prometheusRule.default.store_gateway` | Enable store_gateway rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.create` | would create all default prometheus alerts | `false` |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosCompactIsDown` | Disable ThanosCompactIsDown rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.absent_rules is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryIsDown` | Disable ThanosQueryIsDown rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.absent_rules is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveIsDown` | Disable ThanosReceiveIsDown rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.absent_rules is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleIsDown` | Disable ThanosRuleIsDown rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.absent_rules is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosSidecarIsDown` | Disable ThanosSidecarIsDown rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.absent_rules is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosStoreIsDown` | Disable ThanosStoreIsDown rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.absent_rules is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosCompactMultipleRunning` | Disable ThanosCompactMultipleRunning rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.compaction is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosCompactHalted` | Disable ThanosCompactMultipleRunning rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.compaction is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosCompactHighCompactionFailures` | Disable ThanosCompactMultipleRunning rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.compaction is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosCompactBucketHighOperationFailures` | Disable ThanosCompactMultipleRunning rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.compaction is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosCompactHasNotRun` | Disable ThanosCompactMultipleRunning rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.compaction is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryHttpRequestQueryErrorRateHigh` | Disable ThanosQueryHttpRequestQueryErrorRateHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryHttpRequestQueryRangeErrorRateHigh` | Disable ThanosQueryHttpRequestQueryRangeErrorRateHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryGrpcServerErrorRate` | Disable ThanosQueryGrpcServerErrorRate rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryGrpcClientErrorRate` | Disable ThanosQueryGrpcClientErrorRate rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryHighDNSFailures` | Disable ThanosQueryHighDNSFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryInstantLatencyHigh` | Disable ThanosQueryInstantLatencyHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryRangeLatencyHigh` | Disable ThanosQueryRangeLatencyHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryOverload` | Disable ThanosQueryOverload rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveHttpRequestErrorRateHigh` | Disable ThanosReceiveHttpRequestErrorRateHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveHttpRequestLatencyHigh` | Disable ThanosReceiveHttpRequestLatencyHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveHighReplicationFailures` | Disable ThanosReceiveHighReplicationFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveHighForwardRequestFailures` | Disable ThanosReceiveHighForwardRequestFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveHighHashringFileRefreshFailures` | Disable ThanosReceiveHighHashringFileRefreshFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveConfigReloadFailure` | Disable ThanosReceiveConfigReloadFailure rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveNoUpload` | Disable ThanosReceiveNoUpload rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveTrafficBelowThreshold` | Disable ThanosReceiveTrafficBelowThreshold rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosBucketReplicateErrorRate` | Disable ThanosBucketReplicateErrorRate rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosBucketReplicateRunLatency` | Disable ThanosBucketReplicateRunLatency rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleQueueIsDroppingAlerts` | Disable ThanosRuleQueueIsDroppingAlerts rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleSenderIsFailingAlerts` | Disable ThanosRuleSenderIsFailingAlerts rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleHighRuleEvaluationFailures` | Disable ThanosRuleHighRuleEvaluationFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleHighRuleEvaluationWarnings` | Disable ThanosRuleHighRuleEvaluationWarnings rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleRuleEvaluationLatencyHigh` | Disable ThanosRuleRuleEvaluationLatencyHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleGrpcErrorRate` | Disable ThanosRuleGrpcErrorRate rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleConfigReloadFailure` | Disable ThanosRuleConfigReloadFailure rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleQueryHighDNSFailures` | Disable ThanosRuleQueryHighDNSFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleAlertmanagerHighDNSFailures` | Disable ThanosRuleAlertmanagerHighDNSFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleNoEvaluationFor10Intervals` | Disable ThanosRuleNoEvaluationFor10Intervals rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosNoRuleEvaluations` | Disable ThanosNoRuleEvaluations rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosSidecarBucketOperationsFailed` | Disable ThanosSidecarBucketOperationsFailed rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.sidecar is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosSidecarNoConnectionToStartedPrometheus` | Disable ThanosSidecarNoConnectionToStartedPrometheus rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.sidecar is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosStoreGrpcErrorRate` | Disable ThanosSidecarNoConnectionToStartedPrometheus rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.store_gateway is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosStoreSeriesGateLatencyHigh` | Disable ThanosStoreSeriesGateLatencyHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.store_gateway is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosStoreBucketHighOperationFailures` | Disable ThanosStoreBucketHighOperationFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.store_gateway is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosStoreObjstoreOperationLatencyHigh` | Disable ThanosStoreObjstoreOperationLatencyHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.store_gateway is true | |
|
||||
| `metrics.prometheusRule.default.disabled` | disable one specific prometheus alert rule | `{}` |
|
||||
| `metrics.prometheusRule.namespace` | Namespace in which the PrometheusRule CRD is created | `""` |
|
||||
| `metrics.prometheusRule.additionalLabels` | Additional labels for the prometheusRule | `{}` |
|
||||
| `metrics.prometheusRule.groups` | Prometheus Rule Groups for Thanos components | `[]` |
|
||||
| Name | Description | Value |
|
||||
| --------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------- |
|
||||
| `metrics.enabled` | Enable the export of Prometheus metrics | `false` |
|
||||
| `metrics.serviceMonitor.enabled` | Specify if a ServiceMonitor will be deployed for Prometheus Operator | `false` |
|
||||
| `metrics.serviceMonitor.namespace` | Namespace in which Prometheus is running | `""` |
|
||||
| `metrics.serviceMonitor.labels` | Extra labels for the ServiceMonitor | `{}` |
|
||||
| `metrics.serviceMonitor.jobLabel` | The name of the label on the target service to use as the job name in Prometheus | `""` |
|
||||
| `metrics.serviceMonitor.interval` | How frequently to scrape metrics | `""` |
|
||||
| `metrics.serviceMonitor.scrapeTimeout` | Timeout after which the scrape is ended | `""` |
|
||||
| `metrics.serviceMonitor.metricRelabelings` | Specify additional relabeling of metrics | `[]` |
|
||||
| `metrics.serviceMonitor.relabelings` | Specify general relabeling | `[]` |
|
||||
| `metrics.serviceMonitor.selector` | Prometheus instance selector labels | `{}` |
|
||||
| `metrics.serviceMonitor.extraParameters` | Any extra parameter to be added to the endpoint configured in the ServiceMonitor | `{}` |
|
||||
| `metrics.prometheusRule.enabled` | If `true`, creates a Prometheus Operator PrometheusRule (also requires `metrics.enabled` to be `true`) | `false` |
|
||||
| `metrics.prometheusRule.default.absent_rules` | Enable absent_rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.compaction` | Enable compaction rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.query` | Enable query when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.receive` | Enable receive rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.replicate` | Enable replicate rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.ruler` | Enable ruler rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.sidecar` | Enable sidecar rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.sidecarJobRegex` | Allows the customization of the thanos-sidecar job name to use in the sidecar prometheus alerts | `.*thanos-sidecar.*` |
|
||||
| `metrics.prometheusRule.default.store_gateway` | Enable store_gateway rules when metrics.prometheusRule.default.create is false (also requires `metrics.enabled` to be `true`) | |
|
||||
| `metrics.prometheusRule.default.create` | would create all default prometheus alerts | `false` |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosCompactIsDown` | Disable ThanosCompactIsDown rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.absent_rules is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryIsDown` | Disable ThanosQueryIsDown rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.absent_rules is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveIsDown` | Disable ThanosReceiveIsDown rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.absent_rules is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleIsDown` | Disable ThanosRuleIsDown rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.absent_rules is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosSidecarIsDown` | Disable ThanosSidecarIsDown rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.absent_rules is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosStoreIsDown` | Disable ThanosStoreIsDown rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.absent_rules is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosCompactMultipleRunning` | Disable ThanosCompactMultipleRunning rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.compaction is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosCompactHalted` | Disable ThanosCompactMultipleRunning rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.compaction is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosCompactHighCompactionFailures` | Disable ThanosCompactMultipleRunning rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.compaction is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosCompactBucketHighOperationFailures` | Disable ThanosCompactMultipleRunning rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.compaction is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosCompactHasNotRun` | Disable ThanosCompactMultipleRunning rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.compaction is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryHttpRequestQueryErrorRateHigh` | Disable ThanosQueryHttpRequestQueryErrorRateHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryHttpRequestQueryRangeErrorRateHigh` | Disable ThanosQueryHttpRequestQueryRangeErrorRateHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryGrpcServerErrorRate` | Disable ThanosQueryGrpcServerErrorRate rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryGrpcClientErrorRate` | Disable ThanosQueryGrpcClientErrorRate rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryHighDNSFailures` | Disable ThanosQueryHighDNSFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryInstantLatencyHigh` | Disable ThanosQueryInstantLatencyHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryRangeLatencyHigh` | Disable ThanosQueryRangeLatencyHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosQueryOverload` | Disable ThanosQueryOverload rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.query is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveHttpRequestErrorRateHigh` | Disable ThanosReceiveHttpRequestErrorRateHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveHttpRequestLatencyHigh` | Disable ThanosReceiveHttpRequestLatencyHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveHighReplicationFailures` | Disable ThanosReceiveHighReplicationFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveHighForwardRequestFailures` | Disable ThanosReceiveHighForwardRequestFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveHighHashringFileRefreshFailures` | Disable ThanosReceiveHighHashringFileRefreshFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveConfigReloadFailure` | Disable ThanosReceiveConfigReloadFailure rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveNoUpload` | Disable ThanosReceiveNoUpload rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosReceiveTrafficBelowThreshold` | Disable ThanosReceiveTrafficBelowThreshold rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosBucketReplicateErrorRate` | Disable ThanosBucketReplicateErrorRate rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosBucketReplicateRunLatency` | Disable ThanosBucketReplicateRunLatency rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.receive is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleQueueIsDroppingAlerts` | Disable ThanosRuleQueueIsDroppingAlerts rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleSenderIsFailingAlerts` | Disable ThanosRuleSenderIsFailingAlerts rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleHighRuleEvaluationFailures` | Disable ThanosRuleHighRuleEvaluationFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleHighRuleEvaluationWarnings` | Disable ThanosRuleHighRuleEvaluationWarnings rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleRuleEvaluationLatencyHigh` | Disable ThanosRuleRuleEvaluationLatencyHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleGrpcErrorRate` | Disable ThanosRuleGrpcErrorRate rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleConfigReloadFailure` | Disable ThanosRuleConfigReloadFailure rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleQueryHighDNSFailures` | Disable ThanosRuleQueryHighDNSFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleAlertmanagerHighDNSFailures` | Disable ThanosRuleAlertmanagerHighDNSFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosRuleNoEvaluationFor10Intervals` | Disable ThanosRuleNoEvaluationFor10Intervals rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosNoRuleEvaluations` | Disable ThanosNoRuleEvaluations rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.ruler is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosSidecarBucketOperationsFailed` | Disable ThanosSidecarBucketOperationsFailed rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.sidecar is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosSidecarNoConnectionToStartedPrometheus` | Disable ThanosSidecarNoConnectionToStartedPrometheus rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.sidecar is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosStoreGrpcErrorRate` | Disable ThanosSidecarNoConnectionToStartedPrometheus rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.store_gateway is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosStoreSeriesGateLatencyHigh` | Disable ThanosStoreSeriesGateLatencyHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.store_gateway is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosStoreBucketHighOperationFailures` | Disable ThanosStoreBucketHighOperationFailures rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.store_gateway is true | |
|
||||
| `metrics.prometheusRule.default.disabled.ThanosStoreObjstoreOperationLatencyHigh` | Disable ThanosStoreObjstoreOperationLatencyHigh rule when metrics.prometheusRule.default.create or metrics.prometheusRule.default.store_gateway is true | |
|
||||
| `metrics.prometheusRule.default.disabled` | disable one specific prometheus alert rule | `{}` |
|
||||
| `metrics.prometheusRule.runbookUrl` | Prefix for runbook URLs. Use this to override the first part of the runbookURLs that is common to all rules | `https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-` |
|
||||
| `metrics.prometheusRule.namespace` | Namespace in which the PrometheusRule CRD is created | `""` |
|
||||
| `metrics.prometheusRule.additionalLabels` | Additional labels for the prometheusRule | `{}` |
|
||||
| `metrics.prometheusRule.groups` | Prometheus Rule Groups for Thanos components | `[]` |
|
||||
|
||||
### Volume Permissions parameters
|
||||
|
||||
|
||||
@@ -30,7 +30,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: ThanosCompact has disappeared. Prometheus target for the component cannot be discovered.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanoscompactisdown
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanoscompactisdown
|
||||
summary: Thanos component has disappeared.
|
||||
expr: |
|
||||
absent(up{job=~".*thanos-compact.*"} == 1)
|
||||
@@ -48,7 +48,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: ThanosQuery has disappeared. Prometheus target for the component cannot be discovered.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosqueryisdown
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosqueryisdown
|
||||
summary: Thanos component has disappeared.
|
||||
expr: |
|
||||
absent(up{job=~".*thanos-query.*"} == 1)
|
||||
@@ -66,7 +66,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: ThanosReceive has disappeared. Prometheus target for the component cannot be discovered.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosreceiveisdown
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosreceiveisdown
|
||||
summary: Thanos component has disappeared.
|
||||
expr: |
|
||||
absent(up{job=~".*thanos-receive.*"} == 1)
|
||||
@@ -84,7 +84,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: ThanosRule has disappeared. Prometheus target for the component cannot be discovered.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosruleisdown
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosruleisdown
|
||||
summary: Thanos component has disappeared.
|
||||
expr: |
|
||||
absent(up{job=~".*thanos-rule.*"} == 1)
|
||||
@@ -102,7 +102,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: ThanosSidecar has disappeared. Prometheus target for the component cannot be discovered.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanossidecarisdown
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanossidecarisdown
|
||||
summary: Thanos component has disappeared.
|
||||
expr: |
|
||||
absent(up{job=~"{{ .Values.metrics.prometheusRule.default.sidecarJobRegex }}"} == 1)
|
||||
@@ -120,7 +120,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: ThanosStore has disappeared. Prometheus target for the component cannot be discovered.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosstoreisdown
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosstoreisdown
|
||||
summary: Thanos component has disappeared.
|
||||
expr: |
|
||||
absent(up{job=~".*thanos-store.*"} == 1)
|
||||
|
||||
@@ -30,7 +30,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: No more than one Thanos Compact instance should be running at once. There are {{`{{`}} $value {{`}}`}} instances running.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanoscompactmultiplerunning
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanoscompactmultiplerunning
|
||||
summary: Thanos Compact has multiple instances running.
|
||||
expr: sum by (job) (up{job=~".*thanos-compact.*"}) > 1
|
||||
for: 5m
|
||||
@@ -47,7 +47,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Compact {{`{{`}} $labels.job {{`}}`}} has failed to run and now is halted.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanoscompacthalted
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanoscompacthalted
|
||||
summary: Thanos Compact has failed to run and is now halted.
|
||||
expr: thanos_compact_halted{job=~".*thanos-compact.*"} == 1
|
||||
for: 5m
|
||||
@@ -64,7 +64,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Compact {{`{{`}} $labels.job {{`}}`}} is failing to execute {{`{{`}} $value | humanize {{`}}`}}% of compactions.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanoscompacthighcompactionfailures
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanoscompacthighcompactionfailures
|
||||
summary: Thanos Compact is failing to execute compactions.
|
||||
expr: |
|
||||
(
|
||||
@@ -87,7 +87,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Compact {{`{{`}} $labels.job {{`}}`}} Bucket is failing to execute {{`{{`}} $value | humanize {{`}}`}}% of operations.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanoscompactbuckethighoperationfailures
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanoscompactbuckethighoperationfailures
|
||||
summary: Thanos Compact Bucket is having a high number of operation failures.
|
||||
expr: |
|
||||
(
|
||||
@@ -110,7 +110,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Compact {{`{{`}} $labels.job {{`}}`}} has not uploaded anything for 24 hours.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanoscompacthasnotrun
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanoscompacthasnotrun
|
||||
summary: Thanos Compact has not uploaded anything for last 24 hours.
|
||||
expr: (time() - max by (job) (max_over_time(thanos_objstore_bucket_last_successful_upload_time{job=~".*thanos-compact.*"}[24h]))) / 60 / 60 > 24
|
||||
labels:
|
||||
|
||||
@@ -30,7 +30,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Query {{`{{`}} $labels.job {{`}}`}} is failing to handle {{`{{`}} $value | humanize {{`}}`}}% of "query" requests.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosqueryhttprequestqueryerrorratehigh
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosqueryhttprequestqueryerrorratehigh
|
||||
summary: Thanos Query is failing to handle requests.
|
||||
expr: |
|
||||
(
|
||||
@@ -52,7 +52,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Query {{`{{`}} $labels.job {{`}}`}} is failing to handle {{`{{`}} $value | humanize {{`}}`}}% of "query_range" requests.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosqueryhttprequestqueryrangeerrorratehigh
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosqueryhttprequestqueryrangeerrorratehigh
|
||||
summary: Thanos Query is failing to handle requests.
|
||||
expr: |
|
||||
(
|
||||
@@ -74,7 +74,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Query {{`{{`}} $labels.job {{`}}`}} is failing to handle {{`{{`}} $value | humanize {{`}}`}}% of requests.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosquerygrpcservererrorrate
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosquerygrpcservererrorrate
|
||||
summary: Thanos Query is failing to handle requests.
|
||||
expr: |
|
||||
(
|
||||
@@ -97,7 +97,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Query {{`{{`}} $labels.job {{`}}`}} is failing to send {{`{{`}} $value | humanize {{`}}`}}% of requests.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosquerygrpcclienterrorrate
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosquerygrpcclienterrorrate
|
||||
summary: Thanos Query is failing to send requests.
|
||||
expr: |
|
||||
(
|
||||
@@ -119,7 +119,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Query {{`{{`}} $labels.job {{`}}`}} have {{`{{`}} $value | humanize{{`}}`}}% of failing DNS queries for store endpoints.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosqueryhighdnsfailures
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosqueryhighdnsfailures
|
||||
summary: Thanos Query is having high number of DNS failures.
|
||||
expr: |
|
||||
(
|
||||
@@ -141,7 +141,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Query {{`{{`}} $labels.job {{`}}`}} has a 99th percentile latency of {{`{{`}} $value {{`}}`}} seconds for instant queries.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosqueryinstantlatencyhigh
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosqueryinstantlatencyhigh
|
||||
summary: Thanos Query has high latency for queries.
|
||||
expr: |
|
||||
(
|
||||
@@ -163,7 +163,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Query {{`{{`}} $labels.job {{`}}`}} has a 99th percentile latency of {{`{{`}} $value {{`}}`}} seconds for range queries.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosqueryrangelatencyhigh
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosqueryrangelatencyhigh
|
||||
summary: Thanos Query has high latency for queries.
|
||||
expr: |
|
||||
(
|
||||
@@ -185,7 +185,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Query {{`{{`}} $labels.job {{`}}`}} has been overloaded for more than 15 minutes. This may be a symptom of excessive simultanous complex requests, low performance of the Prometheus API, or failures within these components. Assess the health of the Thanos query instances, the connnected Prometheus instances, look for potential senders of these requests and then contact support.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosqueryoverload
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosqueryoverload
|
||||
summary: Thanos query reaches its maximum capacity serving concurrent requests.
|
||||
expr: |
|
||||
(
|
||||
|
||||
@@ -30,7 +30,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Receive {{`{{`}} $labels.job {{`}}`}} is failing to handle {{`{{`}} $value | humanize {{`}}`}}% of requests.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosreceivehttprequesterrorratehigh
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosreceivehttprequesterrorratehigh
|
||||
summary: Thanos Receive is failing to handle requests.
|
||||
expr: |
|
||||
(
|
||||
@@ -52,7 +52,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Receive {{`{{`}} $labels.job {{`}}`}} has a 99th percentile latency of {{`{{`}} $value {{`}}`}} seconds for requests.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosreceivehttprequestlatencyhigh
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosreceivehttprequestlatencyhigh
|
||||
summary: Thanos Receive has high HTTP requests latency.
|
||||
expr: |
|
||||
(
|
||||
@@ -74,7 +74,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Receive {{`{{`}} $labels.job {{`}}`}} is failing to replicate {{`{{`}} $value | humanize {{`}}`}}% of requests.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosreceivehighreplicationfailures
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosreceivehighreplicationfailures
|
||||
summary: Thanos Receive is having high number of replication failures.
|
||||
expr: |
|
||||
thanos_receive_replication_factor > 1
|
||||
@@ -106,7 +106,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Receive {{`{{`}} $labels.job {{`}}`}} is failing to forward {{`{{`}} $value | humanize {{`}}`}}% of requests.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosreceivehighforwardrequestfailures
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosreceivehighforwardrequestfailures
|
||||
summary: Thanos Receive is failing to forward requests.
|
||||
expr: |
|
||||
(
|
||||
@@ -128,7 +128,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Receive {{`{{`}} $labels.job {{`}}`}} is failing to refresh hashring file, {{`{{`}} $value | humanize {{`}}`}} of attempts failed.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosreceivehighhashringfilerefreshfailures
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosreceivehighhashringfilerefreshfailures
|
||||
summary: Thanos Receive is failing to refresh hasring file.
|
||||
expr: |
|
||||
(
|
||||
@@ -151,7 +151,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Receive {{`{{`}} $labels.job {{`}}`}} has not been able to reload hashring configurations.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosreceiveconfigreloadfailure
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosreceiveconfigreloadfailure
|
||||
summary: Thanos Receive has not been able to reload configuration.
|
||||
expr: avg by (job) (thanos_receive_config_last_reload_successful{job=~".*thanos-receive.*"}) != 1
|
||||
for: 5m
|
||||
@@ -168,7 +168,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Receive {{`{{`}} $labels.instance {{`}}`}} has not uploaded latest data to object storage.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosreceivenoupload
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosreceivenoupload
|
||||
summary: Thanos Receive has not uploaded latest data to object storage.
|
||||
expr: |
|
||||
(up{job=~".*thanos-receive.*"} - 1)
|
||||
@@ -188,7 +188,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: At Thanos Receive {{`{{`}} $labels.job {{`}}`}} in {{`{{`}} $labels.namespace {{`}}`}} , the average 1-hr avg. metrics ingestion rate is {{`{{`}} $value | humanize {{`}}`}}% of 12-hr avg. ingestion rate.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosreceivetrafficbelowthreshold
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosreceivetrafficbelowthreshold
|
||||
summary: Thanos Receive is experiencing low avg. 1-hr ingestion rate relative to avg. 12-hr ingestion rate.
|
||||
expr: |
|
||||
(
|
||||
|
||||
@@ -30,7 +30,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Replicate is failing to run, {{`{{`}} $value | humanize {{`}}`}}% of attempts failed.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosbucketreplicateerrorrate
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosbucketreplicateerrorrate
|
||||
summary: Thanos Replicate is failing to run.
|
||||
expr: |
|
||||
(
|
||||
@@ -52,7 +52,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Replicate {{`{{`}} $labels.job {{`}}`}} has a 99th percentile latency of {{`{{`}} $value {{`}}`}} seconds for the replicate operations.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosbucketreplicaterunlatency
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosbucketreplicaterunlatency
|
||||
summary: Thanos Replicate has a high latency for replicate operations.
|
||||
expr: |
|
||||
(
|
||||
|
||||
@@ -30,7 +30,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Rule {{`{{`}} $labels.instance {{`}}`}} is failing to queue alerts.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosrulequeueisdroppingalerts
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosrulequeueisdroppingalerts
|
||||
summary: Thanos Rule is failing to queue alerts.
|
||||
expr: |
|
||||
sum by (job, instance) (rate(thanos_alert_queue_alerts_dropped_total{job=~".*thanos-rule.*"}[5m])) > 0
|
||||
@@ -48,7 +48,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Rule {{`{{`}} $labels.instance {{`}}`}} is failing to send alerts to alertmanager.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosrulesenderisfailingalerts
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosrulesenderisfailingalerts
|
||||
summary: Thanos Rule is failing to send alerts to alertmanager.
|
||||
expr: |
|
||||
sum by (job, instance) (rate(thanos_alert_sender_alerts_dropped_total{job=~".*thanos-rule.*"}[5m])) > 0
|
||||
@@ -66,7 +66,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Rule {{`{{`}} $labels.instance {{`}}`}} is failing to evaluate rules.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosrulehighruleevaluationfailures
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosrulehighruleevaluationfailures
|
||||
summary: Thanos Rule is failing to evaluate rules.
|
||||
expr: |
|
||||
(
|
||||
@@ -89,7 +89,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Rule {{`{{`}} $labels.instance {{`}}`}} has high number of evaluation warnings.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosrulehighruleevaluationwarnings
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosrulehighruleevaluationwarnings
|
||||
summary: Thanos Rule has high number of evaluation warnings.
|
||||
expr: |
|
||||
sum by (job, instance) (rate(thanos_rule_evaluation_with_warnings_total{job=~".*thanos-rule.*"}[5m])) > 0
|
||||
@@ -107,7 +107,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Rule {{`{{`}} $labels.instance {{`}}`}} has higher evaluation latency than interval for {{`{{`}} $labels.rule_group {{`}}`}}.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosruleruleevaluationlatencyhigh
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosruleruleevaluationlatencyhigh
|
||||
summary: Thanos Rule has high rule evaluation latency.
|
||||
expr: |
|
||||
(
|
||||
@@ -129,7 +129,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Rule {{`{{`}} $labels.job {{`}}`}} is failing to handle {{`{{`}} $value | humanize {{`}}`}}% of requests.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosrulegrpcerrorrate
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosrulegrpcerrorrate
|
||||
summary: Thanos Rule is failing to handle grpc requests.
|
||||
expr: |
|
||||
(
|
||||
@@ -152,7 +152,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Rule {{`{{`}} $labels.job {{`}}`}} has not been able to reload its configuration.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosruleconfigreloadfailure
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosruleconfigreloadfailure
|
||||
summary: Thanos Rule has not been able to reload configuration.
|
||||
expr: avg by (job, instance) (thanos_rule_config_last_reload_successful{job=~".*thanos-rule.*"}) != 1
|
||||
for: 5m
|
||||
@@ -169,7 +169,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Rule {{`{{`}} $labels.job {{`}}`}} has {{`{{`}} $value | humanize{{`}}`}}% of failing DNS queries for query endpoints.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosrulequeryhighdnsfailures
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosrulequeryhighdnsfailures
|
||||
summary: Thanos Rule is having high number of DNS failures.
|
||||
expr: |
|
||||
(
|
||||
@@ -192,7 +192,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Rule {{`{{`}} $labels.instance{{`}}`}} has {{`{{`}} $value | humanize {{`}}`}}% of failing DNS queries for Alertmanager endpoints.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosrulealertmanagerhighdnsfailures
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosrulealertmanagerhighdnsfailures
|
||||
summary: Thanos Rule is having high number of DNS failures.
|
||||
expr: |
|
||||
(
|
||||
@@ -215,7 +215,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Rule {{`{{`}} $labels.job {{`}}`}} has rule groups that did not evaluate for at least 10x of their expected interval.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosrulenoevaluationfor10intervals
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosrulenoevaluationfor10intervals
|
||||
summary: Thanos Rule has rule groups that did not evaluate for 10 intervals.
|
||||
expr: |
|
||||
time() - max by (job, instance, group) (prometheus_rule_group_last_evaluation_timestamp_seconds{job=~".*thanos-rule.*"})
|
||||
@@ -235,7 +235,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Rule {{`{{`}} $labels.instance {{`}}`}} did not perform any rule evaluations in the past 10 minutes.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosnoruleevaluations
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosnoruleevaluations
|
||||
summary: Thanos Rule did not perform any rule evaluations.
|
||||
expr: |
|
||||
sum by (job, instance) (rate(prometheus_rule_evaluations_total{job=~".*thanos-rule.*"}[5m])) <= 0
|
||||
|
||||
@@ -30,7 +30,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Sidecar {{`{{`}} $labels.instance {{`}}`}} bucket operations are failing
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanossidecarbucketoperationsfailed
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanossidecarbucketoperationsfailed
|
||||
summary: Thanos Sidecar bucket operations are failing
|
||||
expr: |
|
||||
sum by (job, instance) (rate(thanos_objstore_bucket_operation_failures_total{job=~"{{ .Values.metrics.prometheusRule.default.sidecarJobRegex }}"}[5m])) > 0
|
||||
@@ -48,7 +48,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Sidecar {{`{{`}} $labels.instance {{`}}`}} is unhealthy.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanossidecarnoconnectiontostartedprometheus
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanossidecarnoconnectiontostartedprometheus
|
||||
summary: Thanos Sidecar cannot access Prometheus, even though Prometheus seems healthy and has reloaded WAL.
|
||||
expr: |
|
||||
thanos_sidecar_prometheus_up{job=~"{{ .Values.metrics.prometheusRule.default.sidecarJobRegex }}"} == 0
|
||||
|
||||
@@ -30,7 +30,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Store {{`{{`}} $labels.job {{`}}`}} is failing to handle {{`{{`}} $value | humanize {{`}}`}}% of requests.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosstoregrpcerrorrate
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosstoregrpcerrorrate
|
||||
summary: Thanos Store is failing to handle qrpcd requests.
|
||||
expr: |
|
||||
(
|
||||
@@ -53,7 +53,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Store {{`{{`}} $labels.job {{`}}`}} has a 99th percentile latency of {{`{{`}} $value {{`}}`}} seconds for store series gate requests.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosstoreseriesgatelatencyhigh
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosstoreseriesgatelatencyhigh
|
||||
summary: Thanos Store has high latency for store series gate requests.
|
||||
expr: |
|
||||
(
|
||||
@@ -75,7 +75,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Store {{`{{`}} $labels.job {{`}}`}} Bucket is failing to execute {{`{{`}} $value | humanize {{`}}`}}% of operations.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosstorebuckethighoperationfailures
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosstorebuckethighoperationfailures
|
||||
summary: Thanos Store Bucket is failing to execute operations.
|
||||
expr: |
|
||||
(
|
||||
@@ -98,7 +98,7 @@ spec:
|
||||
{{- include "common.tplvalues.render" ( dict "value" .Values.commonAnnotations "context" $ ) | nindent 8 }}
|
||||
{{- end }}
|
||||
description: Thanos Store {{`{{`}} $labels.job {{`}}`}} Bucket has a 99th percentile latency of {{`{{`}} $value {{`}}`}} seconds for the bucket operations.
|
||||
runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosstoreobjstoreoperationlatencyhigh
|
||||
runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanosstoreobjstoreoperationlatencyhigh
|
||||
summary: Thanos Store is having high latency for bucket operations.
|
||||
expr: |
|
||||
(
|
||||
|
||||
@@ -4293,6 +4293,9 @@ metrics:
|
||||
## @param metrics.prometheusRule.default.disabled disable one specific prometheus alert rule
|
||||
##
|
||||
disabled: {}
|
||||
## @param metrics.prometheusRule.runbookUrl Prefix for runbook URLs. Use this to override the first part of the runbookURLs that is common to all rules
|
||||
##
|
||||
runbookUrl: "https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-"
|
||||
## @param metrics.prometheusRule.namespace Namespace in which the PrometheusRule CRD is created
|
||||
##
|
||||
namespace: ""
|
||||
@@ -4307,7 +4310,7 @@ metrics:
|
||||
## - alert: ThanosCompactMultipleRunning
|
||||
## annotations:
|
||||
## description: No more than one Thanos Compact instance should be running at once. There are {{`{{`}}$value{{`}}`}} instances running.
|
||||
## runbook_url: https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanoscompactmultiplerunning
|
||||
## runbook_url: {{ .Values.metrics.prometheusRule.runbookUrl }}thanoscompactmultiplerunning
|
||||
## summary: Thanos Compact has multiple instances running.
|
||||
## expr: sum by (job) (up{job=~"{{ template "common.names.fullname" . }}-compact.*"}) > 1
|
||||
## for: 5m
|
||||
|
||||
Reference in New Issue
Block a user