unkin-agent
757ae5b240
The k8s log pipeline stores to ClickHouse via NATS+vector, while the VM estate ships journald to a separate puppet-managed VictoriaLogs cluster. Consolidating on VictoriaLogs in-cluster collapses the two paths, and the logs-ingest gateway has no clients yet so it can be repointed now, ahead of the puppet change. - add VLCluster `logs` at v1.52.0 (2 vlinsert, 2 vlselect, 3 vlstorage, 180d retention, 250Gi each on cephrbd-fast-delete) - cap vlstorage disk use at 220GiB per node so 180d stays time-based rather than disk-bound - repoint the logs-ingest HTTPRoute at `vlinsert-logs:9481` - add a VictoriaLogs Grafana datasource and install its plugin Nothing is removed here; NATS, ClickHouse, vector, logarchiver and logviewer keep running until a follow-up drops them. Reviewed-on: #488 Co-authored-by: unkin-agent <unkin-agent@unkin.net> Co-committed-by: unkin-agent <unkin-agent@unkin.net>
42 lines
1.1 KiB
YAML
42 lines
1.1 KiB
YAML
---
|
|
apiVersion: grafana.integreatly.org/v1beta1
|
|
kind: GrafanaDatasource
|
|
metadata:
|
|
name: victoriametrics
|
|
namespace: grafana
|
|
spec:
|
|
instanceSelector:
|
|
matchLabels:
|
|
dashboards: "grafana"
|
|
# uid matches the previous default datasource so the imported dashboards
|
|
# (which hardcode this uid or use the default) resolve without edits.
|
|
datasource:
|
|
name: "VictoriaMetrics"
|
|
type: "prometheus"
|
|
uid: "det2y55dac4jkc"
|
|
access: "proxy"
|
|
url: "http://vmselect-main.observability.svc.cluster.local:8481/select/0/prometheus"
|
|
isDefault: true
|
|
jsonData:
|
|
timeInterval: "15s"
|
|
httpMethod: "POST"
|
|
---
|
|
apiVersion: grafana.integreatly.org/v1beta1
|
|
kind: GrafanaDatasource
|
|
metadata:
|
|
name: victorialogs
|
|
namespace: grafana
|
|
spec:
|
|
instanceSelector:
|
|
matchLabels:
|
|
dashboards: "grafana"
|
|
plugins:
|
|
- name: victoriametrics-logs-datasource
|
|
version: 0.32.0
|
|
datasource:
|
|
name: "VictoriaLogs"
|
|
type: "victoriametrics-logs-datasource"
|
|
uid: "victorialogs"
|
|
access: "proxy"
|
|
url: "http://vlselect-logs.logging.svc.cluster.local:9471"
|