unkin-agent
757ae5b240
The k8s log pipeline stores to ClickHouse via NATS+vector, while the VM estate ships journald to a separate puppet-managed VictoriaLogs cluster. Consolidating on VictoriaLogs in-cluster collapses the two paths, and the logs-ingest gateway has no clients yet so it can be repointed now, ahead of the puppet change. - add VLCluster `logs` at v1.52.0 (2 vlinsert, 2 vlselect, 3 vlstorage, 180d retention, 250Gi each on cephrbd-fast-delete) - cap vlstorage disk use at 220GiB per node so 180d stays time-based rather than disk-bound - repoint the logs-ingest HTTPRoute at `vlinsert-logs:9481` - add a VictoriaLogs Grafana datasource and install its plugin Nothing is removed here; NATS, ClickHouse, vector, logarchiver and logviewer keep running until a follow-up drops them. Reviewed-on: #488 Co-authored-by: unkin-agent <unkin-agent@unkin.net> Co-committed-by: unkin-agent <unkin-agent@unkin.net>
48 lines
972 B
YAML
48 lines
972 B
YAML
---
|
|
apiVersion: operator.victoriametrics.com/v1
|
|
kind: VLCluster
|
|
metadata:
|
|
name: logs
|
|
namespace: logging
|
|
spec:
|
|
clusterVersion: v1.52.0
|
|
vlinsert:
|
|
replicaCount: 2
|
|
resources:
|
|
requests:
|
|
cpu: 500m
|
|
memory: 1Gi
|
|
limits:
|
|
cpu: "2"
|
|
memory: 4Gi
|
|
vlselect:
|
|
replicaCount: 2
|
|
resources:
|
|
requests:
|
|
cpu: 500m
|
|
memory: 1Gi
|
|
limits:
|
|
cpu: "2"
|
|
memory: 4Gi
|
|
vlstorage:
|
|
replicaCount: 3
|
|
retentionPeriod: 180d
|
|
# ~3 GiB/day measured; 220GiB/node cap keeps 180d time-based, not disk-bound
|
|
retentionMaxDiskSpaceUsageBytes: 220GiB
|
|
storage:
|
|
volumeClaimTemplate:
|
|
spec:
|
|
accessModes:
|
|
- ReadWriteOnce
|
|
storageClassName: cephrbd-fast-delete
|
|
resources:
|
|
requests:
|
|
storage: 250Gi
|
|
resources:
|
|
requests:
|
|
cpu: "1"
|
|
memory: 2Gi
|
|
limits:
|
|
cpu: "4"
|
|
memory: 8Gi
|