Monitoring¶
The dataLOFT platform uses a standard Kubernetes observability stack deployed in the monitoring and observability namespaces.
Components¶
| Component | Namespace | Purpose |
|---|---|---|
| Prometheus | monitoring |
Collects metrics from all services via ServiceMonitor resources. |
| Grafana | monitoring |
Visualises metrics. Includes custom dashboards for contract negotiation and data transfer activity. |
| Alertmanager | monitoring |
Routes alerts to notification targets based on configured rules. |
| Grafana Loki | monitoring |
Aggregates logs from all pods. |
| Jaeger | observability |
Distributed tracing via OpenTelemetry. Services export traces to an OpenTelemetry collector, which forwards them to Jaeger. |
| Weave GitOps | monitoring |
GitOps dashboard showing the reconciliation state of all Flux resources. |
Service instrumentation¶
All dataLOFT services export OpenTelemetry traces. Prometheus metrics are exposed on each service's /metrics endpoint and scraped via ServiceMonitor resources.
Custom Grafana dashboards exist for: - Contract negotiation state transitions and throughput - Data transfer completion rates and latency