Monitoring Overview

Architecture

┌──────────────┐     ┌──────────────┐     ┌──────────────┐
│  Data Sources│────▶│  Prometheus  │────▶│   Grafana    │
│              │     │  (Storage)   │     │ (Dashboard)  │
│ • Backend    │     │              │     │              │
│ • Containers │     │ • Metrics    │     │ • Charts     │
│ • Host       │     │ • Alerts     │     │ • Alerts     │
└──────────────┘     └──────────────┘     └──────────────┘

Components

Component	Technology	Port	Function
Prometheus	prom/prometheus	9090	Metrics collection & storage
Grafana	grafana/grafana	3001	Metrics visualization
OTel Collector	otel-collector-contrib	4317/4318	Telemetry collection
cAdvisor	cadvisor	8082	Container metrics
Node Exporter	node-exporter	9100	Host metrics

Metrics Types

Application Metrics

Metric	Type	Description
http_requests_total	Counter	Total HTTP requests
http_request_duration_seconds	Histogram	Request duration
http_requests_in_flight	Gauge	Current requests in progress

Container Metrics

Metric	Type	Description
container_cpu_usage_seconds_total	Counter	CPU usage
container_memory_usage_bytes	Gauge	Memory usage
container_network_receive_bytes_total	Counter	Network receive

Host Metrics

Metric	Type	Description
node_cpu_seconds_total	Counter	CPU time
node_memory_MemAvailable_bytes	Gauge	Available memory
node_filesystem_avail_bytes	Gauge	Available disk

Dashboards

CLM Dashboard

• Pipeline status
• Data center status
• Throughput metrics
• Log volume
• Error rates

Infrastructure Dashboard

• Container metrics
• Host metrics
• Network metrics
• Disk usage

Next Steps

• Prometheus - Configuration
• Grafana - Dashboards
• OTel Collector - Telemetry
• Dashboard - CLM dashboard