Data Storage
The platform uses Elasticsearch for two categories of data: time-series telemetry metrics from gateways, and structured gateway logs.
Architecture
Metric data flows through the platform in three stages:
- Schema generation - the metrics generator produces Elasticsearch component templates alongside C# types
- Migration - at startup, the index migrator creates the lifecycle policy, index template, and data stream
- Ingestion - the metrics sink bulk-indexes telemetry frames into the data stream
Gateway logs are written by Serilog and queried through the logs query repository.
Pages
| Page | Description |
|---|---|
| Metrics Sink | Bulk indexing of telemetry frames into Elasticsearch |
| Index Migrator | Startup migration for ILM policies, templates, and data streams |
| Logs Query | Querying gateway logs by asset, time range, and text |
Local Development
The Aspire AppHost provisions Elasticsearch 9 and Kibana containers automatically. Index configuration (type, dataset, namespace) is passed through to the platform services via environment variables.