Proxus uses a configuration-first approach to manage data retention. Telemetry and system logs are stored in ClickHouse, while the primary database (PostgreSQL) is reserved for configuration, metadata, and entity definitions.
Telemetry & Log Store (ClickHouse)
Both telemetry data and system logs can be automatically purged or moved to different storage tiers using TTL (Time-To-Live) expressions. For advanced configuration options, see the official ClickHouse TTL documentation.
System Logs Retention
By default, system logs are configured to be retained for 45 days. This is managed via the ClickHouseLogTTLExpression setting:
[ClickHouse]
ClickHouseLogTTLExpression = "toDateTime(Time) + INTERVAL 45 DAY DELETE"Device Data Retention
Retention for raw device data (telemetry) is managed via the ClickHouseTTLExpression. Common strategies include:
- 1 Month Retention:
toDateTime(Time) + INTERVAL 1 MONTH DELETE - 1 Year Retention:
toDateTime(Time) + INTERVAL 1 YEAR DELETE - Tiered Storage: Move data older than 30 days to a cold storage volume named 'slow':
toDateTime(Time) + INTERVAL 30 DAY TO VOLUME 'slow'
Configuration Reference
For more detailed settings, including write intervals and performance tuning, refer to the Configuration Reference.