~Retention Times~

To maintain reasonable data handling and database size, the Aternity platform maintains different “resolutions” of the data, and these resolutions are reduced the farther we go back in history. For today and near past, the data is kept with high resolution, and for the far past, the data is kept with low resolution.

These resolutions are called Aggregation Levels, and the amount of time each aggregation level is maintained is called a Retention Time. By default, the following retention times are configured:

  • None (or Raw Data): By default, retained for 2 days (2880 minutes). Can be retained for longer, with storage size implications. Remember that diverse attributes are retained as long as the raw data.
  • 5-min: Every 5 minutes, the 1-min measurements are aggregated into one 5-min measurement. By default, retained for 10 days.
  • Hourly: Every hour, the 5-min measurements are aggregated into one hourly measurement. By default, retained for 45 days.
  • Daily: Every day, the hourly measurements are aggregated into one daily measurement. By default, retained for a full year (365 days)

Changing the retention times is done as follows.

Important:

Changing retention times may adversely affect the Aternity database and storage requirements. It is strongly recommended to consult with Aternity before making any retention time changes.

To change the None retention time: Raw data is saved on the Data Warehouse Server’s file system, the default folder is <Aternity folder>\datawarehouse\data\. All raw data settings, including retention period, are configured in the Configuration schema at aternity\datawarehouse\rawData.

Note:

Storage of raw data requires extra of 6GB per 1,000 End Points (assuming default raw data retention of 2 days).

To change all the other retention times, all other retention times are configured within the database itself, in the HIST_AGGR table.

Database table with aggregations