Discuss a good way to store signals and events in different granularities

[dyuliu]

We have to use signal processing pipeline to produce signals in different aggregation levels.

One of the required demands from the end-users is to look at the signal in different granularities, such as in 6 minutes, 30 minutes, 1 hour, 6 hours, etc.

(1) How to store the signals in the database to allow efficient data exploration? We have to make a tradeoff between time efficiency and space efficiency. - solution1: store only the most fine-grained level signals so that we can use this data to infer the ones at a coarser level? - solution2: store signals in every granularities ranging from 6 minutes to 6 hours.

(2) For one signal, it can be processed in different aggregation levels and then anomalous events for every aggregation level could be generated in different shapes. We need to think of a good way to organize these events that are related to the same signal but in different granularities.