Skip to content

Pre-stabilization changes for state_agg - part 1 #692

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 12 commits into from
Feb 8, 2023
Merged

Pre-stabilization changes for state_agg - part 1 #692

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
c627db5
Support getting the state duration for a range
syvb Jan 23, 2023
b9dabab
Remove next param from interpolated state functions
syvb Jan 24, 2023
3586f4b
Rename to compressed_state_agg and state_agg
syvb Jan 24, 2023
165f411
use start+interval instead of start+end
syvb Jan 24, 2023
1cab5a0
Add changelog entries
syvb Jan 30, 2023
f8920fa
Use better error messages after name change
syvb Feb 1, 2023
5b8890d
Add explict error for bad duration_in parameters
syvb Feb 1, 2023
2db5a02
Do subsetting in interpolated_duration_in
syvb Feb 2, 2023
3b1e451
compressed -> compact
syvb Feb 6, 2023
b7ffc0b
Default interpolated interval end to NULL
syvb Feb 7, 2023
2083c87
Assume no state prior to first state
syvb Feb 7, 2023
571ace5
Optimize duration calculation loop
syvb Feb 7, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions Changelog.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,9 @@ This changelog should be updated as part of a PR if the work is worth noting (mo
#### Bug fixes

#### Other notable changes
- [#692](https://github.com/timescale/timescaledb-toolkit/pull/692): Support specifying a range to `duration_in` to specify a time range to get states in for state aggregates
- [#692](https://github.com/timescale/timescaledb-toolkit/pull/692): Removed `next` parameter from interpolated state aggregate functions
- [#692](https://github.com/timescale/timescaledb-toolkit/pull/692): Renamed `state_agg` to `compact_state_agg` and `timeline_agg` to `state_agg`

#### Shout-outs

Expand Down
132 changes: 92 additions & 40 deletions docs/state_agg.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,15 +46,15 @@ INSERT INTO states_test_5 VALUES
Compute the amount of time spent in a state as INTERVAL.

```SQL
SELECT toolkit_experimental.duration_in('ERROR', toolkit_experimental.state_agg(ts, state)) FROM states_test;
SELECT toolkit_experimental.duration_in('ERROR', toolkit_experimental.compact_state_agg(ts, state)) FROM states_test;
```
```output
interval
----------
00:00:03
```
```SQL
SELECT toolkit_experimental.duration_in(2, toolkit_experimental.state_agg(ts, state)) FROM states_test_4;
SELECT toolkit_experimental.duration_in(2, toolkit_experimental.compact_state_agg(ts, state)) FROM states_test_4;
```
```output
interval
Expand All @@ -67,7 +67,7 @@ Extract as number of seconds:
```SQL
SELECT
EXTRACT(epoch FROM
toolkit_experimental.duration_in('ERROR', toolkit_experimental.state_agg(ts, state))
toolkit_experimental.duration_in('ERROR', toolkit_experimental.compact_state_agg(ts, state))
)::INTEGER
FROM states_test;
```
Expand All @@ -77,11 +77,71 @@ FROM states_test;
3
```

#### duration_in for a range
```SQL
SELECT toolkit_experimental.duration_in('OK', toolkit_experimental.state_agg(ts, state), '2020-01-01 00:01:00+00', '2 days') FROM states_test;
```
```output
duration_in
-------------
00:00:57
```
```SQL
SELECT toolkit_experimental.duration_in('OK', toolkit_experimental.state_agg(ts, state), '2020-01-01 00:01:00+00', NULL) FROM states_test;
```
```output
duration_in
-------------
00:00:57
```
```SQL
SELECT toolkit_experimental.duration_in('OK', toolkit_experimental.state_agg(ts, state), '2020-01-01 00:01:00+00') FROM states_test;
```
```output
duration_in
-------------
00:00:57
```
```SQL
SELECT toolkit_experimental.duration_in(51351, toolkit_experimental.state_agg(ts, state), '2020-01-01 00:01:00+00', '2 days') FROM states_test_4;
```
```output
duration_in
-------------
00:00:57
```
```SQL
SELECT toolkit_experimental.duration_in(51351, toolkit_experimental.state_agg(ts, state), '2020-01-01 00:01:00+00', NULL) FROM states_test_4;
```
```output
duration_in
-------------
00:00:57
```

```SQL
SELECT toolkit_experimental.duration_in('OK', toolkit_experimental.state_agg(ts, state), '2020-01-01 00:00:15+00', '30 seconds') FROM states_test;
```
```output
duration_in
-------------
00:00:30
```

```SQL
SELECT toolkit_experimental.duration_in('OK', toolkit_experimental.state_agg(ts, state), '2020-01-01 00:00:15+00', '1 minute 1 second') FROM states_test;
```
```output
duration_in
-------------
00:00:58
```

### into_values

```SQL
SELECT state, duration FROM toolkit_experimental.into_values(
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test))
(SELECT toolkit_experimental.compact_state_agg(ts, state) FROM states_test))
ORDER BY state, duration;
```
```output
Expand All @@ -94,7 +154,7 @@ SELECT state, duration FROM toolkit_experimental.into_values(
```
```SQL
SELECT state, duration FROM toolkit_experimental.into_int_values(
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test_4))
(SELECT toolkit_experimental.compact_state_agg(ts, state) FROM states_test_4))
ORDER BY state, duration;
```
```output
Expand All @@ -110,7 +170,7 @@ SELECT state, duration FROM toolkit_experimental.into_int_values(

```SQL
SELECT state, start_time, end_time FROM toolkit_experimental.state_timeline(
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test))
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test))
ORDER BY start_time;
```
```output
Expand All @@ -125,7 +185,7 @@ ERROR | 2020-01-01 00:01:00+00 | 2020-01-01 00:01:03+00

```SQL
SELECT state, start_time, end_time FROM toolkit_experimental.state_int_timeline(
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_4))
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test_4))
ORDER BY start_time;
```
```output
Expand All @@ -141,7 +201,7 @@ state | start_time | end_time

```SQL
SELECT state, start_time, end_time FROM toolkit_experimental.state_timeline(
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_2))
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test_2))
ORDER BY start_time;
```
```output
Expand All @@ -158,7 +218,7 @@ START | 2019-12-31 00:00:00+00 | 2019-12-31 00:00:11+00
SELECT start_time, end_time
FROM toolkit_experimental.state_periods(
'OK',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test)
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test)
)
ORDER BY start_time;
```
Expand All @@ -173,7 +233,7 @@ start_time | end_time
SELECT start_time, end_time
FROM toolkit_experimental.state_periods(
51351,
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_4)
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test_4)
)
ORDER BY start_time;
```
Expand All @@ -188,7 +248,7 @@ start_time | end_time
SELECT start_time, end_time
FROM toolkit_experimental.state_periods(
'ANYTHING',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test)
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test)
)
ORDER BY start_time;
```
Expand All @@ -201,10 +261,9 @@ start_time | end_time

```SQL
SELECT state, start_time, end_time FROM toolkit_experimental.interpolated_state_timeline(
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test),
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test),
'2019-12-31', '1 days',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_3),
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_3)
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test_3)
)
ORDER BY start_time;
```
Expand All @@ -220,10 +279,9 @@ ERROR | 2020-01-01 00:01:00+00 | 2020-01-01 00:01:03+00

```SQL
SELECT state, start_time, end_time FROM toolkit_experimental.interpolated_state_timeline(
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test),
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test),
'2019-12-31', '5 days',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_3),
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_3)
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test_3)
)
ORDER BY start_time;
```
Expand All @@ -239,10 +297,9 @@ ERROR | 2020-01-01 00:01:00+00 | 2020-01-01 00:01:03+00

```SQL
SELECT state, start_time, end_time FROM toolkit_experimental.interpolated_state_timeline(
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test),
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test),
'2019-12-31', '1 days',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_2),
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_2)
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test_2)
)
ORDER BY start_time;
```
Expand All @@ -259,10 +316,9 @@ ERROR | 2020-01-01 00:01:00+00 | 2020-01-01 00:01:03+00

```SQL
SELECT state, start_time, end_time FROM toolkit_experimental.interpolated_state_timeline(
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test),
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test),
'2019-12-31', '5 days',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_2),
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_2)
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test_2)
)
ORDER BY start_time;
```
Expand All @@ -283,10 +339,9 @@ ERROR | 2020-01-01 00:01:00+00 | 2020-01-01 00:01:03+00
```SQL
SELECT start_time, end_time FROM toolkit_experimental.interpolated_state_periods(
'OK',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test),
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test),
'2019-12-31', '1 days',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_3),
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_3)
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test_3)
)
ORDER BY start_time;
```
Expand All @@ -300,10 +355,9 @@ start_time | end_time
```SQL
SELECT start_time, end_time FROM toolkit_experimental.interpolated_state_periods(
'START',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test),
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test),
'2019-12-31', '5 days',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_3),
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_3)
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test_3)
)
ORDER BY start_time;
```
Expand All @@ -316,10 +370,9 @@ start_time | end_time
```SQL
SELECT start_time, end_time FROM toolkit_experimental.interpolated_state_periods(
'STOP',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test),
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test),
'2019-12-31', '1 days',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_2),
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_2)
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test_2)
)
ORDER BY start_time;
```
Expand All @@ -333,10 +386,9 @@ start_time | end_time
```SQL
SELECT start_time, end_time FROM toolkit_experimental.interpolated_state_periods(
'STOP',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test),
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test),
'2019-12-31', '5 days',
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_2),
(SELECT toolkit_experimental.timeline_agg(ts, state) FROM states_test_2)
(SELECT toolkit_experimental.state_agg(ts, state) FROM states_test_2)
)
ORDER BY start_time;
```
Expand All @@ -352,7 +404,7 @@ start_time | end_time
```SQL
WITH buckets AS (SELECT
date_trunc('minute', ts) as dt,
toolkit_experimental.state_agg(ts, state) AS sa
toolkit_experimental.compact_state_agg(ts, state) AS sa
FROM states_test
GROUP BY date_trunc('minute', ts))
SELECT toolkit_experimental.duration_in(
Expand All @@ -370,7 +422,7 @@ FROM buckets;
```SQL
WITH buckets AS (SELECT
date_trunc('minute', ts) as dt,
toolkit_experimental.state_agg(ts, state) AS sa
toolkit_experimental.compact_state_agg(ts, state) AS sa
FROM states_test
GROUP BY date_trunc('minute', ts))
SELECT toolkit_experimental.duration_in(
Expand All @@ -388,7 +440,7 @@ FROM buckets;
```SQL
WITH buckets AS (SELECT
date_trunc('minute', ts) as dt,
toolkit_experimental.timeline_agg(ts, state) AS sa
toolkit_experimental.state_agg(ts, state) AS sa
FROM states_test
GROUP BY date_trunc('minute', ts))
SELECT toolkit_experimental.state_timeline(
Expand All @@ -409,7 +461,7 @@ FROM buckets;
```SQL
WITH buckets AS (SELECT
date_trunc('minute', ts) as dt,
toolkit_experimental.timeline_agg(ts, state) AS sa
toolkit_experimental.state_agg(ts, state) AS sa
FROM states_test
GROUP BY date_trunc('minute', ts)
HAVING date_trunc('minute', ts) != '2020-01-01 00:01:00+00'::timestamptz)
Expand All @@ -429,7 +481,7 @@ FROM buckets;
```SQL
WITH buckets AS (SELECT
date_trunc('minute', ts) as dt,
toolkit_experimental.timeline_agg(ts, state) AS sa
toolkit_experimental.state_agg(ts, state) AS sa
FROM states_test_5
GROUP BY date_trunc('minute', ts)
HAVING date_trunc('minute', ts) != '2020-01-01 00:01:00+00'::timestamptz)
Expand Down
Loading