Event Aggregation

[iyourshaw]

Adds event aggregation as specified in the Preliminary Design Details document.

Adds aggregation for the following events:

• Intersection Reference Alignment Event
• Signal Group Alignment Event
• SPaT Minimum Data Event
• MAP Minimum Data Event
• Signal State Conflict Event
• Time Change Details Event
• Event State Progression Event
• Message Count Progression Event (BSM, MAP, and SPaT)

Configuration

Each event that can be aggregated has a configuration setting to enable or disable aggregation, for eample bsm.message.count.progression.aggregateEvents. Aggregation is enabled by default. When aggregation is enabled, only aggregated events are written to Kafka topics.

Key config settings:

• aggregation.interval: The aggregation interval, default 60
• aggregation.intervalUnits: Default SECONDS

Implementation Details

The key classes that implement the aggregation algorithm are:

• EventAggregationProcessor
• BaseAggregationTopology

All the aggregation topologies inherit from BaseAggregationTopology

The aggregated events all inherit from the EventAggregation class.

Each event that produced notifications also has a corresponding NotificationAggregation added.

See also the related PR for ode-utils that adds new topics for the aggregated events and notifications:
usdot-jpo-ode/jpo-utils#15

Testing

Adds unit tests for each of the new aggregation topologies.

Ran the following integration tests scripts:

• Script-SPAT-MAP-unaligned.csv
• SPAT_TimeChangeDetails.csv
• SignalGroupAlignment-unaligned.csv
• Script-SignalStateConflict-Protected.csv
• MAP_MinData.csv
• SPAT_MinData.csv
• SPAT_EventStateProgression.csv
• BSM_Revisions.csv
• ProcessedSpat_Revisions.csv
• ProcessedMap_Revisions.csv