Adding JPO-Deduplicator to jpo-utils

[John-Wiens]

No description provided.

[Michael7371]

Can we configure these topologies to start based off of the same/similar environmental variables that the kafka-setup pod uses?

if KAFKA_TOPIC_CREATE_ODE then the raw ODE topologies are enabled.
if KAFKA_TOPIC_CREATE_GEOJSONCONVERTER then the Processed topologies are enabled.
if KAFKA_TOPIC_CREATE_CONFLICTMONITOR then the CM topologies are enabled.

It might make sense to use different environmental variables, but having someway to enable/disable based off of environmental variables seems necessary before it can be part of jpo-utils

[John-Wiens]

Can we configure these topologies to start based off of the same/similar environmental variables that the kafka-setup pod uses?

if KAFKA_TOPIC_CREATE_ODE then the raw ODE topologies are enabled. if KAFKA_TOPIC_CREATE_GEOJSONCONVERTER then the Processed topologies are enabled. if KAFKA_TOPIC_CREATE_CONFLICTMONITOR then the CM topologies are enabled.

It might make sense to use different environmental variables, but having someway to enable/disable based off of environmental variables seems necessary before it can be part of jpo-utils

I added a few new environment variables to the sample.env file.
ENABLE_PROCESSED_MAP_DEDUPLICATION
ENABLE_PROCESSED_MAP_WKT_DEDUPLICATION
ENABLE_ODE_MAP_DEDUPLICATION
ENABLE_ODE_TIM_DEDUPLICATION
ENABLE_ODE_RAW_ENCODED_TIM_DEDUPLICATION
ENABLE_PROCESSED_SPAT_DEDUPLICATION
ENABLE_ODE_BSM_DEDUPLICATION

Each of these variables is by default tied to the corresponding KAFKA_TOPIC_CREATE variable. For example, the ENABLE_PROCESSED_MAP_DEDUPLICATION is set to the value of KAFKA_TOPIC_CREATE_GEOJSONCONVERTER by default. This means that if the user is using the geojson converter, the corresponding deduplication topics will also be activated. Alternatively, users may manually configure each of these variables in their .env file.

[Michael7371]

Just a few comments. I was able to build the deduplicator and verify that it starts up correctly

[Michael7371]

LGTM!