UR 1: Ingest Data

[mvmaltitz]

Expectation

As a user, I need to access data from multiple sources which is updated regularly.

Acceptance Criteria

• Ingest datasets below
• Ensure the datasets are stored in the correct format
• Ensure that the correct attributes are stored
• Ensure datasets are updated as per "Updated"

The following datasets need to be ingested into the GAP platform:

Tahmo Ground Observation Data (csv)

Attribute	Details
Source:	TAHMO Gap Filled Data (csv)
Version:	2018-2024
Resolution:	300+ stations across East Africa
Attributes:	Attribute table - https://kartoza.github.io/tomorrownow_gap/developer/api/guide/measurment/#attributes-table
Format:	Database in the GAP
Updated:	Once off ingestion

Tahmo Ground Observation Data (API)

Attribute	Details
Source:	TAHMO API
Version:
Resolution:	300+ stations across East Africa
Attributes:	Attribute table - https://kartoza.github.io/tomorrownow_gap/developer/api/guide/measurment/#attributes-table
Format:
Updated:

Tomorrow.io Climate Reanalysis data

Attribute	Details
Source:	Bias-corrected Reanalysis
Version:	2012-2023
Resolution:	4km²
Attributes:	Attribute table - https://kartoza.github.io/tomorrownow_gap/developer/api/guide/measurment/#attributes-table
Format:	NetCDF
Updated:	Once off ingestion

Arable weather stations

Attribute	Details
Source:	API
Version:
Resolution:
Attributes:	Attribute table - https://kartoza.github.io/tomorrownow_gap/developer/api/guide/measurment/#attributes-table
Format:
Updated:

Laser Disdrometers

Attribute	Details
Source:	API
Version:
Resolution:
Attributes:	Attribute table - https://kartoza.github.io/tomorrownow_gap/developer/api/guide/measurment/#attributes-table
Format:
Updated:

Windborne Balloons

Attribute	Details
Source:	Windborne API
Version:
Resolution:
Attributes:	Attribute table - https://kartoza.github.io/tomorrownow_gap/developer/api/guide/measurment/#attributes-table
Format:
Updated:

• x, y, z location is updated as the balloon is always moving

Tomorrow.io CBAM Forecasts

Attribute	Details
Source:	Tomorrow.io API
Version:
Resolution:	4km²
Attributes:	Attribute table - https://kartoza.github.io/tomorrownow_gap/developer/api/guide/measurment/#attributes-table
Format:	ZARR
Updated:	Daily

• Today is stored in the GAP for historical data

Salient Forecast

Attribute	Details
Source:	Salient API
Version:	v9
Resolution:	9km²
Attributes:	Attribute table - https://kartoza.github.io/tomorrownow_gap/developer/api/guide/measurment/#attributes-table
Format:	ZARR
Updated: