Adding weather data from KNMI

[amotl]

Dear Pim and Marten,

I just became aware of #67 and want to humbly make you aware about what @gutzbenj, @wetterfrosch and all other contributors are conceiving over at https://github.com/earthobservations/wetterdienst.

While this is currently just about ingesting weather information from @DeutscherWetterdienst, we want to tap into data from other domestic weather agencies soon.

So, maybe you can share some information about where we might want to look into when approaching open weather data from the Dutch weather agency?

With kind regards,
Andreas.

cc @ClemensGruber

[amotl]

We see at

BEEP/app/Http/Controllers/ResearchController.php

Lines 413 to 424 in 11d6716

	// Add weather data
	$user_location_coord_where = '('.implode(' OR ', $user_dloc_coords).')';
	try{
	$weather = $influx::query('SELECT COUNT("temperature") as "count" FROM "weather" WHERE '.$user_location_coord_where.' AND time >= \''.$user_consents[0]->updated_at.'\' AND time <= \''.$moment_end->format('Y-m-d H:i:s').'\' GROUP BY time(1d)')->getPoints(); // get first weather date
	} catch (InfluxDB\Exception $e) {
	// return Response::json('influx-group-by-query-error', 500);
	}
	if (count($weather) > 0)
	{
	foreach ($weather as $point)
	$user_weather_data[substr($point['time'],0,10)] = $point['count'];
	}

that you are going to InfluxDB for acquiring weather information. This aligns well with the InfluxDB feature support we have been bringing in with version 0.8.0 and are currently refining with the most recent improvements to the development head.

[amotl]

Hi again,

quickly answering myself here, I found the following information for acquiring data from the Royal Netherlands Meteorological Institute (KNMI). They provide some of their data sets as open data, however one will have to request an API key first.

About

These have been the links I followed in order to find their open data product offerings.

• https://www.knmi.nl/over-het-knmi/about
• https://data.knmi.nl/
• https://www.knmidata.nl/open-data
• https://dataplatform.knmi.nl/catalog/

Example

Please note: For realtime data download or downloading larger(bulk) parts of a dataset, you should use the (Open Data) API.

• https://dataplatform.knmi.nl/catalog/datasets/index.html?x%2Ddataset=Actuele10mindataKNMIstations&x%2Ddataset%2Dversion=2

Open Data API

This looks really straight-forward. They even provide complete examples for Python, beyond what can be expected.

• https://developer.dataplatform.knmi.nl/get-started
• https://developer.dataplatform.knmi.nl/example-scripts

With kind regards,
Andreas.

cc @gutzbenj

[pvgennip]

@amotl Thank you for your considerations, and self answering :-)
We currently load weather data for each hive that has lat/lon coordinates filled from the global weather API DarkSky (that has been recently taken over by Apple unfortunately, so this will discontinue end of 2021). We are looking into converting to another fair use global weather API.

[pvgennip]

See: https://github.com/beepnl/BEEP/blob/11d6716b5451ee3747a22741a5c0f643bf772a0e/app/Http/Controllers/Api/WeatherController.php

[amotl]

Dear Pim,

thanks for your pointers.

We are looking into converting to another fair use global weather API.

Regarding another promising weather API, I would like to point out Bright Sky [1,2] by @jdemaeyer and contributors. However, it is unfortunately not a global weather API as it only works upon data by @DeutscherWetterdienst.

With kind regards,
Andreas.

[1] https://brightsky.dev/
[2] https://github.com/jdemaeyer/brightsky