README.md

environmental-analyzer

Uses Apache Beam to create a distributed data pipeline that combines NexRAD and GSOD datasets to CSV output.

Data Sets Schemas

• GSOD Weather Data
• GSOD Weather Station
• NexRAD Level II

Samples adapted from:

• Google Cloud BigQueryTornado Example
• Google Cloud Join Example
• Valliappa Lakshmanan - Nexrad Pipeline Example

Useful links

• Google Cloud Platform - Dataflow SDK Examples
• Valliappa Lakshmanan - Data Science Examples

License

For all files in this repository that don't contain explicit licensing, the MIT license then applies. See the accompanying LICENSE for more details.

Visualized Batch Job

Here's an example run using google cloud platform.