Dataset Submission: HakaiNutrientSampleResearch

[JessyBarrette]

Hakai Dataset Submission

Below are listed all the different steps related to the initial submission of a dataset.

A more detailed written and visual description of every step is available respectively
here and here.

Submission steps

Initial Submission (Data Administrator)

• Original Data Submission
• CIOOS Metadata Form completed

ERDDAP Dataset Creation (Data Integrator)

• Dataset Transformation (Format label)
  • 🟢 Format Compatible
  • 🟡 Format Minor Revisions
  • 🟠 Format Major Revisions
  • 🔴 Format Incompatible/Missing Information
• Near Real-time Data Integration
• QARTOD Integration
• ERDDAP Integration
• ERDDAP Dataset Documentation
• ERDDAP Test Locally
• Add Dataset to Development Branch

Dataset Review (Data Administrator)

ERDDAP Dataset
CIOOS Metadata form

• Dataset Development Branch Revision (Reviewer Label)
  • 🟢 Reviewer Approved
  • 🟡 Reviewer Minor Revisions
  • 🟠 Reviewer Major Revisions

Dataset Completion (Data Integrator)

• Merge Development Dataset to Production Branch
• COMPLETED

[JessyBarrette]

The objective is to generate a simple tool to review and analyze Nutrient Data on the Hakai database and update review flags based on the review.

This ERDDAP dataset will be generated by querying the database for the nutrient data with a filter on only the approved dataset.

[JessyBarrette]

@CMack89 We would need to create a Metadata record specific to the Hakai Nutrient data here.

[JessyBarrette]

This dataset will essentially be a direct view of the database endpoint /eims/views/output/nutrients with data filtered for certain flags (most likely AV, potentially SVC)

[JessyBarrette]

The first draft of a Nutrient dataset ERDDAP dataset is now available on the Goose ERDDAP:
https://goose.hakai.org/erddap/tabledap/HakaiNutrientSampleResearch.html

As of now, we're not yet filtering the data and dropping any flags. All the data is there, if agreed, ONLY AV data will be kept.

Few variables will be dropped.

[JessyBarrette]

One issue I can find quickly is that we're capturing not only the oceanography data but also nearshore nutrients. We need to find a solution to exclude that data. I'm not sure which way would be the best. Perhaps, the most selective way would be to filter for specific site ids.

[fostermh]

The survey would be another way to filter. We could also look at adding the project to the view for output.

[JessyBarrette]

Thanks @fostermh! Yeah that could an option, sounds like we want to go the more careful route of making available one site at the time anyway, so going by site makes sense for diverse reasons at the end. And it's easy to update the site list by modifying the table

[JessyBarrette]

Just been exchanging with @CMack89 and looks like where gonna provide only records that are QCed as AV or BDL for all three nutrient concentration. We'll start with only QU39 for now and add more sites in the near future.

[JessyBarrette]

The Chlorophyll metadata record is now available here https://cioos-siooc.github.io/metadata-entry-form/#/en/pacific/Q020FzRjJKbVZIm4HPsrGy5HhQr2/-Ma5RGdWbo_pLXJX3Sbg

[JessyBarrette]

@raytula Here's the link to the new metadata record of the nutrient dataset as part of the Hakai records:
https://cioos-siooc.github.io/metadata-entry-form/#/en/hakai/tV5qE0aUgaOjSVmgPgiZ6MyHuSy1/-Ma5RGdWbo_pLXJX3Sbg
(link above was updated)

Here's an example figure from the erddap dataset available as of now on goose
https://goose.hakai.org/erddap/tabledap/HakaiNutrientSampleResearch.graph?time%2Cdepth%2Cno2_no3&time%3E=2015-09-22T00%3A00%3A00Z&time%3C=2021-09-29T00%3A00%3A00Z&.draw=markers&.marker=5%7C5&.color=0x000000&.colorBar=%7C%7C%7C%7C%7C&.yRange=%7C%7Cfalse%7C&.bgColor=0xffccccff

[JessyBarrette]

@pramod-thupaki Here's the suggested nutrient dataset.