Add parquet-only tables to data dictionary

[jdangerx]

Overview

We used a pre-generated metadata.yaml that we use for the pudl database on datasette to build the data dictionary.

This was expedient and gave us a good idea of how the product would work, but doesn't include the tables that are only available as Parquet.

Success Criteria

How will we know that we're done?

• parquet-only tables are available in data dictionary

Next steps

Preview Give feedback

1. figure out which tables are being dropped
2. look at how we're generating the data dictionary for our RTD - how does that figure out the descriptions and locations of each table?

[zaneselvans]

We ought to be very close to being able to output a legitimate datapackage.json that points at the nightly parquet outputs and includes all of the column and table metadata, if that makes anything easier.

[jdangerx]

Agree, that would be the nicest way to do this and seems not that hard... It falls most naturally in the metadata project, but might make sense to Just Do at this point.