Purge WRDS API Dependency from Viz Pipelines

[shawncrawley]

The changes herein originated from ticket #772 - namely improving the process that synchronizes the on-prem WRDS location DB with our cloud version. The syncing process started failing a couple of months back. Turns out that was due to permission errors on the WRDS-side when trying to write the Location DB dump to S3. So with the help of @DrixTabligan-NOAA, we went ahead and tackled #590 to get the DB dump uploaded to the NWM Shared bucket instead.

Once #590 was complete, the syncing process continued to fail due to the WRDS API test failing on the new location DB dumps. This is expected behavior, since the most recent changes to the WRDS DB were more significant. However, rather than just fix the failing code, I also completely removed the dependency on the WRDS API (since none of our services depend on it anymore) and replaced it with tests that are DB-centric.

The terraform code that creates the Test WRDS DB lambda packages every SQL file across our whole repository into a folder that the lambda has access to. When the tests run, the code creates a foreign db connection to the wrds_location3_ondeck db via a new test_external schema and also creates a automated_test schema. Then the code iterates through every SQL file and checks if it has any dependency on the WRDS db (i.e. references to the external schema). If the dependency exists, the SQL is tweaked on the fly to access the wrds_location3_ondeck db via the test_external schema, and also to write any intermediate SELECT ... INTO results to the automated_test db instead. If all of the relevant SQL files execute successfully, the tests pass and the wrds_lcoation3_ondeck db is swapped for the live (i.e. non-_ondeck) version.

That's that! No more dependence upon the WRDS API and even more robust and relevant testing.

[shawncrawley]

We need to get this in ASAP. The WRDS DB syncing has been failing for months again since the initial changes were put in place manually. A VLab ticket was just opened a few days ago pointing out that our DB is out of sync: https://vlab.noaa.gov/redmine/issues/136423.

@DrixTabligan-NOAA Let's tag up on this.

[DrixTabligan-NOAA]

Looks good.