Create and use external Flexion SFTP site for more robust testing

[somesylvie]

Story

As a partner, so that I can feel confident in the system, I need automated workflow testing to be able to include contacting external SFTP sites in addition to the basic ingestion service functionality, RS, and TI

Pre-conditions

• Depends on Complete initial SFTP config implementation #1680

Acceptance Criteria

• Required outcomes of the story

Tasks

Research

• Research work needed to complete the story
• Foundational: High-level research that will support this and future efforts

Engineering

• Set up an external SFTP site for the Flexion org
• Set up another function trigger/CRON for Flexion
  • Flexion simulated lab and/or Flexion golden copy or automated test sender?
  • Set up a cron expression in TF
  • Set up add'l secrets in TF for connecting to SFTP site
• Do we want to start making TF dynamic at this point or wait for add'l partners? I think maybe wait for 1-2 more partners?
• Maybe actually hook this in to some of the automated tests?

Definition of Done

• Documentation tasks completed
  • Documentation and diagrams created or updated
    • ADRs (/adr folder)
    • Main README.md
    • Other READMEs in the repo
    • If applicable, update the ReportStream Setup section in README.md
  • Threat model updated
  • API documentation updated
• Code quality tasks completed
  • Code refactored for clarity and no design/technical debt
  • Adhere to separation of concerns; code is not tightly coupled, especially to 3rd party dependencies
• Testing tasks completed
  • Load tests passed
  • Additional e2e tests created
  • Additional RS e2e assertions created in the rs-e2e project for any new transformations. Includes improvements to the assertion code required to make the new assertions
• Build & Deploy tasks completed
  • Build process updated
  • API(s) are versioned
  • Feature toggles created and/or deleted. Document the feature toggle
  • Source code is merged to the main branch

Note: Please remove any DoD items that are not applicable

Research Questions

• Optional: Any initial questions for research

Decisions

• Optional: Any decisions we've made while working on this story

Notes

• Optional: Any reference material or thoughts we may need for later reference