k3d tests frequently timeout #9585
Labels
Flaky
Indicates a flaky or unreliable test
Testing
Affects how the code is tested
Type: Technical issue
Improve something that users won't notice
Describe the issue
There are two suites that run with k3d instead of docker compose. These suites are copies of other suites so they run exactly the same tests with the only difference being how the CHT is being launched. This is better because it's more like a production environment and therefore more likely to find issues that actual projects would hit. Eventually the goal was to remove all docker compose versions to reduce the number of suites we execute.
However, the k3d suites frequently fail due to hitting the 60 minute GHA limit.
The original issue covering this migration is #8909
Describe the improvement you'd like
We need to find a way to stablise these suites so that we can trust the results of our CI runs. The ideal solution is to figure out why k3d is so much slower than docker compose and fix that. If it's not possible to speed the test up we could execute a minimal k3d suite, and retain docker compose suites for the bulk of the testing.
Describe alternatives you've considered
We could just increase the GHA timeout and that would probably work but then we would have to wait over an hour for each build to complete which is not acceptable.
The text was updated successfully, but these errors were encountered: