Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flaky newman API tests #364

Closed
paullatzelsperger opened this issue Oct 22, 2024 · 0 comments · Fixed by #365
Closed

Flaky newman API tests #364

paullatzelsperger opened this issue Oct 22, 2024 · 0 comments · Fixed by #365
Labels
bug Something isn't working triage

Comments

@paullatzelsperger
Copy link
Member

Bug Report

Describe the Bug

Sometimes the Management API tests, using newman are failing due to timing issues.

Expected Behavior

consistent and stable tests

Observed Behavior

sometimes test fail because there is no retry and timeout mechanism with newman.

Detailed Description

newman executes all requests with a delay of 5 seconds between requests. if the processes running in the connectors haven't finished by then the request test fails with no option to retry.

Possible Implementation

there is no official way to retry a failed request, but there are hacky ways to implement that, for example this.

We'd have to find a way to re-use that retry code, otherwise we'd have to duplicate that in every request.

*I don't think it's worth the effort. I would simply allow the API tests to fail and log a warning, or remove them altogether

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working triage
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant