Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests/i: fix flaky tui/test_updater tests #5849

Merged
merged 1 commit into from
Nov 30, 2023

Conversation

oliver-sanders
Copy link
Member

  • These tests were trying to be a bit too clever, testing the updater whilst it was running.
  • This wasn't really needed for what the tests were tring to assert, there are other tests which run Tui for real (live updater and all), those tests didn't exist when these ones were written.
  • This commit freezes the updater so we can run it in lock-step with the tests.

Tests tests passed on the PR (#5731), but failed when the PR was merged into master, three weeks later. I'm not sure what changed between these points, but they appear to be stable now.

Try me: while true; do if ! pytest tests/integration/tui/test_updater.py::test_filters -s; then break; fi; done

Check List

  • I have read CONTRIBUTING.md and added my name as a Code Contributor.
  • Contains logically grouped changes (else tidy your branch by rebase).
  • Does not contain off-topic changes (use other PRs for other changes).
  • Applied any dependency changes to both setup.cfg (and conda-environment.yml if present).
  • Tests are included (or explain why tests are not needed).
  • CHANGES.md entry included if this is a change that can affect users
  • Cylc-Doc pull request opened if required at cylc/cylc-doc/pull/XXXX.
  • If this is a bug fix, PR should be raised against the relevant ?.?.x branch.

* These tests were trying to be a bit too clever, testing the updater
  whilst it was running.
* This wasn't really needed for what the tests were tring to assert,
  there are other tests which run Tui for real (live updater and all),
  those tests didn't exist when these ones were written.
* This commit freezes the updater so we can run it in lock-step with
  the tests.
@oliver-sanders oliver-sanders added this to the cylc-8.3.0 milestone Nov 28, 2023
@oliver-sanders oliver-sanders self-assigned this Nov 28, 2023
@oliver-sanders
Copy link
Member Author

Well, it go rid of the test_updater failures, will follow up on the others later...

Copy link
Member

@MetRonnie MetRonnie left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we disable or xfail the other flaky tests for now?

@oliver-sanders
Copy link
Member Author

oliver-sanders commented Nov 30, 2023

@wxtim - got the remaining tests fixed in the next PR

@MetRonnie MetRonnie merged commit 732ef98 into cylc:master Nov 30, 2023
19 of 25 checks passed
@oliver-sanders oliver-sanders deleted the tui-updater-tests branch November 30, 2023 10:53
wxtim added a commit to wxtim/cylc that referenced this pull request Dec 5, 2023
…at_runtime

* upstream/master:
  tui: avoid deprecated import (cylc#5858)
  Exclude broken pytest-asyncio version
  remove lint (cylc#5856)
  Async pipe decorator: preserve wrapped func signature
  Maintain order for CYLC_PYTHONPATH (cylc#5853)
  Update tests/integration/tui/conftest.py
  tests/i: fix flaky tui/test_updater tests (cylc#5849)
  tests/i: tui - attempt to stabilise tests
  Bump pypa/gh-action-pypi-publish from 1.8.10 to 1.8.11 (cylc#5851)
  tests/i: fix flaky tui/test_updater tests
  Improve changelog entries
  Fix bad TOML example in `cylc lint` docstring (cylc#5843)
  lint - S011 no longer warns against 0{{a}} (cylc#5841)
  `cylc lint`: add rule to catch `rose date`
  tui: show view
  tui: log view
  tui: tidy dangling interfaces
  tui: fix an obscure freezing issue
  tui: update screenshots
  Tui 1.0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants