Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix flaky test for vis-augmenter #1038

Merged

Conversation

Hailong-am
Copy link
Collaborator

@Hailong-am Hailong-am commented Feb 1, 2024

Description

Add some wait time to dashboard to be searchable

Issues Resolved

#1118

Check List

  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@Hailong-am
Copy link
Collaborator Author

pls hold on merge, there is no test run for this change.

@xluo-aws
Copy link
Member

xluo-aws commented Feb 4, 2024

Saw there are failed test cases related to visualization, is it supposed to be fixed by this change or it's not related?

@Hailong-am
Copy link
Collaborator Author

Saw there are failed test cases related to visualization, is it supposed to be fixed by this change or it's not related?

It's not related, this PR focus on vis-augmenter related test cases.

@ruanyl
Copy link
Member

ruanyl commented Feb 5, 2024

@Hailong-am what's the status of this PR? can we merge?

@Hailong-am
Copy link
Collaborator Author

@Hailong-am what's the status of this PR? can we merge?

Still have issue for the vis-augmenter, under investigation

@Hailong-am Hailong-am marked this pull request as draft February 7, 2024 00:27
@Hailong-am Hailong-am marked this pull request as ready for review February 22, 2024 05:46
@Hailong-am
Copy link
Collaborator Author

test result https://github.com/opensearch-project/opensearch-dashboards-functional-test/actions/runs/7999641394

without security

 Running:  core-opensearch-dashboards/opensearch-dashboards/apps/vis-augmenter/          (35 of 41)
            dashboard_spec.js                                                                       


  Vis augmenter - existing dashboards work as expected
    dashboard with ineligible, eligible, and vega visualizations
      ✓ View events option does not exist for any visualization (90866ms)
      ✓ Validate non-vega visualizations are not rendered with vega under the hood (9762ms)


  2 passing (2m)     

with security

                                                                                                  
  Running:  core-opensearch-dashboards/opensearch-dashboards/apps/vis-augmenter/          (35 of 41)
            dashboard_spec.js                                                                       
  Vis augmenter - existing dashboards work as expected
    dashboard with ineligible, eligible, and vega visualizations
      ✓ View events option does not exist for any visualization (91996ms)
      ✓ Validate non-vega visualizations are not rendered with vega under the hood (9924ms)
  2 passing (2m)

@kavilla kavilla linked an issue Feb 23, 2024 that may be closed by this pull request
@Hailong-am Hailong-am merged commit e9fa679 into opensearch-project:main Feb 23, 2024
35 of 39 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Feb 23, 2024
* wait for dashboard to be searchable

Signed-off-by: Hailong Cui <[email protected]>

* refresh private tenant kibana index also

Signed-off-by: Hailong Cui <[email protected]>

* Add one more filter for core ft

Signed-off-by: Hailong Cui <[email protected]>

* Add CYPRESS_NO_COMMAND_LOG flag

Signed-off-by: Hailong Cui <[email protected]>

* only run vis-augmenter for debug

Signed-off-by: Hailong Cui <[email protected]>

* only run vis-augmenter for debug

Signed-off-by: Hailong Cui <[email protected]>

* only run vis-augmenter for debug

Signed-off-by: Hailong Cui <[email protected]>

* wait for page load

Signed-off-by: Hailong Cui <[email protected]>

* firefox

Signed-off-by: Hailong Cui <[email protected]>

* revert test code

Signed-off-by: Hailong Cui <[email protected]>

* wait for page load

Signed-off-by: Hailong Cui <[email protected]>

* add more timeout

Signed-off-by: Hailong Cui <[email protected]>

* add more checks

Signed-off-by: Hailong Cui <[email protected]>

* add vis to dashboard

Signed-off-by: Hailong Cui <[email protected]>

* no command log

Signed-off-by: Hailong Cui <[email protected]>

* use correct flag CYPRESS_NO_COMMAND_LOG

Signed-off-by: Hailong Cui <[email protected]>

* set to global tenant when security enabled

Signed-off-by: Hailong Cui <[email protected]>

---------

Signed-off-by: Hailong Cui <[email protected]>
(cherry picked from commit e9fa679)
Hailong-am added a commit that referenced this pull request Feb 23, 2024
* wait for dashboard to be searchable

Signed-off-by: Hailong Cui <[email protected]>

* refresh private tenant kibana index also

Signed-off-by: Hailong Cui <[email protected]>

* Add one more filter for core ft

Signed-off-by: Hailong Cui <[email protected]>

* Add CYPRESS_NO_COMMAND_LOG flag

Signed-off-by: Hailong Cui <[email protected]>

* only run vis-augmenter for debug

Signed-off-by: Hailong Cui <[email protected]>

* only run vis-augmenter for debug

Signed-off-by: Hailong Cui <[email protected]>

* only run vis-augmenter for debug

Signed-off-by: Hailong Cui <[email protected]>

* wait for page load

Signed-off-by: Hailong Cui <[email protected]>

* firefox

Signed-off-by: Hailong Cui <[email protected]>

* revert test code

Signed-off-by: Hailong Cui <[email protected]>

* wait for page load

Signed-off-by: Hailong Cui <[email protected]>

* add more timeout

Signed-off-by: Hailong Cui <[email protected]>

* add more checks

Signed-off-by: Hailong Cui <[email protected]>

* add vis to dashboard

Signed-off-by: Hailong Cui <[email protected]>

* no command log

Signed-off-by: Hailong Cui <[email protected]>

* use correct flag CYPRESS_NO_COMMAND_LOG

Signed-off-by: Hailong Cui <[email protected]>

* set to global tenant when security enabled

Signed-off-by: Hailong Cui <[email protected]>

---------

Signed-off-by: Hailong Cui <[email protected]>
(cherry picked from commit e9fa679)

Co-authored-by: Hailong Cui <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Flaky test of vis-augmenter
5 participants