[Detection Engine][FTR] Audit detection engine rule execution FTRs

[yctercero]

Summary

Continues work on #169185 and #151877 .

Related to #151877 this PR:

• Moves FTR tests under the /rule_execution folder that do not require Platinum license into the basics folder. Tests in /rule_execution/trial_license_complete_tier folder should now relate to functionality that requires the higher license tier.
• Rearranged some of the folder structure so that it was clear what the intent of the tests is
• Makes note of any issues in tickets that we will need to follow up on

Related to #169185 this PR:

• Ensures that tests are properly tagged for ESS & serverless
• Ensures none of the tests that are critical contain the @skipInQA tag

Follow up

Beta Give feedback

1. [Detection Engine][FTR] ignore_fields tests seemingly not working for serverless #179767
   Project:Serverless Project:Serverless-GA Team:Detection Engine Team:Detections and Resp failed-test +5
2. [Detection Engine][FTR] Audit machine learning FTRs #179768
   8.14 candidate Project:Serverless Team:Detection Engine Team:Detections and Resp v8.14.0 +5
3. [Detection Engine][FTR] Alert suppression FTRs audit #179771
   Project:Serverless Team:Detection Engine tests_needed +3
4. [FTR] Cross team functionality in FTRs #179772
   Team:Detection Engine Team:Entity Analytics discuss +3

Flakey test runner - https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/5592

[yctercero]

/ci

[kibana-ci]

💔 Build Failed

• Buildkite Build
• Commit: dd39661
• Interpreting CI Failures

Failed CI Steps

• x-pack/test/security_solution_api_integration/test_suites/detections_response/detection_engine/rule_execution_logic/basic_license_essentials_tier/configs/ess.config.ts
• x-pack/test/security_solution_api_integration/test_suites/detections_response/detection_engine/rule_execution_logic/basic_license_essentials_tier/configs/ess.config.ts
• x-pack/test/security_solution_api_integration/test_suites/detections_response/detection_engine/rule_execution_logic/basic_license_essentials_tier/configs/serverless.config.ts
• x-pack/test/security_solution_api_integration/test_suites/detections_response/detection_engine/rule_execution_logic/basic_license_essentials_tier/configs/serverless.config.ts

Test Failures

• [job] [logs] x-pack/test/security_solution_api_integration/test_suites/detections_response/detection_engine/rule_execution_logic/basic_license_essentials_tier/configs/serverless.config.ts / Rule execution logic Detection Engine - rule execution @ess @serverless New terms type rules with asset criticality should be enriched alert with criticality_level
• [job] [logs] x-pack/test/security_solution_api_integration/test_suites/detections_response/detection_engine/rule_execution_logic/basic_license_essentials_tier/configs/serverless.config.ts / Rule execution logic Detection Engine - rule execution @ess @serverless New terms type rules with asset criticality should be enriched alert with criticality_level
• [job] [logs] x-pack/test/security_solution_api_integration/test_suites/detections_response/detection_engine/rule_execution_logic/basic_license_essentials_tier/configs/ess.config.ts / Rule execution logic Detection Engine - rule execution @ess @serverless Threshold type rules generates max alerts warning when circuit breaker is exceeded
• [job] [logs] x-pack/test/security_solution_api_integration/test_suites/detections_response/detection_engine/rule_execution_logic/basic_license_essentials_tier/configs/ess.config.ts / Rule execution logic Detection Engine - rule execution @ess @serverless Threshold type rules generates max alerts warning when circuit breaker is exceeded

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[yctercero]

Don't need to skip entire suite, just flakey tests.