Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[C++] Nightly Integration Testing Report #1587

Open
github-actions bot opened this issue May 7, 2024 · 0 comments
Open

[C++] Nightly Integration Testing Report #1587

github-actions bot opened this issue May 7, 2024 · 0 comments
Labels
nightly-testing

Comments

@github-actions
Copy link

github-actions bot commented May 7, 2024 •
edited
Loading

Note: This report excludes Firestore. Please also check the report for Firestore.

Testing History (last 7 days)

Date Build vs Source Repo Test vs Source Repo SDK Packaging Build vs SDK Package Test vs SDK Package Notes
2024‑09‑29 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android emulator, Installations on Android emulator, Auth on iOS, and GMA on iOS.
2024‑09‑30 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android emulator, Installations on Android emulator, Auth on iOS, and GMA on iOS.
2024‑10‑01 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android emulator, Installations on Android emulator, Auth on iOS, and GMA on iOS.
2024‑10‑02 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android emulator, Installations on Android emulator, Auth on iOS, and GMA on iOS.
2024‑10‑03 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android emulator, Installations on Android emulator, Auth on iOS, and GMA on iOS.
2024‑10‑04 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android emulator, Installations on Android emulator, Auth on iOS, and GMA on iOS.
View extended history (last 30 days)

Testing History (last 30 days)

Date Build vs Source Repo Test vs Source Repo SDK Packaging Build vs SDK Package Test vs SDK Package Notes
2024‑09‑05 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in GMA on Android, App Check on Android, and Dynamic Links on iOS.
2024‑09‑06 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test flakes in GMA on Android and iOS.
2024‑09‑07 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test flakes in Database on iOS, Analytics on iOS, and GMA on Android.
2024‑09‑08 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test flakes in Database on iOS, Analytics on iOS, and GMA on Android.
2024‑09‑09 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test flakes in Database on iOS, Analytics on iOS, and GMA on Android.
2024‑09‑10 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test flakes in Database on iOS, Analytics on iOS, and GMA on Android.
2024‑09‑11 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test flakes in Database on iOS, Analytics on iOS, and GMA on Android.
2024‑09‑12 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test flakes in GMA on Android and App Check on Android emulator.
2024‑09‑13 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Missing test logs on MacOS, and test flakes in GMA on iOS and Storage on Android emulator.
2024‑09‑14 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Missing test logs on MacOS, and test flakes in GMA on iOS and Storage on Android emulator.
2024‑09‑15 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Missing test logs on MacOS, and test flakes in GMA on iOS and Storage on Android emulator.
2024‑09‑16 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android, Installations on iOS, GMA on Android, and App Check on iOS.
2024‑09‑17 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android, Installations on iOS, GMA on Android, and App Check on iOS.
2024‑09‑18 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test flakes in GMA on iOS, Remote Config on Android, and Storage on Android.
2024‑09‑19 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test flakes in GMA on iOS, Remote Config on Android, and Storage on Android.
2024‑09‑20 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test flakes in GMA on iOS, Remote Config on Android, and Storage on Android.
2024‑09‑21 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test flakes in GMA on iOS, Remote Config on Android, and Storage on Android.
2024‑09‑22 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Missing test logs on iOS simulator, and test flakes in Auth on iOS, Installations on Android emulator, and App Check on Android.
2024‑09‑23 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test flakes in Auth on Android and GMA on Android.
2024‑09‑24 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test flakes in Auth on Android and GMA on Android.
2024‑09‑25 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 Test flakes in Installations on Android emulator, Storage on Android, GMA on iOS, and Auth on iOS.
2024‑09‑26 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 Test flakes in Installations on Android emulator, Storage on Android, GMA on iOS, and Auth on iOS.
2024‑09‑27 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Functions on iOS and Dynamic Links on iOS.
2024‑09‑28 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Functions on iOS and Dynamic Links on iOS.
2024‑09‑29 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android emulator, Installations on Android emulator, Auth on iOS, and GMA on iOS.
2024‑09‑30 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android emulator, Installations on Android emulator, Auth on iOS, and GMA on iOS.
2024‑10‑01 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android emulator, Installations on Android emulator, Auth on iOS, and GMA on iOS.
2024‑10‑02 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android emulator, Installations on Android emulator, Auth on iOS, and GMA on iOS.
2024‑10‑03 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android emulator, Installations on Android emulator, Auth on iOS, and GMA on iOS.
2024‑10‑04 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Storage on Android emulator, Installations on Android emulator, Auth on iOS, and GMA on iOS.
Top 10 flakes/failures (last 30 days)
# Latest Product Platform Test Info
10 2 days ago Storage Android Crash or timeout (flaky)
   Logs: 1 2 3 4 5 6 7 8 9 10
6 1 day ago GMA Android FirebaseGmaTest.TestAdViewLoadAd (flaky)
   Logs: 1 2 3 4 5 6
5 5 days ago Installations Android FirebaseInstallationsTest.TestCanGetToken (flaky)
   Logs: 1 2 3 4 5
5 3 days ago GMA Android FirebaseGmaTest.TestAdView (flaky)
   Logs: 1 2 3 4 5
5 5 days ago GMA iOS Crash or timeout (flaky)
   Logs: 1 2 3 4 5
4 1 day ago GMA Android FirebaseGmaTest.TestInterstitialAdLoad (flaky)
   Logs: 1 2 3 4
4 15 days ago Analytics iOS Crash or timeout (flaky)
   Logs: 1 2 3 4
4 6 days ago Database iOS Crash or timeout (flaky)
   Logs: 1 2 3 4
4 1 day ago GMA Android FirebaseGmaTest.TestRewardedAdLoad (flaky)
   Logs: 1 2 3 4
3 1 day ago Functions iOS Crash or timeout (flaky)
   Logs: 1 2 3
📄
2024-09-29			Pass	Pass (flaky)	Pass	Pass	Pass	Test flakes in Storage on Android emulator, Installations on Android emulator, Auth on iOS, and GMA on iOS.
2024-09-30			Pass	Pass (flaky)	Pass	Pass	Pass	'''
2024-10-01			Pass	Pass (flaky)	Pass	Pass	Pass	'''
2024-10-02			Pass	Pass (flaky)	Pass	Pass	Pass	'''
2024-10-03			Pass	Pass (flaky)	Pass	Pass	Pass	'''
2024-10-04			Pass	Pass (flaky)	Pass	Pass	Pass	'''

❌  [build against repo] Integration test FAILED

Requested by @DellaBitta on commit 1431a42
Last updated: Fri Oct 4 15:15 PDT 2024
View integration test log & download artifacts

Failures Configs
missing_log [TEST] [ERROR] [Android] [2/3 os: windows macos] [1/4 android_device: android_latest]
gma [TEST] [FLAKINESS] [Android] [1/3 os: ubuntu] [1/4 android_device: android_target]
(1 failed tests)  FirebaseGmaTest.TestAdView
[TEST] [FLAKINESS] [iOS] [macos] [1/6 ios_device: ios_latest]
(1 failed tests)  CRASH/TIMEOUT
messaging [TEST] [FLAKINESS] [iOS] [macos] [1/6 ios_device: ios_latest]
(1 failed tests)  CRASH/TIMEOUT
remote_config [TEST] [FLAKINESS] [Android] [1/3 os: windows] [1/4 android_device: emulator_ftl_target]
(1 failed tests)  FirebaseRemoteConfigTest.TestAddOnConfigUpdateListener
storage [TEST] [FLAKINESS] [Android] [1/3 os: windows] [1/4 android_device: android_target]
(1 failed tests)  CRASH/TIMEOUT
[TEST] [FLAKINESS] [iOS] [macos] [1/6 ios_device: ios_latest]
(1 failed tests)  CRASH/TIMEOUT

Add flaky tests to go/fpl-cpp-flake-tracker

❌  [build against SDK] Integration test FAILED

Requested by @firebase-workflow-trigger[bot] on commit 1431a42
Last updated: Fri Oct 4 17:15 PDT 2024
View integration test log & download artifacts

Failures Configs
missing_log [TEST] [ERROR] [Android] [2/3 os: ubuntu macos] [1/4 android_device: android_latest]
database [TEST] [FLAKINESS] [iOS] [macos] [1/6 ios_device: ios_min]
(1 failed tests)  CRASH/TIMEOUT
messaging [TEST] [FLAKINESS] [iOS] [macos] [1/6 ios_device: ios_latest]
(1 failed tests)  CRASH/TIMEOUT
storage [TEST] [FLAKINESS] [Android] [1/3 os: windows] [1/4 android_device: emulator_ftl_target]
(1 failed tests)  CRASH/TIMEOUT

Add flaky tests to go/fpl-cpp-flake-tracker
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
nightly-testing
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
0 participants