Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Forge] Relax workload sweep ordered_to_commit: 1.5 -> 2.0 #11500

Merged
merged 1 commit into from
Dec 22, 2023

Conversation

bchocho
Copy link
Contributor

@bchocho bchocho commented Dec 22, 2023

Description

The tests are pretty close to the threshold and many recent runs failed due to this. Relaxing for release sanity over the holidays.

Copy link

trunk-io bot commented Dec 22, 2023

@bchocho bchocho marked this pull request as ready for review December 22, 2023 22:51
@bchocho bchocho enabled auto-merge (squash) December 22, 2023 22:56

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

Copy link
Contributor

✅ Forge suite compat success on aptos-node-v1.8.3 ==> 9cf3f7d882b728c85bb85384982c8893d1f1180c

Compatibility test results for aptos-node-v1.8.3 ==> 9cf3f7d882b728c85bb85384982c8893d1f1180c (PR)
1. Check liveness of validators at old version: aptos-node-v1.8.3
compatibility::simple-validator-upgrade::liveness-check : committed: 3567 txn/s, latency: 6344 ms, (p50: 6300 ms, p90: 9200 ms, p99: 13200 ms), latency samples: 192660
2. Upgrading first Validator to new version: 9cf3f7d882b728c85bb85384982c8893d1f1180c
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1854 txn/s, latency: 15653 ms, (p50: 18900 ms, p90: 22000 ms, p99: 22300 ms), latency samples: 92740
3. Upgrading rest of first batch to new version: 9cf3f7d882b728c85bb85384982c8893d1f1180c
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1616 txn/s, latency: 18006 ms, (p50: 19400 ms, p90: 22300 ms, p99: 22600 ms), latency samples: 84060
4. upgrading second batch to new version: 9cf3f7d882b728c85bb85384982c8893d1f1180c
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3413 txn/s, latency: 9277 ms, (p50: 9900 ms, p90: 14400 ms, p99: 14700 ms), latency samples: 136520
5. check swarm health
Compatibility test for aptos-node-v1.8.3 ==> 9cf3f7d882b728c85bb85384982c8893d1f1180c passed
Test Ok

Copy link
Contributor

✅ Forge suite realistic_env_max_load success on 9cf3f7d882b728c85bb85384982c8893d1f1180c

two traffics test: inner traffic : committed: 7717 txn/s, latency: 5032 ms, (p50: 4500 ms, p90: 6100 ms, p99: 12300 ms), latency samples: 3333760
two traffics test : committed: 100 txn/s, latency: 2273 ms, (p50: 2100 ms, p90: 2500 ms, p99: 14500 ms), latency samples: 1760
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.264, avg: 0.207", "QsPosToProposal: max: 0.144, avg: 0.137", "ConsensusProposalToOrdered: max: 0.559, avg: 0.526", "ConsensusOrderedToCommit: max: 0.481, avg: 0.464", "ConsensusProposalToCommit: max: 1.016, avg: 0.990"]
Max round gap was 1 [limit 4] at version 1224197. Max no progress secs was 9.049454 [limit 10] at version 1224197.
Test Ok

@bchocho bchocho merged commit d903d7e into main Dec 22, 2023
79 of 82 checks passed
@bchocho bchocho deleted the brian/relax-workload-sweep-threshold branch December 22, 2023 23:27
Copy link
Contributor

❌ Forge suite framework_upgrade failure on aptos-node-v1.8.3 ==> 9cf3f7d882b728c85bb85384982c8893d1f1180c

Compatibility test results for aptos-node-v1.8.3 ==> 9cf3f7d882b728c85bb85384982c8893d1f1180c (PR)
Upgrade the nodes to version: 9cf3f7d882b728c85bb85384982c8893d1f1180c
Test Failed: API error: Unknown error error sending request for url (http://aptos-node-3-validator.forge-framework-upgrade-pr-11500.svc:8080/v1/estimate_gas_price): error trying to connect: dns error: failed to lookup address information: Name or service not known

Stack backtrace:
   0: <unknown>
   1: <unknown>
   2: <unknown>
   3: <unknown>
   4: <unknown>
   5: <unknown>
   6: <unknown>
   7: <unknown>
   8: <unknown>
   9: <unknown>
  10: <unknown>
  11: <unknown>
  12: __libc_start_main
  13: <unknown>
Trailing Log Lines:
   5: <unknown>
   6: <unknown>
   7: <unknown>
   8: <unknown>
   9: <unknown>
  10: <unknown>
  11: <unknown>
  12: __libc_start_main
  13: <unknown>


Swarm logs can be found here: See fgi output for more information.
thread 'main' panicked at testsuite/forge/src/backend/k8s/swarm.rs:676:18:
called `Result::unwrap()` on an `Err` value: ApiError: namespaces "forge-framework-upgrade-pr-11500" not found: NotFound (ErrorResponse { status: "Failure", message: "namespaces \"forge-framework-upgrade-pr-11500\" not found", reason: "NotFound", code: 404 })

Caused by:
    namespaces "forge-framework-upgrade-pr-11500" not found: NotFound

Stack backtrace:
   0: <unknown>
   1: <unknown>
   2: <unknown>
   3: <unknown>
   4: <unknown>
   5: <unknown>
   6: <unknown>
   7: <unknown>
   8: <unknown>
   9: <unknown>
  10: <unknown>
  11: <unknown>
  12: <unknown>
  13: <unknown>
  14: __libc_start_main
  15: <unknown>
stack backtrace:
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
Debugging output:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants