Skip to content

Commit

Permalink
Update benchmark result for small_e2e
Browse files Browse the repository at this point in the history
  • Loading branch information
@github-actions
github-actions[bot] committed Nov 2, 2024
1 parent 1cd9524 commit 503e0e8
Showing 1 changed file with 26 additions and 26 deletions.
52 changes: 26 additions & 26 deletions benchmarks/small_e2e.md
View file
Original file line number Diff line number Diff line change
@@ -1,16 +1,16 @@
| group | total_cells_used | total_cycles | total_proof_time_ms |
| --- | --- | --- | --- |
| bench_program_inner | <div style='text-align: right'>341,581</div> | <div style='text-align: right'>42</div> | <span style="color: red">(+8.0 [+0.6%])</span> <div style='text-align: right'>1,449.0</div> |
| inner_verifier | <span style="color: red">(+7,180 [+0.0%])</span> <div style='text-align: right'>270,748,821</div> | <span style="color: red">(+614 [+0.0%])</span> <div style='text-align: right'>6,362,230</div> | <span style="color: red">(+1,311.0 [+1.4%])</span> <div style='text-align: right'>92,013.0</div> |
| bench_program_inner | <div style='text-align: right'>341,581</div> | <div style='text-align: right'>42</div> | <span style="color: red">(+90.0 [+6.2%])</span> <div style='text-align: right'>1,539.0</div> |
| inner_verifier | <span style="color: red">(+1,050 [+0.0%])</span> <div style='text-align: right'>270,749,871</div> | <span style="color: red">(+184 [+0.0%])</span> <div style='text-align: right'>6,362,414</div> | <span style="color: red">(+3,757.0 [+4.1%])</span> <div style='text-align: right'>95,770.0</div> |


<details>
<summary>Detailed Metrics</summary>

| group | execute_and_trace_gen_time_ms | execute_time_ms | stark_prove_excluding_trace_time_ms | total_cells | total_cells_used | total_cycles | total_proof_time_ms | verify_program_compile_ms |
| --- | --- | --- | --- | --- | --- | --- | --- | --- |
| bench_program_inner | <div style='text-align: right'>19.0</div> | <div style='text-align: right'>17.0</div> | <span style="color: red">(+8.0 [+0.6%])</span> <div style='text-align: right'>1,430.0</div> | <div style='text-align: right'>1,980,240</div> | <div style='text-align: right'>341,581</div> | <div style='text-align: right'>42</div> | <span style="color: red">(+8.0 [+0.6%])</span> <div style='text-align: right'>1,449.0</div> | |
| inner_verifier | <span style="color: red">(+10.0 [+0.1%])</span> <div style='text-align: right'>9,484.0</div> | <span style="color: red">(+7.0 [+0.1%])</span> <div style='text-align: right'>7,864.0</div> | <span style="color: red">(+1,301.0 [+1.6%])</span> <div style='text-align: right'>82,529.0</div> | <div style='text-align: right'>651,755,544</div> | <span style="color: red">(+7,180 [+0.0%])</span> <div style='text-align: right'>270,748,821</div> | <span style="color: red">(+614 [+0.0%])</span> <div style='text-align: right'>6,362,230</div> | <span style="color: red">(+1,311.0 [+1.4%])</span> <div style='text-align: right'>92,013.0</div> | <span style="color: green">(-263.0 [-0.6%])</span> <div style='text-align: right'>43,187.0</div> |
| bench_program_inner | <div style='text-align: right'>19.0</div> | <div style='text-align: right'>17.0</div> | <span style="color: red">(+90.0 [+6.3%])</span> <div style='text-align: right'>1,520.0</div> | <div style='text-align: right'>1,980,240</div> | <div style='text-align: right'>341,581</div> | <div style='text-align: right'>42</div> | <span style="color: red">(+90.0 [+6.2%])</span> <div style='text-align: right'>1,539.0</div> | |
| inner_verifier | <span style="color: red">(+119.0 [+1.3%])</span> <div style='text-align: right'>9,603.0</div> | <span style="color: red">(+52.0 [+0.7%])</span> <div style='text-align: right'>7,916.0</div> | <span style="color: red">(+3,638.0 [+4.4%])</span> <div style='text-align: right'>86,167.0</div> | <div style='text-align: right'>651,755,544</div> | <span style="color: red">(+1,050 [+0.0%])</span> <div style='text-align: right'>270,749,871</div> | <span style="color: red">(+184 [+0.0%])</span> <div style='text-align: right'>6,362,414</div> | <span style="color: red">(+3,757.0 [+4.1%])</span> <div style='text-align: right'>95,770.0</div> | <span style="color: green">(-20.0 [-0.0%])</span> <div style='text-align: right'>43,167.0</div> |

| group | chip_name | rows_used |
| --- | --- | --- |
Expand All @@ -27,12 +27,12 @@
| bench_program_inner | Memory Boundary | <div style='text-align: right'>65</div> |
| bench_program_inner | ProgramChip | <div style='text-align: right'>37</div> |
| inner_verifier | BranchEqual | <div style='text-align: right'>706,303</div> |
| inner_verifier | FieldArithmetic | <span style="color: red">(+3 [+0.0%])</span> <div style='text-align: right'>1,595,220</div> |
| inner_verifier | FieldArithmetic | <span style="color: red">(+6 [+0.0%])</span> <div style='text-align: right'>1,595,226</div> |
| inner_verifier | FieldExtension | <div style='text-align: right'>857,974</div> |
| inner_verifier | Jal | <span style="color: red">(+611 [+2.1%])</span> <div style='text-align: right'>29,948</div> |
| inner_verifier | Jal | <span style="color: red">(+178 [+0.6%])</span> <div style='text-align: right'>30,126</div> |
| inner_verifier | LoadStore | <div style='text-align: right'>2,928,722</div> |
| inner_verifier | Memory AccessAdapter<2> | <span style="color: red">(+56 [+0.0%])</span> <div style='text-align: right'>1,976,563</div> |
| inner_verifier | Memory AccessAdapter<4> | <span style="color: red">(+28 [+0.0%])</span> <div style='text-align: right'>988,325</div> |
| inner_verifier | Memory AccessAdapter<2> | <span style="color: green">(-52 [-0.0%])</span> <div style='text-align: right'>1,976,511</div> |
| inner_verifier | Memory AccessAdapter<4> | <span style="color: green">(-26 [-0.0%])</span> <div style='text-align: right'>988,299</div> |
| inner_verifier | Memory AccessAdapter<8> | <div style='text-align: right'>33,560</div> |
| inner_verifier | Memory Boundary | <div style='text-align: right'>598,936</div> |
| inner_verifier | Phantom | <div style='text-align: right'>223,666</div> |
Expand Down Expand Up @@ -66,7 +66,7 @@
| inner_verifier | AddEFFI | STOREW | <div style='text-align: right'>399</div> |
| inner_verifier | AddEFI | ADD | <div style='text-align: right'>224</div> |
| inner_verifier | AddEI | ADD | <div style='text-align: right'>67,996</div> |
| inner_verifier | AddFI | ADD | <span style="color: red">(+3 [+0.0%])</span> <div style='text-align: right'>14,051</div> |
| inner_verifier | AddFI | ADD | <span style="color: red">(+6 [+0.0%])</span> <div style='text-align: right'>14,057</div> |
| inner_verifier | AddV | ADD | <div style='text-align: right'>6,262</div> |
| inner_verifier | AddVI | ADD | <div style='text-align: right'>278,789</div> |
| inner_verifier | Alloc | ADD | <div style='text-align: right'>24,557</div> |
Expand Down Expand Up @@ -108,7 +108,7 @@
| inner_verifier | HintInputVec | PHANTOM | <div style='text-align: right'>9,724</div> |
| inner_verifier | IfEq | BNE | <div style='text-align: right'>7,629</div> |
| inner_verifier | IfEqI | BNE | <div style='text-align: right'>124,910</div> |
| inner_verifier | IfEqI | JAL | <span style="color: red">(+611 [+6.5%])</span> <div style='text-align: right'>10,065</div> |
| inner_verifier | IfEqI | JAL | <span style="color: red">(+178 [+1.8%])</span> <div style='text-align: right'>10,243</div> |
| inner_verifier | IfNe | BEQ | <div style='text-align: right'>6,893</div> |
| inner_verifier | IfNe | JAL | <div style='text-align: right'>20</div> |
| inner_verifier | IfNeI | BEQ | <div style='text-align: right'>1,079</div> |
Expand Down Expand Up @@ -207,10 +207,10 @@
| inner_verifier | AccessAdapter<4> | AddEFI | ADD | <div style='text-align: right'>507</div> |
| inner_verifier | Boundary | AddEFI | ADD | <div style='text-align: right'>1,232</div> |
| inner_verifier | <NativeAdapterAir<2, 1>,FieldArithmeticCoreAir> | AddEI | ADD | <div style='text-align: right'>2,039,880</div> |
| inner_verifier | AccessAdapter<2> | AddEI | ADD | <span style="color: red">(+308 [+0.1%])</span> <div style='text-align: right'>381,876</div> |
| inner_verifier | AccessAdapter<4> | AddEI | ADD | <span style="color: red">(+182 [+0.1%])</span> <div style='text-align: right'>225,654</div> |
| inner_verifier | AccessAdapter<2> | AddEI | ADD | <span style="color: green">(-286 [-0.1%])</span> <div style='text-align: right'>381,590</div> |
| inner_verifier | AccessAdapter<4> | AddEI | ADD | <span style="color: green">(-169 [-0.1%])</span> <div style='text-align: right'>225,485</div> |
| inner_verifier | Boundary | AddEI | ADD | <div style='text-align: right'>660,220</div> |
| inner_verifier | <NativeAdapterAir<2, 1>,FieldArithmeticCoreAir> | AddFI | ADD | <span style="color: red">(+90 [+0.0%])</span> <div style='text-align: right'>421,530</div> |
| inner_verifier | <NativeAdapterAir<2, 1>,FieldArithmeticCoreAir> | AddFI | ADD | <span style="color: red">(+180 [+0.0%])</span> <div style='text-align: right'>421,710</div> |
| inner_verifier | Boundary | AddFI | ADD | <div style='text-align: right'>264</div> |
| inner_verifier | <NativeAdapterAir<2, 1>,FieldArithmeticCoreAir> | AddV | ADD | <div style='text-align: right'>187,860</div> |
| inner_verifier | Boundary | AddV | ADD | <div style='text-align: right'>22</div> |
Expand Down Expand Up @@ -273,7 +273,7 @@
| inner_verifier | PhantomAir | HintInputVec | PHANTOM | <div style='text-align: right'>58,344</div> |
| inner_verifier | <BranchNativeAdapterAir,BranchEqualCoreAir<1>> | IfEq | BNE | <div style='text-align: right'>175,467</div> |
| inner_verifier | <BranchNativeAdapterAir,BranchEqualCoreAir<1>> | IfEqI | BNE | <div style='text-align: right'>2,872,930</div> |
| inner_verifier | <JalNativeAdapterAir,JalCoreAir> | IfEqI | JAL | <span style="color: red">(+6,110 [+6.5%])</span> <div style='text-align: right'>100,650</div> |
| inner_verifier | <JalNativeAdapterAir,JalCoreAir> | IfEqI | JAL | <span style="color: red">(+1,780 [+1.8%])</span> <div style='text-align: right'>102,430</div> |
| inner_verifier | <BranchNativeAdapterAir,BranchEqualCoreAir<1>> | IfNe | BEQ | <div style='text-align: right'>158,539</div> |
| inner_verifier | <JalNativeAdapterAir,JalCoreAir> | IfNe | JAL | <div style='text-align: right'>200</div> |
| inner_verifier | <BranchNativeAdapterAir,BranchEqualCoreAir<1>> | IfNeI | BEQ | <div style='text-align: right'>24,817</div> |
Expand Down Expand Up @@ -308,8 +308,8 @@
| inner_verifier | <NativeLoadStoreAdapterAir<1>,KernelLoadStoreCoreAir<1>> | LoadV | LOADW2 | <div style='text-align: right'>2,946,998</div> |
| inner_verifier | Boundary | LoadV | LOADW2 | <div style='text-align: right'>935</div> |
| inner_verifier | <NativeVectorizedAdapterAir<4>,FieldExtensionCoreAir> | MulE | BBE4MUL | <div style='text-align: right'>16,608,240</div> |
| inner_verifier | AccessAdapter<2> | MulE | BBE4MUL | <span style="color: red">(+308 [+0.1%])</span> <div style='text-align: right'>496,232</div> |
| inner_verifier | AccessAdapter<4> | MulE | BBE4MUL | <span style="color: red">(+182 [+0.1%])</span> <div style='text-align: right'>293,228</div> |
| inner_verifier | AccessAdapter<2> | MulE | BBE4MUL | <span style="color: green">(-286 [-0.1%])</span> <div style='text-align: right'>495,946</div> |
| inner_verifier | AccessAdapter<4> | MulE | BBE4MUL | <span style="color: green">(-169 [-0.1%])</span> <div style='text-align: right'>293,059</div> |
| inner_verifier | Boundary | MulE | BBE4MUL | <div style='text-align: right'>698,060</div> |
| inner_verifier | <NativeAdapterAir<2, 1>,FieldArithmeticCoreAir> | MulEF | MUL | <div style='text-align: right'>51,960</div> |
| inner_verifier | AccessAdapter<2> | MulEF | MUL | <div style='text-align: right'>8,514</div> |
Expand Down Expand Up @@ -430,17 +430,17 @@
<details>
<summary>Flamegraphs</summary>

[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-bench_program_inner.dsl_ir.opcode.air_name.cells_used.reverse.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-bench_program_inner.dsl_ir.opcode.air_name.cells_used.reverse.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-bench_program_inner.dsl_ir.opcode.air_name.cells_used.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-bench_program_inner.dsl_ir.opcode.air_name.cells_used.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-bench_program_inner.dsl_ir.opcode.frequency.reverse.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-bench_program_inner.dsl_ir.opcode.frequency.reverse.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-bench_program_inner.dsl_ir.opcode.frequency.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-bench_program_inner.dsl_ir.opcode.frequency.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-inner_verifier.dsl_ir.opcode.air_name.cells_used.reverse.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-inner_verifier.dsl_ir.opcode.air_name.cells_used.reverse.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-inner_verifier.dsl_ir.opcode.air_name.cells_used.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-inner_verifier.dsl_ir.opcode.air_name.cells_used.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-inner_verifier.dsl_ir.opcode.frequency.reverse.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-inner_verifier.dsl_ir.opcode.frequency.reverse.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-inner_verifier.dsl_ir.opcode.frequency.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/1c36cc1623daf114fec9f60cedbeca9759b93714/small_e2e-inner_verifier.dsl_ir.opcode.frequency.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-bench_program_inner.dsl_ir.opcode.air_name.cells_used.reverse.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-bench_program_inner.dsl_ir.opcode.air_name.cells_used.reverse.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-bench_program_inner.dsl_ir.opcode.air_name.cells_used.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-bench_program_inner.dsl_ir.opcode.air_name.cells_used.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-bench_program_inner.dsl_ir.opcode.frequency.reverse.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-bench_program_inner.dsl_ir.opcode.frequency.reverse.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-bench_program_inner.dsl_ir.opcode.frequency.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-bench_program_inner.dsl_ir.opcode.frequency.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-inner_verifier.dsl_ir.opcode.air_name.cells_used.reverse.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-inner_verifier.dsl_ir.opcode.air_name.cells_used.reverse.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-inner_verifier.dsl_ir.opcode.air_name.cells_used.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-inner_verifier.dsl_ir.opcode.air_name.cells_used.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-inner_verifier.dsl_ir.opcode.frequency.reverse.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-inner_verifier.dsl_ir.opcode.frequency.reverse.svg)
[![](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-inner_verifier.dsl_ir.opcode.frequency.svg)](https://axiom-public-data-sandbox-us-east-1.s3.us-east-1.amazonaws.com/benchmark/github/flamegraphs/9b82ff0b3c28814e5257c580fd785c0c584b4508/small_e2e-inner_verifier.dsl_ir.opcode.frequency.svg)

</details>

Commit: https://github.com/axiom-crypto/afs-prototype/commit/1c36cc1623daf114fec9f60cedbeca9759b93714
Commit: https://github.com/axiom-crypto/afs-prototype/commit/9b82ff0b3c28814e5257c580fd785c0c584b4508
Instance Type: 64cpu-linux-arm64
[Benchmark Workflow](https://github.com/axiom-crypto/afs-prototype/actions/runs/11638876514)
[Benchmark Workflow](https://github.com/axiom-crypto/afs-prototype/actions/runs/11639164351)

0 comments on commit 503e0e8

Please sign in to comment.