Skip to content

Wip partial notes#4857

Closed
alexghr wants to merge 9 commits intomasterfrom
wip-partial-note
Closed

Wip partial notes#4857
alexghr wants to merge 9 commits intomasterfrom
wip-partial-note

Conversation

@alexghr
Copy link
Copy Markdown
Contributor

@alexghr alexghr commented Feb 29, 2024

wip PR, just for running tests

@AztecBot
Copy link
Copy Markdown
Collaborator

AztecBot commented Feb 29, 2024

Benchmark results

Metrics with a significant change:

  • note_trial_decrypting_time_in_ms (8): 30.6 (+91%)
Detailed results

All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.

This benchmark source data is available in JSON format on S3 here.

Values are compared against data from master at commit 237f870c and shown if the difference exceeds 1%.

L2 block published to L1

Each column represents the number of txs on an L2 block published to L1.

Metric 8 txs 32 txs 128 txs
l1_rollup_calldata_size_in_bytes 54,212 214,436 855,332
l1_rollup_calldata_gas 259,928 1,019,852 4,056,884
l1_rollup_execution_gas 354,114 1,139,300 4,278,285
l2_block_processing_time_in_ms 1,197 (-1%) 4,535 (-10%) 17,979 (-1%)
note_successful_decrypting_time_in_ms 218 (+8%) 616 (+6%) 2,200 (+12%)
note_trial_decrypting_time_in_ms ⚠️ 30.6 (+91%) 50.0 (-58%) 184 (+12%)
l2_block_building_time_in_ms 15,978 63,482 257,551
l2_block_rollup_simulation_time_in_ms 12,241 48,687 198,472
l2_block_public_tx_process_time_in_ms 3,706 14,723 58,810

L2 chain processing

Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric 5 blocks 10 blocks
node_history_sync_time_in_ms 15,730 (+2%) 28,965 (-2%)
note_history_successful_decrypting_time_in_ms 1,434 (-1%) 2,783 (+7%)
note_history_trial_decrypting_time_in_ms 166 (+6%) 227 (-13%)
node_database_size_in_bytes 19,054,672 36,577,360 (+1%)
pxe_database_size_in_bytes 29,923 59,478

Circuits stats

Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit circuit_simulation_time_in_ms circuit_input_size_in_bytes circuit_output_size_in_bytes
private-kernel-init 238 (-2%) 44,664 27,457
private-kernel-ordering 153 (-2%) 45,777 14,627
base-rollup 1,300 (-1%) 175,344 933
root-rollup 70.4 (-2%) 4,192 825
private-kernel-inner 302 (-2%) 73,099 27,457
public-kernel-app-logic 185 (-2%) 32,254 25,379
merge-rollup 5.72 (-1%) 2,712 933

Tree insertion stats

The duration to insert a fixed batch of leaves into each tree type.

Metric 1 leaves 2 leaves 8 leaves 16 leaves 32 leaves 128 leaves 64 leaves 512 leaves 1024 leaves 2048 leaves 8192 leaves
batch_insert_into_append_only_tree_16_depth_ms 9.95 11.2 (-3%) 15.7 (+24%) 16.4 (-2%) 22.1 61.7 (-24%) N/A N/A N/A N/A N/A
batch_insert_into_append_only_tree_16_depth_hash_count 16.9 17.5 23.0 31.6 47.0 143 N/A N/A N/A N/A N/A
batch_insert_into_append_only_tree_16_depth_hash_ms 0.576 0.625 (-2%) 0.668 (+25%) 0.505 (-2%) 0.463 0.426 (-24%) N/A N/A N/A N/A N/A
batch_insert_into_append_only_tree_32_depth_ms N/A N/A N/A N/A N/A 72.3 (-2%) 46.1 229 (-2%) 449 (+1%) 864 (-1%) 3,413
batch_insert_into_append_only_tree_32_depth_hash_count N/A N/A N/A N/A N/A 159 96.0 543 1,055 2,079 8,223
batch_insert_into_append_only_tree_32_depth_hash_ms N/A N/A N/A N/A N/A 0.447 (-1%) 0.472 0.419 0.420 (+1%) 0.411 (-1%) 0.410
batch_insert_into_indexed_tree_20_depth_ms N/A N/A N/A N/A N/A 100 (-1%) 54.5 (-2%) 337 (-1%) 666 1,319 (-1%) 5,244 (-1%)
batch_insert_into_indexed_tree_20_depth_hash_count N/A N/A N/A N/A N/A 197 104 691 1,363 2,707 10,771
batch_insert_into_indexed_tree_20_depth_hash_ms N/A N/A N/A N/A N/A 0.476 0.480 (-2%) 0.457 (-1%) 0.457 0.457 (-1%) 0.456 (-1%)
batch_insert_into_indexed_tree_40_depth_ms N/A N/A N/A N/A 62.0 N/A N/A N/A N/A N/A N/A
batch_insert_into_indexed_tree_40_depth_hash_count N/A N/A N/A N/A 110 N/A N/A N/A N/A N/A N/A
batch_insert_into_indexed_tree_40_depth_hash_ms N/A N/A N/A N/A 0.537 N/A N/A N/A N/A N/A N/A

Miscellaneous

Transaction sizes based on how many contracts are deployed in the tx.

Metric 0 deployed contracts
tx_size_in_bytes 18,431

Transaction processing duration by data writes.

Metric 0 new note hashes 1 new note hashes
tx_pxe_processing_time_ms 2,518 (-1%) 1,287 (-2%)
Metric 0 public data writes 1 public data writes
tx_sequencer_processing_time_ms 0.0253 (-29%) 456 (-1%)

@alexghr
Copy link
Copy Markdown
Contributor Author

alexghr commented Mar 7, 2024

superseded by #4891

@alexghr alexghr closed this Mar 7, 2024
@alexghr alexghr deleted the wip-partial-note branch March 7, 2024 09:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants