Moved presets to the testnet runtimes by bkontur · Pull Request #5327 · paritytech/polkadot-sdk

bkontur · 2024-08-12T14:56:47Z

It is a first step for switching to the frame-omni-bencher for CI.

This PR includes several changes related to generating chain specs plus:

pallet assigned_slots fix missing #[serde(skip)] for phantom
pallet paras_inherent benchmark fix - cherry-picked from fix rococo-dev bench #5688
migrates get_preset to the relevant runtimes
fixes Rococo genesis presets - does not work https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7317249
fixes Rococo benchmarks for CI
migrate westend genesis
remove wococo stuff

Closes: #5680

Follow-ups

Fix for frame-omni-bencher [benchmarking] Reset to genesis storage after each run #5655
Enable new short-benchmarking CI - Enable GHA short benchmarks with frame-omni-bencher #5706
Remove gitlab pipelines for short benchmarking
refactor all Cumulus runtimes to use get_preset - Refactor polkadot-parachain-bin chain-specs for cumulus runtimes and move genesis presets to the runtimes get_preset #5704
Refactor get_account_id_from_seed / get_from_seed to one common place #5705
Only customized fields in preset json blob? #5700
Backport to the stable

bkontur · 2024-08-30T13:37:37Z

@michalkucharczyk I just saw your branch origin/mku-asset-hub-rococo-preset and your PR, I think you are doing the same as I here, but in this PR I've already refactored some of the testnet AssetHubs/BridgeHubs.

What if I update this branch to actual master and then we could merge your PR's changes here and then you could also continue with other runtimes here? wdyt?

michalkucharczyk · 2024-08-30T14:14:37Z

@michalkucharczyk I just saw your branch origin/mku-asset-hub-rococo-preset and your PR, I think you are doing the same as I here, but in this PR I've already refactored some of the testnet AssetHubs/BridgeHubs.

What if I update this branch to actual master and then we could merge your PR's changes here and then you could also continue with other runtimes here? wdyt?

Can we just merge my PR to master (as it is ready to be merged) and then you can merge master to this PR?
I am not sure who will work on reworking rest of runtimes as I am still invoved in #4639 .

michalkucharczyk · 2024-08-30T14:17:19Z

cumulus/polkadot-parachain/src/chain_spec/asset_hubs.rs

-		testnet_parachains_constants::westend::currency::UNITS * 1_000_000,
-		1000.into(),
-	))
+	.with_genesis_config_patch(asset_hub_westend_development_genesis(para_id.into()))


You shall use: with_genesis_config_preset_name.

This would allow to fetch the preset from the wasm blob, w/o necessity to natively compile the runtime.

I noticed the same in polkadot-fellows/runtimes#379 (review)

yes, I saw that fellows comment, it is still in my TODOs :)

bkontur · 2024-08-30T14:25:56Z

@michalkucharczyk I just saw your branch origin/mku-asset-hub-rococo-preset and your PR, I think you are doing the same as I here, but in this PR I've already refactored some of the testnet AssetHubs/BridgeHubs.
What if I update this branch to actual master and then we could merge your PR's changes here and then you could also continue with other runtimes here? wdyt?

Can we just merge my PR to master (as it is ready to be merged) and then you can merge master to this PR? I am not sure who will work on reworking rest of runtimes as I am still invoved in #4639 .

ok, let's merge your and I will adjust and continue here with other testnets

michalkucharczyk · 2024-08-30T14:26:43Z

@michalkucharczyk I just saw your branch origin/mku-asset-hub-rococo-preset and your PR, I think you are doing the same as I here, but in this PR I've already refactored some of the testnet AssetHubs/BridgeHubs.
What if I update this branch to actual master and then we could merge your PR's changes here and then you could also continue with other runtimes here? wdyt?

Can we just merge my PR to master (as it is ready to be merged) and then you can merge master to this PR? I am not sure who will work on reworking rest of runtimes as I am still invoved in #4639 .

ok, let's merge your and I will adjust and continue here with other testnets

Thank you

michalkucharczyk · 2024-08-30T14:27:59Z

Not sure if you are interested - there is one more I plan to merge soon: #4739

paritytech-cicd-pr · 2024-09-01T21:12:22Z

The CI pipeline was cancelled due to failure one of the required jobs.
Job name: test-linux-stable 1/3
Logs: https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7209375

paritytech-cicd-pr · 2024-09-01T21:12:22Z

The CI pipeline was cancelled due to failure one of the required jobs.
Job name: test-linux-stable 3/3
Logs: https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7209377

bkontur · 2024-09-02T11:11:56Z

bot fmt

command-bot · 2024-09-02T11:12:02Z

@bkontur https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7214774 was started for your command "$PIPELINE_SCRIPTS_DIR/commands/fmt/fmt.sh". Check out https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/pipelines?page=1&scope=all&username=group_605_bot to know what else is being executed currently.

Comment bot cancel 2-3568b7dd-c695-4ae7-a3d4-30e9d1fb4ca3 to cancel this command or bot cancel to cancel all commands in this pull request.

command-bot · 2024-09-02T11:13:51Z

@bkontur Command "$PIPELINE_SCRIPTS_DIR/commands/fmt/fmt.sh" has finished. Result: https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7214774 has finished. If any artifacts were generated, you can download them from https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7214774/artifacts/download.

cumulus/parachains/runtimes/assets/asset-hub-westend/src/genesis_config_presets.rs

…testnets

paritytech-cmd-bot-polkadot-sdk · 2024-09-22T17:50:02Z

Created backport PR for stable2407:

[stable2407] Backport #5327 #5797 with remaining conflicts!

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin backport-5327-to-stable2407
git worktree add --checkout .worktree/backport-5327-to-stable2407 backport-5327-to-stable2407
cd .worktree/backport-5327-to-stable2407
git reset --hard HEAD^
git cherry-pick -x 8735c66393978fec6fd811ef7832b08355a2885a
git push --force-with-lease

paritytech-cmd-bot-polkadot-sdk · 2024-09-22T17:50:06Z

Created backport PR for stable2409:

[stable2409] Backport #5327 #5798 with remaining conflicts!

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin backport-5327-to-stable2409
git worktree add --checkout .worktree/backport-5327-to-stable2409 backport-5327-to-stable2409
cd .worktree/backport-5327-to-stable2409
git reset --hard HEAD^
git cherry-pick -x 8735c66393978fec6fd811ef7832b08355a2885a
git push --force-with-lease

It is a first step for switching to the `frame-omni-bencher` for CI. This PR includes several changes related to generating chain specs plus: - [x] pallet `assigned_slots` fix missing `#[serde(skip)]` for phantom - [x] pallet `paras_inherent` benchmark fix - cherry-picked from #5688 - [x] migrates `get_preset` to the relevant runtimes - [x] fixes Rococo genesis presets - does not work https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7317249 - [x] fixes Rococo benchmarks for CI - [x] migrate westend genesis - [x] remove wococo stuff Closes: #5680 - Fix for frame-omni-bencher #5655 - Enable new short-benchmarking CI - #5706 - Remove gitlab pipelines for short benchmarking - refactor all Cumulus runtimes to use `get_preset` - #5704 - #5705 - #5700 - [ ] Backport to the stable --------- Co-authored-by: command-bot <> Co-authored-by: ordian <[email protected]> (cherry picked from commit 8735c66)

Backport #5327 into `stable2409` from bkontur. See the [documentation](https://github.com/paritytech/polkadot-sdk/blob/master/docs/BACKPORT.md) on how to use this bot.  Co-authored-by: Branislav Kontur <[email protected]>

bkontur added T12-benchmarks This PR/Issue is related to benchmarking and weights. T14-system_parachains This PR/Issue is related to system parachains. R0-no-crate-publish-required The change does not require any crates to be re-published. labels Aug 12, 2024

bkontur force-pushed the bko-get_preset-for-testnets branch from 63d05be to 932e369 Compare August 13, 2024 08:54

This was referenced Aug 13, 2024

CI short benchmarking with frame-omni-bencher #4405

Closed

frame-omni-bencher fix for --repeat > 1 #5083

Draft

bkontur force-pushed the bko-get_preset-for-testnets branch from 932e369 to 80475ff Compare August 30, 2024 13:56

michalkucharczyk reviewed Aug 30, 2024

View reviewed changes

bkontur mentioned this pull request Aug 30, 2024

asset-hub-rococo: genesis config presets added #3996

Merged

bkontur force-pushed the bko-get_preset-for-testnets branch 2 times, most recently from 89133a0 to 493ad6b Compare September 1, 2024 21:00

bkontur force-pushed the bko-get_preset-for-testnets branch from 493ad6b to 4ae31df Compare September 2, 2024 11:09

michalkucharczyk reviewed Sep 2, 2024

View reviewed changes

cumulus/parachains/runtimes/assets/asset-hub-westend/src/genesis_config_presets.rs Outdated Show resolved Hide resolved

bkontur force-pushed the bko-get_preset-for-testnets branch from e96f540 to 24d28ae Compare September 2, 2024 19:36

bkontur mentioned this pull request Sep 3, 2024

polkadot-omni-node: Fully remove benchmark sub-command #5564

Closed

bkontur force-pushed the bko-get_preset-for-testnets branch 2 times, most recently from bc435cd to 8238baf Compare September 9, 2024 17:58

bkontur mentioned this pull request Sep 9, 2024

[benchmarking] Reset to genesis storage after each run #5655

Merged

bkontur force-pushed the bko-get_preset-for-testnets branch 2 times, most recently from b95e603 to c35a621 Compare September 11, 2024 09:26

bkontur added 6 commits September 18, 2024 11:06

Update substrate/primitives/genesis-builder/src/lib.rs

b60c89a

prdoc

5308200

Merge remote-tracking branch 'origin/master' into bko-get_preset-for-…

992af98

…testnets

Merge remote-tracking branch 'origin/master' into bko-get_preset-for-…

8a499e0

…testnets

Nits

87ac7ad

Merge remote-tracking branch 'origin/master' into bko-get_preset-for-…

1724235

…testnets

bkontur added this pull request to the merge queue Sep 22, 2024

Merged via the queue into master with commit 8735c66 Sep 22, 2024

bkontur deleted the bko-get_preset-for-testnets branch September 22, 2024 17:04

bkontur added the A4-needs-backport label Sep 22, 2024

paritytech-cmd-bot-polkadot-sdk bot mentioned this pull request Sep 22, 2024

[stable2407] Backport #5327 #5797

Closed

paritytech-cmd-bot-polkadot-sdk bot mentioned this pull request Sep 22, 2024

[stable2409] Backport #5327 #5798

Merged

bkontur had a problem deploying to subsystem-benchmarks September 22, 2024 18:11 — with GitHub Actions Failure

bkontur mentioned this pull request Sep 30, 2024

templates: add genesis config presets for minimal/solochain #5868

Merged

TDemeco mentioned this pull request Oct 14, 2024

feat: ⏫ upgrade to Polkadot SDK stable2409 Moonsong-Labs/storage-hub#228

Merged

github-actions bot mentioned this pull request Feb 26, 2025

Update polkadot-sdk from stable2409 to stable2412 moondance-labs/tanssi#889

Closed

github-actions bot mentioned this pull request Mar 20, 2025

Update polkadot-sdk from stable2409 to stable2412 moonbeam-foundation/moonbeam#3223

Closed

RomarQ mentioned this pull request Apr 2, 2025

Update to polkadot-sdk stable2412 moonbeam-foundation/moonbeam#3224

Merged

16 tasks

ashutoshvarma mentioned this pull request Apr 24, 2025

[Uplift] polkadot-sdk stable2412 uplift AstarNetwork/Astar#1405

Closed

pgherveou added this to [preview] release tracker Mar 20, 2026

github-project-automation bot moved this to Todo in [preview] release tracker Mar 20, 2026

github-project-automation bot moved this from Todo to Done in [preview] release tracker Mar 20, 2026

pgherveou removed this from [preview] release tracker Mar 20, 2026

pgherveou added this to [preview] release tracker Mar 23, 2026

github-project-automation bot moved this to Done in [preview] release tracker Mar 23, 2026

Conversation

bkontur commented Aug 12, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Follow-ups

Uh oh!

bkontur commented Aug 30, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

michalkucharczyk commented Aug 30, 2024

Uh oh!

michalkucharczyk Aug 30, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

bkontur Aug 30, 2024

Choose a reason for hiding this comment

Uh oh!

bkontur commented Aug 30, 2024

Uh oh!

michalkucharczyk commented Aug 30, 2024

Uh oh!

michalkucharczyk commented Aug 30, 2024

Uh oh!

paritytech-cicd-pr commented Sep 1, 2024

Uh oh!

paritytech-cicd-pr commented Sep 1, 2024

Uh oh!

bkontur commented Sep 2, 2024

Uh oh!

command-bot bot commented Sep 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

command-bot bot commented Sep 2, 2024

Uh oh!

Uh oh!

paritytech-cmd-bot-polkadot-sdk bot commented Sep 22, 2024

Uh oh!

paritytech-cmd-bot-polkadot-sdk bot commented Sep 22, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

10 participants

bkontur commented Aug 12, 2024 •

edited

Loading

bkontur commented Aug 30, 2024 •

edited

Loading

michalkucharczyk Aug 30, 2024 •

edited

Loading

command-bot bot commented Sep 2, 2024 •

edited

Loading