Skip to content
Merged
Show file tree
Hide file tree
Changes from 57 commits
Commits
Show all changes
58 commits
Select commit Hold shift + click to select a range
ea41888
Implement phase 3 of shielded sync
batconjurer Jul 9, 2024
be08bce
Generalize the shutdown signal abstraction in the sdk
sug0 Jul 29, 2024
684887b
Add progress trackers to ss
sug0 Jul 29, 2024
7e292f0
Start ss from last query height
sug0 Jul 30, 2024
a861234
Increment ss progress bars by given block ranges
sug0 Jul 30, 2024
bb5682a
Remove ss start height param
sug0 Jul 30, 2024
d27e5a9
Always start ss from min vk height
sug0 Jul 30, 2024
5828a4d
Set correct upper bound on ss progress bars
sug0 Jul 30, 2024
746aed7
Limit number of concurrent ledger client requests
sug0 Jul 30, 2024
6b3d8d4
Limit number of concurrent indexer client requests
sug0 Jul 30, 2024
0bb28e8
Remove async from extract_masp_tx
sug0 Jul 30, 2024
3f7e9ef
Improve pre_cache_transaction
sug0 Jul 30, 2024
51a22ca
Remove scan_tx
sug0 Jul 30, 2024
bac111a
Allow ss fetch to run in wasm
sug0 Jul 30, 2024
2b60270
Remove ss specific TODOs
sug0 Jul 30, 2024
e2cd22a
Spelling
sug0 Jul 30, 2024
26095ef
Fix note positions bug in ss
sug0 Jul 31, 2024
4639363
Only store valid notes and their offsets
sug0 Jul 31, 2024
f239ca1
Make shutdown signal aware of whether a tokio rt is running
sug0 Aug 1, 2024
79d612c
Fixing unit tests
batconjurer Aug 1, 2024
75f7ea0
Cleanups and test fixes
batconjurer Aug 1, 2024
f150969
Improved progress bars
batconjurer Aug 1, 2024
d3a7608
Cleanup dependencies
sug0 Aug 1, 2024
981d784
Fetch latest block index from masp indexer
sug0 Aug 1, 2024
cefc882
Skip fetching blocks without masp txs in indexer client
sug0 Aug 1, 2024
f661630
Make block index calls optional
sug0 Aug 1, 2024
5ab214a
Bump `init_once`
sug0 Aug 1, 2024
42fca85
Cleanups after rebasing on main
batconjurer Aug 2, 2024
d2b2068
fixed checked crates
batconjurer Aug 2, 2024
d3807cc
Bump `init_once`
sug0 Aug 2, 2024
7e30b94
Implement shielded sync cache IO for benches
sug0 Aug 2, 2024
92e64cc
Bump `init_once`
sug0 Aug 5, 2024
ca3e993
Wait until ss target height is available
sug0 Aug 7, 2024
c0fcf87
Wait for the channel to drain
sug0 Aug 8, 2024
3b8f55f
Unlock rayon dependency
sug0 Aug 8, 2024
c2c9c43
Clone rpc client
sug0 Aug 8, 2024
87546ff
Fetch blocks not accounted for by the masp txs block index
sug0 Aug 9, 2024
e77a00d
Print progress on applied scanned txs
sug0 Aug 9, 2024
6c6bf7a
Optionally announce exit on interrupt signal
sug0 Aug 9, 2024
622bc8d
Replace tracing calls with bar specific io
sug0 Aug 9, 2024
e2cb092
Add shutdown signal to shielded sync config
sug0 Aug 9, 2024
528bd32
Expose max concurrent fetches
sug0 Aug 9, 2024
c1734e1
Tested the block filter and fixed an off-by-one error
batconjurer Aug 12, 2024
a61ba30
Added retry strategy to shielded sync args
batconjurer Aug 12, 2024
01934d3
Tiny
batconjurer Aug 13, 2024
8561699
Renamed tx_note_map to note_index
batconjurer Aug 13, 2024
715a7d4
Renamed main ss method from fetch to sync
batconjurer Aug 13, 2024
b06673a
Remaining notes map rename
sug0 Aug 13, 2024
90b7478
Simplify IntoIter impl
sug0 Aug 13, 2024
9a887e1
Fetch concurrently within masp tx indexer client rpc method
sug0 Aug 13, 2024
8293cc4
Fix CLI formatting
sug0 Aug 13, 2024
e0d5287
Undo accidental find-replaces
sug0 Aug 13, 2024
2804a82
Avoid redundant `is_err` check
sug0 Aug 13, 2024
deb3e43
Fix error string
sug0 Aug 13, 2024
d09f4b8
Fix benchmarks
sug0 Aug 14, 2024
fa6ecf8
Fix inaccessible indexer client
sug0 Aug 14, 2024
b689533
Changelog for #3578
sug0 Aug 2, 2024
9626233
Merge remote-tracking branch 'origin/main' into tiago+jacob/masp-ss-c…
sug0 Aug 16, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .changelog/unreleased/SDK/3578-masp-ss-client-phase-3.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
- Parallelize the shielded sync implementation in Namada.
([\#3578](https://github.com/anoma/namada/pull/3578))
77 changes: 75 additions & 2 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

7 changes: 6 additions & 1 deletion Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -109,6 +109,7 @@ expectrl = "0.7.0"
eyre = "0.6.12"
fd-lock = "3.0.12"
flate2 = "1.0.22"
flume = "0.11.0"
fs_extra = "1.2.0"
futures = "0.3"
git2 = { version = "0.18.1", default-features = false }
Expand All @@ -118,9 +119,11 @@ ibc-testkit = { git = "https://github.com/heliaxdev/cosmos-ibc-rs", rev = "9f2df
ics23 = "0.11.0"
index-set = { git = "https://github.com/heliaxdev/index-set", tag = "v0.8.1", features = ["serialize-borsh", "serialize-serde"] }
indexmap = { git = "https://github.com/heliaxdev/indexmap", tag = "2.2.4-heliax-1", features = ["borsh-schema", "serde"] }
init-once = "0.6.0"
itertools = "0.12.1"
jubjub = "0.10"
k256 = { version = "0.13.0", default-features = false, features = ["ecdsa", "pkcs8", "precomputed-tables", "serde", "std"]}
kdam = "0.5.2"
konst = { version = "0.3.8", default-features = false }
lazy_static = "1.4.0"
ledger-namada-rs = { git = "https://github.com/Zondax/ledger-namada", tag = "v0.0.24" }
Expand Down Expand Up @@ -149,7 +152,7 @@ prost = "0.12.0"
prost-types = "0.12.0"
rand = {version = "0.8", default-features = false}
rand_core = {version = "0.6", default-features = false}
rayon = "=1.5.3"
rayon = "1.5.3"
regex = "1.10.2"
reqwest = "0.11.4"
ripemd = "0.1"
Expand Down Expand Up @@ -191,6 +194,7 @@ tracing = "0.1.30"
tracing-appender = "0.2.2"
tracing-log = "0.2.0"
tracing-subscriber = {version = "0.3.7", default-features = false, features = ["env-filter", "fmt"]}
typed-builder = "0.19.1"
wasmparser = "0.107.0"
wasm-instrument = {version = "0.4.0", features = ["sign_ext"]}
wasmer = "4.3.5"
Expand All @@ -201,6 +205,7 @@ wasmer-types = "4.3.5"
wasmer-vm = "4.3.5"
wasmtimer = "0.2.0"
winapi = "0.3.9"
xorf = { version = "0.11.0", features = ["serde"] }
yansi = "0.5.1"
zeroize = { version = "1.5.5", features = ["zeroize_derive"] }

Expand Down
1 change: 1 addition & 0 deletions crates/apps_lib/Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -54,6 +54,7 @@ fd-lock.workspace = true
flate2.workspace = true
futures.workspace = true
itertools.workspace = true
kdam.workspace = true
lazy_static = { workspace = true, optional = true }
linkme = { workspace = true, optional = true }
ledger-namada-rs.workspace = true
Expand Down
Loading