Skip to content

[bug]: Excessive disk writes on two litd nodes #1989

@youngzhenhao

Description

@youngzhenhao

Background

I am running two litd nodes on separate devices, each with only one Bitcoin Lightning channel and one Taproot Assets channel. The main activity is sending/receiving a large volume of keysend payments, which results in generating and storing a very large number of invoices.

Both nodes are experiencing extremely high disk write activity, leading to terabytes of writes over ~15 days. This seems abnormal given the minimal channel count and low routing/forwarding volume. The storage is mSATA SSD, and such high write amplification may significantly reduce its lifespan.

One node has lnd.ignore-historical-gossip-filters=true configured, so historical gossip sync is unlikely to be the cause.

Ubuntu does not seem to provide a straightforward way to read cumulative host/NAND write totals directly from the running system (or I may have missed the right tool), so I connected the mSATA SSD to a Windows machine to check the SMART write statistics (Host Writes and NAND Writes) via tools like CrystalDiskInfo.

How do I confirm the root cause of this excessive write activity?

SMART/NVMe write stats:

Device 1

  • Period: 2026-01-27 09:31:34 → 2026-02-11 10:10:08 (~15 days)
  • Host total writes delta: 10233 GB (~680 GB/day)
  • NAND total writes delta: 7131 GB (~475 GB/day)

Device 2

  • Period: 2026-01-27 09:26:38 → 2026-02-11 10:01:49 (~15 days)
  • Host total writes delta: 4605 GB (~307 GB/day)
  • NAND total writes delta: 5347 GB (~356 GB/day)

Your environment

litd version 0.16.0-alpha
Ubuntu 24.04 LTS live server
neutrino

Other

  • Device 1 lit.conf
lnd.bitcoin.node=neutrino
lnd.bitcoin.mainnet=true
lnd.bitcoin.defaultchanconfs=1
lnd.ignore-historical-gossip-filters=true

[Application Options]
lnd-mode=integrated
httpslisten=127.0.0.1:8443
uipassword_file=/root/.lit/uipassword
network=mainnet
autopilot.disable=true

[Integrated lnd (use when lnd-mode=integrated)]
lnd.alias=123
lnd.debuglevel=info
lnd.maxbackoff=2s
lnd.sync-freelist=true
lnd.accept-keysend=true
lnd.tlsdisableautofill=true
lnd.maxpendingchannels=1000
lnd.max-commit-fee-rate-anchors=20
lnd.accept-positive-inbound-fees=true
lnd.payments-expiration-grace-period=24h
lnd.norest=1
lnd.rpclisten=127.0.0.1:10009
lnd.coin-selection-strategy=random
lnd.bitcoin.active=true
lnd.wallet-unlock-password-file=/root/.lit/password
lnd.wallet-unlock-allow-create=true
lnd.externalip=123.123.123.123:9735

[db]
lnd.db.no-graph-cache=false

[bolt]
lnd.db.bolt.auto-compact=false

[routing]
lnd.routing.strictgraphpruning=false

[neutrino]
lnd.neutrino.maxpeers=125
lnd.neutrino.banduration=10m
lnd.neutrino.banthreshold=20
lnd.neutrino.addpeer=123.123.123.123:8333
lnd.neutrino.addpeer=123.123.123.123:8333
lnd.neutrino.addpeer=123.123.123.123:8333
lnd.neutrino.broadcasttimeout=10s
lnd.neutrino.persistfilters=true

[fee]
lnd.fee.url=https://nodes.lightning.computer/fees/v1/btc-fee-estimates.json

[Autopilot]
lnd.autopilot.active=false
lnd.autopilot.private=true
lnd.autopilot.minconfs=1
lnd.autopilot.conftarget=3
lnd.autopilot.allocation=0.5
lnd.autopilot.heuristic=externalscore:1.00
lnd.autopilot.heuristic=preferential:0.00

[protocol]
lnd.protocol.wumbo-channels=true
lnd.protocol.zero-conf=true
lnd.protocol.option-scid-alias=true
lnd.protocol.simple-taproot-chans=true
lnd.protocol.simple-taproot-overlay-chans=true
lnd.protocol.custom-message=17

[routerrpc]
lnd.routerrpc.estimator=apriori

[rpcmiddleware]
lnd.rpcmiddleware.enable=true
lnd.rpcmiddleware.intercepttimeout=2s

[Integrated faraday options (use when faraday-mode=integrated)]
#faraday.faradaydir=

[Integrated loop options (use when loop-mode=integrated)]
#loop.loopdir=

[Integrated pool options (use when pool-mode=integrated)]
#pool.basedir=

[Integrated taproot assets options (use when taproot-assets=integrated)]
taproot-assets.network=mainnet
taproot-assets.universe.federationserver=123.123.123.123:8444
taproot-assets.proofcourieraddr=universerpc://123.123.123.123:8444
taproot-assets.experimental.rfq.priceoracleaddress=rfqrpc://123.123.123.123:1234

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    Status

    🆕 New

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions