Skip to content

Cleanup Calibration datasets to (temporarily) reduce chain bandwidth pressure before GA #411

@BigLep

Description

@BigLep

Done Criteria

~50% of the ~11k datasets on calibration as of 2026-02-03 are deleted.

Why Important

  1. Reduce the strain on Calibration as discussed in Audit impact of increasing DEFAULT_MAX_PROVING_PERIOD on Calibnet #409
  2. Helps validate that users can self-service delete their datasets and pieces

Notes

  1. Some quick analysis should be done to see the top creator of datasets to ensure that cleaning up dealbot and loadtests will get us the headroom we are looking for.
  2. We don't just want to terminate datasets as termination results in 30 more days of proving by default. We want to also delete pieces.
  3. The suggested set of actions would be: - List all datasets
    • For each dataset
      • List all pieces
      • Delete each piece
      • Terminate the dataset
  4. filecoin-pin already has rm --piece functionality per Add rm --piece $pieceCid command filecoin-project/filecoin-pin#8. Terminating datasets is in progress with Add data-set $dataSetId --terminate filecoin-project/filecoin-pin#189. Those should be the key things someone needs to script the above.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

Status

⌨️ In Progress

Relationships

None yet

Development

No branches or pull requests

Issue actions