Skip to content

bugfix: ASR figures in probe docs are now actual ASRs#1392

Merged
jmartin-tech merged 1 commit intoNVIDIA:mainfrom
leondz:bugfix/doc_asr_pass
Oct 1, 2025
Merged

bugfix: ASR figures in probe docs are now actual ASRs#1392
jmartin-tech merged 1 commit intoNVIDIA:mainfrom
leondz:bugfix/doc_asr_pass

Conversation

@leondz
Copy link
Collaborator

@leondz leondz commented Oct 1, 2025

  • prev was pass rate
  • added a note to bag.md to clarify what is measured in the calibration

testing:

  • check that ASR in docs is 1-pass rate in calibration
  • e.g. that leakreplay -Cloze attacks have low-ish ASR, but above 0
  • e.g. that leakreplay -Complete attacks have lower ASR than the -Cloze attacks

@leondz leondz added bug Something isn't working documentation Improvements or additions to documentation labels Oct 1, 2025
@leondz leondz requested a review from jmartin-tech October 1, 2025 10:01
Copy link
Collaborator

@jmartin-tech jmartin-tech left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good!

@jmartin-tech jmartin-tech merged commit 637a23b into NVIDIA:main Oct 1, 2025
17 of 26 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators Oct 1, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

bug Something isn't working documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants