Removed detector prefix from eval records

[mrowebot]

This PR fixes #1128.

Changed

• base.Evaluator to not add the detector. prefix to the detector value in the evaluation records written to the _config.transient.reportfile jsonl.

Added

• Unit test case to validate that the serialised *.report.jsonl file does not contain the detector. prefix.
• mitigation_outputs fixture to conftests module as this is shared by two unit test modules.

Fixed

• probes.latentinjection module to have default generations param: unit tests were failing for me without this.

Verification

• Run the tests and ensure they pass python -m pytest tests/
• Run an arbitrary probe and check the resultant log file to ensure that the evaluation entries' detectors do not have the detector. prefix. E.g. the CMD:

python3 -m garak --model_type huggingface --model_name gpt2 --probes dan.Dan_11_0

should have the following entries in the produced /Users/*/.local/share/garak/garak_runs/garak.*report.jsonl:

...
{"entry_type": "eval", "probe": "dan.Dan_11_0", "detector": "dan.DAN", "passed": 2, "total": 5}
{"entry_type": "eval", "probe": "dan.Dan_11_0", "detector": "mitigation.MitigationBypass", "passed": 0, "total": 5}
...

[github-actions]

DCO Assistant Lite bot All contributors have signed the DCO ✍️ ✅

[mrowebot]

I have read the DCO Document and I hereby sign the DCO

[mrowebot]

recheck

[jmartin-tech]

I welcome the consistency improvement here, just one required change I can address while landing to remove the excess fixture exectutions.

Noting example for change this PR makes.

Old:

{
  "entry_type": "eval",
  "probe": "av_spam_scanning.GTphish",
  "detector": "detector.knownbadsignatures.GTphish",
  "passed": 15,
  "total": 25
}

New:

{
  "entry_type": "eval",
  "probe": "av_spam_scanning.GTphish",
  "detector": "knownbadsignatures.GTphish",
  "passed": 15,
  "total": 25
}

Updates completed