update: add soft prompt caps to encoding probes

[leondz]

encoding probes now support soft prompt caps by default. These include prompt set expansion due to custom payloads.

Verification

List the steps needed to make sure this thing works

• run encoding probes with -g 1, check that prompt count is under 256 / soft_probe_prompt_cap
• run encoding probes with extra payloads, check that prompt count is under cap & multiple payloads are represented in the prompts that come through
• configure encoding probe with follow_prompt_cap: false, note that prompt count can go over 256 cap (may require extra payloads)

[jmartin-tech]

The targeted change looks reasonable.

This PR highlights a configurable pattern divergence for this module that should be refactored soon.

The module level _load_payloads() method here should not need to access _config in a hardcoded path. This also causes churn the method level globals for payloads & extra_tags.

[leondz]

Agree, good catch

[erickgalinkin]

lgtm

[jmartin-tech]

Prior to this change triggers were already populated when Probe.__init__() was called.

Merge of #943 suggests some adjustments here to ensure language (bcp47) values behave as expected. Triggers are now being populated after probe initialization without translation. Prompts in this probe may also need to skip translation as the bulk of the prompt is the encoded values injected into templates with limited language instruction and the triggers are specific to the raw payloads.

I suspect adjusting the distribution of payloads as class level param following the patterns in Configurable may offer a clear path forward.

Taking this as an action item to resolve during testing to ensure original PR intent is completed.

[jmartin-tech]

Consistency question noted, thoughts?

[leondz]

Yup, sure. Comment diffs out of date else would've put them through.

[leondz]

Noting the language provision here attempts to translate payloads that are (a) looked for as exact matches (b) may explicitly have non-language assigned. Not to be addressed in the PR.