Skip to content

docs: clarify model graded history prompts#4090

Merged
jjallaire merged 2 commits into
UKGovernmentBEIS:mainfrom
he-yufeng:fix/model-graded-history-docs
Jun 1, 2026
Merged

docs: clarify model graded history prompts#4090
jjallaire merged 2 commits into
UKGovernmentBEIS:mainfrom
he-yufeng:fix/model-graded-history-docs

Conversation

@he-yufeng

Copy link
Copy Markdown
Contributor

Summary

  • clarify that include_history=True keeps the conversation history in the presented question
  • note that the default templates also place the final assistant answer in the submission field
  • update the nearby implementation comment to match the current behavior

Relates to #4017.

To verify

  • python -m py_compile src\inspect_ai\scorer\_model.py
  • python -m ruff check src\inspect_ai\scorer\_model.py
  • git diff --check
  • python -m pytest -q tests\scorer\test_model_graded.py::test_model_graded_include_history

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants