Skip to content

Add ordeal skill — automated chaos testing for Python#845

Open
teilomillet wants to merge 5 commits intoanthropics:mainfrom
teilomillet:add-ordeal-skill
Open

Add ordeal skill — automated chaos testing for Python#845
teilomillet wants to merge 5 commits intoanthropics:mainfrom
teilomillet:add-ordeal-skill

Conversation

@teilomillet
Copy link
Copy Markdown

Summary

  • Adds skills/ordeal/ with SKILL.md teaching AI agents how to use ordeal for Python testing
  • Registers the skill in marketplace.json under example-skills

What is ordeal?

ordeal is an automated chaos testing toolkit for Python. It discovers properties, injects faults, runs mutation testing, and explores reachable states. Key capabilities:

  • ordeal init — zero-to-validated-tests in one command (mine properties, generate tests, validate with mutations)
  • ordeal mutate — mutation testing with gap analysis and test stub generation
  • ordeal explore — coverage-guided state-space exploration (AFL-style)
  • ordeal audit — mutation score + property coverage + test gap reporting
  • Fault injection, chaos testing, differential testing, metamorphic testing

What the skill teaches agents

  • Decision tree: which ordeal tool to use for a given task
  • CLI commands and Python API with examples
  • How to read and interpret results (mutation gaps, coverage reports)
  • Key patterns (seed replay, fault ablation, config)

Test plan

  • Verify SKILL.md frontmatter follows repo conventions (name, description, license)
  • Verify marketplace.json is valid JSON
  • Verify skill activates when user asks to test Python code

🤖 Generated with Claude Code

teilomillet and others added 5 commits April 1, 2026 23:04
ordeal discovers properties, injects faults, runs mutation testing, and
explores reachable states for Python code. This skill teaches AI agents
how to use ordeal's CLI and Python API to test, audit, and improve
coverage for Python projects.

Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant