Reference
Python API
| inspect_ai.agent | Agent scaffolds and protocol. |
| inspect_ai.analysis | Data frames for analysis. |
| inspect_ai.approval | Approvers and approval policies. |
| inspect_ai.dataset | Reading samples from datasets. |
| inspect_ai.event | Transcript events. |
| inspect_ai.hooks | Hook into Inspect lifecycle events. |
| inspect_ai.log | List, read, write, and analyse logs. |
| inspect_ai.model | Model interface and providers. |
| inspect_ai | Tasks, evaluation, and scoring. |
| inspect_ai.scorer | Task scoring and metrics. |
| inspect_ai.solver | Prompting and elicitation. |
| inspect_ai.tool | Built-in and custom tool functions. |
| inspect_ai.util | Miscellaneous utility functions. |
CLI
| inspect cache | Manage the Inspect model cache. |
| inspect eval-retry | Retry an evaluation task. |
| inspect eval-set | Evaluate a set of tasks with retries. |
| inspect eval | Evaluate one or more tasks. |
| inspect info | Read version and configuration. |
| inspect list | List tasks on the filesystem. |
| inspect log | Query, read, write, and convert logs. |
| inspect sandbox | Manage sandbox environments. |
| inspect score | Score a previous evaluation run. |
| inspect trace | List and read execution traces. |
| inspect view | Inspect log viewer. |