Reference

Python API

inspect_ai	Tasks, evaluation, and scoring.
inspect_ai.solver	Prompting and elicitation.
inspect_ai.tool	Built-in and custom tool functions.
inspect_ai.agent	Agent scaffols and protocol.
inspect_ai.scorer	Task scoring and metrics.
inspect_ai.model	Model interface and providers.
inspect_ai.dataset	Reading samples from datasets.
inspect_ai.approval	Approvers and approval policies.
inspect_ai.log	List, read, write, and analyse logs.
inspect_ai.event	Transcript events.
inspect_ai.analysis	Data frames for analysis.
inspect_ai.util	Miscellaneous utility functions.

Inspect CLI

inspect eval	Evaluate one or more tasks.
inspect eval-retry	Retry an evaluation task.
inspect eval-set	Evaluate a set of tasks with retries.
inspect score	Score a previous evaluation run.
inspect view	Inspect log viewer
inspect_log	Query, read, write, and convert logs.
inspect trace	List and read execution traces.
inspect sandbox	Manage sandbox environments.
inspect cache	Manage the Inspect model cache.
inspect list	List tasks on the filesystem.
inspect info	Read version and configuration.