Benchmark virtual agents with scripted multi-turn conversations using Agent Evaluation

Run concurrent scripted conversations against a target agent to measure whether it stays on task, responds correctly, and holds up in repeatable test cases.

Prerequisites

Python environment, target agent endpoint or integration, optional AWS services such as Bedrock or SageMaker

Installation

No source-backed install or usage instructions could be extracted automatically. Review the upstream project before running this skill in a sensitive workflow.

• Source: https://github.com/awslabs/agent-evaluation

Documentation

• https://awslabs.github.io/agent-evaluation/

Source

• Agent Skill Exchange