> ## Documentation Index
> Fetch the complete documentation index at: https://docs.hiddenlayer.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Red Team Evaluation

Red Team Evaluation Evaluation simulates real-world adversarial attacks against your AI system by generating prompts based on the <a href="https://hiddenlayer.com/innovation-hub/introducing-a-taxonomy-of-adversarial-prompt-engineering/" target="_blank">APE</a> objectives and techniques.

## Prerequisites

Before starting a Red Team Evaluation, you should have:

* A system prompt to test
* The model(s) that power the application

## Best Practices

* **Compare Versions**: Run evaluations on both original and enhanced prompts to measure improvement.
* **Review Failed Attacks**: Understanding why attacks failed is as important as knowing which succeeded.
* **Use Appropriate Models**: Match the target model to what you're actually using in production.

<Frame>
  <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-red-teaming-active-evaluations.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=cbf776230e36de7bbc930fe46593daac" alt="Red Team Table" width="3678" height="1038" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-red-teaming-active-evaluations.png" />
</Frame>

## Run New Evaluation

1. In the HiddenLayer Console, select **Attack Simulation > Red Teaming**.

2. Click **Run New Evaluation**. The Create Red Team Evaluation slideout displays.

3. Enter a name for the evaluation.

4. Enter the target system prompt.

5. Select a target model.

   * Select a model that is similar to what you have in your environment to simulate the attacks against your system prompt.

     <Warning>
       **Beta Models**

       Models marked with a `beta` designation may be subject to lower usage quotas, limited availability, or ongoing development changes. As a result, these models may exhibit unexpected results, reduced performance, or intermittent failures during testing. Users should account for these limitations when selecting beta models.
     </Warning>

     <Frame>
       <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation-2.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=14ab5bc4c63552dc8e2824e37a94cbb3" alt="Red Team Create Evaluation" width="960" height="878" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation-2.png" />
     </Frame>

6. Optionally, click **Objectives** to change the severity level for a default objective and to add a custom objective.

   * To change the severity for a default objective, click the severity dropdown menu, then select the desired severity.

     * When a default objective severity is changed, the word **Override** appears next to the severity level.

   * To add a custom objective, click **Add objective**, then select the custom objective.

     * Use the search field to find a custom objective. Use the full or partial name for the objective.

       <Frame>
         <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation-objectives.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=29a86fdee837a5a5423677e1b7d0793b" alt="Red Team Create Evaluation - Add Objectives" width="1912" height="1554" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation-objectives.png" />
       </Frame>

7. Optionally, click **Advanced Options** to expand the section.

   * Select a project to apply runtime policies to interaction tagging.

     * If no project is selected, the default project is used.

   * Select an execution strategy.

     * **Single**: Runs each technique once per objective.

     * **Random**: Runs all techniques plus N additional random techniques.

       * Select the number of additional random techniques.

         <Frame>
           <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation-random.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=b13a67ad1f10dea925e35c40ca8a157c" alt="Red Team Evaluation Random" width="1921" height="716" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation-random.png" />
         </Frame>

     * **Static prompt set**: Uses a predefined set of static prompts for evaluation.

       * Select the prompt set from the drop-down list.

         <Frame>
           <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation-static-set.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=2fb409db98f0c3ea15d02dbecf3f6151" alt="Red Team Evaluation Static Prompt Set" width="1911" height="626" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation-static-set.png" />
         </Frame>

   * Set the maximum number of conversation turns allowed per technique when attempting to achieve an objective. The minimum is one and the maximum is five.

     * The attack simulator will do multi-turn, trying to attack the target for N turns, and then go to the next session.
     * **Note**: If you selected `static_prompt_set`, then **Attacker Max Turns to Complete Objective** is not available.

   * Set the number of independent sessions to run for each technique. The minimum is one and the maximum is five.

     * This is the number of times you want to run the same technique or static prompt.

8. Click **Start Evaluation**.

9. When the evaluation completes, click the green arrow to view the results. See [Red Team Evaluation Summary](/docs/products/ai-attack-simulation/console/attack_simulation_red_teaming_evaluation_summary) for more information.

## Terminate Running Evaluation

You can terminate a running evaluation from the Active Evaluations tab.

1. In the Console, go to **Attack Simulation > Red Teaming**.

2. Select the **Active Evaluations** tab.

3. For the running evaluation that you want to terminate, click the **x** in the **Status** column. A confirmation message displays.

   <Frame>
     <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-running-evaluation.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=33c3cef2f8243bda6209448629573862" alt="Red Team Evaluation Static Prompt Set" width="3804" height="1010" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-running-evaluation.png" />
   </Frame>

4. Click **Terminate**. If the evaluation was successfully terminated, **Terminated** displays for the status.

   <Frame>
     <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-evaluation-terminated-successfully.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=6f304ce24dbb3a762cd91c60903435e3" alt="Red Team Evaluation Static Prompt Set" width="3790" height="1012" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-evaluation-terminated-successfully.png" />
   </Frame>

## Active Evaluations

Active evaluations show running jobs and recently completed evaluations (last 90 days). This provides an operational view of what is running and what just finished. For a historical view that includes results older than 90 days, see [Evaluation Results](#evaluation-results)

<Frame>
  <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-red-teaming-active-evaluations.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=cbf776230e36de7bbc930fe46593daac" alt="Red Team Table" width="3678" height="1038" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-red-teaming-active-evaluations.png" />
</Frame>

### Filter Results

1. Click **Filter**. The Filters slide-out displays.
2. Select the statuses you want to view.
3. Click **Show Results**.

<Frame>
  <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-status-filter.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=e198f19c2591bf7dc3e87580b2f0da6c" alt="Red Team Table" width="902" height="935" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-status-filter.png" />
</Frame>

### Active Evaluation Table Descriptions

| Column               | Description                                                                                                                                                                                                                                                   |
| -------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| Name                 | The name of the evaluation.                                                                                                                                                                                                                                   |
| Start Time           | The date and time the evaluation started.                                                                                                                                                                                                                     |
| Elapsed              | The time it took for the evaluation to end. The time is in hhmmss.                                                                                                                                                                                            |
| Status               | The status of the evaluation. Statuses: Terminated, Completed, Running, Failed, Canceled, Continued As New, Timed Out.                                                                                                                                        |
| Status (green arrow) | Click to go to the Red Team Evaluation page. This page contains Metrics, Interactions, and Config data. See [Red Team Evaluation Summary](/docs/products/ai-attack-simulation/console/attack_simulation_red_teaming_evaluation_summary) for more information. |

## Evaluation Results

Evaluation results show all completed evaluation results (no date constraints). This provides a historical view of completed evaluations. To see evaluations that are currently running, see [Active Evaluations](#active-evaluations).

<Frame>
  <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-evaluation-results.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=27bb1086c10ed17bb223c1082a09254b" alt="Red Team Table" width="3756" height="1051" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-evaluation-results.png" />
</Frame>

### Evaluation Results Table Descriptions

| Column             | Description                                                                                                                                                                                                                                                   |
| ------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| Name               | The name of the evaluation.                                                                                                                                                                                                                                   |
| Target Model       | The model targeted for the evaluation. Example: `openai/gpt-5.1`.                                                                                                                                                                                             |
| Start Time         | The date and time the evaluation started.                                                                                                                                                                                                                     |
| Completed          | The date and time the evaluation completed.                                                                                                                                                                                                                   |
| Actions            | The actions available for the evaluation.<ul><li>**View Summary**: View the Evaluation Summary slide-out.</li><li>**Download CSV**: Download the evaluation summary as a CSV file.</li></ul>                                                                  |
| View (green arrow) | Click to go to the Red Team Evaluation page. This page contains Metrics, Interactions, and Config data. See [Red Team Evaluation Summary](/docs/products/ai-attack-simulation/console/attack_simulation_red_teaming_evaluation_summary) for more information. |
