> ## Documentation Index
> Fetch the complete documentation index at: https://docs.hiddenlayer.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Red Team Prompt Sets

Manage reusable prompt sets for testing.

<Frame>
  <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-prompt-sets.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=0487fe363cf560f57990735758682f62" alt="Log In Page" width="3816" height="1078" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-prompt-sets.png" />
</Frame>

## Create Prompt Set

1. In the HiddenLayer Console, select **Attack Simulation > Prompt Sets**.

2. Click **Create Prompt Set +**. The Create Prompt Set slide-out displays.

3. Enter a name for the prompt set.

4. Optionally, enter a description.

5. Upload a CSV file containing your prompt set. You can either drag-and-drop the file into the Upload Prompts field or click inside the field to open the file browser.

   * See [CSV File Example](#csv-file-example) for more information.

6. Click **Create Prompt Set**.

   <Frame>
     <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-create-prompt-set.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=5347ca6be60ece4f0884f1accfac297b" alt="Red Team Create Prompt Set" width="1906" height="1469" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-create-prompt-set.png" />
   </Frame>

### CSV File Example

CSV format requirements:

* Maximum file size: 10MB
* Maximum 1,000 prompts
* Single column: user prompts only
* Two columns: system prompts (optional), user prompts
* First row may contain headers: "system prompt, user prompt" or "user prompt"
* User prompts: max 20KB each
* System prompts: max 10KB each

#### Example Formats

**System Prompt and User Prompt with header**

```csv theme={null}
system prompt, user prompt
this is the test system prompt, this is a test user prompt 1,
this is the test system prompt, this is a test user prompt 2
```

**System Prompt and User Prompt without header**

```csv theme={null}
this is the test system prompt, this is a test user prompt 1,
this is the test system prompt, this is a test user prompt 2
```

**User Prompt with header**

```csv theme={null}
user prompt
this is a test user prompt 1,
this is a test user prompt 2,
```

**User Prompt without header**

```csv theme={null}
this is a test user prompt 1,
this is a test user prompt 2
```

## Best Practices

* **Compare Versions**: Run evaluations on both original and enhanced prompts to measure improvement.
* **Review Failed Attacks**: Understanding why attacks failed is as important as knowing which succeeded.
* **Use Appropriate Models**: Match the target model to what you're actually using in production.

## Run Evaluation

You can run an evaluation using any available prompt set.

1. In the Console, select **Attack Simulation > Prompt Sets**.

2. For the prompt set you want to use, click **Run Evaluation**. The Create Red Team Evaluation slide-out displays.

3. Enter a name for the evaluation.

4. Enter the target system prompt.

5. Select a target model.

   * Select a model that is similar to what you have in your environment to simulate the attacks against your system prompt.

     <Warning>
       **Beta Models**

       Models marked with a `beta` designation may be subject to lower usage quotas, limited availability, or ongoing development changes. As a result, these models may exhibit unexpected results, reduced performance, or intermittent failures during testing. Users should account for these limitations when selecting beta models.
     </Warning>

   <Frame>
     <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=8f84636d16e88e5f0d50cb908369c737" alt="Red Team Create Evaluation" width="1914" height="1663" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation.png" />
   </Frame>

6. Optional: Click **Advanced Options** to expand the section.

   * Select a project to apply runtime policies to interaction tagging.

     * If no project is selected, the default project is used.

   * Select an execution strategy.

     * **Single**: Runs each technique once per objective.

     * **Random**: Runs all techniques plus N additional random techniques.

       * Select the number of additional random techniques.

       <Frame>
         <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation-random.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=b13a67ad1f10dea925e35c40ca8a157c" alt="Red Team Evaluation Random" width="1921" height="716" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation-random.png" />
       </Frame>

     * **Static prompt set**: Uses a predefined set of static prompts for evaluation.

       * Select the prompt set from the drop-down list.

       <Frame>
         <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation-static-set.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=2fb409db98f0c3ea15d02dbecf3f6151" alt="Red Team Evaluation Static Prompt Set" width="1911" height="626" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-evaluation-static-set.png" />
       </Frame>

   * Set the maximum number of conversation turns allowed per technique when attempting to achieve an objective. The minimum is one and the maximum is five.

     * The attack simulator will do multi-turn, trying to attack the target for N turns, and then go to the next session.
     * **Note**: If you selected `static_prompt_set`, then **Attacker Max Turns to Complete Objective** is not available.

   * Set the number of independent sessions to run for each technique. The minimum is one and the maximum is five.

     * This is the number of times you want to run the same technique or static prompt.

7. Click **Start Evaluation**.

8. When the evaluation completes, click the green arrow to view the results. See [Red Team Evaluation Summary](/docs/products/ai-attack-simulation/console/attack_simulation_red_teaming_evaluation_summary) for more information.

<Frame>
  <img src="https://mintcdn.com/hiddenlayer/MngCbtFB0OBAHS9B/docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-run-prompt-set.png?fit=max&auto=format&n=MngCbtFB0OBAHS9B&q=85&s=f5098b6907477b72ade9cad23bb46038" alt="Red Team Run Prompt Set" width="1880" height="1786" data-path="docs/products/ai-attack-simulation/console/images/attack-simulation-red-team-run-prompt-set.png" />
</Frame>

<Note>
  **Terminate Running Evaulation**

  You can terminate a running evaluation from the Active Evaluations tab on the Red Teaming page.

  * In the **Status** column, click the **x** icon for the running evaluation that you want to terminate.
  * A confirmation message displays. Click **Terminate**.
  * If the evaluation was terminated successfully, **Terminated** displays for the status.
</Note>

## Pre-Configured Red Team Prompt Sets

Select a prompt set to run red team evaluations using pre-configured adversarial prompts designed to test your AI system's defenses.

To run an evaluation, see [Run Evaluation](#run-evaluation).

| Prompt Set                   | Description                                                                                                                                                                                                                                       |
| ---------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| Do Anything Now APE          | Do Anything Now adversarial prompts for testing LLM safety and security.                                                                                                                                                                          |
| Financial Assistant Advanced | Financial Assistant Advanced is a prompt set scenario for testing a financial application against adversarial prompts. The system prompt for this scenario has been ran through the system prompt evaluation to make a more robust system prompt. |
| Financial Assistant Basic    | Financial Assistant Basic is a prompt set scenario for testing a financial assistant application against adversarial prompts. The system prompt for this scenario has not been run through the system prompt evaluation.                          |
