As organizations adopt AI systems, they must safeguard their AI models, applications, and data during live operations. Organizations must continuously monitor and protect against threats that occur during live interactions, like prompt injection, data leakage, and model misuse. Runtime Protection does this by utilizing HiddenLayer's AI Detection & Response (AIDR).
HiddenLayer's Runtime Protection helps organizations:
- Detect AI attacks in real time before they cause damage
- Respond faster with predefined playbooks and expert guidance
- Minimize downtime and business disruption from AI incidents
The HiddenLayer AI Detection & Response is a real-time input and output monitor for hosted or custom LLMs. It detects malicious input prompts and/or undesired output as they are sent to and returned from an LLM, and can (when configured appropriately) block content from being sent to the LLM or returned to the user. It has different modes of operation which can be flexibly employed, depending on the architecture already in place and the desired level of integration.
HiddenLayer’s target operating model is designed to provide maximum flexibility, security, and operational independence for our customers. Our software is available as container images, allowing for seamless deployment, scaling, and integration into existing customer architecture. We provide pre-packaged, production-ready container images, which the customer deploys, configures, and operates independently within its own cloud or on-premises Kubernetes infrastructure. This makes deployment and integration into an existing containerized infrastructure straightforward for DevOps teams.
AIDR is a separate product from the Console.
- The LLM Sandbox, while part of the Console, is designed for testing scenarios and viewing the test results.
AIDR must be deployed. See AIDR Deployment for more information.
Read the latest AIDR release notes.