Data handling
Prompts and completions
Prompts and completions are never stored. They pass through the gateway in memory, in AWS
us-east-1, to and from Bedrock in your account, and are never written to a log, database or
file.
Inference runs in your AWS account, in the region you connected, under your account's Bedrock terms.
What is kept
| Data | What it holds |
|---|---|
| Usage | Request and token counts per model per hour |
| Routing metadata | Task type, difficulty score and the model chosen. No prompt or response text |
| Budgets | Month-to-date requests, tokens and estimated cost per subscription and API key, deleted about 40 days after the month ends |
| API keys | A hash only |
Usage and routing metadata power the Usage page, billing and routing improvements.
Guardrails
The gateway sends your guardrail's id and version with each request and does not ask Bedrock for the guardrail trace, so the matched text is neither returned nor stored.
Credentials
The gateway holds no long-lived credential for your account. It uses temporary credentials for your role, which require your External ID. See Your AWS account for what the role can do.
If your data must not pass through the US, note the us-east-1 pass-through.
Full guide: data-handling.md on GitHub