Skip to content
Install Core free
ProductsCompare Core, Hub, Connect and MDM pricing
Solutions
Docs
ResearchPricing
CompareCompare all AI data-leak tools
TrustBenchmarks
Start 30-day free trial

Shadow Hub for your business

Tell us about your team and we'll help you get started.

We use these details only to reply to your enquiry. No newsletter, no cookies, no trackers.

AI Leak Report #1

AI Leak Report #1: 122,255 sensitive values caught on one developer laptop

In 30 days Shadow masked 122,255 sensitive values in AI traffic from one developer laptop, including 287 secrets and 1,405 emails. What it found and why.

Shadow Research Team6 min read

In 30 days, Shadow caught and masked 122,255 sensitive values in the AI traffic of one developer laptop: 287 secrets and API keys, 1,405 email addresses, 2,759 names, 184 national IDs and 87 card numbers, across 1,669 requests. Each value was replaced with a realistic fake before the request left the machine. The total is high because coding agents resend the files they have read on every turn, so one secret in a config file is counted each time it is sent.

This is not an industry survey. It is what one active developer workstation sends over a month of normal AI-assisted work, published to show how much exposure builds up without anyone noticing.

What did the laptop send to AI tools?

CategoryCountWhere it usually comes from
Names2,759Customer names in logs, test fixtures and commit metadata
Email addresses1,405User emails in config, support tickets read into context
Secrets and API keys287Keys in .env, tokens in logs, connection strings
National IDs184Social security, passport and other government numbers in test data
Card numbers87Test cards and card numbers in debugging sessions
Other types117,533The remaining detected types, such as hostnames, IP addresses, usernames, addresses and custom terms
All protected values122,255Every value replaced before it left the laptop

In the same window Shadow observed 1,669 AI requests and blocked 12 dangerous tool calls with its intent policy.

Why are the numbers so high?

Coding agents build context by reading files, and every turn of a conversation resends that context. Secrets in .env files, customer data in test fixtures and API keys in logs all become prompt content, again and again. The other 117,533 values are the remaining types Shadow detects, such as hostnames, IP addresses, usernames and the organisation’s own terms; this report does not break them down further.

Why does this matter now?

This week, Claude Code was reported to put the account’s email address into outbound User-Agent headers because the address was already in the model’s context (anthropics/claude-code#107757). The same applies to any data in the context window: if the agent can see it, a tool call can send it somewhere.

Data typeHow it enters contextWhy it matters
API keys and secretsThe agent reads .env, config files or error logsCredential theft and unauthorised access
Customer emails and namesTest fixtures, support tickets or logs in the repositoryPrivacy breaches and GDPR exposure
Internal hostnamesStack traces, config, environment variablesA map of your internal network
Database credentialsConnection strings in config or .envDirect database access
Commit author detailsGit metadata the agent readsIdentifies employees for phishing

What does masking look like?

An illustrative example, not data from the laptop. Shadow replaces each value with a fake of the same shape, so the prompt still makes sense to the model:

Sent by the agent: DATABASE_URL=postgres://admin:skobayashi2@db.yamamoto-corp.internal
OPENAI_API_KEY=sk-proj-Q7wKIHXZ4097704176058327
Received by the AI: DATABASE_URL=postgres://admin:Lq0vT8d2xW@db.nexora-dev.internal
OPENAI_API_KEY=sk-proj-mB2rTnYp8814620093715542

The provider never sees the real credentials or hostname. When the answer comes back, Shadow puts the real values back, including inside tool-call arguments, so the code the agent writes still works. Teams that never want a secret sent in any form can set secret = "redact" under [policy.always].

How can developers reduce the exposure?

From what this laptop sent, five habits matter most:

  1. Keep secrets out of the repository tree. Store credentials in environment variables, a secrets manager, or a .env file listed in .gitignore and in your AI tool’s ignore file.
  2. Use short-lived, scoped credentials. A leaked temporary token expires; a scoped one can do little.
  3. Check what your tools actually send. Most AI tools have a verbose or debug mode that shows the full request. Look at the context, headers and tool arguments, not just the chat box.
  4. Audit test fixtures and logs. Real customer data lingers in test data, support exports and error logs, and agents read them.
  5. Mask on the machine. A privacy proxy replaces sensitive values before the request leaves the laptop, including in files you did not know held sensitive data. It works for tools whose traffic it can read; see which tools Shadow masks.

About the AI Leak Report

The AI Leak Report is a recurring Shadow Research series on what sensitive data developer AI tools send to model providers, and how to reduce it. Future reports will cover specific tools, team-wide numbers and other ways of working. If you have measured this in your own setup, write to support@getshadow.dev.

About this research

Produced by the Shadow Research Team from Shadow Core’s activity log on one laptop. Shadow is a privacy layer for AI: it runs on your machine, masks personal data and secrets in prompts to the AI APIs and chat apps it supports, and restores the real values in the answer. The real-to-fake mapping stays in an encrypted vault on the machine, with no account and no telemetry. For teams, Shadow Hub shows these numbers per person, app and AI service, at the sharing level the organisation chooses.

Disclosure: we build the tool that collected these numbers, and have tried to be precise about what they represent and what they do not.

Install Shadow Core freeAll research

Frequently asked questions

What counts as a sensitive value in this report?

Any string Shadow's detectors classed as personal data, a secret or a custom term: API keys and tokens, email addresses, names, national ID numbers, payment card numbers, hostnames, IP addresses, usernames, addresses and the organisation's own terms.

Were any data breaches confirmed?

No. These are sensitive-looking values Shadow intercepted and replaced before they reached a model provider. Some detections may be false positives, and nobody can say what would have happened without the masking.

Why are the numbers so high for one laptop?

Coding agents read files for context and resend that context on every turn. One secret in a config file, or a page of names in a test fixture, is counted each time it is sent. Over a month of active development the counts add up quickly.

Does this mean Claude Code or ChatGPT are unsafe?

No. These tools follow their published data-handling policies. The point is that prompts and context reach providers at all: even with training off and zero-data-retention terms, the data travels over the network and is processed on the provider's infrastructure.

How can I protect my own development environment?

Keep secrets out of the workspace, list .env files in your tool's ignore file (such as .cursorignore), use short-lived credentials, check what your tools send with their debug modes, and route agents that call model APIs through a masking proxy such as Shadow.