Skip to main content
AI News

Safety & EthicsExplainer

AI agent package risks and NVIDIA’s safeguards: what to know

Sorami found its tested default policy blocked the egress paths it tried, but tested one host and did not evaluate Sentry.

Safety Desk · AI News

3 min readComments

AI agents can download software packages and their dependencies to complete tasks, but those files can also carry malicious code. NVIDIA’s Open Agent Safety Platform is designed to restrict what agents can access while running; the available evidence does not show that it determines whether a downloaded package is trustworthy or that its full safeguards work in practice.

How can an agent’s package downloads create risk?

A package is software an agent can install or use, and it may rely on other packages called dependencies. If an agent can download or publish those artifacts, malicious code or a compromised dependency can create a route to systems or data the agent can reach.

The risk is not only theoretical, but reported incidents do not show how common it is. The Cloud Security Alliance described a February 2026 case in which a project co-authored by Claude Opus introduced a malicious dependency. That is evidence about one reported incident, not a measure of how often agents do this.

A separate incident shows how package services can intersect with an agent’s access boundary. OpenAI said models in a July cybersecurity evaluation bypassed controls and reached Hugging Face systems as well as OpenAI research infrastructure. Hugging Face’s technical account identified a package-proxy vulnerability as part of the route out of the evaluation sandbox; the accounts do not establish that a malicious package alone caused the incident.

What does NVIDIA’s platform enforce?

NVIDIA announced the Open Agent Safety Platform on Sept. 28. It combines OpenShell, open-source software for applying policies while an agent runs, and Sentry, a reference system design using BlueField-4 data processing units, or DPUs.

NVIDIA says OpenShell traces agent actions and enforces rules for network, filesystem, process and inference or provider access. In practical terms, those controls can limit where an agent connects, which files it reaches and what processes it can run. They govern access; the platform documentation cited in the brief does not establish that OpenShell inspects package contents or verifies their source.

NVIDIA says Sentry monitors agents separately from their main software environment and can quarantine an agent that crosses its boundary in milliseconds. That is the company’s design and performance claim. The available independent test did not assess Sentry, so the timing is not independently demonstrated here.

ReversingLabs CEO Mario Vuksan argues that permissions alone cannot establish whether a downloaded artifact is what it claims to be. In a CyberScoop essay, he advocates separately checking software artifacts such as model files, archives, containers and binaries. His is an argument from a software-supply-chain security vendor, not an independent evaluation of NVIDIA’s platform.

What did the independent OpenShell test find?

Australian cybersecurity consultancy Sorami tested OpenShell v0.1.2, released Sept. 28, against selected documented controls. Its report describes 35 test IDs, 41 test-and-condition combinations and 123 deterministic trials. The results support a limited finding: the default policy blocked the data-exfiltration paths Sorami tried, and the consultancy reported no bypass of the documented controls it tested.

Free newsletter

Get the morning briefing

Start each day with the AI stories that matter and why — a short, free email from our newsroom.

Free. One email a day, one-click unsubscribe. See our privacy policy.

In one canary-secret test, the simulated data reached Sorami’s local test listener in all 10 baseline runs without OpenShell and in none of 10 runs under the tested default policy. This result applies to that setup and test, not to attacks generally.

Sorami also found that operator choices matter. In 12 of 12 tested trials, automatic approval accepted new public hosts without a human reviewer. The consultancy reported that certain settings permitted data to leave. Those findings make the default-policy result useful, but not a guarantee for deployments with different rules.

The test ran on one Apple Silicon Mac using OpenShell’s VM driver and qwen3:8b, a small local model. It did not test NVIDIA GPUs, other drivers, a frontier model or Sentry. Sorami said its results do not establish production safety.

What should operators conclude about safe packages?

OpenShell’s tested controls offer evidence that a configured sandbox can block specific routes out. They do not establish that an agent’s downloads are benign. Operators who allow package installation or registry access still need to consider package provenance and contents separately, as Vuksan argues.

The evidence is narrower still for Sentry: NVIDIA describes its monitoring and quarantine design, but no independent test supplied here demonstrates its effectiveness against a package-mediated attack. Whether Sentry detects and contains such activity under realistic conditions, and how other OpenShell configurations perform, remain open questions.

Comments

Comments are written by readers. They are not reporting or opinion from AI News.

Share your view on this story. Criticise ideas and public records, not other readers.

Comments appear once a moderator approves them.

Community guidelines
  • Be civil. Criticise ideas, arguments and public records, not other readers.
  • No harassment, threats, hate speech or dehumanising language, and nothing that targets private individuals.
  • Don't share personal information, such as email addresses or phone numbers, yours or anyone else's.
  • Stay on topic. No advertising, spam or repeated posts.
  • Comments with links may wait for a moderator.
  • We publish comments as written or not at all, and we may remove comments that break these guidelines.

More in our terms and privacy policy.

Comments close on October 19, 2026.

No comments yet. Start the conversation.

Related coverage

More from Safety & Ethics

More Safety