LlamaFirewall

Meta's layered guardrail framework that scans agent prompts, plans, and generated code.

Open SourceSelf HostedOffline Capable
0.0 (0)

About

Securing agents rather than chatbots is the design center of LlamaFirewall, the guardrail framework Meta runs in production and ships inside the PurpleLlama repository. Three scanner layers cover different failure modes: PromptGuard 2, an 86M-parameter classifier with a faster 22M variant, catches jailbreaks and injected instructions in user input and untrusted tool output; AlignmentCheck, an experimental chain-of-thought auditor, reads an agent's reasoning trace to detect goal hijacking mid-plan; and CodeShield, a static analyzer, flags insecure coding patterns in generated code before it executes. Scanners compose into per-conversation pipelines alongside regex and custom rules, engineered for low-latency inline use in high-throughput agent systems. The framework code is MIT licensed and installs from PyPI as llamafirewall, while the PromptGuard model weights carry the Llama community license; the small classifiers run on CPU, so no GPU is needed for the core path. An accompanying 2025 paper documents the design and benchmark results, and Meta positions it as the open backbone for agent-side defense.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Intermediate (3/5)
License
MIT
Added
Aug 24, 2026

Related Tools

UK AI Security Institute framework for large language model evaluations and benchmarks.

Open SourceSelf HostedOffline
Easy
Featured

ML experiment tracking, visualization, and collaboration

Open Source
Easy
Featured

Open source LLM engineering platform for tracing and analytics

Open SourceSelf Hosted
Easy

Open-source library for evaluating and tracking LLM applications.

Open SourceSelf Hosted
Easy

Open-source AI observability platform for tracing, evaluation, and experimentation.

Open SourceSelf Hosted
Easy

Python framework for unit testing and evaluating LLM applications with metrics like G-Eval.

Open SourceSelf HostedOffline
Easy
Browse all AI Observability & Evaluation tools