Promptfoo
CLI and library for testing, evaluating, and red-teaming LLM outputs.
About
Promptfoo is a CLI and library for testing, evaluating, and red-teaming LLM applications. It compares prompts, models, and RAG pipelines with automated assertions, scores outputs against expected behavior, and includes vulnerability scanning and adversarial red-teaming for security testing. It installs via npm, Homebrew, or pip and runs without setup through npx. Released under the MIT license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Observability & Evaluation
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Easy (2/5)
- License
- MIT
- Added
- Apr 3, 2026
Related Tools
Open source LLM engineering platform for tracing and analytics
Open-source library for evaluating and tracking LLM applications.
Open-source AI metadata tracker for logging and comparing ML experiments.
UK AI Security Institute framework for large language model evaluations and benchmarks.
Open-source AI observability platform for tracing, evaluation, and experimentation.
ML experiment tracking, visualization, and collaboration