Promptfoo

Promptfoo is a CLI tool for testing LLM prompts against test cases, catching regressions, and comparing models. Supports red-teaming, assertion-based testing, and CI/CD integration. Best for teams that need reliable prompt evaluation and quality assurance for production AI.

AI ToolFree Tier: Fully free open-source; local-firstCompany: PromptfooCategory: Safety & EthicsOpen Source: YesQuick Start: npm install -g promptfoo → Write a promptfooconfig.yaml with your prompts and test cases → Run 'promptfoo eval' to see pass/fail results

Promptfoo

Test and evaluate LLM prompts — catch regressions before production

Visit Promptfoo →

Promptfoo is a CLI tool for testing LLM prompts against test cases, catching regressions, and comparing models. Supports red-teaming, assertion-based testing, and CI/CD integration. Best for teams that need reliable prompt evaluation and quality assurance for production AI.

FREE TIER
Fully free open-source; local-first
COMPANY
Promptfoo
CATEGORY
Safety & Ethics › Evaluation
OPEN SOURCE
Yes
PRIVACY
Runs locally; no data sent to cloud
TAGS
evaluationtestingci-cdopen-source

QUICK START

npm install -g promptfoo → Write a promptfooconfig.yaml with your prompts and test cases → Run 'promptfoo eval' to see pass/fail results

Finding similar tools…
← Back to all tools