promptfoo

Test and evaluate LLM applications locally with comprehensive testing

brewmacoslinux
Try with needOr install directly
Source

About

Test your LLM app locally

Commands

promptfoo

Examples

Initialize a new promptfoo project with default configuration$ promptfoo init
Run tests against your LLM prompts and models$ promptfoo test
View results in an interactive web dashboard$ promptfoo view