promptfoo/promptfoo — Test your prompts, agents, and RAGs. Red teaming/pentes | Sourcevana

promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

Verified Snapshot (173.2 MB)

TypeScript20.2K1.7KUpdated 3h agoFeatured

GitHub

Quick Overview

AI summary will be generated soon. Check back later for an in-depth analysis of this project.

Scores

Trust Score

Star reputation (15%)86

Star velocity 7d (15%)0

Commit recency (15%)100

Fork ratio (10%)29

Issue ratio (10%)86

Contributor signal (10%)100

README quality (5%)100

License (5%)100

Homepage/demo (5%)100

Docs URL (5%)0

Topic count (5%)100

Maintenance

Commit frequency95

Issue management25

Documentation85

Popularity

Stars100

Forks100

Growth trend10

Star History

Not enough data yet. Star history will appear after a few days of tracking.

Snapshot Versions

Version

README

Promptfoo: LLM evals & red teaming

promptfoo is a CLI and library for evaluating and red-teaming LLM apps. Stop the trial-and-error approach - start shipping secure, reliable AI apps.

Website · Getting Started · Red Teaming · Documentation · Discord

Promptfoo is now part of OpenAI. Promptfoo remains open source and MIT licensed. Read the company update.

Quick Start

npm install -g promptfoo
promptfoo init --example getting-started

promptfoo

Quick Overview

Scores

Trust Score

Maintenance

Popularity

Star History

Snapshot Versions

Alternatives

prompts.chat

dify

langchain

open-webui

awesome-llm-apps

hermes-agent

Community Reviews

README

Promptfoo: LLM evals & red teaming

Quick Start