Search results

[Feature] F1 score metric for tool calling evaluations

Status: Open.

#6547 In promptfoo/promptfoo;

· stefanoamorelli opened on Dec 7, 2025

Import YAML Preset For Redteamin

Status: Open.

#6493 In promptfoo/promptfoo;

· d3ad1Yb0073r opened on Dec 4, 2025

[Discussion Request] Tool calling as a more reliable grading output mechanic

Status: Open.

#6491 In promptfoo/promptfoo;

· xdivby0 opened on Dec 4, 2025

Upgrade zod and zod-validation-error when possible

blocked

dependenciesPull requests that update a dependency filePull requests that update a dependency file

Status: Open.

#6480 In promptfoo/promptfoo;

· JustinBeckwith opened on Dec 3, 2025

How to integrate n8n agent prompt's

Feature RequestNew feature or requestNew feature or request

good-first-issueGood for newcomersGood for newcomers

help-wantedExtra attention is neededExtra attention is needed

Status: Open.

#6192 In promptfoo/promptfoo;

· mcr-ksh opened on Nov 12, 2025

Web viewer: env-var controlled table settings

Feature RequestNew feature or requestNew feature or request

Status: Open.

#6187 In promptfoo/promptfoo;

· DKAndreasen opened on Nov 12, 2025

modelaudit source code

Status: Open.

#6061 In promptfoo/promptfoo;

· Zoobdude opened on Oct 30, 2025

Unfixed case number in red teaming test

bugSomething isn't workingSomething isn't working

Status: Open.

#6003 In promptfoo/promptfoo;

· Gii16 opened on Oct 23, 2025

red teaming plugin harmful:misinformation-disinformation and promptfoo:redteam:harmful:specialized-advice failed

bugSomething isn't workingSomething isn't working

Status: Open.

#5995 In promptfoo/promptfoo;

· Gii16 opened on Oct 22, 2025

Feature Request: Support pass^N metric for evaluating consistency across repeated test runs

Status: Open.

#5947 In promptfoo/promptfoo;

· arvinxx opened on Oct 16, 2025

Add n1n.ai API as a model provider

Feature RequestNew feature or requestNew feature or request

Status: Open.

#5917 In promptfoo/promptfoo;

· n1n-api opened on Oct 14, 2025

JSON Schema validation errors for custom fields (assertionTemplates & $ref)

Status: Open.

#5901 In promptfoo/promptfoo;

· pokutuna opened on Oct 12, 2025