Open Issues Need Help
View All on GitHub documentation help wanted
Tests: cover empty and scalar JSONL sources 11 days ago
help wanted good first issue
Tests: cover nested CLI output paths 12 days ago
help wanted good first issue
Tests: cover JSONL snapshot option propagation 12 days ago
help wanted good first issue
Handle non-UTF-8 JSONL sources as user errors 13 days ago
help wanted good first issue
Tests: cover missing JSONL source errors 13 days ago
help wanted good first issue
help wanted good first issue
Tests: cover CLI errors for invalid manifests 13 days ago
help wanted good first issue
Docs: add development setup troubleshooting 25 days ago
documentation help wanted good first issue
Docs: add Windows development setup commands 25 days ago
documentation help wanted good first issue
documentation help wanted good first issue
Adapter: compare stored Promptfoo evaluation exports about 1 month ago
enhancement help wanted
Privacy: allow manifests to suppress sample ID previews about 1 month ago
enhancement help wanted good first issue
Tests: add Windows path and local-content normalisation fixtures about 1 month ago
help wanted good first issue
Adapter: define a semantic contract for lm-evaluation-harness tasks about 1 month ago
enhancement help wanted
Adapter: snapshot Hugging Face Datasets without storing raw rows about 1 month ago
enhancement help wanted
Registry: add a versioned reproducibility-card validator about 1 month ago
enhancement help wanted