ssf0409/tracelens

docs: onboarding-path drift (`tracelens>=0.3.0` on four pages, installation layout versus `tracelens init`, three baseline paths, reproducibility wording, README demo from a PyPI install) 9 days ago

documentation good first issue priority:P2

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

fix(report): Markdown table cells are not escaped, so a `|` or raw HTML in a task id breaks the per-task and gate tables piped into the job summary 9 days ago

bug good first issue priority:P2

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

fix: small-fixes batch from the 2026-09-13 review (low-severity notes, each with a one-line repro; verify before fixing) 9 days ago

bug good first issue priority:P2

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

examples: a CLI-loadable, environment-driven `LLMGrader` so the calibration loop is exercised with the grader type it exists for 9 days ago

enhancement good first issue priority:P2

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

docs(process): claim an issue before starting, and check the pull request queue before implementing 10 days ago

documentation good first issue priority:P2

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

test(journey): cover the calibration loop (sample, worksheet, reconcile) 17 days ago

enhancement good first issue priority:P2

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

test: stop the hello-world example test rewriting the checked-in sample reports 17 days ago

bug good first issue

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

docs: show `provenance_version` in the adapter and grader examples 17 days ago

documentation good first issue

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

feat(cli): `tracelens report --format ci` re-renders the one-line CI summary 17 days ago

enhancement good first issue

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

docs/examples: integration cookbook (LangChain/LangGraph, OpenAI SDK) as recipes, not core deps 3 months ago

documentation enhancement good first issue priority:P1

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

feat(cli): tracelens compare — A/B two saved runs with bootstrap significance 3 months ago

enhancement good first issue priority:P1

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

feat(cli): tracelens init — scaffold a runnable eval/ directory 3 months ago

enhancement good first issue priority:P0

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

docs: positioning page — when to choose TraceLens vs adjacent tools 3 months ago

documentation good first issue

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

feat: CSV/JSONL task loaders (+ optional HuggingFace datasets) 3 months ago

enhancement good first issue

ssf0409/tracelens

2

Evaluation and regression-testing framework for AI agents, published in pypi.org/project/tracelens/

Python

#agents#ai#ai-agents#evals#evaluation#llm#llm-as-judge#llm-evaluation#mlops#python#regression-testing#testing

Open Issues Need Help