The-AI-Alliance/ai-application-testing

[Task/Feature/Issue] Add an `AGENTS.md` file 17 days ago

enhancement good first issue help wanted

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Add a benchmark example that uses CUBE Standard 4 months ago

documentation enhancement help wanted

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Make the tools and ChatBot application pip installable packages 5 months ago

enhancement good first issue help wanted

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Discuss prompt engineering tools 5 months ago

documentation enhancement help wanted tools research

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Show how to use Docling for extraction of test data from PDFs 7 months ago

documentation enhancement help wanted tools examples

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Integration with Weights and Biases 7 months ago

documentation enhancement help wanted research examples

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Integration with MLflow 7 months ago

documentation enhancement help wanted research examples

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Add content about langfuse OSS tooling 7 months ago

documentation enhancement help wanted research examples

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Fill in the Agents Testing chapter 7 months ago

documentation enhancement help wanted tools research examples

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Discuss "prompt tuning" 8 months ago

documentation enhancement help wanted

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Fix LiteLLM logging 9 months ago

enhancement help wanted

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Add ALTK tools. 9 months ago

enhancement help wanted tools research

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Docs/Website] Fill in more details in the "microsite" 9 months ago

documentation enhancement help wanted

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Investigate `LLM-Uncertainty-Bench` 10 months ago

documentation enhancement help wanted research examples

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Docs/Website] Add discussion of DSPy 11 months ago

documentation enhancement help wanted tools

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

Explore Seismometer? 11 months ago

enhancement help wanted tools

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

Add a discussion of Plurai.ai's Intellagent 11 months ago

documentation help wanted research

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Docs/Website] Create a working example of external tool generation of synthetic data for the healthcare ChatBot 11 months ago

documentation enhancement help wanted tools examples

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Docs/Website] Ensure that a consistent "voice" is used. 11 months ago

documentation good first issue help wanted

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Fill in the Statistics chapter 11 months ago

documentation enhancement help wanted tools research examples

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Fill in the Systems Testing chapter 11 months ago

documentation enhancement help wanted tools research examples

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Provide an example of using LLM as a Judge during test runs 11 months ago

documentation enhancement help wanted tools examples

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Docs/Website] Create a working example of external tool validation for the healthcare ChatBot example 11 months ago

documentation enhancement help wanted tools examples

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Docs/Website] Add a test double example to an appropriate chapter 11 months ago

documentation enhancement help wanted tools

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Discuss other "pro" benchmark and testing tools 11 months ago

documentation enhancement good first issue help wanted

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

[Task/Feature/Issue] Finish the section on integration of unit benchmark tools into standard testing tools 11 months ago

enhancement good first issue help wanted

The-AI-Alliance/ai-application-testing

12

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Python

#ai#testing

The-AI-Alliance/ai-application-testing

Open Issues Need Help