A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

279 stars 126 forks 279 watchers Python BSD 3-Clause "New" or "Revised" License
benchmarking continuous-integration framework hpc performance-testing python3 regression-testing validation-testing
9 Open Issues Need Help Last updated: Jul 14, 2026

Open Issues Need Help

View All on GitHub
help wanted prio: normal schedulers

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

Python
#benchmarking#continuous-integration#framework#hpc#performance-testing#python3#regression-testing#validation-testing

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

Python
#benchmarking#continuous-integration#framework#hpc#performance-testing#python3#regression-testing#validation-testing
help wanted prio: normal

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

Python
#benchmarking#continuous-integration#framework#hpc#performance-testing#python3#regression-testing#validation-testing

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

Python
#benchmarking#continuous-integration#framework#hpc#performance-testing#python3#regression-testing#validation-testing

AI Summary: The user wants to test a large number of nodes (500) with many tests per node using ReFrame's `--distribute` option on Slurm. They are stuck between `--distribute=idle` (which skips busy nodes, preventing full coverage) and `--distribute=avail` (which queues too many jobs on busy nodes, hitting Slurm's `MaxSubmit` limit and stalling the entire pipeline, even if other nodes are free). The core problem is efficiently testing *all* target nodes without overwhelming the scheduler with jobs destined for currently busy resources.

Complexity: 4/5
help wanted prio: normal

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

Python
#benchmarking#continuous-integration#framework#hpc#performance-testing#python3#regression-testing#validation-testing

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

Python
#benchmarking#continuous-integration#framework#hpc#performance-testing#python3#regression-testing#validation-testing
help wanted prio: normal

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

Python
#benchmarking#continuous-integration#framework#hpc#performance-testing#python3#regression-testing#validation-testing
help wanted prio: normal

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

Python
#benchmarking#continuous-integration#framework#hpc#performance-testing#python3#regression-testing#validation-testing
help wanted prio: normal

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

Python
#benchmarking#continuous-integration#framework#hpc#performance-testing#python3#regression-testing#validation-testing