KushagraKanaujia

KushagraKanaujia/throttle

Safe, local benchmarking for OpenAI-compatible inference endpoints

7 stars 6 forks 7 watchers Python MIT License

inference-benchmarking llm-inference python-cli vllm

2 Open Issues Need Help Last updated: Sep 4, 2026

Open Issues Need Help

View All on GitHub

Consistent terminal output across demo/watch/golden 18 days ago

enhancement good first issue

KushagraKanaujia/throttle

7

Safe, local benchmarking for OpenAI-compatible inference endpoints

Python

#inference-benchmarking#llm-inference#python-cli#vllm

Design pass on golden HTML report 18 days ago

enhancement good first issue

KushagraKanaujia/throttle

7

Safe, local benchmarking for OpenAI-compatible inference endpoints

Python

#inference-benchmarking#llm-inference#python-cli#vllm