Hi ClawsBench team,
I hope this message finds you well. I'm reaching out to request access to the evaluation code for ClawsBench, as I'm working on AI model performance benchmarking and aim to locally reproduce the evaluation process of this benchmark.
I noticed two key points:
- The HuggingFace dataset page (https://huggingface.co/datasets/benchflow/ClawsBench) mentions that "open-source task definitions and Dockerized evaluation environment are planned to be released";
- The official GitHub repo (https://github.com/benchflow-ai/ClawsBench) currently lacks executable evaluation scripts/code to run local assessments.
Could you kindly share the preliminary version of the ClawsBench evaluation code (even a draft version) or inform the expected timeline for the official release of the open-source task definitions and Dockerized environment? This will help me complete the performance benchmarking of AI models more accurately and reproducibly.
Thank you very much for your hard work on ClawsBench, and I appreciate your time and reply!
Hi ClawsBench team,
I hope this message finds you well. I'm reaching out to request access to the evaluation code for ClawsBench, as I'm working on AI model performance benchmarking and aim to locally reproduce the evaluation process of this benchmark.
I noticed two key points:
Could you kindly share the preliminary version of the ClawsBench evaluation code (even a draft version) or inform the expected timeline for the official release of the open-source task definitions and Dockerized environment? This will help me complete the performance benchmarking of AI models more accurately and reproducibly.
Thank you very much for your hard work on ClawsBench, and I appreciate your time and reply!