A minimum reporting standard for AI evaluations
A short proposal for the least an evaluation result has to disclose before it can be compared with another result or repeated by anyone else.
Topic
Open science
Code, datasets and reporting practice released so that others can repeat the work.
3 entries
Published under this topic
The evaluation harness is now public
The code I use to run and record my own evaluations, released so the results here can be reproduced.
Why this exists
What this practice is for, what it will publish, and the things it will not do.