EvalCards: A Framework for Standardized Evaluation Reporting

2026-10-26 · ArXiv

arXiv:2511.21695v2 Announce Type: replace-cross

Abstract: Evaluation reports guide the use of general-purpose AI (GPAI) models, yet inconsistent reporting often leaves essential questions unanswered. Through a review of prior work, we identify three central issues in evaluation reporting practices today, reproducibility, accessibility, and accountability, and examine how existing reporting artifacts fall short in addressing them. We introduce the EvalCards framework, outlining its key dimensions and presenting a preliminary format for concise evaluation summaries. We conclude by discussing how the framework can guide the future development of evaluation reporting standards.

原文链接：https://arxiv.org/abs/2511.21695

查看更多资讯请见 AI 行业资讯。