Working Group on Interoperable Benchmarking of AI Systems

The Working Group on Interoperable Benchmarking of AI Systems was established by The Athens Roundtable in October 2021, to produce interoperable benchmarks that assess the extent to which AI-enabled systems do, in fact, meet their intended real-world purpose. The vision for the working group is:

• a set of ongoing programs of open AI benchmarks that empower citizens and innovators, inform regulators and policymakers, advance international coordination and collaboration (with an initial focus on the US and Europe), and support the development of values-driven, evidence-based norms.

The working group includes experts emanating from US NIST, IEEE, and European Standards-development organizations.