Skip to content

Commit

Permalink
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Update MLPerf_Results_Messaging_Guidelines.adoc
Browse files Browse the repository at this point in the history
nv-rborkar authored Apr 20, 2023

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
1 parent 7484070 commit 75439b9
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion MLPerf_Results_Messaging_Guidelines.adoc
Original file line number Diff line number Diff line change
@@ -81,7 +81,7 @@ MLPerf results may not be compared against non-MLPerf results. For example, an M

== When comparing MLPerf results, you must identify any submission differences

When comparing results the main text, table, or figure must clearly identify any difference in version, division, category, verified or unverified status, scenario or chip count (count of the compute devices executing the largest number of ops, which could be processors or accelerators) or submitter name. When comparing Open and Closed division results, any ways in which the Open result would not qualify as a Closed result must be identified. When making comparisons, submissions must not be portrayed as representing the performance available from an Independent Hardware Vendor (IHV) unless the submission was by that IHV.
When comparing results the main text, table, or figure must clearly identify any difference in version, division, category, verified or unverified status, scenario or chip count (count of the compute devices executing the largest number of ops, which could be processors or accelerators) or submitter name. When comparing Open and Closed division results, any ways in which the Open result would not qualify as a Closed result must be identified. When making comparisons, submissions must not be portrayed as representing the performance available from a submitter unless the submission was by that submitter - e.g. a submission by SuperServers Inc that happened to use an accelerator from AccelCorp Ltd must not be portrayed as representing AccelCorp's performance.

**Example for Non-MLCommons Reviewed Result**:

0 comments on commit 75439b9

Please sign in to comment.