The IO500 Foundation Steering Committee Rules - Version 2.0
+The IO500® Foundation Steering Committee Rules - Version 2.0
Messaging Policy
@@ -28,7 +28,7 @@Verified and Unverified Results
- If a submission is officially listed on a published IO500 List, then mention of the IO500 benchmark result must be listed as “verified”. A “verified” submission has been audited by the committee for correctness of the whole submission package. This includes reviewing the documentation provided by the submitter for correctness, feasibility, and consistency. The term verified must be prominently displayed in the same paragraph as the first mention of the IO500 result. + If a submission is officially listed on a published IO500® List, then mention of the IO500 benchmark result must be listed as “verified”. A “verified” submission has been audited by the committee for correctness of the whole submission package. This includes reviewing the documentation provided by the submitter for correctness, feasibility, and consistency. The term verified must be prominently displayed in the same paragraph as the first mention of the IO500 result.
@@ -39,7 +39,7 @@ Note that the inclusion of the terms “verified” or “unverified” are only required in public statements. This includes blogs, websites, papers, chatrooms, social media, talks, etc. This does not cover mentioning IO500 results within a classroom or other research setting. For example, researchers are encouraged to run IO500 in a variety of novel and innovative configurations, and these comparisons (all of which are unverified), are not required to be listed as such.
-Standards for Using IO500 Results
+Standards for Using IO500® Results
To maintain the integrity of the IO500 lists and results, all participants must adhere to the following rules when referencing verified or unverified results: @@ -69,7 +69,7 @@ -
IO500 Result Usage Examples
+IO500® Result Usage Examples
Examples of acceptable language include: @@ -77,7 +77,7 @@
-
- “These results are unverified by IO500 Foundation”
+ “These results are unverified by IO500® Foundation”
- This assumes all the other required details were included in the statement as well.
- - <Company> achieved an unverified IO500 bandwidth score that would have achieved 3rd place on the ISC25 Production List. + <Company> achieved an unverified IO500® bandwidth score that would have achieved 3rd place on the ISC25 Production List.
- - We measured the ISC25 edition IO500 benchmarks on product X for testing and achieved an unverified overall score of Y. + We measured the ISC25 edition IO500® benchmarks on product X for testing and achieved an unverified overall score of Y.
-
- “Running the IO500 on product X, we achieved a score better than rank 1 of the IO500.”
+ “Running the IO500® on product X, we achieved a score better than rank 1 of the IO500®.”
-
This is unacceptable because:
- Lacks unverified statement -
- Does not state which IO500 list (and hence benchmark edition) they are referring to +
- Does not state which IO500® list (and hence benchmark edition) they are referring to
- Does not indicate whether they are referring to the overall score, bw score, or metadata score
- Did not specify changes made to benchmark (if there were any)
-
This is unacceptable because:
-
-
- ‘primary competitors’ is not an IO500 metric +
- ‘primary competitors’ is not an IO500® metric
- Not listed as verified or unverified -
- Does not state which IO500 list they are referring to +
- Does not state which IO500® list they are referring to
Addressing Violations
- If the IO500 Steering Committee identifies a violation of these guidelines, the following enforcement process will be initiated: + If the IO500® Steering Committee identifies a violation of these guidelines, the following enforcement process will be initiated:
-
@@ -147,13 +147,13 @@
Escalated Action: If the party is unresponsive or unwilling to rectify the issue, the Committee may take further action, including but not limited to the following, in order of increasing severity:
- - Public Notice: Issuing a formal statement on the IO500 website and social media channels. + Public Notice: Issuing a formal statement on the IO500® website and social media channels.
- - Submission Removal: Removing the relevant entries from the IO500 lists on which they appear. + Submission Removal: Removing the relevant entries from the IO500® lists on which they appear.
- - Organizational Sanctions: Removing all submissions from the associated organization from the IO500. + Organizational Sanctions: Removing all submissions from the associated organization from the IO500®.
-
Submission Ban: Banning the submitter or organization from making new submissions for a set period (e.g., one year) or indefinitely.
@@ -180,6 +180,6 @@
Changes to This Policy
- The IO500 reserves the right to update this policy periodically. If significant changes are made, we will notify the community via a prominent notice on our primary communication channels. + The IO500® reserves the right to update this policy periodically. If significant changes are made, we will notify the community via a prominent notice on our primary communication channels.
-
This is unacceptable because: