Below is the guide that was used to mark the Reviews:
- 10/10 : All 3 reviews were excellent.
- 9/10 : 2 excellent and 1 good review.
- 8/10 : All 3 reviews were good or excellent.
- 7/10 : The majority of the reviews were good.
- 6/10 : The majority of the reviews were average.
- 5/10 : The majority of the reviews were acceptable.
- ≤ 4/10 : The majority of the reviews were poor.
- Excellent:
- Numerical scores should be consistent with the review that is written.
- Provide a brief statement of what the paper is about. Do not copy it from the paper.
- List the positive aspects of the paper. No matter how bad the paper is, you must find something that is positive.
- List aspects that should be improved. No matter how good the paper is, you can find things that could be improved or extended. Highlight unclear/imprecise passages, unsupported claims, etc.
- Give your overall opinion of the paper. Is it the best document that you ever read? Is it fatally flawed? Incomprehensible? Most papers fall in-between these extremes.
- Presentation, organization, grammar, spelling, language usage, etc. You should point to all the important problems, but you do not be overly extensive. If certain mistakes happen repeatedly, it is enough to point to it once and indicate that they should be fixed throughout the paper.
- Your own writing should meet a standard appropriate for academic writing.
- The review should be comprehensible and understandable.
- Good:
- Would be an excellent review but is missing one of the aspects described above.
- Average:
- Would be an excellent review but is missing a couple of the aspects described above.
- Acceptable:
- Missing several of the aspects that would make this review excellent.
- Poor:
- Little or no effort was put into the review.
