Review¶
A Review is an object that stores scores, feedback, recommendations and any other information provided by a single Reviewer for a single Submission.
A review is created whenever a Submission is assigned to a Reviewer. (See Assignment)
A review is defined and controlled by its Review Type.
Only one review of a specific Review Type is allowed for each Submission/Reviewer combination.
Linked Submission Status¶
Each Review has a Linked Submission Status.
This is a submission status of type Review.
The list of available statuses is controlled by the Review Type Status Link. The Linked Submission Status is automatically set whenever a submission changes status to one of these available statuses.
The Linked Submission Status is used to control when the Review is considered complete or not. (See Field Definition Status Link)
Note
The Linked Submission Staus may not be the same as the current status of the review's submission.
Example¶
A project is configured so that a submission can have the following statuses:
| Status | Type |
|---|---|
| Abstract | Edit |
| Abstract Review | Review |
| Paper | Edit |
| Paper Review | Review |
| Accepted | Finished |
| Rejected | Finished |
A review type is configured with two status links:
- Abstract Review
- Paper Review.
A review is created when the submission is in Abstract Review.
The Linked Submission Status is set to Abstract Review
Abstract Review status is then used to control if the review is complete or not. (See Field Definition Status Link)
The submission then moves to Paper status.
The Linked Submission Status is still set to Abstract Review and Abstract Review is still used to control if the review is complete or not.
The submission then moves to Paper Review status.
The Linked Submission Status is then updated to Paper Review and this new status is used to control if the review is complete or not.
Status¶
Submission Reviews are used by Reviewers to grade a submission and can offer both internal comments for the administrator and feedback for the submitter. Each review has a status field that can be one of the following:
Incomplete¶
The review has one or more mandatory questions/fields unanswered.
Excluded¶
The review has been excluded and should not be used when deciding how to markup a submission.
A review is normally marked as excluded if there is a conflict of interest recorded by the reviewer.
Excluded reviews will be ignored when calculating average scores etc. for the submission. A review can be excluded irrespective of whether any questions/fields are answered.
Included¶
A review is Included if all mandatory questions/fields in the review have been answered and the review is not Excluded. Any scores etc. will be included in average scores etc. for the submission.
Note
A review is considered to be Complete if it is either Excluded or Included. This means that the review has been competed by the reviewer but may or may not useful when deciding how to markup a submission.
Note
If a review has no mandatory questions then it will be immediately marked as Included, even if a reviewer hasn't answered any of the questions.
Example¶
The following is allowed:
- Submission 0001 has a review of type Abstract Review from richard@company.com
- Submission 0001 has a review of type Abstract Review from rupert@company.com
- Submission 0001 has a review of type Paper Review from richard@company.com
Once created, a Reviewer is normally invited to review a Submission by sending out an email Message via the Communications Dashboard.
The Reviewer then logs in and completes the review using a review Form to provide scores and feedback for the Submission.
Administrators can track the progress of the reviews using the Reviewing Dashboard.