Questions defined here are used by reviewers to score submissions. Typically, the Answer Type for reviewer scoring questions is either a "Drop Down" or, less often, "Yes No". It is important that the numeric value associated with each subcode answer value is defined in the Option 1 column in the App_Subcode table, because reviewer scores are averaged. If no numeric value is defined for a scoring answer, then the system will not be able to calculate the average.
To define reviewer scoring questions:
1. Once
you have created a new submission
type, defined submitter
requirements, defined
submitter disclosure questions, defined
material requirements, defined
submission disclosure questions, define
dcontent (text block) questions, defined
rules for file attachments, and defined
the review process on the Material Requirements page, from the Define
Review Process page, enter the Instructions
for Reviewers Scoring Submissions in the section highlighted below.
These instructions display on the Review and Scoring tab for the reviewer
of the submission, as shown below. These instructions are NOT displayed
to the submitter.
2. From the "Reviewer Scoring Questions" section, perform the following to add reviewer scoring questions:
a. Click
Add a Question.
The question configuration steps display, as shown below.
b. Enter the Text of Question/Header.
c. Select
the Answer Type from the drop-down.
The only available options are "Text Box" and "Drop Down".
i. Text Box: displays a text box for
the submitter to enter their response, as shown below.
ii. Yes
No: displays a "Yes" and
"No" radio button for the submitter to each either option, as
shown below.
d. Depending on the option selected, the following additional information can be defined:
i. Submitting Criterion Code: this identifies the scoring criterion on which the reviewer is scoring the submission. The available values are populated based on the non-fixed SCORING_CRITERION system code. This is used for reporting purposes only. For example, KNOWLEDGE_OF_SUBJECT, ORIGINALITY_OF_RESEARCH, RELEVANCE, RESEARCH_STANDARDS, etc.
ii. Answer Validation Code: if the Answer Type is "DROP_DOWN", this identifies the answer code associated with the subcode values that can be selected as the answer to the submitter disclosure question. The available values are populated based on the non-fixed AUTHOR_DISCLOSURE_ANSWER system type.
iii. Max. No. of Characters: the maximum number of characters the submitter can enter for the answer to the submitter disclosure question. This option is only available if you selected "Text Box" as the Answer Type. If you selected "Text Box", this option defaults to 500.
e. Click Save.
f. Use the Move Up and Move Down button to place the questions in the order in which you want them to display on the page for the submitter.
3. Click
Save Changes.
The Work with Submission Type screen displays, as shown below. From this
screen, you can update any of the information defined for this submission
type by clicking the appropriate tab.
The screen above will display anytime you want to edit a submission type
setup by simply selecting the appropriate submission type from the Home
Page, as shown below.
4. Once you have successfully completed the submission type setup steps above, you can view submissions submitted for this submission type and manage reviewers within this call.