How to understand a session dashboard ?
You have just started your evaluations, the evaluators take note of the deposits and start their ratings.
Would you like to track the progress of the ranking and see where your evaluators are now ? You can do so with the dashboard of your evaluation session.
The general ranking
On this table, you will find the following informations :
- The essential informations of the deposits : response number, identity, email, reference, tags
- The evaluation status for each deposit : not evaluated, in progress, evaluated
- The average of each criterion
- The overall average
- The number of evaluators assigned to each deposit
- The number of completed evaluations for each deposit
In order to have the latest version of your general ranking, we advise you to update it regularly by clicking on the "Update" button.
You can export the overall ranking to excel by clicking on the download button.
From the general ranking, by selecting the deposits, you can also perform the following actions :
- Exporting evaluations as PDF
- Sending an email
- Adding/Removing a tag
- Moving the selected deposit(s) to another evaluation session
How is the overall average calculated ?
The overall average is the sum of the average of each criteria type score.
Overall average = Average criterion 1 + Average criterion 2 + Average criterion 3 etc.
To illustrate this calculation, we will use an example :
| Criterion 1 (/10) | Criterion 2 (/5) | Criterion 3 (/10) |
Evaluator A | 7 | 3 | 6 |
Evaluator B | 9 | 5 | 8 |
Average of the criterion | 8/10 | 4/5 | 7/10 |
In this example, the overall average will be 19/25 (8+4+7 = 19)
Please note that in order for a rating to be taken into account in the general ranking, the evaluator must definitively validate his/her rating.
For more information on the evaluation of a deposit for an evaluator, we invite you to consult this article :
Evaluate a depositHow are the other criteria calculated (single choice, multiple choice, drop down)
Other criteria cannot be included in the overall average (it is not possible to average different types of criteria).
For these criteria, the answer most chosen by the evaluators is indicated on the ranking (in %).
Let's take the example of a single choice criterion with two answer options "Yes" and "No".
Criterion 1 | Yes | No |
Evaluator A | X |
|
Evaluator B |
| X |
Evaluator C | X |
|
Evaluator D | X |
|
Average of the criterion | 75% | 25% |
The answer "Yes" was chosen by the majority of the evaluators. Therefore on the overall ranking, for criterion 1 it will be indicated "Yes (75%)".
Ranking by evaluator
You can also consult the ranking by evaluator, to follow the evaluations more closely.
To do this, simply click on the drop-down list, and select the concerned evaluator.
On this ranking, you will find the following informations :
- The essential informations of the deposits: response number, identity, email, reference, tags
- The evaluation status for each deposit : not evaluated, in progress, evaluated
- The average of each criterion
- The overall average
- The start date of the evaluation ("attribution of the deposit")
- The end date of the evaluation (evaluated deposit)
You will be able to see the ratings for each deposit assigned to the concerned evaluator.
Do you want to retake a rating ? It is possible to re-draft or delete a rating.