The scoreboard of an evaluation session

The scoreboard of an evaluation session

How to understand a session dashboard ?

You've launched your appraisals, and your appraisers are starting to review the submissions and assign their scores. Now, if you'd like to keep track of your ratings and check the progress of your evaluations, you can do so via your evaluation session dashboard.

The general ranking

The overall ranking allows you to see the evolution of the ratings for all the deposits in your session in the form of a table.

On this table, you will find the following informations :
  1. The essential informations of the deposits : response number, identity, email, reference, tags
  2. The evaluation status for each deposit : not evaluated, in progress, evaluated
  3. The average of each criterion
  4. The overall average
  5. The number of evaluators assigned to each deposit
  6. The number of completed evaluations for each deposit
Info
In order to have the latest version of your general ranking, we advise you to update it regularly by clicking on the "Update" button.



  1. You can export the overall ranking to excel by clicking on the download button.




From the general ranking, by selecting the deposits, you can also perform the following actions :
  1. Exporting evaluations as PDF
  2. Sending an email
  3. Adding/Removing a tag
  4. Moving the selected deposit(s) to another evaluation session



How is the overall average calculated ?

  1. The overall average is the sum of the average of each criteria type score.
Overall average = Average criterion 1 + Average criterion 2 + Average criterion 3 etc.



To illustrate this calculation, we will use an example :


Criterion 1 (/10)Criterion 2 (/5)Criterion 3 (/10)
Evaluator A736
Evaluator B958
Average of the criterion8/104/57/10

In this example, the overall average will be 19/25 (8+4+7 = 19)
Info
Please note that in order for a rating to be taken into account in the general ranking, the evaluator must definitively validate his/her rating.
For more information on the evaluation of a deposit for an evaluator, we invite you to consult this article :  Evaluate a deposit

How are the other criteria calculated (single choice, multiple choice, drop down)

Other criteria cannot be included in the overall average (it is not possible to average different types of criteria).
For these criteria, the answer most chosen by the evaluators is indicated on the ranking (in %).



Let's take the example of a single choice criterion with two answer options "Yes" and "No".

Criterion 1YesNo
Evaluator AX
Evaluator B
X
Evaluator CX
Evaluator DX
Average of the criterion75%25%

The answer "Yes" was chosen by the majority of the evaluators. Therefore on the overall ranking, for criterion 1 it will be indicated "Yes (75%)".

Ranking by evaluator

You can also consult the ranking by evaluator, to follow the evaluations more closely.

To do this, simply click on the drop-down list, and select the concerned evaluator.



On this ranking, you will find the following informations :
  1. The essential informations of the deposits: response number, identity, email, reference, tags
  2. The evaluation status for each deposit : not evaluated, in progress, evaluated
  3. The average of each criterion
  4. The overall average
  5. The start date of the evaluation ("attribution of the deposit")
  6. The end date of the evaluation (evaluated deposit)
You will be able to see the ratings for each deposit assigned to the concerned evaluator.




Info