User Tools

Site Tools


maintaining_the_subject_pool:reputation_system

Reputation system

The participation tracking in ORSEE (see also Completing and closing a session) serves the purpose of establishing a reputation system for subjects' reliability. After completing an experiment session the experimenter fills in the participation data.

From these data, the software calculates a reputation score, the number of no-shows, for each subject. (Since this is a ressource-intensive task, this is done by a background process on a regular basis. The process can be configured in Options/Regular tasks.) Subjects are informed about their score on their participant profile page. In the administration section, the score is included in participant lists, and experimenters may condition eligibility for their experiments based on the reputation score (see section Assigning participants).

You may employ a policy to exclude subjects after a certain number of no-shows, which in turn will provide incentives to them to take session enrolments seriously and show up in time. Some laboratories exclude subjects from the pool right after the first (unjustified) no-show, other laboratories allow one or even more no-shows before exclusion.

ORSEE includes two features which can automate the process: 1) it can automatically send no-show warning emails after each no-show, and 2) it can automatically exclude a subject based on the number of their no-shows. Both functions need to be enabled as regular tasks (Options/Regular tasks), and their respective email templates can be edited in Options/Email templates.

The policy can be configured in Options/General settings. In particular, you will have to set the exclusion rule (that is, after how many no-shows a participant should be excluded) and whether a participant should be informed about the exclusion by email or not.

maintaining_the_subject_pool/reputation_system.txt · Last modified: 2023/04/12 14:20 by 127.0.0.1

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki