Participants saw one of six messages:
dom_1: By now you know the task at hand. If you don’t complete it
and do it well, you will not get the full bonus.
dom_2: All right, it’s go time. If you want to keep your entire
bonus, you’re going to need to jump in and nail this task.
dom_3: Ok, get in there and do your absolute best across all rounds.
If you don’t perform well, I will take away some or all of your
bonus.
nondom_1: I appreciate your hard work. Just look at the shapes
carefully and try to get as many as you can right.
nondom_2: Please complete this task to the best of your ability.
Thanks!
nondom_3: Your job in this task is to select the shapes that match
the description. Make sure you look at them carefully.
Do you want to perform the task?
message | choice | n |
---|---|---|
dom | No | 2 |
dom | Yes | 14 |
nondom | Yes | 14 |
For those who decided to complete the task, how many points did they score (0-50)?
Here, we started by asking if they would to the task with
their manager for 2 dollars. If they said yes, we asked
if they would do it for 1.50, and so on, until 0. If they said no, we
asked if they would do it for 2.50, and so on, until 4.
First, let’s see how many people wouldn’t do it for any price.
message | do_it | n |
---|---|---|
dom | would | 13 |
dom | would_not | 3 |
nondom | would | 13 |
nondom | would_not | 1 |
For those who agreed to do it, what is their RP?
This is looking real good. Gotta figure out how to incorporate the people who kept saying no. That’s meaningful data, just not sure how to quantify it within this context.
Here, we started by asking if they would to the task with
someone at random for 2 dollars. If they said yes, we
asked if they would do it for 1.50, and so on, until 0. If they said no,
we asked if they would do it for 2.50, and so on, until 4.
First, let’s see how many people wouldn’t do it for any price.
message | do_it | n |
---|---|---|
dom | would | 14 |
dom | would_not | 2 |
nondom | would | 13 |
nondom | would_not | 1 |
For those who agreed to do it, what is their RP?
this is not great. We’d expect no difference between dom and nondom.
Price of doing the task with the current manager MINUS price of doing the task with someone at random. Only for those who agreed to do it at all.
Tiny tiny difference. But… maybe with more power. Looks like the nondom messages do lead to a bit of a discount.
How much will the employee like the manager?
is_dom: dummy-coded message shown (0 = nondom; 1 =
dom).
again_man: price to get them to do the new task with
the current manager.
again_rand: price to get them to do the new task with
someone at random.
again_diff: price of again MINUS price of
againrand.
like: how much does the employee like the manager.
Ok, that’s actually good to see. that r = 0.10 between is_dom and again_diff is in the right direction and likely significant with more power. Of course, reminding myself here: This is just the employee side. All of these will just serve as a ground truth comparison for the managers’ estimates.
Participants one of six messages:
dom_1: By now you know the task at hand. If you don’t complete it
and do it well, you will not get the full bonus.
dom_2: All right, it’s go time. If you want to keep your entire
bonus, you’re going to need to jump in and nail this task.
dom_3: Ok, get in there and do your absolute best across all rounds.
If you don’t perform well, I will take away some or all of your
bonus.
nondom_1: I appreciate your hard work. Just look at the shapes
carefully and try to get as many as you can right.
nondom_2: Please complete this task to the best of your ability.
Thanks!
nondom_3: Your job in this task is to select the shapes that match
the description. Make sure you look at them carefully.
Score per message
dom_nondom | message | n | points |
---|---|---|---|
dom | 1 | 5 | 31.20000 |
dom | 2 | 5 | 37.80000 |
dom | 3 | 4 | 29.25000 |
nondom | 1 | 5 | 42.40000 |
nondom | 2 | 7 | 27.14286 |
nondom | 3 | 2 | 23.00000 |
dom_nondom | message | n | price |
---|---|---|---|
dom | 1 | 5 | 2.300000 |
dom | 2 | 5 | 1.375000 |
dom | 3 | 4 | 2.000000 |
nondom | 1 | 5 | 1.400000 |
nondom | 2 | 7 | 1.333333 |
nondom | 3 | 2 | 1.750000 |
dom_nondom | message | n | price |
---|---|---|---|
dom | 1 | 5 | 2.300000 |
dom | 2 | 5 | 1.900000 |
dom | 3 | 4 | 2.333333 |
nondom | 1 | 5 | 1.600000 |
nondom | 2 | 7 | 1.500000 |
nondom | 3 | 2 | 1.750000 |
dom_nondom | message | n | price |
---|---|---|---|
dom | 1 | 5 | 3.200000 |
dom | 2 | 5 | 4.800000 |
dom | 3 | 4 | 4.500000 |
nondom | 1 | 5 | 5.800000 |
nondom | 2 | 7 | 4.714286 |
nondom | 3 | 2 | 3.500000 |