Data Cleaning

Survey item naming:
- Pos/Neg: Valence of emotion (Positive versus Negative)
- Exp/Res: Direction of norm (Expression versus Restraint)
- G/S: Question type (General: single question versus Specific: 3 questions)

Survey item structure:
- Student [X] is [description of event]. [He/She] feels [emotion].

Survey item emotions:
- NegRes_1: Anger
- NegRes_2: Disappointment
- NegRes_3: Embarrassment
- NegRes_3: Frustration
- NegRes_3: Sadness
- NegExp_1: Sadness
- NegExp_2: Fear
- NegExp_3: Disappointment
- NegExp_4: Nervousness
- NegExp_5: Regretfulness
- PosRes_1: Pridefulness
- PosRes_2: Excitement
- PosRes_3: Gratefulness
- PosRes_4: Joyfulness
- PosRes_5: Relief
- PosExp_1: Amusement
- PosExp_2: Excitement
- PosExp_3: Gratefulness
- PosExp_4: Joyfulness
- PosExp_5: Pridefulness

Survey item questions:
- General: How appropriate is it for student [X] to express [his/her] [emotion]?
- Specific: How appropriate is it for student [X] to express [his/her] [emotion] in front of the teacher?
- Specific: How appropriate is it for student [X] to express [his/her] [emotion] in front of the class?
- Specific: How appropriate is it for student [X] to express [his/her] [emotion] in front of one or a small group of peers?

Survey item response options:
- 1: extremely inappropriate
- 2: somewhat inappropriate
- 3: neither appropriate nor inappropriate
- 4: somewhat appropriate
- 5: extremely appropriate

Descriptive Statistics

Variables collapsed across gender

Does each vignette align with our expectations related to norms of emotional expression when separated between general and specific questions?

Yes, most vignettes align with our expectations, especially PosExpG_3, PosExpG_2, and PosExpG_1 (where we expected expressiveness) and PosResS_2, PosResS_1, NegResS_4 (where expected restraint). However, certain scenarios did not trend in the expected direction (e.g., NegExpS_3 aligned with restraint while PosResG_3 aligned with expression). We also see that the vignettes aligned with expression had the highest ratings when participants responded to the single general question, and vignettes aligned with restraint had lowest ratings when participants responded to the three specific questions.

Averages across 20 Items (General vs. Specific)
variable vars n mean sd median trimmed mad min max range skew kurtosis se category
PosExpG_3 18 18 4.888889 0.4714045 5.000000 5.000000 0.0000 3.000000 5.000000 2.000000 -3.5617230 11.3240741 0.1111111 Expression
PosExpG_1 16 19 4.789474 0.5353034 5.000000 4.882353 0.0000 3.000000 5.000000 2.000000 -2.2526182 4.0909028 0.1228070 Expression
PosExpG_2 17 19 4.789474 0.5353034 5.000000 4.882353 0.0000 3.000000 5.000000 2.000000 -2.2526182 4.0909028 0.1228070 Expression
PosResG_3 13 19 4.684210 0.5823927 5.000000 4.764706 0.0000 3.000000 5.000000 2.000000 -1.4967847 1.1457670 0.1336101 Restraint
PosExpS_2 37 16 4.583333 0.4127595 4.666667 4.595238 0.4942 4.000000 5.000000 1.000000 -0.3456324 -1.5960760 0.1031899 Expression
NegResG_2 2 22 4.500000 0.9636241 5.000000 4.722222 0.0000 1.000000 5.000000 4.000000 -2.2859507 5.2435449 0.2054454 Restraint
PosExpG_4 19 18 4.388889 0.9164438 5.000000 4.500000 0.0000 2.000000 5.000000 3.000000 -1.2065452 0.2791832 0.2160079 Expression
PosResG_4 14 19 4.368421 0.8306976 5.000000 4.470588 0.0000 2.000000 5.000000 3.000000 -1.2559184 1.0555401 0.1905751 Restraint
PosResS_4 34 16 4.354167 0.7350359 4.666667 4.404762 0.4942 3.000000 5.000000 2.000000 -0.4586202 -1.4590104 0.1837590 Restraint
PosExpS_1 36 16 4.354167 0.6142596 4.166667 4.404762 0.7413 3.000000 5.000000 2.000000 -0.3850682 -0.9217878 0.1535649 Expression
PosExpG_5 20 18 4.333333 0.9074852 5.000000 4.437500 0.0000 2.000000 5.000000 3.000000 -1.0902855 0.1128118 0.2138963 Expression
PosExpS_3 38 16 4.312500 0.5087203 4.166667 4.309524 0.7413 3.666667 5.000000 1.333333 0.2031596 -1.6051936 0.1271801 Expression
NegExpS_1 26 16 4.291667 0.5692750 4.333333 4.309524 0.4942 3.333333 5.000000 1.666667 -0.3458346 -1.3093718 0.1423188 Expression
PosExpS_4 39 16 4.145833 0.7197608 4.000000 4.166667 0.9884 3.000000 5.000000 2.000000 -0.0132405 -1.6319821 0.1799402 Expression
NegExpG_1 6 21 4.142857 1.1952286 4.000000 4.411765 1.4826 1.000000 5.000000 4.000000 -1.5981914 1.7189116 0.2608203 Expression
NegExpG_5 10 21 4.142857 1.3147515 5.000000 4.411765 0.0000 1.000000 5.000000 4.000000 -1.2546244 0.3304108 0.2869023 Expression
PosResS_3 33 16 4.125000 0.6540472 4.000000 4.166667 0.4942 2.666667 5.000000 2.333333 -0.3459354 -0.6147926 0.1635118 Restraint
NegExpS_4 29 16 4.104167 0.8407999 4.333333 4.166667 0.7413 2.333333 5.000000 2.666667 -0.7514632 -0.7487686 0.2102000 Expression
PosExpS_5 40 16 4.062500 0.9126173 4.333333 4.095238 0.9884 2.666667 5.000000 2.333333 -0.3299782 -1.6623735 0.2281543 Expression
PosResG_5 15 19 4.052632 0.9112680 4.000000 4.117647 1.4826 2.000000 5.000000 3.000000 -0.5121012 -0.8399122 0.2090592 Restraint
NegExpG_4 9 21 4.047619 1.2031704 4.000000 4.294118 1.4826 1.000000 5.000000 4.000000 -1.3981242 1.1435238 0.2625533 Expression
NegExpS_2 27 16 4.000000 0.8432740 4.333333 4.095238 0.4942 2.000000 4.666667 2.666667 -1.5286401 1.0649414 0.2108185 Expression
NegResG_1 1 22 3.954546 0.8985318 4.000000 4.055556 0.0000 1.000000 5.000000 4.000000 -1.4214579 2.9040164 0.1915676 Restraint
NegResS_2 22 16 3.875000 0.6309898 4.000000 3.880952 0.4942 2.666667 5.000000 2.333333 -0.2643272 -0.8227653 0.1577475 Restraint
PosResG_2 12 20 3.800000 1.2396944 4.000000 3.937500 1.4826 1.000000 5.000000 4.000000 -0.7432234 -0.7072537 0.2772041 Restraint
NegExpG_2 7 21 3.666667 1.2382784 4.000000 3.823529 1.4826 1.000000 5.000000 4.000000 -0.8917299 -0.3084886 0.2702145 Expression
NegExpG_3 8 21 3.666667 1.3165612 4.000000 3.823529 1.4826 1.000000 5.000000 4.000000 -0.7836674 -0.7247112 0.2872972 Expression
PosResG_1 11 20 3.650000 1.4964871 4.000000 3.812500 1.4826 1.000000 5.000000 4.000000 -0.6783101 -1.1080214 0.3346247 Restraint
NegExpS_5 30 16 3.645833 0.9848388 3.500000 3.738095 0.7413 1.000000 5.000000 4.000000 -0.8298738 0.8438493 0.2462097 Expression
NegResS_3 23 16 3.458333 0.7290278 3.500000 3.428571 0.7413 2.333333 5.000000 2.666667 0.2296356 -0.9909327 0.1822569 Restraint
NegResS_1 21 16 3.437500 0.9405967 3.666667 3.428571 0.9884 2.000000 5.000000 3.000000 -0.1320207 -1.3298964 0.2351492 Restraint
NegResG_3 3 21 3.333333 1.0645813 4.000000 3.352941 1.4826 1.000000 5.000000 4.000000 -0.4122205 -0.7920580 0.2323107 Restraint
NegResG_4 4 21 3.333333 1.1972190 4.000000 3.411765 1.4826 1.000000 5.000000 4.000000 -0.4563301 -0.8315177 0.2612546 Restraint
PosResS_5 35 16 3.333333 0.8520129 3.166667 3.309524 0.7413 2.000000 5.000000 3.000000 0.3592932 -0.9237167 0.2130032 Restraint
NegResS_5 25 16 3.166667 0.7200823 3.166667 3.190476 0.7413 2.000000 4.000000 2.000000 -0.3905804 -1.2149235 0.1800206 Restraint
NegResS_4 24 16 3.145833 0.6551081 3.166667 3.095238 0.2471 2.000000 5.000000 3.000000 0.9519183 1.8074324 0.1637770 Restraint
PosResS_1 31 16 3.083333 0.8649556 3.000000 3.119048 0.4942 1.000000 4.666667 3.666667 -0.2146279 0.2810145 0.2162389 Restraint
NegResG_5 5 21 3.047619 1.3592715 3.000000 3.058823 1.4826 1.000000 5.000000 4.000000 -0.1949418 -1.2918186 0.2966174 Restraint
PosResS_2 32 16 3.020833 0.8816546 3.000000 2.952381 0.9884 2.000000 5.000000 3.000000 0.5043589 -0.7100167 0.2204136 Restraint
NegExpS_3 28 16 2.833333 0.6440612 2.833333 2.833333 0.4942 1.666667 4.000000 2.333333 0.0000000 -0.9058713 0.1610153 Expression

Variables collapsed across gender and items (correlations)

Do general and specific survey items correlate?

The correlations between the general and specific items are not consistent with a range of .11-.74. In terms of which are most trending in the anticipated direction, the restrained items have 8/10 lower specific items than general items, and the expression items have 6/10 higher general items than specific items. It would seem that specific survey items are more likely to be rated lower when they are expected to be restrained, and general survey items are slightly more likely to be rated higher when they are expected to be expressive.

Averages and Correlations across 20 Items
Correlation General_Mean Specific_Mean
NegRes_1 0.65 3.95 3.44
NegRes_2 0.33 4.50 3.88
NegRes_3 0.49 3.33 3.46
NegRes_4 0.11 3.33 3.15
NegRes_5 0.56 3.05 3.17
NegExp_1 0.37 4.14 4.29
NegExp_2 0.74 3.67 4.00
NegExp_3 0.25 3.67 2.83
NegExp_4 0.32 4.05 4.10
NegExp_5 0.54 4.14 3.65
PosRes_1 0.29 3.65 3.08
PosRes_2 0.48 3.80 3.02
PosRes_3 0.12 4.68 4.12
PosRes_4 0.57 4.37 4.35
PosRes_5 0.43 4.05 3.33
PosExp_1 0.27 4.79 4.35
PosExp_2 0.56 4.79 4.58
PosExp_3 0.16 4.89 4.31
PosExp_4 0.68 4.39 4.15
PosExp_5 0.62 4.33 4.06

Variables collapsed across gender with specific items only

Do the 3 specific versions of each survey item correlate?

The correlations between the 3 specific versions of each item range from .1-.79. In terms of which are most trending in the anticipated direction, the restraint items are lowest for item 2 and the expression items are highest for item 3. It would seem that survey items with the context ‘in front of the class’ are much more likely to be rated lower when they are expected to be expressive, and items with the context ‘in front of one or a small group of peers’ are slightly more likely to be rated higher when they are expected to be expressive.

Averages across 20 Specific Items
Construct Item Mean_1 Mean_2 Mean_3 r_avg n
NegRes 1 3.688 2.812 3.812 0.577 16
NegRes 2 4.188 2.875 4.562 0.318 16
NegRes 3 3.625 2.688 4.062 0.211 16
NegRes 4 3.625 1.875 3.938 0.097 16
NegRes 5 3.375 2.250 3.875 0.257 16
NegExp 1 4.625 3.812 4.438 0.567 16
NegExp 2 4.688 3.188 4.125 0.693 16
NegExp 3 2.688 1.875 3.938 0.231 16
NegExp 4 4.250 3.688 4.375 0.670 16
NegExp 5 3.688 3.188 4.062 0.614 16
PosRes 1 3.375 2.312 3.562 0.573 16
PosRes 2 3.125 2.250 3.688 0.438 16
PosRes 3 4.188 3.688 4.500 0.487 16
PosRes 4 4.438 4.062 4.562 0.670 16
PosRes 5 2.938 2.875 4.188 0.594 16
PosExp 1 4.438 4.125 4.500 0.761 16
PosExp 2 4.438 4.625 4.688 0.411 16
PosExp 3 4.438 4.000 4.500 0.488 16
PosExp 4 4.500 3.438 4.500 0.675 16
PosExp 5 4.312 3.500 4.375 0.786 16

Variables collapsed across gender and item

Does each vignette align with our expectations related to norms of emotional expression?

Yes, most expressive vignettes align with our expectations, especially PosExp_3, PosExp_2, PosExp_1, and NegExp_1 (where we expected expressiveness). Survey items for NegRes_5, PosRes_2, NegRes_4, and PosRes_1 were aligned with ratings of emotional restraint, but were still rated as neither appropriate nor inappropriate (or somewhat or extremely apprioriate), indicating lack of strong alignment with emotional restraint for these vignettes. Essentially, the restraint vignettes had higher averages once combined with the general question (whereas they had more extreme responses when just looking at the specific questions).

Averages across 20 Items
variable vars n mean sd median trimmed mad min max range skew kurtosis se category
Avg_PosExp_2 17 19 4.719298 0.4196288 4.833333 4.774510 0.24710 3.500000 5.000000 1.500000 -1.5455740 1.4682273 0.0962695 Expression
Avg_PosExp_3 18 18 4.638889 0.3845462 4.666667 4.687500 0.49420 3.500000 5.000000 1.500000 -1.2468444 1.6109305 0.0906384 Expression
Avg_PosExp_1 16 19 4.622807 0.4642866 4.833333 4.666667 0.24710 3.500000 5.000000 1.500000 -0.8822557 -0.4712370 0.1065147 Expression
Avg_PosRes_3 13 19 4.473684 0.4946103 4.500000 4.509804 0.49420 3.333333 5.000000 1.666667 -0.6883639 -0.5711735 0.1134714 Restraint
Avg_PosRes_4 14 19 4.359649 0.6832727 4.500000 4.431373 0.74130 2.500000 5.000000 2.500000 -0.9871873 0.4242282 0.1567535 Restraint
Avg_PosExp_4 19 18 4.314815 0.7603080 4.500000 4.385417 0.74130 2.500000 5.000000 2.500000 -0.8275031 -0.4539541 0.1792063 Expression
Avg_NegRes_2 2 22 4.227273 0.8931625 4.416667 4.388889 0.61775 1.000000 5.000000 4.000000 -2.1167423 5.0759598 0.1904229 Restraint
Avg_PosExp_5 20 18 4.222222 0.8104707 4.416667 4.270833 0.86485 2.666667 5.000000 2.333333 -0.5974677 -1.1225930 0.1910298 Expression
Avg_NegExp_1 6 21 4.063492 1.1211058 4.333333 4.313726 0.74130 1.000000 5.000000 4.000000 -1.7969374 2.4284682 0.2446454 Expression
Avg_NegExp_4 9 21 3.968254 1.1530383 4.333333 4.196078 0.98840 1.000000 5.000000 4.000000 -1.4439984 1.3790673 0.2516136 Expression
Avg_NegExp_5 10 21 3.865079 1.2400930 4.166667 4.068627 0.98840 1.000000 5.000000 4.000000 -1.1346135 0.1829861 0.2706105 Expression
Avg_PosRes_5 15 19 3.771930 0.7702223 4.000000 3.784314 0.74130 2.333333 5.000000 2.666667 -0.3077820 -0.9821315 0.1767011 Restraint
Avg_NegRes_1 1 22 3.727273 0.9393590 3.916667 3.805556 0.98840 1.000000 5.000000 4.000000 -0.8486689 0.9945208 0.2002720 Restraint
Avg_NegExp_2 7 21 3.666667 1.1690452 4.166667 3.843137 0.49420 1.000000 4.833333 3.833333 -1.2286218 0.1316393 0.2551066 Expression
Avg_PosRes_2 12 20 3.433333 1.0941097 3.500000 3.479167 0.74130 1.000000 5.000000 4.000000 -0.3704743 -0.6268669 0.2446504 Restraint
Avg_PosRes_1 11 20 3.408333 1.1335849 3.666667 3.468750 1.11195 1.000000 5.000000 4.000000 -0.4286475 -0.9072882 0.2534773 Restraint
Avg_NegRes_3 3 21 3.317460 0.9802278 3.333333 3.362745 0.98840 1.000000 5.000000 4.000000 -0.4373183 -0.4634529 0.2139032 Restraint
Avg_NegExp_3 8 21 3.222222 1.0479256 3.500000 3.313725 0.74130 1.000000 5.000000 4.000000 -0.6732746 -0.3427778 0.2286761 Expression
Avg_NegRes_4 4 21 3.126984 0.9470785 3.166667 3.235294 0.74130 1.000000 4.500000 3.500000 -0.8002069 0.0081366 0.2066695 Restraint
Avg_NegRes_5 5 21 2.968254 1.0924222 3.000000 3.019608 1.48260 1.000000 4.500000 3.500000 -0.3326054 -1.1609406 0.2383861 Restraint

Variables collapsed across gender, item, and item category

Does each vignette category align with our expectations related to norms of emotional expression when separated between general and specific questions?

Yes, survey items for PosExpG and NegExpG were aligned with ratings of emotional expression were rated as somewhat appropriate or extremely appropriate. Survey items for NegResS and PosResS were aligned with ratings of emotional restraint, but were still rated as neither appropriate nor inappropriate (or somewhat or extremely appropriate), indicating lack of strong alignment with emotional restraint for these vignettes. The prior trend continued in which survey items with general questions were rated as most expressive and survey items with specific questions were rated as least expressive.

Averages across 4 Categories (General vs. Specific)
variable vars n mean sd median trimmed mad min max range skew kurtosis se category
Avg_PosExpG 4 19 4.652632 0.5409543 5.000000 4.729412 0.00000 3.000000 5.000000 2.000000 -1.6685340 2.1160813 0.1241034 Expression
Avg_PosExpS 8 16 4.291667 0.5276784 4.333333 4.304762 0.64246 3.400000 5.000000 1.600000 -0.2135147 -1.4092151 0.1319196 Expression
Avg_PosResG 3 20 4.010000 1.0452398 4.300000 4.175000 1.03782 1.000000 5.000000 4.000000 -1.2059508 1.0109313 0.2337227 Restraint
Avg_NegExpG 2 21 3.933333 1.0850499 4.200000 4.164706 0.59304 1.000000 5.000000 4.000000 -1.7676536 2.2312555 0.2367773 Expression
Avg_NegExpS 6 16 3.775000 0.5122933 3.866667 3.847619 0.29652 2.200000 4.333333 2.133333 -1.7303451 2.8475305 0.1280733 Expression
Avg_NegResG 1 22 3.668182 0.8604464 3.700000 3.727778 0.74130 1.000000 5.000000 4.000000 -1.0641567 1.8024365 0.1834478 Restraint
Avg_PosResS 7 16 3.583333 0.5606874 3.500000 3.571429 0.44478 2.733333 4.600000 1.866667 0.3271617 -0.8536998 0.1401719 Restraint
Avg_NegResS 5 16 3.416667 0.4310195 3.566667 3.447619 0.29652 2.400000 4.000000 1.600000 -0.8558073 -0.2974050 0.1077549 Restraint

Variables collapsed across gender, item, item category, and question type

Does each vignette category align with our expectations related to norms of emotional expression?

Yes, categories broadly aligned with expression or restraint. However, restraint vignettes were still rated as neither appropriate nor inappropriate on average.

Averages across 4 Categories
variable vars n mean sd median trimmed mad min max range skew kurtosis se category
Avg_PosExp 4 16 4.445833 0.5035982 4.616667 4.485714 0.49420 3.333333 5.000000 1.666667 -0.7204554 -0.7793479 0.1258995 Expression
Avg_NegExp 2 16 4.006250 0.4649522 4.050000 4.045238 0.24710 2.800000 4.666667 1.866667 -0.9820561 0.5989539 0.1162381 Expression
Avg_PosRes 3 16 3.854167 0.6193037 4.100000 3.873810 0.79072 2.633333 4.800000 2.166667 -0.3131841 -1.0665132 0.1548259 Restraint
Avg_NegRes 1 16 3.633333 0.4661902 3.566667 3.630952 0.54362 2.800000 4.500000 1.700000 0.0467447 -1.1147456 0.1165476 Restraint