Reward_recognition Descriptives

Data were aggregated by Department (final N=269 departments)

Descriptive Statistics for Reward_recognition
vars n mean sd median trimmed mad min max range skew kurtosis se
X1 1 269 2.613265 0.7376417 2.5 2.586534 0.7413 1 5 4 0.4684769 0.8408714 0.0449748

Descriptive Statistics for Reward_recognition by Category
reward_recognition_category Count Mean SD
Favorable 178 2.214916 0.4630320
Neutral 74 3.179686 0.2215281
Unfavorable 17 4.318627 0.4231119
Descriptive Statistics for Reward_recognition by Percentile
reward_recognition_percentile Count Mean SD
Top 20% 33 1.478114 0.3119911
Middle 60% 182 2.508116 0.3647303
Bottom 20% 54 3.661360 0.5280057

Reward_recognition and Quit Probability

Correlation between Reward_recognition and Quit Probability
Correlation
-0.0359315
## `geom_smooth()` using formula = 'y ~ x'

ANOVA Results for Quit Probability by Reward_recognition Category
Df Sum Sq Mean Sq F value Pr(>F)
reward_recognition_category 2 0.0000564 2.82e-05 0.8118956 0.4453121
Residuals 225 0.0078147 3.47e-05 NA NA
Tukey’s HSD Post-hoc Results for Reward_recognition Category
Comparison Estimate Std_Error z_value p_value
Neutral - Favorable Neutral - Favorable -0.0009219 0.0008706 -1.0589712 0.5288576
Unfavorable - Favorable Unfavorable - Favorable -0.0013743 0.0015525 -0.8852347 0.6399202
Unfavorable - Neutral Unfavorable - Neutral -0.0004524 0.0016399 -0.2758828 0.9573188

ANOVA Results for Quit Probability by Reward_recognition Percentile
Df Sum Sq Mean Sq F value Pr(>F)
reward_recognition_percentile 2 0.0000285 1.42e-05 0.408295 0.6652743
Residuals 225 0.0078427 3.49e-05 NA NA
Tukey’s HSD Post-hoc Results for Reward_recognition Percentile
Comparison Estimate Std_Error z_value p_value
Middle 60% - Top 20% Middle 60% - Top 20% 0.0002474 0.0012962 0.1908612 0.9795933
Bottom 20% - Top 20% Bottom 20% - Top 20% -0.0006149 0.0014614 -0.4207558 0.9047523
Bottom 20% - Middle 60% Bottom 20% - Middle 60% -0.0008623 0.0009546 -0.9033085 0.6318799

##Relationship between Reward_recognition and Scheduling Shaps

Correlation Matrix: Reward_recognition and Scheduling SHAP Variables
reward_recognition Unscheduled_Time_risk_factor_shap Scheduling_overlapping_appointments_risk_factor_shap Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap Scheduling_back_to_back_appointments_risk_factor_shap SchedulingWeekends_risk_factor_shap
reward_recognition 1.0000000 -0.0528248 0.1784634 0.0464669 -0.0101732 0.0587434 0.0037260 0.0479818
Unscheduled_Time_risk_factor_shap -0.0528248 1.0000000 0.1074331 0.1203767 0.0780532 0.0613317 0.0960513 -0.0179730
Scheduling_overlapping_appointments_risk_factor_shap 0.1784634 0.1074331 1.0000000 -0.1655393 -0.1191948 -0.4153116 0.2109286 0.0743987
Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 0.0464669 0.1203767 -0.1655393 1.0000000 0.1472663 0.6380386 -0.0603795 0.1498284
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap -0.0101732 0.0780532 -0.1191948 0.1472663 1.0000000 0.2968274 0.1307884 -0.0434544
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 0.0587434 0.0613317 -0.4153116 0.6380386 0.2968274 1.0000000 -0.1558050 0.0968575
Scheduling_back_to_back_appointments_risk_factor_shap 0.0037260 0.0960513 0.2109286 -0.0603795 0.1307884 -0.1558050 1.0000000 -0.0204519
SchedulingWeekends_risk_factor_shap 0.0479818 -0.0179730 0.0743987 0.1498284 -0.0434544 0.0968575 -0.0204519 1.0000000
P-values for the Correlations
reward_recognition Unscheduled_Time_risk_factor_shap Scheduling_overlapping_appointments_risk_factor_shap Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap Scheduling_back_to_back_appointments_risk_factor_shap SchedulingWeekends_risk_factor_shap
reward_recognition NA 0.4530281 0.0106543 0.4939232 0.8810076 0.3869864 0.9578192 0.5064513
Unscheduled_Time_risk_factor_shap 0.4530281 NA 0.1261524 0.0863451 0.2671430 0.3835198 0.1717447 0.8086599
Scheduling_overlapping_appointments_risk_factor_shap 0.0106543 0.1261524 NA 0.0179720 0.0895004 0.0000000 0.0024594 0.3155196
Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 0.4939232 0.0863451 0.0179720 NA 0.0293493 0.0000000 0.3909610 0.0370542
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 0.8810076 0.2671430 0.0895004 0.0293493 NA 0.0000079 0.0622417 0.5474255
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 0.3869864 0.3835198 0.0000000 0.0000000 0.0000079 NA 0.0260629 0.1791063
Scheduling_back_to_back_appointments_risk_factor_shap 0.9578192 0.1717447 0.0024594 0.3909610 0.0622417 0.0260629 NA 0.7828853
SchedulingWeekends_risk_factor_shap 0.5064513 0.8086599 0.3155196 0.0370542 0.5474255 0.1791063 0.7828853 NA
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Scheduling SHAP Variables by Reward_recognition Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
reward_recognition_category…1 Unscheduled_Time_risk_factor_shap 2 0.0200646 0.0100323 3.4110590 0.0349286
Residuals …2 Unscheduled_Time_risk_factor_shap 201 0.5911636 0.0029411 NA NA
reward_recognition_category…3 Scheduling_overlapping_appointments_risk_factor_shap 2 0.1108014 0.0554007 5.0834673 0.0070194
Residuals …4 Scheduling_overlapping_appointments_risk_factor_shap 201 2.1905396 0.0108982 NA NA
reward_recognition_category…5 Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 2 0.0032022 0.0016011 0.2893666 0.7490275
Residuals …6 Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 216 1.1951428 0.0055331 NA NA
reward_recognition_category…7 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 2 0.0000161 0.0000081 0.1208206 0.8862528
Residuals …8 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 216 0.0144286 0.0000668 NA NA
reward_recognition_category…9 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 2 0.0160854 0.0080427 1.8158268 0.1651781
Residuals …10 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 216 0.9567097 0.0044292 NA NA
reward_recognition_category…11 Scheduling_back_to_back_appointments_risk_factor_shap 2 0.0005088 0.0002544 0.4325796 0.6494358
Residuals …12 Scheduling_back_to_back_appointments_risk_factor_shap 201 0.1182134 0.0005881 NA NA
reward_recognition_category…13 SchedulingWeekends_risk_factor_shap 2 0.0260970 0.0130485 1.2774139 0.2811278
Residuals …14 SchedulingWeekends_risk_factor_shap 191 1.9510251 0.0102148 NA NA

##Relationship between Reward_recognition and Workload Shaps

Encounter_Duration_risk_factor_shap

Clinical_Workload_RVU_risk_factor_shap

Clinical_Workload_Procedure_Type_risk_factor_shap

Clinical_Workload_Procedure_Count_risk_factor_shap”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap

“Nonpatient_contact_time_risk_factor_shap

##Relationship between Reward_recognition and Workload Shaps

Encounter_Duration_risk_factor_shap

Clinical_Workload_RVU_risk_factor_shap

Clinical_Workload_Procedure_Type_risk_factor_shap

Clinical_Workload_Procedure_Count_risk_factor_shap”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap

“Nonpatient_contact_time_risk_factor_shap

“Clinical_Workload_Encounter_count_risk_factor_shap”

Correlation Matrix: Reward_recognition and Workload SHAP Variables
reward_recognition Encounter_Duration_risk_factor_shap Clinical_Workload_RVU_risk_factor_shap Clinical_Workload_Procedure_Type_risk_factor_shap Clinical_Workload_Procedure_Count_risk_factor_shap Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap Clinical_Workload_Encounter_count_risk_factor_shap Nonpatient_contact_time_risk_factor_shap
reward_recognition 1.0000000 -0.0704563 0.0597535 0.1083505 0.1065467 -0.0763605 -0.0455718 0.0907618 0.0611508
Encounter_Duration_risk_factor_shap -0.0704563 1.0000000 -0.2262257 -0.0446032 -0.2084849 0.1380264 0.1550642 0.2730183 -0.2203552
Clinical_Workload_RVU_risk_factor_shap 0.0597535 -0.2262257 1.0000000 0.0800352 0.5795920 0.0809919 0.0589783 -0.2399206 0.3581040
Clinical_Workload_Procedure_Type_risk_factor_shap 0.1083505 -0.0446032 0.0800352 1.0000000 0.0416841 0.2444559 0.0595537 0.1101940 -0.1025363
Clinical_Workload_Procedure_Count_risk_factor_shap 0.1065467 -0.2084849 0.5795920 0.0416841 1.0000000 0.1053561 0.0178292 -0.2028889 0.2165978
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap -0.0763605 0.1380264 0.0809919 0.2444559 0.1053561 1.0000000 -0.0176133 0.3770314 -0.2855978
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap -0.0455718 0.1550642 0.0589783 0.0595537 0.0178292 -0.0176133 1.0000000 0.0402679 0.1507316
Clinical_Workload_Encounter_count_risk_factor_shap 0.0907618 0.2730183 -0.2399206 0.1101940 -0.2028889 0.3770314 0.0402679 1.0000000 -0.4980576
Nonpatient_contact_time_risk_factor_shap 0.0611508 -0.2203552 0.3581040 -0.1025363 0.2165978 -0.2855978 0.1507316 -0.4980576 1.0000000
P-values for the Correlations
reward_recognition Encounter_Duration_risk_factor_shap Clinical_Workload_RVU_risk_factor_shap Clinical_Workload_Procedure_Type_risk_factor_shap Clinical_Workload_Procedure_Count_risk_factor_shap Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap Clinical_Workload_Encounter_count_risk_factor_shap Nonpatient_contact_time_risk_factor_shap
reward_recognition NA 0.3251983 0.3799641 0.1106499 0.1167489 0.2605006 0.5206163 0.1818323 0.3849267
Encounter_Duration_risk_factor_shap 0.3251983 NA 0.0013907 0.5337042 0.0032823 0.0530845 0.0295734 0.0001038 0.0018615
Clinical_Workload_RVU_risk_factor_shap 0.3799641 0.0013907 NA 0.2392750 0.0000000 0.2336874 0.4067796 0.0003624 0.0000002
Clinical_Workload_Procedure_Type_risk_factor_shap 0.1106499 0.5337042 0.2392750 NA 0.5404144 0.0002684 0.4022096 0.1054866 0.1454655
Clinical_Workload_Procedure_Count_risk_factor_shap 0.1167489 0.0032823 0.0000000 0.5404144 NA 0.1209160 0.8021371 0.0026753 0.0019098
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 0.2605006 0.0530845 0.2336874 0.0002684 0.1209160 NA 0.8040003 0.0000000 0.0000346
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 0.5206163 0.0295734 0.4067796 0.4022096 0.8021371 0.8040003 NA 0.5703301 0.0326892
Clinical_Workload_Encounter_count_risk_factor_shap 0.1818323 0.0001038 0.0003624 0.1054866 0.0026753 0.0000000 0.5703301 NA 0.0000000
Nonpatient_contact_time_risk_factor_shap 0.3849267 0.0018615 0.0000002 0.1454655 0.0019098 0.0000346 0.0326892 0.0000000 NA
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Workload SHAP Variables by Reward_recognition Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
reward_recognition_category…1 Encounter_Duration_risk_factor_shap 2 0.0203941 0.0101970 1.1041468 0.3335676
Residuals …2 Encounter_Duration_risk_factor_shap 194 1.7916312 0.0092352 NA NA
reward_recognition_category…3 Clinical_Workload_RVU_risk_factor_shap 2 0.0193733 0.0096866 0.9034976 0.4066827
Residuals …4 Clinical_Workload_RVU_risk_factor_shap 215 2.3050728 0.0107213 NA NA
reward_recognition_category…5 Clinical_Workload_Procedure_Type_risk_factor_shap 2 0.0083585 0.0041793 1.0749407 0.3431451
Residuals …6 Clinical_Workload_Procedure_Type_risk_factor_shap 215 0.8358983 0.0038879 NA NA
reward_recognition_category…7 Clinical_Workload_Procedure_Count_risk_factor_shap 2 0.0040952 0.0020476 0.6769449 0.5092469
Residuals …8 Clinical_Workload_Procedure_Count_risk_factor_shap 215 0.6503289 0.0030248 NA NA
reward_recognition_category…9 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 2 0.0022052 0.0011026 1.1535697 0.3174444
Residuals …10 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 216 0.2064544 0.0009558 NA NA
reward_recognition_category…11 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 2 0.0060323 0.0030162 1.1278442 0.3258011
Residuals …12 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 198 0.5295077 0.0026743 NA NA
reward_recognition_category…13 Clinical_Workload_Encounter_count_risk_factor_shap 2 0.0375770 0.0187885 2.3055244 0.1021667
Residuals …14 Clinical_Workload_Encounter_count_risk_factor_shap 215 1.7521066 0.0081493 NA NA
reward_recognition_category…15 Nonpatient_contact_time_risk_factor_shap 2 0.0403705 0.0201853 1.1371890 0.3227739
Residuals …16 Nonpatient_contact_time_risk_factor_shap 201 3.5677759 0.0177501 NA NA

##Relationship between Reward_recognition and Ehr Shaps

EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_patient_history_risk_factor_shap”,

“EHR_usage_time_spent_on_patient_education_risk_factor_shap”,

“EHR_usage_time_spent_on_orders_risk_factor_shap”,

“EHR_usage_time_spent_on_notes_risk_factor_shap”,

“EHR_usage_time_spent_on_messaging_risk_factor_shap”,

“EHR_usage_time_spent_on_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_charging_risk_factor_shap”,

“EHR_usage_time_spent_on_assessment_risk_factor_shap”,

“EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap”,

“EHR_usage_time_spent_on_administrative_processes_risk_factor_shap”,

“EHR_uncategorized_time_risk_factor_shap” )

Correlation Matrix: Reward_recognition and Ehr SHAP Variables
reward_recognition EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_patient_history_risk_factor_shap EHR_usage_time_spent_on_patient_education_risk_factor_shap EHR_usage_time_spent_on_orders_risk_factor_shap EHR_usage_time_spent_on_notes_risk_factor_shap EHR_usage_time_spent_on_messaging_risk_factor_shap EHR_usage_time_spent_on_EHR_system_risk_factor_shap EHR_usage_time_spent_on_charging_risk_factor_shap EHR_usage_time_spent_on_assessment_risk_factor_shap EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap EHR_usage_time_spent_on_administrative_processes_risk_factor_shap EHR_uncategorized_time_risk_factor_shap
reward_recognition 1.0000000 -0.0720826 -0.0025513 -0.0685567 0.0329007 -0.1156899 -0.0633182 -0.0001695 -0.0808002 -0.1153177 0.0059266 0.1107517 -0.0145837 -0.0204162
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap -0.0720826 1.0000000 0.4625391 0.3935647 0.3936631 0.0127669 0.4791951 0.0681449 0.7803844 0.2866464 0.3693576 -0.4094449 0.6996216 0.0985913
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap -0.0025513 0.4625391 1.0000000 0.5524408 0.2875210 0.0456950 0.3675777 -0.0364662 0.5467299 0.2346365 0.3206382 -0.3139356 0.6583274 0.1774795
EHR_usage_time_spent_on_patient_history_risk_factor_shap -0.0685567 0.3935647 0.5524408 1.0000000 0.1080566 0.0133008 0.2421737 -0.0005768 0.4133753 0.1490189 0.3183151 -0.2257065 0.4830547 0.1880824
EHR_usage_time_spent_on_patient_education_risk_factor_shap 0.0329007 0.3936631 0.2875210 0.1080566 1.0000000 0.1352755 0.3408316 -0.1021671 0.4900959 0.1682598 0.2923523 -0.3348235 0.4988600 0.0186822
EHR_usage_time_spent_on_orders_risk_factor_shap -0.1156899 0.0127669 0.0456950 0.0133008 0.1352755 1.0000000 -0.0263452 -0.0695341 0.1039823 -0.0442113 0.0135692 -0.0741403 0.0139322 0.0810434
EHR_usage_time_spent_on_notes_risk_factor_shap -0.0633182 0.4791951 0.3675777 0.2421737 0.3408316 -0.0263452 1.0000000 0.0642468 0.5635219 0.2766452 0.2532913 -0.4678691 0.5000973 0.0184974
EHR_usage_time_spent_on_messaging_risk_factor_shap -0.0001695 0.0681449 -0.0364662 -0.0005768 -0.1021671 -0.0695341 0.0642468 1.0000000 0.0506593 0.1245726 0.0011789 -0.1052265 -0.0782965 0.0039928
EHR_usage_time_spent_on_EHR_system_risk_factor_shap -0.0808002 0.7803844 0.5467299 0.4133753 0.4900959 0.1039823 0.5635219 0.0506593 1.0000000 0.3715501 0.3687570 -0.4470924 0.7563752 0.0920523
EHR_usage_time_spent_on_charging_risk_factor_shap -0.1153177 0.2866464 0.2346365 0.1490189 0.1682598 -0.0442113 0.2766452 0.1245726 0.3715501 1.0000000 0.0502955 -0.1996492 0.2853860 0.0517544
EHR_usage_time_spent_on_assessment_risk_factor_shap 0.0059266 0.3693576 0.3206382 0.3183151 0.2923523 0.0135692 0.2532913 0.0011789 0.3687570 0.0502955 1.0000000 -0.2501693 0.4996607 0.0693299
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 0.1107517 -0.4094449 -0.3139356 -0.2257065 -0.3348235 -0.0741403 -0.4678691 -0.1052265 -0.4470924 -0.1996492 -0.2501693 1.0000000 -0.5065934 -0.0807939
EHR_usage_time_spent_on_administrative_processes_risk_factor_shap -0.0145837 0.6996216 0.6583274 0.4830547 0.4988600 0.0139322 0.5000973 -0.0782965 0.7563752 0.2853860 0.4996607 -0.5065934 1.0000000 0.1356093
EHR_uncategorized_time_risk_factor_shap -0.0204162 0.0985913 0.1774795 0.1880824 0.0186822 0.0810434 0.0184974 0.0039928 0.0920523 0.0517544 0.0693299 -0.0807939 0.1356093 1.0000000
P-values for the Correlations
reward_recognition EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_patient_history_risk_factor_shap EHR_usage_time_spent_on_patient_education_risk_factor_shap EHR_usage_time_spent_on_orders_risk_factor_shap EHR_usage_time_spent_on_notes_risk_factor_shap EHR_usage_time_spent_on_messaging_risk_factor_shap EHR_usage_time_spent_on_EHR_system_risk_factor_shap EHR_usage_time_spent_on_charging_risk_factor_shap EHR_usage_time_spent_on_assessment_risk_factor_shap EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap EHR_usage_time_spent_on_administrative_processes_risk_factor_shap EHR_uncategorized_time_risk_factor_shap
reward_recognition NA 0.2827349 0.9697105 0.3070060 0.6242824 0.0840588 0.3455250 0.9979871 0.2283920 0.0850675 0.9297134 0.0982502 0.8281618 0.7612158
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 0.2827349 NA 0.0000000 0.0000000 0.0000000 0.8492967 0.0000000 0.3099278 0.0000000 0.0000131 0.0000000 0.0000000 0.0000000 0.1413156
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 0.9697105 0.0000000 NA 0.0000000 0.0000123 0.4962322 0.0000000 0.5871960 0.0000000 0.0003976 0.0000009 0.0000016 0.0000000 0.0077544
EHR_usage_time_spent_on_patient_history_risk_factor_shap 0.3070060 0.0000000 0.0000000 NA 0.1067615 0.8430736 0.0002533 0.9931510 0.0000000 0.0257275 0.0000011 0.0006660 0.0000000 0.0047360
EHR_usage_time_spent_on_patient_education_risk_factor_shap 0.6242824 0.0000000 0.0000123 0.1067615 NA 0.0431147 0.0000002 0.1273754 0.0000000 0.0116623 0.0000086 0.0000003 0.0000000 0.7809591
EHR_usage_time_spent_on_orders_risk_factor_shap 0.0840588 0.8492967 0.4962322 0.8430736 0.0431147 NA 0.6949397 0.3001447 0.1207180 0.5103358 0.8399496 0.2691841 0.8357271 0.2269898
EHR_usage_time_spent_on_notes_risk_factor_shap 0.3455250 0.0000000 0.0000000 0.0002533 0.0000002 0.6949397 NA 0.3384825 0.0000000 0.0000267 0.0001269 0.0000000 0.0000000 0.7830711
EHR_usage_time_spent_on_messaging_risk_factor_shap 0.9979871 0.3099278 0.5871960 0.9931510 0.1273754 0.3001447 0.3384825 NA 0.4505838 0.0627078 0.9860019 0.1163133 0.2431815 0.9526135
EHR_usage_time_spent_on_EHR_system_risk_factor_shap 0.2283920 0.0000000 0.0000000 0.0000000 0.0000000 0.1207180 0.0000000 0.4505838 NA 0.0000000 0.0000000 0.0000000 0.0000000 0.1697766
EHR_usage_time_spent_on_charging_risk_factor_shap 0.0850675 0.0000131 0.0003976 0.0257275 0.0116623 0.5103358 0.0000267 0.0627078 0.0000000 NA 0.4538472 0.0026853 0.0000144 0.4408424
EHR_usage_time_spent_on_assessment_risk_factor_shap 0.9297134 0.0000000 0.0000009 0.0000011 0.0000086 0.8399496 0.0001269 0.9860019 0.0000000 0.4538472 NA 0.0001546 0.0000000 0.3015694
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 0.0982502 0.0000000 0.0000016 0.0006660 0.0000003 0.2691841 0.0000000 0.1163133 0.0000000 0.0026853 0.0001546 NA 0.0000000 0.2284282
EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 0.8281618 0.0000000 0.0000000 0.0000000 0.0000000 0.8357271 0.0000000 0.2431815 0.0000000 0.0000144 0.0000000 0.0000000 NA 0.0425975
EHR_uncategorized_time_risk_factor_shap 0.7612158 0.1413156 0.0077544 0.0047360 0.7809591 0.2269898 0.7830711 0.9526135 0.1697766 0.4408424 0.3015694 0.2284282 0.0425975 NA
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Ehr SHAP Variables by Reward_recognition Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
reward_recognition_category…1 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 2 0.0183843 0.0091921 0.7270435 0.4844882
Residuals …2 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 221 2.7941426 0.0126432 NA NA
reward_recognition_category…3 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 2 0.0103403 0.0051701 0.4175315 0.6591892
Residuals …4 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 221 2.7365568 0.0123826 NA NA
reward_recognition_category…5 EHR_usage_time_spent_on_patient_history_risk_factor_shap 2 0.0266248 0.0133124 1.5896615 0.2063182
Residuals …6 EHR_usage_time_spent_on_patient_history_risk_factor_shap 221 1.8507308 0.0083743 NA NA
reward_recognition_category…7 EHR_usage_time_spent_on_patient_education_risk_factor_shap 2 0.0346109 0.0173054 3.1468378 0.0449204
Residuals …8 EHR_usage_time_spent_on_patient_education_risk_factor_shap 221 1.2153475 0.0054993 NA NA
reward_recognition_category…9 EHR_usage_time_spent_on_orders_risk_factor_shap 2 0.0569620 0.0284810 4.4456903 0.0127964
Residuals …10 EHR_usage_time_spent_on_orders_risk_factor_shap 221 1.4158205 0.0064064 NA NA
reward_recognition_category…11 EHR_usage_time_spent_on_notes_risk_factor_shap 2 0.0108962 0.0054481 0.7489349 0.4740662
Residuals …12 EHR_usage_time_spent_on_notes_risk_factor_shap 221 1.6076572 0.0072745 NA NA
reward_recognition_category…13 EHR_usage_time_spent_on_messaging_risk_factor_shap 2 0.0019139 0.0009569 0.4243492 0.6547273
Residuals …14 EHR_usage_time_spent_on_messaging_risk_factor_shap 221 0.4983750 0.0022551 NA NA
reward_recognition_category…15 EHR_usage_time_spent_on_EHR_system_risk_factor_shap 2 0.1214209 0.0607104 1.7029970 0.1845182
Residuals …16 EHR_usage_time_spent_on_EHR_system_risk_factor_shap 221 7.8784689 0.0356492 NA NA
reward_recognition_category…17 EHR_usage_time_spent_on_charging_risk_factor_shap 2 0.0714598 0.0357299 1.9290011 0.1477317
Residuals …18 EHR_usage_time_spent_on_charging_risk_factor_shap 221 4.0934685 0.0185225 NA NA
reward_recognition_category…19 EHR_usage_time_spent_on_assessment_risk_factor_shap 2 0.0019625 0.0009813 0.4022357 0.6693117
Residuals …20 EHR_usage_time_spent_on_assessment_risk_factor_shap 221 0.5391287 0.0024395 NA NA
reward_recognition_category…21 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 2 0.0780891 0.0390446 3.1212629 0.0460516
Residuals …22 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 221 2.7645377 0.0125092 NA NA
reward_recognition_category…23 EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 2 0.1352851 0.0676426 1.2141445 0.2989370
Residuals …24 EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 221 12.3123795 0.0557121 NA NA
reward_recognition_category…25 EHR_uncategorized_time_risk_factor_shap 2 0.0000608 0.0000304 0.7097802 0.4928697
Residuals …26 EHR_uncategorized_time_risk_factor_shap 221 0.0094667 0.0000428 NA NA

##Relationship between Reward_recognition and Scheduling Features

Correlation Matrix: Reward_recognition and Scheduling FEATURE Variables
reward_recognition Unscheduled_Time_risk_factor_feature_value Scheduling_overlapping_appointments_risk_factor_feature_value Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value Scheduling_back_to_back_appointments_risk_factor_feature_value SchedulingWeekends_risk_factor_feature_value
reward_recognition 1.0000000 0.0645603 -0.1205586 -0.0584630 0.0448700 0.0457732 -0.0786602 -0.0049973
Unscheduled_Time_risk_factor_feature_value 0.0645603 1.0000000 -0.0573554 -0.0892838 -0.0063455 0.1238255 0.0769870 -0.1136307
Scheduling_overlapping_appointments_risk_factor_feature_value -0.1205586 -0.0573554 1.0000000 -0.3596856 0.1347903 0.3324081 0.3666426 0.0226906
Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value -0.0584630 -0.0892838 -0.3596856 1.0000000 -0.0073217 0.1566051 0.0715954 -0.0773370
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 0.0448700 -0.0063455 0.1347903 -0.0073217 1.0000000 -0.0071389 0.0363418 0.2210164
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 0.0457732 0.1238255 0.3324081 0.1566051 -0.0071389 1.0000000 0.8187556 -0.2911901
Scheduling_back_to_back_appointments_risk_factor_feature_value -0.0786602 0.0769870 0.3666426 0.0715954 0.0363418 0.8187556 1.0000000 -0.3121378
SchedulingWeekends_risk_factor_feature_value -0.0049973 -0.1136307 0.0226906 -0.0773370 0.2210164 -0.2911901 -0.3121378 1.0000000
P-values for the Correlations
reward_recognition Unscheduled_Time_risk_factor_feature_value Scheduling_overlapping_appointments_risk_factor_feature_value Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value Scheduling_back_to_back_appointments_risk_factor_feature_value SchedulingWeekends_risk_factor_feature_value
reward_recognition NA 0.3589347 0.0858675 0.3892608 0.5089025 0.5004012 0.2634295 0.9448660
Unscheduled_Time_risk_factor_feature_value 0.3589347 NA 0.4151659 0.2041098 0.9282273 0.0776459 0.2737519 0.1245786
Scheduling_overlapping_appointments_risk_factor_feature_value 0.0858675 0.4151659 NA 0.0000001 0.0545879 0.0000012 0.0000001 0.7598090
Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 0.3892608 0.2041098 0.0000001 NA 0.9142077 0.0204164 0.3088633 0.2837987
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 0.5089025 0.9282273 0.0545879 0.9142077 NA 0.9163422 0.6058230 0.0019556
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 0.5004012 0.0776459 0.0000012 0.0204164 0.9163422 NA 0.0000000 0.0000380
Scheduling_back_to_back_appointments_risk_factor_feature_value 0.2634295 0.2737519 0.0000001 0.3088633 0.6058230 0.0000000 NA 0.0000161
SchedulingWeekends_risk_factor_feature_value 0.9448660 0.1245786 0.7598090 0.2837987 0.0019556 0.0000380 0.0000161 NA
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Scheduling FEATURE Variables by Reward_recognition Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
reward_recognition_category…1 Unscheduled_Time_risk_factor_feature_value 2 1.390413e+01 6.952068e+00 1.2586097 0.2862775
Residuals …2 Unscheduled_Time_risk_factor_feature_value 201 1.110245e+03 5.523609e+00 NA NA
reward_recognition_category…3 Scheduling_overlapping_appointments_risk_factor_feature_value 2 1.823285e+03 9.116426e+02 1.7516685 0.1761220
Residuals …4 Scheduling_overlapping_appointments_risk_factor_feature_value 201 1.046089e+05 5.204424e+02 NA NA
reward_recognition_category…5 Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 2 3.387040e-02 1.693520e-02 1.3116302 0.2715173
Residuals …6 Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 216 2.788897e+00 1.291160e-02 NA NA
reward_recognition_category…7 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 2 3.537690e+01 1.768845e+01 0.1420547 0.8676548
Residuals …8 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 216 2.689601e+04 1.245186e+02 NA NA
reward_recognition_category…9 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 2 4.422015e+06 2.211008e+06 1.1561013 0.3166503
Residuals …10 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 216 4.130933e+08 1.912469e+06 NA NA
reward_recognition_category…11 Scheduling_back_to_back_appointments_risk_factor_feature_value 2 1.297829e+05 6.489146e+04 1.2542944 0.2875002
Residuals …12 Scheduling_back_to_back_appointments_risk_factor_feature_value 201 1.039882e+07 5.173543e+04 NA NA
reward_recognition_category…13 SchedulingWeekends_risk_factor_feature_value 2 3.479394e+04 1.739697e+04 1.9873667 0.1398800
Residuals …14 SchedulingWeekends_risk_factor_feature_value 191 1.671972e+06 8.753780e+03 NA NA

##Relationship between Reward_recognition and Workload Features

Encounter_Duration_risk_factor_feature_value

Clinical_Workload_RVU_risk_factor_feature_value

Clinical_Workload_Procedure_Type_risk_factor_feature_value

Clinical_Workload_Procedure_Count_risk_factor_feature_value”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value

“Nonpatient_contact_time_risk_factor_feature_value

“Clinical_Workload_Encounter_count_risk_factor_feature_value”

Correlation Matrix: Reward_recognition and Workload FEATURE Variables
reward_recognition Encounter_Duration_risk_factor_feature_value Clinical_Workload_RVU_risk_factor_feature_value Clinical_Workload_Procedure_Type_risk_factor_feature_value Clinical_Workload_Procedure_Count_risk_factor_feature_value Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value Clinical_Workload_Encounter_count_risk_factor_feature_value Nonpatient_contact_time_risk_factor_feature_value
reward_recognition 1.0000000 0.1047715 0.0427859 0.1805130 0.0090574 -0.0205737 0.0689209 0.0335798 -0.0876831
Encounter_Duration_risk_factor_feature_value 0.1047715 1.0000000 -0.0907257 -0.0018126 -0.1102129 -0.0564773 0.2571414 -0.0702778 -0.0337045
Clinical_Workload_RVU_risk_factor_feature_value 0.0427859 -0.0907257 1.0000000 0.6336461 0.8829654 0.5771087 0.0119758 0.5452412 0.5751453
Clinical_Workload_Procedure_Type_risk_factor_feature_value 0.1805130 -0.0018126 0.6336461 1.0000000 0.5157007 0.5627637 -0.0891127 0.5484507 0.4725423
Clinical_Workload_Procedure_Count_risk_factor_feature_value 0.0090574 -0.1102129 0.8829654 0.5157007 1.0000000 0.5039168 0.0939605 0.4616627 0.6085621
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value -0.0205737 -0.0564773 0.5771087 0.5627637 0.5039168 1.0000000 0.1190617 0.8678634 0.8993081
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 0.0689209 0.2571414 0.0119758 -0.0891127 0.0939605 0.1190617 1.0000000 0.0685954 0.0983374
Clinical_Workload_Encounter_count_risk_factor_feature_value 0.0335798 -0.0702778 0.5452412 0.5484507 0.4616627 0.8678634 0.0685954 1.0000000 0.8541545
Nonpatient_contact_time_risk_factor_feature_value -0.0876831 -0.0337045 0.5751453 0.4725423 0.6085621 0.8993081 0.0983374 0.8541545 1.0000000
P-values for the Correlations
reward_recognition Encounter_Duration_risk_factor_feature_value Clinical_Workload_RVU_risk_factor_feature_value Clinical_Workload_Procedure_Type_risk_factor_feature_value Clinical_Workload_Procedure_Count_risk_factor_feature_value Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value Clinical_Workload_Encounter_count_risk_factor_feature_value Nonpatient_contact_time_risk_factor_feature_value
reward_recognition NA 0.1428620 0.5297533 0.0075422 0.8942215 0.7620788 0.3309588 0.6219498 0.2123706
Encounter_Duration_risk_factor_feature_value 0.1428620 NA 0.2048307 0.9798325 0.1231299 0.4305324 0.0002646 0.3264284 0.6382202
Clinical_Workload_RVU_risk_factor_feature_value 0.5297533 0.2048307 NA 0.0000000 0.0000000 0.0000000 0.8663408 0.0000000 0.0000000
Clinical_Workload_Procedure_Type_risk_factor_feature_value 0.0075422 0.9798325 0.0000000 NA 0.0000000 0.0000000 0.2095358 0.0000000 0.0000000
Clinical_Workload_Procedure_Count_risk_factor_feature_value 0.8942215 0.1231299 0.0000000 0.0000000 NA 0.0000000 0.1857015 0.0000000 0.0000000
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 0.7620788 0.4305324 0.0000000 0.0000000 0.0000000 NA 0.0922867 0.0000000 0.0000000
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 0.3309588 0.0002646 0.8663408 0.2095358 0.1857015 0.0922867 NA 0.3332526 0.1648795
Clinical_Workload_Encounter_count_risk_factor_feature_value 0.6219498 0.3264284 0.0000000 0.0000000 0.0000000 0.0000000 0.3332526 NA 0.0000000
Nonpatient_contact_time_risk_factor_feature_value 0.2123706 0.6382202 0.0000000 0.0000000 0.0000000 0.0000000 0.1648795 0.0000000 NA
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Workload FEATURE Variables by Reward_recognition Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
reward_recognition_category…1 Encounter_Duration_risk_factor_feature_value 2 3.595099e+03 1.797550e+03 1.5909865 0.2063710
Residuals …2 Encounter_Duration_risk_factor_feature_value 194 2.191877e+05 1.129833e+03 NA NA
reward_recognition_category…3 Clinical_Workload_RVU_risk_factor_feature_value 2 5.691560e+04 2.845780e+04 0.4613879 0.6310308
Residuals …4 Clinical_Workload_RVU_risk_factor_feature_value 215 1.326092e+07 6.167869e+04 NA NA
reward_recognition_category…5 Clinical_Workload_Procedure_Type_risk_factor_feature_value 2 4.018384e+03 2.009192e+03 2.1150545 0.1231297
Residuals …6 Clinical_Workload_Procedure_Type_risk_factor_feature_value 215 2.042389e+05 9.499482e+02 NA NA
reward_recognition_category…7 Clinical_Workload_Procedure_Count_risk_factor_feature_value 2 4.629158e+05 2.314579e+05 0.9203680 0.3999361
Residuals …8 Clinical_Workload_Procedure_Count_risk_factor_feature_value 215 5.406908e+07 2.514841e+05 NA NA
reward_recognition_category…9 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 2 3.237910e+05 1.618955e+05 0.4094358 0.6645390
Residuals …10 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 216 8.540881e+07 3.954111e+05 NA NA
reward_recognition_category…11 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 2 8.967971e+00 4.483986e+00 1.4855645 0.2288866
Residuals …12 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 198 5.976376e+02 3.018372e+00 NA NA
reward_recognition_category…13 Clinical_Workload_Encounter_count_risk_factor_feature_value 2 5.290796e+06 2.645398e+06 0.9833590 0.3757285
Residuals …14 Clinical_Workload_Encounter_count_risk_factor_feature_value 215 5.783855e+08 2.690165e+06 NA NA
reward_recognition_category…15 Nonpatient_contact_time_risk_factor_feature_value 2 1.307559e+05 6.537795e+04 1.0561741 0.3497059
Residuals …16 Nonpatient_contact_time_risk_factor_feature_value 201 1.244205e+07 6.190074e+04 NA NA

##Relationship between Reward_recognition and Ehr Features

EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_patient_history_risk_factor_feature_value”,

“EHR_usage_time_spent_on_patient_education_risk_factor_feature_value”,

“EHR_usage_time_spent_on_orders_risk_factor_feature_value”,

“EHR_usage_time_spent_on_notes_risk_factor_feature_value”,

“EHR_usage_time_spent_on_messaging_risk_factor_feature_value”,

“EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_charging_risk_factor_feature_value”,

“EHR_usage_time_spent_on_assessment_risk_factor_feature_value”,

“EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value”,

“EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value”,

“EHR_uncategorized_time_risk_factor_feature_value” )

Correlation Matrix: Reward_recognition and Ehr FEATURE Variables
reward_recognition EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_patient_history_risk_factor_feature_value EHR_usage_time_spent_on_patient_education_risk_factor_feature_value EHR_usage_time_spent_on_orders_risk_factor_feature_value EHR_usage_time_spent_on_notes_risk_factor_feature_value EHR_usage_time_spent_on_messaging_risk_factor_feature_value EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_charging_risk_factor_feature_value EHR_usage_time_spent_on_assessment_risk_factor_feature_value EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value EHR_uncategorized_time_risk_factor_feature_value
reward_recognition 1.0000000 -0.0653342 -0.0110933 -0.0193776 0.1086591 0.0197108 0.0582956 -0.0097731 0.0066412 -0.0818506 0.0228974 0.0521851 -0.0474169 -0.0170064
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value -0.0653342 1.0000000 0.2955489 0.3723345 0.1599872 0.0268260 0.4117812 0.1801960 0.7616065 0.1771519 0.0978425 0.4026231 0.3718345 -0.0161345
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value -0.0110933 0.2955489 1.0000000 0.3205523 0.2230759 -0.0521011 0.2451910 0.1672860 0.4518141 -0.0490269 -0.0200799 0.2844927 0.4313724 -0.0109216
EHR_usage_time_spent_on_patient_history_risk_factor_feature_value -0.0193776 0.3723345 0.3205523 1.0000000 0.1266236 -0.0325975 0.3838695 0.2204826 0.3932471 0.0576596 -0.0362776 0.1970041 0.3480255 -0.0108374
EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 0.1086591 0.1599872 0.2230759 0.1266236 1.0000000 0.0032137 0.0847692 0.2714108 0.6727675 -0.0385705 0.0382361 0.0851150 0.2363722 -0.0061608
EHR_usage_time_spent_on_orders_risk_factor_feature_value 0.0197108 0.0268260 -0.0521011 -0.0325975 0.0032137 1.0000000 -0.0238416 -0.0177976 0.0730937 0.0699412 -0.0130243 -0.0614662 -0.0122152 0.5652791
EHR_usage_time_spent_on_notes_risk_factor_feature_value 0.0582956 0.4117812 0.2451910 0.3838695 0.0847692 -0.0238416 1.0000000 0.1751917 0.5249399 -0.0835920 -0.0131401 0.8298625 0.4328561 -0.0438828
EHR_usage_time_spent_on_messaging_risk_factor_feature_value -0.0097731 0.1801960 0.1672860 0.2204826 0.2714108 -0.0177976 0.1751917 1.0000000 0.3370017 -0.0247184 0.1690793 0.1167211 0.2077730 -0.0278838
EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 0.0066412 0.7616065 0.4518141 0.3932471 0.6727675 0.0730937 0.5249399 0.3370017 1.0000000 0.1512172 0.1143254 0.5293828 0.5519003 0.0248733
EHR_usage_time_spent_on_charging_risk_factor_feature_value -0.0818506 0.1771519 -0.0490269 0.0576596 -0.0385705 0.0699412 -0.0835920 -0.0247184 0.1512172 1.0000000 -0.0095429 -0.0738147 -0.0599366 0.0132267
EHR_usage_time_spent_on_assessment_risk_factor_feature_value 0.0228974 0.0978425 -0.0200799 -0.0362776 0.0382361 -0.0130243 -0.0131401 0.1690793 0.1143254 -0.0095429 1.0000000 0.0029973 0.1155403 -0.0120041
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 0.0521851 0.4026231 0.2844927 0.1970041 0.0851150 -0.0614662 0.8298625 0.1167211 0.5293828 -0.0738147 0.0029973 1.0000000 0.5063808 -0.0383480
EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value -0.0474169 0.3718345 0.4313724 0.3480255 0.2363722 -0.0122152 0.4328561 0.2077730 0.5519003 -0.0599366 0.1155403 0.5063808 1.0000000 0.0427446
EHR_uncategorized_time_risk_factor_feature_value -0.0170064 -0.0161345 -0.0109216 -0.0108374 -0.0061608 0.5652791 -0.0438828 -0.0278838 0.0248733 0.0132267 -0.0120041 -0.0383480 0.0427446 1.0000000
P-values for the Correlations
reward_recognition EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_patient_history_risk_factor_feature_value EHR_usage_time_spent_on_patient_education_risk_factor_feature_value EHR_usage_time_spent_on_orders_risk_factor_feature_value EHR_usage_time_spent_on_notes_risk_factor_feature_value EHR_usage_time_spent_on_messaging_risk_factor_feature_value EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_charging_risk_factor_feature_value EHR_usage_time_spent_on_assessment_risk_factor_feature_value EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value EHR_uncategorized_time_risk_factor_feature_value
reward_recognition NA 0.3303532 0.8688604 0.7730236 0.1048103 0.7692300 0.3852046 0.8843511 0.9212638 0.2223805 0.7332364 0.4370438 0.4801269 0.8001734
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 0.3303532 NA 0.0000068 0.0000000 0.0165512 0.6896572 0.0000000 0.0068509 0.0000000 0.0078702 0.1443769 0.0000000 0.0000000 0.8102191
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 0.8688604 0.0000068 NA 0.0000010 0.0007724 0.4377832 0.0002107 0.0121625 0.0000000 0.4653278 0.7650336 0.0000153 0.0000000 0.8708724
EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 0.7730236 0.0000000 0.0000010 NA 0.0584711 0.6274817 0.0000000 0.0008925 0.0000000 0.3904194 0.5891330 0.0030658 0.0000001 0.8718599
EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 0.1048103 0.0165512 0.0007724 0.0584711 NA 0.9618519 0.2062704 0.0000384 0.0000000 0.5657960 0.5691713 0.2044191 0.0003589 0.9269435
EHR_usage_time_spent_on_orders_risk_factor_feature_value 0.7692300 0.6896572 0.4377832 0.6274817 0.9618519 NA 0.7226779 0.7910855 0.2760202 0.2973172 0.8462953 0.3598444 0.8557360 0.0000000
EHR_usage_time_spent_on_notes_risk_factor_feature_value 0.3852046 0.0000000 0.0002107 0.0000000 0.2062704 0.7226779 NA 0.0085961 0.0000000 0.2126639 0.8449462 0.0000000 0.0000000 0.5134872
EHR_usage_time_spent_on_messaging_risk_factor_feature_value 0.8843511 0.0068509 0.0121625 0.0008925 0.0000384 0.7910855 0.0085961 NA 0.0000002 0.7129193 0.0112555 0.0813143 0.0017693 0.6780888
EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 0.9212638 0.0000000 0.0000000 0.0000000 0.0000000 0.2760202 0.0000000 0.0000002 NA 0.0235998 0.0878044 0.0000000 0.0000000 0.7112003
EHR_usage_time_spent_on_charging_risk_factor_feature_value 0.2223805 0.0078702 0.4653278 0.3904194 0.5657960 0.2973172 0.2126639 0.7129193 0.0235998 NA 0.8870565 0.2712985 0.3719469 0.8439370
EHR_usage_time_spent_on_assessment_risk_factor_feature_value 0.7332364 0.1443769 0.7650336 0.5891330 0.5691713 0.8462953 0.8449462 0.0112555 0.0878044 0.8870565 NA 0.9644198 0.0844630 0.8582029
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 0.4370438 0.0000000 0.0000153 0.0030658 0.2044191 0.3598444 0.0000000 0.0813143 0.0000000 0.2712985 0.9644198 NA 0.0000000 0.5680403
EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 0.4801269 0.0000000 0.0000000 0.0000001 0.0003589 0.8557360 0.0000000 0.0017693 0.0000000 0.3719469 0.0844630 0.0000000 NA 0.5244805
EHR_uncategorized_time_risk_factor_feature_value 0.8001734 0.8102191 0.8708724 0.8718599 0.9269435 0.0000000 0.5134872 0.6780888 0.7112003 0.8439370 0.8582029 0.5680403 0.5244805 NA
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Ehr FEATURE Variables by Reward_recognition Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
reward_recognition_category…1 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 2 9.391162e+01 46.9558091 0.6849486 0.5051830
Residuals …2 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 221 1.515038e+04 68.5537711 NA NA
reward_recognition_category…3 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 2 1.300357e+02 65.0178642 1.8105191 0.1659869
Residuals …4 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 221 7.936369e+03 35.9111731 NA NA
reward_recognition_category…5 EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 2 1.485953e+00 0.7429767 0.0460098 0.9550417
Residuals …6 EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 221 3.568758e+03 16.1482272 NA NA
reward_recognition_category…7 EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 2 1.145830e+04 5729.1518464 5.4242411 0.0050151
Residuals …8 EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 221 2.334230e+05 1056.2126122 NA NA
reward_recognition_category…9 EHR_usage_time_spent_on_orders_risk_factor_feature_value 2 2.900716e+00 1.4503582 0.9506215 0.3880754
Residuals …10 EHR_usage_time_spent_on_orders_risk_factor_feature_value 221 3.371785e+02 1.5256948 NA NA
reward_recognition_category…11 EHR_usage_time_spent_on_notes_risk_factor_feature_value 2 3.971947e+00 1.9859733 0.8061995 0.4478608
Residuals …12 EHR_usage_time_spent_on_notes_risk_factor_feature_value 221 5.444063e+02 2.4633769 NA NA
reward_recognition_category…13 EHR_usage_time_spent_on_messaging_risk_factor_feature_value 2 1.228500e-03 0.0006142 0.2471038 0.7812751
Residuals …14 EHR_usage_time_spent_on_messaging_risk_factor_feature_value 221 5.493405e-01 0.0024857 NA NA
reward_recognition_category…15 EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 2 1.208333e+03 604.1663245 1.6520100 0.1940222
Residuals …16 EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 221 8.082321e+04 365.7159006 NA NA
reward_recognition_category…17 EHR_usage_time_spent_on_charging_risk_factor_feature_value 2 3.592127e+01 17.9606354 0.6139736 0.5421166
Residuals …18 EHR_usage_time_spent_on_charging_risk_factor_feature_value 221 6.464937e+03 29.2531071 NA NA
reward_recognition_category…19 EHR_usage_time_spent_on_assessment_risk_factor_feature_value 2 5.286448e+00 2.6432238 0.3425225 0.7103534
Residuals …20 EHR_usage_time_spent_on_assessment_risk_factor_feature_value 221 1.705443e+03 7.7169358 NA NA
reward_recognition_category…21 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 2 8.348908e+00 4.1744541 1.0309662 0.3583710
Residuals …22 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 221 8.948445e+02 4.0490700 NA NA
reward_recognition_category…23 EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 2 4.487322e-01 0.2243661 0.1746407 0.8398745
Residuals …24 EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 221 2.839253e+02 1.2847298 NA NA
reward_recognition_category…25 EHR_uncategorized_time_risk_factor_feature_value 2 9.926000e-04 0.0004963 0.5210161 0.5946444
Residuals …26 EHR_uncategorized_time_risk_factor_feature_value 221 2.105209e-01 0.0009526 NA NA