Retention Descriptives

Data were aggregated by Department (final N=269 departments)

Descriptive Statistics for Retention
vars n mean sd median trimmed mad min max range skew kurtosis se
X1 1 269 1.925756 0.7257524 2 1.856506 0.6762737 1 5 4 1.27078 3.336764 0.0442499

Descriptive Statistics for Retention by Category
retention_category Count Mean SD
Favorable 237 1.733594 0.4761997
Neutral 27 3.080247 0.1752310
Unfavorable 5 4.800000 0.4472136
Descriptive Statistics for Retention by Percentile
retention_percentile Count Mean SD
Top 20% 53 1.019542 0.0691838
Middle 60% 156 1.847632 0.2471903
Bottom 20% 60 2.929368 0.6705538

Retention and Quit Probability

Correlation between Retention and Quit Probability
Correlation
0.0293125 
## `geom_smooth()` using formula = 'y ~ x'

ANOVA Results for Quit Probability by Retention Category
Df Sum Sq Mean Sq F value Pr(>F)
retention_category 2 0.0000069 3.5e-06 0.0991689 0.9056293
Residuals 225 0.0078642 3.5e-05 NA NA
Tukey’s HSD Post-hoc Results for Retention Category
Comparison Estimate Std_Error z_value p_value
Neutral - Favorable Neutral - Favorable -0.0005787 0.0013017 -0.4445546 0.8909007
Unfavorable - Favorable Unfavorable - Favorable 0.0000115 0.0026768 0.0042960 0.9999892
Unfavorable - Neutral Unfavorable - Neutral 0.0005902 0.0029172 0.2023085 0.9763170

ANOVA Results for Quit Probability by Retention Percentile
Df Sum Sq Mean Sq F value Pr(>F)
retention_percentile 2 0.0001231 6.15e-05 1.786857 0.1698542
Residuals 225 0.0077481 3.44e-05 NA NA
Tukey’s HSD Post-hoc Results for Retention Percentile
Comparison Estimate Std_Error z_value p_value
Middle 60% - Top 20% Middle 60% - Top 20% 0.0015771 0.0010492 1.5031292 0.2879790
Bottom 20% - Top 20% Bottom 20% - Top 20% 0.0001619 0.0012108 0.1337125 0.9900674
Bottom 20% - Middle 60% Bottom 20% - Middle 60% -0.0014152 0.0009418 -1.5026086 0.2882289

##Relationship between Retention and Scheduling Shaps

Correlation Matrix: Retention and Scheduling SHAP Variables
retention Unscheduled_Time_risk_factor_shap Scheduling_overlapping_appointments_risk_factor_shap Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap Scheduling_back_to_back_appointments_risk_factor_shap SchedulingWeekends_risk_factor_shap
retention 1.0000000 -0.0224234 0.1768914 -0.0007738 -0.0519711 -0.0425199 0.1177345 0.0253064
Unscheduled_Time_risk_factor_shap -0.0224234 1.0000000 0.1074331 0.1203767 0.0780532 0.0613317 0.0960513 -0.0179730
Scheduling_overlapping_appointments_risk_factor_shap 0.1768914 0.1074331 1.0000000 -0.1655393 -0.1191948 -0.4153116 0.2109286 0.0743987
Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap -0.0007738 0.1203767 -0.1655393 1.0000000 0.1472663 0.6380386 -0.0603795 0.1498284
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap -0.0519711 0.0780532 -0.1191948 0.1472663 1.0000000 0.2968274 0.1307884 -0.0434544
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap -0.0425199 0.0613317 -0.4153116 0.6380386 0.2968274 1.0000000 -0.1558050 0.0968575
Scheduling_back_to_back_appointments_risk_factor_shap 0.1177345 0.0960513 0.2109286 -0.0603795 0.1307884 -0.1558050 1.0000000 -0.0204519
SchedulingWeekends_risk_factor_shap 0.0253064 -0.0179730 0.0743987 0.1498284 -0.0434544 0.0968575 -0.0204519 1.0000000
P-values for the Correlations
retention Unscheduled_Time_risk_factor_shap Scheduling_overlapping_appointments_risk_factor_shap Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap Scheduling_back_to_back_appointments_risk_factor_shap SchedulingWeekends_risk_factor_shap
retention NA 0.7502259 0.0113744 0.9909162 0.4441419 0.5313677 0.0935248 0.7261465
Unscheduled_Time_risk_factor_shap 0.7502259 NA 0.1261524 0.0863451 0.2671430 0.3835198 0.1717447 0.8086599
Scheduling_overlapping_appointments_risk_factor_shap 0.0113744 0.1261524 NA 0.0179720 0.0895004 0.0000000 0.0024594 0.3155196
Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 0.9909162 0.0863451 0.0179720 NA 0.0293493 0.0000000 0.3909610 0.0370542
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 0.4441419 0.2671430 0.0895004 0.0293493 NA 0.0000079 0.0622417 0.5474255
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 0.5313677 0.3835198 0.0000000 0.0000000 0.0000079 NA 0.0260629 0.1791063
Scheduling_back_to_back_appointments_risk_factor_shap 0.0935248 0.1717447 0.0024594 0.3909610 0.0622417 0.0260629 NA 0.7828853
SchedulingWeekends_risk_factor_shap 0.7261465 0.8086599 0.3155196 0.0370542 0.5474255 0.1791063 0.7828853 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Scheduling SHAP Variables by Retention Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
retention_category…1 Unscheduled_Time_risk_factor_shap 2 0.0081816 0.0040908 1.3634955 0.2581205
Residuals …2 Unscheduled_Time_risk_factor_shap 201 0.6030466 0.0030002 NA NA
retention_category…3 Scheduling_overlapping_appointments_risk_factor_shap 2 0.0347218 0.0173609 1.5395357 0.2169989
Residuals …4 Scheduling_overlapping_appointments_risk_factor_shap 201 2.2666191 0.0112767 NA NA
retention_category…5 Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 2 0.0058951 0.0029475 0.5339177 0.5870753
Residuals …6 Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 216 1.1924499 0.0055206 NA NA
retention_category…7 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 2 0.0001293 0.0000646 0.9751249 0.3787992
Residuals …8 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 216 0.0143155 0.0000663 NA NA
retention_category…9 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 2 0.0068857 0.0034428 0.7698999 0.4643258
Residuals …10 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 216 0.9659094 0.0044718 NA NA
retention_category…11 Scheduling_back_to_back_appointments_risk_factor_shap 2 0.0014624 0.0007312 1.2533703 0.2877627
Residuals …12 Scheduling_back_to_back_appointments_risk_factor_shap 201 0.1172599 0.0005834 NA NA
retention_category…13 SchedulingWeekends_risk_factor_shap 2 0.0405548 0.0202774 1.9999207 0.1381704
Residuals …14 SchedulingWeekends_risk_factor_shap 191 1.9365673 0.0101391 NA NA

##Relationship between Retention and Workload Shaps

Encounter_Duration_risk_factor_shap

Clinical_Workload_RVU_risk_factor_shap

Clinical_Workload_Procedure_Type_risk_factor_shap

Clinical_Workload_Procedure_Count_risk_factor_shap”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap

“Nonpatient_contact_time_risk_factor_shap

##Relationship between Retention and Workload Shaps

Encounter_Duration_risk_factor_shap

Clinical_Workload_RVU_risk_factor_shap

Clinical_Workload_Procedure_Type_risk_factor_shap

Clinical_Workload_Procedure_Count_risk_factor_shap”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap

“Nonpatient_contact_time_risk_factor_shap

“Clinical_Workload_Encounter_count_risk_factor_shap”

Correlation Matrix: Retention and Workload SHAP Variables
retention Encounter_Duration_risk_factor_shap Clinical_Workload_RVU_risk_factor_shap Clinical_Workload_Procedure_Type_risk_factor_shap Clinical_Workload_Procedure_Count_risk_factor_shap Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap Clinical_Workload_Encounter_count_risk_factor_shap Nonpatient_contact_time_risk_factor_shap
retention 1.0000000 -0.0038812 0.1622470 0.0220483 0.1783454 -0.0802138 0.0228266 -0.1399786 0.2054387
Encounter_Duration_risk_factor_shap -0.0038812 1.0000000 -0.2262257 -0.0446032 -0.2084849 0.1380264 0.1550642 0.2730183 -0.2203552
Clinical_Workload_RVU_risk_factor_shap 0.1622470 -0.2262257 1.0000000 0.0800352 0.5795920 0.0809919 0.0589783 -0.2399206 0.3581040
Clinical_Workload_Procedure_Type_risk_factor_shap 0.0220483 -0.0446032 0.0800352 1.0000000 0.0416841 0.2444559 0.0595537 0.1101940 -0.1025363
Clinical_Workload_Procedure_Count_risk_factor_shap 0.1783454 -0.2084849 0.5795920 0.0416841 1.0000000 0.1053561 0.0178292 -0.2028889 0.2165978
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap -0.0802138 0.1380264 0.0809919 0.2444559 0.1053561 1.0000000 -0.0176133 0.3770314 -0.2855978
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 0.0228266 0.1550642 0.0589783 0.0595537 0.0178292 -0.0176133 1.0000000 0.0402679 0.1507316
Clinical_Workload_Encounter_count_risk_factor_shap -0.1399786 0.2730183 -0.2399206 0.1101940 -0.2028889 0.3770314 0.0402679 1.0000000 -0.4980576
Nonpatient_contact_time_risk_factor_shap 0.2054387 -0.2203552 0.3581040 -0.1025363 0.2165978 -0.2855978 0.1507316 -0.4980576 1.0000000
P-values for the Correlations
retention Encounter_Duration_risk_factor_shap Clinical_Workload_RVU_risk_factor_shap Clinical_Workload_Procedure_Type_risk_factor_shap Clinical_Workload_Procedure_Count_risk_factor_shap Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap Clinical_Workload_Encounter_count_risk_factor_shap Nonpatient_contact_time_risk_factor_shap
retention NA 0.9568327 0.0164991 0.7461596 0.0083079 0.2371390 0.7477209 0.0389178 0.0032012
Encounter_Duration_risk_factor_shap 0.9568327 NA 0.0013907 0.5337042 0.0032823 0.0530845 0.0295734 0.0001038 0.0018615
Clinical_Workload_RVU_risk_factor_shap 0.0164991 0.0013907 NA 0.2392750 0.0000000 0.2336874 0.4067796 0.0003624 0.0000002
Clinical_Workload_Procedure_Type_risk_factor_shap 0.7461596 0.5337042 0.2392750 NA 0.5404144 0.0002684 0.4022096 0.1054866 0.1454655
Clinical_Workload_Procedure_Count_risk_factor_shap 0.0083079 0.0032823 0.0000000 0.5404144 NA 0.1209160 0.8021371 0.0026753 0.0019098
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 0.2371390 0.0530845 0.2336874 0.0002684 0.1209160 NA 0.8040003 0.0000000 0.0000346
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 0.7477209 0.0295734 0.4067796 0.4022096 0.8021371 0.8040003 NA 0.5703301 0.0326892
Clinical_Workload_Encounter_count_risk_factor_shap 0.0389178 0.0001038 0.0003624 0.1054866 0.0026753 0.0000000 0.5703301 NA 0.0000000
Nonpatient_contact_time_risk_factor_shap 0.0032012 0.0018615 0.0000002 0.1454655 0.0019098 0.0000346 0.0326892 0.0000000 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Workload SHAP Variables by Retention Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
retention_category…1 Encounter_Duration_risk_factor_shap 2 0.0019011 0.0009505 0.1018751 0.9031906
Residuals …2 Encounter_Duration_risk_factor_shap 194 1.8101242 0.0093305 NA NA
retention_category…3 Clinical_Workload_RVU_risk_factor_shap 2 0.0443867 0.0221934 2.0927396 0.1258543
Residuals …4 Clinical_Workload_RVU_risk_factor_shap 215 2.2800594 0.0106049 NA NA
retention_category…5 Clinical_Workload_Procedure_Type_risk_factor_shap 2 0.0019149 0.0009574 0.2443798 0.7834074
Residuals …6 Clinical_Workload_Procedure_Type_risk_factor_shap 215 0.8423420 0.0039179 NA NA
retention_category…7 Clinical_Workload_Procedure_Count_risk_factor_shap 2 0.0139179 0.0069590 2.3359279 0.0991709
Residuals …8 Clinical_Workload_Procedure_Count_risk_factor_shap 215 0.6405062 0.0029791 NA NA
retention_category…9 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 2 0.0025470 0.0012735 1.3345792 0.2654309
Residuals …10 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 216 0.2061126 0.0009542 NA NA
retention_category…11 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 2 0.0003751 0.0001876 0.0693934 0.9329822
Residuals …12 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 198 0.5351649 0.0027029 NA NA
retention_category…13 Clinical_Workload_Encounter_count_risk_factor_shap 2 0.0349851 0.0174925 2.1433296 0.1197627
Residuals …14 Clinical_Workload_Encounter_count_risk_factor_shap 215 1.7546985 0.0081614 NA NA
retention_category…15 Nonpatient_contact_time_risk_factor_shap 2 0.1137552 0.0568776 3.2716416 0.0399743
Residuals …16 Nonpatient_contact_time_risk_factor_shap 201 3.4943912 0.0173850 NA NA

##Relationship between Retention and Ehr Shaps

EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_patient_history_risk_factor_shap”,

“EHR_usage_time_spent_on_patient_education_risk_factor_shap”,

“EHR_usage_time_spent_on_orders_risk_factor_shap”,

“EHR_usage_time_spent_on_notes_risk_factor_shap”,

“EHR_usage_time_spent_on_messaging_risk_factor_shap”,

“EHR_usage_time_spent_on_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_charging_risk_factor_shap”,

“EHR_usage_time_spent_on_assessment_risk_factor_shap”,

“EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap”,

“EHR_usage_time_spent_on_administrative_processes_risk_factor_shap”,

“EHR_uncategorized_time_risk_factor_shap” )

Correlation Matrix: Retention and Ehr SHAP Variables
retention EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_patient_history_risk_factor_shap EHR_usage_time_spent_on_patient_education_risk_factor_shap EHR_usage_time_spent_on_orders_risk_factor_shap EHR_usage_time_spent_on_notes_risk_factor_shap EHR_usage_time_spent_on_messaging_risk_factor_shap EHR_usage_time_spent_on_EHR_system_risk_factor_shap EHR_usage_time_spent_on_charging_risk_factor_shap EHR_usage_time_spent_on_assessment_risk_factor_shap EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap EHR_usage_time_spent_on_administrative_processes_risk_factor_shap EHR_uncategorized_time_risk_factor_shap
retention 1.0000000 0.0315062 0.0376626 -0.0027964 0.1163559 -0.1384246 -0.0150645 -0.0294526 0.0335305 0.0254214 0.0184788 0.0646113 0.0485570 0.0183177
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 0.0315062 1.0000000 0.4625391 0.3935647 0.3936631 0.0127669 0.4791951 0.0681449 0.7803844 0.2866464 0.3693576 -0.4094449 0.6996216 0.0985913
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 0.0376626 0.4625391 1.0000000 0.5524408 0.2875210 0.0456950 0.3675777 -0.0364662 0.5467299 0.2346365 0.3206382 -0.3139356 0.6583274 0.1774795
EHR_usage_time_spent_on_patient_history_risk_factor_shap -0.0027964 0.3935647 0.5524408 1.0000000 0.1080566 0.0133008 0.2421737 -0.0005768 0.4133753 0.1490189 0.3183151 -0.2257065 0.4830547 0.1880824
EHR_usage_time_spent_on_patient_education_risk_factor_shap 0.1163559 0.3936631 0.2875210 0.1080566 1.0000000 0.1352755 0.3408316 -0.1021671 0.4900959 0.1682598 0.2923523 -0.3348235 0.4988600 0.0186822
EHR_usage_time_spent_on_orders_risk_factor_shap -0.1384246 0.0127669 0.0456950 0.0133008 0.1352755 1.0000000 -0.0263452 -0.0695341 0.1039823 -0.0442113 0.0135692 -0.0741403 0.0139322 0.0810434
EHR_usage_time_spent_on_notes_risk_factor_shap -0.0150645 0.4791951 0.3675777 0.2421737 0.3408316 -0.0263452 1.0000000 0.0642468 0.5635219 0.2766452 0.2532913 -0.4678691 0.5000973 0.0184974
EHR_usage_time_spent_on_messaging_risk_factor_shap -0.0294526 0.0681449 -0.0364662 -0.0005768 -0.1021671 -0.0695341 0.0642468 1.0000000 0.0506593 0.1245726 0.0011789 -0.1052265 -0.0782965 0.0039928
EHR_usage_time_spent_on_EHR_system_risk_factor_shap 0.0335305 0.7803844 0.5467299 0.4133753 0.4900959 0.1039823 0.5635219 0.0506593 1.0000000 0.3715501 0.3687570 -0.4470924 0.7563752 0.0920523
EHR_usage_time_spent_on_charging_risk_factor_shap 0.0254214 0.2866464 0.2346365 0.1490189 0.1682598 -0.0442113 0.2766452 0.1245726 0.3715501 1.0000000 0.0502955 -0.1996492 0.2853860 0.0517544
EHR_usage_time_spent_on_assessment_risk_factor_shap 0.0184788 0.3693576 0.3206382 0.3183151 0.2923523 0.0135692 0.2532913 0.0011789 0.3687570 0.0502955 1.0000000 -0.2501693 0.4996607 0.0693299
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 0.0646113 -0.4094449 -0.3139356 -0.2257065 -0.3348235 -0.0741403 -0.4678691 -0.1052265 -0.4470924 -0.1996492 -0.2501693 1.0000000 -0.5065934 -0.0807939
EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 0.0485570 0.6996216 0.6583274 0.4830547 0.4988600 0.0139322 0.5000973 -0.0782965 0.7563752 0.2853860 0.4996607 -0.5065934 1.0000000 0.1356093
EHR_uncategorized_time_risk_factor_shap 0.0183177 0.0985913 0.1774795 0.1880824 0.0186822 0.0810434 0.0184974 0.0039928 0.0920523 0.0517544 0.0693299 -0.0807939 0.1356093 1.0000000
P-values for the Correlations
retention EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_patient_history_risk_factor_shap EHR_usage_time_spent_on_patient_education_risk_factor_shap EHR_usage_time_spent_on_orders_risk_factor_shap EHR_usage_time_spent_on_notes_risk_factor_shap EHR_usage_time_spent_on_messaging_risk_factor_shap EHR_usage_time_spent_on_EHR_system_risk_factor_shap EHR_usage_time_spent_on_charging_risk_factor_shap EHR_usage_time_spent_on_assessment_risk_factor_shap EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap EHR_usage_time_spent_on_administrative_processes_risk_factor_shap EHR_uncategorized_time_risk_factor_shap
retention NA 0.6390552 0.5749830 0.9668025 0.0822779 0.0384397 0.8225889 0.6610710 0.6176588 0.7051301 0.7832841 0.3357438 0.4696214 0.7851270
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 0.6390552 NA 0.0000000 0.0000000 0.0000000 0.8492967 0.0000000 0.3099278 0.0000000 0.0000131 0.0000000 0.0000000 0.0000000 0.1413156
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 0.5749830 0.0000000 NA 0.0000000 0.0000123 0.4962322 0.0000000 0.5871960 0.0000000 0.0003976 0.0000009 0.0000016 0.0000000 0.0077544
EHR_usage_time_spent_on_patient_history_risk_factor_shap 0.9668025 0.0000000 0.0000000 NA 0.1067615 0.8430736 0.0002533 0.9931510 0.0000000 0.0257275 0.0000011 0.0006660 0.0000000 0.0047360
EHR_usage_time_spent_on_patient_education_risk_factor_shap 0.0822779 0.0000000 0.0000123 0.1067615 NA 0.0431147 0.0000002 0.1273754 0.0000000 0.0116623 0.0000086 0.0000003 0.0000000 0.7809591
EHR_usage_time_spent_on_orders_risk_factor_shap 0.0384397 0.8492967 0.4962322 0.8430736 0.0431147 NA 0.6949397 0.3001447 0.1207180 0.5103358 0.8399496 0.2691841 0.8357271 0.2269898
EHR_usage_time_spent_on_notes_risk_factor_shap 0.8225889 0.0000000 0.0000000 0.0002533 0.0000002 0.6949397 NA 0.3384825 0.0000000 0.0000267 0.0001269 0.0000000 0.0000000 0.7830711
EHR_usage_time_spent_on_messaging_risk_factor_shap 0.6610710 0.3099278 0.5871960 0.9931510 0.1273754 0.3001447 0.3384825 NA 0.4505838 0.0627078 0.9860019 0.1163133 0.2431815 0.9526135
EHR_usage_time_spent_on_EHR_system_risk_factor_shap 0.6176588 0.0000000 0.0000000 0.0000000 0.0000000 0.1207180 0.0000000 0.4505838 NA 0.0000000 0.0000000 0.0000000 0.0000000 0.1697766
EHR_usage_time_spent_on_charging_risk_factor_shap 0.7051301 0.0000131 0.0003976 0.0257275 0.0116623 0.5103358 0.0000267 0.0627078 0.0000000 NA 0.4538472 0.0026853 0.0000144 0.4408424
EHR_usage_time_spent_on_assessment_risk_factor_shap 0.7832841 0.0000000 0.0000009 0.0000011 0.0000086 0.8399496 0.0001269 0.9860019 0.0000000 0.4538472 NA 0.0001546 0.0000000 0.3015694
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 0.3357438 0.0000000 0.0000016 0.0006660 0.0000003 0.2691841 0.0000000 0.1163133 0.0000000 0.0026853 0.0001546 NA 0.0000000 0.2284282
EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 0.4696214 0.0000000 0.0000000 0.0000000 0.0000000 0.8357271 0.0000000 0.2431815 0.0000000 0.0000144 0.0000000 0.0000000 NA 0.0425975
EHR_uncategorized_time_risk_factor_shap 0.7851270 0.1413156 0.0077544 0.0047360 0.7809591 0.2269898 0.7830711 0.9526135 0.1697766 0.4408424 0.3015694 0.2284282 0.0425975 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Ehr SHAP Variables by Retention Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
retention_category…1 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 2 0.0460355 0.0230178 1.8387643 0.1614382
Residuals …2 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 221 2.7664914 0.0125181 NA NA
retention_category…3 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 2 0.0178180 0.0089090 0.7214484 0.4871888
Residuals …4 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 221 2.7290790 0.0123488 NA NA
retention_category…5 EHR_usage_time_spent_on_patient_history_risk_factor_shap 2 0.0163233 0.0081616 0.9692064 0.3809906
Residuals …6 EHR_usage_time_spent_on_patient_history_risk_factor_shap 221 1.8610323 0.0084210 NA NA
retention_category…7 EHR_usage_time_spent_on_patient_education_risk_factor_shap 2 0.0204085 0.0102042 1.8341152 0.1621781
Residuals …8 EHR_usage_time_spent_on_patient_education_risk_factor_shap 221 1.2295499 0.0055636 NA NA
retention_category…9 EHR_usage_time_spent_on_orders_risk_factor_shap 2 0.1064044 0.0532022 8.6050017 0.0002519
Residuals …10 EHR_usage_time_spent_on_orders_risk_factor_shap 221 1.3663780 0.0061827 NA NA
retention_category…11 EHR_usage_time_spent_on_notes_risk_factor_shap 2 0.0019504 0.0009752 0.1333162 0.8752586
Residuals …12 EHR_usage_time_spent_on_notes_risk_factor_shap 221 1.6166030 0.0073149 NA NA
retention_category…13 EHR_usage_time_spent_on_messaging_risk_factor_shap 2 0.0028461 0.0014230 0.6322190 0.5323696
Residuals …14 EHR_usage_time_spent_on_messaging_risk_factor_shap 221 0.4974428 0.0022509 NA NA
retention_category…15 EHR_usage_time_spent_on_EHR_system_risk_factor_shap 2 0.0454549 0.0227275 0.6314425 0.5327808
Residuals …16 EHR_usage_time_spent_on_EHR_system_risk_factor_shap 221 7.9544348 0.0359929 NA NA
retention_category…17 EHR_usage_time_spent_on_charging_risk_factor_shap 2 0.0246461 0.0123231 0.6577811 0.5190106
Residuals …18 EHR_usage_time_spent_on_charging_risk_factor_shap 221 4.1402821 0.0187343 NA NA
retention_category…19 EHR_usage_time_spent_on_assessment_risk_factor_shap 2 0.0004532 0.0002266 0.0926241 0.9115715
Residuals …20 EHR_usage_time_spent_on_assessment_risk_factor_shap 221 0.5406380 0.0024463 NA NA
retention_category…21 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 2 0.0525491 0.0262745 2.0811869 0.1272208
Residuals …22 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 221 2.7900778 0.0126248 NA NA
retention_category…23 EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 2 0.0179630 0.0089815 0.1596912 0.8525052
Residuals …24 EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 221 12.4297016 0.0562430 NA NA
retention_category…25 EHR_uncategorized_time_risk_factor_shap 2 0.0002126 0.0001063 2.5222594 0.0825869
Residuals …26 EHR_uncategorized_time_risk_factor_shap 221 0.0093149 0.0000421 NA NA

##Relationship between Retention and Scheduling Features

Correlation Matrix: Retention and Scheduling FEATURE Variables
retention Unscheduled_Time_risk_factor_feature_value Scheduling_overlapping_appointments_risk_factor_feature_value Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value Scheduling_back_to_back_appointments_risk_factor_feature_value SchedulingWeekends_risk_factor_feature_value
retention 1.0000000 0.0872795 -0.0509526 -0.1325091 0.0054001 -0.1110721 -0.2409618 0.0113815
Unscheduled_Time_risk_factor_feature_value 0.0872795 1.0000000 -0.0573554 -0.0892838 -0.0063455 0.1238255 0.0769870 -0.1136307
Scheduling_overlapping_appointments_risk_factor_feature_value -0.0509526 -0.0573554 1.0000000 -0.3596856 0.1347903 0.3324081 0.3666426 0.0226906
Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value -0.1325091 -0.0892838 -0.3596856 1.0000000 -0.0073217 0.1566051 0.0715954 -0.0773370
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 0.0054001 -0.0063455 0.1347903 -0.0073217 1.0000000 -0.0071389 0.0363418 0.2210164
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value -0.1110721 0.1238255 0.3324081 0.1566051 -0.0071389 1.0000000 0.8187556 -0.2911901
Scheduling_back_to_back_appointments_risk_factor_feature_value -0.2409618 0.0769870 0.3666426 0.0715954 0.0363418 0.8187556 1.0000000 -0.3121378
SchedulingWeekends_risk_factor_feature_value 0.0113815 -0.1136307 0.0226906 -0.0773370 0.2210164 -0.2911901 -0.3121378 1.0000000
P-values for the Correlations
retention Unscheduled_Time_risk_factor_feature_value Scheduling_overlapping_appointments_risk_factor_feature_value Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value Scheduling_back_to_back_appointments_risk_factor_feature_value SchedulingWeekends_risk_factor_feature_value
retention NA 0.2144910 0.4692212 0.0501857 0.9366683 0.1011327 0.0005170 0.8748455
Unscheduled_Time_risk_factor_feature_value 0.2144910 NA 0.4151659 0.2041098 0.9282273 0.0776459 0.2737519 0.1245786
Scheduling_overlapping_appointments_risk_factor_feature_value 0.4692212 0.4151659 NA 0.0000001 0.0545879 0.0000012 0.0000001 0.7598090
Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 0.0501857 0.2041098 0.0000001 NA 0.9142077 0.0204164 0.3088633 0.2837987
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 0.9366683 0.9282273 0.0545879 0.9142077 NA 0.9163422 0.6058230 0.0019556
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 0.1011327 0.0776459 0.0000012 0.0204164 0.9163422 NA 0.0000000 0.0000380
Scheduling_back_to_back_appointments_risk_factor_feature_value 0.0005170 0.2737519 0.0000001 0.3088633 0.6058230 0.0000000 NA 0.0000161
SchedulingWeekends_risk_factor_feature_value 0.8748455 0.1245786 0.7598090 0.2837987 0.0019556 0.0000380 0.0000161 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Scheduling FEATURE Variables by Retention Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
retention_category…1 Unscheduled_Time_risk_factor_feature_value 2 1.242108e+01 6.210542e+00 1.1228633 0.3273790
Residuals …2 Unscheduled_Time_risk_factor_feature_value 201 1.111728e+03 5.530987e+00 NA NA
retention_category…3 Scheduling_overlapping_appointments_risk_factor_feature_value 2 1.014745e+01 5.073727e+00 0.0095828 0.9904634
Residuals …4 Scheduling_overlapping_appointments_risk_factor_feature_value 201 1.064221e+05 5.294630e+02 NA NA
retention_category…5 Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 2 4.970600e-02 2.485300e-02 1.9358564 0.1467960
Residuals …6 Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 216 2.773062e+00 1.283820e-02 NA NA
retention_category…7 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 2 8.420520e+01 4.210260e+01 0.3387380 0.7130470
Residuals …8 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 216 2.684718e+04 1.242925e+02 NA NA
retention_category…9 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 2 7.618752e+06 3.809376e+06 2.0073973 0.1368364
Residuals …10 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 216 4.098966e+08 1.897669e+06 NA NA
retention_category…11 Scheduling_back_to_back_appointments_risk_factor_feature_value 2 6.394080e+05 3.197040e+05 6.4980507 0.0018425
Residuals …12 Scheduling_back_to_back_appointments_risk_factor_feature_value 201 9.889197e+06 4.919999e+04 NA NA
retention_category…13 SchedulingWeekends_risk_factor_feature_value 2 1.221719e+03 6.108595e+02 0.0684088 0.9339015
Residuals …14 SchedulingWeekends_risk_factor_feature_value 191 1.705544e+06 8.929551e+03 NA NA

##Relationship between Retention and Workload Features

Encounter_Duration_risk_factor_feature_value

Clinical_Workload_RVU_risk_factor_feature_value

Clinical_Workload_Procedure_Type_risk_factor_feature_value

Clinical_Workload_Procedure_Count_risk_factor_feature_value”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value

“Nonpatient_contact_time_risk_factor_feature_value

“Clinical_Workload_Encounter_count_risk_factor_feature_value”

Correlation Matrix: Retention and Workload FEATURE Variables
retention Encounter_Duration_risk_factor_feature_value Clinical_Workload_RVU_risk_factor_feature_value Clinical_Workload_Procedure_Type_risk_factor_feature_value Clinical_Workload_Procedure_Count_risk_factor_feature_value Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value Clinical_Workload_Encounter_count_risk_factor_feature_value Nonpatient_contact_time_risk_factor_feature_value
retention 1.0000000 0.0649061 -0.1011194 0.0030217 -0.0563071 -0.1804178 -0.0032348 -0.1262492 -0.2216038
Encounter_Duration_risk_factor_feature_value 0.0649061 1.0000000 -0.0907257 -0.0018126 -0.1102129 -0.0564773 0.2571414 -0.0702778 -0.0337045
Clinical_Workload_RVU_risk_factor_feature_value -0.1011194 -0.0907257 1.0000000 0.6336461 0.8829654 0.5771087 0.0119758 0.5452412 0.5751453
Clinical_Workload_Procedure_Type_risk_factor_feature_value 0.0030217 -0.0018126 0.6336461 1.0000000 0.5157007 0.5627637 -0.0891127 0.5484507 0.4725423
Clinical_Workload_Procedure_Count_risk_factor_feature_value -0.0563071 -0.1102129 0.8829654 0.5157007 1.0000000 0.5039168 0.0939605 0.4616627 0.6085621
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value -0.1804178 -0.0564773 0.5771087 0.5627637 0.5039168 1.0000000 0.1190617 0.8678634 0.8993081
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value -0.0032348 0.2571414 0.0119758 -0.0891127 0.0939605 0.1190617 1.0000000 0.0685954 0.0983374
Clinical_Workload_Encounter_count_risk_factor_feature_value -0.1262492 -0.0702778 0.5452412 0.5484507 0.4616627 0.8678634 0.0685954 1.0000000 0.8541545
Nonpatient_contact_time_risk_factor_feature_value -0.2216038 -0.0337045 0.5751453 0.4725423 0.6085621 0.8993081 0.0983374 0.8541545 1.0000000
P-values for the Correlations
retention Encounter_Duration_risk_factor_feature_value Clinical_Workload_RVU_risk_factor_feature_value Clinical_Workload_Procedure_Type_risk_factor_feature_value Clinical_Workload_Procedure_Count_risk_factor_feature_value Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value Clinical_Workload_Encounter_count_risk_factor_feature_value Nonpatient_contact_time_risk_factor_feature_value
retention NA 0.3648513 0.1366866 0.9646191 0.4081005 0.0074360 0.9636492 0.0627749 0.0014456
Encounter_Duration_risk_factor_feature_value 0.3648513 NA 0.2048307 0.9798325 0.1231299 0.4305324 0.0002646 0.3264284 0.6382202
Clinical_Workload_RVU_risk_factor_feature_value 0.1366866 0.2048307 NA 0.0000000 0.0000000 0.0000000 0.8663408 0.0000000 0.0000000
Clinical_Workload_Procedure_Type_risk_factor_feature_value 0.9646191 0.9798325 0.0000000 NA 0.0000000 0.0000000 0.2095358 0.0000000 0.0000000
Clinical_Workload_Procedure_Count_risk_factor_feature_value 0.4081005 0.1231299 0.0000000 0.0000000 NA 0.0000000 0.1857015 0.0000000 0.0000000
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 0.0074360 0.4305324 0.0000000 0.0000000 0.0000000 NA 0.0922867 0.0000000 0.0000000
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 0.9636492 0.0002646 0.8663408 0.2095358 0.1857015 0.0922867 NA 0.3332526 0.1648795
Clinical_Workload_Encounter_count_risk_factor_feature_value 0.0627749 0.3264284 0.0000000 0.0000000 0.0000000 0.0000000 0.3332526 NA 0.0000000
Nonpatient_contact_time_risk_factor_feature_value 0.0014456 0.6382202 0.0000000 0.0000000 0.0000000 0.0000000 0.1648795 0.0000000 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Workload FEATURE Variables by Retention Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
retention_category…1 Encounter_Duration_risk_factor_feature_value 2 9.126398e+02 4.563199e+02 0.3989995 0.6715404
Residuals …2 Encounter_Duration_risk_factor_feature_value 194 2.218701e+05 1.143660e+03 NA NA
retention_category…3 Clinical_Workload_RVU_risk_factor_feature_value 2 2.027865e+05 1.013932e+05 1.6621783 0.1921539
Residuals …4 Clinical_Workload_RVU_risk_factor_feature_value 215 1.311505e+07 6.100022e+04 NA NA
retention_category…5 Clinical_Workload_Procedure_Type_risk_factor_feature_value 2 3.210614e+03 1.605307e+03 1.6832320 0.1882113
Residuals …6 Clinical_Workload_Procedure_Type_risk_factor_feature_value 215 2.050466e+05 9.537052e+02 NA NA
retention_category…7 Clinical_Workload_Procedure_Count_risk_factor_feature_value 2 3.007295e+05 1.503648e+05 0.5961216 0.5518523
Residuals …8 Clinical_Workload_Procedure_Count_risk_factor_feature_value 215 5.423126e+07 2.522384e+05 NA NA
retention_category…9 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 2 1.687396e+06 8.436981e+05 2.1683425 0.1168502
Residuals …10 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 216 8.404520e+07 3.890982e+05 NA NA
retention_category…11 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 2 9.442344e-01 4.721172e-01 0.1543424 0.8570816
Residuals …12 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 198 6.056613e+02 3.058895e+00 NA NA
retention_category…13 Clinical_Workload_Encounter_count_risk_factor_feature_value 2 1.190934e+07 5.954672e+06 2.2391195 0.1090314
Residuals …14 Clinical_Workload_Encounter_count_risk_factor_feature_value 215 5.717669e+08 2.659381e+06 NA NA
retention_category…15 Nonpatient_contact_time_risk_factor_feature_value 2 5.855860e+05 2.927930e+05 4.9095125 0.0082845
Residuals …16 Nonpatient_contact_time_risk_factor_feature_value 201 1.198722e+07 5.963790e+04 NA NA

##Relationship between Retention and Ehr Features

EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_patient_history_risk_factor_feature_value”,

“EHR_usage_time_spent_on_patient_education_risk_factor_feature_value”,

“EHR_usage_time_spent_on_orders_risk_factor_feature_value”,

“EHR_usage_time_spent_on_notes_risk_factor_feature_value”,

“EHR_usage_time_spent_on_messaging_risk_factor_feature_value”,

“EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_charging_risk_factor_feature_value”,

“EHR_usage_time_spent_on_assessment_risk_factor_feature_value”,

“EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value”,

“EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value”,

“EHR_uncategorized_time_risk_factor_feature_value” )

Correlation Matrix: Retention and Ehr FEATURE Variables
retention EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_patient_history_risk_factor_feature_value EHR_usage_time_spent_on_patient_education_risk_factor_feature_value EHR_usage_time_spent_on_orders_risk_factor_feature_value EHR_usage_time_spent_on_notes_risk_factor_feature_value EHR_usage_time_spent_on_messaging_risk_factor_feature_value EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_charging_risk_factor_feature_value EHR_usage_time_spent_on_assessment_risk_factor_feature_value EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value EHR_uncategorized_time_risk_factor_feature_value
retention 1.0000000 -0.1392423 -0.1020363 -0.1677909 0.0474735 0.1056643 -0.0775746 -0.0222801 -0.0942442 -0.1229859 0.0587330 -0.0580086 -0.0671794 0.0101494
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value -0.1392423 1.0000000 0.2955489 0.3723345 0.1599872 0.0268260 0.4117812 0.1801960 0.7616065 0.1771519 0.0978425 0.4026231 0.3718345 -0.0161345
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value -0.1020363 0.2955489 1.0000000 0.3205523 0.2230759 -0.0521011 0.2451910 0.1672860 0.4518141 -0.0490269 -0.0200799 0.2844927 0.4313724 -0.0109216
EHR_usage_time_spent_on_patient_history_risk_factor_feature_value -0.1677909 0.3723345 0.3205523 1.0000000 0.1266236 -0.0325975 0.3838695 0.2204826 0.3932471 0.0576596 -0.0362776 0.1970041 0.3480255 -0.0108374
EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 0.0474735 0.1599872 0.2230759 0.1266236 1.0000000 0.0032137 0.0847692 0.2714108 0.6727675 -0.0385705 0.0382361 0.0851150 0.2363722 -0.0061608
EHR_usage_time_spent_on_orders_risk_factor_feature_value 0.1056643 0.0268260 -0.0521011 -0.0325975 0.0032137 1.0000000 -0.0238416 -0.0177976 0.0730937 0.0699412 -0.0130243 -0.0614662 -0.0122152 0.5652791
EHR_usage_time_spent_on_notes_risk_factor_feature_value -0.0775746 0.4117812 0.2451910 0.3838695 0.0847692 -0.0238416 1.0000000 0.1751917 0.5249399 -0.0835920 -0.0131401 0.8298625 0.4328561 -0.0438828
EHR_usage_time_spent_on_messaging_risk_factor_feature_value -0.0222801 0.1801960 0.1672860 0.2204826 0.2714108 -0.0177976 0.1751917 1.0000000 0.3370017 -0.0247184 0.1690793 0.1167211 0.2077730 -0.0278838
EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value -0.0942442 0.7616065 0.4518141 0.3932471 0.6727675 0.0730937 0.5249399 0.3370017 1.0000000 0.1512172 0.1143254 0.5293828 0.5519003 0.0248733
EHR_usage_time_spent_on_charging_risk_factor_feature_value -0.1229859 0.1771519 -0.0490269 0.0576596 -0.0385705 0.0699412 -0.0835920 -0.0247184 0.1512172 1.0000000 -0.0095429 -0.0738147 -0.0599366 0.0132267
EHR_usage_time_spent_on_assessment_risk_factor_feature_value 0.0587330 0.0978425 -0.0200799 -0.0362776 0.0382361 -0.0130243 -0.0131401 0.1690793 0.1143254 -0.0095429 1.0000000 0.0029973 0.1155403 -0.0120041
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value -0.0580086 0.4026231 0.2844927 0.1970041 0.0851150 -0.0614662 0.8298625 0.1167211 0.5293828 -0.0738147 0.0029973 1.0000000 0.5063808 -0.0383480
EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value -0.0671794 0.3718345 0.4313724 0.3480255 0.2363722 -0.0122152 0.4328561 0.2077730 0.5519003 -0.0599366 0.1155403 0.5063808 1.0000000 0.0427446
EHR_uncategorized_time_risk_factor_feature_value 0.0101494 -0.0161345 -0.0109216 -0.0108374 -0.0061608 0.5652791 -0.0438828 -0.0278838 0.0248733 0.0132267 -0.0120041 -0.0383480 0.0427446 1.0000000
P-values for the Correlations
retention EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_patient_history_risk_factor_feature_value EHR_usage_time_spent_on_patient_education_risk_factor_feature_value EHR_usage_time_spent_on_orders_risk_factor_feature_value EHR_usage_time_spent_on_notes_risk_factor_feature_value EHR_usage_time_spent_on_messaging_risk_factor_feature_value EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_charging_risk_factor_feature_value EHR_usage_time_spent_on_assessment_risk_factor_feature_value EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value EHR_uncategorized_time_risk_factor_feature_value
retention NA 0.0372983 0.1278657 0.0119008 0.4796029 0.1147937 0.2475673 0.7401659 0.1597960 0.0661556 0.3816429 0.3875532 0.3168485 0.8799308
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 0.0372983 NA 0.0000068 0.0000000 0.0165512 0.6896572 0.0000000 0.0068509 0.0000000 0.0078702 0.1443769 0.0000000 0.0000000 0.8102191
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 0.1278657 0.0000068 NA 0.0000010 0.0007724 0.4377832 0.0002107 0.0121625 0.0000000 0.4653278 0.7650336 0.0000153 0.0000000 0.8708724
EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 0.0119008 0.0000000 0.0000010 NA 0.0584711 0.6274817 0.0000000 0.0008925 0.0000000 0.3904194 0.5891330 0.0030658 0.0000001 0.8718599
EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 0.4796029 0.0165512 0.0007724 0.0584711 NA 0.9618519 0.2062704 0.0000384 0.0000000 0.5657960 0.5691713 0.2044191 0.0003589 0.9269435
EHR_usage_time_spent_on_orders_risk_factor_feature_value 0.1147937 0.6896572 0.4377832 0.6274817 0.9618519 NA 0.7226779 0.7910855 0.2760202 0.2973172 0.8462953 0.3598444 0.8557360 0.0000000
EHR_usage_time_spent_on_notes_risk_factor_feature_value 0.2475673 0.0000000 0.0002107 0.0000000 0.2062704 0.7226779 NA 0.0085961 0.0000000 0.2126639 0.8449462 0.0000000 0.0000000 0.5134872
EHR_usage_time_spent_on_messaging_risk_factor_feature_value 0.7401659 0.0068509 0.0121625 0.0008925 0.0000384 0.7910855 0.0085961 NA 0.0000002 0.7129193 0.0112555 0.0813143 0.0017693 0.6780888
EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 0.1597960 0.0000000 0.0000000 0.0000000 0.0000000 0.2760202 0.0000000 0.0000002 NA 0.0235998 0.0878044 0.0000000 0.0000000 0.7112003
EHR_usage_time_spent_on_charging_risk_factor_feature_value 0.0661556 0.0078702 0.4653278 0.3904194 0.5657960 0.2973172 0.2126639 0.7129193 0.0235998 NA 0.8870565 0.2712985 0.3719469 0.8439370
EHR_usage_time_spent_on_assessment_risk_factor_feature_value 0.3816429 0.1443769 0.7650336 0.5891330 0.5691713 0.8462953 0.8449462 0.0112555 0.0878044 0.8870565 NA 0.9644198 0.0844630 0.8582029
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 0.3875532 0.0000000 0.0000153 0.0030658 0.2044191 0.3598444 0.0000000 0.0813143 0.0000000 0.2712985 0.9644198 NA 0.0000000 0.5680403
EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 0.3168485 0.0000000 0.0000000 0.0000001 0.0003589 0.8557360 0.0000000 0.0017693 0.0000000 0.3719469 0.0844630 0.0000000 NA 0.5244805
EHR_uncategorized_time_risk_factor_feature_value 0.8799308 0.8102191 0.8708724 0.8718599 0.9269435 0.0000000 0.5134872 0.6780888 0.7112003 0.8439370 0.8582029 0.5680403 0.5244805 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Ehr FEATURE Variables by Retention Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
retention_category…1 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 2 7.604236e+01 38.0211823 0.5539650 0.5754626
Residuals …2 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 221 1.516825e+04 68.6346275 NA NA
retention_category…3 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 2 2.114825e+01 10.5741232 0.2904670 0.7481993
Residuals …4 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 221 8.045257e+03 36.4038767 NA NA
retention_category…5 EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 2 3.239629e+01 16.1981429 1.0118551 0.3652218
Residuals …6 EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 221 3.537848e+03 16.0083615 NA NA
retention_category…7 EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 2 2.429005e+03 1214.5025098 1.1070428 0.3323608
Residuals …8 EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 221 2.424523e+05 1097.0691673 NA NA
retention_category…9 EHR_usage_time_spent_on_orders_risk_factor_feature_value 2 2.115347e-01 0.1057674 0.0687755 0.9335562
Residuals …10 EHR_usage_time_spent_on_orders_risk_factor_feature_value 221 3.398677e+02 1.5378630 NA NA
retention_category…11 EHR_usage_time_spent_on_notes_risk_factor_feature_value 2 2.183693e+00 1.0918467 0.4417805 0.6434572
Residuals …12 EHR_usage_time_spent_on_notes_risk_factor_feature_value 221 5.461946e+02 2.4714686 NA NA
retention_category…13 EHR_usage_time_spent_on_messaging_risk_factor_feature_value 2 5.072700e-03 0.0025363 1.0275654 0.3595806
Residuals …14 EHR_usage_time_spent_on_messaging_risk_factor_feature_value 221 5.454963e-01 0.0024683 NA NA
retention_category…15 EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 2 5.912443e+02 295.6221563 0.8022133 0.4496367
Residuals …16 EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 221 8.144030e+04 368.5081555 NA NA
retention_category…17 EHR_usage_time_spent_on_charging_risk_factor_feature_value 2 1.036995e+01 5.1849745 0.1765475 0.8382771
Residuals …18 EHR_usage_time_spent_on_charging_risk_factor_feature_value 221 6.490488e+03 29.3687239 NA NA
retention_category…19 EHR_usage_time_spent_on_assessment_risk_factor_feature_value 2 3.390840e+00 1.6954201 0.2194573 0.8031292
Residuals …20 EHR_usage_time_spent_on_assessment_risk_factor_feature_value 221 1.707338e+03 7.7255132 NA NA
retention_category…21 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 2 2.345755e+00 1.1728776 0.2877356 0.7502404
Residuals …22 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 221 9.008476e+02 4.0762336 NA NA
retention_category…23 EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 2 1.098300e+00 0.5491502 0.4284243 0.6520749
Residuals …24 EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 221 2.832757e+02 1.2817906 NA NA
retention_category…25 EHR_uncategorized_time_risk_factor_feature_value 2 3.312000e-04 0.0001656 0.1733111 0.8409901
Residuals …26 EHR_uncategorized_time_risk_factor_feature_value 221 2.111823e-01 0.0009556 NA NA