Sustainable Engagement Descriptives

Data were aggregated by Department (final N=269 departments)

Descriptive Statistics for Sustainable Engagement
vars n mean sd median trimmed mad min max range skew kurtosis se
X1 1 269 2.378683 0.6595056 2.333333 2.353234 0.5765667 1 5 4 0.6054719 1.230802 0.0402108

Descriptive Statistics for Sustainable Engagement by Category
sustainable_engage_category Count Mean SD
Favorable 224 2.170951 0.4658564
Unfavorable 6 4.472222 0.3234650
NA 39 3.249724 0.2347174
Descriptive Statistics for Sustainable Engagement by Percentile
sustainable_engage_percentile Count Mean SD
Top 20% 54 1.539165 0.2858725
Bottom 20% 61 3.272068 0.4801120
NA 154 2.319186 0.2695184

Sustainable Engagement and Quit Probability

Correlation between Sustainable Engagement and Quit Probability
Correlation
-0.0313704 
## `geom_smooth()` using formula = 'y ~ x'

ANOVA Results for Quit Probability by Sustainable Engagement Category
Df Sum Sq Mean Sq F value Pr(>F)
sustainable_engage_category 1 0.0000020 2.00e-06 0.0500536 0.8232092
Residuals 191 0.0077298 4.05e-05 NA NA
Tukey’s HSD Post-hoc Results for Sustainable Engagement Category
Comparison Estimate Std_Error z_value p_value
Unfavorable - Favorable Unfavorable - Favorable -0.0005903 0.0026385 -0.2237265 0.8232092

ANOVA Results for Quit Probability by Sustainable Engagement Percentile
Df Sum Sq Mean Sq F value Pr(>F)
sustainable_engage_percentile 1 0.0000037 3.7e-06 0.4136658 0.5217146
Residuals 92 0.0008172 8.9e-06 NA NA
Tukey’s HSD Post-hoc Results for Sustainable Engagement Percentile
Comparison Estimate Std_Error z_value p_value
Bottom 20% - Top 20% Bottom 20% - Top 20% -0.0004029 0.0006264 -0.6431686 0.5217146

##Relationship between Sustainable Engagement and Scheduling Shaps

Correlation Matrix: Sustainable Engagement and Scheduling SHAP Variables
sustainable_engage Unscheduled_Time_risk_factor_shap Scheduling_overlapping_appointments_risk_factor_shap Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap Scheduling_back_to_back_appointments_risk_factor_shap SchedulingWeekends_risk_factor_shap
sustainable_engage 1.0000000 -0.0346551 0.1943846 0.0733419 -0.0356866 0.0938179 -0.0066292 0.0349551
Unscheduled_Time_risk_factor_shap -0.0346551 1.0000000 0.1074331 0.1203767 0.0780532 0.0613317 0.0960513 -0.0179730
Scheduling_overlapping_appointments_risk_factor_shap 0.1943846 0.1074331 1.0000000 -0.1655393 -0.1191948 -0.4153116 0.2109286 0.0743987
Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 0.0733419 0.1203767 -0.1655393 1.0000000 0.1472663 0.6380386 -0.0603795 0.1498284
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap -0.0356866 0.0780532 -0.1191948 0.1472663 1.0000000 0.2968274 0.1307884 -0.0434544
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 0.0938179 0.0613317 -0.4153116 0.6380386 0.2968274 1.0000000 -0.1558050 0.0968575
Scheduling_back_to_back_appointments_risk_factor_shap -0.0066292 0.0960513 0.2109286 -0.0603795 0.1307884 -0.1558050 1.0000000 -0.0204519
SchedulingWeekends_risk_factor_shap 0.0349551 -0.0179730 0.0743987 0.1498284 -0.0434544 0.0968575 -0.0204519 1.0000000
P-values for the Correlations
sustainable_engage Unscheduled_Time_risk_factor_shap Scheduling_overlapping_appointments_risk_factor_shap Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap Scheduling_back_to_back_appointments_risk_factor_shap SchedulingWeekends_risk_factor_shap
sustainable_engage NA 0.6226623 0.0053374 0.2798727 0.5994037 0.1665158 0.9250268 0.6284788
Unscheduled_Time_risk_factor_shap 0.6226623 NA 0.1261524 0.0863451 0.2671430 0.3835198 0.1717447 0.8086599
Scheduling_overlapping_appointments_risk_factor_shap 0.0053374 0.1261524 NA 0.0179720 0.0895004 0.0000000 0.0024594 0.3155196
Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 0.2798727 0.0863451 0.0179720 NA 0.0293493 0.0000000 0.3909610 0.0370542
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 0.5994037 0.2671430 0.0895004 0.0293493 NA 0.0000079 0.0622417 0.5474255
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 0.1665158 0.3835198 0.0000000 0.0000000 0.0000079 NA 0.0260629 0.1791063
Scheduling_back_to_back_appointments_risk_factor_shap 0.9250268 0.1717447 0.0024594 0.3909610 0.0622417 0.0260629 NA 0.7828853
SchedulingWeekends_risk_factor_shap 0.6284788 0.8086599 0.3155196 0.0370542 0.5474255 0.1791063 0.7828853 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Scheduling SHAP Variables by Sustainable Engagement Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
sustainable_engage_category…1 Unscheduled_Time_risk_factor_shap 1 0.0001983 0.0001983 0.0654629 0.7983669
Residuals …2 Unscheduled_Time_risk_factor_shap 172 0.5209931 0.0030290 NA NA
sustainable_engage_category…3 Scheduling_overlapping_appointments_risk_factor_shap 1 0.0218635 0.0218635 1.9367234 0.1658219
Residuals …4 Scheduling_overlapping_appointments_risk_factor_shap 172 1.9416964 0.0112889 NA NA
sustainable_engage_category…5 Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 1 0.0010856 0.0010856 0.2051016 0.6511648
Residuals …6 Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 185 0.9791867 0.0052929 NA NA
sustainable_engage_category…7 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 1 0.0004750 0.0004750 9.6725125 0.0021665
Residuals …8 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 185 0.0090853 0.0000491 NA NA
sustainable_engage_category…9 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 1 0.0065098 0.0065098 1.4308609 0.2331548
Residuals …10 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 185 0.8416720 0.0045496 NA NA
sustainable_engage_category…11 Scheduling_back_to_back_appointments_risk_factor_shap 1 0.0014567 0.0014567 2.5695610 0.1107728
Residuals …12 Scheduling_back_to_back_appointments_risk_factor_shap 172 0.0975111 0.0005669 NA NA
sustainable_engage_category…13 SchedulingWeekends_risk_factor_shap 1 0.0158901 0.0158901 1.4659438 0.2277394
Residuals …14 SchedulingWeekends_risk_factor_shap 163 1.7668415 0.0108395 NA NA

##Relationship between Sustainable Engagement and Workload Shaps

Encounter_Duration_risk_factor_shap

Clinical_Workload_RVU_risk_factor_shap

Clinical_Workload_Procedure_Type_risk_factor_shap

Clinical_Workload_Procedure_Count_risk_factor_shap”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap

“Nonpatient_contact_time_risk_factor_shap

##Relationship between Sustainable Engagement and Workload Shaps

Encounter_Duration_risk_factor_shap

Clinical_Workload_RVU_risk_factor_shap

Clinical_Workload_Procedure_Type_risk_factor_shap

Clinical_Workload_Procedure_Count_risk_factor_shap”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap

“Nonpatient_contact_time_risk_factor_shap

“Clinical_Workload_Encounter_count_risk_factor_shap”

Correlation Matrix: Sustainable Engagement and Workload SHAP Variables
sustainable_engage Encounter_Duration_risk_factor_shap Clinical_Workload_RVU_risk_factor_shap Clinical_Workload_Procedure_Type_risk_factor_shap Clinical_Workload_Procedure_Count_risk_factor_shap Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap Clinical_Workload_Encounter_count_risk_factor_shap Nonpatient_contact_time_risk_factor_shap
sustainable_engage 1.0000000 -0.0322362 0.0612692 0.1777623 0.1742005 -0.0263369 -0.0259576 0.0133521 0.0603618
Encounter_Duration_risk_factor_shap -0.0322362 1.0000000 -0.2262257 -0.0446032 -0.2084849 0.1380264 0.1550642 0.2730183 -0.2203552
Clinical_Workload_RVU_risk_factor_shap 0.0612692 -0.2262257 1.0000000 0.0800352 0.5795920 0.0809919 0.0589783 -0.2399206 0.3581040
Clinical_Workload_Procedure_Type_risk_factor_shap 0.1777623 -0.0446032 0.0800352 1.0000000 0.0416841 0.2444559 0.0595537 0.1101940 -0.1025363
Clinical_Workload_Procedure_Count_risk_factor_shap 0.1742005 -0.2084849 0.5795920 0.0416841 1.0000000 0.1053561 0.0178292 -0.2028889 0.2165978
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap -0.0263369 0.1380264 0.0809919 0.2444559 0.1053561 1.0000000 -0.0176133 0.3770314 -0.2855978
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap -0.0259576 0.1550642 0.0589783 0.0595537 0.0178292 -0.0176133 1.0000000 0.0402679 0.1507316
Clinical_Workload_Encounter_count_risk_factor_shap 0.0133521 0.2730183 -0.2399206 0.1101940 -0.2028889 0.3770314 0.0402679 1.0000000 -0.4980576
Nonpatient_contact_time_risk_factor_shap 0.0603618 -0.2203552 0.3581040 -0.1025363 0.2165978 -0.2855978 0.1507316 -0.4980576 1.0000000
P-values for the Correlations
sustainable_engage Encounter_Duration_risk_factor_shap Clinical_Workload_RVU_risk_factor_shap Clinical_Workload_Procedure_Type_risk_factor_shap Clinical_Workload_Procedure_Count_risk_factor_shap Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap Clinical_Workload_Encounter_count_risk_factor_shap Nonpatient_contact_time_risk_factor_shap
sustainable_engage NA 0.6529310 0.3679741 0.0085253 0.0099666 0.6983219 0.7145300 0.8445973 0.3911006
Encounter_Duration_risk_factor_shap 0.6529310 NA 0.0013907 0.5337042 0.0032823 0.0530845 0.0295734 0.0001038 0.0018615
Clinical_Workload_RVU_risk_factor_shap 0.3679741 0.0013907 NA 0.2392750 0.0000000 0.2336874 0.4067796 0.0003624 0.0000002
Clinical_Workload_Procedure_Type_risk_factor_shap 0.0085253 0.5337042 0.2392750 NA 0.5404144 0.0002684 0.4022096 0.1054866 0.1454655
Clinical_Workload_Procedure_Count_risk_factor_shap 0.0099666 0.0032823 0.0000000 0.5404144 NA 0.1209160 0.8021371 0.0026753 0.0019098
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 0.6983219 0.0530845 0.2336874 0.0002684 0.1209160 NA 0.8040003 0.0000000 0.0000346
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 0.7145300 0.0295734 0.4067796 0.4022096 0.8021371 0.8040003 NA 0.5703301 0.0326892
Clinical_Workload_Encounter_count_risk_factor_shap 0.8445973 0.0001038 0.0003624 0.1054866 0.0026753 0.0000000 0.5703301 NA 0.0000000
Nonpatient_contact_time_risk_factor_shap 0.3911006 0.0018615 0.0000002 0.1454655 0.0019098 0.0000346 0.0326892 0.0000000 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Workload SHAP Variables by Sustainable Engagement Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
sustainable_engage_category…1 Encounter_Duration_risk_factor_shap 1 0.0193404 0.0193404 2.1111792 0.1481258
Residuals …2 Encounter_Duration_risk_factor_shap 165 1.5115564 0.0091609 NA NA
sustainable_engage_category…3 Clinical_Workload_RVU_risk_factor_shap 1 0.0019235 0.0019235 0.2075795 0.6492084
Residuals …4 Clinical_Workload_RVU_risk_factor_shap 184 1.7050069 0.0092663 NA NA
sustainable_engage_category…5 Clinical_Workload_Procedure_Type_risk_factor_shap 1 0.0000702 0.0000702 0.0218282 0.8827068
Residuals …6 Clinical_Workload_Procedure_Type_risk_factor_shap 184 0.5915173 0.0032148 NA NA
sustainable_engage_category…7 Clinical_Workload_Procedure_Count_risk_factor_shap 1 0.0016749 0.0016749 0.5419252 0.4625734
Residuals …8 Clinical_Workload_Procedure_Count_risk_factor_shap 184 0.5686791 0.0030906 NA NA
sustainable_engage_category…9 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 1 0.0037777 0.0037777 4.0487820 0.0456538
Residuals …10 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 185 0.1726151 0.0009331 NA NA
sustainable_engage_category…11 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 1 0.0005416 0.0005416 0.1871974 0.6658111
Residuals …12 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 169 0.4889671 0.0028933 NA NA
sustainable_engage_category…13 Clinical_Workload_Encounter_count_risk_factor_shap 1 0.0084095 0.0084095 1.0082763 0.3166348
Residuals …14 Clinical_Workload_Encounter_count_risk_factor_shap 184 1.5346529 0.0083405 NA NA
sustainable_engage_category…15 Nonpatient_contact_time_risk_factor_shap 1 0.0067086 0.0067086 0.3728337 0.5422697
Residuals …16 Nonpatient_contact_time_risk_factor_shap 172 3.0948878 0.0179935 NA NA

##Relationship between Sustainable Engagement and Ehr Shaps

EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_patient_history_risk_factor_shap”,

“EHR_usage_time_spent_on_patient_education_risk_factor_shap”,

“EHR_usage_time_spent_on_orders_risk_factor_shap”,

“EHR_usage_time_spent_on_notes_risk_factor_shap”,

“EHR_usage_time_spent_on_messaging_risk_factor_shap”,

“EHR_usage_time_spent_on_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_charging_risk_factor_shap”,

“EHR_usage_time_spent_on_assessment_risk_factor_shap”,

“EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap”,

“EHR_usage_time_spent_on_administrative_processes_risk_factor_shap”,

“EHR_uncategorized_time_risk_factor_shap” )

Correlation Matrix: Sustainable Engagement and Ehr SHAP Variables
sustainable_engage EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_patient_history_risk_factor_shap EHR_usage_time_spent_on_patient_education_risk_factor_shap EHR_usage_time_spent_on_orders_risk_factor_shap EHR_usage_time_spent_on_notes_risk_factor_shap EHR_usage_time_spent_on_messaging_risk_factor_shap EHR_usage_time_spent_on_EHR_system_risk_factor_shap EHR_usage_time_spent_on_charging_risk_factor_shap EHR_usage_time_spent_on_assessment_risk_factor_shap EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap EHR_usage_time_spent_on_administrative_processes_risk_factor_shap EHR_uncategorized_time_risk_factor_shap
sustainable_engage 1.0000000 -0.0999110 -0.0724809 -0.0720806 -0.0067187 -0.2421716 -0.0998028 -0.0026918 -0.1309331 -0.0873428 -0.0594763 0.1281674 -0.0573493 -0.0063780
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap -0.0999110 1.0000000 0.4625391 0.3935647 0.3936631 0.0127669 0.4791951 0.0681449 0.7803844 0.2866464 0.3693576 -0.4094449 0.6996216 0.0985913
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap -0.0724809 0.4625391 1.0000000 0.5524408 0.2875210 0.0456950 0.3675777 -0.0364662 0.5467299 0.2346365 0.3206382 -0.3139356 0.6583274 0.1774795
EHR_usage_time_spent_on_patient_history_risk_factor_shap -0.0720806 0.3935647 0.5524408 1.0000000 0.1080566 0.0133008 0.2421737 -0.0005768 0.4133753 0.1490189 0.3183151 -0.2257065 0.4830547 0.1880824
EHR_usage_time_spent_on_patient_education_risk_factor_shap -0.0067187 0.3936631 0.2875210 0.1080566 1.0000000 0.1352755 0.3408316 -0.1021671 0.4900959 0.1682598 0.2923523 -0.3348235 0.4988600 0.0186822
EHR_usage_time_spent_on_orders_risk_factor_shap -0.2421716 0.0127669 0.0456950 0.0133008 0.1352755 1.0000000 -0.0263452 -0.0695341 0.1039823 -0.0442113 0.0135692 -0.0741403 0.0139322 0.0810434
EHR_usage_time_spent_on_notes_risk_factor_shap -0.0998028 0.4791951 0.3675777 0.2421737 0.3408316 -0.0263452 1.0000000 0.0642468 0.5635219 0.2766452 0.2532913 -0.4678691 0.5000973 0.0184974
EHR_usage_time_spent_on_messaging_risk_factor_shap -0.0026918 0.0681449 -0.0364662 -0.0005768 -0.1021671 -0.0695341 0.0642468 1.0000000 0.0506593 0.1245726 0.0011789 -0.1052265 -0.0782965 0.0039928
EHR_usage_time_spent_on_EHR_system_risk_factor_shap -0.1309331 0.7803844 0.5467299 0.4133753 0.4900959 0.1039823 0.5635219 0.0506593 1.0000000 0.3715501 0.3687570 -0.4470924 0.7563752 0.0920523
EHR_usage_time_spent_on_charging_risk_factor_shap -0.0873428 0.2866464 0.2346365 0.1490189 0.1682598 -0.0442113 0.2766452 0.1245726 0.3715501 1.0000000 0.0502955 -0.1996492 0.2853860 0.0517544
EHR_usage_time_spent_on_assessment_risk_factor_shap -0.0594763 0.3693576 0.3206382 0.3183151 0.2923523 0.0135692 0.2532913 0.0011789 0.3687570 0.0502955 1.0000000 -0.2501693 0.4996607 0.0693299
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 0.1281674 -0.4094449 -0.3139356 -0.2257065 -0.3348235 -0.0741403 -0.4678691 -0.1052265 -0.4470924 -0.1996492 -0.2501693 1.0000000 -0.5065934 -0.0807939
EHR_usage_time_spent_on_administrative_processes_risk_factor_shap -0.0573493 0.6996216 0.6583274 0.4830547 0.4988600 0.0139322 0.5000973 -0.0782965 0.7563752 0.2853860 0.4996607 -0.5065934 1.0000000 0.1356093
EHR_uncategorized_time_risk_factor_shap -0.0063780 0.0985913 0.1774795 0.1880824 0.0186822 0.0810434 0.0184974 0.0039928 0.0920523 0.0517544 0.0693299 -0.0807939 0.1356093 1.0000000
P-values for the Correlations
sustainable_engage EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_patient_history_risk_factor_shap EHR_usage_time_spent_on_patient_education_risk_factor_shap EHR_usage_time_spent_on_orders_risk_factor_shap EHR_usage_time_spent_on_notes_risk_factor_shap EHR_usage_time_spent_on_messaging_risk_factor_shap EHR_usage_time_spent_on_EHR_system_risk_factor_shap EHR_usage_time_spent_on_charging_risk_factor_shap EHR_usage_time_spent_on_assessment_risk_factor_shap EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap EHR_usage_time_spent_on_administrative_processes_risk_factor_shap EHR_uncategorized_time_risk_factor_shap
sustainable_engage NA 0.1360410 0.2800764 0.2827484 0.9203481 0.0002534 0.1364677 0.9680435 0.0503360 0.1927780 0.3756372 0.0554403 0.3929791 0.9243752
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 0.1360410 NA 0.0000000 0.0000000 0.0000000 0.8492967 0.0000000 0.3099278 0.0000000 0.0000131 0.0000000 0.0000000 0.0000000 0.1413156
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 0.2800764 0.0000000 NA 0.0000000 0.0000123 0.4962322 0.0000000 0.5871960 0.0000000 0.0003976 0.0000009 0.0000016 0.0000000 0.0077544
EHR_usage_time_spent_on_patient_history_risk_factor_shap 0.2827484 0.0000000 0.0000000 NA 0.1067615 0.8430736 0.0002533 0.9931510 0.0000000 0.0257275 0.0000011 0.0006660 0.0000000 0.0047360
EHR_usage_time_spent_on_patient_education_risk_factor_shap 0.9203481 0.0000000 0.0000123 0.1067615 NA 0.0431147 0.0000002 0.1273754 0.0000000 0.0116623 0.0000086 0.0000003 0.0000000 0.7809591
EHR_usage_time_spent_on_orders_risk_factor_shap 0.0002534 0.8492967 0.4962322 0.8430736 0.0431147 NA 0.6949397 0.3001447 0.1207180 0.5103358 0.8399496 0.2691841 0.8357271 0.2269898
EHR_usage_time_spent_on_notes_risk_factor_shap 0.1364677 0.0000000 0.0000000 0.0002533 0.0000002 0.6949397 NA 0.3384825 0.0000000 0.0000267 0.0001269 0.0000000 0.0000000 0.7830711
EHR_usage_time_spent_on_messaging_risk_factor_shap 0.9680435 0.3099278 0.5871960 0.9931510 0.1273754 0.3001447 0.3384825 NA 0.4505838 0.0627078 0.9860019 0.1163133 0.2431815 0.9526135
EHR_usage_time_spent_on_EHR_system_risk_factor_shap 0.0503360 0.0000000 0.0000000 0.0000000 0.0000000 0.1207180 0.0000000 0.4505838 NA 0.0000000 0.0000000 0.0000000 0.0000000 0.1697766
EHR_usage_time_spent_on_charging_risk_factor_shap 0.1927780 0.0000131 0.0003976 0.0257275 0.0116623 0.5103358 0.0000267 0.0627078 0.0000000 NA 0.4538472 0.0026853 0.0000144 0.4408424
EHR_usage_time_spent_on_assessment_risk_factor_shap 0.3756372 0.0000000 0.0000009 0.0000011 0.0000086 0.8399496 0.0001269 0.9860019 0.0000000 0.4538472 NA 0.0001546 0.0000000 0.3015694
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 0.0554403 0.0000000 0.0000016 0.0006660 0.0000003 0.2691841 0.0000000 0.1163133 0.0000000 0.0026853 0.0001546 NA 0.0000000 0.2284282
EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 0.3929791 0.0000000 0.0000000 0.0000000 0.0000000 0.8357271 0.0000000 0.2431815 0.0000000 0.0000144 0.0000000 0.0000000 NA 0.0425975
EHR_uncategorized_time_risk_factor_shap 0.9243752 0.1413156 0.0077544 0.0047360 0.7809591 0.2269898 0.7830711 0.9526135 0.1697766 0.4408424 0.3015694 0.2284282 0.0425975 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Ehr SHAP Variables by Sustainable Engagement Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
sustainable_engage_category…1 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 1 0.0102946 0.0102946 0.7999873 0.3722408
Residuals …2 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 188 2.4192755 0.0128685 NA NA
sustainable_engage_category…3 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 1 0.0071927 0.0071927 0.5669596 0.4524115
Residuals …4 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 188 2.3850545 0.0126865 NA NA
sustainable_engage_category…5 EHR_usage_time_spent_on_patient_history_risk_factor_shap 1 0.0000180 0.0000180 0.0024336 0.9607072
Residuals …6 EHR_usage_time_spent_on_patient_history_risk_factor_shap 188 1.3901586 0.0073945 NA NA
sustainable_engage_category…7 EHR_usage_time_spent_on_patient_education_risk_factor_shap 1 0.0093214 0.0093214 1.6658033 0.1984066
Residuals …8 EHR_usage_time_spent_on_patient_education_risk_factor_shap 188 1.0520004 0.0055957 NA NA
sustainable_engage_category…9 EHR_usage_time_spent_on_orders_risk_factor_shap 1 0.1299060 0.1299060 21.8877955 0.0000055
Residuals …10 EHR_usage_time_spent_on_orders_risk_factor_shap 188 1.1157962 0.0059351 NA NA
sustainable_engage_category…11 EHR_usage_time_spent_on_notes_risk_factor_shap 1 0.0003141 0.0003141 0.0415823 0.8386387
Residuals …12 EHR_usage_time_spent_on_notes_risk_factor_shap 188 1.4202808 0.0075547 NA NA
sustainable_engage_category…13 EHR_usage_time_spent_on_messaging_risk_factor_shap 1 0.0033964 0.0033964 1.4824014 0.2249252
Residuals …14 EHR_usage_time_spent_on_messaging_risk_factor_shap 188 0.4307314 0.0022911 NA NA
sustainable_engage_category…15 EHR_usage_time_spent_on_EHR_system_risk_factor_shap 1 0.0004050 0.0004050 0.0111090 0.9161712
Residuals …16 EHR_usage_time_spent_on_EHR_system_risk_factor_shap 188 6.8540725 0.0364578 NA NA
sustainable_engage_category…17 EHR_usage_time_spent_on_charging_risk_factor_shap 1 0.0205974 0.0205974 1.7155229 0.1918686
Residuals …18 EHR_usage_time_spent_on_charging_risk_factor_shap 188 2.2572187 0.0120065 NA NA
sustainable_engage_category…19 EHR_usage_time_spent_on_assessment_risk_factor_shap 1 0.0000162 0.0000162 0.0066854 0.9349212
Residuals …20 EHR_usage_time_spent_on_assessment_risk_factor_shap 188 0.4544713 0.0024174 NA NA
sustainable_engage_category…21 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 1 0.0142598 0.0142598 1.2719082 0.2608463
Residuals …22 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 188 2.1077348 0.0112114 NA NA
sustainable_engage_category…23 EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 1 0.0059840 0.0059840 0.1076773 0.7431694
Residuals …24 EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 188 10.4477380 0.0555731 NA NA
sustainable_engage_category…25 EHR_uncategorized_time_risk_factor_shap 1 0.0000105 0.0000105 0.2408807 0.6241432
Residuals …26 EHR_uncategorized_time_risk_factor_shap 188 0.0081759 0.0000435 NA NA

##Relationship between Sustainable Engagement and Scheduling Features

Correlation Matrix: Sustainable Engagement and Scheduling FEATURE Variables
sustainable_engage Unscheduled_Time_risk_factor_feature_value Scheduling_overlapping_appointments_risk_factor_feature_value Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value Scheduling_back_to_back_appointments_risk_factor_feature_value SchedulingWeekends_risk_factor_feature_value
sustainable_engage 1.0000000 0.0845454 -0.0874803 -0.0693288 0.0774376 0.0588950 -0.0770051 -0.0308493
Unscheduled_Time_risk_factor_feature_value 0.0845454 1.0000000 -0.0573554 -0.0892838 -0.0063455 0.1238255 0.0769870 -0.1136307
Scheduling_overlapping_appointments_risk_factor_feature_value -0.0874803 -0.0573554 1.0000000 -0.3596856 0.1347903 0.3324081 0.3666426 0.0226906
Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value -0.0693288 -0.0892838 -0.3596856 1.0000000 -0.0073217 0.1566051 0.0715954 -0.0773370
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 0.0774376 -0.0063455 0.1347903 -0.0073217 1.0000000 -0.0071389 0.0363418 0.2210164
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 0.0588950 0.1238255 0.3324081 0.1566051 -0.0071389 1.0000000 0.8187556 -0.2911901
Scheduling_back_to_back_appointments_risk_factor_feature_value -0.0770051 0.0769870 0.3666426 0.0715954 0.0363418 0.8187556 1.0000000 -0.3121378
SchedulingWeekends_risk_factor_feature_value -0.0308493 -0.1136307 0.0226906 -0.0773370 0.2210164 -0.2911901 -0.3121378 1.0000000
P-values for the Correlations
sustainable_engage Unscheduled_Time_risk_factor_feature_value Scheduling_overlapping_appointments_risk_factor_feature_value Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value Scheduling_back_to_back_appointments_risk_factor_feature_value SchedulingWeekends_risk_factor_feature_value
sustainable_engage NA 0.2292537 0.2134343 0.3070976 0.2538169 0.3857599 0.2736393 0.6693753
Unscheduled_Time_risk_factor_feature_value 0.2292537 NA 0.4151659 0.2041098 0.9282273 0.0776459 0.2737519 0.1245786
Scheduling_overlapping_appointments_risk_factor_feature_value 0.2134343 0.4151659 NA 0.0000001 0.0545879 0.0000012 0.0000001 0.7598090
Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 0.3070976 0.2041098 0.0000001 NA 0.9142077 0.0204164 0.3088633 0.2837987
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 0.2538169 0.9282273 0.0545879 0.9142077 NA 0.9163422 0.6058230 0.0019556
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 0.3857599 0.0776459 0.0000012 0.0204164 0.9163422 NA 0.0000000 0.0000380
Scheduling_back_to_back_appointments_risk_factor_feature_value 0.2736393 0.2737519 0.0000001 0.3088633 0.6058230 0.0000000 NA 0.0000161
SchedulingWeekends_risk_factor_feature_value 0.6693753 0.1245786 0.7598090 0.2837987 0.0019556 0.0000380 0.0000161 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Scheduling FEATURE Variables by Sustainable Engagement Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
sustainable_engage_category…1 Unscheduled_Time_risk_factor_feature_value 1 8.318613e-01 8.318613e-01 0.1518191 0.6972850
Residuals …2 Unscheduled_Time_risk_factor_feature_value 172 9.424384e+02 5.479293e+00 NA NA
sustainable_engage_category…3 Scheduling_overlapping_appointments_risk_factor_feature_value 1 5.887452e+02 5.887452e+02 1.1231571 0.2907256
Residuals …4 Scheduling_overlapping_appointments_risk_factor_feature_value 172 9.016030e+04 5.241878e+02 NA NA
sustainable_engage_category…5 Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 1 4.761300e-03 4.761300e-03 0.3489315 0.5554395
Residuals …6 Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 185 2.524398e+00 1.364540e-02 NA NA
sustainable_engage_category…7 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 1 2.128322e+00 2.128322e+00 0.0500868 0.8231592
Residuals …8 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 185 7.861140e+03 4.249265e+01 NA NA
sustainable_engage_category…9 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 1 5.923703e+06 5.923703e+06 3.1750124 0.0764130
Residuals …10 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 185 3.451593e+08 1.865726e+06 NA NA
sustainable_engage_category…11 Scheduling_back_to_back_appointments_risk_factor_feature_value 1 1.080858e+04 1.080858e+04 0.2050945 0.6512105
Residuals …12 Scheduling_back_to_back_appointments_risk_factor_feature_value 172 9.064485e+06 5.270049e+04 NA NA
sustainable_engage_category…13 SchedulingWeekends_risk_factor_feature_value 1 5.227229e+03 5.227229e+03 0.5527897 0.4582504
Residuals …14 SchedulingWeekends_risk_factor_feature_value 163 1.541343e+06 9.456090e+03 NA NA

##Relationship between Sustainable Engagement and Workload Features

Encounter_Duration_risk_factor_feature_value

Clinical_Workload_RVU_risk_factor_feature_value

Clinical_Workload_Procedure_Type_risk_factor_feature_value

Clinical_Workload_Procedure_Count_risk_factor_feature_value”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value

“Nonpatient_contact_time_risk_factor_feature_value

“Clinical_Workload_Encounter_count_risk_factor_feature_value”

Correlation Matrix: Sustainable Engagement and Workload FEATURE Variables
sustainable_engage Encounter_Duration_risk_factor_feature_value Clinical_Workload_RVU_risk_factor_feature_value Clinical_Workload_Procedure_Type_risk_factor_feature_value Clinical_Workload_Procedure_Count_risk_factor_feature_value Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value Clinical_Workload_Encounter_count_risk_factor_feature_value Nonpatient_contact_time_risk_factor_feature_value
sustainable_engage 1.0000000 0.0699177 0.0760615 0.2470941 0.0615949 -0.0336505 0.0231865 0.0463162 -0.0842006
Encounter_Duration_risk_factor_feature_value 0.0699177 1.0000000 -0.0907257 -0.0018126 -0.1102129 -0.0564773 0.2571414 -0.0702778 -0.0337045
Clinical_Workload_RVU_risk_factor_feature_value 0.0760615 -0.0907257 1.0000000 0.6336461 0.8829654 0.5771087 0.0119758 0.5452412 0.5751453
Clinical_Workload_Procedure_Type_risk_factor_feature_value 0.2470941 -0.0018126 0.6336461 1.0000000 0.5157007 0.5627637 -0.0891127 0.5484507 0.4725423
Clinical_Workload_Procedure_Count_risk_factor_feature_value 0.0615949 -0.1102129 0.8829654 0.5157007 1.0000000 0.5039168 0.0939605 0.4616627 0.6085621
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value -0.0336505 -0.0564773 0.5771087 0.5627637 0.5039168 1.0000000 0.1190617 0.8678634 0.8993081
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 0.0231865 0.2571414 0.0119758 -0.0891127 0.0939605 0.1190617 1.0000000 0.0685954 0.0983374
Clinical_Workload_Encounter_count_risk_factor_feature_value 0.0463162 -0.0702778 0.5452412 0.5484507 0.4616627 0.8678634 0.0685954 1.0000000 0.8541545
Nonpatient_contact_time_risk_factor_feature_value -0.0842006 -0.0337045 0.5751453 0.4725423 0.6085621 0.8993081 0.0983374 0.8541545 1.0000000
P-values for the Correlations
sustainable_engage Encounter_Duration_risk_factor_feature_value Clinical_Workload_RVU_risk_factor_feature_value Clinical_Workload_Procedure_Type_risk_factor_feature_value Clinical_Workload_Procedure_Count_risk_factor_feature_value Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value Clinical_Workload_Encounter_count_risk_factor_feature_value Nonpatient_contact_time_risk_factor_feature_value
sustainable_engage NA 0.3289199 0.2634820 0.0002290 0.3654285 0.6204084 0.7438805 0.4963246 0.2311650
Encounter_Duration_risk_factor_feature_value 0.3289199 NA 0.2048307 0.9798325 0.1231299 0.4305324 0.0002646 0.3264284 0.6382202
Clinical_Workload_RVU_risk_factor_feature_value 0.2634820 0.2048307 NA 0.0000000 0.0000000 0.0000000 0.8663408 0.0000000 0.0000000
Clinical_Workload_Procedure_Type_risk_factor_feature_value 0.0002290 0.9798325 0.0000000 NA 0.0000000 0.0000000 0.2095358 0.0000000 0.0000000
Clinical_Workload_Procedure_Count_risk_factor_feature_value 0.3654285 0.1231299 0.0000000 0.0000000 NA 0.0000000 0.1857015 0.0000000 0.0000000
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 0.6204084 0.4305324 0.0000000 0.0000000 0.0000000 NA 0.0922867 0.0000000 0.0000000
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 0.7438805 0.0002646 0.8663408 0.2095358 0.1857015 0.0922867 NA 0.3332526 0.1648795
Clinical_Workload_Encounter_count_risk_factor_feature_value 0.4963246 0.3264284 0.0000000 0.0000000 0.0000000 0.0000000 0.3332526 NA 0.0000000
Nonpatient_contact_time_risk_factor_feature_value 0.2311650 0.6382202 0.0000000 0.0000000 0.0000000 0.0000000 0.1648795 0.0000000 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Workload FEATURE Variables by Sustainable Engagement Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
sustainable_engage_category…1 Encounter_Duration_risk_factor_feature_value 1 1.464163e+02 1.464163e+02 0.1232166 0.7260195
Residuals …2 Encounter_Duration_risk_factor_feature_value 165 1.960668e+05 1.188284e+03 NA NA
sustainable_engage_category…3 Clinical_Workload_RVU_risk_factor_feature_value 1 3.925030e+03 3.925030e+03 0.0658960 0.7976955
Residuals …4 Clinical_Workload_RVU_risk_factor_feature_value 184 1.095977e+07 5.956399e+04 NA NA
sustainable_engage_category…5 Clinical_Workload_Procedure_Type_risk_factor_feature_value 1 1.119550e+03 1.119550e+03 1.3959231 0.2389322
Residuals …6 Clinical_Workload_Procedure_Type_risk_factor_feature_value 184 1.475705e+05 8.020138e+02 NA NA
sustainable_engage_category…7 Clinical_Workload_Procedure_Count_risk_factor_feature_value 1 5.519273e+03 5.519273e+03 0.0279490 0.8674124
Residuals …8 Clinical_Workload_Procedure_Count_risk_factor_feature_value 184 3.633571e+07 1.974767e+05 NA NA
sustainable_engage_category…9 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 1 3.013418e+04 3.013418e+04 0.0744710 0.7852393
Residuals …10 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 185 7.485900e+07 4.046432e+05 NA NA
sustainable_engage_category…11 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 1 6.804502e-01 6.804502e-01 0.2173847 0.6416403
Residuals …12 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 169 5.289980e+02 3.130166e+00 NA NA
sustainable_engage_category…13 Clinical_Workload_Encounter_count_risk_factor_feature_value 1 6.331801e+06 6.331801e+06 2.4004969 0.1230150
Residuals …14 Clinical_Workload_Encounter_count_risk_factor_feature_value 184 4.853376e+08 2.637704e+06 NA NA
sustainable_engage_category…15 Nonpatient_contact_time_risk_factor_feature_value 1 3.573539e+03 3.573539e+03 0.0572576 0.8111689
Residuals …16 Nonpatient_contact_time_risk_factor_feature_value 172 1.073479e+07 6.241156e+04 NA NA

##Relationship between Sustainable Engagement and Ehr Features

EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_patient_history_risk_factor_feature_value”,

“EHR_usage_time_spent_on_patient_education_risk_factor_feature_value”,

“EHR_usage_time_spent_on_orders_risk_factor_feature_value”,

“EHR_usage_time_spent_on_notes_risk_factor_feature_value”,

“EHR_usage_time_spent_on_messaging_risk_factor_feature_value”,

“EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_charging_risk_factor_feature_value”,

“EHR_usage_time_spent_on_assessment_risk_factor_feature_value”,

“EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value”,

“EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value”,

“EHR_uncategorized_time_risk_factor_feature_value” )

Correlation Matrix: Sustainable Engagement and Ehr FEATURE Variables
sustainable_engage EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_patient_history_risk_factor_feature_value EHR_usage_time_spent_on_patient_education_risk_factor_feature_value EHR_usage_time_spent_on_orders_risk_factor_feature_value EHR_usage_time_spent_on_notes_risk_factor_feature_value EHR_usage_time_spent_on_messaging_risk_factor_feature_value EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_charging_risk_factor_feature_value EHR_usage_time_spent_on_assessment_risk_factor_feature_value EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value EHR_uncategorized_time_risk_factor_feature_value
sustainable_engage 1.0000000 0.0235080 0.0202155 -0.0359843 0.1420264 0.0605788 0.0012753 0.0253625 0.0705647 -0.0293714 0.0280499 0.0320757 0.0081325 -0.0277952
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 0.0235080 1.0000000 0.2955489 0.3723345 0.1599872 0.0268260 0.4117812 0.1801960 0.7616065 0.1771519 0.0978425 0.4026231 0.3718345 -0.0161345
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 0.0202155 0.2955489 1.0000000 0.3205523 0.2230759 -0.0521011 0.2451910 0.1672860 0.4518141 -0.0490269 -0.0200799 0.2844927 0.4313724 -0.0109216
EHR_usage_time_spent_on_patient_history_risk_factor_feature_value -0.0359843 0.3723345 0.3205523 1.0000000 0.1266236 -0.0325975 0.3838695 0.2204826 0.3932471 0.0576596 -0.0362776 0.1970041 0.3480255 -0.0108374
EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 0.1420264 0.1599872 0.2230759 0.1266236 1.0000000 0.0032137 0.0847692 0.2714108 0.6727675 -0.0385705 0.0382361 0.0851150 0.2363722 -0.0061608
EHR_usage_time_spent_on_orders_risk_factor_feature_value 0.0605788 0.0268260 -0.0521011 -0.0325975 0.0032137 1.0000000 -0.0238416 -0.0177976 0.0730937 0.0699412 -0.0130243 -0.0614662 -0.0122152 0.5652791
EHR_usage_time_spent_on_notes_risk_factor_feature_value 0.0012753 0.4117812 0.2451910 0.3838695 0.0847692 -0.0238416 1.0000000 0.1751917 0.5249399 -0.0835920 -0.0131401 0.8298625 0.4328561 -0.0438828
EHR_usage_time_spent_on_messaging_risk_factor_feature_value 0.0253625 0.1801960 0.1672860 0.2204826 0.2714108 -0.0177976 0.1751917 1.0000000 0.3370017 -0.0247184 0.1690793 0.1167211 0.2077730 -0.0278838
EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 0.0705647 0.7616065 0.4518141 0.3932471 0.6727675 0.0730937 0.5249399 0.3370017 1.0000000 0.1512172 0.1143254 0.5293828 0.5519003 0.0248733
EHR_usage_time_spent_on_charging_risk_factor_feature_value -0.0293714 0.1771519 -0.0490269 0.0576596 -0.0385705 0.0699412 -0.0835920 -0.0247184 0.1512172 1.0000000 -0.0095429 -0.0738147 -0.0599366 0.0132267
EHR_usage_time_spent_on_assessment_risk_factor_feature_value 0.0280499 0.0978425 -0.0200799 -0.0362776 0.0382361 -0.0130243 -0.0131401 0.1690793 0.1143254 -0.0095429 1.0000000 0.0029973 0.1155403 -0.0120041
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 0.0320757 0.4026231 0.2844927 0.1970041 0.0851150 -0.0614662 0.8298625 0.1167211 0.5293828 -0.0738147 0.0029973 1.0000000 0.5063808 -0.0383480
EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 0.0081325 0.3718345 0.4313724 0.3480255 0.2363722 -0.0122152 0.4328561 0.2077730 0.5519003 -0.0599366 0.1155403 0.5063808 1.0000000 0.0427446
EHR_uncategorized_time_risk_factor_feature_value -0.0277952 -0.0161345 -0.0109216 -0.0108374 -0.0061608 0.5652791 -0.0438828 -0.0278838 0.0248733 0.0132267 -0.0120041 -0.0383480 0.0427446 1.0000000
P-values for the Correlations
sustainable_engage EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_patient_history_risk_factor_feature_value EHR_usage_time_spent_on_patient_education_risk_factor_feature_value EHR_usage_time_spent_on_orders_risk_factor_feature_value EHR_usage_time_spent_on_notes_risk_factor_feature_value EHR_usage_time_spent_on_messaging_risk_factor_feature_value EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_charging_risk_factor_feature_value EHR_usage_time_spent_on_assessment_risk_factor_feature_value EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value EHR_uncategorized_time_risk_factor_feature_value
sustainable_engage NA 0.7264020 0.7634937 0.5921494 0.0336245 0.3668352 0.9848568 0.7057807 0.2930203 0.6619480 0.6762788 0.6330046 0.9036621 0.6790555
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 0.7264020 NA 0.0000068 0.0000000 0.0165512 0.6896572 0.0000000 0.0068509 0.0000000 0.0078702 0.1443769 0.0000000 0.0000000 0.8102191
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 0.7634937 0.0000068 NA 0.0000010 0.0007724 0.4377832 0.0002107 0.0121625 0.0000000 0.4653278 0.7650336 0.0000153 0.0000000 0.8708724
EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 0.5921494 0.0000000 0.0000010 NA 0.0584711 0.6274817 0.0000000 0.0008925 0.0000000 0.3904194 0.5891330 0.0030658 0.0000001 0.8718599
EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 0.0336245 0.0165512 0.0007724 0.0584711 NA 0.9618519 0.2062704 0.0000384 0.0000000 0.5657960 0.5691713 0.2044191 0.0003589 0.9269435
EHR_usage_time_spent_on_orders_risk_factor_feature_value 0.3668352 0.6896572 0.4377832 0.6274817 0.9618519 NA 0.7226779 0.7910855 0.2760202 0.2973172 0.8462953 0.3598444 0.8557360 0.0000000
EHR_usage_time_spent_on_notes_risk_factor_feature_value 0.9848568 0.0000000 0.0002107 0.0000000 0.2062704 0.7226779 NA 0.0085961 0.0000000 0.2126639 0.8449462 0.0000000 0.0000000 0.5134872
EHR_usage_time_spent_on_messaging_risk_factor_feature_value 0.7057807 0.0068509 0.0121625 0.0008925 0.0000384 0.7910855 0.0085961 NA 0.0000002 0.7129193 0.0112555 0.0813143 0.0017693 0.6780888
EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 0.2930203 0.0000000 0.0000000 0.0000000 0.0000000 0.2760202 0.0000000 0.0000002 NA 0.0235998 0.0878044 0.0000000 0.0000000 0.7112003
EHR_usage_time_spent_on_charging_risk_factor_feature_value 0.6619480 0.0078702 0.4653278 0.3904194 0.5657960 0.2973172 0.2126639 0.7129193 0.0235998 NA 0.8870565 0.2712985 0.3719469 0.8439370
EHR_usage_time_spent_on_assessment_risk_factor_feature_value 0.6762788 0.1443769 0.7650336 0.5891330 0.5691713 0.8462953 0.8449462 0.0112555 0.0878044 0.8870565 NA 0.9644198 0.0844630 0.8582029
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 0.6330046 0.0000000 0.0000153 0.0030658 0.2044191 0.3598444 0.0000000 0.0813143 0.0000000 0.2712985 0.9644198 NA 0.0000000 0.5680403
EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 0.9036621 0.0000000 0.0000000 0.0000001 0.0003589 0.8557360 0.0000000 0.0017693 0.0000000 0.3719469 0.0844630 0.0000000 NA 0.5244805
EHR_uncategorized_time_risk_factor_feature_value 0.6790555 0.8102191 0.8708724 0.8718599 0.9269435 0.0000000 0.5134872 0.6780888 0.7112003 0.8439370 0.8582029 0.5680403 0.5244805 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Ehr FEATURE Variables by Sustainable Engagement Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
sustainable_engage_category…1 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 1 4.637910e+00 4.6379099 0.0599569 0.8068312
Residuals …2 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 188 1.454257e+04 77.3541109 NA NA
sustainable_engage_category…3 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 1 3.856136e+01 38.5613588 1.1540143 0.2840872
Residuals …4 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 188 6.282015e+03 33.4149736 NA NA
sustainable_engage_category…5 EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 1 2.569249e-01 0.2569249 0.0148066 0.9032804
Residuals …6 EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 188 3.262178e+03 17.3520094 NA NA
sustainable_engage_category…7 EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 1 3.002750e+02 300.2749511 0.4003865 0.5276586
Residuals …8 EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 188 1.409930e+05 749.9626767 NA NA
sustainable_engage_category…9 EHR_usage_time_spent_on_orders_risk_factor_feature_value 1 2.652241e-01 0.2652241 0.2100661 0.6472450
Residuals …10 EHR_usage_time_spent_on_orders_risk_factor_feature_value 188 2.373640e+02 1.2625746 NA NA
sustainable_engage_category…11 EHR_usage_time_spent_on_notes_risk_factor_feature_value 1 2.219764e+00 2.2197638 0.8885588 0.3470779
Residuals …12 EHR_usage_time_spent_on_notes_risk_factor_feature_value 188 4.696544e+02 2.4981619 NA NA
sustainable_engage_category…13 EHR_usage_time_spent_on_messaging_risk_factor_feature_value 1 3.461000e-04 0.0003461 0.1290903 0.7197803
Residuals …14 EHR_usage_time_spent_on_messaging_risk_factor_feature_value 188 5.040011e-01 0.0026809 NA NA
sustainable_engage_category…15 EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 1 1.714224e+02 171.4224430 0.4637718 0.4967044
Residuals …16 EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 188 6.948982e+04 369.6267210 NA NA
sustainable_engage_category…17 EHR_usage_time_spent_on_charging_risk_factor_feature_value 1 6.517228e+00 6.5172283 0.1900751 0.6633543
Residuals …18 EHR_usage_time_spent_on_charging_risk_factor_feature_value 188 6.446077e+03 34.2876449 NA NA
sustainable_engage_category…19 EHR_usage_time_spent_on_assessment_risk_factor_feature_value 1 1.323363e-01 0.1323363 0.0359832 0.8497549
Residuals …20 EHR_usage_time_spent_on_assessment_risk_factor_feature_value 188 6.914128e+02 3.6777279 NA NA
sustainable_engage_category…21 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 1 8.714820e+00 8.7148200 2.2409576 0.1360747
Residuals …22 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 188 7.311099e+02 3.8888822 NA NA
sustainable_engage_category…23 EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 1 1.871625e-01 0.1871625 0.1383122 0.7103836
Residuals …24 EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 188 2.543995e+02 1.3531889 NA NA
sustainable_engage_category…25 EHR_uncategorized_time_risk_factor_feature_value 1 8.610000e-05 0.0000861 0.0767376 0.7820725
Residuals …26 EHR_uncategorized_time_risk_factor_feature_value 188 2.109629e-01 0.0011221 NA NA