Collaboration Descriptives

Data were aggregated by Department (final N=269 departments)

Descriptive Statistics for Collaboration
vars n mean sd median trimmed mad min max range skew kurtosis se
X1 1 269 1.975155 0.6773866 1.959259 1.921326 0.5546022 1 5 4 1.34914 3.882527 0.041301

Descriptive Statistics for Collaboration by Category
collaboration_category Count Mean SD
Favorable 247 1.838889 0.4775605
Neutral 18 3.191358 0.2381713
Unfavorable 4 4.916667 0.1666667
Descriptive Statistics for Collaboration by Percentile
collaboration_percentile Count Mean SD
Top 20% 53 1.156843 0.1675299
Middle 60% 162 1.911722 0.2509398
Bottom 20% 54 2.968609 0.6433544

Collaboration and Quit Probability

Correlation between Collaboration and Quit Probability
Correlation
-0.005107 
## `geom_smooth()` using formula = 'y ~ x'

ANOVA Results for Quit Probability by Collaboration Category
Df Sum Sq Mean Sq F value Pr(>F)
collaboration_category 2 0.0000141 7.10e-06 0.2024334 0.8168895
Residuals 225 0.0078570 3.49e-05 NA NA
Tukey’s HSD Post-hoc Results for Collaboration Category
Comparison Estimate Std_Error z_value p_value
Neutral - Favorable Neutral - Favorable -0.0008987 0.0015331 -0.5862188 0.8183336
Unfavorable - Favorable Unfavorable - Favorable 0.0006733 0.0029829 0.2257277 0.9706094
Unfavorable - Neutral Unfavorable - Neutral 0.0015721 0.0033034 0.4758906 0.8760703

ANOVA Results for Quit Probability by Collaboration Percentile
Df Sum Sq Mean Sq F value Pr(>F)
collaboration_percentile 2 0.0001444 7.22e-05 2.102872 0.1244987
Residuals 225 0.0077267 3.43e-05 NA NA
Tukey’s HSD Post-hoc Results for Collaboration Percentile
Comparison Estimate Std_Error z_value p_value
Middle 60% - Top 20% Middle 60% - Top 20% 0.0016360 0.0010354 1.5801011 0.2530751
Bottom 20% - Top 20% Bottom 20% - Top 20% 0.0000303 0.0012211 0.0248022 0.9996564
Bottom 20% - Middle 60% Bottom 20% - Middle 60% -0.0016057 0.0009632 -1.6670964 0.2171730

##Relationship between Collaboration and Scheduling Shaps

Correlation Matrix: Collaboration and Scheduling SHAP Variables
collaboration Unscheduled_Time_risk_factor_shap Scheduling_overlapping_appointments_risk_factor_shap Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap Scheduling_back_to_back_appointments_risk_factor_shap SchedulingWeekends_risk_factor_shap
collaboration 1.0000000 -0.0007647 0.1279896 0.0248179 -0.0378663 0.0898580 0.0674456 0.0387277
Unscheduled_Time_risk_factor_shap -0.0007647 1.0000000 0.1074331 0.1203767 0.0780532 0.0613317 0.0960513 -0.0179730
Scheduling_overlapping_appointments_risk_factor_shap 0.1279896 0.1074331 1.0000000 -0.1655393 -0.1191948 -0.4153116 0.2109286 0.0743987
Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 0.0248179 0.1203767 -0.1655393 1.0000000 0.1472663 0.6380386 -0.0603795 0.1498284
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap -0.0378663 0.0780532 -0.1191948 0.1472663 1.0000000 0.2968274 0.1307884 -0.0434544
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 0.0898580 0.0613317 -0.4153116 0.6380386 0.2968274 1.0000000 -0.1558050 0.0968575
Scheduling_back_to_back_appointments_risk_factor_shap 0.0674456 0.0960513 0.2109286 -0.0603795 0.1307884 -0.1558050 1.0000000 -0.0204519
SchedulingWeekends_risk_factor_shap 0.0387277 -0.0179730 0.0743987 0.1498284 -0.0434544 0.0968575 -0.0204519 1.0000000
P-values for the Correlations
collaboration Unscheduled_Time_risk_factor_shap Scheduling_overlapping_appointments_risk_factor_shap Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap Scheduling_back_to_back_appointments_risk_factor_shap SchedulingWeekends_risk_factor_shap
collaboration NA 0.9913397 0.0681015 0.7149432 0.5772797 0.1852216 0.3378168 0.5918691
Unscheduled_Time_risk_factor_shap 0.9913397 NA 0.1261524 0.0863451 0.2671430 0.3835198 0.1717447 0.8086599
Scheduling_overlapping_appointments_risk_factor_shap 0.0681015 0.1261524 NA 0.0179720 0.0895004 0.0000000 0.0024594 0.3155196
Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 0.7149432 0.0863451 0.0179720 NA 0.0293493 0.0000000 0.3909610 0.0370542
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 0.5772797 0.2671430 0.0895004 0.0293493 NA 0.0000079 0.0622417 0.5474255
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 0.1852216 0.3835198 0.0000000 0.0000000 0.0000079 NA 0.0260629 0.1791063
Scheduling_back_to_back_appointments_risk_factor_shap 0.3378168 0.1717447 0.0024594 0.3909610 0.0622417 0.0260629 NA 0.7828853
SchedulingWeekends_risk_factor_shap 0.5918691 0.8086599 0.3155196 0.0370542 0.5474255 0.1791063 0.7828853 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Scheduling SHAP Variables by Collaboration Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
collaboration_category…1 Unscheduled_Time_risk_factor_shap 2 0.0114527 0.0057264 1.9190486 0.1494256
Residuals …2 Unscheduled_Time_risk_factor_shap 201 0.5997755 0.0029840 NA NA
collaboration_category…3 Scheduling_overlapping_appointments_risk_factor_shap 2 0.0403274 0.0201637 1.7925147 0.1691928
Residuals …4 Scheduling_overlapping_appointments_risk_factor_shap 201 2.2610136 0.0112488 NA NA
collaboration_category…5 Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 2 0.0020960 0.0010480 0.1892321 0.8277314
Residuals …6 Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 216 1.1962490 0.0055382 NA NA
collaboration_category…7 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 2 0.0004495 0.0002247 3.4686638 0.0329051
Residuals …8 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 216 0.0139953 0.0000648 NA NA
collaboration_category…9 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 2 0.0092598 0.0046299 1.0379097 0.3559539
Residuals …10 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 216 0.9635352 0.0044608 NA NA
collaboration_category…11 Scheduling_back_to_back_appointments_risk_factor_shap 2 0.0018257 0.0009129 1.5696219 0.2106640
Residuals …12 Scheduling_back_to_back_appointments_risk_factor_shap 201 0.1168966 0.0005816 NA NA
collaboration_category…13 SchedulingWeekends_risk_factor_shap 2 0.0103961 0.0051981 0.5048141 0.6044208
Residuals …14 SchedulingWeekends_risk_factor_shap 191 1.9667260 0.0102970 NA NA

##Relationship between Collaboration and Workload Shaps

Encounter_Duration_risk_factor_shap

Clinical_Workload_RVU_risk_factor_shap

Clinical_Workload_Procedure_Type_risk_factor_shap

Clinical_Workload_Procedure_Count_risk_factor_shap”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap

“Nonpatient_contact_time_risk_factor_shap

##Relationship between Collaboration and Workload Shaps

Encounter_Duration_risk_factor_shap

Clinical_Workload_RVU_risk_factor_shap

Clinical_Workload_Procedure_Type_risk_factor_shap

Clinical_Workload_Procedure_Count_risk_factor_shap”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap

“Nonpatient_contact_time_risk_factor_shap

“Clinical_Workload_Encounter_count_risk_factor_shap”

Correlation Matrix: Collaboration and Workload SHAP Variables
collaboration Encounter_Duration_risk_factor_shap Clinical_Workload_RVU_risk_factor_shap Clinical_Workload_Procedure_Type_risk_factor_shap Clinical_Workload_Procedure_Count_risk_factor_shap Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap Clinical_Workload_Encounter_count_risk_factor_shap Nonpatient_contact_time_risk_factor_shap
collaboration 1.0000000 0.0681392 -0.0217577 0.1751188 0.1453893 0.0281343 0.0270128 0.0097463 0.0349077
Encounter_Duration_risk_factor_shap 0.0681392 1.0000000 -0.2262257 -0.0446032 -0.2084849 0.1380264 0.1550642 0.2730183 -0.2203552
Clinical_Workload_RVU_risk_factor_shap -0.0217577 -0.2262257 1.0000000 0.0800352 0.5795920 0.0809919 0.0589783 -0.2399206 0.3581040
Clinical_Workload_Procedure_Type_risk_factor_shap 0.1751188 -0.0446032 0.0800352 1.0000000 0.0416841 0.2444559 0.0595537 0.1101940 -0.1025363
Clinical_Workload_Procedure_Count_risk_factor_shap 0.1453893 -0.2084849 0.5795920 0.0416841 1.0000000 0.1053561 0.0178292 -0.2028889 0.2165978
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 0.0281343 0.1380264 0.0809919 0.2444559 0.1053561 1.0000000 -0.0176133 0.3770314 -0.2855978
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 0.0270128 0.1550642 0.0589783 0.0595537 0.0178292 -0.0176133 1.0000000 0.0402679 0.1507316
Clinical_Workload_Encounter_count_risk_factor_shap 0.0097463 0.2730183 -0.2399206 0.1101940 -0.2028889 0.3770314 0.0402679 1.0000000 -0.4980576
Nonpatient_contact_time_risk_factor_shap 0.0349077 -0.2203552 0.3581040 -0.1025363 0.2165978 -0.2855978 0.1507316 -0.4980576 1.0000000
P-values for the Correlations
collaboration Encounter_Duration_risk_factor_shap Clinical_Workload_RVU_risk_factor_shap Clinical_Workload_Procedure_Type_risk_factor_shap Clinical_Workload_Procedure_Count_risk_factor_shap Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap Clinical_Workload_Encounter_count_risk_factor_shap Nonpatient_contact_time_risk_factor_shap
collaboration NA 0.3414016 0.7493930 0.0095757 0.0318953 0.6788382 0.7034600 0.8862281 0.6201276
Encounter_Duration_risk_factor_shap 0.3414016 NA 0.0013907 0.5337042 0.0032823 0.0530845 0.0295734 0.0001038 0.0018615
Clinical_Workload_RVU_risk_factor_shap 0.7493930 0.0013907 NA 0.2392750 0.0000000 0.2336874 0.4067796 0.0003624 0.0000002
Clinical_Workload_Procedure_Type_risk_factor_shap 0.0095757 0.5337042 0.2392750 NA 0.5404144 0.0002684 0.4022096 0.1054866 0.1454655
Clinical_Workload_Procedure_Count_risk_factor_shap 0.0318953 0.0032823 0.0000000 0.5404144 NA 0.1209160 0.8021371 0.0026753 0.0019098
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 0.6788382 0.0530845 0.2336874 0.0002684 0.1209160 NA 0.8040003 0.0000000 0.0000346
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 0.7034600 0.0295734 0.4067796 0.4022096 0.8021371 0.8040003 NA 0.5703301 0.0326892
Clinical_Workload_Encounter_count_risk_factor_shap 0.8862281 0.0001038 0.0003624 0.1054866 0.0026753 0.0000000 0.5703301 NA 0.0000000
Nonpatient_contact_time_risk_factor_shap 0.6201276 0.0018615 0.0000002 0.1454655 0.0019098 0.0000346 0.0326892 0.0000000 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Workload SHAP Variables by Collaboration Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
collaboration_category…1 Encounter_Duration_risk_factor_shap 2 0.0060717 0.0030358 0.3261170 0.7221156
Residuals …2 Encounter_Duration_risk_factor_shap 194 1.8059536 0.0093090 NA NA
collaboration_category…3 Clinical_Workload_RVU_risk_factor_shap 2 0.0120469 0.0060235 0.5600425 0.5720158
Residuals …4 Clinical_Workload_RVU_risk_factor_shap 215 2.3123992 0.0107553 NA NA
collaboration_category…5 Clinical_Workload_Procedure_Type_risk_factor_shap 2 0.0110838 0.0055419 1.4300791 0.2415569
Residuals …6 Clinical_Workload_Procedure_Type_risk_factor_shap 215 0.8331731 0.0038752 NA NA
collaboration_category…7 Clinical_Workload_Procedure_Count_risk_factor_shap 2 0.0157273 0.0078637 2.6470924 0.0731658
Residuals …8 Clinical_Workload_Procedure_Count_risk_factor_shap 215 0.6386967 0.0029707 NA NA
collaboration_category…9 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 2 0.0031443 0.0015722 1.6523637 0.1940090
Residuals …10 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 216 0.2055152 0.0009515 NA NA
collaboration_category…11 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 2 0.0023803 0.0011902 0.4419907 0.6433882
Residuals …12 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 198 0.5331597 0.0026927 NA NA
collaboration_category…13 Clinical_Workload_Encounter_count_risk_factor_shap 2 0.0042372 0.0021186 0.2551148 0.7750618
Residuals …14 Clinical_Workload_Encounter_count_risk_factor_shap 215 1.7854464 0.0083044 NA NA
collaboration_category…15 Nonpatient_contact_time_risk_factor_shap 2 0.0609056 0.0304528 1.7255697 0.1806989
Residuals …16 Nonpatient_contact_time_risk_factor_shap 201 3.5472408 0.0176480 NA NA

##Relationship between Collaboration and Ehr Shaps

EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_patient_history_risk_factor_shap”,

“EHR_usage_time_spent_on_patient_education_risk_factor_shap”,

“EHR_usage_time_spent_on_orders_risk_factor_shap”,

“EHR_usage_time_spent_on_notes_risk_factor_shap”,

“EHR_usage_time_spent_on_messaging_risk_factor_shap”,

“EHR_usage_time_spent_on_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_charging_risk_factor_shap”,

“EHR_usage_time_spent_on_assessment_risk_factor_shap”,

“EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap”,

“EHR_usage_time_spent_on_administrative_processes_risk_factor_shap”,

“EHR_uncategorized_time_risk_factor_shap” )

Correlation Matrix: Collaboration and Ehr SHAP Variables
collaboration EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_patient_history_risk_factor_shap EHR_usage_time_spent_on_patient_education_risk_factor_shap EHR_usage_time_spent_on_orders_risk_factor_shap EHR_usage_time_spent_on_notes_risk_factor_shap EHR_usage_time_spent_on_messaging_risk_factor_shap EHR_usage_time_spent_on_EHR_system_risk_factor_shap EHR_usage_time_spent_on_charging_risk_factor_shap EHR_usage_time_spent_on_assessment_risk_factor_shap EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap EHR_usage_time_spent_on_administrative_processes_risk_factor_shap EHR_uncategorized_time_risk_factor_shap
collaboration 1.0000000 0.0294397 0.0934971 0.0870612 0.0138819 -0.0717506 -0.0478786 -0.0138519 0.0069591 -0.0791158 -0.0026896 0.1436855 0.0710490 -0.0769377
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 0.0294397 1.0000000 0.4625391 0.3935647 0.3936631 0.0127669 0.4791951 0.0681449 0.7803844 0.2866464 0.3693576 -0.4094449 0.6996216 0.0985913
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 0.0934971 0.4625391 1.0000000 0.5524408 0.2875210 0.0456950 0.3675777 -0.0364662 0.5467299 0.2346365 0.3206382 -0.3139356 0.6583274 0.1774795
EHR_usage_time_spent_on_patient_history_risk_factor_shap 0.0870612 0.3935647 0.5524408 1.0000000 0.1080566 0.0133008 0.2421737 -0.0005768 0.4133753 0.1490189 0.3183151 -0.2257065 0.4830547 0.1880824
EHR_usage_time_spent_on_patient_education_risk_factor_shap 0.0138819 0.3936631 0.2875210 0.1080566 1.0000000 0.1352755 0.3408316 -0.1021671 0.4900959 0.1682598 0.2923523 -0.3348235 0.4988600 0.0186822
EHR_usage_time_spent_on_orders_risk_factor_shap -0.0717506 0.0127669 0.0456950 0.0133008 0.1352755 1.0000000 -0.0263452 -0.0695341 0.1039823 -0.0442113 0.0135692 -0.0741403 0.0139322 0.0810434
EHR_usage_time_spent_on_notes_risk_factor_shap -0.0478786 0.4791951 0.3675777 0.2421737 0.3408316 -0.0263452 1.0000000 0.0642468 0.5635219 0.2766452 0.2532913 -0.4678691 0.5000973 0.0184974
EHR_usage_time_spent_on_messaging_risk_factor_shap -0.0138519 0.0681449 -0.0364662 -0.0005768 -0.1021671 -0.0695341 0.0642468 1.0000000 0.0506593 0.1245726 0.0011789 -0.1052265 -0.0782965 0.0039928
EHR_usage_time_spent_on_EHR_system_risk_factor_shap 0.0069591 0.7803844 0.5467299 0.4133753 0.4900959 0.1039823 0.5635219 0.0506593 1.0000000 0.3715501 0.3687570 -0.4470924 0.7563752 0.0920523
EHR_usage_time_spent_on_charging_risk_factor_shap -0.0791158 0.2866464 0.2346365 0.1490189 0.1682598 -0.0442113 0.2766452 0.1245726 0.3715501 1.0000000 0.0502955 -0.1996492 0.2853860 0.0517544
EHR_usage_time_spent_on_assessment_risk_factor_shap -0.0026896 0.3693576 0.3206382 0.3183151 0.2923523 0.0135692 0.2532913 0.0011789 0.3687570 0.0502955 1.0000000 -0.2501693 0.4996607 0.0693299
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 0.1436855 -0.4094449 -0.3139356 -0.2257065 -0.3348235 -0.0741403 -0.4678691 -0.1052265 -0.4470924 -0.1996492 -0.2501693 1.0000000 -0.5065934 -0.0807939
EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 0.0710490 0.6996216 0.6583274 0.4830547 0.4988600 0.0139322 0.5000973 -0.0782965 0.7563752 0.2853860 0.4996607 -0.5065934 1.0000000 0.1356093
EHR_uncategorized_time_risk_factor_shap -0.0769377 0.0985913 0.1774795 0.1880824 0.0186822 0.0810434 0.0184974 0.0039928 0.0920523 0.0517544 0.0693299 -0.0807939 0.1356093 1.0000000
P-values for the Correlations
collaboration EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_patient_history_risk_factor_shap EHR_usage_time_spent_on_patient_education_risk_factor_shap EHR_usage_time_spent_on_orders_risk_factor_shap EHR_usage_time_spent_on_notes_risk_factor_shap EHR_usage_time_spent_on_messaging_risk_factor_shap EHR_usage_time_spent_on_EHR_system_risk_factor_shap EHR_usage_time_spent_on_charging_risk_factor_shap EHR_usage_time_spent_on_assessment_risk_factor_shap EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap EHR_usage_time_spent_on_administrative_processes_risk_factor_shap EHR_uncategorized_time_risk_factor_shap
collaboration NA 0.6612105 0.1631475 0.1942225 0.8363124 0.2849634 0.4758578 0.8366615 0.9175089 0.2382701 0.9680701 0.0315851 0.2897119 0.2514823
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 0.6612105 NA 0.0000000 0.0000000 0.0000000 0.8492967 0.0000000 0.3099278 0.0000000 0.0000131 0.0000000 0.0000000 0.0000000 0.1413156
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 0.1631475 0.0000000 NA 0.0000000 0.0000123 0.4962322 0.0000000 0.5871960 0.0000000 0.0003976 0.0000009 0.0000016 0.0000000 0.0077544
EHR_usage_time_spent_on_patient_history_risk_factor_shap 0.1942225 0.0000000 0.0000000 NA 0.1067615 0.8430736 0.0002533 0.9931510 0.0000000 0.0257275 0.0000011 0.0006660 0.0000000 0.0047360
EHR_usage_time_spent_on_patient_education_risk_factor_shap 0.8363124 0.0000000 0.0000123 0.1067615 NA 0.0431147 0.0000002 0.1273754 0.0000000 0.0116623 0.0000086 0.0000003 0.0000000 0.7809591
EHR_usage_time_spent_on_orders_risk_factor_shap 0.2849634 0.8492967 0.4962322 0.8430736 0.0431147 NA 0.6949397 0.3001447 0.1207180 0.5103358 0.8399496 0.2691841 0.8357271 0.2269898
EHR_usage_time_spent_on_notes_risk_factor_shap 0.4758578 0.0000000 0.0000000 0.0002533 0.0000002 0.6949397 NA 0.3384825 0.0000000 0.0000267 0.0001269 0.0000000 0.0000000 0.7830711
EHR_usage_time_spent_on_messaging_risk_factor_shap 0.8366615 0.3099278 0.5871960 0.9931510 0.1273754 0.3001447 0.3384825 NA 0.4505838 0.0627078 0.9860019 0.1163133 0.2431815 0.9526135
EHR_usage_time_spent_on_EHR_system_risk_factor_shap 0.9175089 0.0000000 0.0000000 0.0000000 0.0000000 0.1207180 0.0000000 0.4505838 NA 0.0000000 0.0000000 0.0000000 0.0000000 0.1697766
EHR_usage_time_spent_on_charging_risk_factor_shap 0.2382701 0.0000131 0.0003976 0.0257275 0.0116623 0.5103358 0.0000267 0.0627078 0.0000000 NA 0.4538472 0.0026853 0.0000144 0.4408424
EHR_usage_time_spent_on_assessment_risk_factor_shap 0.9680701 0.0000000 0.0000009 0.0000011 0.0000086 0.8399496 0.0001269 0.9860019 0.0000000 0.4538472 NA 0.0001546 0.0000000 0.3015694
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 0.0315851 0.0000000 0.0000016 0.0006660 0.0000003 0.2691841 0.0000000 0.1163133 0.0000000 0.0026853 0.0001546 NA 0.0000000 0.2284282
EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 0.2897119 0.0000000 0.0000000 0.0000000 0.0000000 0.8357271 0.0000000 0.2431815 0.0000000 0.0000144 0.0000000 0.0000000 NA 0.0425975
EHR_uncategorized_time_risk_factor_shap 0.2514823 0.1413156 0.0077544 0.0047360 0.7809591 0.2269898 0.7830711 0.9526135 0.1697766 0.4408424 0.3015694 0.2284282 0.0425975 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Ehr SHAP Variables by Collaboration Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
collaboration_category…1 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 2 0.0273355 0.0136677 1.0845100 0.3398596
Residuals …2 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 221 2.7851915 0.0126027 NA NA
collaboration_category…3 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 2 0.0189186 0.0094593 0.7663215 0.4659502
Residuals …4 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 221 2.7279784 0.0123438 NA NA
collaboration_category…5 EHR_usage_time_spent_on_patient_history_risk_factor_shap 2 0.0143226 0.0071613 0.8495005 0.4290200
Residuals …6 EHR_usage_time_spent_on_patient_history_risk_factor_shap 221 1.8630330 0.0084300 NA NA
collaboration_category…7 EHR_usage_time_spent_on_patient_education_risk_factor_shap 2 0.0035411 0.0017706 0.3139341 0.7308924
Residuals …8 EHR_usage_time_spent_on_patient_education_risk_factor_shap 221 1.2464173 0.0056399 NA NA
collaboration_category…9 EHR_usage_time_spent_on_orders_risk_factor_shap 2 0.0253172 0.0126586 1.9327265 0.1471918
Residuals …10 EHR_usage_time_spent_on_orders_risk_factor_shap 221 1.4474652 0.0065496 NA NA
collaboration_category…11 EHR_usage_time_spent_on_notes_risk_factor_shap 2 0.0000819 0.0000409 0.0055896 0.9944261
Residuals …12 EHR_usage_time_spent_on_notes_risk_factor_shap 221 1.6184716 0.0073234 NA NA
collaboration_category…13 EHR_usage_time_spent_on_messaging_risk_factor_shap 2 0.0098298 0.0049149 2.2146429 0.1116103
Residuals …14 EHR_usage_time_spent_on_messaging_risk_factor_shap 221 0.4904591 0.0022193 NA NA
collaboration_category…15 EHR_usage_time_spent_on_EHR_system_risk_factor_shap 2 0.0640135 0.0320067 0.8913308 0.4115786
Residuals …16 EHR_usage_time_spent_on_EHR_system_risk_factor_shap 221 7.9358763 0.0359089 NA NA
collaboration_category…17 EHR_usage_time_spent_on_charging_risk_factor_shap 2 0.0485656 0.0242828 1.3036983 0.2736056
Residuals …18 EHR_usage_time_spent_on_charging_risk_factor_shap 221 4.1163627 0.0186261 NA NA
collaboration_category…19 EHR_usage_time_spent_on_assessment_risk_factor_shap 2 0.0052294 0.0026147 1.0783561 0.3419371
Residuals …20 EHR_usage_time_spent_on_assessment_risk_factor_shap 221 0.5358617 0.0024247 NA NA
collaboration_category…21 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 2 0.0662398 0.0331199 2.6363381 0.0738750
Residuals …22 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 221 2.7763871 0.0125628 NA NA
collaboration_category…23 EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 2 0.2032246 0.1016123 1.8340012 0.1621963
Residuals …24 EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 221 12.2444400 0.0554047 NA NA
collaboration_category…25 EHR_uncategorized_time_risk_factor_shap 2 0.0000958 0.0000479 1.1218706 0.3275175
Residuals …26 EHR_uncategorized_time_risk_factor_shap 221 0.0094317 0.0000427 NA NA

##Relationship between Collaboration and Scheduling Features

Correlation Matrix: Collaboration and Scheduling FEATURE Variables
collaboration Unscheduled_Time_risk_factor_feature_value Scheduling_overlapping_appointments_risk_factor_feature_value Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value Scheduling_back_to_back_appointments_risk_factor_feature_value SchedulingWeekends_risk_factor_feature_value
collaboration 1.0000000 0.0388488 -0.1138645 0.0120932 -0.0770585 0.0868994 0.0040830 -0.0261426
Unscheduled_Time_risk_factor_feature_value 0.0388488 1.0000000 -0.0573554 -0.0892838 -0.0063455 0.1238255 0.0769870 -0.1136307
Scheduling_overlapping_appointments_risk_factor_feature_value -0.1138645 -0.0573554 1.0000000 -0.3596856 0.1347903 0.3324081 0.3666426 0.0226906
Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 0.0120932 -0.0892838 -0.3596856 1.0000000 -0.0073217 0.1566051 0.0715954 -0.0773370
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value -0.0770585 -0.0063455 0.1347903 -0.0073217 1.0000000 -0.0071389 0.0363418 0.2210164
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 0.0868994 0.1238255 0.3324081 0.1566051 -0.0071389 1.0000000 0.8187556 -0.2911901
Scheduling_back_to_back_appointments_risk_factor_feature_value 0.0040830 0.0769870 0.3666426 0.0715954 0.0363418 0.8187556 1.0000000 -0.3121378
SchedulingWeekends_risk_factor_feature_value -0.0261426 -0.1136307 0.0226906 -0.0773370 0.2210164 -0.2911901 -0.3121378 1.0000000
P-values for the Correlations
collaboration Unscheduled_Time_risk_factor_feature_value Scheduling_overlapping_appointments_risk_factor_feature_value Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value Scheduling_back_to_back_appointments_risk_factor_feature_value SchedulingWeekends_risk_factor_feature_value
collaboration NA 0.5811737 0.1048901 0.8587664 0.2561557 0.2001732 0.9537813 0.7174769
Unscheduled_Time_risk_factor_feature_value 0.5811737 NA 0.4151659 0.2041098 0.9282273 0.0776459 0.2737519 0.1245786
Scheduling_overlapping_appointments_risk_factor_feature_value 0.1048901 0.4151659 NA 0.0000001 0.0545879 0.0000012 0.0000001 0.7598090
Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 0.8587664 0.2041098 0.0000001 NA 0.9142077 0.0204164 0.3088633 0.2837987
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 0.2561557 0.9282273 0.0545879 0.9142077 NA 0.9163422 0.6058230 0.0019556
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 0.2001732 0.0776459 0.0000012 0.0204164 0.9163422 NA 0.0000000 0.0000380
Scheduling_back_to_back_appointments_risk_factor_feature_value 0.9537813 0.2737519 0.0000001 0.3088633 0.6058230 0.0000000 NA 0.0000161
SchedulingWeekends_risk_factor_feature_value 0.7174769 0.1245786 0.7598090 0.2837987 0.0019556 0.0000380 0.0000161 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Scheduling FEATURE Variables by Collaboration Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
collaboration_category…1 Unscheduled_Time_risk_factor_feature_value 2 8.924350e-01 4.462175e-01 0.0798479 0.9232860
Residuals …2 Unscheduled_Time_risk_factor_feature_value 201 1.123257e+03 5.588343e+00 NA NA
collaboration_category…3 Scheduling_overlapping_appointments_risk_factor_feature_value 2 1.346965e+03 6.734826e+02 1.2881922 0.2780356
Residuals …4 Scheduling_overlapping_appointments_risk_factor_feature_value 201 1.050853e+05 5.228122e+02 NA NA
collaboration_category…5 Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 2 9.956400e-03 4.978200e-03 0.3822829 0.6827627
Residuals …6 Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 216 2.812811e+00 1.302230e-02 NA NA
collaboration_category…7 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 2 5.899450e+01 2.949725e+01 0.2370986 0.7891185
Residuals …8 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 216 2.687239e+04 1.244092e+02 NA NA
collaboration_category…9 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 2 4.218739e+06 2.109370e+06 1.1024138 0.3339295
Residuals …10 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 216 4.132966e+08 1.913410e+06 NA NA
collaboration_category…11 Scheduling_back_to_back_appointments_risk_factor_feature_value 2 5.992359e+04 2.996180e+04 0.5752702 0.5634763
Residuals …12 Scheduling_back_to_back_appointments_risk_factor_feature_value 201 1.046868e+07 5.208299e+04 NA NA
collaboration_category…13 SchedulingWeekends_risk_factor_feature_value 2 6.560785e+03 3.280392e+03 0.3685173 0.6922500
Residuals …14 SchedulingWeekends_risk_factor_feature_value 191 1.700205e+06 8.901597e+03 NA NA

##Relationship between Collaboration and Workload Features

Encounter_Duration_risk_factor_feature_value

Clinical_Workload_RVU_risk_factor_feature_value

Clinical_Workload_Procedure_Type_risk_factor_feature_value

Clinical_Workload_Procedure_Count_risk_factor_feature_value”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value

“Nonpatient_contact_time_risk_factor_feature_value

“Clinical_Workload_Encounter_count_risk_factor_feature_value”

Correlation Matrix: Collaboration and Workload FEATURE Variables
collaboration Encounter_Duration_risk_factor_feature_value Clinical_Workload_RVU_risk_factor_feature_value Clinical_Workload_Procedure_Type_risk_factor_feature_value Clinical_Workload_Procedure_Count_risk_factor_feature_value Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value Clinical_Workload_Encounter_count_risk_factor_feature_value Nonpatient_contact_time_risk_factor_feature_value
collaboration 1.0000000 -0.0548966 0.1534724 0.2513774 0.1136949 0.0087376 0.0157158 0.0667911 -0.0207512
Encounter_Duration_risk_factor_feature_value -0.0548966 1.0000000 -0.0907257 -0.0018126 -0.1102129 -0.0564773 0.2571414 -0.0702778 -0.0337045
Clinical_Workload_RVU_risk_factor_feature_value 0.1534724 -0.0907257 1.0000000 0.6336461 0.8829654 0.5771087 0.0119758 0.5452412 0.5751453
Clinical_Workload_Procedure_Type_risk_factor_feature_value 0.2513774 -0.0018126 0.6336461 1.0000000 0.5157007 0.5627637 -0.0891127 0.5484507 0.4725423
Clinical_Workload_Procedure_Count_risk_factor_feature_value 0.1136949 -0.1102129 0.8829654 0.5157007 1.0000000 0.5039168 0.0939605 0.4616627 0.6085621
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 0.0087376 -0.0564773 0.5771087 0.5627637 0.5039168 1.0000000 0.1190617 0.8678634 0.8993081
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 0.0157158 0.2571414 0.0119758 -0.0891127 0.0939605 0.1190617 1.0000000 0.0685954 0.0983374
Clinical_Workload_Encounter_count_risk_factor_feature_value 0.0667911 -0.0702778 0.5452412 0.5484507 0.4616627 0.8678634 0.0685954 1.0000000 0.8541545
Nonpatient_contact_time_risk_factor_feature_value -0.0207512 -0.0337045 0.5751453 0.4725423 0.6085621 0.8993081 0.0983374 0.8541545 1.0000000
P-values for the Correlations
collaboration Encounter_Duration_risk_factor_feature_value Clinical_Workload_RVU_risk_factor_feature_value Clinical_Workload_Procedure_Type_risk_factor_feature_value Clinical_Workload_Procedure_Count_risk_factor_feature_value Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value Clinical_Workload_Encounter_count_risk_factor_feature_value Nonpatient_contact_time_risk_factor_feature_value
collaboration NA 0.4435665 0.0234263 0.0001764 0.0940385 0.8977006 0.8247548 0.3263038 0.7683019
Encounter_Duration_risk_factor_feature_value 0.4435665 NA 0.2048307 0.9798325 0.1231299 0.4305324 0.0002646 0.3264284 0.6382202
Clinical_Workload_RVU_risk_factor_feature_value 0.0234263 0.2048307 NA 0.0000000 0.0000000 0.0000000 0.8663408 0.0000000 0.0000000
Clinical_Workload_Procedure_Type_risk_factor_feature_value 0.0001764 0.9798325 0.0000000 NA 0.0000000 0.0000000 0.2095358 0.0000000 0.0000000
Clinical_Workload_Procedure_Count_risk_factor_feature_value 0.0940385 0.1231299 0.0000000 0.0000000 NA 0.0000000 0.1857015 0.0000000 0.0000000
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 0.8977006 0.4305324 0.0000000 0.0000000 0.0000000 NA 0.0922867 0.0000000 0.0000000
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 0.8247548 0.0002646 0.8663408 0.2095358 0.1857015 0.0922867 NA 0.3332526 0.1648795
Clinical_Workload_Encounter_count_risk_factor_feature_value 0.3263038 0.3264284 0.0000000 0.0000000 0.0000000 0.0000000 0.3332526 NA 0.0000000
Nonpatient_contact_time_risk_factor_feature_value 0.7683019 0.6382202 0.0000000 0.0000000 0.0000000 0.0000000 0.1648795 0.0000000 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Workload FEATURE Variables by Collaboration Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
collaboration_category…1 Encounter_Duration_risk_factor_feature_value 2 3.277365e+02 1.638682e+02 0.1429073 0.8669256
Residuals …2 Encounter_Duration_risk_factor_feature_value 194 2.224550e+05 1.146675e+03 NA NA
collaboration_category…3 Clinical_Workload_RVU_risk_factor_feature_value 2 1.877427e+04 9.387133e+03 0.1517576 0.8592885
Residuals …4 Clinical_Workload_RVU_risk_factor_feature_value 215 1.329906e+07 6.185609e+04 NA NA
collaboration_category…5 Clinical_Workload_Procedure_Type_risk_factor_feature_value 2 2.306084e+03 1.153042e+03 1.2037031 0.3020949
Residuals …6 Clinical_Workload_Procedure_Type_risk_factor_feature_value 215 2.059512e+05 9.579124e+02 NA NA
collaboration_category…7 Clinical_Workload_Procedure_Count_risk_factor_feature_value 2 7.303367e+04 3.651684e+04 0.1441658 0.8658278
Residuals …8 Clinical_Workload_Procedure_Count_risk_factor_feature_value 215 5.445896e+07 2.532975e+05 NA NA
collaboration_category…9 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 2 5.509820e+05 2.754910e+05 0.6985786 0.4984116
Residuals …10 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 216 8.518162e+07 3.943593e+05 NA NA
collaboration_category…11 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 2 1.879008e+00 9.395039e-01 0.3076131 0.7355505
Residuals …12 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 198 6.047265e+02 3.054174e+00 NA NA
collaboration_category…13 Clinical_Workload_Encounter_count_risk_factor_feature_value 2 5.608927e+06 2.804464e+06 1.0430614 0.3541504
Residuals …14 Clinical_Workload_Encounter_count_risk_factor_feature_value 215 5.780673e+08 2.688685e+06 NA NA
collaboration_category…15 Nonpatient_contact_time_risk_factor_feature_value 2 1.026161e+05 5.130806e+04 0.8270059 0.4388394
Residuals …16 Nonpatient_contact_time_risk_factor_feature_value 201 1.247019e+07 6.204074e+04 NA NA

##Relationship between Collaboration and Ehr Features

EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_patient_history_risk_factor_feature_value”,

“EHR_usage_time_spent_on_patient_education_risk_factor_feature_value”,

“EHR_usage_time_spent_on_orders_risk_factor_feature_value”,

“EHR_usage_time_spent_on_notes_risk_factor_feature_value”,

“EHR_usage_time_spent_on_messaging_risk_factor_feature_value”,

“EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_charging_risk_factor_feature_value”,

“EHR_usage_time_spent_on_assessment_risk_factor_feature_value”,

“EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value”,

“EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value”,

“EHR_uncategorized_time_risk_factor_feature_value” )

Correlation Matrix: Collaboration and Ehr FEATURE Variables
collaboration EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_patient_history_risk_factor_feature_value EHR_usage_time_spent_on_patient_education_risk_factor_feature_value EHR_usage_time_spent_on_orders_risk_factor_feature_value EHR_usage_time_spent_on_notes_risk_factor_feature_value EHR_usage_time_spent_on_messaging_risk_factor_feature_value EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_charging_risk_factor_feature_value EHR_usage_time_spent_on_assessment_risk_factor_feature_value EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value EHR_uncategorized_time_risk_factor_feature_value
collaboration 1.0000000 -0.0150155 -0.0797494 -0.0804358 0.0280737 0.0653532 0.0991963 -0.0420605 0.0179195 0.0002723 0.0082891 0.1076139 -0.0189883 -0.0678417
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value -0.0150155 1.0000000 0.2955489 0.3723345 0.1599872 0.0268260 0.4117812 0.1801960 0.7616065 0.1771519 0.0978425 0.4026231 0.3718345 -0.0161345
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value -0.0797494 0.2955489 1.0000000 0.3205523 0.2230759 -0.0521011 0.2451910 0.1672860 0.4518141 -0.0490269 -0.0200799 0.2844927 0.4313724 -0.0109216
EHR_usage_time_spent_on_patient_history_risk_factor_feature_value -0.0804358 0.3723345 0.3205523 1.0000000 0.1266236 -0.0325975 0.3838695 0.2204826 0.3932471 0.0576596 -0.0362776 0.1970041 0.3480255 -0.0108374
EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 0.0280737 0.1599872 0.2230759 0.1266236 1.0000000 0.0032137 0.0847692 0.2714108 0.6727675 -0.0385705 0.0382361 0.0851150 0.2363722 -0.0061608
EHR_usage_time_spent_on_orders_risk_factor_feature_value 0.0653532 0.0268260 -0.0521011 -0.0325975 0.0032137 1.0000000 -0.0238416 -0.0177976 0.0730937 0.0699412 -0.0130243 -0.0614662 -0.0122152 0.5652791
EHR_usage_time_spent_on_notes_risk_factor_feature_value 0.0991963 0.4117812 0.2451910 0.3838695 0.0847692 -0.0238416 1.0000000 0.1751917 0.5249399 -0.0835920 -0.0131401 0.8298625 0.4328561 -0.0438828
EHR_usage_time_spent_on_messaging_risk_factor_feature_value -0.0420605 0.1801960 0.1672860 0.2204826 0.2714108 -0.0177976 0.1751917 1.0000000 0.3370017 -0.0247184 0.1690793 0.1167211 0.2077730 -0.0278838
EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 0.0179195 0.7616065 0.4518141 0.3932471 0.6727675 0.0730937 0.5249399 0.3370017 1.0000000 0.1512172 0.1143254 0.5293828 0.5519003 0.0248733
EHR_usage_time_spent_on_charging_risk_factor_feature_value 0.0002723 0.1771519 -0.0490269 0.0576596 -0.0385705 0.0699412 -0.0835920 -0.0247184 0.1512172 1.0000000 -0.0095429 -0.0738147 -0.0599366 0.0132267
EHR_usage_time_spent_on_assessment_risk_factor_feature_value 0.0082891 0.0978425 -0.0200799 -0.0362776 0.0382361 -0.0130243 -0.0131401 0.1690793 0.1143254 -0.0095429 1.0000000 0.0029973 0.1155403 -0.0120041
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 0.1076139 0.4026231 0.2844927 0.1970041 0.0851150 -0.0614662 0.8298625 0.1167211 0.5293828 -0.0738147 0.0029973 1.0000000 0.5063808 -0.0383480
EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value -0.0189883 0.3718345 0.4313724 0.3480255 0.2363722 -0.0122152 0.4328561 0.2077730 0.5519003 -0.0599366 0.1155403 0.5063808 1.0000000 0.0427446
EHR_uncategorized_time_risk_factor_feature_value -0.0678417 -0.0161345 -0.0109216 -0.0108374 -0.0061608 0.5652791 -0.0438828 -0.0278838 0.0248733 0.0132267 -0.0120041 -0.0383480 0.0427446 1.0000000
P-values for the Correlations
collaboration EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_patient_history_risk_factor_feature_value EHR_usage_time_spent_on_patient_education_risk_factor_feature_value EHR_usage_time_spent_on_orders_risk_factor_feature_value EHR_usage_time_spent_on_notes_risk_factor_feature_value EHR_usage_time_spent_on_messaging_risk_factor_feature_value EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_charging_risk_factor_feature_value EHR_usage_time_spent_on_assessment_risk_factor_feature_value EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value EHR_uncategorized_time_risk_factor_feature_value
collaboration NA 0.8231570 0.2345199 0.2305041 0.6760204 0.3302121 0.1388783 0.5311445 0.7896886 0.9967670 0.9018158 0.1082136 0.7774635 0.3120904
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 0.8231570 NA 0.0000068 0.0000000 0.0165512 0.6896572 0.0000000 0.0068509 0.0000000 0.0078702 0.1443769 0.0000000 0.0000000 0.8102191
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 0.2345199 0.0000068 NA 0.0000010 0.0007724 0.4377832 0.0002107 0.0121625 0.0000000 0.4653278 0.7650336 0.0000153 0.0000000 0.8708724
EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 0.2305041 0.0000000 0.0000010 NA 0.0584711 0.6274817 0.0000000 0.0008925 0.0000000 0.3904194 0.5891330 0.0030658 0.0000001 0.8718599
EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 0.6760204 0.0165512 0.0007724 0.0584711 NA 0.9618519 0.2062704 0.0000384 0.0000000 0.5657960 0.5691713 0.2044191 0.0003589 0.9269435
EHR_usage_time_spent_on_orders_risk_factor_feature_value 0.3302121 0.6896572 0.4377832 0.6274817 0.9618519 NA 0.7226779 0.7910855 0.2760202 0.2973172 0.8462953 0.3598444 0.8557360 0.0000000
EHR_usage_time_spent_on_notes_risk_factor_feature_value 0.1388783 0.0000000 0.0002107 0.0000000 0.2062704 0.7226779 NA 0.0085961 0.0000000 0.2126639 0.8449462 0.0000000 0.0000000 0.5134872
EHR_usage_time_spent_on_messaging_risk_factor_feature_value 0.5311445 0.0068509 0.0121625 0.0008925 0.0000384 0.7910855 0.0085961 NA 0.0000002 0.7129193 0.0112555 0.0813143 0.0017693 0.6780888
EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 0.7896886 0.0000000 0.0000000 0.0000000 0.0000000 0.2760202 0.0000000 0.0000002 NA 0.0235998 0.0878044 0.0000000 0.0000000 0.7112003
EHR_usage_time_spent_on_charging_risk_factor_feature_value 0.9967670 0.0078702 0.4653278 0.3904194 0.5657960 0.2973172 0.2126639 0.7129193 0.0235998 NA 0.8870565 0.2712985 0.3719469 0.8439370
EHR_usage_time_spent_on_assessment_risk_factor_feature_value 0.9018158 0.1443769 0.7650336 0.5891330 0.5691713 0.8462953 0.8449462 0.0112555 0.0878044 0.8870565 NA 0.9644198 0.0844630 0.8582029
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 0.1082136 0.0000000 0.0000153 0.0030658 0.2044191 0.3598444 0.0000000 0.0813143 0.0000000 0.2712985 0.9644198 NA 0.0000000 0.5680403
EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 0.7774635 0.0000000 0.0000000 0.0000001 0.0003589 0.8557360 0.0000000 0.0017693 0.0000000 0.3719469 0.0844630 0.0000000 NA 0.5244805
EHR_uncategorized_time_risk_factor_feature_value 0.3120904 0.8102191 0.8708724 0.8718599 0.9269435 0.0000000 0.5134872 0.6780888 0.7112003 0.8439370 0.8582029 0.5680403 0.5244805 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Ehr FEATURE Variables by Collaboration Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
collaboration_category…1 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 2 3.315913e+01 16.5795632 0.2408816 0.7861407
Residuals …2 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 221 1.521114e+04 68.8286693 NA NA
collaboration_category…3 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 2 1.334859e+02 66.7429567 1.8593652 0.1582001
Residuals …4 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 221 7.932919e+03 35.8955614 NA NA
collaboration_category…5 EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 2 2.345668e+01 11.7283406 0.7307918 0.4826875
Residuals …6 EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 221 3.546787e+03 16.0488122 NA NA
collaboration_category…7 EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 2 1.613630e+03 806.8152037 0.7329629 0.4816476
Residuals …8 EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 221 2.432677e+05 1100.7586452 NA NA
collaboration_category…9 EHR_usage_time_spent_on_orders_risk_factor_feature_value 2 4.980047e+00 2.4900236 1.6421859 0.1959094
Residuals …10 EHR_usage_time_spent_on_orders_risk_factor_feature_value 221 3.350992e+02 1.5162860 NA NA
collaboration_category…11 EHR_usage_time_spent_on_notes_risk_factor_feature_value 2 6.857959e-01 0.3428980 0.1383631 0.8708578
Residuals …12 EHR_usage_time_spent_on_notes_risk_factor_feature_value 221 5.476924e+02 2.4782464 NA NA
collaboration_category…13 EHR_usage_time_spent_on_messaging_risk_factor_feature_value 2 6.501700e-03 0.0032508 1.3204931 0.2691019
Residuals …14 EHR_usage_time_spent_on_messaging_risk_factor_feature_value 221 5.440673e-01 0.0024618 NA NA
collaboration_category…15 EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 2 3.059463e+02 152.9731655 0.4136656 0.6617329
Residuals …16 EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 221 8.172560e+04 369.7990966 NA NA
collaboration_category…17 EHR_usage_time_spent_on_charging_risk_factor_feature_value 2 4.683636e+00 2.3418180 0.0796687 0.9234487
Residuals …18 EHR_usage_time_spent_on_charging_risk_factor_feature_value 221 6.496174e+03 29.3944538 NA NA
collaboration_category…19 EHR_usage_time_spent_on_assessment_risk_factor_feature_value 2 2.289435e+00 1.1447172 0.1480781 0.8624493
Residuals …20 EHR_usage_time_spent_on_assessment_risk_factor_feature_value 221 1.708440e+03 7.7304970 NA NA
collaboration_category…21 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 2 1.253160e+00 0.6265802 0.1535293 0.8577671
Residuals …22 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 221 9.019402e+02 4.0811775 NA NA
collaboration_category…23 EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 2 1.766239e+00 0.8831197 0.6906018 0.5023527
Residuals …24 EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 221 2.826078e+02 1.2787682 NA NA
collaboration_category…25 EHR_uncategorized_time_risk_factor_feature_value 2 1.995000e-04 0.0000997 0.1042978 0.9010012
Residuals …26 EHR_uncategorized_time_risk_factor_feature_value 221 2.113140e-01 0.0009562 NA NA