Safety Descriptives

Data were aggregated by Department (final N=269 departments)

Descriptive Statistics for Safety
vars n mean sd median trimmed mad min max range skew kurtosis se
X1 1 269 2.045364 0.5795997 2 2.027657 0.4942 1 5 4 0.7894235 2.979137 0.0353388

Descriptive Statistics for Safety by Category
safety_category Count Mean SD
Favorable 252 1.955060 0.4567680
Neutral 15 3.201852 0.2376738
Unfavorable 2 4.750000 0.3535534
Descriptive Statistics for Safety by Percentile
safety_percentile Count Mean SD
Top 20% 52 1.239660 0.1932875
Middle 60% 162 2.036724 0.2093858
Bottom 20% 55 2.832572 0.4946958

Safety and Quit Probability

Correlation between Safety and Quit Probability
Correlation
0.0213229 
## `geom_smooth()` using formula = 'y ~ x'

ANOVA Results for Quit Probability by Safety Category
Df Sum Sq Mean Sq F value Pr(>F)
safety_category 2 0.0000304 1.52e-05 0.4355484 0.6474541
Residuals 225 0.0078408 3.48e-05 NA NA
Tukey’s HSD Post-hoc Results for Safety Category
Comparison Estimate Std_Error z_value p_value
Neutral - Favorable Neutral - Favorable -0.0008784 0.0016290 -0.5392513 0.8419849
Unfavorable - Favorable Unfavorable - Favorable 0.0031394 0.0041938 0.7485818 0.7187035
Unfavorable - Neutral Unfavorable - Neutral 0.0040179 0.0044624 0.9003781 0.6210378

ANOVA Results for Quit Probability by Safety Percentile
Df Sum Sq Mean Sq F value Pr(>F)
safety_percentile 2 0.0000280 1.40e-05 0.4022666 0.6692825
Residuals 225 0.0078431 3.49e-05 NA NA
Tukey’s HSD Post-hoc Results for Safety Percentile
Comparison Estimate Std_Error z_value p_value
Middle 60% - Top 20% Middle 60% - Top 20% 0.0009693 0.0010808 0.8968896 0.6389389
Bottom 20% - Top 20% Bottom 20% - Top 20% 0.0007716 0.0012652 0.6098554 0.8124572
Bottom 20% - Middle 60% Bottom 20% - Middle 60% -0.0001977 0.0009666 -0.2045742 0.9768510

##Relationship between Safety and Scheduling Shaps

Correlation Matrix: Safety and Scheduling SHAP Variables
safety Unscheduled_Time_risk_factor_shap Scheduling_overlapping_appointments_risk_factor_shap Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap Scheduling_back_to_back_appointments_risk_factor_shap SchedulingWeekends_risk_factor_shap
safety 1.0000000 0.0133034 0.1746579 -0.0054333 -0.0928978 -0.0316412 0.0433165 0.0676321
Unscheduled_Time_risk_factor_shap 0.0133034 1.0000000 0.1074331 0.1203767 0.0780532 0.0613317 0.0960513 -0.0179730
Scheduling_overlapping_appointments_risk_factor_shap 0.1746579 0.1074331 1.0000000 -0.1655393 -0.1191948 -0.4153116 0.2109286 0.0743987
Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap -0.0054333 0.1203767 -0.1655393 1.0000000 0.1472663 0.6380386 -0.0603795 0.1498284
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap -0.0928978 0.0780532 -0.1191948 0.1472663 1.0000000 0.2968274 0.1307884 -0.0434544
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap -0.0316412 0.0613317 -0.4153116 0.6380386 0.2968274 1.0000000 -0.1558050 0.0968575
Scheduling_back_to_back_appointments_risk_factor_shap 0.0433165 0.0960513 0.2109286 -0.0603795 0.1307884 -0.1558050 1.0000000 -0.0204519
SchedulingWeekends_risk_factor_shap 0.0676321 -0.0179730 0.0743987 0.1498284 -0.0434544 0.0968575 -0.0204519 1.0000000
P-values for the Correlations
safety Unscheduled_Time_risk_factor_shap Scheduling_overlapping_appointments_risk_factor_shap Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap Scheduling_back_to_back_appointments_risk_factor_shap SchedulingWeekends_risk_factor_shap
safety NA 0.8502096 0.0124713 0.9362807 0.1707309 0.6414419 0.5384426 0.3487625
Unscheduled_Time_risk_factor_shap 0.8502096 NA 0.1261524 0.0863451 0.2671430 0.3835198 0.1717447 0.8086599
Scheduling_overlapping_appointments_risk_factor_shap 0.0124713 0.1261524 NA 0.0179720 0.0895004 0.0000000 0.0024594 0.3155196
Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 0.9362807 0.0863451 0.0179720 NA 0.0293493 0.0000000 0.3909610 0.0370542
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 0.1707309 0.2671430 0.0895004 0.0293493 NA 0.0000079 0.0622417 0.5474255
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 0.6414419 0.3835198 0.0000000 0.0000000 0.0000079 NA 0.0260629 0.1791063
Scheduling_back_to_back_appointments_risk_factor_shap 0.5384426 0.1717447 0.0024594 0.3909610 0.0622417 0.0260629 NA 0.7828853
SchedulingWeekends_risk_factor_shap 0.3487625 0.8086599 0.3155196 0.0370542 0.5474255 0.1791063 0.7828853 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Scheduling SHAP Variables by Safety Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
safety_category…1 Unscheduled_Time_risk_factor_shap 2 0.0423070 0.0211535 7.4735459 0.0007401
Residuals …2 Unscheduled_Time_risk_factor_shap 201 0.5689212 0.0028305 NA NA
safety_category…3 Scheduling_overlapping_appointments_risk_factor_shap 2 0.0898078 0.0449039 4.0811879 0.0183065
Residuals …4 Scheduling_overlapping_appointments_risk_factor_shap 201 2.2115331 0.0110027 NA NA
safety_category…5 Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 2 0.0006756 0.0003378 0.0609227 0.9409121
Residuals …6 Scheduling_Hours_worked_outside_7am7pm_risk_factor_shap 216 1.1976694 0.0055448 NA NA
safety_category…7 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 2 0.0009046 0.0004523 7.2155111 0.0009259
Residuals …8 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_shap 216 0.0135402 0.0000627 NA NA
safety_category…9 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 2 0.0018045 0.0009022 0.2007048 0.8183063
Residuals …10 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_shap 216 0.9709906 0.0044953 NA NA
safety_category…11 Scheduling_back_to_back_appointments_risk_factor_shap 2 0.0029019 0.0014509 2.5180014 0.0831612
Residuals …12 Scheduling_back_to_back_appointments_risk_factor_shap 201 0.1158204 0.0005762 NA NA
safety_category…13 SchedulingWeekends_risk_factor_shap 2 0.0274606 0.0137303 1.3450998 0.2629701
Residuals …14 SchedulingWeekends_risk_factor_shap 191 1.9496615 0.0102077 NA NA

##Relationship between Safety and Workload Shaps

Encounter_Duration_risk_factor_shap

Clinical_Workload_RVU_risk_factor_shap

Clinical_Workload_Procedure_Type_risk_factor_shap

Clinical_Workload_Procedure_Count_risk_factor_shap”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap

“Nonpatient_contact_time_risk_factor_shap

##Relationship between Safety and Workload Shaps

Encounter_Duration_risk_factor_shap

Clinical_Workload_RVU_risk_factor_shap

Clinical_Workload_Procedure_Type_risk_factor_shap

Clinical_Workload_Procedure_Count_risk_factor_shap”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap

“Nonpatient_contact_time_risk_factor_shap

“Clinical_Workload_Encounter_count_risk_factor_shap”

Correlation Matrix: Safety and Workload SHAP Variables
safety Encounter_Duration_risk_factor_shap Clinical_Workload_RVU_risk_factor_shap Clinical_Workload_Procedure_Type_risk_factor_shap Clinical_Workload_Procedure_Count_risk_factor_shap Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap Clinical_Workload_Encounter_count_risk_factor_shap Nonpatient_contact_time_risk_factor_shap
safety 1.0000000 0.0345014 0.0609255 0.1043787 0.1307817 -0.0901749 -0.1019497 -0.0257072 0.1364134
Encounter_Duration_risk_factor_shap 0.0345014 1.0000000 -0.2262257 -0.0446032 -0.2084849 0.1380264 0.1550642 0.2730183 -0.2203552
Clinical_Workload_RVU_risk_factor_shap 0.0609255 -0.2262257 1.0000000 0.0800352 0.5795920 0.0809919 0.0589783 -0.2399206 0.3581040
Clinical_Workload_Procedure_Type_risk_factor_shap 0.1043787 -0.0446032 0.0800352 1.0000000 0.0416841 0.2444559 0.0595537 0.1101940 -0.1025363
Clinical_Workload_Procedure_Count_risk_factor_shap 0.1307817 -0.2084849 0.5795920 0.0416841 1.0000000 0.1053561 0.0178292 -0.2028889 0.2165978
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap -0.0901749 0.1380264 0.0809919 0.2444559 0.1053561 1.0000000 -0.0176133 0.3770314 -0.2855978
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap -0.1019497 0.1550642 0.0589783 0.0595537 0.0178292 -0.0176133 1.0000000 0.0402679 0.1507316
Clinical_Workload_Encounter_count_risk_factor_shap -0.0257072 0.2730183 -0.2399206 0.1101940 -0.2028889 0.3770314 0.0402679 1.0000000 -0.4980576
Nonpatient_contact_time_risk_factor_shap 0.1364134 -0.2203552 0.3581040 -0.1025363 0.2165978 -0.2855978 0.1507316 -0.4980576 1.0000000
P-values for the Correlations
safety Encounter_Duration_risk_factor_shap Clinical_Workload_RVU_risk_factor_shap Clinical_Workload_Procedure_Type_risk_factor_shap Clinical_Workload_Procedure_Count_risk_factor_shap Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap Clinical_Workload_Encounter_count_risk_factor_shap Nonpatient_contact_time_risk_factor_shap
safety NA 0.6302944 0.3706727 0.1244223 0.0538356 0.1836698 0.1498316 0.7058447 0.0517142
Encounter_Duration_risk_factor_shap 0.6302944 NA 0.0013907 0.5337042 0.0032823 0.0530845 0.0295734 0.0001038 0.0018615
Clinical_Workload_RVU_risk_factor_shap 0.3706727 0.0013907 NA 0.2392750 0.0000000 0.2336874 0.4067796 0.0003624 0.0000002
Clinical_Workload_Procedure_Type_risk_factor_shap 0.1244223 0.5337042 0.2392750 NA 0.5404144 0.0002684 0.4022096 0.1054866 0.1454655
Clinical_Workload_Procedure_Count_risk_factor_shap 0.0538356 0.0032823 0.0000000 0.5404144 NA 0.1209160 0.8021371 0.0026753 0.0019098
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 0.1836698 0.0530845 0.2336874 0.0002684 0.1209160 NA 0.8040003 0.0000000 0.0000346
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 0.1498316 0.0295734 0.4067796 0.4022096 0.8021371 0.8040003 NA 0.5703301 0.0326892
Clinical_Workload_Encounter_count_risk_factor_shap 0.7058447 0.0001038 0.0003624 0.1054866 0.0026753 0.0000000 0.5703301 NA 0.0000000
Nonpatient_contact_time_risk_factor_shap 0.0517142 0.0018615 0.0000002 0.1454655 0.0019098 0.0000346 0.0326892 0.0000000 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Workload SHAP Variables by Safety Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
safety_category…1 Encounter_Duration_risk_factor_shap 2 0.0140677 0.0070338 0.7589531 0.4695411
Residuals …2 Encounter_Duration_risk_factor_shap 194 1.7979576 0.0092678 NA NA
safety_category…3 Clinical_Workload_RVU_risk_factor_shap 2 0.0065572 0.0032786 0.3041133 0.7380941
Residuals …4 Clinical_Workload_RVU_risk_factor_shap 215 2.3178889 0.0107809 NA NA
safety_category…5 Clinical_Workload_Procedure_Type_risk_factor_shap 2 0.0614293 0.0307147 8.4356426 0.0002972
Residuals …6 Clinical_Workload_Procedure_Type_risk_factor_shap 215 0.7828275 0.0036411 NA NA
safety_category…7 Clinical_Workload_Procedure_Count_risk_factor_shap 2 0.0077609 0.0038804 1.2901533 0.2773506
Residuals …8 Clinical_Workload_Procedure_Count_risk_factor_shap 215 0.6466632 0.0030077 NA NA
safety_category…9 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 2 0.0061420 0.0030710 3.2754384 0.0396862
Residuals …10 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_shap 216 0.2025176 0.0009376 NA NA
safety_category…11 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 2 0.0002811 0.0001406 0.0519927 0.9493488
Residuals …12 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_shap 198 0.5352590 0.0027033 NA NA
safety_category…13 Clinical_Workload_Encounter_count_risk_factor_shap 2 0.0017174 0.0008587 0.1032557 0.9019410
Residuals …14 Clinical_Workload_Encounter_count_risk_factor_shap 215 1.7879662 0.0083161 NA NA
safety_category…15 Nonpatient_contact_time_risk_factor_shap 2 0.0797124 0.0398562 2.2704404 0.1059091
Residuals …16 Nonpatient_contact_time_risk_factor_shap 201 3.5284339 0.0175544 NA NA

##Relationship between Safety and Ehr Shaps

EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_patient_history_risk_factor_shap”,

“EHR_usage_time_spent_on_patient_education_risk_factor_shap”,

“EHR_usage_time_spent_on_orders_risk_factor_shap”,

“EHR_usage_time_spent_on_notes_risk_factor_shap”,

“EHR_usage_time_spent_on_messaging_risk_factor_shap”,

“EHR_usage_time_spent_on_EHR_system_risk_factor_shap”,

“EHR_usage_time_spent_on_charging_risk_factor_shap”,

“EHR_usage_time_spent_on_assessment_risk_factor_shap”,

“EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap”,

“EHR_usage_time_spent_on_administrative_processes_risk_factor_shap”,

“EHR_uncategorized_time_risk_factor_shap” )

Correlation Matrix: Safety and Ehr SHAP Variables
safety EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_patient_history_risk_factor_shap EHR_usage_time_spent_on_patient_education_risk_factor_shap EHR_usage_time_spent_on_orders_risk_factor_shap EHR_usage_time_spent_on_notes_risk_factor_shap EHR_usage_time_spent_on_messaging_risk_factor_shap EHR_usage_time_spent_on_EHR_system_risk_factor_shap EHR_usage_time_spent_on_charging_risk_factor_shap EHR_usage_time_spent_on_assessment_risk_factor_shap EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap EHR_usage_time_spent_on_administrative_processes_risk_factor_shap EHR_uncategorized_time_risk_factor_shap
safety 1.0000000 0.0382543 0.0048998 -0.0139692 0.0497431 -0.0879467 0.0141191 -0.0194197 0.0805845 0.0229808 0.0891003 0.1171429 0.0913620 -0.0807952
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 0.0382543 1.0000000 0.4625391 0.3935647 0.3936631 0.0127669 0.4791951 0.0681449 0.7803844 0.2866464 0.3693576 -0.4094449 0.6996216 0.0985913
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 0.0048998 0.4625391 1.0000000 0.5524408 0.2875210 0.0456950 0.3675777 -0.0364662 0.5467299 0.2346365 0.3206382 -0.3139356 0.6583274 0.1774795
EHR_usage_time_spent_on_patient_history_risk_factor_shap -0.0139692 0.3935647 0.5524408 1.0000000 0.1080566 0.0133008 0.2421737 -0.0005768 0.4133753 0.1490189 0.3183151 -0.2257065 0.4830547 0.1880824
EHR_usage_time_spent_on_patient_education_risk_factor_shap 0.0497431 0.3936631 0.2875210 0.1080566 1.0000000 0.1352755 0.3408316 -0.1021671 0.4900959 0.1682598 0.2923523 -0.3348235 0.4988600 0.0186822
EHR_usage_time_spent_on_orders_risk_factor_shap -0.0879467 0.0127669 0.0456950 0.0133008 0.1352755 1.0000000 -0.0263452 -0.0695341 0.1039823 -0.0442113 0.0135692 -0.0741403 0.0139322 0.0810434
EHR_usage_time_spent_on_notes_risk_factor_shap 0.0141191 0.4791951 0.3675777 0.2421737 0.3408316 -0.0263452 1.0000000 0.0642468 0.5635219 0.2766452 0.2532913 -0.4678691 0.5000973 0.0184974
EHR_usage_time_spent_on_messaging_risk_factor_shap -0.0194197 0.0681449 -0.0364662 -0.0005768 -0.1021671 -0.0695341 0.0642468 1.0000000 0.0506593 0.1245726 0.0011789 -0.1052265 -0.0782965 0.0039928
EHR_usage_time_spent_on_EHR_system_risk_factor_shap 0.0805845 0.7803844 0.5467299 0.4133753 0.4900959 0.1039823 0.5635219 0.0506593 1.0000000 0.3715501 0.3687570 -0.4470924 0.7563752 0.0920523
EHR_usage_time_spent_on_charging_risk_factor_shap 0.0229808 0.2866464 0.2346365 0.1490189 0.1682598 -0.0442113 0.2766452 0.1245726 0.3715501 1.0000000 0.0502955 -0.1996492 0.2853860 0.0517544
EHR_usage_time_spent_on_assessment_risk_factor_shap 0.0891003 0.3693576 0.3206382 0.3183151 0.2923523 0.0135692 0.2532913 0.0011789 0.3687570 0.0502955 1.0000000 -0.2501693 0.4996607 0.0693299
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 0.1171429 -0.4094449 -0.3139356 -0.2257065 -0.3348235 -0.0741403 -0.4678691 -0.1052265 -0.4470924 -0.1996492 -0.2501693 1.0000000 -0.5065934 -0.0807939
EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 0.0913620 0.6996216 0.6583274 0.4830547 0.4988600 0.0139322 0.5000973 -0.0782965 0.7563752 0.2853860 0.4996607 -0.5065934 1.0000000 0.1356093
EHR_uncategorized_time_risk_factor_shap -0.0807952 0.0985913 0.1774795 0.1880824 0.0186822 0.0810434 0.0184974 0.0039928 0.0920523 0.0517544 0.0693299 -0.0807939 0.1356093 1.0000000
P-values for the Correlations
safety EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap EHR_usage_time_spent_on_patient_history_risk_factor_shap EHR_usage_time_spent_on_patient_education_risk_factor_shap EHR_usage_time_spent_on_orders_risk_factor_shap EHR_usage_time_spent_on_notes_risk_factor_shap EHR_usage_time_spent_on_messaging_risk_factor_shap EHR_usage_time_spent_on_EHR_system_risk_factor_shap EHR_usage_time_spent_on_charging_risk_factor_shap EHR_usage_time_spent_on_assessment_risk_factor_shap EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap EHR_usage_time_spent_on_administrative_processes_risk_factor_shap EHR_uncategorized_time_risk_factor_shap
safety NA 0.5689876 0.9418671 0.8352975 0.4588272 0.1897077 0.8335560 0.7725447 0.2296406 0.7323016 0.1839423 0.0802126 0.1730140 0.2284210
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 0.5689876 NA 0.0000000 0.0000000 0.0000000 0.8492967 0.0000000 0.3099278 0.0000000 0.0000131 0.0000000 0.0000000 0.0000000 0.1413156
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 0.9418671 0.0000000 NA 0.0000000 0.0000123 0.4962322 0.0000000 0.5871960 0.0000000 0.0003976 0.0000009 0.0000016 0.0000000 0.0077544
EHR_usage_time_spent_on_patient_history_risk_factor_shap 0.8352975 0.0000000 0.0000000 NA 0.1067615 0.8430736 0.0002533 0.9931510 0.0000000 0.0257275 0.0000011 0.0006660 0.0000000 0.0047360
EHR_usage_time_spent_on_patient_education_risk_factor_shap 0.4588272 0.0000000 0.0000123 0.1067615 NA 0.0431147 0.0000002 0.1273754 0.0000000 0.0116623 0.0000086 0.0000003 0.0000000 0.7809591
EHR_usage_time_spent_on_orders_risk_factor_shap 0.1897077 0.8492967 0.4962322 0.8430736 0.0431147 NA 0.6949397 0.3001447 0.1207180 0.5103358 0.8399496 0.2691841 0.8357271 0.2269898
EHR_usage_time_spent_on_notes_risk_factor_shap 0.8335560 0.0000000 0.0000000 0.0002533 0.0000002 0.6949397 NA 0.3384825 0.0000000 0.0000267 0.0001269 0.0000000 0.0000000 0.7830711
EHR_usage_time_spent_on_messaging_risk_factor_shap 0.7725447 0.3099278 0.5871960 0.9931510 0.1273754 0.3001447 0.3384825 NA 0.4505838 0.0627078 0.9860019 0.1163133 0.2431815 0.9526135
EHR_usage_time_spent_on_EHR_system_risk_factor_shap 0.2296406 0.0000000 0.0000000 0.0000000 0.0000000 0.1207180 0.0000000 0.4505838 NA 0.0000000 0.0000000 0.0000000 0.0000000 0.1697766
EHR_usage_time_spent_on_charging_risk_factor_shap 0.7323016 0.0000131 0.0003976 0.0257275 0.0116623 0.5103358 0.0000267 0.0627078 0.0000000 NA 0.4538472 0.0026853 0.0000144 0.4408424
EHR_usage_time_spent_on_assessment_risk_factor_shap 0.1839423 0.0000000 0.0000009 0.0000011 0.0000086 0.8399496 0.0001269 0.9860019 0.0000000 0.4538472 NA 0.0001546 0.0000000 0.3015694
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 0.0802126 0.0000000 0.0000016 0.0006660 0.0000003 0.2691841 0.0000000 0.1163133 0.0000000 0.0026853 0.0001546 NA 0.0000000 0.2284282
EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 0.1730140 0.0000000 0.0000000 0.0000000 0.0000000 0.8357271 0.0000000 0.2431815 0.0000000 0.0000144 0.0000000 0.0000000 NA 0.0425975
EHR_uncategorized_time_risk_factor_shap 0.2284210 0.1413156 0.0077544 0.0047360 0.7809591 0.2269898 0.7830711 0.9526135 0.1697766 0.4408424 0.3015694 0.2284282 0.0425975 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Ehr SHAP Variables by Safety Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
safety_category…1 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 2 0.0675719 0.0337859 2.7201505 0.0680706
Residuals …2 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_shap 221 2.7449550 0.0124206 NA NA
safety_category…3 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 2 0.0417168 0.0208584 1.7040289 0.1843308
Residuals …4 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_shap 221 2.7051802 0.0122406 NA NA
safety_category…5 EHR_usage_time_spent_on_patient_history_risk_factor_shap 2 0.0438242 0.0219121 2.6411179 0.0735310
Residuals …6 EHR_usage_time_spent_on_patient_history_risk_factor_shap 221 1.8335314 0.0082965 NA NA
safety_category…7 EHR_usage_time_spent_on_patient_education_risk_factor_shap 2 0.0031838 0.0015919 0.2821735 0.7544141
Residuals …8 EHR_usage_time_spent_on_patient_education_risk_factor_shap 221 1.2467746 0.0056415 NA NA
safety_category…9 EHR_usage_time_spent_on_orders_risk_factor_shap 2 0.0582813 0.0291407 4.5529047 0.0115438
Residuals …10 EHR_usage_time_spent_on_orders_risk_factor_shap 221 1.4145011 0.0064005 NA NA
safety_category…11 EHR_usage_time_spent_on_notes_risk_factor_shap 2 0.0178904 0.0089452 1.2350434 0.2928214
Residuals …12 EHR_usage_time_spent_on_notes_risk_factor_shap 221 1.6006630 0.0072428 NA NA
safety_category…13 EHR_usage_time_spent_on_messaging_risk_factor_shap 2 0.0009531 0.0004765 0.2109054 0.8100135
Residuals …14 EHR_usage_time_spent_on_messaging_risk_factor_shap 221 0.4993358 0.0022594 NA NA
safety_category…15 EHR_usage_time_spent_on_EHR_system_risk_factor_shap 2 0.2893020 0.1446510 4.1459705 0.0170759
Residuals …16 EHR_usage_time_spent_on_EHR_system_risk_factor_shap 221 7.7105878 0.0348895 NA NA
safety_category…17 EHR_usage_time_spent_on_charging_risk_factor_shap 2 0.0774430 0.0387215 2.0935724 0.1256837
Residuals …18 EHR_usage_time_spent_on_charging_risk_factor_shap 221 4.0874853 0.0184954 NA NA
safety_category…19 EHR_usage_time_spent_on_assessment_risk_factor_shap 2 0.0045371 0.0022685 0.9343790 0.3943759
Residuals …20 EHR_usage_time_spent_on_assessment_risk_factor_shap 221 0.5365541 0.0024278 NA NA
safety_category…21 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 2 0.1035487 0.0517743 4.1773655 0.0165670
Residuals …22 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_shap 221 2.7390782 0.0123940 NA NA
safety_category…23 EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 2 0.4275427 0.2137713 3.9303648 0.0210242
Residuals …24 EHR_usage_time_spent_on_administrative_processes_risk_factor_shap 221 12.0201219 0.0543897 NA NA
safety_category…25 EHR_uncategorized_time_risk_factor_shap 2 0.0001290 0.0000645 1.5164687 0.2217605
Residuals …26 EHR_uncategorized_time_risk_factor_shap 221 0.0093985 0.0000425 NA NA

##Relationship between Safety and Scheduling Features

Correlation Matrix: Safety and Scheduling FEATURE Variables
safety Unscheduled_Time_risk_factor_feature_value Scheduling_overlapping_appointments_risk_factor_feature_value Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value Scheduling_back_to_back_appointments_risk_factor_feature_value SchedulingWeekends_risk_factor_feature_value
safety 1.0000000 -0.0286464 -0.1632947 -0.0421333 -0.0404836 -0.0790288 -0.1693644 0.0733375
Unscheduled_Time_risk_factor_feature_value -0.0286464 1.0000000 -0.0573554 -0.0892838 -0.0063455 0.1238255 0.0769870 -0.1136307
Scheduling_overlapping_appointments_risk_factor_feature_value -0.1632947 -0.0573554 1.0000000 -0.3596856 0.1347903 0.3324081 0.3666426 0.0226906
Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value -0.0421333 -0.0892838 -0.3596856 1.0000000 -0.0073217 0.1566051 0.0715954 -0.0773370
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value -0.0404836 -0.0063455 0.1347903 -0.0073217 1.0000000 -0.0071389 0.0363418 0.2210164
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value -0.0790288 0.1238255 0.3324081 0.1566051 -0.0071389 1.0000000 0.8187556 -0.2911901
Scheduling_back_to_back_appointments_risk_factor_feature_value -0.1693644 0.0769870 0.3666426 0.0715954 0.0363418 0.8187556 1.0000000 -0.3121378
SchedulingWeekends_risk_factor_feature_value 0.0733375 -0.1136307 0.0226906 -0.0773370 0.2210164 -0.2911901 -0.3121378 1.0000000
P-values for the Correlations
safety Unscheduled_Time_risk_factor_feature_value Scheduling_overlapping_appointments_risk_factor_feature_value Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value Scheduling_back_to_back_appointments_risk_factor_feature_value SchedulingWeekends_risk_factor_feature_value
safety NA 0.6842121 0.0196131 0.5351107 0.5512299 0.2441611 0.0154496 0.3095146
Unscheduled_Time_risk_factor_feature_value 0.6842121 NA 0.4151659 0.2041098 0.9282273 0.0776459 0.2737519 0.1245786
Scheduling_overlapping_appointments_risk_factor_feature_value 0.0196131 0.4151659 NA 0.0000001 0.0545879 0.0000012 0.0000001 0.7598090
Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 0.5351107 0.2041098 0.0000001 NA 0.9142077 0.0204164 0.3088633 0.2837987
Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 0.5512299 0.9282273 0.0545879 0.9142077 NA 0.9163422 0.6058230 0.0019556
Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 0.2441611 0.0776459 0.0000012 0.0204164 0.9163422 NA 0.0000000 0.0000380
Scheduling_back_to_back_appointments_risk_factor_feature_value 0.0154496 0.2737519 0.0000001 0.3088633 0.6058230 0.0000000 NA 0.0000161
SchedulingWeekends_risk_factor_feature_value 0.3095146 0.1245786 0.7598090 0.2837987 0.0019556 0.0000380 0.0000161 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Scheduling FEATURE Variables by Safety Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
safety_category…1 Unscheduled_Time_risk_factor_feature_value 2 1.364990e-02 6.825000e-03 0.0012203 0.9987804
Residuals …2 Unscheduled_Time_risk_factor_feature_value 201 1.124136e+03 5.592715e+00 NA NA
safety_category…3 Scheduling_overlapping_appointments_risk_factor_feature_value 2 2.845648e+03 1.422824e+03 2.7608558 0.0656371
Residuals …4 Scheduling_overlapping_appointments_risk_factor_feature_value 201 1.035866e+05 5.153561e+02 NA NA
safety_category…5 Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 2 5.427600e-03 2.713800e-03 0.2080604 0.8123206
Residuals …6 Scheduling_Hours_worked_outside_7am7pm_risk_factor_feature_value 216 2.817340e+00 1.304320e-02 NA NA
safety_category…7 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 2 5.098576e+00 2.549288e+00 0.0204501 0.9797594
Residuals …8 Scheduling_count_of_late_encounters_between_7pm12am_risk_factor_feature_value 216 2.692629e+04 1.246587e+02 NA NA
safety_category…9 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 2 2.588143e+05 1.294071e+05 0.0669898 0.9352241
Residuals …10 Scheduling_count_of_hours_worked_between_12_am__7_am_risk_factor_feature_value 216 4.172565e+08 1.931743e+06 NA NA
safety_category…11 Scheduling_back_to_back_appointments_risk_factor_feature_value 2 3.609160e+04 1.804580e+04 0.3456946 0.7081485
Residuals …12 Scheduling_back_to_back_appointments_risk_factor_feature_value 201 1.049251e+07 5.220156e+04 NA NA
safety_category…13 SchedulingWeekends_risk_factor_feature_value 2 2.223628e+03 1.111814e+03 0.1245827 0.8829369
Residuals …14 SchedulingWeekends_risk_factor_feature_value 191 1.704542e+06 8.924305e+03 NA NA

##Relationship between Safety and Workload Features

Encounter_Duration_risk_factor_feature_value

Clinical_Workload_RVU_risk_factor_feature_value

Clinical_Workload_Procedure_Type_risk_factor_feature_value

Clinical_Workload_Procedure_Count_risk_factor_feature_value”

“Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value”

“Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value

“Nonpatient_contact_time_risk_factor_feature_value

“Clinical_Workload_Encounter_count_risk_factor_feature_value”

Correlation Matrix: Safety and Workload FEATURE Variables
safety Encounter_Duration_risk_factor_feature_value Clinical_Workload_RVU_risk_factor_feature_value Clinical_Workload_Procedure_Type_risk_factor_feature_value Clinical_Workload_Procedure_Count_risk_factor_feature_value Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value Clinical_Workload_Encounter_count_risk_factor_feature_value Nonpatient_contact_time_risk_factor_feature_value
safety 1.0000000 -0.0713039 -0.0092151 0.1357972 -0.0306079 -0.1647152 -0.0508718 -0.0900510 -0.1810259
Encounter_Duration_risk_factor_feature_value -0.0713039 1.0000000 -0.0907257 -0.0018126 -0.1102129 -0.0564773 0.2571414 -0.0702778 -0.0337045
Clinical_Workload_RVU_risk_factor_feature_value -0.0092151 -0.0907257 1.0000000 0.6336461 0.8829654 0.5771087 0.0119758 0.5452412 0.5751453
Clinical_Workload_Procedure_Type_risk_factor_feature_value 0.1357972 -0.0018126 0.6336461 1.0000000 0.5157007 0.5627637 -0.0891127 0.5484507 0.4725423
Clinical_Workload_Procedure_Count_risk_factor_feature_value -0.0306079 -0.1102129 0.8829654 0.5157007 1.0000000 0.5039168 0.0939605 0.4616627 0.6085621
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value -0.1647152 -0.0564773 0.5771087 0.5627637 0.5039168 1.0000000 0.1190617 0.8678634 0.8993081
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value -0.0508718 0.2571414 0.0119758 -0.0891127 0.0939605 0.1190617 1.0000000 0.0685954 0.0983374
Clinical_Workload_Encounter_count_risk_factor_feature_value -0.0900510 -0.0702778 0.5452412 0.5484507 0.4616627 0.8678634 0.0685954 1.0000000 0.8541545
Nonpatient_contact_time_risk_factor_feature_value -0.1810259 -0.0337045 0.5751453 0.4725423 0.6085621 0.8993081 0.0983374 0.8541545 1.0000000
P-values for the Correlations
safety Encounter_Duration_risk_factor_feature_value Clinical_Workload_RVU_risk_factor_feature_value Clinical_Workload_Procedure_Type_risk_factor_feature_value Clinical_Workload_Procedure_Count_risk_factor_feature_value Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value Clinical_Workload_Encounter_count_risk_factor_feature_value Nonpatient_contact_time_risk_factor_feature_value
safety NA 0.3193977 0.8923906 0.0452008 0.6531239 0.0146749 0.4732516 0.1852922 0.0095664
Encounter_Duration_risk_factor_feature_value 0.3193977 NA 0.2048307 0.9798325 0.1231299 0.4305324 0.0002646 0.3264284 0.6382202
Clinical_Workload_RVU_risk_factor_feature_value 0.8923906 0.2048307 NA 0.0000000 0.0000000 0.0000000 0.8663408 0.0000000 0.0000000
Clinical_Workload_Procedure_Type_risk_factor_feature_value 0.0452008 0.9798325 0.0000000 NA 0.0000000 0.0000000 0.2095358 0.0000000 0.0000000
Clinical_Workload_Procedure_Count_risk_factor_feature_value 0.6531239 0.1231299 0.0000000 0.0000000 NA 0.0000000 0.1857015 0.0000000 0.0000000
Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 0.0146749 0.4305324 0.0000000 0.0000000 0.0000000 NA 0.0922867 0.0000000 0.0000000
Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 0.4732516 0.0002646 0.8663408 0.2095358 0.1857015 0.0922867 NA 0.3332526 0.1648795
Clinical_Workload_Encounter_count_risk_factor_feature_value 0.1852922 0.3264284 0.0000000 0.0000000 0.0000000 0.0000000 0.3332526 NA 0.0000000
Nonpatient_contact_time_risk_factor_feature_value 0.0095664 0.6382202 0.0000000 0.0000000 0.0000000 0.0000000 0.1648795 0.0000000 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Workload FEATURE Variables by Safety Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
safety_category…1 Encounter_Duration_risk_factor_feature_value 2 3.473025e+02 1.736512e+02 0.1514522 0.8595605
Residuals …2 Encounter_Duration_risk_factor_feature_value 194 2.224355e+05 1.146575e+03 NA NA
safety_category…3 Clinical_Workload_RVU_risk_factor_feature_value 2 5.969587e+04 2.984793e+04 0.4840277 0.6169661
Residuals …4 Clinical_Workload_RVU_risk_factor_feature_value 215 1.325814e+07 6.166576e+04 NA NA
safety_category…5 Clinical_Workload_Procedure_Type_risk_factor_feature_value 2 1.081750e+04 5.408752e+03 5.8898056 0.0032337
Residuals …6 Clinical_Workload_Procedure_Type_risk_factor_feature_value 215 1.974397e+05 9.183244e+02 NA NA
safety_category…7 Clinical_Workload_Procedure_Count_risk_factor_feature_value 2 2.135841e+04 1.067921e+04 0.0421208 0.9587619
Residuals …8 Clinical_Workload_Procedure_Count_risk_factor_feature_value 215 5.451063e+07 2.535378e+05 NA NA
safety_category…9 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 2 4.102893e+05 2.051446e+05 0.5193394 0.5956543
Residuals …10 Patient_Facing_Work_Flow_no_of_completed_appointments_risk_factor_feature_value 216 8.532231e+07 3.950107e+05 NA NA
safety_category…11 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 2 1.526495e+00 7.632476e-01 0.2497575 0.7792347
Residuals …12 Patient_Facing_Work_Flow_end_of_schedule_time_risk_factor_feature_value 198 6.050790e+02 3.055955e+00 NA NA
safety_category…13 Clinical_Workload_Encounter_count_risk_factor_feature_value 2 5.896819e+05 2.948409e+05 0.1087159 0.8970345
Residuals …14 Clinical_Workload_Encounter_count_risk_factor_feature_value 215 5.830866e+08 2.712031e+06 NA NA
safety_category…15 Nonpatient_contact_time_risk_factor_feature_value 2 7.062624e+04 3.531312e+04 0.5677361 0.5677135
Residuals …16 Nonpatient_contact_time_risk_factor_feature_value 201 1.250218e+07 6.219989e+04 NA NA

##Relationship between Safety and Ehr Features

EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_patient_history_risk_factor_feature_value”,

“EHR_usage_time_spent_on_patient_education_risk_factor_feature_value”,

“EHR_usage_time_spent_on_orders_risk_factor_feature_value”,

“EHR_usage_time_spent_on_notes_risk_factor_feature_value”,

“EHR_usage_time_spent_on_messaging_risk_factor_feature_value”,

“EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value”,

“EHR_usage_time_spent_on_charging_risk_factor_feature_value”,

“EHR_usage_time_spent_on_assessment_risk_factor_feature_value”,

“EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value”,

“EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value”,

“EHR_uncategorized_time_risk_factor_feature_value” )

Correlation Matrix: Safety and Ehr FEATURE Variables
safety EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_patient_history_risk_factor_feature_value EHR_usage_time_spent_on_patient_education_risk_factor_feature_value EHR_usage_time_spent_on_orders_risk_factor_feature_value EHR_usage_time_spent_on_notes_risk_factor_feature_value EHR_usage_time_spent_on_messaging_risk_factor_feature_value EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_charging_risk_factor_feature_value EHR_usage_time_spent_on_assessment_risk_factor_feature_value EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value EHR_uncategorized_time_risk_factor_feature_value
safety 1.0000000 -0.1185244 -0.0532427 -0.0720235 -0.0083516 0.0142438 -0.0361693 -0.0289609 -0.1131575 -0.0605473 0.0042236 -0.0361892 -0.1131733 -0.0991385
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value -0.1185244 1.0000000 0.2955489 0.3723345 0.1599872 0.0268260 0.4117812 0.1801960 0.7616065 0.1771519 0.0978425 0.4026231 0.3718345 -0.0161345
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value -0.0532427 0.2955489 1.0000000 0.3205523 0.2230759 -0.0521011 0.2451910 0.1672860 0.4518141 -0.0490269 -0.0200799 0.2844927 0.4313724 -0.0109216
EHR_usage_time_spent_on_patient_history_risk_factor_feature_value -0.0720235 0.3723345 0.3205523 1.0000000 0.1266236 -0.0325975 0.3838695 0.2204826 0.3932471 0.0576596 -0.0362776 0.1970041 0.3480255 -0.0108374
EHR_usage_time_spent_on_patient_education_risk_factor_feature_value -0.0083516 0.1599872 0.2230759 0.1266236 1.0000000 0.0032137 0.0847692 0.2714108 0.6727675 -0.0385705 0.0382361 0.0851150 0.2363722 -0.0061608
EHR_usage_time_spent_on_orders_risk_factor_feature_value 0.0142438 0.0268260 -0.0521011 -0.0325975 0.0032137 1.0000000 -0.0238416 -0.0177976 0.0730937 0.0699412 -0.0130243 -0.0614662 -0.0122152 0.5652791
EHR_usage_time_spent_on_notes_risk_factor_feature_value -0.0361693 0.4117812 0.2451910 0.3838695 0.0847692 -0.0238416 1.0000000 0.1751917 0.5249399 -0.0835920 -0.0131401 0.8298625 0.4328561 -0.0438828
EHR_usage_time_spent_on_messaging_risk_factor_feature_value -0.0289609 0.1801960 0.1672860 0.2204826 0.2714108 -0.0177976 0.1751917 1.0000000 0.3370017 -0.0247184 0.1690793 0.1167211 0.2077730 -0.0278838
EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value -0.1131575 0.7616065 0.4518141 0.3932471 0.6727675 0.0730937 0.5249399 0.3370017 1.0000000 0.1512172 0.1143254 0.5293828 0.5519003 0.0248733
EHR_usage_time_spent_on_charging_risk_factor_feature_value -0.0605473 0.1771519 -0.0490269 0.0576596 -0.0385705 0.0699412 -0.0835920 -0.0247184 0.1512172 1.0000000 -0.0095429 -0.0738147 -0.0599366 0.0132267
EHR_usage_time_spent_on_assessment_risk_factor_feature_value 0.0042236 0.0978425 -0.0200799 -0.0362776 0.0382361 -0.0130243 -0.0131401 0.1690793 0.1143254 -0.0095429 1.0000000 0.0029973 0.1155403 -0.0120041
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value -0.0361892 0.4026231 0.2844927 0.1970041 0.0851150 -0.0614662 0.8298625 0.1167211 0.5293828 -0.0738147 0.0029973 1.0000000 0.5063808 -0.0383480
EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value -0.1131733 0.3718345 0.4313724 0.3480255 0.2363722 -0.0122152 0.4328561 0.2077730 0.5519003 -0.0599366 0.1155403 0.5063808 1.0000000 0.0427446
EHR_uncategorized_time_risk_factor_feature_value -0.0991385 -0.0161345 -0.0109216 -0.0108374 -0.0061608 0.5652791 -0.0438828 -0.0278838 0.0248733 0.0132267 -0.0120041 -0.0383480 0.0427446 1.0000000
P-values for the Correlations
safety EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_patient_history_risk_factor_feature_value EHR_usage_time_spent_on_patient_education_risk_factor_feature_value EHR_usage_time_spent_on_orders_risk_factor_feature_value EHR_usage_time_spent_on_notes_risk_factor_feature_value EHR_usage_time_spent_on_messaging_risk_factor_feature_value EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value EHR_usage_time_spent_on_charging_risk_factor_feature_value EHR_usage_time_spent_on_assessment_risk_factor_feature_value EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value EHR_uncategorized_time_risk_factor_feature_value
safety NA 0.0766885 0.4277966 0.2831309 0.9010795 0.8321074 0.5902455 0.6663863 0.0911155 0.3670849 0.9498781 0.5900407 0.0910703 0.1391099
EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 0.0766885 NA 0.0000068 0.0000000 0.0165512 0.6896572 0.0000000 0.0068509 0.0000000 0.0078702 0.1443769 0.0000000 0.0000000 0.8102191
EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 0.4277966 0.0000068 NA 0.0000010 0.0007724 0.4377832 0.0002107 0.0121625 0.0000000 0.4653278 0.7650336 0.0000153 0.0000000 0.8708724
EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 0.2831309 0.0000000 0.0000010 NA 0.0584711 0.6274817 0.0000000 0.0008925 0.0000000 0.3904194 0.5891330 0.0030658 0.0000001 0.8718599
EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 0.9010795 0.0165512 0.0007724 0.0584711 NA 0.9618519 0.2062704 0.0000384 0.0000000 0.5657960 0.5691713 0.2044191 0.0003589 0.9269435
EHR_usage_time_spent_on_orders_risk_factor_feature_value 0.8321074 0.6896572 0.4377832 0.6274817 0.9618519 NA 0.7226779 0.7910855 0.2760202 0.2973172 0.8462953 0.3598444 0.8557360 0.0000000
EHR_usage_time_spent_on_notes_risk_factor_feature_value 0.5902455 0.0000000 0.0002107 0.0000000 0.2062704 0.7226779 NA 0.0085961 0.0000000 0.2126639 0.8449462 0.0000000 0.0000000 0.5134872
EHR_usage_time_spent_on_messaging_risk_factor_feature_value 0.6663863 0.0068509 0.0121625 0.0008925 0.0000384 0.7910855 0.0085961 NA 0.0000002 0.7129193 0.0112555 0.0813143 0.0017693 0.6780888
EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 0.0911155 0.0000000 0.0000000 0.0000000 0.0000000 0.2760202 0.0000000 0.0000002 NA 0.0235998 0.0878044 0.0000000 0.0000000 0.7112003
EHR_usage_time_spent_on_charging_risk_factor_feature_value 0.3670849 0.0078702 0.4653278 0.3904194 0.5657960 0.2973172 0.2126639 0.7129193 0.0235998 NA 0.8870565 0.2712985 0.3719469 0.8439370
EHR_usage_time_spent_on_assessment_risk_factor_feature_value 0.9498781 0.1443769 0.7650336 0.5891330 0.5691713 0.8462953 0.8449462 0.0112555 0.0878044 0.8870565 NA 0.9644198 0.0844630 0.8582029
EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 0.5900407 0.0000000 0.0000153 0.0030658 0.2044191 0.3598444 0.0000000 0.0813143 0.0000000 0.2712985 0.9644198 NA 0.0000000 0.5680403
EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 0.0910703 0.0000000 0.0000000 0.0000001 0.0003589 0.8557360 0.0000000 0.0017693 0.0000000 0.3719469 0.0844630 0.0000000 NA 0.5244805
EHR_uncategorized_time_risk_factor_feature_value 0.1391099 0.8102191 0.8708724 0.8718599 0.9269435 0.0000000 0.5134872 0.6780888 0.7112003 0.8439370 0.8582029 0.5680403 0.5244805 NA 
## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

## `geom_smooth()` using formula = 'y ~ x'

Combined ANOVA Results for All Ehr FEATURE Variables by Safety Category
Variable Df Sum Sq Mean Sq F value Pr(>F)
safety_category…1 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 2 7.294635e+01 36.4731769 0.5313023 0.5885879
Residuals …2 EHR_usage_total_documentation_time_in_EHR_system_risk_factor_feature_value 221 1.517135e+04 68.6486366 NA NA
safety_category…3 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 2 3.739113e+01 18.6955654 0.5145987 0.5984549
Residuals …4 EHR_usage_time_spent_on_vitals_in_EHR_system_risk_factor_feature_value 221 8.029014e+03 36.3303795 NA NA
safety_category…5 EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 2 1.151647e+01 5.7582372 0.3575914 0.6997627
Residuals …6 EHR_usage_time_spent_on_patient_history_risk_factor_feature_value 221 3.558728e+03 16.1028403 NA NA
safety_category…7 EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 2 1.045529e+03 522.7645218 0.4738065 0.6232587
Residuals …8 EHR_usage_time_spent_on_patient_education_risk_factor_feature_value 221 2.438358e+05 1103.3292396 NA NA
safety_category…9 EHR_usage_time_spent_on_orders_risk_factor_feature_value 2 1.276994e+00 0.6384968 0.4164901 0.6598735
Residuals …10 EHR_usage_time_spent_on_orders_risk_factor_feature_value 221 3.388023e+02 1.5330419 NA NA
safety_category…11 EHR_usage_time_spent_on_notes_risk_factor_feature_value 2 2.213267e+00 1.1066335 0.4477878 0.6396188
Residuals …12 EHR_usage_time_spent_on_notes_risk_factor_feature_value 221 5.461650e+02 2.4713347 NA NA
safety_category…13 EHR_usage_time_spent_on_messaging_risk_factor_feature_value 2 4.971100e-03 0.0024855 1.0067965 0.3670572
Residuals …14 EHR_usage_time_spent_on_messaging_risk_factor_feature_value 221 5.455979e-01 0.0024688 NA NA
safety_category…15 EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 2 8.617586e+02 430.8792933 1.1731498 0.3113100
Residuals …16 EHR_usage_time_spent_on_EHR_system_risk_factor_feature_value 221 8.116979e+04 367.2841090 NA NA
safety_category…17 EHR_usage_time_spent_on_charging_risk_factor_feature_value 2 5.926241e+00 2.9631205 0.1008247 0.9041331
Residuals …18 EHR_usage_time_spent_on_charging_risk_factor_feature_value 221 6.494932e+03 29.3888312 NA NA
safety_category…19 EHR_usage_time_spent_on_assessment_risk_factor_feature_value 2 2.526118e+00 1.2630589 0.1634091 0.8493462
Residuals …20 EHR_usage_time_spent_on_assessment_risk_factor_feature_value 221 1.708203e+03 7.7294260 NA NA
safety_category…21 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 2 5.369313e+00 2.6846567 0.6608301 0.5174399
Residuals …22 EHR_usage_time_spent_on_alerts_such_as_best_practice_advisories_risk_factor_feature_value 221 8.978241e+02 4.0625523 NA NA
safety_category…23 EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 2 2.688645e+00 1.3443223 1.0547059 0.3500413
Residuals …24 EHR_usage_time_spent_on_administrative_processes_risk_factor_feature_value 221 2.816854e+02 1.2745945 NA NA
safety_category…25 EHR_uncategorized_time_risk_factor_feature_value 2 1.660000e-04 0.0000830 0.0867865 0.9169041
Residuals …26 EHR_uncategorized_time_risk_factor_feature_value 221 2.113475e-01 0.0009563 NA NA