Test AUC

0.74

Test Accuracy

81.0%

Held-out Patients

84

CV AUC (5-fold)

0.785 ± 0.029

Dataset & Split Summary
Item Value
Total patients (OHHR) 581
Patients with clinical HL (PTA > 20 dB) 417
Churn rate (at-risk) 77.2%
Training set (80%) 333
Test set (20%) 84
Split method initial_split() — tidymodels
Stratification Stratified by churn_risk
Positive class at_risk (first factor level — event_level = ‘first’)
Imputation Median imputation (step_impute_median)
Churn Proxy Definition
Label Condition Count
At-risk (non-adopter) PTA > 25 dB AND not currently using HA 115
At-risk (under-user) Using HA but < 4 hours/day 14
At-risk (poor outcome) Using HA but effectiveness ≤ 2 (reversed 1–5 scale) 193
Engaged Using HA ≥ 4h/day AND effectiveness ≥ 3 95
Excluded PTA ≤ 20 dB and not using HA (no clinical need) 164
Model Specification
Parameter Value
Model type Gradient Boosting (boost_tree)
Engine LightGBM (bonsai)
Trees 200
Max depth 3
Learning rate 0.05
Min node size 10
Subsample 0.8
Validation 5-fold stratified CV
Metrics ROC AUC, Accuracy, Sensitivity, Specificity
Cross-Validation Metrics (Training Set)
Metric Mean Std Error Folds
accuracy 0.8528 0.0111 5
roc_auc 0.7845 0.0288 5
sensitivity 0.9532 0.0078 5
specificity 0.5133 0.0327 5