Impact Interaction Analyses - DLF
Josh Wilson
5/7/2024
Next Steps
- Confirm what is in Events - Collaboratives might need to take them out and investigate individually
- Does impact interaction volume change if we look at last couple of FYs vs. the previous FYs?
- PLWs - what gets captured? Are they actually PLWs? Dissect the impact interaction categories and make sure we feel good about them.
DLF Analysis
The purpose of this analysis is to understand the variable effect of impact interactions on the likelihood of a partner to renew their partnership. Simply, which service levers matter more for partnership renewal.
Executive Summary
Methodological Considerations
The data set consists of decisions from FY19 through March of FY24 (April).
Similar to previous analyses, we are primarily looking at the year leading up to a decision.
Lastly, we are looking at unit renewal rates instead of $ renewal rates. This allows us to treat impact interactions equitably across partnerships.
Renewal by Decision Type
The below table should not come as a surprise. Opt Outs tend to perform very well while NNLOA can be quite mixed.
- Healthy amount of decisions in both buckets. Opt Outs clearly perform significantly better than NNLOA.
| DecisionType | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|
| Need New LOA | 192 | 114 | 78 | 1.5 | 59.4% |
| Opt Out | 201 | 171 | 30 | 5.7 | 85.1% |
| Total | 393 | 285 | 108 | 2.6 | 72.5% |
Renewals by Decision Type and Year
Since we are combining multiple years of data, we will frequently take a look at whether there are differences across the years.
- Last 3 FYs, NNLOA has been above 60% and vacillated a bit. We dipped below 60% this FY, which breaks with the threshold set by the past 3 FYs.
- Smaller N this FY than the previous FYs.
- Opt Out performance had been getting better FY19-FY21. Then you had a couple of years of similar performance, with a large swing in the positive for FY24.
| DecisionType | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 2020 | 10 | 3 | 7 | 0.4 | 30.0% |
| Need New LOA | 2021 | 40 | 26 | 14 | 1.9 | 65.0% |
| Need New LOA | 2022 | 55 | 33 | 22 | 1.5 | 60.0% |
| Need New LOA | 2023 | 62 | 39 | 23 | 1.7 | 62.9% |
| Need New LOA | 2024 | 25 | 13 | 12 | 1.1 | 52.0% |
| Opt Out | 2019 | 16 | 12 | 4 | 3.0 | 75.0% |
| Opt Out | 2020 | 45 | 38 | 7 | 5.4 | 84.4% |
| Opt Out | 2021 | 48 | 43 | 5 | 8.6 | 89.6% |
| Opt Out | 2022 | 39 | 32 | 7 | 4.6 | 82.1% |
| Opt Out | 2023 | 35 | 29 | 6 | 4.8 | 82.9% |
| Opt Out | 2024 | 18 | 17 | 1 | 17.0 | 94.4% |
| Total | NA | 393 | 285 | 108 | 2.6 | 72.5% |
Impact Interaction Volume Histogram
- Central tendency is just under 5.
- Lots of low utilizers in the 0-2 bucket.
- Bunch of partners in the 3-6 bucket.
- Longish tail starting around 7.l.
Impact Interaction Volume Histogram Split by Decision
- A lot of the drops are in the 0-3.
- Higher utilizers have fewer drops.
Impact Interaction Volume Histogram Split by Pool Date FY
- FY24 has a healthy spread from 3-9, with some partners in the 0-1 range.
- FY23 looks like it might have had a higher proportion in the 0-1 range.
Renewal by Interaction Volume and Decision Type, Unbinned
- [NNLOA] At least 4 and you start to see a healthy return.
- [Opt Out] 2+ looks good here.
| DecisionType | II_Credited_Volume | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 19 | 4 | 15 | 0.3 | 21.1% |
| Need New LOA | 1 | 19 | 7 | 12 | 0.6 | 36.8% |
| Need New LOA | 2 | 20 | 8 | 12 | 0.7 | 40.0% |
| Need New LOA | 3 | 32 | 16 | 16 | 1.0 | 50.0% |
| Need New LOA | 4 | 23 | 15 | 8 | 1.9 | 65.2% |
| Need New LOA | 5 | 21 | 15 | 6 | 2.5 | 71.4% |
| Need New LOA | 6 | 24 | 20 | 4 | 5.0 | 83.3% |
| Need New LOA | 7 | 12 | 12 | 0 | Inf | 100.0% |
| Need New LOA | 8 | 7 | 7 | 0 | Inf | 100.0% |
| Need New LOA | 9 | 5 | 2 | 3 | 0.7 | 40.0% |
| Need New LOA | 10 | 2 | 2 | 0 | Inf | 100.0% |
| Need New LOA | 11 | 1 | 1 | 0 | Inf | 100.0% |
| Need New LOA | 12 | 2 | 1 | 1 | 1.0 | 50.0% |
| Need New LOA | 13 | 2 | 2 | 0 | Inf | 100.0% |
| Need New LOA | 14 | 1 | 0 | 1 | 0.0 | 0.0% |
| Need New LOA | 16 | 1 | 1 | 0 | Inf | 100.0% |
| Need New LOA | 17 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 0 | 17 | 10 | 7 | 1.4 | 58.8% |
| Opt Out | 1 | 27 | 21 | 6 | 3.5 | 77.8% |
| Opt Out | 2 | 18 | 15 | 3 | 5.0 | 83.3% |
| Opt Out | 3 | 11 | 9 | 2 | 4.5 | 81.8% |
| Opt Out | 4 | 20 | 17 | 3 | 5.7 | 85.0% |
| Opt Out | 5 | 24 | 21 | 3 | 7.0 | 87.5% |
| Opt Out | 6 | 16 | 14 | 2 | 7.0 | 87.5% |
| Opt Out | 7 | 15 | 14 | 1 | 14.0 | 93.3% |
| Opt Out | 8 | 10 | 10 | 0 | Inf | 100.0% |
| Opt Out | 9 | 16 | 14 | 2 | 7.0 | 87.5% |
| Opt Out | 10 | 8 | 8 | 0 | Inf | 100.0% |
| Opt Out | 11 | 8 | 7 | 1 | 7.0 | 87.5% |
| Opt Out | 12 | 2 | 2 | 0 | Inf | 100.0% |
| Opt Out | 13 | 3 | 3 | 0 | Inf | 100.0% |
| Opt Out | 14 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 16 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 17 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 18 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 19 | 2 | 2 | 0 | Inf | 100.0% |
Renewal by Impact Interaction Volume and Decision Type, (Binned)
Adjusted the binning to better capture the high volume present in URF.
- For NNLOA, binning makes 4+ look like a solid space.
- For Opt Out, as suggested above, 2+.
| DecisionType | II_Volume_Bins | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 19 | 4 | 15 | 0.3 | 21.1% |
| Need New LOA | 1 | 19 | 7 | 12 | 0.6 | 36.8% |
| Need New LOA | 2-3 | 52 | 24 | 28 | 0.9 | 46.2% |
| Need New LOA | 4-6 | 68 | 50 | 18 | 2.8 | 73.5% |
| Need New LOA | 7+ | 34 | 29 | 5 | 5.8 | 85.3% |
| Opt Out | 0 | 17 | 10 | 7 | 1.4 | 58.8% |
| Opt Out | 1 | 27 | 21 | 6 | 3.5 | 77.8% |
| Opt Out | 2-3 | 29 | 24 | 5 | 4.8 | 82.8% |
| Opt Out | 4-6 | 60 | 52 | 8 | 6.5 | 86.7% |
| Opt Out | 7+ | 68 | 64 | 4 | 16.0 | 94.1% |
#####Simple Regression for Impact Interaction Volume
- The Estimate for Impact Interaction Volume is Positive -> increased consumption means increased likelihood to renew.
- This is statistically significant.
##
## Call:
## glm(formula = Target_Binary ~ II_Credited_Volume, family = "binomial",
## data = df_nnloa)
##
## Coefficients:
## Estimate Std. Error z value Pr(>|z|)
## (Intercept) -0.84386 0.28771 -2.933 0.00336 **
## II_Credited_Volume 0.31735 0.06768 4.689 2.75e-06 ***
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
## (Dispersion parameter for binomial family taken to be 1)
##
## Null deviance: 259.38 on 191 degrees of freedom
## Residual deviance: 230.05 on 190 degrees of freedom
## AIC: 234.05
##
## Number of Fisher Scoring iterations: 4Penetration by Event Grouping
Reminder: 1. Experience = VIP Days & Collaboratives
Service = Benchmarking, Audits, Secret Shopper, Customer Research Projects, Market Insights, and Survey Walkthroughs
Expert Call = Expert Center, Benchmarking Walkthrough, Tool’s Walkthrough
SL Led = Research SL Impact, Evergreen Action, Exec Update, National Meeting Pre-wire
Research Interview = Research Initial & Scoping
Events = National Meeting, COVID Working Group
PLW/Onsite = Onsite, PLW
Events and Expert Calls are the highest penetration. Research interviews follows suit in third.
Research Interviews favors Opt Outs, with Onsites/PLW, and Expert Calls.
| DecisionType | Perc_Events | Perc_Service | Perc_SLLed | Perc_ResearchInt | Perc_PLW_Onsite | Perc_Experience | Perc_ExpertCall |
|---|---|---|---|---|---|---|---|
| Need New LOA | 67.2% | 20.3% | 7.8% | 39.6% | 16.7% | 0.0% | 59.4% |
| Opt Out | 68.2% | 19.4% | 15.4% | 50.2% | 20.9% | 0.0% | 65.7% |
Renewal by Event Consumption
- [NNLOA] 10% bump above the average. Giant leap above not consuming - 32%.
- [Opt Out] Large effect for Opt Outs, as well, 15% lift vs. not consuming. However, consuming only small lift above average 5%.
| DecisionType | II_Events_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 63 | 24 | 39 | 0.6 | 38.1% |
| Need New LOA | 1 | 129 | 90 | 39 | 2.3 | 69.8% |
| Opt Out | 0 | 64 | 48 | 16 | 3.0 | 75.0% |
| Opt Out | 1 | 137 | 123 | 14 | 8.8 | 89.8% |
Renewal by Event Consumption Volume
- 2+ Event seems better than 1, which tracks roughly to the overall average renewal rate.
Renewal by Event, OT
- [NNLOA] Oddly every other year you see a spike in NNNLOA performance.
- [Opt Out] Relatively consistent performance across the FYs.
| DecisionType | II_Events_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2020 | 6 | 2 | 4 | 0.5 | 33.3% |
| Need New LOA | 0 | 2021 | 17 | 8 | 9 | 0.9 | 47.1% |
| Need New LOA | 0 | 2022 | 13 | 6 | 7 | 0.9 | 46.2% |
| Need New LOA | 0 | 2023 | 17 | 4 | 13 | 0.3 | 23.5% |
| Need New LOA | 0 | 2024 | 10 | 4 | 6 | 0.7 | 40.0% |
| Need New LOA | 1 | 2020 | 4 | 1 | 3 | 0.3 | 25.0% |
| Need New LOA | 1 | 2021 | 23 | 18 | 5 | 3.6 | 78.3% |
| Need New LOA | 1 | 2022 | 42 | 27 | 15 | 1.8 | 64.3% |
| Need New LOA | 1 | 2023 | 45 | 35 | 10 | 3.5 | 77.8% |
| Need New LOA | 1 | 2024 | 15 | 9 | 6 | 1.5 | 60.0% |
| Opt Out | 0 | 2019 | 4 | 3 | 1 | 3.0 | 75.0% |
| Opt Out | 0 | 2020 | 11 | 8 | 3 | 2.7 | 72.7% |
| Opt Out | 0 | 2021 | 14 | 11 | 3 | 3.7 | 78.6% |
| Opt Out | 0 | 2022 | 13 | 8 | 5 | 1.6 | 61.5% |
| Opt Out | 0 | 2023 | 15 | 11 | 4 | 2.8 | 73.3% |
| Opt Out | 0 | 2024 | 7 | 7 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2019 | 12 | 9 | 3 | 3.0 | 75.0% |
| Opt Out | 1 | 2020 | 34 | 30 | 4 | 7.5 | 88.2% |
| Opt Out | 1 | 2021 | 34 | 32 | 2 | 16.0 | 94.1% |
| Opt Out | 1 | 2022 | 26 | 24 | 2 | 12.0 | 92.3% |
| Opt Out | 1 | 2023 | 20 | 18 | 2 | 9.0 | 90.0% |
| Opt Out | 1 | 2024 | 11 | 10 | 1 | 10.0 | 90.9% |
Renewal by Service Consumption
- [NNLOA] No real lift here.
- [Opt Out] No real lift here.
| DecisionType | II_Service_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 153 | 91 | 62 | 1.5 | 59.5% |
| Need New LOA | 1 | 39 | 23 | 16 | 1.4 | 59.0% |
| Opt Out | 0 | 162 | 137 | 25 | 5.5 | 84.6% |
| Opt Out | 1 | 39 | 34 | 5 | 6.8 | 87.2% |
Renewal by Service Consumption Volume
- Most consume 1 of these, if any.
Renewal by Service Consumption, OT
- [NNLOA] Not many for FY24.
- [Opt Out] Not many for FY24.
| DecisionType | II_Service_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2020 | 10 | 3 | 7 | 0.4 | 30.0% |
| Need New LOA | 0 | 2021 | 40 | 26 | 14 | 1.9 | 65.0% |
| Need New LOA | 0 | 2022 | 35 | 21 | 14 | 1.5 | 60.0% |
| Need New LOA | 0 | 2023 | 45 | 29 | 16 | 1.8 | 64.4% |
| Need New LOA | 0 | 2024 | 23 | 12 | 11 | 1.1 | 52.2% |
| Need New LOA | 1 | 2022 | 20 | 12 | 8 | 1.5 | 60.0% |
| Need New LOA | 1 | 2023 | 17 | 10 | 7 | 1.4 | 58.8% |
| Need New LOA | 1 | 2024 | 2 | 1 | 1 | 1.0 | 50.0% |
| Opt Out | 0 | 2019 | 6 | 3 | 3 | 1.0 | 50.0% |
| Opt Out | 0 | 2020 | 38 | 33 | 5 | 6.6 | 86.8% |
| Opt Out | 0 | 2021 | 48 | 43 | 5 | 8.6 | 89.6% |
| Opt Out | 0 | 2022 | 25 | 20 | 5 | 4.0 | 80.0% |
| Opt Out | 0 | 2023 | 31 | 25 | 6 | 4.2 | 80.6% |
| Opt Out | 0 | 2024 | 14 | 13 | 1 | 13.0 | 92.9% |
| Opt Out | 1 | 2019 | 10 | 9 | 1 | 9.0 | 90.0% |
| Opt Out | 1 | 2020 | 7 | 5 | 2 | 2.5 | 71.4% |
| Opt Out | 1 | 2022 | 14 | 12 | 2 | 6.0 | 85.7% |
| Opt Out | 1 | 2023 | 4 | 4 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2024 | 4 | 4 | 0 | Inf | 100.0% |
Renewal by SL Consumption
- [NNLOA] Marginal benefit, almost no lift. Small N.
- [Opt Out] 5-6% lift above average. Not large volume.
| DecisionType | II_SLLed_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 177 | 105 | 72 | 1.5 | 59.3% |
| Need New LOA | 1 | 15 | 9 | 6 | 1.5 | 60.0% |
| Opt Out | 0 | 170 | 143 | 27 | 5.3 | 84.1% |
| Opt Out | 1 | 31 | 28 | 3 | 9.3 | 90.3% |
SL Consumption Volume & Renewal
- Mostly only one consumed.
Renewal by SL Consumption, OT
No data.
| DecisionType | II_SLLed_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2020 | 9 | 2 | 7 | 0.3 | 22.2% |
| Need New LOA | 0 | 2021 | 27 | 19 | 8 | 2.4 | 70.4% |
| Need New LOA | 0 | 2022 | 54 | 32 | 22 | 1.5 | 59.3% |
| Need New LOA | 0 | 2023 | 62 | 39 | 23 | 1.7 | 62.9% |
| Need New LOA | 0 | 2024 | 25 | 13 | 12 | 1.1 | 52.0% |
| Need New LOA | 1 | 2020 | 1 | 1 | 0 | Inf | 100.0% |
| Need New LOA | 1 | 2021 | 13 | 7 | 6 | 1.2 | 53.8% |
| Need New LOA | 1 | 2022 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 0 | 2019 | 14 | 12 | 2 | 6.0 | 85.7% |
| Opt Out | 0 | 2020 | 36 | 29 | 7 | 4.1 | 80.6% |
| Opt Out | 0 | 2021 | 30 | 26 | 4 | 6.5 | 86.7% |
| Opt Out | 0 | 2022 | 37 | 30 | 7 | 4.3 | 81.1% |
| Opt Out | 0 | 2023 | 35 | 29 | 6 | 4.8 | 82.9% |
| Opt Out | 0 | 2024 | 18 | 17 | 1 | 17.0 | 94.4% |
| Opt Out | 1 | 2019 | 2 | 0 | 2 | 0.0 | 0.0% |
| Opt Out | 1 | 2020 | 9 | 9 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2021 | 18 | 17 | 1 | 17.0 | 94.4% |
| Opt Out | 1 | 2022 | 2 | 2 | 0 | Inf | 100.0% |
Renewal by Research Interview Consumption
- [NNLOA] Small lift, 5%.
- [Opt out] No real lift.
| DecisionType | II_ResearchInterview_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 116 | 66 | 50 | 1.3 | 56.9% |
| Need New LOA | 1 | 76 | 48 | 28 | 1.7 | 63.2% |
| Opt Out | 0 | 100 | 83 | 17 | 4.9 | 83.0% |
| Opt Out | 1 | 101 | 88 | 13 | 6.8 | 87.1% |
Research Interview Volume & Renewal
- 2+ looks good.
Renewal By Research Interview Consumption, OT
- [NNLOA] FY24 is light on this interaction. Although FY23/FY24 look to have larger lift.
- [Opt Out] Stablish across time.
| DecisionType | II_ResearchInterview_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2020 | 2 | 1 | 1 | 1.0 | 50.0% |
| Need New LOA | 0 | 2021 | 29 | 18 | 11 | 1.6 | 62.1% |
| Need New LOA | 0 | 2022 | 31 | 19 | 12 | 1.6 | 61.3% |
| Need New LOA | 0 | 2023 | 35 | 18 | 17 | 1.1 | 51.4% |
| Need New LOA | 0 | 2024 | 19 | 10 | 9 | 1.1 | 52.6% |
| Need New LOA | 1 | 2020 | 8 | 2 | 6 | 0.3 | 25.0% |
| Need New LOA | 1 | 2021 | 11 | 8 | 3 | 2.7 | 72.7% |
| Need New LOA | 1 | 2022 | 24 | 14 | 10 | 1.4 | 58.3% |
| Need New LOA | 1 | 2023 | 27 | 21 | 6 | 3.5 | 77.8% |
| Need New LOA | 1 | 2024 | 6 | 3 | 3 | 1.0 | 50.0% |
| Opt Out | 0 | 2019 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 0 | 2020 | 11 | 9 | 2 | 4.5 | 81.8% |
| Opt Out | 0 | 2021 | 34 | 29 | 5 | 5.8 | 85.3% |
| Opt Out | 0 | 2022 | 21 | 16 | 5 | 3.2 | 76.2% |
| Opt Out | 0 | 2023 | 22 | 17 | 5 | 3.4 | 77.3% |
| Opt Out | 0 | 2024 | 11 | 11 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2019 | 15 | 11 | 4 | 2.8 | 73.3% |
| Opt Out | 1 | 2020 | 34 | 29 | 5 | 5.8 | 85.3% |
| Opt Out | 1 | 2021 | 14 | 14 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2022 | 18 | 16 | 2 | 8.0 | 88.9% |
| Opt Out | 1 | 2023 | 13 | 12 | 1 | 12.0 | 92.3% |
| Opt Out | 1 | 2024 | 7 | 6 | 1 | 6.0 | 85.7% |
Renewal by PLW OR Onsite Consumption
- [NNLOA] Small N, but huge lift when delivered - 20% above avg.
- [Opt Out] Marginal effect.
| DecisionType | II_PLW_Onsite_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 160 | 88 | 72 | 1.2 | 55.0% |
| Need New LOA | 1 | 32 | 26 | 6 | 4.3 | 81.2% |
| Opt Out | 0 | 159 | 134 | 25 | 5.4 | 84.3% |
| Opt Out | 1 | 42 | 37 | 5 | 7.4 | 88.1% |
PLW / Onsite Volume & Renewal
- 1 seems sufficient.
Renewal by PLW/Onsite OT
- [NNLOA] Last two year of data is super!
- [Opt Out] Same as NNLOA.
| DecisionType | II_PLW_Onsite_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2020 | 7 | 2 | 5 | 0.4 | 28.6% |
| Need New LOA | 0 | 2021 | 33 | 20 | 13 | 1.5 | 60.6% |
| Need New LOA | 0 | 2022 | 48 | 28 | 20 | 1.4 | 58.3% |
| Need New LOA | 0 | 2023 | 52 | 30 | 22 | 1.4 | 57.7% |
| Need New LOA | 0 | 2024 | 20 | 8 | 12 | 0.7 | 40.0% |
| Need New LOA | 1 | 2020 | 3 | 1 | 2 | 0.5 | 33.3% |
| Need New LOA | 1 | 2021 | 7 | 6 | 1 | 6.0 | 85.7% |
| Need New LOA | 1 | 2022 | 7 | 5 | 2 | 2.5 | 71.4% |
| Need New LOA | 1 | 2023 | 10 | 9 | 1 | 9.0 | 90.0% |
| Need New LOA | 1 | 2024 | 5 | 5 | 0 | Inf | 100.0% |
| Opt Out | 0 | 2019 | 11 | 8 | 3 | 2.7 | 72.7% |
| Opt Out | 0 | 2020 | 31 | 27 | 4 | 6.8 | 87.1% |
| Opt Out | 0 | 2021 | 39 | 34 | 5 | 6.8 | 87.2% |
| Opt Out | 0 | 2022 | 35 | 29 | 6 | 4.8 | 82.9% |
| Opt Out | 0 | 2023 | 30 | 24 | 6 | 4.0 | 80.0% |
| Opt Out | 0 | 2024 | 13 | 12 | 1 | 12.0 | 92.3% |
| Opt Out | 1 | 2019 | 5 | 4 | 1 | 4.0 | 80.0% |
| Opt Out | 1 | 2020 | 14 | 11 | 3 | 3.7 | 78.6% |
| Opt Out | 1 | 2021 | 9 | 9 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2022 | 4 | 3 | 1 | 3.0 | 75.0% |
| Opt Out | 1 | 2023 | 5 | 5 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2024 | 5 | 5 | 0 | Inf | 100.0% |
Renewal by Experience Consumption
No consumption.
| DecisionType | II_Experience_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 192 | 114 | 78 | 1.5 | 59.4% |
| Opt Out | 0 | 201 | 171 | 30 | 5.7 | 85.1% |
Experience Volume & Renewal
No consumption.
Renewal by Experience Consumption OT
No consumption.
| DecisionType | II_Experience_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2020 | 10 | 3 | 7 | 0.4 | 30.0% |
| Need New LOA | 0 | 2021 | 40 | 26 | 14 | 1.9 | 65.0% |
| Need New LOA | 0 | 2022 | 55 | 33 | 22 | 1.5 | 60.0% |
| Need New LOA | 0 | 2023 | 62 | 39 | 23 | 1.7 | 62.9% |
| Need New LOA | 0 | 2024 | 25 | 13 | 12 | 1.1 | 52.0% |
| Opt Out | 0 | 2019 | 16 | 12 | 4 | 3.0 | 75.0% |
| Opt Out | 0 | 2020 | 45 | 38 | 7 | 5.4 | 84.4% |
| Opt Out | 0 | 2021 | 48 | 43 | 5 | 8.6 | 89.6% |
| Opt Out | 0 | 2022 | 39 | 32 | 7 | 4.6 | 82.1% |
| Opt Out | 0 | 2023 | 35 | 29 | 6 | 4.8 | 82.9% |
| Opt Out | 0 | 2024 | 18 | 17 | 1 | 17.0 | 94.4% |
Renewal by Expert Call Consumption
- [NNLOA] Small lift above the average. Not a large drop if not consumed.
- [Opt Out] 5% of lift above the average.
| DecisionType | II_ExpertCall_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 78 | 43 | 35 | 1.2 | 55.1% |
| Need New LOA | 1 | 114 | 71 | 43 | 1.7 | 62.3% |
| Opt Out | 0 | 69 | 53 | 16 | 3.3 | 76.8% |
| Opt Out | 1 | 132 | 118 | 14 | 8.4 | 89.4% |
Expert Call Volume & Renewal
- Decent degree of utilizationm. Effect might be closer to 3+.
Renewal by Expert Call Consumption OT
- [NNLOA] Mostly consistent, except FY23
- [Opt Out] Effect has been pretty strong the past two years.
| DecisionType | II_ExpertCall_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2020 | 2 | 0 | 2 | 0.0 | 0.0% |
| Need New LOA | 0 | 2021 | 14 | 9 | 5 | 1.8 | 64.3% |
| Need New LOA | 0 | 2022 | 17 | 8 | 9 | 0.9 | 47.1% |
| Need New LOA | 0 | 2023 | 29 | 19 | 10 | 1.9 | 65.5% |
| Need New LOA | 0 | 2024 | 16 | 7 | 9 | 0.8 | 43.8% |
| Need New LOA | 1 | 2020 | 8 | 3 | 5 | 0.6 | 37.5% |
| Need New LOA | 1 | 2021 | 26 | 17 | 9 | 1.9 | 65.4% |
| Need New LOA | 1 | 2022 | 38 | 25 | 13 | 1.9 | 65.8% |
| Need New LOA | 1 | 2023 | 33 | 20 | 13 | 1.5 | 60.6% |
| Need New LOA | 1 | 2024 | 9 | 6 | 3 | 2.0 | 66.7% |
| Opt Out | 0 | 2019 | 4 | 2 | 2 | 1.0 | 50.0% |
| Opt Out | 0 | 2020 | 11 | 10 | 1 | 10.0 | 90.9% |
| Opt Out | 0 | 2021 | 16 | 13 | 3 | 4.3 | 81.2% |
| Opt Out | 0 | 2022 | 10 | 7 | 3 | 2.3 | 70.0% |
| Opt Out | 0 | 2023 | 17 | 11 | 6 | 1.8 | 64.7% |
| Opt Out | 0 | 2024 | 11 | 10 | 1 | 10.0 | 90.9% |
| Opt Out | 1 | 2019 | 12 | 10 | 2 | 5.0 | 83.3% |
| Opt Out | 1 | 2020 | 34 | 28 | 6 | 4.7 | 82.4% |
| Opt Out | 1 | 2021 | 32 | 30 | 2 | 15.0 | 93.8% |
| Opt Out | 1 | 2022 | 29 | 25 | 4 | 6.2 | 86.2% |
| Opt Out | 1 | 2023 | 18 | 18 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2024 | 7 | 7 | 0 | Inf | 100.0% |
Finer Grain Look at What Was Consumed
Event Category and Event Purpose
- Benchmark looks very good.
- Tool’s walkthrough.
- SL Led - Return to learn.
| Event_Category | EventPurpose | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Audits and Diagnostics | K-12 Short-Term DEIJ Plan Review | 5 | 2 | 3 | 0.7 | 40.0% |
| Benchmark | DLF Survey: Managing Disruptive Behaviors Member Survey | 17 | 14 | 3 | 4.7 | 82.4% |
| COVID Working Group Session | DLF COVID 19 Return to School | 10 | 9 | 1 | 9.0 | 90.0% |
| COVID Working Group Session | DLF COVID-19 Working Group Session | 15 | 12 | 3 | 4.0 | 80.0% |
| COVID Working Group Session | DLF Lessons Learned COVID in Case Reclosures | 1 | 1 | 0 | Inf | 100.0% |
| COVID Working Group Session | Pulling Up on Learning Acceleration: Superintendent Focus Group Discussion on What’s Working So Far, | 18 | 15 | 3 | 5.0 | 83.3% |
| Expert Center | DEIJ Expert Call | 1 | 1 | 0 | Inf | 100.0% |
| Expert Center | EAB| DLF Match Webinar *duplicate for logging | 1 | 1 | 0 | Inf | 100.0% |
| Expert Center | Expert Center | 131 | 100 | 43 | 2.3 | 76.3% |
| Expert Center | Expert Center Call | 24 | 15 | 9 | 1.7 | 62.5% |
| Expert Center | PLW | Preparing Principals to Lead | 1 | 1 | 0 | Inf | 100.0% |
| Expert Center | Planning Call | 1 | 1 | 0 | Inf | 100.0% |
| Expert Center | Principal Support Design Lab Overview | 1 | 1 | 0 | Inf | 100.0% |
| Expert Center | Principal Support Design Lab SME call | 1 | 0 | 1 | 0.0 | 0.0% |
| Expert Center | Principal Support System Design Lab | 1 | 1 | 0 | Inf | 100.0% |
| Expert Center | SME | DEIJ Revised Plan Review Debrief Call | 1 | 1 | 0 | Inf | 100.0% |
| Expert Center | SME| Black Hole Campaign Call | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Absenteeism | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Academic achievements and impacts Montessori Schools have on students | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Accountability measures | 1 | 0 | 1 | 0.0 | 0.0% |
| K-12 On Demand | After school programming | 1 | 0 | 1 | 0.0 | 0.0% |
| K-12 On Demand | Alternative Programs | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Change Management | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Chronic absenteeism within Native American population | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Custom Request | Class Rank and College Admissions | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Dual Enrollment | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Dual Language Immersion Programs at Texas Public School Districts | 1 | 0 | 1 | 0.0 | 0.0% |
| K-12 On Demand | ELA instruction in MS and HS | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | ELL Students reading below grade level | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Early language learning programs | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Effectiveness of AVID to prepare students for success in post-secondary | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Elementary Alternative Education Options | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Evergreen DLF - personalization | 1 | 0 | 1 | 0.0 | 0.0% |
| K-12 On Demand | Extending School Time | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Facilities Master Plan | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | First on-Demand - 1:1 Technology | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | First on-demand | 2 | 1 | 1 | 1.0 | 50.0% |
| K-12 On Demand | First on-demand - ELL | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | GT Learners | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Gallup McKinnley APTT in grades 6-12 | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Impact of AP/IB Coursework and Homework on Mental Health | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Instructional Coaches On-Demand | 1 | 0 | 1 | 0.0 | 0.0% |
| K-12 On Demand | Math Instruction | 1 | 0 | 1 | 0.0 | 0.0% |
| K-12 On Demand | Measuring K-12 Students’ Soft Skills | 1 | 0 | 1 | 0.0 | 0.0% |
| K-12 On Demand | Mental Health | 1 | 0 | 1 | 0.0 | 0.0% |
| K-12 On Demand | Middle Level Gifted and Talented Services | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Middle school behavior | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Middle school scheduling | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | On-Demand Community Involvement in Budgeting Request | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | On-Demand Request: Family Engagement | 1 | 0 | 1 | 0.0 | 0.0% |
| K-12 On Demand | On-Demand Request: MAP vs. STAR | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | On-Demand Research Request - Dual Language Immersion | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | On-demand request form: Approaches to primary (K-2) Gifted identification and Services | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | On-demand request form: SROs | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | On-demand teacher conferences | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | PLCs | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Parent outreach - on-demand | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Preventing and Addressing Cyberbullying | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Princeton Model | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Program evaluation models | 1 | 0 | 1 | 0.0 | 0.0% |
| K-12 On Demand | RTI | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | SEL | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | School to Family/Community Communication and Home Visits | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Standards based grading | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Standards-Referenced Grading Practices | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Stop It App | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Strategies for School Closure | 1 | 0 | 1 | 0.0 | 0.0% |
| K-12 On Demand | Summer Programs for Kindergarten and Sixth Grade Readiness | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Talent Development Models | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Teacher induction programs | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Teacher mentoring | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Weight Grades | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | Weight Grades - updated research from 1990’s study | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | full-day kindergarten program versus a half day program | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | second on-demand on Foreign Languages | 1 | 1 | 0 | Inf | 100.0% |
| K-12 On Demand | NA | 2 | 2 | 0 | Inf | 100.0% |
| K-12 Webinar | DLF (Virtual 15 Sep 2020) | 21 | 19 | 2 | 9.5 | 90.5% |
| K-12 Webinar | DLF (Virtual 20 Aug 2020) | 7 | 5 | 2 | 2.5 | 71.4% |
| K-12 Webinar | DLF (Virtual 24 Sep 2020) | 26 | 21 | 5 | 4.2 | 80.8% |
| K-12 Webinar | DLF (Virtual 27 Aug 2020) | 25 | 23 | 2 | 11.5 | 92.0% |
| K-12 Webinar | DLF (Virtual 8 Sep 2020) | 14 | 12 | 2 | 6.0 | 85.7% |
| K-12 Webinar | DLF AAF SAF HESF (Virtual 22 Sep 2020) | 28 | 24 | 4 | 6.0 | 85.7% |
| K-12 Webinar | DLF CTO (Virtual 28 Oct 2020) | 14 | 11 | 3 | 3.7 | 78.6% |
| K-12 Webinar | DLF ISEF (Virtual 18 Aug 2020) | 19 | 16 | 3 | 5.3 | 84.2% |
| National Meeting | 2017-2018 District Leadership Forum, Chicago, IL | 1 | 0 | 1 | 0.0 | 0.0% |
| National Meeting | 2017-2018 District Leadership Forum, Washington, DC | 3 | 3 | 0 | Inf | 100.0% |
| National Meeting | 2018 District Leadership Forum Special Session, Vancouver, WA | 1 | 0 | 1 | 0.0 | 0.0% |
| National Meeting | 2018-2019 District Leadership Forum, Dallas, TX | 9 | 9 | 0 | Inf | 100.0% |
| National Meeting | 2018-2019 District Leadership Forum, Los Angeles, CA | 3 | 2 | 1 | 2.0 | 66.7% |
| National Meeting | 2018-2019 District Leadership Forum, Washington, DC | 25 | 22 | 3 | 7.3 | 88.0% |
| National Meeting | 2019 District Leadership Forum Special Session, Tyler, TX | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | 2019-2020 District Leadership Forum National Meeting, | 32 | 28 | 4 | 7.0 | 87.5% |
| National Meeting | 2019-2020 District Leadership Forum National Meeting, Austin, TX | 8 | 7 | 1 | 7.0 | 87.5% |
| National Meeting | 2019-2020 District Leadership Forum National Meeting, Los Angeles, CA | 3 | 1 | 2 | 0.5 | 33.3% |
| National Meeting | 2019-2020 District Leadership Forum National Meeting, Washington, DC | 9 | 8 | 1 | 8.0 | 88.9% |
| National Meeting | 2020 Virtual Superintendent Roundtable on “Return to Learn” Planning, | 26 | 23 | 3 | 7.7 | 88.5% |
| National Meeting | 2023 Executive Roundtable for District Superintendents, | 20 | 18 | 2 | 9.0 | 90.0% |
| National Meeting | 2024 Executive Roundtable for District Superintendents, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | A Roadmap for Effective and Efficient Mental Health Care in California Schools, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | Collaborative for Creating Conditions for Positive Student Behavior: An EAB-led Experience for Schoo, | 11 | 11 | 0 | Inf | 100.0% |
| National Meeting | Connected Cohort: Collaborative for Creating Conditions for Positive Student Behavior, | 4 | 4 | 0 | Inf | 100.0% |
| National Meeting | DLF Collaborative to Improve Teacher Morale: Back-to-School Planning, | 10 | 10 | 0 | Inf | 100.0% |
| National Meeting | DLF Collaborative to Improve Teacher Morale: Co-Design Solutions Part II, | 8 | 8 | 0 | Inf | 100.0% |
| National Meeting | DLF Collaborative to Improve Teacher Morale: Diagnose Causes, | 10 | 10 | 0 | Inf | 100.0% |
| National Meeting | DLF Collaborative to Improve Teacher Morale: Kickoff, | 13 | 12 | 1 | 12.0 | 92.3% |
| National Meeting | DLF Collaborative to Improve Teacher Morale: Prioritize Threats, | 8 | 8 | 0 | Inf | 100.0% |
| National Meeting | DLF Collaborative to Improve Teacher Morale: Progress Monitoring, | 8 | 7 | 1 | 7.0 | 87.5% |
| National Meeting | DLF Prospect Roundtables, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | DLF Raising Teacher Morale Collaborative: Co-Design Solutions, | 8 | 6 | 2 | 3.0 | 75.0% |
| National Meeting | DLF Raising Teacher Morale Collaborative: Diagnosing Causes, | 14 | 13 | 1 | 13.0 | 92.9% |
| National Meeting | DLF Raising Teacher Morale Collaborative: Kick Off, | 17 | 16 | 1 | 16.0 | 94.1% |
| National Meeting | DLF Raising Teacher Morale Collaborative: Prioritizing Threats, | 9 | 8 | 1 | 8.0 | 88.9% |
| National Meeting | DLF | EAB’s Nationwide Collaborative to Improve Teacher Morale Progress Monitoring: Planning for Per, | 4 | 3 | 1 | 3.0 | 75.0% |
| National Meeting | DLF | EAB’s Nationwide Collaborative to Improve Teacher Morale Progress Monitoring: Progress Monitor, | 2 | 2 | 0 | Inf | 100.0% |
| National Meeting | Developing a Security-First Culture: How to Fortify Your District Against Escalating Cyber Threats, | 7 | 6 | 1 | 6.0 | 85.7% |
| National Meeting | EAB and Coxsackie-Athens School District | Building a High-Performance District Leadership Team, | 2 | 2 | 0 | Inf | 100.0% |
| National Meeting | EAB and Mansfield ISD | How District Leaders Can Craft Strategy and Messaging for the 2021/22 School, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | EAB and Mansfield Park ISD | How District Leaders Can Craft Strategy and Messaging for the 2021/22 S, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | EAB and Waukegan CUSD 60 | Crafting Strategy and Communications to Advance Key Priorities in 2021, | 3 | 3 | 0 | Inf | 100.0% |
| National Meeting | EAB’s Nationwide Collaborative to Raise Teacher Morale Cohort Five: Diagnose Causes, | 3 | 3 | 0 | Inf | 100.0% |
| National Meeting | EAB’s Nationwide Collaborative to Raise Teacher Morale Cohort Five: Kickoff, | 3 | 3 | 0 | Inf | 100.0% |
| National Meeting | EAB’s Nationwide Collaborative to Raise Teacher Morale Cohort Five: Planning for Permanence, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | EAB’s Nationwide Collaborative to Raise Teacher Morale Cohort Five: Prioritize Threats, | 2 | 2 | 0 | Inf | 100.0% |
| National Meeting | EAB’s Nationwide Collaborative to Raise Teacher Morale: Co-Design Solutions, | 2 | 1 | 1 | 1.0 | 50.0% |
| National Meeting | EAB’s Nationwide Collaborative to Raise Teacher Morale: Diagnose Causes, | 3 | 1 | 2 | 0.5 | 33.3% |
| National Meeting | EAB’s Nationwide Collaborative to Raise Teacher Morale: Kickoff, | 5 | 4 | 1 | 4.0 | 80.0% |
| National Meeting | EAB’s Nationwide Collaborative to Raise Teacher Morale: Planning for Permanence, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | EAB’s Nationwide Collaborative to Raise Teacher Morale: Prioritize Threats, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | EAB’s Nationwide Collaborative to Raise Teacher Morale: Progress Monitoring #1, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | EAB’s Nationwide Collaborative to Raise Teacher Morale: Progress Monitoring #2, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | Efficient Problem Solving 101: An Introduction to Root Cause Analysis, | 3 | 3 | 0 | Inf | 100.0% |
| National Meeting | Executive Roundtable for District Superintendents: Rebuilding the Conditions for Schools to Thrive, | 22 | 21 | 1 | 21.0 | 95.5% |
| National Meeting | Hardwiring Effective Parent Communications to Improve Attendance, | 3 | 2 | 1 | 2.0 | 66.7% |
| National Meeting | Joint Virtual Working Session DLF and ISEF: Joint session with CEO of One Schoolhouse , | 5 | 4 | 1 | 4.0 | 80.0% |
| National Meeting | K-12’s Hidden Opportunities to Boost Postsecondary Success: How Students’ College Decision Making Ha, | 18 | 15 | 3 | 5.0 | 83.3% |
| National Meeting | K-12’s Path Forward: The Seven “Wonders” of a Post-Vaccine World, | 11 | 11 | 0 | Inf | 100.0% |
| National Meeting | K-12’s Path Forward: The Seven Wonders of a Post-Vaccine World, | 9 | 7 | 2 | 3.5 | 77.8% |
| National Meeting | Learning Recovery Leadership Workshop, | 16 | 14 | 2 | 7.0 | 87.5% |
| National Meeting | Learning Recovery Superintendent Workshop, | 1 | 0 | 1 | 0.0 | 0.0% |
| National Meeting | Narrowing the Third Grade Reading Gap, | 14 | 12 | 2 | 6.0 | 85.7% |
| National Meeting | New Superintendents Institute: Cultivating Community Trust and Confidence, | 3 | 3 | 0 | Inf | 100.0% |
| National Meeting | New Superintendents Institute: Launching a Strategic Superintendency, | 4 | 4 | 0 | Inf | 100.0% |
| National Meeting | New Superintendents Institute: Rethinking the Employee Experience, | 3 | 3 | 0 | Inf | 100.0% |
| National Meeting | Preparing Principals to Lead Strategy Summit for District Leaders in Illinois, | 7 | 7 | 0 | Inf | 100.0% |
| National Meeting | Preparing Principals to Lead Strategy Summit for District Leaders in Texas, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | Preparing for Your Next District Flashpoint: What Every District Leader Should Do Now to Help Naviga, | 20 | 17 | 3 | 5.7 | 85.0% |
| National Meeting | Reaching Today’s Parents to Reduce Chronic Absenteeism, | 2 | 2 | 0 | Inf | 100.0% |
| National Meeting | Recession Proof Your Budget: EAB Collaborative Series on Recession Planning, | 10 | 9 | 1 | 9.0 | 90.0% |
| National Meeting | Recession Proof Your Budget: EAB Collaborative Series on recession Planning, | 30 | 25 | 6 | 4.2 | 83.3% |
| National Meeting | Recovery Planning Collaborative for Virginia Division Leaders, | 4 | 4 | 0 | Inf | 100.0% |
| National Meeting | Supported Cohort: Collaborative for Creating Conditions for Positive Student Behavior, | 2 | 2 | 0 | Inf | 100.0% |
| National Meeting | Virtual Working Session DLF: Advancement Challenges Amidst COVID-19 Crisis, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | Virtual Working Session DLF: General Superintendents Session, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | Virtual Working Session DLF: Identfying Students in Need, | 2 | 2 | 0 | Inf | 100.0% |
| National Meeting | Virtual Working Session DLF: SEL in a Virtual World, | 3 | 2 | 1 | 2.0 | 66.7% |
| National Meeting | Virtual Working Session DLF: Serving Special Ed Students and IEP, | 4 | 3 | 1 | 3.0 | 75.0% |
| National Meeting | Virtual Working Session DLF: Special Ed, | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | Virtual Working Session DLF: Student Mental Health, | 3 | 2 | 1 | 2.0 | 66.7% |
| National Meeting | Virtual Working Session DLF: Supporting the Mental Health Needs of Teachers and Staff, | 1 | 0 | 1 | 0.0 | 0.0% |
| National Meeting | Voice of the Superintendent Series: Trailblazer Roundtables, | 10 | 6 | 4 | 1.5 | 60.0% |
| National Meeting | What It Takes to Boost Teacher Morale During the Pandemic: A Listening Tour with District Leaders, | 10 | 9 | 1 | 9.0 | 90.0% |
| National Meeting | What You Need to Know About the Postsecondary Success Crises: How the Pandemic Has Changed Student D, | 15 | 14 | 1 | 14.0 | 93.3% |
| National Meeting | Why Teacher Morale Became the Overlooked Barrier to Pandemic Recovery and How School Districts Can I, | 57 | 42 | 15 | 2.8 | 73.7% |
| Onsite | Early Literacy Framework Audit | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Expert Call | DLF | Root-Cause Analysis | 1 | 0 | 1 | 0.0 | 0.0% |
| Onsite | Hatboro Horsham Science of Reading Onsite | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Hold exp. 08/07 | Onsite | DLF | 10/29/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite l DLF l Presentation date: 11/6/18 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite l DLF l Presentation date: 6/12/18 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | DLF | 01/30/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | DLF | 02/27/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | DLF | 03/13/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | DLF | 05/29/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | DLF | 09/19/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | DLF | 12/04/2018 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | DLF | Date of Presentation: 2/2/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | DLF | Presentation Date: 06/06/2019 | 1 | 0 | 1 | 0.0 | 0.0% |
| Onsite | Onsite | DLF | Presentation Date: 07/22/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | DLF | Presentation Date: 07/31/2019 | 1 | 0 | 1 | 0.0 | 0.0% |
| Onsite | Onsite | DLF | Presentation Date: 12/13/18 | 1 | 0 | 1 | 0.0 | 0.0% |
| Onsite | Onsite | DLF | Presentation Date: July 17 &18, 2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite: Managing Behavioral Disruptions in Early Grades - DLF - 10/1/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite: Managing Behavioral Disruptions in Early Grades - DLF - 8/06/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite: Narrowing the 3rd Grade Reading Gap - DLF - 11/4/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite: Scope MtM Closing the College Access Gap - DLF - 1/14/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Partner Intensive | DLF | Chronic Absenteeism | 2 | 2 | 0 | Inf | 100.0% |
| Onsite | Partner Intensive | DLF | Narrowing 3rd Grade Reading Gap | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Partner Intensive | DLF | Narrowing the 3rd Grade Reading Gap | 2 | 2 | 0 | Inf | 100.0% |
| Onsite | Partner Intensive | DLF | Preparing Principals to Lead | 2 | 2 | 0 | Inf | 100.0% |
| Onsite | Partner Intensive | DLF | Principal Design Support Lab | 4 | 4 | 0 | Inf | 100.0% |
| Onsite | Partner Intensive | DLF | Principal Support Design Lab | 2 | 2 | 0 | Inf | 100.0% |
| Onsite | Partner Intensive | DLF | Root Cause Analysis | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Partner Intensive | DLF | Student Behavior | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Partner Intensive | DLF | Teacher Morale | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | NA | 7 | 3 | 4 | 0.8 | 42.9% |
| Research Initial | 2022 DTLF Cybersecurity Research | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Approaches to K-2 G/T Programs | 2 | 1 | 1 | 1.0 | 50.0% |
| Research Initial | Benchmarking Large Districts’ Student Support Services | 2 | 2 | 0 | Inf | 100.0% |
| Research Initial | DLF Flashpoint Response | 4 | 3 | 1 | 3.0 | 75.0% |
| Research Initial | District Program Evaluation | 3 | 3 | 0 | Inf | 100.0% |
| Research Initial | Dual Language Immersion Programs | 4 | 3 | 1 | 3.0 | 75.0% |
| Research Initial | Establishing Postsecondary Transition Programs for Students with Disabilities | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Establishing a Parent Advisory Committee | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Fairfax Advanced Course Limits | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Fairfax Dual Enrollment | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Full-Day PreK Programs | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Generative AI for Public School Districts | 3 | 3 | 0 | Inf | 100.0% |
| Research Initial | Impacts of School-Provided GPA, Class Rank, and Advanced Course Limits | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Improving Student Attendance | 11 | 8 | 3 | 2.7 | 72.7% |
| Research Initial | K12 Declining Enrollment Pandemic | 16 | 14 | 2 | 7.0 | 87.5% |
| Research Initial | K12 Student Behavior 2022 | 14 | 12 | 2 | 6.0 | 85.7% |
| Research Initial | Male Mentoring | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Managing Behavioral Disruptions in Early Grades | 14 | 10 | 4 | 2.5 | 71.4% |
| Research Initial | Middle School Gifted and Talented | 1 | 0 | 1 | 0.0 | 0.0% |
| Research Initial | Middle School Grade Retention | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Middle School Schedules | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Multi Grade Classrooms | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Multimodal Learning Research | 4 | 4 | 0 | Inf | 100.0% |
| Research Initial | NOLA Public Schools - Early Warning Systems | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | NPD K12 CAO Research | 6 | 5 | 1 | 5.0 | 83.3% |
| Research Initial | NPD K12 CBO Research | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Narrowing the 3rd Grade Reading Gap | 10 | 8 | 2 | 4.0 | 80.0% |
| Research Initial | Non-Immersion World Language Programs in Elementary Schools | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Opening a New District High School | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Paraprofessional Support | 1 | 0 | 1 | 0.0 | 0.0% |
| Research Initial | Pine Bush Learning Management System Study | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Preparing Teachers for Effective Block Schedule Implementation | 1 | 0 | 1 | 0.0 | 0.0% |
| Research Initial | Preventing and Addressing Cyberbullying Initiatives | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Principal Leadership Scoping | 7 | 7 | 0 | Inf | 100.0% |
| Research Initial | Project Approval Management Review | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Pull-Out Services in Special Education | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Recession Planning | 8 | 6 | 2 | 3.0 | 75.0% |
| Research Initial | Recruiting, Retaining, and Developing Great Principals | 21 | 19 | 2 | 9.5 | 90.5% |
| Research Initial | Responding to the Adolescent Mental Health Crisis | 18 | 14 | 4 | 3.5 | 77.8% |
| Research Initial | SPED Research Calls | 3 | 1 | 2 | 0.5 | 33.3% |
| Research Initial | School Start Times | 1 | 0 | 1 | 0.0 | 0.0% |
| Research Initial | Strategic Planning | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Summer Programs for Kindergarten and Sixth Grade Readiness | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Supporting English Language Learners in Low-Incidence Districts | 3 | 3 | 0 | Inf | 100.0% |
| Research Initial | Talent Development | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Teacher Mentorship Programs | 1 | 1 | 0 | Inf | 100.0% |
| Research Initial | Teacher Workforce | 30 | 23 | 7 | 3.3 | 76.7% |
| Research Initial | Year-Round Calendars | 1 | 1 | 0 | Inf | 100.0% |
| Research SL Impact | Research SL Impact - AASA Panelist | 1 | 1 | 0 | Inf | 100.0% |
| Research SL Impact | Research SL Impact - AASA Reading Panelist | 1 | 1 | 0 | Inf | 100.0% |
| Research SL Impact | Research SL Impact - Co-hosted COVID webinar | 1 | 0 | 1 | 0.0 | 0.0% |
| Research SL Impact | Research SL Impact - Co-presented with us at NYSCOSS on DEIJ plan writing | 2 | 2 | 0 | Inf | 100.0% |
| Research SL Impact | Research SL Impact - HARI | 3 | 3 | 0 | Inf | 100.0% |
| Research SL Impact | Research SL Impact - NYSCOSS Presentation | 1 | 1 | 0 | Inf | 100.0% |
| Research SL Impact | Research SL Impact - Return To Learn Webcon Attendees | 2 | 1 | 1 | 1.0 | 50.0% |
| Research SL Impact | Research SL Impact - Return to Learn Webcon Attendees | 32 | 27 | 5 | 5.4 | 84.4% |
| Research SL Impact | Research SL Impact - Sit down at AASA | 1 | 1 | 0 | Inf | 100.0% |
| Research SL Impact | Research SL Impact Visit | 2 | 0 | 2 | 0.0 | 0.0% |
| Scoping | DLF Flashpoint Response | 14 | 10 | 4 | 2.5 | 71.4% |
| Scoping | Effective Practices for Aligning Pre-K Through Third Grade | 1 | 1 | 0 | Inf | 100.0% |
| Scoping | Elementary School Grade Configurations | 1 | 1 | 0 | Inf | 100.0% |
| Scoping | Generative AI for Public School Districts | 6 | 5 | 1 | 5.0 | 83.3% |
| Scoping | Implementing Math Pedagogy Reforms | 1 | 0 | 1 | 0.0 | 0.0% |
| Scoping | Improving Student Attendance | 7 | 6 | 1 | 6.0 | 85.7% |
| Scoping | Initiating an Employee Childcare Program | 1 | 1 | 0 | Inf | 100.0% |
| Scoping | Middle School Gifted and Talented | 1 | 1 | 0 | Inf | 100.0% |
| Scoping | NOLA Public Schools - Early Warning Systems | 1 | 1 | 0 | Inf | 100.0% |
| Scoping | Parent Involvement and Engagement at Rural Secondary Schools | 1 | 1 | 0 | Inf | 100.0% |
| Scoping | Recruiting, Retaining, and Developing Great Principals | 9 | 8 | 1 | 8.0 | 88.9% |
| Scoping | Talent Development | 1 | 1 | 0 | Inf | 100.0% |
| Survey Walkthrough | 2023 Voice of the Superintendent Survey | 12 | 8 | 4 | 2.0 | 66.7% |
| Survey Walkthrough | 2024 DLF Research Topic Poll | 1 | 1 | 0 | Inf | 100.0% |
| Survey Walkthrough | 2024 Voice of the Superintendent Survey | 1 | 1 | 0 | Inf | 100.0% |
| Survey Walkthrough | K12 Student Behavior 2022 | 2 | 2 | 0 | Inf | 100.0% |
| Survey Walkthrough | Survey Walkthrough | 1 | 1 | 0 | Inf | 100.0% |
| Survey Walkthrough | Teacher Workforce | 38 | 27 | 11 | 2.5 | 71.1% |
| Survey Walkthrough | Voice of the Superintendent | 13 | 11 | 2 | 5.5 | 84.6% |
| Tool’s Walkthrough | Tool’s Walk Through | 54 | 42 | 15 | 2.8 | 77.8% |
| Tool’s Walkthrough | Tool’s Walk Through Call | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | DLF | PLW | Root-Cause Analysis Workshop | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW | Root Cause Analysis Workshop #2 | 1 | 0 | 1 | 0.0 | 0.0% |
| Webinar | PLW: *Customized Presentation - DLF - 7/20/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: Closing the College Access Gap - DLF - 4/16/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: Narrowing the 3rd Grade Reading Gap - DLF - 7/31/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: Narrowing the 3rd Grade Reading Gap - DLF- 3/13/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: Preparing Principals to Lead - DLF - 6/4/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: Responding to the Adolescent Mental Health Crisis - DLF - 4/27/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: Responding to the Adolescent Mental Health Crisis - DLF - 5/21/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: Responding to the Adolescent Mental Health Crisis - DLF - 6/17/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: Responding to the Adolescent Mental Health Crisis - DLF - 6/5/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: Responding to the Adolescent Mental Health Crisis - DLF - 6/9/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: TBD - DLF - 4/20/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | *Customized - DEIJ | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Building Better Behavior Strategy | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Building Better Behavior Strategy (Part II) | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Building Better Behavior Strategy (Part III) | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Chronic Absenteeism | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Compassionate Leadership | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Customized Presentation | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Empathy Mapping | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | HARI | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Hallmarks of an Anti-Racist Institution | 2 | 2 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Hidden Opportunities to Boost Postsecondary Success | 2 | 2 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Managing Behavioral Disruptions in Early Grades | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Morale Collaborative (Co-Designing Solutions) | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Narrowing 3rd Grade Reading Gap | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Narrowing the 3rd Grade Reading Gap | 2 | 2 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Narrowing the 3rd Grade Reading Gap | Presentation Date: 9/30/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Navigating Divisive Conversation | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Navigating Divisive Conversations | 1 | 0 | 1 | 0.0 | 0.0% |
| Webinar | Partner Intensive | DLF | Principal Design Support Lab | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Root Cause Analysis | 3 | 2 | 1 | 2.0 | 66.7% |
| Webinar | Partner Intensive | DLF | Systems Thinking Applications to Advance Racial Justice | 2 | 2 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Systems Thinking Applications to Advance Racial Justice | Presentation Date: 08/26/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | DLF | Systems Thinking Applications | Presentation Date: 11/01/21 | 1 | 0 | 1 | 0.0 | 0.0% |
| Webinar | RSU 38 Empathy Mapping | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Root Cause Analysis | Presentation Date: 02/05/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Meeting | DLF | Hallmarks of an Anti-Racist Institution | 6/22/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Meeting | DLF | Mental Health PD session | 8/18/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Meeting | DLF | Narrowing 3rd Grade Reading Gap | 5/21/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Meeting | DLF | Narrowing the 3rd Grade Reading Gap | 8/26/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Meeting | DLF | Narrowing the 3rd Grade Reading Gap | 8/4/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Meeting | DLF | Narrowing the 3rd Grade Reading Gap | 9/7/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Meeting | DLF | Narrowing the 3rd Grade Reading Gap: Part 1 | 5/7/21 | 1 | 0 | 1 | 0.0 | 0.0% |
| Webinar | Virtual Meeting | DLF | Narrowing the 3rd Grade Reading Gap: Part 2 | 5/21/21 | 1 | 0 | 1 | 0.0 | 0.0% |
| Webinar | Virtual Meeting | DLF | Preparing Principals to Lead | 8/5/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Meeting | DLF | Science of Reading PD session | 8/18/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Meeting: “Return to Learn” Planning - DLF - 7/1 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Presentation: Preparing Principals to Lead - DLF | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | NA | 1 | 1 | 0 | Inf | 100.0% |
| NA | NA | 30 | 11 | 22 | 0.5 | 36.7% |
Correlation betwen Event Groupings, and Renewal
- Events, Expert Calls, Research Interviews, and PLW/Onsites are most correlated with renewal.
- Positive Correlations: Events appear to be the most halo-ey.
- Negative Correlations: No real negative haloes.
Multivariate Regression (still kind of simple)
Note: Looking at all decision types.
- Overall, Events and Research Interview are statistically significant.
##
## Call:
## glm(formula = Target_Binary ~ II_Events_Volume + II_SLLed_Volume +
## II_ResearchInterview_Volume + II_PLW_Onsite_Volume + II_ExpertCall_Volume +
## II_Service_Volume, family = "binomial", data = df)
##
## Coefficients:
## Estimate Std. Error z value Pr(>|z|)
## (Intercept) -0.03944 0.19856 -0.199 0.8426
## II_Events_Volume 0.50626 0.10308 4.911 9.05e-07 ***
## II_SLLed_Volume 0.25697 0.41297 0.622 0.5338
## II_ResearchInterview_Volume 0.26826 0.12217 2.196 0.0281 *
## II_PLW_Onsite_Volume 0.02600 0.26935 0.097 0.9231
## II_ExpertCall_Volume 0.19746 0.12567 1.571 0.1161
## II_Service_Volume -0.26848 0.23531 -1.141 0.2539
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
## (Dispersion parameter for binomial family taken to be 1)
##
## Null deviance: 462.16 on 392 degrees of freedom
## Residual deviance: 408.75 on 386 degrees of freedom
## AIC: 422.75
##
## Number of Fisher Scoring iterations: 5