Impact Interaction Analyses - ISEF
Josh Wilson
5/23/2022
ISEF Analysis
The purpose of this analysis is to understand the variable effect of impact interactions on the likelihood of a partner to renew their partnership. Simply, which service levers matter more for partnership renewal.
Executive Summary
Methodological Considerations
The data set consists of decisions from FY19 through March of FY22.
Similar to previous analyses, we are primarily looking at the year leading up to a decision.
Lastly, we are looking at unit renewal rates instead of $ renewal rates. This allows us to treat impact interactions equitably across partnerships.
Renewal by Decision Type
The below table should not come as a surprise. Opt Outs tend to perform very well while NNLOA can be quite mixed.
- Remember the Ratios: 1.2 for NNLOA, 3.0 for Opt Outs.
- Most of the decisions are NNLOA: ~72%.
| DecisionType | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|
| Need New LOA | 93 | 51 | 42 | 1.2 | 54.8% |
| Opt Out | 36 | 27 | 9 | 3.0 | 75.0% |
| Total | 129 | 78 | 51 | 1.5 | 60.5% |
Renewals by Decision Type and Year
Since we are combining multiple years of data, we will frequently take a look at whether there are differences across the years.
- NNLOA performance had been climbing since FY19!
- Opt Out performance alternates each year, strong and weaker, with FY22 very strong.
| DecisionType | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 2019 | 18 | 7 | 11 | 0.6 | 38.9% |
| Need New LOA | 2020 | 35 | 14 | 21 | 0.7 | 40.0% |
| Need New LOA | 2021 | 16 | 9 | 7 | 1.3 | 56.2% |
| Need New LOA | 2022 | 24 | 21 | 3 | 7.0 | 87.5% |
| Opt Out | 2019 | 5 | 3 | 2 | 1.5 | 60.0% |
| Opt Out | 2020 | 14 | 10 | 4 | 2.5 | 71.4% |
| Opt Out | 2021 | 8 | 5 | 3 | 1.7 | 62.5% |
| Opt Out | 2022 | 9 | 9 | 0 | Inf | 100.0% |
| Total | NA | 129 | 78 | 51 | 1.5 | 60.5% |
Impact Interaction Volume Histogram
- Central tendency is around 5.6.
- Utilization looks pretty solid. Potentially a couple segments - lower utilzation (4-5) and higher utilzation (7-9).
Impact Interaction Volume Histogram Split by Decision
- Drops all over the place, even in the higher utilizaiton sections.
Impact Interaction Volume Histogram Split by Pool Date FY
- FY22 is pretty compact in the middle of the distribution.
- FY22 a few lower utilizers.
- FY21 has some of those very high utilizers.
Renewal by Interaction Volume and Decision Type, Unbinned
- [NNLOA] 6+ might be where we start to see some benefit. 0-1 is deadly.
- [Opt Out] A lot of the drops are in the 9-11 utilization.
| DecisionType | II_Credited_Volume | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 3 | 1 | 2 | 0.5 | 33.3% |
| Need New LOA | 1 | 7 | 2 | 5 | 0.4 | 28.6% |
| Need New LOA | 2 | 10 | 4 | 6 | 0.7 | 40.0% |
| Need New LOA | 3 | 6 | 4 | 2 | 2.0 | 66.7% |
| Need New LOA | 4 | 14 | 7 | 7 | 1.0 | 50.0% |
| Need New LOA | 5 | 15 | 8 | 7 | 1.1 | 53.3% |
| Need New LOA | 6 | 6 | 5 | 1 | 5.0 | 83.3% |
| Need New LOA | 7 | 11 | 4 | 7 | 0.6 | 36.4% |
| Need New LOA | 8 | 7 | 5 | 2 | 2.5 | 71.4% |
| Need New LOA | 9 | 8 | 6 | 2 | 3.0 | 75.0% |
| Need New LOA | 10 | 1 | 1 | 0 | Inf | 100.0% |
| Need New LOA | 12 | 4 | 4 | 0 | Inf | 100.0% |
| Need New LOA | 15 | 1 | 0 | 1 | 0.0 | 0.0% |
| Opt Out | 2 | 2 | 1 | 1 | 1.0 | 50.0% |
| Opt Out | 3 | 4 | 4 | 0 | Inf | 100.0% |
| Opt Out | 4 | 7 | 6 | 1 | 6.0 | 85.7% |
| Opt Out | 5 | 5 | 4 | 1 | 4.0 | 80.0% |
| Opt Out | 6 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 7 | 2 | 2 | 0 | Inf | 100.0% |
| Opt Out | 8 | 2 | 2 | 0 | Inf | 100.0% |
| Opt Out | 9 | 4 | 2 | 2 | 1.0 | 50.0% |
| Opt Out | 10 | 5 | 2 | 3 | 0.7 | 40.0% |
| Opt Out | 11 | 2 | 1 | 1 | 1.0 | 50.0% |
| Opt Out | 12 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 13 | 1 | 1 | 0 | Inf | 100.0% |
Renewal by Impact Interaction Volume and Decision Type, (Binned)
Adjusted the binning to better capture the high volume present in URF.
- For NNLOA, binning makes 4+ look like a solid gain. 7+ even more gain, although cost-benefit would have to be taken into account.
- For Opt Out, as suggested above, drops in the highest utilization cause some funny looking data.
| DecisionType | II_Volume_Bins | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 3 | 1 | 2 | 0.5 | 33.3% |
| Need New LOA | 1 | 7 | 2 | 5 | 0.4 | 28.6% |
| Need New LOA | 2-3 | 16 | 8 | 8 | 1.0 | 50.0% |
| Need New LOA | 4-6 | 35 | 20 | 15 | 1.3 | 57.1% |
| Need New LOA | 7+ | 32 | 20 | 12 | 1.7 | 62.5% |
| Opt Out | 2-3 | 6 | 5 | 1 | 5.0 | 83.3% |
| Opt Out | 4-6 | 13 | 11 | 2 | 5.5 | 84.6% |
| Opt Out | 7+ | 17 | 11 | 6 | 1.8 | 64.7% |
#####Simple Regression for Impact Interaction Volume
- The Estimate for Impact Interaction Volume is Positive -> increased consumption means increased likelihood to renew.
- This is statistically significant for NNLOA; not for Opt Outs!
| Target_Binary | |||
|---|---|---|---|
| Predictors | Odds Ratios | CI | p |
| (Intercept) | 0.90 | 0.43 – 1.88 | 0.786 |
| II Credited Volume | 1.10 | 0.98 – 1.24 | 0.113 |
| Observations | 129 | ||
| R2 Tjur | 0.020 | ||
Penetration by Event Grouping
Reminder: 1. Experience = VIP Days & Collaboratives
Service = Benchmarking, Audits, Secret Shopper, Customer Research Projects, Market Insights, and Survey Walkthroughs
Expert Call = Expert Center, Benchmarking Walkthrough, Tool’s Walkthrough
SL Led = Research SL Impact, Evergreen Action, Exec Update, National Meeting Pre-wire
Research Interview = Research Initial & Scoping
Events = National Meeting, COVID Working Group
PLW/Onsite = Onsite, PLW
Events and Research Interviews are the highest penetration. Expert Calls follows suit in third.
Research Interviews favors Opt Outs, to the largest degree.
| DecisionType | Perc_Events | Perc_Service | Perc_SLLed | Perc_ResearchInt | Perc_PLW_Onsite | Perc_Experience | Perc_ExpertCall |
|---|---|---|---|---|---|---|---|
| Need New LOA | 86.0% | 5.4% | 8.6% | 63.4% | 36.6% | 1.1% | 62.4% |
| Opt Out | 91.7% | 13.9% | 2.8% | 77.8% | 25.0% | 0.0% | 55.6% |
Renewal by Event Consumption
- [NNLOA] Small bump above the average, but a huge lift above not consuming - 37%
- [Opt Out] Not consuming too small for comparison.
| DecisionType | II_Events_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 13 | 3 | 10 | 0.3 | 23.1% |
| Need New LOA | 1 | 80 | 48 | 32 | 1.5 | 60.0% |
| Opt Out | 0 | 3 | 2 | 1 | 2.0 | 66.7% |
| Opt Out | 1 | 33 | 25 | 8 | 3.1 | 75.8% |
Renewal by Event Consumption Volume
- 3+ is where we seem to start seeing lower levels of drops.
Renewal by Event, OT
- [NNLOA] Increasing return across the years. Consistently better - FY22 N too low for no consumption.
| DecisionType | II_Events_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2019 | 3 | 0 | 3 | 0.0 | 0.0% |
| Need New LOA | 0 | 2020 | 8 | 1 | 7 | 0.1 | 12.5% |
| Need New LOA | 0 | 2022 | 2 | 2 | 0 | Inf | 100.0% |
| Need New LOA | 1 | 2019 | 15 | 7 | 8 | 0.9 | 46.7% |
| Need New LOA | 1 | 2020 | 27 | 13 | 14 | 0.9 | 48.1% |
| Need New LOA | 1 | 2021 | 16 | 9 | 7 | 1.3 | 56.2% |
| Need New LOA | 1 | 2022 | 22 | 19 | 3 | 6.3 | 86.4% |
| Opt Out | 0 | 2019 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 0 | 2020 | 2 | 1 | 1 | 1.0 | 50.0% |
| Opt Out | 1 | 2019 | 4 | 2 | 2 | 1.0 | 50.0% |
| Opt Out | 1 | 2020 | 12 | 9 | 3 | 3.0 | 75.0% |
| Opt Out | 1 | 2021 | 8 | 5 | 3 | 1.7 | 62.5% |
| Opt Out | 1 | 2022 | 9 | 9 | 0 | Inf | 100.0% |
Renewal by Service Consumption
- [NNLOA] N is too low to make a call here. Inverse relations.
- [Opt Out] Same as NNLOA.
| DecisionType | II_Service_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 88 | 49 | 39 | 1.3 | 55.7% |
| Need New LOA | 1 | 5 | 2 | 3 | 0.7 | 40.0% |
| Opt Out | 0 | 31 | 25 | 6 | 4.2 | 80.6% |
| Opt Out | 1 | 5 | 2 | 3 | 0.7 | 40.0% |
Renewal by Service Consumption Volume
- Small N, but some higher utilization. Drops there too!
Renewal by Service Consumption, OT
- [NNLOA] Parsed too fine.
| DecisionType | II_Service_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2019 | 18 | 7 | 11 | 0.6 | 38.9% |
| Need New LOA | 0 | 2020 | 32 | 14 | 18 | 0.8 | 43.8% |
| Need New LOA | 0 | 2021 | 15 | 8 | 7 | 1.1 | 53.3% |
| Need New LOA | 0 | 2022 | 23 | 20 | 3 | 6.7 | 87.0% |
| Need New LOA | 1 | 2020 | 3 | 0 | 3 | 0.0 | 0.0% |
| Need New LOA | 1 | 2021 | 1 | 1 | 0 | Inf | 100.0% |
| Need New LOA | 1 | 2022 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 0 | 2019 | 4 | 3 | 1 | 3.0 | 75.0% |
| Opt Out | 0 | 2020 | 10 | 8 | 2 | 4.0 | 80.0% |
| Opt Out | 0 | 2021 | 8 | 5 | 3 | 1.7 | 62.5% |
| Opt Out | 0 | 2022 | 9 | 9 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2019 | 1 | 0 | 1 | 0.0 | 0.0% |
| Opt Out | 1 | 2020 | 4 | 2 | 2 | 1.0 | 50.0% |
Renewal by SL Consumption
- [NNLOA] Small N. Negative relationship.
- [Opt Out] N too low.
| DecisionType | II_SLLed_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 85 | 47 | 38 | 1.2 | 55.3% |
| Need New LOA | 1 | 8 | 4 | 4 | 1.0 | 50.0% |
| Opt Out | 0 | 35 | 27 | 8 | 3.4 | 77.1% |
| Opt Out | 1 | 1 | 0 | 1 | 0.0 | 0.0% |
SL Consumption Volume & Renewal
- Mostly only one consumed.
Renewal by SL Consumption, OT
- [NNLOA] Consumption increased in FY21, steady previous years. No FY22 consumption.
| DecisionType | II_SLLed_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2019 | 16 | 7 | 9 | 0.8 | 43.8% |
| Need New LOA | 0 | 2020 | 33 | 12 | 21 | 0.6 | 36.4% |
| Need New LOA | 0 | 2021 | 12 | 7 | 5 | 1.4 | 58.3% |
| Need New LOA | 0 | 2022 | 24 | 21 | 3 | 7.0 | 87.5% |
| Need New LOA | 1 | 2019 | 2 | 0 | 2 | 0.0 | 0.0% |
| Need New LOA | 1 | 2020 | 2 | 2 | 0 | Inf | 100.0% |
| Need New LOA | 1 | 2021 | 4 | 2 | 2 | 1.0 | 50.0% |
| Opt Out | 0 | 2019 | 5 | 3 | 2 | 1.5 | 60.0% |
| Opt Out | 0 | 2020 | 13 | 10 | 3 | 3.3 | 76.9% |
| Opt Out | 0 | 2021 | 8 | 5 | 3 | 1.7 | 62.5% |
| Opt Out | 0 | 2022 | 9 | 9 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2020 | 1 | 0 | 1 | 0.0 | 0.0% |
Renewal by Research Interview Consumption
- [NNLOA] Higher N, inverse relationship. -2%.
- [Opt out] No lift.
| DecisionType | II_ResearchInterview_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 34 | 20 | 14 | 1.4 | 58.8% |
| Need New LOA | 1 | 59 | 31 | 28 | 1.1 | 52.5% |
| Opt Out | 0 | 8 | 6 | 2 | 3.0 | 75.0% |
| Opt Out | 1 | 28 | 21 | 7 | 3.0 | 75.0% |
Research Interview Volume & Renewal
- More consumption doesn’t look like it improves the relationship.
Renewal By Research Interview Consumption, OT
- [NNLOA] FY22 reverses to the negative; FY20/21 shows a positive effect.
- [Opt Out] Low N with consistent positive effect.
| DecisionType | II_ResearchInterview_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2020 | 11 | 2 | 9 | 0.2 | 18.2% |
| Need New LOA | 0 | 2021 | 9 | 5 | 4 | 1.2 | 55.6% |
| Need New LOA | 0 | 2022 | 14 | 13 | 1 | 13.0 | 92.9% |
| Need New LOA | 1 | 2019 | 18 | 7 | 11 | 0.6 | 38.9% |
| Need New LOA | 1 | 2020 | 24 | 12 | 12 | 1.0 | 50.0% |
| Need New LOA | 1 | 2021 | 7 | 4 | 3 | 1.3 | 57.1% |
| Need New LOA | 1 | 2022 | 10 | 8 | 2 | 4.0 | 80.0% |
| Opt Out | 0 | 2021 | 4 | 2 | 2 | 1.0 | 50.0% |
| Opt Out | 0 | 2022 | 4 | 4 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2019 | 5 | 3 | 2 | 1.5 | 60.0% |
| Opt Out | 1 | 2020 | 14 | 10 | 4 | 2.5 | 71.4% |
| Opt Out | 1 | 2021 | 4 | 3 | 1 | 3.0 | 75.0% |
| Opt Out | 1 | 2022 | 5 | 5 | 0 | Inf | 100.0% |
Renewal by PLW OR Onsite Consumption
- [NNLOA] Marginal effect.
- [Opt Out] Marginal effect.
| DecisionType | II_PLW_Onsite_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 59 | 32 | 27 | 1.2 | 54.2% |
| Need New LOA | 1 | 34 | 19 | 15 | 1.3 | 55.9% |
| Opt Out | 0 | 27 | 20 | 7 | 2.9 | 74.1% |
| Opt Out | 1 | 9 | 7 | 2 | 3.5 | 77.8% |
PLW / Onsite Volume & Renewal
- 1 seems sufficient; 2 looks even better, although small N.
Renewal by PLW/Onsite OT
- [NNLOA] Effect increases in size until FY22, where it is roughly even.
- [Opt Out] Inconsistent through the years.
| DecisionType | II_PLW_Onsite_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2019 | 8 | 3 | 5 | 0.6 | 37.5% |
| Need New LOA | 0 | 2020 | 22 | 8 | 14 | 0.6 | 36.4% |
| Need New LOA | 0 | 2021 | 12 | 6 | 6 | 1.0 | 50.0% |
| Need New LOA | 0 | 2022 | 17 | 15 | 2 | 7.5 | 88.2% |
| Need New LOA | 1 | 2019 | 10 | 4 | 6 | 0.7 | 40.0% |
| Need New LOA | 1 | 2020 | 13 | 6 | 7 | 0.9 | 46.2% |
| Need New LOA | 1 | 2021 | 4 | 3 | 1 | 3.0 | 75.0% |
| Need New LOA | 1 | 2022 | 7 | 6 | 1 | 6.0 | 85.7% |
| Opt Out | 0 | 2019 | 2 | 1 | 1 | 1.0 | 50.0% |
| Opt Out | 0 | 2020 | 10 | 6 | 4 | 1.5 | 60.0% |
| Opt Out | 0 | 2021 | 7 | 5 | 2 | 2.5 | 71.4% |
| Opt Out | 0 | 2022 | 8 | 8 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2019 | 3 | 2 | 1 | 2.0 | 66.7% |
| Opt Out | 1 | 2020 | 4 | 4 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2021 | 1 | 0 | 1 | 0.0 | 0.0% |
| Opt Out | 1 | 2022 | 1 | 1 | 0 | Inf | 100.0% |
Renewal by Experience Consumption
Basically no consumption.
| DecisionType | II_Experience_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 92 | 50 | 42 | 1.2 | 54.3% |
| Need New LOA | 1 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 0 | 36 | 27 | 9 | 3.0 | 75.0% |
Experience Volume & Renewal
Basically no consumption.
Renewal by Experience Consumption OT
Basically no consumption.
| DecisionType | II_Experience_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2019 | 17 | 6 | 11 | 0.5 | 35.3% |
| Need New LOA | 0 | 2020 | 35 | 14 | 21 | 0.7 | 40.0% |
| Need New LOA | 0 | 2021 | 16 | 9 | 7 | 1.3 | 56.2% |
| Need New LOA | 0 | 2022 | 24 | 21 | 3 | 7.0 | 87.5% |
| Need New LOA | 1 | 2019 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 0 | 2019 | 5 | 3 | 2 | 1.5 | 60.0% |
| Opt Out | 0 | 2020 | 14 | 10 | 4 | 2.5 | 71.4% |
| Opt Out | 0 | 2021 | 8 | 5 | 3 | 1.7 | 62.5% |
| Opt Out | 0 | 2022 | 9 | 9 | 0 | Inf | 100.0% |
Renewal by Expert Call Consumption
- [NNLOA] Small lift above the average.
- [Opt Out] Inverse relationship.
| DecisionType | II_ExpertCall_Binary | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| Need New LOA | 0 | 35 | 18 | 17 | 1.1 | 51.4% |
| Need New LOA | 1 | 58 | 33 | 25 | 1.3 | 56.9% |
| Opt Out | 0 | 16 | 14 | 2 | 7.0 | 87.5% |
| Opt Out | 1 | 20 | 13 | 7 | 1.9 | 65.0% |
Expert Call Volume & Renewal
- Consistent proportion of drops throughout.
Renewal by Expert Call Consumption OT
- [NNLOA] Low N not consuming in FY21/22.
| DecisionType | II_ExpertCall_Binary | FiscalYear | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|---|
| Need New LOA | 0 | 2019 | 9 | 5 | 4 | 1.2 | 55.6% |
| Need New LOA | 0 | 2020 | 18 | 6 | 12 | 0.5 | 33.3% |
| Need New LOA | 0 | 2021 | 4 | 3 | 1 | 3.0 | 75.0% |
| Need New LOA | 0 | 2022 | 4 | 4 | 0 | Inf | 100.0% |
| Need New LOA | 1 | 2019 | 9 | 2 | 7 | 0.3 | 22.2% |
| Need New LOA | 1 | 2020 | 17 | 8 | 9 | 0.9 | 47.1% |
| Need New LOA | 1 | 2021 | 12 | 6 | 6 | 1.0 | 50.0% |
| Need New LOA | 1 | 2022 | 20 | 17 | 3 | 5.7 | 85.0% |
| Opt Out | 0 | 2019 | 1 | 1 | 0 | Inf | 100.0% |
| Opt Out | 0 | 2020 | 7 | 6 | 1 | 6.0 | 85.7% |
| Opt Out | 0 | 2021 | 4 | 3 | 1 | 3.0 | 75.0% |
| Opt Out | 0 | 2022 | 4 | 4 | 0 | Inf | 100.0% |
| Opt Out | 1 | 2019 | 4 | 2 | 2 | 1.0 | 50.0% |
| Opt Out | 1 | 2020 | 7 | 4 | 3 | 1.3 | 57.1% |
| Opt Out | 1 | 2021 | 4 | 2 | 2 | 1.0 | 50.0% |
| Opt Out | 1 | 2022 | 5 | 5 | 0 | Inf | 100.0% |
Finer Grain Look at What Was Consumed
Event Category and Event Purpose
- A few national meetings look very strong - Hidden Enemies.
| Event_Category | EventPurpose | N | ATL | Dropped | Ratio | Perc_Renewed |
|---|---|---|---|---|---|---|
| COVID Working Group Session | ISEF - COVID-19 Outreach | 2 | 2 | 0 | Inf | 100.0% |
| COVID Working Group Session | ISEF - Reopening Schools After COVID 19 | 2 | 2 | 0 | Inf | 100.0% |
| COVID Working Group Session | ISEF COVID-19 Working Group Session | 13 | 8 | 5 | 1.6 | 61.5% |
| COVID Working Group Session | ISEF COVID Response | 1 | 1 | 0 | Inf | 100.0% |
| Diagnostic or Audit | Employment Website Audit | 9 | 3 | 6 | 0.5 | 33.3% |
| Diagnostic or Audit | K-12 Short-Term DEIJ Plan Review ISEF | 1 | 1 | 0 | Inf | 100.0% |
| Expert Center | Expert Center | 52 | 34 | 18 | 1.9 | 65.4% |
| Expert Center | Expert Center Call | 21 | 7 | 14 | 0.5 | 33.3% |
| K-12 Webinar | ISEF (Virtual 25 Aug 2020) | 3 | 3 | 0 | Inf | 100.0% |
| National Meeting | 2017-2018 Independent School Executive Forum, Santa Monica, CA | 1 | 1 | 0 | Inf | 100.0% |
| National Meeting | 2018 Independent School Executive Forum Special Session, Portland, OR | 5 | 2 | 3 | 0.7 | 40.0% |
| National Meeting | 2018 Independent School Executive Forum Special Session, Seattle, WA | 2 | 1 | 1 | 1.0 | 50.0% |
| National Meeting | 2018 Independent School Executive Forum Special Session, Washington, DC | 11 | 4 | 7 | 0.6 | 36.4% |
| National Meeting | 2019 Advancement Leaders Roundtable, Portland, OR | 1 | 0 | 1 | 0.0 | 0.0% |
| National Meeting | 2019 Advancement Leaders Roundtable, Washington, DC | 12 | 9 | 3 | 3.0 | 75.0% |
| National Meeting | 2019 Independent School Executive Forum Risk Management Workshop, Portland, OR | 2 | 2 | 0 | Inf | 100.0% |
| National Meeting | 2019 Independent School Executive Forum Risk Management Workshop, Washington, DC | 9 | 7 | 2 | 3.5 | 77.8% |
| National Meeting | 2019 Independent School Executive Forum, Santa Monica, CA | 7 | 3 | 4 | 0.8 | 42.9% |
| National Meeting | 2019 Independent School Executive Forum, Washington, DC | 32 | 18 | 14 | 1.3 | 56.2% |
| National Meeting | 2020 Independent School Executive Forum National Meeting, | 10 | 7 | 3 | 2.3 | 70.0% |
| National Meeting | 2020 Independent School Executive Forum National Meeting, Dana Point, CA | 4 | 3 | 1 | 3.0 | 75.0% |
| National Meeting | 2020 Independent School Executive Forum National Meeting, Washington, DC | 12 | 9 | 3 | 3.0 | 75.0% |
| National Meeting | 2020 ISEF Collaborative: Addressing Racial Justice on Campus, | 5 | 5 | 0 | Inf | 100.0% |
| National Meeting | 2020 ISEF Collaborative: CFO Peer Virtual Roundtables, | 9 | 6 | 4 | 1.5 | 66.7% |
| National Meeting | 2020 ISEF Collaborative: Prepare for Controversial Campus Events, | 8 | 7 | 1 | 7.0 | 87.5% |
| National Meeting | At the Forefront of Social Justice and Innovation: A Vision of EAB Partnership in 2021, | 25 | 19 | 6 | 3.2 | 76.0% |
| National Meeting | At the Forefront of Social Justice and Innovation: A Vision of EAB Partnership in 2021, | 7 | 6 | 1 | 6.0 | 85.7% |
| National Meeting | Collaborative ISEF: Preparing Independent Schools for the 2020 Election, | 5 | 5 | 0 | Inf | 100.0% |
| National Meeting | DEI in Advancement: A Working Session for Independent Schools on Fostering Inclusive Philanthropy, | 7 | 4 | 3 | 1.3 | 57.1% |
| National Meeting | EAB Strategy Workshops: Tomorrow’s Reality Lies in the Seeds of the Present, | 24 | 22 | 2 | 11.0 | 91.7% |
| National Meeting | Hidden Enemies to Strategy: How Cognitive Biases Inhibit Strategic Thinking and How to Mitigate thei, | 23 | 21 | 2 | 10.5 | 91.3% |
| National Meeting | Institutional Resilience and Excellence through Uncertainty: ISEF’s 2022 Vision of Service, | 2 | 2 | 0 | Inf | 100.0% |
| National Meeting | New Head of School Transition Cohort, | 2 | 1 | 1 | 1.0 | 50.0% |
| National Meeting | Partnering with Today’s Parents: Why Independent Schools are Missing the Mark and What to Do About I, | 6 | 6 | 0 | Inf | 100.0% |
| National Meeting | Preparing Independent Schools for the 2020 Election, | 14 | 13 | 1 | 13.0 | 92.9% |
| National Meeting | Research Working Session ISEF: April Maintaining and Advancement, | 7 | 5 | 2 | 2.5 | 71.4% |
| National Meeting | Virtual Working Session IESF: Community Engagement, | 2 | 1 | 1 | 1.0 | 50.0% |
| National Meeting | Virtual Working Session ISEF: Advancement Leaders Virtual Roundtables, | 8 | 2 | 6 | 0.3 | 25.0% |
| National Meeting | Virtual Working Session ISEF: CARES Funding and Independent Schools, | 4 | 4 | 0 | Inf | 100.0% |
| National Meeting | Virtual Working Session ISEF: Enrollment Leader Virtual Roundtables, | 9 | 4 | 5 | 0.8 | 44.4% |
| National Meeting | Virtual Working Session ISEF: Maintain Community, | 4 | 2 | 2 | 1.0 | 50.0% |
| National Meeting | Virtual Working Session ISEF: Maintaining Enrollments for Fall 2020, | 4 | 2 | 2 | 1.0 | 50.0% |
| National Meeting | Virtual Working Session ISEF: Preliminary Enrollment Yield Trends in the COVID-Era: Results from an, | 3 | 3 | 0 | Inf | 100.0% |
| National Meeting | Virtual Working Session ISEF: Revenue Uncertainty, | 3 | 1 | 2 | 0.5 | 33.3% |
| National Meeting | Virtual Working Session ISEF: Roundtable for Heads Transitioning to New Schools, | 1 | 0 | 1 | 0.0 | 0.0% |
| Onsite | hold exp. 08/12 | Onsite | ISEF | 09/27/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Hold exp. 8/28 | Onsite | ISEF | Presentation Date: 11/14/2019 | 1 | 0 | 1 | 0.0 | 0.0% |
| Onsite | Onsite | DLF | Presentation Date: 09/17/2019 | 1 | 0 | 1 | 0.0 | 0.0% |
| Onsite | Onsite | ISEF | 01/25/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | ISEF | 03/27/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | ISEF | 04/15/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | ISEF | 04/23/2019 | 1 | 0 | 1 | 0.0 | 0.0% |
| Onsite | Onsite | ISEF | 07/09/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | ISEF | 08/21/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | ISEF | 1/12/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | ISEF | 10/17/2018 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | ISEF | 10/19/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | ISEF | 10/29/2018 | 1 | 0 | 1 | 0.0 | 0.0% |
| Onsite | Onsite | ISEF | 11/15/2018 | 1 | 0 | 1 | 0.0 | 0.0% |
| Onsite | Onsite | ISEF | 11/16/2018 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | ISEF | Presentation Date: 05/16/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | ISEF | Presentation Date: 05/22/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | ISEF | Presentation Date: 06/27/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite | ISEF | Presentation Date: 07/24/2019 | 1 | 0 | 1 | 0.0 | 0.0% |
| Onsite | Onsite | ISEF | Presentation date: 5/10/18 | 1 | 0 | 1 | 0.0 | 0.0% |
| Onsite | Onsite | ISEF | Presentation Date: 5/28/19 | 1 | 1 | 0 | Inf | 100.0% |
| Onsite | Onsite: Risk Management Workshop - ISEF - 3/4/2020 | 1 | 0 | 1 | 0.0 | 0.0% |
| Onsite | Partner Intensive | ISEF | Customized Presentation | 3 | 3 | 0 | Inf | 100.0% |
| Onsite | NA | 3 | 1 | 2 | 0.5 | 33.3% |
| Research Initial | 2018-19 ISEF National Meeting Research | 33 | 15 | 18 | 0.8 | 45.5% |
| Research Initial | 2019-20 ISEF National Meeting Research | 21 | 10 | 11 | 0.9 | 47.6% |
| Research Initial | 2019-2020 ISEF Academic Leaders | 9 | 6 | 3 | 2.0 | 66.7% |
| Research Initial | 2019-2020 ISEF Civility Study | 17 | 12 | 5 | 2.4 | 70.6% |
| Research Initial | Employment Website Audit | 2 | 1 | 1 | 1.0 | 50.0% |
| Research Initial | Heads Transition Project | 8 | 6 | 2 | 3.0 | 75.0% |
| Research Initial | ISEF Parent Research | 9 | 8 | 1 | 8.0 | 88.9% |
| Research Initial | ISEF Social Justice | 6 | 4 | 2 | 2.0 | 66.7% |
| Research Initial | Wildwood Teacher Compensation | 2 | 2 | 0 | Inf | 100.0% |
| Research SL Impact | Research SL Impact - Check in | 1 | 0 | 1 | 0.0 | 0.0% |
| Research SL Impact | Research SL Impact - Faculty PD call | 1 | 0 | 1 | 0.0 | 0.0% |
| Research SL Impact | Research SL Impact - Meeting | 4 | 3 | 1 | 3.0 | 75.0% |
| Research SL Impact | Research SL Impact Visit | 3 | 1 | 2 | 0.5 | 33.3% |
| Scoping | ISEF Parent Research | 9 | 6 | 3 | 2.0 | 66.7% |
| Scoping | ISEF Topic Poll 2022 | 3 | 2 | 1 | 2.0 | 66.7% |
| Survey Walkthrough | Survey Walkthrough | 1 | 1 | 0 | Inf | 100.0% |
| Tool’s Walkthrough | Tool’s Walk Through | 11 | 4 | 7 | 0.6 | 36.4% |
| Tool’s Walkthrough | Tool’s Walk Through Call | 5 | 3 | 2 | 1.5 | 60.0% |
| VIP Day | VIP Day | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | ISEF | Customized Presentation | 2 | 2 | 0 | Inf | 100.0% |
| Webinar | Partner Intensive | ISEF | DEI in Advancement Workshop Part 2 | Presentation Date: 08/26/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW | ISEF | 03/04/2019 | 1 | 0 | 1 | 0.0 | 0.0% |
| Webinar | PLW | ISEF | 05/21/2019 | 1 | 0 | 1 | 0.0 | 0.0% |
| Webinar | PLW | ISEF | 10/18/2018 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW | ISEF | 11/27/2018 | 1 | 0 | 1 | 0.0 | 0.0% |
| Webinar | PLW | ISEF | 12/07/2018 | 1 | 0 | 1 | 0.0 | 0.0% |
| Webinar | PLW | ISEF | Presentation Date: 06/24/2019 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: *Customized Presentation (Promoting Civil and Open Discourse) - ISEF - 5/22/2020 | 1 | 0 | 1 | 0.0 | 0.0% |
| Webinar | PLW: Promoting Civil and Open Discourse - ISEF - 8/19/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: Tackling the Student Stress Dilemma - ISEF - 4/21/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: Tackling the Student Stress Dilemma - ISEF 5/21/2020 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | PLW: Word of Mouth Workshop - ISEF - 5/12/2020 | 1 | 0 | 1 | 0.0 | 0.0% |
| Webinar | Virtual Meeting | ISEF | Customized Presentation | 6/23/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Meeting | ISEF | Customized Presentation | Presentation Date: 11/05/20 | 1 | 0 | 1 | 0.0 | 0.0% |
| Webinar | Virtual Meeting | ISEF | Ensuring Financial Sustainability | Presentation Date: 01/30/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Meeting | ISEF | Ensuring Financial Sustainability | Presentation Date: 04/27/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Meeting | ISEF | Promoting Civil and Open Discourse | Presentation date: 9/16/20 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Meeting | ISEF | Promoting Civil and Open Discourse | Presentation date: 9/29/20 | 1 | 0 | 1 | 0.0 | 0.0% |
| Webinar | Virtual Meeting | ISEF | The Institutional Risk Management Playbook | 6/10/21 | 1 | 1 | 0 | Inf | 100.0% |
| Webinar | Virtual Presentation: *Customized Presentation - ISEF - 9/1/2020 | 1 | 1 | 0 | Inf | 100.0% |
| NA | NA | 3 | 1 | 2 | 0.5 | 33.3% |
Correlation betwen Event Groupings, and Renewal
- Events are most correlated with renewal.
- Positive Correlations: Onsites/PLW appear to be the most halo-ey.
- Negative Correlations: SL Led interactions have some negative associations.
Multivariate Regression (still kind of simple)
Note: Looking at all decision types.
- Overall, Events are statistically significant.
- For NNLOAs, same as above.
| Target_Binary | |||
|---|---|---|---|
| Predictors | Odds Ratios | CI | p |
| (Intercept) | 0.45 | 0.17 – 1.12 | 0.092 |
| II Events Volume | 1.56 | 1.17 – 2.21 | 0.006 |
| II SLLed Volume | 0.37 | 0.06 – 2.04 | 0.261 |
|
II ResearchInterview Volume |
1.01 | 0.73 – 1.42 | 0.942 |
| II PLW Onsite Volume | 1.51 | 0.65 – 3.66 | 0.347 |
| II ExpertCall Volume | 1.01 | 0.63 – 1.63 | 0.960 |
| II Service Volume | 0.54 | 0.12 – 1.54 | 0.306 |
| Observations | 93 | ||
| R2 Tjur | 0.130 | ||