SAF Analysis

The purpose of this analysis is to understand the variable effect of impact interactions on the likelihood of a partner to renew their partnership. Simply, which service levers matter more for partnership renewal.

Executive Summary

Methodological Considerations

  1. The data set consists of decisions from FY19 through March of FY22.

  2. Similar to previous analyses, we are primarily looking at the year leading up to a decision.

  3. We are not looking at ‘integrated’ partnerships. That is, we are focusing on utilization at the account where the renewal decision is made.

  4. I’ve taken CRPs out of this analysis, because they renew at a high rate - obscuring other performance - AND are covered in a separate analysis.

  5. Lastly, we are looking at unit renewal rates instead of $ renewal rates. This allows us to treat impact interactions equitably across partnerships.

Renewal by Decision Type

The below table should not come as a surprise. Opt Outs tend to perform very well while NNLOA can be quite mixed.

  1. Remember the Ratios: 1.1 for NNLOA, 6.8 for Opt Outs.
  2. Few of the decisions are opt outs: ~25%.
Renewal Ratio by Decision Type
DecisionType N ATL Dropped Ratio Perc_Renewed
Need New LOA 120 62 58 1.1 51.7%
Opt Out 47 41 6 6.8 87.2%
Total 167 103 64 1.6 61.7%

Renewals by Decision Type and Year

Since we are combining multiple years of data, we will frequently take a look at whether there are differences across the years.

  1. NNLOA performance had been climbing since FY20, where there was a dip. FY22 is very strong!
  2. Opt Out performance has been improving since FY19, with the exception fo FY21.
Renewal Ratio by Decision Type
DecisionType FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 2019 14 6 8 0.8 42.9%
Need New LOA 2020 36 12 24 0.5 33.3%
Need New LOA 2021 52 29 23 1.3 55.8%
Need New LOA 2022 18 15 3 5.0 83.3%
Opt Out 2019 11 9 2 4.5 81.8%
Opt Out 2020 12 11 1 11.0 91.7%
Opt Out 2021 14 11 3 3.7 78.6%
Opt Out 2022 10 10 0 Inf 100.0%
Total NA 167 103 64 1.6 61.7%
Renewal Rate by Account Segment
  1. Large Public & Private (42% of decisions) are top of the leaderboard, with Canada close behind.
  2. Regional Public and Selectives perform similarly.
  3. Regional Private is the smallest N and bottom of the board.
Renewal Ratio by Account Segment
AccountSegment N ATL Dropped Ratio Perc_Renewed
Canada 15 10 5 2.0 66.7%
Large Public & Private 71 50 21 2.4 70.4%
Regional Private 10 2 8 0.2 20.0%
Regional Public 40 23 17 1.4 57.5%
Selective 31 18 13 1.4 58.1%
Renewal Rate by Account Segment & Fiscal Year
  1. Large P&P continual improvement across the FYs, no dip in FY20.
  2. Rest of the segments do have FY20 dips with Selectives and Regional Publics rebounding.
  3. Regional Privates have no F22 decisions - might have helped!
Renewal Ratio by Account Segment
AccountSegment FiscalYear N ATL Dropped Ratio Perc_Renewed
Canada 2019 2 2 0 Inf 100.0%
Canada 2020 5 3 2 1.5 60.0%
Canada 2021 5 3 2 1.5 60.0%
Canada 2022 3 2 1 2.0 66.7%
Large Public & Private 2019 11 6 5 1.2 54.5%
Large Public & Private 2020 16 10 6 1.7 62.5%
Large Public & Private 2021 31 21 10 2.1 67.7%
Large Public & Private 2022 13 13 0 Inf 100.0%
Regional Private 2019 3 1 2 0.5 33.3%
Regional Private 2020 5 1 4 0.2 20.0%
Regional Private 2021 2 0 2 0.0 0.0%
Regional Public 2019 6 4 2 2.0 66.7%
Regional Public 2020 15 6 9 0.7 40.0%
Regional Public 2021 15 9 6 1.5 60.0%
Regional Public 2022 4 4 0 Inf 100.0%
Selective 2019 3 2 1 2.0 66.7%
Selective 2020 7 3 4 0.8 42.9%
Selective 2021 13 7 6 1.2 53.8%
Selective 2022 8 6 2 3.0 75.0%
Renewal by Decision Type & Segment
  1. Large P&P NNLOA is one of the best we’ve seen!
  2. Regional Publics and Selectives still look similar, across NNLOA and Opt Out.
Renewal Ratio by Account Segment
AccountSegment DecisionType N ATL Dropped Ratio Perc_Renewed
Canada Need New LOA 13 9 4 2.2 69.2%
Canada Opt Out 2 1 1 1.0 50.0%
Large Public & Private Need New LOA 49 31 18 1.7 63.3%
Large Public & Private Opt Out 22 19 3 6.3 86.4%
Regional Private Need New LOA 9 1 8 0.1 11.1%
Regional Private Opt Out 1 1 0 Inf 100.0%
Regional Public Need New LOA 26 11 15 0.7 42.3%
Regional Public Opt Out 14 12 2 6.0 85.7%
Selective Need New LOA 23 10 13 0.8 43.5%
Selective Opt Out 8 8 0 Inf 100.0%
CRP Inclusion
  1. Taken out of the analysis. Proof of the fact.
Renewal Ratio by CRP Inclusion
GRP3-4 N ATL Dropped Ratio Perc_Renewed
0 167 103 64 1.6 61.7%
Impact Interaction Volume Histogram
  1. Central tendency is around 3.5.
  2. Lots of low utilizers in the 0-2 bucket.
  3. Another peak at 4 and then a longish tail.

Impact Interaction Volume Histogram Split by Decision
  1. The distribution below might make me believe that there is a sweetspot between 4 and 6. Too much utilization might not be good and too little is certainly not good.

Impact Interaction Volume Histogram Split by Pool Date FY
  1. FY22 is a close image of the entire distribution, but no one in the 0 bucket!
  2. FY21 looks to have some of the higher utilizers.

Renewal by Interaction Volume and Decision Type, Unbinned
  1. [NNLOA] 4-6 region. Anything more might not be good.
  2. [Opt Out] No pattern.
Renewal Ratio by Impact Interaction Volume
DecisionType II_Credited_Volume N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 8 2 6 0.3 25.0%
Need New LOA 1 16 4 12 0.3 25.0%
Need New LOA 2 22 11 11 1.0 50.0%
Need New LOA 3 14 5 9 0.6 35.7%
Need New LOA 4 23 17 6 2.8 73.9%
Need New LOA 5 12 6 6 1.0 50.0%
Need New LOA 6 12 11 1 11.0 91.7%
Need New LOA 7 8 5 3 1.7 62.5%
Need New LOA 8 2 1 1 1.0 50.0%
Need New LOA 9 2 0 2 0.0 0.0%
Need New LOA 12 1 0 1 0.0 0.0%
Opt Out 0 1 1 0 Inf 100.0%
Opt Out 1 7 7 0 Inf 100.0%
Opt Out 2 12 8 4 2.0 66.7%
Opt Out 3 6 6 0 Inf 100.0%
Opt Out 4 7 7 0 Inf 100.0%
Opt Out 5 5 4 1 4.0 80.0%
Opt Out 6 3 3 0 Inf 100.0%
Opt Out 7 2 2 0 Inf 100.0%
Opt Out 8 3 2 1 2.0 66.7%
Opt Out 10 1 1 0 Inf 100.0%
Renewal by Impact Interaction Volume and Decision Type, (Binned)

Adjusted the binning to better capture the high volume present in URF.

  1. For NNLOA, increased impact interaction volume does look to help, as you go from 2 to 4-6. But then 7+ doesn’t look strong.
  2. For Opt Out, as suggested above, it is all over the place.
Renewal Ratio by Impact Interaction Volume (Binned)
DecisionType II_Volume_Bins N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 8 2 6 0.3 25.0%
Need New LOA 1 16 4 12 0.3 25.0%
Need New LOA 2-3 36 16 20 0.8 44.4%
Need New LOA 4-6 47 34 13 2.6 72.3%
Need New LOA 7+ 13 6 7 0.9 46.2%
Opt Out 0 1 1 0 Inf 100.0%
Opt Out 1 7 7 0 Inf 100.0%
Opt Out 2-3 18 14 4 3.5 77.8%
Opt Out 4-6 15 14 1 14.0 93.3%
Opt Out 7+ 6 5 1 5.0 83.3%

Renewal by Impact Interaction Volume and Account Segment, (Binned)

  1. 7+ is low N spread across the Segments: each segment is still lower compared to 4-6.
Renewal Ratio by Impact Interaction Volume (Binned)
AccountSegment II_Volume_Bins N ATL Dropped Ratio Perc_Renewed
Canada 0 1 1 0 Inf 100.0%
Canada 1 1 0 1 0.0 0.0%
Canada 2-3 5 5 0 Inf 100.0%
Canada 4-6 7 3 4 0.8 42.9%
Canada 7+ 1 1 0 Inf 100.0%
Large Public & Private 0 5 1 4 0.2 20.0%
Large Public & Private 1 11 7 4 1.8 63.6%
Large Public & Private 2-3 19 12 7 1.7 63.2%
Large Public & Private 4-6 29 26 3 8.7 89.7%
Large Public & Private 7+ 7 4 3 1.3 57.1%
Regional Private 0 1 0 1 0.0 0.0%
Regional Private 1 2 1 1 1.0 50.0%
Regional Private 2-3 4 0 4 0.0 0.0%
Regional Private 4-6 3 1 2 0.5 33.3%
Regional Public 0 2 1 1 1.0 50.0%
Regional Public 1 4 0 4 0.0 0.0%
Regional Public 2-3 16 8 8 1.0 50.0%
Regional Public 4-6 15 12 3 4.0 80.0%
Regional Public 7+ 3 2 1 2.0 66.7%
Selective 1 5 3 2 1.5 60.0%
Selective 2-3 10 5 5 1.0 50.0%
Selective 4-6 8 6 2 3.0 75.0%
Selective 7+ 8 4 4 1.0 50.0%

Large P&P NNLOA Renewal by Impact Interaction Volume (Binned) & Decision Type

  1. Parsed a little too finely to draw much of a conclusion here.
Large P&P Renewal Ratio by Decision Type & Impact Interaction Volume (Binned)
II_Volume_Bins FiscalYear N ATL Dropped Ratio Perc_Renewed
0 2019 2 0 2 0.0 0.0%
0 2020 2 1 1 1.0 50.0%
0 2021 1 0 1 0.0 0.0%
1 2019 1 0 1 0.0 0.0%
1 2020 2 0 2 0.0 0.0%
1 2021 2 1 1 1.0 50.0%
1 2022 1 1 0 Inf 100.0%
2-3 2019 1 1 0 Inf 100.0%
2-3 2020 4 1 3 0.3 25.0%
2-3 2021 6 4 2 2.0 66.7%
2-3 2022 2 2 0 Inf 100.0%
4-6 2019 1 1 0 Inf 100.0%
4-6 2020 2 2 0 Inf 100.0%
4-6 2021 11 8 3 2.7 72.7%
4-6 2022 6 6 0 Inf 100.0%
7+ 2020 1 1 0 Inf 100.0%
7+ 2021 4 2 2 1.0 50.0%

#####Simple Regression for Impact Interaction Volume

  1. The Estimate for Impact Interaction Volume is Positive -> increased consumption means increased likelihood to renew.
  2. This is statistically significant.
  Target_Binary
Predictors Odds Ratios CI p
(Intercept) 0.57 0.28 – 1.12 0.107
II Credited Volume 1.20 1.02 – 1.42 0.036
Observations 120
R2 Tjur 0.041
Penetration by Event Grouping

Reminder: 1. Experience = VIP Days & Collaboratives

  1. Service = Benchmarking, Audits, Secret Shopper, Customer Research Projects, Market Insights, and Survey Walkthroughs

  2. Expert Call = Expert Center, Benchmarking Walkthrough, Tool’s Walkthrough

  3. SL Led = Research SL Impact, Evergreen Action, Exec Update, National Meeting Pre-wire

  4. Research Interview = Research Initial & Scoping

  5. Events = National Meeting, COVID Working Group

  6. PLW/Onsite = Onsite, PLW

  7. SL Led, Expert Calls, and Events are the highest penetration.

  8. SL Led favors Opt Outs, while Events favors NNLOA.

Percent of Renewals w/ At Least 1 Interaction in a Group
DecisionType Perc_Events Perc_Service Perc_SLLed Perc_ResearchInt Perc_PLW_Onsite Perc_Experience Perc_ExpertCall
Need New LOA 55.8% 30.0% 45.8% 16.7% 14.2% 6.7% 59.2%
Opt Out 44.7% 31.9% 66.0% 29.8% 17.0% 0.0% 53.2%
Renewal by Event Consumption
  1. [NNLOA] 10% bump above the average. Giant leap above not consuming - 22%.
  2. [Opt Out] No effect for Opt Outs.
Renewal Ratio by Event Consumption
DecisionType II_Events_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 53 21 32 0.7 39.6%
Need New LOA 1 67 41 26 1.6 61.2%
Opt Out 0 26 23 3 7.7 88.5%
Opt Out 1 21 18 3 6.0 85.7%
Renewal by Event Consumption Volume
  1. 1 Event seems better than 0, and 2+ combined look strong.

Renewal by Event, OT

  1. [NNLOA] Except FY22, consistent pattern of attending events is better than not. FY22 is pretty close and very high, anyway.
Renewal Ratio by Event Consumption
DecisionType II_Events_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 9 2 7 0.3 22.2%
Need New LOA 0 2020 20 5 15 0.3 25.0%
Need New LOA 0 2021 17 8 9 0.9 47.1%
Need New LOA 0 2022 7 6 1 6.0 85.7%
Need New LOA 1 2019 5 4 1 4.0 80.0%
Need New LOA 1 2020 16 7 9 0.8 43.8%
Need New LOA 1 2021 35 21 14 1.5 60.0%
Need New LOA 1 2022 11 9 2 4.5 81.8%
Opt Out 0 2019 7 6 1 6.0 85.7%
Opt Out 0 2020 8 7 1 7.0 87.5%
Opt Out 0 2021 6 5 1 5.0 83.3%
Opt Out 0 2022 5 5 0 Inf 100.0%
Opt Out 1 2019 4 3 1 3.0 75.0%
Opt Out 1 2020 4 4 0 Inf 100.0%
Opt Out 1 2021 8 6 2 3.0 75.0%
Opt Out 1 2022 5 5 0 Inf 100.0%
Renewal by Service Consumption
  1. [NNLOA] Decent lift above the average - 7%. Not consuming is just below the average.
  2. [Opt Out] 9% bump.
Renewal Ratio by Service Consumption
DecisionType II_Service_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 84 41 43 1.0 48.8%
Need New LOA 1 36 21 15 1.4 58.3%
Opt Out 0 32 27 5 5.4 84.4%
Opt Out 1 15 14 1 14.0 93.3%
Renewal by Service Consumption Volume
  1. You start to see some benefit from consuming 1 service.
  2. More considerable renewal benefit from 2+.

Renewal by Service Consumption, OT

  1. [NNLOA] Consumption mostly over the past couple FYs.
  2. [NNLOA] Tough to compete with FY22 no consumption - perfect score - which lowers effect of Service.
Renewal Ratio by Service Consumption
DecisionType II_Service_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 12 6 6 1.0 50.0%
Need New LOA 0 2020 33 11 22 0.5 33.3%
Need New LOA 0 2021 31 16 15 1.1 51.6%
Need New LOA 0 2022 8 8 0 Inf 100.0%
Need New LOA 1 2019 2 0 2 0.0 0.0%
Need New LOA 1 2020 3 1 2 0.5 33.3%
Need New LOA 1 2021 21 13 8 1.6 61.9%
Need New LOA 1 2022 10 7 3 2.3 70.0%
Opt Out 0 2019 9 7 2 3.5 77.8%
Opt Out 0 2020 10 10 0 Inf 100.0%
Opt Out 0 2021 6 3 3 1.0 50.0%
Opt Out 0 2022 7 7 0 Inf 100.0%
Opt Out 1 2019 2 2 0 Inf 100.0%
Opt Out 1 2020 2 1 1 1.0 50.0%
Opt Out 1 2021 8 8 0 Inf 100.0%
Opt Out 1 2022 3 3 0 Inf 100.0%
Renewal by SL Consumption
  1. [NNLOA] Marginal benefit.
  2. [Opt Out] Same as NNLOA.
Renewal Ratio by SL-Led Consumption
DecisionType II_SLLed_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 65 32 33 1.0 49.2%
Need New LOA 1 55 30 25 1.2 54.5%
Opt Out 0 16 14 2 7.0 87.5%
Opt Out 1 31 27 4 6.8 87.1%

SL Consumption Volume & Renewal

  1. Relatively consistent performance for 0-2. 3+ looks good.

Renewal by SL Consumption, OT
  1. [NNLOA] FY20 really pulling down the total. Other years support higher lift from SL Led impact interactions.
Renewal Ratio by SL-Led Consumption
DecisionType II_SLLed_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 8 1 7 0.1 12.5%
Need New LOA 0 2020 14 6 8 0.8 42.9%
Need New LOA 0 2021 31 16 15 1.1 51.6%
Need New LOA 0 2022 12 9 3 3.0 75.0%
Need New LOA 1 2019 6 5 1 5.0 83.3%
Need New LOA 1 2020 22 6 16 0.4 27.3%
Need New LOA 1 2021 21 13 8 1.6 61.9%
Need New LOA 1 2022 6 6 0 Inf 100.0%
Opt Out 0 2019 5 4 1 4.0 80.0%
Opt Out 0 2020 4 3 1 3.0 75.0%
Opt Out 0 2021 3 3 0 Inf 100.0%
Opt Out 0 2022 4 4 0 Inf 100.0%
Opt Out 1 2019 6 5 1 5.0 83.3%
Opt Out 1 2020 8 8 0 Inf 100.0%
Opt Out 1 2021 11 8 3 2.7 72.7%
Opt Out 1 2022 6 6 0 Inf 100.0%
Renewal by Research Interview Consumption
  1. [NNLOA] Lower N, High return. Huge lift above average - 29%.
  2. [Opt out] Small lift here.
Renewal Ratio by Research Interview Consumption
DecisionType II_ResearchInterview_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 100 46 54 0.9 46.0%
Need New LOA 1 20 16 4 4.0 80.0%
Opt Out 0 33 28 5 5.6 84.8%
Opt Out 1 14 13 1 13.0 92.9%
Research Interview Volume & Renewal
  1. Increasing consumption in this category does seem to improve unit rate.

Renewal By Research Interview Consumption, OT
  1. [NNLOA] Consistently better across the time.
Renewal Ratio by Research Interview Consumption
DecisionType II_ResearchInterview_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 12 4 8 0.5 33.3%
Need New LOA 0 2020 29 7 22 0.3 24.1%
Need New LOA 0 2021 46 25 21 1.2 54.3%
Need New LOA 0 2022 13 10 3 3.3 76.9%
Need New LOA 1 2019 2 2 0 Inf 100.0%
Need New LOA 1 2020 7 5 2 2.5 71.4%
Need New LOA 1 2021 6 4 2 2.0 66.7%
Need New LOA 1 2022 5 5 0 Inf 100.0%
Opt Out 0 2019 7 6 1 6.0 85.7%
Opt Out 0 2020 6 5 1 5.0 83.3%
Opt Out 0 2021 14 11 3 3.7 78.6%
Opt Out 0 2022 6 6 0 Inf 100.0%
Opt Out 1 2019 4 3 1 3.0 75.0%
Opt Out 1 2020 6 6 0 Inf 100.0%
Opt Out 1 2022 4 4 0 Inf 100.0%
Renewal by PLW OR Onsite Consumption
  1. [NNLOA] Also decent sized lift - ~20%. Lower N, like Research interview.
  2. [Opt Out] No effect.
Renewal Ratio by PLW OR Onsite Consumption
DecisionType II_PLW_Onsite_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 103 50 53 0.9 48.5%
Need New LOA 1 17 12 5 2.4 70.6%
Opt Out 0 39 34 5 6.8 87.2%
Opt Out 1 8 7 1 7.0 87.5%
PLW / Onsite Volume & Renewal
  1. 1 seems sufficient.

Renewal by PLW/Onsite OT
  1. [NNLOA] Mostly delivered in the past 2 years to a high degree of success.
Renewal Ratio by PLW OR Onsite Consumption
DecisionType II_PLW_Onsite_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 12 5 7 0.7 41.7%
Need New LOA 0 2020 34 12 22 0.5 35.3%
Need New LOA 0 2021 46 25 21 1.2 54.3%
Need New LOA 0 2022 11 8 3 2.7 72.7%
Need New LOA 1 2019 2 1 1 1.0 50.0%
Need New LOA 1 2020 2 0 2 0.0 0.0%
Need New LOA 1 2021 6 4 2 2.0 66.7%
Need New LOA 1 2022 7 7 0 Inf 100.0%
Opt Out 0 2019 9 7 2 3.5 77.8%
Opt Out 0 2020 10 9 1 9.0 90.0%
Opt Out 0 2021 12 10 2 5.0 83.3%
Opt Out 0 2022 8 8 0 Inf 100.0%
Opt Out 1 2019 2 2 0 Inf 100.0%
Opt Out 1 2020 2 2 0 Inf 100.0%
Opt Out 1 2021 2 1 1 1.0 50.0%
Opt Out 1 2022 2 2 0 Inf 100.0%
Renewal by Experience Consumption
  1. [NNLOA] Very low N. Inversion. Might not be worth dedicating much time to.
Renewal Ratio by Experience Consumption
DecisionType II_Experience_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 112 60 52 1.2 53.6%
Need New LOA 1 8 2 6 0.3 25.0%
Opt Out 0 47 41 6 6.8 87.2%
Experience Volume & Renewal

N too low.

Renewal by Experience Consumption OT

N too low. Mostly from 2020.

Renewal Ratio by Experience Consumption
DecisionType II_Experience_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 14 6 8 0.8 42.9%
Need New LOA 0 2020 29 10 19 0.5 34.5%
Need New LOA 0 2021 51 29 22 1.3 56.9%
Need New LOA 0 2022 18 15 3 5.0 83.3%
Need New LOA 1 2020 7 2 5 0.4 28.6%
Need New LOA 1 2021 1 0 1 0.0 0.0%
Opt Out 0 2019 11 9 2 4.5 81.8%
Opt Out 0 2020 12 11 1 11.0 91.7%
Opt Out 0 2021 14 11 3 3.7 78.6%
Opt Out 0 2022 10 10 0 Inf 100.0%
Renewal by Expert Call Consumption
  1. [NNLOA] High degree of penetration, very low benefit.
  2. [Opt Out] Small lift, unlikely to be statistically significant.
Renewal Ratio by Expert Call Consumption
DecisionType II_ExpertCall_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 49 26 23 1.1 53.1%
Need New LOA 1 71 36 35 1.0 50.7%
Opt Out 0 22 19 3 6.3 86.4%
Opt Out 1 25 22 3 7.3 88.0%
Expert Call Volume & Renewal
  1. Decent degree of utilizationm, with roughly equivalent drops across the board.

Renewal by Expert Call Consumption OT
  1. [NNLOA] Only marginally worse in FY22. FY20/21 have larger N and drive the result.
Renewal Ratio by Expert Call Consumption
DecisionType II_ExpertCall_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 10 4 6 0.7 40.0%
Need New LOA 0 2020 14 5 9 0.6 35.7%
Need New LOA 0 2021 18 11 7 1.6 61.1%
Need New LOA 0 2022 7 6 1 6.0 85.7%
Need New LOA 1 2019 4 2 2 1.0 50.0%
Need New LOA 1 2020 22 7 15 0.5 31.8%
Need New LOA 1 2021 34 18 16 1.1 52.9%
Need New LOA 1 2022 11 9 2 4.5 81.8%
Opt Out 0 2019 5 3 2 1.5 60.0%
Opt Out 0 2020 8 8 0 Inf 100.0%
Opt Out 0 2021 5 4 1 4.0 80.0%
Opt Out 0 2022 4 4 0 Inf 100.0%
Opt Out 1 2019 6 6 0 Inf 100.0%
Opt Out 1 2020 4 3 1 3.0 75.0%
Opt Out 1 2021 9 7 2 3.5 77.8%
Opt Out 1 2022 6 6 0 Inf 100.0%

Finer Grain Look at What Was Consumed

Event Category and Event Purpose

  1. Diagnostic and Audits! Career Services and Orientation!
  2. Some successful national meetings.
  3. Odd that Tool’s walkthrough would be lower than Diagnostic.
Renewal Ratio by Event Category and Event Purpose
Event_Category EventPurpose N ATL Dropped Ratio Perc_Renewed
Benchmark SAF - Campus Climate Survey CCS2018 4 2 2 1.0 50.0%
Benchmark SAF - Campus Climate Survey SP19 4 2 2 1.0 50.0%
Collaborative How to Mitigate the Impact of Controversial Campus Events 2 1 1 1.0 50.0%
Collaborative SAF - Emotional Support Animal Accommodations 6 2 4 0.5 33.3%
Collaborative Student Affairs Forum Collaborative: Working Session 1 2 0 2 0.0 0.0%
COVID Working Group Session COVID-19 Web Audit (SAF) 1 1 0 Inf 100.0%
COVID Working Group Session COVID Orientation Research SAF/EMF 3 1 2 0.5 33.3%
COVID Working Group Session COVID Social Distancing Research 3 2 1 2.0 66.7%
COVID Working Group Session SAF COVID-19 Working Group - Critical Conversations: SLAC Private Session 1 1 0 Inf 100.0%
COVID Working Group Session SAF COVID Working Group - Rapidly Building Community Online for Students during 13 9 4 2.2 69.2%
COVID Working Group Session SAF COVID Working Group - Supporting Staff Self Care and Reflection during COVID 5 1 4 0.2 20.0%
Diagnostic or Audit Career Services Web Audit (SAF) 24 17 7 2.4 70.8%
Diagnostic or Audit Orientation Web Audit (SAF) 15 12 3 4.0 80.0%
Diagnostic or Audit Staff Engagement and Self-Care Audit 3 2 1 2.0 66.7%
Diagnostic or Audit User Experience Audit (AAF) 1 1 0 Inf 100.0%
Diagnostic or Audit User Experience Audit (SAF) 3 3 0 Inf 100.0%
Evergreen Action Evergreen Action 6 3 3 1.0 50.0%
Executive Update Executive Update 2 2 0 Inf 100.0%
Expert Center Expert Center 61 38 25 1.5 62.3%
Expert Center Expert Center Call 20 11 10 1.1 55.0%
Market Research NA 2 1 1 1.0 50.0%
National Meeting 2018 Student Affairs Forum National Meeting, 1 1 0 Inf 100.0%
National Meeting 2018 Student Affairs Forum National Meeting, Chicago, IL 2 0 2 0.0 0.0%
National Meeting 2018 Student Affairs Forum National Meeting, Santa Monica, CA 1 1 0 Inf 100.0%
National Meeting 2018 Student Affairs Forum National Meeting, Washington, DC 8 5 3 1.7 62.5%
National Meeting 2019 Student Affairs Forum National Meeting, Chicago, IL 6 4 2 2.0 66.7%
National Meeting 2019 Student Affairs Forum National Meeting, Santa Monica, CA 3 3 0 Inf 100.0%
National Meeting 2019 Student Affairs Forum National Meeting, Washington, DC 17 11 6 1.8 64.7%
National Meeting Enrolling and Serving the Students of the Pandemic: What Higher Ed Leaders Need to Know About Tomorr, 11 10 1 10.0 90.9%
National Meeting ET - Virtual - SAF, 25 18 8 2.2 72.0%
National Meeting Joint Virtual Working Session EMF and SAF: Crafting a Compelling Virtual Orientation, 16 9 7 1.3 56.2%
National Meeting Mental Health Collaborative | Fundraising for Student Mental Health and Wellbeing, 1 1 0 Inf 100.0%
National Meeting Supporting Student Mental Health and Wellness in Spring 2021: A Facilitated Conversation with EAB, 3 1 2 0.5 33.3%
National Meeting Supporting Students Financially Across the Student Lifecycle, 1 1 0 Inf 100.0%
National Meeting The Next Decade in Student Mental Health and Wellness, 7 7 0 Inf 100.0%
National Meeting Virtual Working Session SAF: Rapidly Building Community Online for Students during COVID19, 12 9 3 3.0 75.0%
National Meeting Virtual Working Session SAF: Supporting Staff Self Care and Reflection during COVID19, 5 1 4 0.2 20.0%
National Meeting Pre-Wire National Meeting Pre-Wire 1 0 1 0.0 0.0%
Onsite Onsite | SAF | 04/10/2019 1 1 0 Inf 100.0%
Onsite Onsite | SAF | Presentation Date: 05/29/2019 1 0 1 0.0 0.0%
Onsite Onsite l SAF l Presentation date: 6/22/18 1 1 0 Inf 100.0%
Onsite Program Innovation 1 1 0 Inf 100.0%
Onsite NA 1 0 1 0.0 0.0%
Research Initial 2018 SAF Scoping 1 1 0 Inf 100.0%
Research Initial 2019 SAF Scoping 3 3 0 Inf 100.0%
Research Initial 2019 SAF Supporting Low-Income Students 15 12 3 4.0 80.0%
Research Initial Blueprint for Growth 1 1 0 Inf 100.0%
Research Initial Career Services Web Audit (SAF) 1 1 0 Inf 100.0%
Research Initial Exam Accommodations and Services 1 1 0 Inf 100.0%
Research Initial Future of the Hybrid Campus 1 1 0 Inf 100.0%
Research Initial Residence Life 1 1 0 Inf 100.0%
Research Initial SAF 2018 Research: Campus Climate Flashpoints 1 1 0 Inf 100.0%
Research Initial SAF 2018 Research: Growth Mindset 1 0 1 0.0 0.0%
Research Initial SAF 2019 Research: Citizenry of the Future 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - (SAF) Coffee w/ Flavius Lilly 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Breakfast Meeting in Chicago 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Call 5 2 3 0.7 40.0%
Research SL Impact Research SL Impact - Call - Hartford - SAF - Fred Sweitzer 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Call - UCSC - SAF - HARI debrief - Dani Barker and Lucy Rojas 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Campus Climate Survey Participation 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Campus Climate Survey Walkthrough 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Campus Visit 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Career Services Audit Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Career Services Virtual Working Session: Supporting Career Needs Through and Beyond COVID-19 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Check In, Equity Audit Walk through 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Check In/Tools Walk Through 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Citadel SAF 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Colorado College SAF/AF Joint Visit with David F 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Coping and Resiliency Walk through 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Custom Benchmark and Research Walkthrough 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Dalhousie University SAF - Check in Call - Ivan Joseph- Vice-Provost, Student Affairs 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - DLF Webinar - Series - 2020 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Election 2020 Collaborative Walkthrough 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Enrollment State of the Union 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Executive Cabinet Presentation 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Expert Call: Food Pantry 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Expert Panel on Free Speech Policies 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - HARI 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In-Person Meeting at 10/2/19 SAF National Meeting 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - In-person Visit->Linnea Hengst 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - In-Person Visit with Tim Pierson 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Meeting 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Visit 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - in person visit at meeting 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - IPM Campus 2020 Walkthru 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - IPV 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Leadership Team Meeting 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting 3 3 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting - Baylor - SAF - Kevin Jackson (VP, Student Life) 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting - Campus Safety - Amanda Taylor 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - MSU LRP Planning Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Networking Connection 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - On Campus Meeting with Tracy Tyree 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - onsite (campus activism) 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Partner Meeting 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Phone Appointment-SME-Ivan Joseph 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - PLW Follow Up 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Research Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Research SL Impact, COVID19 Web Audit & SAF Self-Care Audit 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - research sl visit 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Ryerson SAF Meeting Attendance 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SAF and Campus Climate Survey Discussion 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SAF meeting attendance 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - SAF Team Meeting Attendance 10/14 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Schedule Seton Hall and EAB Joint Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Second Exec Roundtable Topic 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Self-Care Audit 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - SF UNH SAF 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SF UNH SAF Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SF Wichita SAF Expert Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SL impact 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SL visit - Baylor Univ - Kevin Jackson at SOTF Summit 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Student Affairs Forum Quarterly Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Student Affairs Leadership Team Meeting 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Tool/Research Walkthrough on Advising and Mental Health Resources 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Tools Waklthrough 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Transfer Students Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - U Toronto SAF forward planning call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - University of Houston SAF | Dr. Richard Walker: Vice President for Student Affairs, Dr. Daniel Maxwell: Associate Vice President for Student Affairs, 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - University of Houston SAF | Senior Leadership presentation 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Walkthrough of SAF Audit 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Webinar - SAF - UVA - ARP - Shaka Sydnor 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Working Group Second Program 8 4 4 1.0 50.0%
Research SL Impact Research SL Impact Visit 26 17 9 1.9 65.4%
Scoping 2021 Student Belonging Scoping 5 5 0 Inf 100.0%
Scoping S21 Mental Health Strategy 4 3 1 3.0 75.0%
Scoping Scope of Care - Summer 2021 1 1 0 Inf 100.0%
Survey Walkthrough SAF - Campus Climate Survey SP20 5 3 2 1.5 60.0%
Tool’s Walkthrough Tool’s Walk Through 17 8 10 0.8 47.1%
Webinar Partner Intensive | SAF | Customized Presentation 1 1 0 Inf 100.0%
Webinar Partner Intensive | SAF | Overcoming Hidden Enemies to Strategy | Presentation Date: 07/23/21 1 1 0 Inf 100.0%
Webinar Partner Intensive | SAF | Serving Students of the Pandemic 1 1 0 Inf 100.0%
Webinar Partner Intensive | SAF | Serving the Students of the Pandemic and Creating a Culture of Well Being 1 1 0 Inf 100.0%
Webinar Partner Intensive | SAF | The Evolving Nature of Student Activism 1 1 0 Inf 100.0%
Webinar PLW | SAF | 03/20/2019 1 1 0 Inf 100.0%
Webinar PLW | SAF | 04/16/2019 1 0 1 0.0 0.0%
Webinar PLW | SAF | Presentation Date: 03/26/2019 1 1 0 Inf 100.0%
Webinar PLW l SAF l Presentation date: 4/17/18 1 1 0 Inf 100.0%
Webinar PLW: Fall Contingency Planning - SAF - 5/22/2020 1 1 0 Inf 100.0%
Webinar Student Affairs Contingency Planning - SAF | Presentation Date 6/9/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | SAF | Anticipating the Impact of Gen Z | Presentation Date: 12/2/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | SAF | Campus Flashpoints 1 1 0 Inf 100.0%
Webinar Virtual Meeting | SAF | Civil Discourse and the Evolving Challenges in Student Activism | Presentation date: 11/5/20 1 0 1 0.0 0.0%
Webinar Virtual Meeting | SAF | Generation Z and the Students of the Pandemic 1 1 0 Inf 100.0%
Webinar Virtual Meeting | SAF | Meeting the Escalating Demand for Mental Health Services 1 1 0 Inf 100.0%
Webinar Virtual Meeting | SAF | Navigating the Student Activism Wave | Presentation date: 9/29/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | SAF | The Evolving Nature of Student Activism 1 1 0 Inf 100.0%
Webinar Virtual Meeting | SAF | The Evolving Nature of Student Activism | Presentation date: 10/19/20 1 0 1 0.0 0.0%
Webinar Virtual Meeting | SAF | The Evolving Nature of Student Activism | Presentation date: 12/3/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | Seton Hall University | Custom Presentation | AAF 1 1 0 Inf 100.0%
Webinar NA 3 1 2 0.5 33.3%
NA NA 9 4 5 0.8 44.4%
Correlation betwen Event Groupings, and Renewal
  1. Research Interview, Onsites, and Service are most correlated with renewal.
  2. Positive Correlations: Onsites appear to be the most halo-ey.
  3. Negative Correlations: Expert Calls crowding out other interactions?

Multivariate Regression (still kind of simple)

Note: Looking at all decision types.

  1. Overall, Research interviews are statistically significant.
  2. For NNLOAs, Events and Expert Calls pop as significant.
  Target_Binary
Predictors Odds Ratios CI p
(Intercept) 0.54 0.27 – 1.06 0.077
II Events Volume 1.28 0.92 – 1.86 0.154
II SLLed Volume 1.26 0.84 – 1.91 0.263
II ResearchInterview
Volume 		4.57 1.64 – 16.96 0.009
II PLW Onsite Volume 2.70 1.09 – 8.27 0.049
II ExpertCall Volume 0.82 0.59 – 1.12 0.224
II Service Volume 1.33 0.70 – 2.65 0.393
Observations 120
R2 Tjur 0.150