FF Analysis

The purpose of this analysis is to understand the variable effect of impact interactions on the likelihood of a partner to renew their partnership. Simply, which service levers matter more for partnership renewal.

Executive Summary

Methodological Considerations

  1. The data set consists of decisions from FY19 through March of FY22.

  2. Similar to previous analyses, we are primarily looking at the year leading up to a decision.

  3. We are not looking at ‘integrated’ partnerships. That is, we are focusing on utilization at the account where the renewal decision is made.

  4. I’ve taken CRPs out of this analysis, because they renew at a high rate - obscuring other performance - AND are covered in a separate analysis.

  5. Lastly, we are looking at unit renewal rates instead of $ renewal rates. This allows us to treat impact interactions equitably across partnerships.

Renewal by Decision Type

The below table should not come as a surprise. Opt Outs tend to perform very well while NNLOA can be quite mixed.

  1. Remember the Ratios: 0.9 for NNLOA, 3.6 for Opt Outs.
  2. Opt Outs perform well, while NNLOA are below 50%.
Renewal Ratio by Decision Type
DecisionType N ATL Dropped Ratio Perc_Renewed
Need New LOA 94 44 50 0.9 46.8%
Opt Out 37 29 8 3.6 78.4%
Total 131 73 58 1.3 55.7%

Renewals by Decision Type and Year

Since we are combining multiple years of data, we will frequently take a look at whether there are differences across the years.

  1. NNLOA performance has been climbing since FY20.
  2. NNLOA performance appears to have clusters - FY19-20 are similar, FY21-22 are similar.
  3. Most of the opt outs took place in FY19-20, with solid performance.
  4. FY21 has half of the drops for Opt Outs, with a very low overall N.
  5. FY22 looks to be back on pace.
Renewal Ratio by Decision Type
DecisionType FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 2019 15 6 9 0.7 40.0%
Need New LOA 2020 27 10 17 0.6 37.0%
Need New LOA 2021 38 20 18 1.1 52.6%
Need New LOA 2022 14 8 6 1.3 57.1%
Opt Out 2019 10 9 1 9.0 90.0%
Opt Out 2020 15 12 3 4.0 80.0%
Opt Out 2021 8 4 4 1.0 50.0%
Opt Out 2022 4 4 0 Inf 100.0%
Total NA 131 73 58 1.3 55.7%
Renewal Rate by Account Segment
  1. Most of the decisions are in Large P&P or Selective - performance in both is nearly identical at the aggregate level.
  2. Regionals and Canada are lower Ns and also significantly worse performers.
Renewal Ratio by Account Segment
AccountSegment N ATL Dropped Ratio Perc_Renewed
Canada 8 2 6 0.3 25.0%
Large Public & Private 70 42 28 1.5 60.0%
Regional Private 1 0 1 0.0 0.0%
Regional Public 14 6 8 0.8 42.9%
Selective 38 23 15 1.5 60.5%
Renewal Rate by Account Segment & Fiscal Year
  1. Large P&P had a couple of tough years in the middle, with performance in this last FY being stronger.
  2. Selectives have been relatively steady across the years; a blip in FY20.
Renewal Ratio by Account Segment
AccountSegment FiscalYear N ATL Dropped Ratio Perc_Renewed
Canada 2019 2 0 2 0.0 0.0%
Canada 2020 2 2 0 Inf 100.0%
Canada 2021 3 0 3 0.0 0.0%
Canada 2022 1 0 1 0.0 0.0%
Large Public & Private 2019 9 6 3 2.0 66.7%
Large Public & Private 2020 24 13 11 1.2 54.2%
Large Public & Private 2021 27 15 12 1.2 55.6%
Large Public & Private 2022 10 8 2 4.0 80.0%
Regional Private 2021 1 0 1 0.0 0.0%
Regional Public 2019 5 3 2 1.5 60.0%
Regional Public 2020 4 1 3 0.3 25.0%
Regional Public 2021 4 2 2 1.0 50.0%
Regional Public 2022 1 0 1 0.0 0.0%
Selective 2019 9 6 3 2.0 66.7%
Selective 2020 12 6 6 1.0 50.0%
Selective 2021 11 7 4 1.8 63.6%
Selective 2022 6 4 2 2.0 66.7%
Renewal by Decision Type & Segment
  1. Opt Out drops are coming from everywhere BUT Large P&P.
  2. NNLOA performance for Large P&P a source of weakness that is responsible for the overall NNLOA being lower.
Renewal Ratio by Account Segment
AccountSegment DecisionType N ATL Dropped Ratio Perc_Renewed
Canada Need New LOA 6 2 4 0.5 33.3%
Canada Opt Out 2 0 2 0.0 0.0%
Large Public & Private Need New LOA 52 24 28 0.9 46.2%
Large Public & Private Opt Out 18 18 0 Inf 100.0%
Regional Private Need New LOA 1 0 1 0.0 0.0%
Regional Public Need New LOA 11 5 6 0.8 45.5%
Regional Public Opt Out 3 1 2 0.5 33.3%
Selective Need New LOA 24 13 11 1.2 54.2%
Selective Opt Out 14 10 4 2.5 71.4%
CRP Inclusion
  1. Taken out of the analysis. Proof of the fact.
Renewal Ratio by CRP Inclusion
GRP3-4 N ATL Dropped Ratio Perc_Renewed
0 131 73 58 1.3 55.7%
Impact Interaction Volume Histogram
  1. Central tendency is at 4.1.
  2. Lots of low utilizers in the 0-3 bucket.
  3. There is long tail with heavy utilizers.

Impact Interaction Volume Histogram Split by Decision
  1. Super users definitively renew at a pretty high rate; the cut off could be around 4 or 5 for this forum.
  2. Pretty clear that most of the drops and mass are below 4.

Impact Interaction Volume Histogram Split by Pool Date FY
  1. A lot of the 4 and below are FY20 and FY21.
  2. FY22 has a split between those who use it and those who rarely use FF.

Renewal by Interaction Volume and Decision Type, Unbinned
  1. [NNLOA] You start to see much lift until the 4+ region.
  2. [NNLOA] The results at 9 and 10 are disconcerting. 9 is mostly a mix of FY20 and FY21
  3. [Opt Out] Unlike other forums, some evidence that utilization matters here. The bar might be a little bit lower - 3+.
Renewal Ratio by Impact Interaction Volume
DecisionType II_Credited_Volume N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 11 0 11 0.0 0.0%
Need New LOA 1 14 6 8 0.8 42.9%
Need New LOA 2 15 6 9 0.7 40.0%
Need New LOA 3 13 6 7 0.9 46.2%
Need New LOA 4 10 6 4 1.5 60.0%
Need New LOA 5 4 3 1 3.0 75.0%
Need New LOA 6 10 7 3 2.3 70.0%
Need New LOA 7 3 3 0 Inf 100.0%
Need New LOA 8 1 1 0 Inf 100.0%
Need New LOA 9 7 1 6 0.2 14.3%
Need New LOA 10 1 0 1 0.0 0.0%
Need New LOA 11 1 1 0 Inf 100.0%
Need New LOA 12 3 3 0 Inf 100.0%
Need New LOA 13 1 1 0 Inf 100.0%
Opt Out 0 1 1 0 Inf 100.0%
Opt Out 1 2 1 1 1.0 50.0%
Opt Out 2 4 2 2 1.0 50.0%
Opt Out 3 9 7 2 3.5 77.8%
Opt Out 4 5 3 2 1.5 60.0%
Opt Out 5 5 4 1 4.0 80.0%
Opt Out 6 2 2 0 Inf 100.0%
Opt Out 7 4 4 0 Inf 100.0%
Opt Out 8 3 3 0 Inf 100.0%
Opt Out 14 1 1 0 Inf 100.0%
Opt Out 16 1 1 0 Inf 100.0%
Renewal by Impact Interaction Volume and Decision Type, (Binned)

Adjusted the binning to better capture the high volume present in AAF.

  1. For NNLOA, increased impact interaction volume does tend to be associated with increased likelihood to renew.
  2. For NNLOA, 4+ is where this binning suggests there is a cutoff.
  3. NNLOA: The lower result at 7+ due to those at 9 interactions who overwhelmingly dropped.
  4. For Opt Out, as suggested above, there is some meaning to increased interaction here.
Renewal Ratio by Impact Interaction Volume (Binned)
DecisionType II_Volume_Bins N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 11 0 11 0.0 0.0%
Need New LOA 1 14 6 8 0.8 42.9%
Need New LOA 2-3 28 12 16 0.8 42.9%
Need New LOA 4-6 24 16 8 2.0 66.7%
Need New LOA 7+ 17 10 7 1.4 58.8%
Opt Out 0 1 1 0 Inf 100.0%
Opt Out 1 2 1 1 1.0 50.0%
Opt Out 2-3 13 9 4 2.2 69.2%
Opt Out 4-6 12 9 3 3.0 75.0%
Opt Out 7+ 9 9 0 Inf 100.0%

Renewal by Impact Interaction Volume and Account Segment, (Binned)

  1. For Large P&P and Selectives, 4+ cutoff looks solid.
Renewal Ratio by Impact Interaction Volume (Binned)
AccountSegment II_Volume_Bins N ATL Dropped Ratio Perc_Renewed
Canada 2-3 3 0 3 0.0 0.0%
Canada 4-6 4 2 2 1.0 50.0%
Canada 7+ 1 0 1 0.0 0.0%
Large Public & Private 0 9 1 8 0.1 11.1%
Large Public & Private 1 8 6 2 3.0 75.0%
Large Public & Private 2-3 24 13 11 1.2 54.2%
Large Public & Private 4-6 13 10 3 3.3 76.9%
Large Public & Private 7+ 16 12 4 3.0 75.0%
Regional Private 0 1 0 1 0.0 0.0%
Regional Public 0 2 0 2 0.0 0.0%
Regional Public 1 2 0 2 0.0 0.0%
Regional Public 2-3 3 2 1 2.0 66.7%
Regional Public 4-6 7 4 3 1.3 57.1%
Selective 1 6 1 5 0.2 16.7%
Selective 2-3 11 6 5 1.2 54.5%
Selective 4-6 12 9 3 3.0 75.0%
Selective 7+ 9 7 2 3.5 77.8%

Large P&P NNLOA Renewal by Impact Interaction Volume (Binned) & Decision Type

  1. Parsed a little too finely to draw much of a conclusion here.
Large P&P Renewal Ratio by Decision Type & Impact Interaction Volume (Binned)
II_Volume_Bins FiscalYear N ATL Dropped Ratio Perc_Renewed
0 2020 2 0 2 0.0 0.0%
0 2021 5 0 5 0.0 0.0%
0 2022 1 0 1 0.0 0.0%
1 2020 2 1 1 1.0 50.0%
1 2021 2 1 1 1.0 50.0%
1 2022 3 3 0 Inf 100.0%
2-3 2019 1 0 1 0.0 0.0%
2-3 2020 8 1 7 0.1 12.5%
2-3 2021 7 4 3 1.3 57.1%
2-3 2022 1 1 0 Inf 100.0%
4-6 2019 1 1 0 Inf 100.0%
4-6 2020 1 1 0 Inf 100.0%
4-6 2021 4 2 2 1.0 50.0%
4-6 2022 2 1 1 1.0 50.0%
7+ 2019 3 1 2 0.5 33.3%
7+ 2020 2 1 1 1.0 50.0%
7+ 2021 6 5 1 5.0 83.3%
7+ 2022 1 1 0 Inf 100.0%

#####Simple Regression for Impact Interaction Volume

  1. The Estimate for Impact Interaction Volume is Positive -> increased consumption means increased likelihood to renew.
  2. This is statistically significant.
  3. Controlling for account segment shows that Impact Interactions seem to matter more for Large P&P and Selectives.
  Target_Binary
Predictors Odds Ratios CI p
(Intercept) 0.10 0.01 – 0.54 0.013
II Credited Volume 1.27 1.11 – 1.48 0.001
AccountSegment [Large
Public & Private] 		6.21 1.23 – 47.37 0.040
AccountSegment [Regional
Private] 		0.00 NA – 307286768014841979562248202866408608888428866684800864448860048480640888602828644440842684200262800664268084264400602026446.00 0.993
AccountSegment [Regional
Public] 		3.38 0.50 – 30.98 0.231
AccountSegment
[Selective] 		5.10 0.96 – 40.23 0.075
Observations 131
R2 Tjur 0.143
Penetration by Event Grouping

Reminder: 1. Experience = VIP Days & Collaboratives

  1. Service = Benchmarking, Audits, Secret Shopper, Customer Research Projects, Market Insights, and Survey Walkthroughs

  2. Expert Call = Expert Center, Benchmarking Walkthrough, Tool’s Walkthrough

  3. SL Led = Research SL Impact, Evergreen Action, Exec Update, National Meeting Pre-wire

  4. Research Interview = Research Initial & Scoping

  5. Events = National Meeting, COVID Working Group

  6. PLW/Onsite = Onsite, PLW

  7. Events and Expert Calls are the highest penetration. SL Led and Research Interviews follow suit.

  8. A few of the interactions tend to favor Opt Outs - Events, SL led, and Onsites.

Percent of Renewals w/ At Least 1 Interaction in a Group
DecisionType Perc_Events Perc_Service Perc_SLLed Perc_ResearchInt Perc_PLW_Onsite Perc_Experience Perc_ExpertCall
Need New LOA 58.5% 29.8% 38.3% 25.5% 13.8% 11.7% 55.3%
Opt Out 67.6% 27.0% 56.8% 40.5% 29.7% 13.5% 51.4%
Renewal by Event Consumption
  1. [NNLOA] Compelling evidence for the value of events. Attending is a 19% bump above not attending, and a 8% lift above the average.
  2. [Opt Out] Small lift from attending, both above the average and vs. those who did not attend.
Renewal Ratio by Event Consumption
DecisionType II_Events_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 39 14 25 0.6 35.9%
Need New LOA 1 55 30 25 1.2 54.5%
Opt Out 0 12 9 3 3.0 75.0%
Opt Out 1 25 20 5 4.0 80.0%
Renewal by Event Consumption Volume
  1. 1 Event doesn’t seem to be enough to generate lift. 2+ has the desired effect.

Renewal by Event, OT

  1. [NNLOA] No consistent pattern across the years - on average attendance is more beneficial.
  2. [Opt Out] Same as NNLOA.
Renewal Ratio by Event Consumption
DecisionType II_Events_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 5 1 4 0.2 20.0%
Need New LOA 0 2020 14 6 8 0.8 42.9%
Need New LOA 0 2021 15 4 11 0.4 26.7%
Need New LOA 0 2022 5 3 2 1.5 60.0%
Need New LOA 1 2019 10 5 5 1.0 50.0%
Need New LOA 1 2020 13 4 9 0.4 30.8%
Need New LOA 1 2021 23 16 7 2.3 69.6%
Need New LOA 1 2022 9 5 4 1.2 55.6%
Opt Out 0 2019 1 1 0 Inf 100.0%
Opt Out 0 2020 8 6 2 3.0 75.0%
Opt Out 0 2021 1 0 1 0.0 0.0%
Opt Out 0 2022 2 2 0 Inf 100.0%
Opt Out 1 2019 9 8 1 8.0 88.9%
Opt Out 1 2020 7 6 1 6.0 85.7%
Opt Out 1 2021 7 4 3 1.3 57.1%
Opt Out 1 2022 2 2 0 Inf 100.0%
Renewal by Service Consumption
  1. [NNLOA] Decent lift above the average - 11%. Not consuming is just below the average.
  2. [Opt Out] Not much lift from consumption.
Renewal Ratio by Service Consumption
DecisionType II_Service_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 66 28 38 0.7 42.4%
Need New LOA 1 28 16 12 1.3 57.1%
Opt Out 0 27 21 6 3.5 77.8%
Opt Out 1 10 8 2 4.0 80.0%
Renewal by Service Consumption Volume
  1. The 2+ range might show some higher lift.

Renewal by Service Consumption, OT

  1. [NNLOA] Alternating pattern on whether consumption of Services is beneficial.
  2. [NNLOA] Most of the decisions taking place in years where consumption is pretty low.
  3. [Opt Out] Similar to NNLOA.
Renewal Ratio by Service Consumption
DecisionType II_Service_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 2 0 2 0.0 0.0%
Need New LOA 0 2020 23 9 14 0.6 39.1%
Need New LOA 0 2021 31 13 18 0.7 41.9%
Need New LOA 0 2022 10 6 4 1.5 60.0%
Need New LOA 1 2019 13 6 7 0.9 46.2%
Need New LOA 1 2020 4 1 3 0.3 25.0%
Need New LOA 1 2021 7 7 0 Inf 100.0%
Need New LOA 1 2022 4 2 2 1.0 50.0%
Opt Out 0 2019 5 5 0 Inf 100.0%
Opt Out 0 2020 11 9 2 4.5 81.8%
Opt Out 0 2021 8 4 4 1.0 50.0%
Opt Out 0 2022 3 3 0 Inf 100.0%
Opt Out 1 2019 5 4 1 4.0 80.0%
Opt Out 1 2020 4 3 1 3.0 75.0%
Opt Out 1 2022 1 1 0 Inf 100.0%
Renewal by SL Consumption
  1. [NNLOA] Only a small lift above the average. Not consuming is pretty close to the average.
  2. [Opt Out] Inverse relationship. Margin is not large enough to cause alarm.
Renewal Ratio by SL-Led Consumption
DecisionType II_SLLed_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 58 26 32 0.8 44.8%
Need New LOA 1 36 18 18 1.0 50.0%
Opt Out 0 16 13 3 4.3 81.2%
Opt Out 1 21 16 5 3.2 76.2%

SL Consumption Volume & Renewal

  1. 2+ interactions appears to be where we are seeing better renewal rates - this likely ties into correlation with overall utilization!

Renewal by SL Consumption, OT
  1. [NNLOA] Relatively consistent lift, albeit not large, across the years. FY21 is a large difference. FY22 is where we see a reversal.
  2. [Opt Out] More of the drops are with accounts who have had SL Interactions - although the N is a little bit larger - ends up roughly close.
Renewal Ratio by SL-Led Consumption
DecisionType II_SLLed_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 10 4 6 0.7 40.0%
Need New LOA 0 2020 18 6 12 0.5 33.3%
Need New LOA 0 2021 21 10 11 0.9 47.6%
Need New LOA 0 2022 9 6 3 2.0 66.7%
Need New LOA 1 2019 5 2 3 0.7 40.0%
Need New LOA 1 2020 9 4 5 0.8 44.4%
Need New LOA 1 2021 17 10 7 1.4 58.8%
Need New LOA 1 2022 5 2 3 0.7 40.0%
Opt Out 0 2019 4 3 1 3.0 75.0%
Opt Out 0 2020 7 6 1 6.0 85.7%
Opt Out 0 2021 4 3 1 3.0 75.0%
Opt Out 0 2022 1 1 0 Inf 100.0%
Opt Out 1 2019 6 6 0 Inf 100.0%
Opt Out 1 2020 8 6 2 3.0 75.0%
Opt Out 1 2021 4 1 3 0.3 25.0%
Opt Out 1 2022 3 3 0 Inf 100.0%
Renewal by Research Interview Consumption
  1. [NNLOA] Inverse relationship. Not consuming a research interaction is better than consuming one.
  2. [Opt Out] Exact opposite relationship for Opt Outs - the largest positive difference thus far, with nearly no one dropping.
Renewal Ratio by Research Interview Consumption
DecisionType II_ResearchInterview_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 70 34 36 0.9 48.6%
Need New LOA 1 24 10 14 0.7 41.7%
Opt Out 0 22 15 7 2.1 68.2%
Opt Out 1 15 14 1 14.0 93.3%
Research Interview Volume & Renewal
  1. Consistently we are seeing that 1 interaction in a ‘category’ does not look much different from 0.

Renewal By Research Interview Consumption, OT
  1. [NNLOA] FY21 and FY22 units that did not consume driving the inversion.
  2. [NNLOA] FY21 results for units that did consume this interaction is a glimpse of positive news - but the N is too low.
  3. [Opt Out] FY20 responsible for the positive outcome here.
Renewal Ratio by Research Interview Consumption
DecisionType II_ResearchInterview_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 8 4 4 1.0 50.0%
Need New LOA 0 2020 15 6 9 0.7 40.0%
Need New LOA 0 2021 33 16 17 0.9 48.5%
Need New LOA 0 2022 14 8 6 1.3 57.1%
Need New LOA 1 2019 7 2 5 0.4 28.6%
Need New LOA 1 2020 12 4 8 0.5 33.3%
Need New LOA 1 2021 5 4 1 4.0 80.0%
Opt Out 0 2019 6 5 1 5.0 83.3%
Opt Out 0 2020 5 3 2 1.5 60.0%
Opt Out 0 2021 8 4 4 1.0 50.0%
Opt Out 0 2022 3 3 0 Inf 100.0%
Opt Out 1 2019 4 4 0 Inf 100.0%
Opt Out 1 2020 10 9 1 9.0 90.0%
Opt Out 1 2022 1 1 0 Inf 100.0%
Renewal by PLW OR Onsite Consumption
  1. [NNLOA] Decent lift from consuming this interaction - 7%.
  2. [Opt Out] Large positive lift - with barely any drops.
  3. Lower N overall.
Renewal Ratio by PLW OR Onsite Consumption
DecisionType II_PLW_Onsite_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 81 37 44 0.8 45.7%
Need New LOA 1 13 7 6 1.2 53.8%
Opt Out 0 26 19 7 2.7 73.1%
Opt Out 1 11 10 1 10.0 90.9%
PLW / Onsite Volume & Renewal
  1. First instance where only 1 consumption seems to do the trick.

Renewal by PLW/Onsite OT
  1. [NNLOA] Low N in FY19 and FY22. Result driven largely by FY20 and FY21.
  2. [Opt Out] Low N with near perfect results: nothing really changes YoY.
Renewal Ratio by PLW OR Onsite Consumption
DecisionType II_PLW_Onsite_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 13 6 7 0.9 46.2%
Need New LOA 0 2020 22 7 15 0.5 31.8%
Need New LOA 0 2021 33 16 17 0.9 48.5%
Need New LOA 0 2022 13 8 5 1.6 61.5%
Need New LOA 1 2019 2 0 2 0.0 0.0%
Need New LOA 1 2020 5 3 2 1.5 60.0%
Need New LOA 1 2021 5 4 1 4.0 80.0%
Need New LOA 1 2022 1 0 1 0.0 0.0%
Opt Out 0 2019 4 3 1 3.0 75.0%
Opt Out 0 2020 13 11 2 5.5 84.6%
Opt Out 0 2021 6 2 4 0.5 33.3%
Opt Out 0 2022 3 3 0 Inf 100.0%
Opt Out 1 2019 6 6 0 Inf 100.0%
Opt Out 1 2020 2 1 1 1.0 50.0%
Opt Out 1 2021 2 2 0 Inf 100.0%
Opt Out 1 2022 1 1 0 Inf 100.0%
Renewal by Experience Consumption
  1. [NNLOA] Decent lift - 8% above the average. Not consuming is basically the average. Pretty low N.
  2. [Opt Out] Nothing to write home about here.
Renewal Ratio by Experience Consumption
DecisionType II_Experience_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 83 38 45 0.8 45.8%
Need New LOA 1 11 6 5 1.2 54.5%
Opt Out 0 32 25 7 3.6 78.1%
Opt Out 1 5 4 1 4.0 80.0%
Experience Volume & Renewal
  1. Most only consume one of these.

Renewal by Experience Consumption OT

Not enough usage across the years to make sense of any patterns

Renewal Ratio by Experience Consumption
DecisionType II_Experience_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 15 6 9 0.7 40.0%
Need New LOA 0 2020 18 6 12 0.5 33.3%
Need New LOA 0 2021 36 18 18 1.0 50.0%
Need New LOA 0 2022 14 8 6 1.3 57.1%
Need New LOA 1 2020 9 4 5 0.8 44.4%
Need New LOA 1 2021 2 2 0 Inf 100.0%
Opt Out 0 2019 10 9 1 9.0 90.0%
Opt Out 0 2020 10 8 2 4.0 80.0%
Opt Out 0 2021 8 4 4 1.0 50.0%
Opt Out 0 2022 4 4 0 Inf 100.0%
Opt Out 1 2020 5 4 1 4.0 80.0%
Renewal by Expert Call Consumption
  1. [NNLOA] Largest Lift yet - 13% above the average. Those without this consumption renew at VERY LOW rates.
  2. [Opt Out] Inversion here. Small different on drops (2) with similar N. Nothing to be alarmed about.
Renewal Ratio by Expert Call Consumption
DecisionType II_ExpertCall_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 42 13 29 0.4 31.0%
Need New LOA 1 52 31 21 1.5 59.6%
Opt Out 0 18 15 3 5.0 83.3%
Opt Out 1 19 14 5 2.8 73.7%
Expert Call Volume & Renewal
  1. At 2+ is where we see greater success.

Renewal by Expert Call Consumption OT
  1. [NNLOA] Relatively consistent overperformance for consumption - FY22 is the exception to that pattern.
Renewal Ratio by Expert Call Consumption
DecisionType II_ExpertCall_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 6 2 4 0.5 33.3%
Need New LOA 0 2020 16 4 12 0.3 25.0%
Need New LOA 0 2021 16 4 12 0.3 25.0%
Need New LOA 0 2022 4 3 1 3.0 75.0%
Need New LOA 1 2019 9 4 5 0.8 44.4%
Need New LOA 1 2020 11 6 5 1.2 54.5%
Need New LOA 1 2021 22 16 6 2.7 72.7%
Need New LOA 1 2022 10 5 5 1.0 50.0%
Opt Out 0 2019 4 4 0 Inf 100.0%
Opt Out 0 2020 9 7 2 3.5 77.8%
Opt Out 0 2021 3 2 1 2.0 66.7%
Opt Out 0 2022 2 2 0 Inf 100.0%
Opt Out 1 2019 6 5 1 5.0 83.3%
Opt Out 1 2020 6 5 1 5.0 83.3%
Opt Out 1 2021 5 2 3 0.7 40.0%
Opt Out 1 2022 2 2 0 Inf 100.0%

Finer Grain Look at What Was Consumed

Event Category and Event Purpose

  1. Facilities Org Chart Review looks strong.
  2. A few of the meetings have fantastic results: ‘How Higher Education Can Keep Pace with Growing Sustainability Aspirations’; ‘Virtual Working Group for SFOs’
  3. The DEIJ content appears to be pretty solid.
  4. Benchmarking survey.
Renewal Ratio by Event Category and Event Purpose
Event_Category EventPurpose N ATL Dropped Ratio Perc_Renewed
Benchmark Facilities Project Management Survey 2018 9 4 5 0.8 44.4%
Benchmarking Walkthrough Benchmarking Walkthrough 1 0 1 0.0 0.0%
Collaborative 2018-2019 Facilities Leadership Development Fellowship 7 2 5 0.4 28.6%
Collaborative 2019-2020 Facilities Leadership Development Fellowship 10 8 2 4.0 80.0%
COVID Working Group Session FF COVID-19 Research Interactions 15 10 5 2.0 66.7%
COVID Working Group Session FF COVID-19 Working Group - COVID Response for Facilities Leaders 13 11 2 5.5 84.6%
Diagnostic or Audit 2018-2019 FF Topic Poll Participant 17 10 7 1.4 58.8%
Diagnostic or Audit Diagnostic or Audit 1 1 0 Inf 100.0%
Diagnostic or Audit Facilities Dashboard/Metrics Review 1 1 0 Inf 100.0%
Diagnostic or Audit Facilities Maturity Diagnostic 1 1 0 Inf 100.0%
Diagnostic or Audit Facilities Org Chart Review 13 10 3 3.3 76.9%
Diagnostic or Audit Sustainability Plan Review 4 3 1 3.0 75.0%
Evergreen Action Evergreen Action 5 4 1 4.0 80.0%
Expert Center Expert Center 42 27 15 1.8 64.3%
Expert Center Expert Center Call 25 14 11 1.3 56.0%
National Meeting 2018 Facilities Forum, Marina del Rey, CA 2 2 0 Inf 100.0%
National Meeting 2018 Facilities Forum, Washington, DC 8 7 1 7.0 87.5%
National Meeting 2019 Facilities Forum National Meeting, Chicago, IL 6 5 1 5.0 83.3%
National Meeting 2019 Facilities Forum National Meeting, Santa Monica, CA 4 1 3 0.3 25.0%
National Meeting 2019 Facilities Forum National Meeting, Washington, DC 17 6 11 0.5 35.3%
National Meeting 2020 Facilities Forum National Meeting, 10 5 5 1.0 50.0%
National Meeting How Higher Education Can Keep Pace with Growing Sustainability Aspirations: Lessons on Building a Be, 15 13 2 6.5 86.7%
National Meeting Making Remote Work Make Sense for Your Campus, 4 3 1 3.0 75.0%
National Meeting Planning for Remote Work: A Facilitated Conversation for Facilities Leaders, 2 1 1 1.0 50.0%
National Meeting Space Planning and Utilisation on the Post-COVID Campus, 1 1 0 Inf 100.0%
National Meeting Strategies to Optimize Remote Work: Preparing the Campus and the Workforce for a New Era of Flexibil, 10 7 3 2.3 70.0%
National Meeting The State of Facilities 2022: How Estates and Facilities Management Teams Are Evolving to Meet Campu, 1 1 0 Inf 100.0%
National Meeting Virtual Working Group for SFOs: Communicating and Securing Facilities’ Value Amidst Growing Financia, 13 11 2 5.5 84.6%
National Meeting Virtual Working Session FF: COVID Response for Facilities Leaders, 13 11 2 5.5 84.6%
National Meeting Virtual Working Session FF: Engaging Facilities Staff Amidst COVID-19 Response, 2 2 0 Inf 100.0%
National Meeting Workplaces for an Untethered Workforce: How Campuses Can Realize the Promise of Remote Work, 11 8 3 2.7 72.7%
National Meeting Pre-Wire National Meeting Pre-Wire 2 1 1 1.0 50.0%
Onsite Onsite | 12/06/2018 | FF 1 1 0 Inf 100.0%
Onsite Onsite | FF | 08/29/2018 1 1 0 Inf 100.0%
Onsite Onsite | FF | 09/12/2018 1 1 0 Inf 100.0%
Onsite Onsite | FF | 10/23/2019 1 0 1 0.0 0.0%
Onsite Onsite | FF | 11/16/2018 1 0 1 0.0 0.0%
Onsite Onsite | FF | Presentation Date: 08/01/2019 1 1 0 Inf 100.0%
Onsite Onsite | FF | Presentation Date: 08/06/2019 1 0 1 0.0 0.0%
Onsite Onsite | FF| 06/19/2019 1 0 1 0.0 0.0%
Onsite Onsite l FF l Presentation date: 10/22/18 1 1 0 Inf 100.0%
Onsite Onsite: Working with Academic Leaders to Improve Space Management - FF | Virginia Commonwealth University 1 1 0 Inf 100.0%
Onsite NA 4 3 1 3.0 75.0%
Research Initial 2020 FF Sustainability 3 3 0 Inf 100.0%
Research Initial Campus of the Future Redux 16 10 6 1.7 62.5%
Research Initial Facilities Dashboard/Metrics Review 1 1 0 Inf 100.0%
Research Initial Facilities Project Management 2018 7 4 3 1.3 57.1%
Research Initial Facilities Talent Update 2022 1 1 0 Inf 100.0%
Research Initial Facilities Total Cost of Ownership Study 14 8 6 1.3 57.1%
Research Initial Facilities Workforce Study 1 0 1 0.0 0.0%
Research Initial FF 2019 Agenda Setting 4 3 1 3.0 75.0%
Research Initial Research Initial 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Call 2 1 1 1.0 50.0%
Research SL Impact Research SL Impact - Concordia FF Call with Marie-Claude 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Concordia in person visit with Marie-claude 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - COVID Facilities Practices and Capstone Project Discussion 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - E+E Committee COVID-19 Expert Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Expert Call 2 0 2 0.0 0.0%
Research SL Impact Research SL Impact - Facilities Forum National Meeting Debrief 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - FF Introductory Session 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - FF Welcome Session 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Meeting 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - in person SL impact visit 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - In Person Visit-Research SL Impact-Candace Boeninger 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Visit-Research SL Impact-Carlos Hernandez 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - In Person Visit-Research SL Impact-Charles Mann 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Visit-Research SL Impact-Gregory Perkinson 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Visit-Research SL Impact-Laura Barnum 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Visit-Research SL Impact-Robin Van Harpen 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting 5 4 1 4.0 80.0%
Research SL Impact Research SL Impact - Meeting - CMU - FF - Ralph Horgan & Don Coffelt 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting - CMU - FF - Steve Guenther 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting | UC Berkeley - FF - on-campus visit 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - National Meeting - Jamie Gayer - Dummy record 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - PLW Call - Wayne State FF with Rob Davenport 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Research Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Second Exec Roundtable Topic 10 6 4 1.5 60.0%
Research SL Impact Research SL Impact - SL Impact Interaction 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Welcome Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact Visit 19 11 9 1.2 57.9%
Scoping Campus 2025 Update 1 1 0 Inf 100.0%
Tool’s Walkthrough Tool’s Walk Through 6 4 2 2.0 66.7%
Tool’s Walkthrough Tool’s Walk Through Call 1 1 0 Inf 100.0%
Webinar Hold Exp. 10/24 | PLW | FF - Increasing the Impact of Limited Deferred and Preventative Maintenance Dollars | Presentation Date: 11/4/2019 1 0 1 0.0 0.0%
Webinar PLW | FF | Presentation date: 5/16/18 1 1 0 Inf 100.0%
Webinar PLW | FF |11/07/2018 1 0 1 0.0 0.0%
Webinar PLW l FF l The New Facilities Dashboard | Presentation date: 10/31/18 1 1 0 Inf 100.0%
Webinar State of the Industry Talent and Management 1 1 0 Inf 100.0%
Webinar Virtual Meeting | FF | Working with Administration to Improve Space Utilization 1 1 0 Inf 100.0%
Webinar Virtual Meeting | FF | An Overview of EAB Facilities Research | 1/27/21 1 0 1 0.0 0.0%
Webinar Virtual Meeting | FF | Building a Total Cost of Ownership Mindset | Presentation Date: 10/19/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | FF | Building a Total Cost of Ownership Mindset | Presentation Date: 10/23/20 1 1 0 Inf 100.0%
Webinar VIRTUAL MEETING | FF | State of the Sector | 12/10 1 1 0 Inf 100.0%
Webinar Virtual Meeting | FF | Untethering the Administrative Workforce | Presentation Date: 12/8/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | FF | Workplaces for an Untethered Workforce: How Campuses Can Realize the Promise of Remote Work | 2/2/21 1 1 0 Inf 100.0%
Webinar NA 1 1 0 Inf 100.0%
NA NA 12 1 11 0.1 8.3%
Correlation betwen Event Groupings, and Renewal
  1. Events and Experience are most correlated with renewal.
  2. Research interviews have high correlation with Expert Calls and Service - this suggest research interviews might not alone be impactful but could drive further utilization in other categories!

Multivariate Regression (still kind of simple)

Note: Looking at all decision types.

  1. Events pop as significant.
  2. Looking at NNLOAs alone doesn’t change the results.
  Target_Binary
Predictors Odds Ratios CI p
(Intercept) 0.41 0.20 – 0.80 0.012
II Events Volume 1.81 1.25 – 2.82 0.004
II SLLed Volume 0.98 0.58 – 1.64 0.948
II ResearchInterview
Volume 		0.75 0.36 – 1.49 0.423
II PLW Onsite Volume 1.00 0.29 – 3.29 0.996
II ExpertCall Volume 1.16 0.79 – 1.74 0.450
II Service Volume 1.20 0.68 – 2.17 0.524
Observations 94
R2 Tjur 0.154

Combinations of Impact Interactions

Combinations of Impact Interactions

Renewal Ratio by Impact Interaction Combos
II_Combo_Text N ATL Dropped Ratio Perc_Renewed
NA 12 1 11 0.1 8.3%
Events 5 1 4 0.2 20.0%
Expert Call 4 2 2 1.0 50.0%
SL-Led Impact 3 1 2 0.5 33.3%
Events; Expert Call 2 1 1 1.0 50.0%
Expert Call; Events 2 1 1 1.0 50.0%
Expert Call; Events; Expert Call; Expert Call 2 0 2 0.0 0.0%
Expert Call; Expert Call 2 1 1 1.0 50.0%
PLW/Onsite; Research Interview 2 0 2 0.0 0.0%
Research Interview 2 1 1 1.0 50.0%
Service/Tool; Expert Call 2 0 2 0.0 0.0%
SL-Led Impact; Events 2 1 1 1.0 50.0%
Events; Events 1 1 0 Inf 100.0%
Events; Events; Events; Expert Call; SL-Led Impact; Expert Call 1 0 1 0.0 0.0%
Events; Events; Experience; Events; SL-Led Impact; Events; Research Interview 1 1 0 Inf 100.0%
Events; Events; Expert Call; Events; Events; Events; PLW/Onsite; SL-Led Impact; Events; Events; Expert Call; Service/Tool 1 1 0 Inf 100.0%
Events; Events; Expert Call; Events; Events; Expert Call 1 1 0 Inf 100.0%
Events; Events; Expert Call; Events; Expert Call 1 1 0 Inf 100.0%
Events; Events; Expert Call; Events; PLW/Onsite; Expert Call; Service/Tool; Expert Call; Expert Call; Expert Call; Expert Call 1 1 0 Inf 100.0%
Events; Events; Expert Call; Expert Call; Service/Tool; Events 1 1 0 Inf 100.0%
Events; Events; PLW/Onsite; Events; PLW/Onsite; Events; PLW/Onsite 1 1 0 Inf 100.0%
Events; Events; Service/Tool 1 1 0 Inf 100.0%
Events; Events; Service/Tool; Expert Call 1 1 0 Inf 100.0%
Events; Experience; Experience 1 0 1 0.0 0.0%
Events; Expert Call; Experience; Research Interview 1 1 0 Inf 100.0%
Events; Expert Call; Expert Call; Expert Call; Expert Call; Events; Expert Call; Events; Expert Call; Expert Call; Events; Events 1 1 0 Inf 100.0%
Events; Expert Call; SL-Led Impact 1 0 1 0.0 0.0%
Events; Expert Call; SL-Led Impact; Events 1 0 1 0.0 0.0%
Events; PLW/Onsite; Research Interview; Service/Tool; Service/Tool; Research Interview; SL-Led Impact; PLW/Onsite; SL-Led Impact 1 0 1 0.0 0.0%
Events; Research Interview 1 1 0 Inf 100.0%
Events; Research Interview; Research Interview; Events; Expert Call; SL-Led Impact; Events; PLW/Onsite; Research Interview; Events; Events; Experience 1 1 0 Inf 100.0%
Events; Research Interview; SL-Led Impact 1 0 1 0.0 0.0%
Events; Research Interview; SL-Led Impact; SL-Led Impact; SL-Led Impact; SL-Led Impact; PLW/Onsite 1 1 0 Inf 100.0%
Events; Service/Tool; Events; Service/Tool; Expert Call; Service/Tool 1 1 0 Inf 100.0%
Events; Service/Tool; Research Interview; Service/Tool; SL-Led Impact; Service/Tool 1 0 1 0.0 0.0%
Events; SL-Led Impact; Events; Expert Call; Events; SL-Led Impact; Expert Call; Events 1 1 0 Inf 100.0%
Events; SL-Led Impact; Expert Call 1 0 1 0.0 0.0%
Events; SL-Led Impact; Research Interview 1 0 1 0.0 0.0%
Events; SL-Led Impact; SL-Led Impact 1 1 0 Inf 100.0%
Events; SL-Led Impact; SL-Led Impact; Expert Call; Service/Tool; Service/Tool 1 1 0 Inf 100.0%
Experience 1 1 0 Inf 100.0%
Experience; Expert Call 1 0 1 0.0 0.0%
Experience; Expert Call; Events; Events; Expert Call; Expert Call; Research Interview 1 1 0 Inf 100.0%
Experience; Expert Call; Research Interview; SL-Led Impact; Research Interview; Expert Call; SL-Led Impact 1 1 0 Inf 100.0%
Experience; PLW/Onsite; Research Interview 1 1 0 Inf 100.0%
Experience; Research Interview; SL-Led Impact; Expert Call; Events 1 1 0 Inf 100.0%
Expert Call; Events; Events 1 1 0 Inf 100.0%
Expert Call; Events; Events; Expert Call; SL-Led Impact; Events 1 1 0 Inf 100.0%
Expert Call; Events; Events; Service/Tool; SL-Led Impact 1 0 1 0.0 0.0%
Expert Call; Events; PLW/Onsite; Expert Call 1 1 0 Inf 100.0%
Expert Call; Events; Research Interview; Expert Call; Experience; Events 1 0 1 0.0 0.0%
Expert Call; Expert Call; Events; Events; Events; Events; Service/Tool; Service/Tool; Events; Events 1 1 0 Inf 100.0%
Expert Call; Expert Call; Expert Call; Expert Call 1 1 0 Inf 100.0%
Expert Call; Expert Call; Expert Call; Expert Call; Service/Tool; Service/Tool; SL-Led Impact 1 1 0 Inf 100.0%
Expert Call; Expert Call; Expert Call; SL-Led Impact; Events; Research Interview; Events; PLW/Onsite 1 1 0 Inf 100.0%
Expert Call; Expert Call; Expert Call; SL-Led Impact; SL-Led Impact 1 1 0 Inf 100.0%
Expert Call; Expert Call; SL-Led Impact; Expert Call 1 1 0 Inf 100.0%
Expert Call; PLW/Onsite; Events; Events 1 1 0 Inf 100.0%
Expert Call; SL-Led Impact; Events; Expert Call; PLW/Onsite; Expert Call; Expert Call; Expert Call 1 1 0 Inf 100.0%
PLW/Onsite; Events; SL-Led Impact; SL-Led Impact; Service/Tool; Expert Call; Service/Tool 1 1 0 Inf 100.0%
PLW/Onsite; Experience; Events; SL-Led Impact 1 0 1 0.0 0.0%
PLW/Onsite; Expert Call; Events; Events 1 1 0 Inf 100.0%
PLW/Onsite; Expert Call; Expert Call; Expert Call; Events; Events; Service/Tool; Events; SL-Led Impact 1 0 1 0.0 0.0%
PLW/Onsite; Research Interview; Expert Call; Experience; Research Interview 1 1 0 Inf 100.0%
PLW/Onsite; SL-Led Impact; Events; Research Interview; Research Interview; SL-Led Impact 1 1 0 Inf 100.0%
Research Interview; Events 1 1 0 Inf 100.0%
Research Interview; Events; SL-Led Impact; Research Interview; SL-Led Impact; SL-Led Impact 1 1 0 Inf 100.0%
Research Interview; Experience; Research Interview 1 1 0 Inf 100.0%
Research Interview; Experience; SL-Led Impact; Expert Call; Expert Call; Expert Call; Expert Call; Events; Research Interview 1 0 1 0.0 0.0%
Research Interview; Research Interview; Expert Call; Research Interview; Expert Call; Research Interview; Service/Tool; Events; PLW/Onsite 1 0 1 0.0 0.0%
Research Interview; Service/Tool; Service/Tool 1 1 0 Inf 100.0%
Research Interview; SL-Led Impact; Events; Events; Expert Call; Events; Events; SL-Led Impact; Events 1 1 0 Inf 100.0%
Service/Tool 1 1 0 Inf 100.0%
Service/Tool; Events; Service/Tool 1 1 0 Inf 100.0%
Service/Tool; Expert Call; Events 1 0 1 0.0 0.0%
Service/Tool; Expert Call; Events; Events 1 1 0 Inf 100.0%
Service/Tool; Expert Call; Research Interview 1 0 1 0.0 0.0%
Service/Tool; Expert Call; Research Interview; Service/Tool; Service/Tool; Research Interview; Service/Tool; Research Interview; SL-Led Impact; Expert Call; Expert Call; Expert Call; Expert Call; Events 1 1 0 Inf 100.0%
Service/Tool; Expert Call; SL-Led Impact; Events; SL-Led Impact; SL-Led Impact; SL-Led Impact; SL-Led Impact 1 1 0 Inf 100.0%
Service/Tool; PLW/Onsite; Events; Expert Call; Events; Events; Events; Expert Call; Events; SL-Led Impact; Events; Events; SL-Led Impact 1 1 0 Inf 100.0%
Service/Tool; Research Interview 1 0 1 0.0 0.0%
Service/Tool; Research Interview; Service/Tool; Research Interview; Events; Expert Call 1 1 0 Inf 100.0%
Service/Tool; Service/Tool 1 0 1 0.0 0.0%
Service/Tool; Service/Tool; Expert Call; Events; Service/Tool; Research Interview; Expert Call 1 1 0 Inf 100.0%
Service/Tool; Service/Tool; Expert Call; Service/Tool; SL-Led Impact; Service/Tool; Service/Tool; Research Interview; Service/Tool; SL-Led Impact; Expert Call; Research Interview; Events; Service/Tool; Service/Tool; Service/Tool 1 1 0 Inf 100.0%
Service/Tool; Service/Tool; Service/Tool; Events; PLW/Onsite 1 1 0 Inf 100.0%
Service/Tool; SL-Led Impact; Events 1 0 1 0.0 0.0%
Service/Tool; SL-Led Impact; Research Interview 1 1 0 Inf 100.0%
Service/Tool; SL-Led Impact; SL-Led Impact; SL-Led Impact 1 1 0 Inf 100.0%
SL-Led Impact; Events; Events 1 1 0 Inf 100.0%
SL-Led Impact; Events; Events; Expert Call; Events 1 0 1 0.0 0.0%
SL-Led Impact; Events; Expert Call; Events 1 0 1 0.0 0.0%
SL-Led Impact; Events; PLW/Onsite; PLW/Onsite; Expert Call 1 1 0 Inf 100.0%
SL-Led Impact; Events; Research Interview; Service/Tool; SL-Led Impact; SL-Led Impact; Expert Call; SL-Led Impact; Service/Tool; SL-Led Impact 1 0 1 0.0 0.0%
SL-Led Impact; Events; SL-Led Impact 1 1 0 Inf 100.0%
SL-Led Impact; Experience; Service/Tool; Service/Tool; SL-Led Impact; Events; Research Interview; Service/Tool; Events 1 0 1 0.0 0.0%
SL-Led Impact; Expert Call; Expert Call; Expert Call; SL-Led Impact; SL-Led Impact; Expert Call; Expert Call; Expert Call 1 0 1 0.0 0.0%
SL-Led Impact; Expert Call; PLW/Onsite; SL-Led Impact 1 0 1 0.0 0.0%
SL-Led Impact; Expert Call; Research Interview; Expert Call; SL-Led Impact; Expert Call 1 1 0 Inf 100.0%
SL-Led Impact; Research Interview; SL-Led Impact 1 0 1 0.0 0.0%
SL-Led Impact; Service/Tool 1 1 0 Inf 100.0%
SL-Led Impact; SL-Led Impact; Expert Call 1 1 0 Inf 100.0%
SL-Led Impact; SL-Led Impact; SL-Led Impact; SL-Led Impact; SL-Led Impact; SL-Led Impact; SL-Led Impact 1 1 0 Inf 100.0%

Looking At Combinations of Different Groupings

Renewal Ratio by Impact Interaction Combos Slim
II_Combo_Text_Slim N ATL Dropped Ratio Perc_Renewed
NA 12 1 11 0.1 8.3%
Expert Call 7 4 3 1.3 57.1%
Events 6 2 4 0.5 33.3%
Events; Expert Call 6 5 1 5.0 83.3%
Expert Call; Events 4 1 3 0.3 25.0%
Expert Call; Events; SL-Led Impact 4 2 2 1.0 50.0%
SL-Led Impact 4 2 2 1.0 50.0%
SL-Led Impact; Events 3 3 0 Inf 100.0%
Events; Expert Call; Service/Tool 2 1 1 1.0 50.0%
Events; Research Interview 2 2 0 Inf 100.0%
Events; Service/Tool 2 2 0 Inf 100.0%
Events; Service/Tool; Expert Call 2 2 0 Inf 100.0%
Events; SL-Led Impact 2 1 1 1.0 50.0%
Events; SL-Led Impact; Expert Call 2 0 2 0.0 0.0%
Events; SL-Led Impact; Research Interview 2 1 1 1.0 50.0%
Expert Call; SL-Led Impact 2 2 0 Inf 100.0%
PLW/Onsite; Events; Expert Call 2 2 0 Inf 100.0%
Research Interview 2 1 1 1.0 50.0%
Service/Tool 2 1 1 1.0 50.0%
Service/Tool; Events; SL-Led Impact; Expert Call 2 2 0 Inf 100.0%
Service/Tool; Expert Call 2 0 2 0.0 0.0%
Service/Tool; Research Interview 2 1 1 1.0 50.0%
Service/Tool; SL-Led Impact 2 2 0 Inf 100.0%
SL-Led Impact; Expert Call 2 1 1 1.0 50.0%
Events; Experience 1 0 1 0.0 0.0%
Events; Expert Call; PLW/Onsite; SL-Led Impact; Service/Tool 1 1 0 Inf 100.0%
Events; Expert Call; SL-Led Impact; Research Interview; Experience 1 0 1 0.0 0.0%
Events; PLW/Onsite; SL-Led Impact; Experience 1 0 1 0.0 0.0%
Events; PLW/Onsite; SL-Led Impact; Expert Call; Research Interview 1 1 0 Inf 100.0%
Events; PLW/Onsite; SL-Led Impact; Expert Call; Service/Tool 1 1 0 Inf 100.0%
Events; PLW/Onsite; SL-Led Impact; Research Interview; Service/Tool 1 0 1 0.0 0.0%
Events; Research Interview; Expert Call; Service/Tool 1 1 0 Inf 100.0%
Events; Research Interview; Expert Call; Service/Tool; SL-Led Impact 1 1 0 Inf 100.0%
Events; Research Interview; PLW/Onsite; SL-Led Impact 1 1 0 Inf 100.0%
Events; Research Interview; SL-Led Impact; Service/Tool 1 0 1 0.0 0.0%
Events; SL-Led Impact; Research Interview; PLW/Onsite 1 1 0 Inf 100.0%
Experience 1 1 0 Inf 100.0%
Experience; Events; Research Interview; Expert Call 1 1 0 Inf 100.0%
Experience; Expert Call 1 0 1 0.0 0.0%
Experience; PLW/Onsite; Research Interview; Expert Call 1 1 0 Inf 100.0%
Expert Call; Events; Research Interview; Experience 1 1 0 Inf 100.0%
Expert Call; Events; Service/Tool 1 1 0 Inf 100.0%
Expert Call; PLW/Onsite; Events 1 1 0 Inf 100.0%
Expert Call; Research Interview; Events; Experience 1 0 1 0.0 0.0%
Expert Call; Research Interview; Events; Service/Tool 1 1 0 Inf 100.0%
Expert Call; Research Interview; Events; SL-Led Impact; Service/Tool 1 1 0 Inf 100.0%
Expert Call; Service/Tool; PLW/Onsite; Events 1 1 0 Inf 100.0%
PLW/Onsite; Events 1 1 0 Inf 100.0%
PLW/Onsite; Research Interview 1 0 1 0.0 0.0%
PLW/Onsite; SL-Led Impact; Events; Expert Call 1 1 0 Inf 100.0%
PLW/Onsite; SL-Led Impact; Expert Call 1 0 1 0.0 0.0%
Research Interview; Events; Expert Call; SL-Led Impact 1 1 0 Inf 100.0%
Research Interview; Experience 1 1 0 Inf 100.0%
Research Interview; Experience; Events; SL-Led Impact 1 1 0 Inf 100.0%
Research Interview; PLW/Onsite 1 0 1 0.0 0.0%
Research Interview; PLW/Onsite; Events; SL-Led Impact; Expert Call; Experience 1 1 0 Inf 100.0%
Research Interview; PLW/Onsite; Experience 1 1 0 Inf 100.0%
Research Interview; Service/Tool; Events; Expert Call; PLW/Onsite 1 0 1 0.0 0.0%
Research Interview; Service/Tool; SL-Led Impact; Events; Experience 1 0 1 0.0 0.0%
Research Interview; SL-Led Impact; Expert Call; Service/Tool; Events 1 0 1 0.0 0.0%
Service/Tool; Events; Expert Call 1 1 0 Inf 100.0%
Service/Tool; Events; Expert Call; SL-Led Impact; PLW/Onsite 1 0 1 0.0 0.0%
Service/Tool; Events; PLW/Onsite 1 1 0 Inf 100.0%
Service/Tool; Events; SL-Led Impact 1 0 1 0.0 0.0%
Service/Tool; Research Interview; Expert Call 1 0 1 0.0 0.0%
Service/Tool; SL-Led Impact; Expert Call 1 1 0 Inf 100.0%
Service/Tool; SL-Led Impact; Expert Call; Events 1 0 1 0.0 0.0%
SL-Led Impact; Events; Expert Call 1 0 1 0.0 0.0%
SL-Led Impact; Events; Service/Tool; Expert Call; PLW/Onsite 1 1 0 Inf 100.0%
SL-Led Impact; Expert Call; Events 1 0 1 0.0 0.0%
SL-Led Impact; Expert Call; Events; Experience; Research Interview 1 1 0 Inf 100.0%
SL-Led Impact; Expert Call; PLW/Onsite; Events 1 1 0 Inf 100.0%
SL-Led Impact; Expert Call; Research Interview; Experience 1 1 0 Inf 100.0%
SL-Led Impact; Research Interview 1 0 1 0.0 0.0%
SL-Led Impact; Research Interview; Events 1 0 1 0.0 0.0%
SL-Led Impact; Research Interview; Expert Call 1 1 0 Inf 100.0%
SL-Led Impact; Research Interview; Service/Tool 1 1 0 Inf 100.0%