AAF Analysis

The purpose of this analysis is to understand the variable effect of impact interactions on the likelihood of a partner to renew their partnership. Simply, which service levers matter more for partnership renewal.

Executive Summary

Methodological Considerations

  1. The data set consists of decisions from FY19 through March of FY22.

  2. Similar to previous analyses, we are primarily looking at the year leading up to a decision.

  3. We are not looking at ‘integrated’ partnerships. That is, we are focusing on utilization at the account where the renewal decision is made.

  4. Lastly, we are looking at unit renewal rates instead of $ renewal rates. This allows us to treat impact interactions equitably across partnerships.

Renewal by Decision Type

The below table should not come as a surprise. Opt Outs tend to perform very well while NNLOA can be quite mixed.

  1. Remember the Ratios: 1.0 for NNLOA, 6.1 for Opt Outs.
  2. Opt Outs perform exceedingly well, while NNLOA are hovering just above 50%.
Renewal Ratio by Decision Type
DecisionType N ATL Dropped Ratio Perc_Renewed
Need New LOA 182 93 89 1.0 51.1%
Opt Out 57 49 8 6.1 86.0%
Total 239 142 97 1.5 59.4%

Renewals by Decision Type and Year

Since we are combining multiple years of data, we will frequently take a look at whether there are differences across the years.

  1. NNLOA - Solid increase in renewal rate FY20
  2. Opt Outs - Same as NNLOA - FY22 has been PERFECT.
Renewal Ratio by Decision Type
DecisionType FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 2019 20 9 11 0.8 45.0%
Need New LOA 2020 64 26 38 0.7 40.6%
Need New LOA 2021 72 42 30 1.4 58.3%
Need New LOA 2022 26 16 10 1.6 61.5%
Opt Out 2019 10 9 1 9.0 90.0%
Opt Out 2020 18 14 4 3.5 77.8%
Opt Out 2021 18 15 3 5.0 83.3%
Opt Out 2022 11 11 0 Inf 100.0%
Total NA 239 142 97 1.5 59.4%
Renewal Rate by Account Segment
  1. 36% in the large P&P with decent smattering across the other Segments
  2. Canada looks strong
  3. Large P&P and Selective relatively similar on performance and performance is decent.
  4. Regionals are the lower performers, with Regional Private underperforming considerably.
Renewal Ratio by Account Segment
AccountSegment N ATL Dropped Ratio Perc_Renewed
4 Year Other 1 1 0 Inf 100.0%
Canada 29 22 7 3.1 75.9%
Large Public & Private 98 64 34 1.9 65.3%
Regional Private 26 9 17 0.5 34.6%
Regional Public 41 18 23 0.8 43.9%
Selective 44 28 16 1.8 63.6%
Renewal Rate by Account Segment & Fiscal Year
  1. Large P&P had a nadir in FY20 with a strong bounce back and an even stronger FY22.
  2. selectives have been increasing since FY19 to an incredible FY22.
  3. Canada is relatively steady in the 70’s over the past couple of years. Odd FY20 result, when everything else drops, Canada was strong. O Canada!
  4. Regional Privates decisions have dwindled down to close to 0. The renewal rate dropped considerably over the time period.
Renewal Ratio by Account Segment
AccountSegment FiscalYear N ATL Dropped Ratio Perc_Renewed
4 Year Other 2022 1 1 0 Inf 100.0%
Canada 2019 3 2 1 2.0 66.7%
Canada 2020 9 8 1 8.0 88.9%
Canada 2021 10 7 3 2.3 70.0%
Canada 2022 7 5 2 2.5 71.4%
Large Public & Private 2019 11 8 3 2.7 72.7%
Large Public & Private 2020 32 14 18 0.8 43.8%
Large Public & Private 2021 40 29 11 2.6 72.5%
Large Public & Private 2022 15 13 2 6.5 86.7%
Regional Private 2019 5 4 1 4.0 80.0%
Regional Private 2020 12 3 9 0.3 25.0%
Regional Private 2021 8 2 6 0.3 25.0%
Regional Private 2022 1 0 1 0.0 0.0%
Regional Public 2019 6 2 4 0.5 33.3%
Regional Public 2020 16 8 8 1.0 50.0%
Regional Public 2021 15 8 7 1.1 53.3%
Regional Public 2022 4 0 4 0.0 0.0%
Selective 2019 5 2 3 0.7 40.0%
Selective 2020 13 7 6 1.2 53.8%
Selective 2021 17 11 6 1.8 64.7%
Selective 2022 9 8 1 8.0 88.9%
Renewal by Decision Type & Segment
  1. Across all of the segments, NNLOA and Opt Outs perform remarkably different.
  2. Opt Outs typically represent a small % of the total number of decisions.
Renewal Ratio by Account Segment
AccountSegment DecisionType N ATL Dropped Ratio Perc_Renewed
4 Year Other Opt Out 1 1 0 Inf 100.0%
Canada Need New LOA 25 18 7 2.6 72.0%
Canada Opt Out 4 4 0 Inf 100.0%
Large Public & Private Need New LOA 71 41 30 1.4 57.7%
Large Public & Private Opt Out 27 23 4 5.8 85.2%
Regional Private Need New LOA 23 7 16 0.4 30.4%
Regional Private Opt Out 3 2 1 2.0 66.7%
Regional Public Need New LOA 31 10 21 0.5 32.3%
Regional Public Opt Out 10 8 2 4.0 80.0%
Selective Need New LOA 32 17 15 1.1 53.1%
Selective Opt Out 12 11 1 11.0 91.7%
CRP Inclusion

No CRPs! Took them out.

Renewal Ratio by CRP Inclusion
GRP3-4 N ATL Dropped Ratio Perc_Renewed
0 239 142 97 1.5 59.4%
Impact Interaction Volume Histogram
  1. Central tendency increased to about 4, similar to last year. A lot of the mass looks like it is between 2 and 5.
  2. There is long tail with heavy utilizers.
  3. There is also a decent number of lower utilizers.

Impact Interaction Volume Histogram Split by Decision
  1. Super users definitively renew at a pretty high rate.
  2. Lower utilization still has some partners who renew, but definitely want to avoid 0 or 1.
  3. Appears to be around 5+ where the value really kicks in.

Impact Interaction Volume Histogram Split by Pool Date FY
  1. Many of the high bars are comprised of multiple FY decisions, which can provide some measure of comfort in making conclusions which are more general.
  2. A few more decisions from 2021 and 2022 reside in the long tail, as compared to 2019 and 2020.

Renewal by Interaction Volume and Decision Type, Unbinned
  1. Both NNLOA and Opt Outs show a tendency toward 3-5 impact interactions. More of the mass resides in these parts of the distribution.
  2. For NNLOA, 4+ continues to look good.
Renewal Ratio by Impact Interaction Volume
DecisionType II_Credited_Volume N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 16 2 14 0.1 12.5%
Need New LOA 1 18 3 15 0.2 16.7%
Need New LOA 2 23 11 12 0.9 47.8%
Need New LOA 3 31 15 16 0.9 48.4%
Need New LOA 4 29 19 10 1.9 65.5%
Need New LOA 5 23 16 7 2.3 69.6%
Need New LOA 6 16 9 7 1.3 56.2%
Need New LOA 7 9 5 4 1.2 55.6%
Need New LOA 8 4 2 2 1.0 50.0%
Need New LOA 9 6 5 1 5.0 83.3%
Need New LOA 10 3 2 1 2.0 66.7%
Need New LOA 12 2 2 0 Inf 100.0%
Need New LOA 13 1 1 0 Inf 100.0%
Need New LOA 17 1 1 0 Inf 100.0%
Opt Out 0 5 4 1 4.0 80.0%
Opt Out 1 4 4 0 Inf 100.0%
Opt Out 2 7 5 2 2.5 71.4%
Opt Out 3 12 10 2 5.0 83.3%
Opt Out 4 4 3 1 3.0 75.0%
Opt Out 5 9 8 1 8.0 88.9%
Opt Out 6 6 5 1 5.0 83.3%
Opt Out 7 3 3 0 Inf 100.0%
Opt Out 8 1 1 0 Inf 100.0%
Opt Out 9 1 1 0 Inf 100.0%
Opt Out 10 3 3 0 Inf 100.0%
Opt Out 13 1 1 0 Inf 100.0%
Opt Out 18 1 1 0 Inf 100.0%
Renewal by Impact Interaction Volume and Decision Type, (Binned)

Adjusted the binning to better capture the high volume present in AAF.

  1. For both NNLOA, increased impact interaction volume does tend to be associated with increased likelihood to renew.
  2. For NNLOA, 4+ is again confirmed. Inversely, under 2 could be a risk factor.
  3. For Opt Out, unit rate wobbles but is so high there is not much to glean.
Renewal Ratio by Impact Interaction Volume (Binned)
DecisionType II_Volume_Bins N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 16 2 14 0.1 12.5%
Need New LOA 1 18 3 15 0.2 16.7%
Need New LOA 2-3 54 26 28 0.9 48.1%
Need New LOA 4-6 68 44 24 1.8 64.7%
Need New LOA 7+ 26 18 8 2.2 69.2%
Opt Out 0 5 4 1 4.0 80.0%
Opt Out 1 4 4 0 Inf 100.0%
Opt Out 2-3 19 15 4 3.8 78.9%
Opt Out 4-6 19 16 3 5.3 84.2%
Opt Out 7+ 10 10 0 Inf 100.0%

Renewal by Impact Interaction Volume and Account Segment, (Binned)

  1. 4+ cutoff driven a lot by Large P&P and Selectives.
  2. For Regional Publics, the bar might be lower, at 2+. 4+ even better.
Renewal Ratio by Impact Interaction Volume (Binned)
AccountSegment II_Volume_Bins N ATL Dropped Ratio Perc_Renewed
4 Year Other 4-6 1 1 0 Inf 100.0%
Canada 0 1 0 1 0.0 0.0%
Canada 1 3 2 1 2.0 66.7%
Canada 2-3 6 5 1 5.0 83.3%
Canada 4-6 15 12 3 4.0 80.0%
Canada 7+ 4 3 1 3.0 75.0%
Large Public & Private 0 7 3 4 0.8 42.9%
Large Public & Private 1 11 2 9 0.2 18.2%
Large Public & Private 2-3 24 14 10 1.4 58.3%
Large Public & Private 4-6 35 27 8 3.4 77.1%
Large Public & Private 7+ 21 18 3 6.0 85.7%
Regional Private 0 2 0 2 0.0 0.0%
Regional Private 2-3 13 5 8 0.6 38.5%
Regional Private 4-6 10 4 6 0.7 40.0%
Regional Private 7+ 1 0 1 0.0 0.0%
Regional Public 0 8 2 6 0.3 25.0%
Regional Public 1 5 1 4 0.2 20.0%
Regional Public 2-3 13 9 4 2.2 69.2%
Regional Public 4-6 11 4 7 0.6 36.4%
Regional Public 7+ 4 2 2 1.0 50.0%
Selective 0 3 1 2 0.5 33.3%
Selective 1 3 2 1 2.0 66.7%
Selective 2-3 17 8 9 0.9 47.1%
Selective 4-6 15 12 3 4.0 80.0%
Selective 7+ 6 5 1 5.0 83.3%

Large P&P Renewal by Impact Interaction Volume (Binned) & Decision Type

  1. Seems to confirm that utilization does drive renewal for this segment…specifically for NNLOA.
RLarge P&P Renewal Ratio by Decision Type & Impact Interaction Volume (Binned)
DecisionType II_Volume_Bins N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 5 1 4 0.2 20.0%
Need New LOA 1 10 1 9 0.1 10.0%
Need New LOA 2-3 17 9 8 1.1 52.9%
Need New LOA 4-6 26 20 6 3.3 76.9%
Need New LOA 7+ 13 10 3 3.3 76.9%
Opt Out 0 2 2 0 Inf 100.0%
Opt Out 1 1 1 0 Inf 100.0%
Opt Out 2-3 7 5 2 2.5 71.4%
Opt Out 4-6 9 7 2 3.5 77.8%
Opt Out 7+ 8 8 0 Inf 100.0%

#####Simple Regression for Impact Interaction Volume

  1. The Estimate for Impact Interaction Volume is Positive -> increased consumption means increased likelihood to renew.
  2. This is statistically significant.
  Target_Binary
Predictors Odds Ratios CI p
(Intercept) 0.55 0.33 – 0.90 0.019
II Credited Volume 1.29 1.16 – 1.46 <0.001
Observations 239
R2 Tjur 0.091
Penetration by Event Grouping
  1. Expert Calls, Events, and SL Led are the highest penetration.
  2. Not many large differences between NNLOA and Opt Outs - SL Led may be the highest.

Reminder: 1. Experience = VIP Days & Collaboratives 2. Service = Benchmarking, Audits, Secret Shopper, Customer Research Projects, Market Insights, and Survey Walkthroughs 3. Expert Call = Expert Center, Benchmarking Walkthrough, Tool’s Walkthrough 4. SL Led = Research SL Impact, Evergreen Action, Exec Update, National Meeting Pre-wire 5. Research Interview = Research Initial & Scoping 6. Events = National Meeting, COVID Working Group 7. PLW/Onsite = Onsite, PLW

Percent of Renewals w/ At Least 1 Interaction in a Group
DecisionType Perc_Events Perc_Service Perc_SLLed Perc_ResearchInt Perc_PLW_Onsite Perc_Experience Perc_ExpertCall
Need New LOA 57.1% 15.4% 51.6% 18.7% 20.3% 10.4% 61.5%
Opt Out 50.9% 15.8% 56.1% 24.6% 33.3% 12.3% 63.2%
Renewal by Event Consumption
  1. [NNLOA] Compelling evidence for the value of events.
  2. [Opt Out] Even here, with super high renewal, there seems to be some benefit.
Renewal Ratio by Event Consumption
DecisionType II_Events_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 78 29 49 0.6 37.2%
Need New LOA 1 104 64 40 1.6 61.5%
Opt Out 0 28 22 6 3.7 78.6%
Opt Out 1 29 27 2 13.5 93.1%
Renewal by Event Consumption Volume
  1. 1 seems to do create some lift, with more than 1 driving more value.

Renewal by Event, OT

  1. NNLOA: Consistently higher than not consuming, across the years.
  2. NNLOA: FY22 Performance has been very high.
Renewal Ratio by Event Consumption
DecisionType II_Events_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 12 4 8 0.5 33.3%
Need New LOA 0 2020 39 14 25 0.6 35.9%
Need New LOA 0 2021 17 7 10 0.7 41.2%
Need New LOA 0 2022 10 4 6 0.7 40.0%
Need New LOA 1 2019 8 5 3 1.7 62.5%
Need New LOA 1 2020 25 12 13 0.9 48.0%
Need New LOA 1 2021 55 35 20 1.8 63.6%
Need New LOA 1 2022 16 12 4 3.0 75.0%
Opt Out 0 2019 3 3 0 Inf 100.0%
Opt Out 0 2020 10 7 3 2.3 70.0%
Opt Out 0 2021 9 6 3 2.0 66.7%
Opt Out 0 2022 6 6 0 Inf 100.0%
Opt Out 1 2019 7 6 1 6.0 85.7%
Opt Out 1 2020 8 7 1 7.0 87.5%
Opt Out 1 2021 9 9 0 Inf 100.0%
Opt Out 1 2022 5 5 0 Inf 100.0%
Renewal by Service Consumption
  1. [NNLOA] Pretty large difference for renewal in this category, although penetration is certainly lower.
  2. [Opt Out] Inversion here! Number of drops is so low, we can put aside any serious concern.
Renewal Ratio by Service Consumption
DecisionType II_Service_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 154 72 82 0.9 46.8%
Need New LOA 1 28 21 7 3.0 75.0%
Opt Out 0 48 43 5 8.6 89.6%
Opt Out 1 9 6 3 2.0 66.7%
Renewal by Service Consumption Volume
  1. Confirmatory - 1+.

Renewal by Service Consumption, OT

  1. NNLOA: Steady lift from consumption in FY21 and FY22.
Renewal Ratio by Service Consumption
DecisionType II_Service_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 20 9 11 0.8 45.0%
Need New LOA 0 2020 63 25 38 0.7 39.7%
Need New LOA 0 2021 59 32 27 1.2 54.2%
Need New LOA 0 2022 12 6 6 1.0 50.0%
Need New LOA 1 2020 1 1 0 Inf 100.0%
Need New LOA 1 2021 13 10 3 3.3 76.9%
Need New LOA 1 2022 14 10 4 2.5 71.4%
Opt Out 0 2019 10 9 1 9.0 90.0%
Opt Out 0 2020 18 14 4 3.5 77.8%
Opt Out 0 2021 13 13 0 Inf 100.0%
Opt Out 0 2022 7 7 0 Inf 100.0%
Opt Out 1 2021 5 2 3 0.7 40.0%
Opt Out 1 2022 4 4 0 Inf 100.0%
Renewal by SL Consumption
  1. [NNLOA] Smallest difference thus far. Unlikely to be meaningful as the percent renewed is so close to the average.
  2. [Opt Out] Very small positive effect.
Renewal Ratio by SL-Led Consumption
DecisionType II_SLLed_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 88 40 48 0.8 45.5%
Need New LOA 1 94 53 41 1.3 56.4%
Opt Out 0 25 21 4 5.2 84.0%
Opt Out 1 32 28 4 7.0 87.5%

SL Consumption Volume & Renewal

  1. See relatively high volumes of SL Led interactions.
  2. Drops scattered throughout.
  3. The 2-3 seems to hold some promise.

Renewal by SL Consumption, OT
  1. NNLOA: Consistently better than not consuming. FY21 and FY22 show the largest positive differences.
Renewal Ratio by SL-Led Consumption
DecisionType II_SLLed_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 12 5 7 0.7 41.7%
Need New LOA 0 2020 29 11 18 0.6 37.9%
Need New LOA 0 2021 37 19 18 1.1 51.4%
Need New LOA 0 2022 10 5 5 1.0 50.0%
Need New LOA 1 2019 8 4 4 1.0 50.0%
Need New LOA 1 2020 35 15 20 0.8 42.9%
Need New LOA 1 2021 35 23 12 1.9 65.7%
Need New LOA 1 2022 16 11 5 2.2 68.8%
Opt Out 0 2019 6 5 1 5.0 83.3%
Opt Out 0 2020 8 6 2 3.0 75.0%
Opt Out 0 2021 6 5 1 5.0 83.3%
Opt Out 0 2022 5 5 0 Inf 100.0%
Opt Out 1 2019 4 4 0 Inf 100.0%
Opt Out 1 2020 10 8 2 4.0 80.0%
Opt Out 1 2021 12 10 2 5.0 83.3%
Opt Out 1 2022 6 6 0 Inf 100.0%
Renewal by Research Interview Consumption
  1. [NNLOA] If you consumed it, you renewed at 10%+ against the average. If not, you renewed only slightly worse than the average. Most of the N is in not consuming. Interesting effect.
  2. [Opt Out] Those who did engage in this interaction renewed at the highest of rates.
Renewal Ratio by Research Interview Consumption
DecisionType II_ResearchInterview_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 148 72 76 0.9 48.6%
Need New LOA 1 34 21 13 1.6 61.8%
Opt Out 0 43 35 8 4.4 81.4%
Opt Out 1 14 14 0 Inf 100.0%
Research Interview Volume & Renewal
  1. 1+ looks good. Very low volume beyond that mark.

Renewal By Research Interview Consumption, OT
  1. NNLOA: Increasing renewal rate across the years. FY22 is a rather large difference.
Renewal Ratio by Research Interview Consumption
DecisionType II_ResearchInterview_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 13 6 7 0.9 46.2%
Need New LOA 0 2020 47 15 32 0.5 31.9%
Need New LOA 0 2021 66 38 28 1.4 57.6%
Need New LOA 0 2022 22 13 9 1.4 59.1%
Need New LOA 1 2019 7 3 4 0.8 42.9%
Need New LOA 1 2020 17 11 6 1.8 64.7%
Need New LOA 1 2021 6 4 2 2.0 66.7%
Need New LOA 1 2022 4 3 1 3.0 75.0%
Opt Out 0 2019 4 3 1 3.0 75.0%
Opt Out 0 2020 14 10 4 2.5 71.4%
Opt Out 0 2021 17 14 3 4.7 82.4%
Opt Out 0 2022 8 8 0 Inf 100.0%
Opt Out 1 2019 6 6 0 Inf 100.0%
Opt Out 1 2020 4 4 0 Inf 100.0%
Opt Out 1 2021 1 1 0 Inf 100.0%
Opt Out 1 2022 3 3 0 Inf 100.0%
Renewal by PLW OR Onsite Consumption
  1. [NNLOA] Showing some lift above the average; not consuming is very close to the average. Most of the N resides in not consuming.
  2. [Opt Out] Small lift, not likely to be significant.
Renewal Ratio by PLW OR Onsite Consumption
DecisionType II_PLW_Onsite_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 145 72 73 1.0 49.7%
Need New LOA 1 37 21 16 1.3 56.8%
Opt Out 0 38 32 6 5.3 84.2%
Opt Out 1 19 17 2 8.5 89.5%
PLW / Onsite Volume & Renewal
  1. No institution gets these at a large volume.
  2. 1 is where the effect starts.

Renewal by PLW/Onsite OT
  1. NNLOA: Dip in FY20, otherwise decent lift across the other years. FY21 with the largest.
Renewal Ratio by PLW OR Onsite Consumption
DecisionType II_PLW_Onsite_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 14 6 8 0.8 42.9%
Need New LOA 0 2020 53 22 31 0.7 41.5%
Need New LOA 0 2021 58 32 26 1.2 55.2%
Need New LOA 0 2022 20 12 8 1.5 60.0%
Need New LOA 1 2019 6 3 3 1.0 50.0%
Need New LOA 1 2020 11 4 7 0.6 36.4%
Need New LOA 1 2021 14 10 4 2.5 71.4%
Need New LOA 1 2022 6 4 2 2.0 66.7%
Opt Out 0 2019 6 5 1 5.0 83.3%
Opt Out 0 2020 10 7 3 2.3 70.0%
Opt Out 0 2021 13 11 2 5.5 84.6%
Opt Out 0 2022 9 9 0 Inf 100.0%
Opt Out 1 2019 4 4 0 Inf 100.0%
Opt Out 1 2020 8 7 1 7.0 87.5%
Opt Out 1 2021 5 4 1 4.0 80.0%
Opt Out 1 2022 2 2 0 Inf 100.0%
Renewal by Experience Consumption
  1. [NNLOA] Almost no consumption of this type of interaction. Even so, a decent sized effect appears.
  2. [Opt Out] Lower penetration on Experience - high reward.
Renewal Ratio by Experience Consumption
DecisionType II_Experience_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 163 79 84 0.9 48.5%
Need New LOA 1 19 14 5 2.8 73.7%
Opt Out 0 50 42 8 5.2 84.0%
Opt Out 1 7 7 0 Inf 100.0%
Experience Volume & Renewal
  1. Almost no institutions consume more than 1.

Renewal by Experience Consumption OT
  1. NNLOA: Consistently outperforms not consuming. I would ignore FY22.
  2. NNLOA: Increasing renewal rate from FY20.
Renewal Ratio by Experience Consumption
DecisionType II_Experience_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 18 8 10 0.8 44.4%
Need New LOA 0 2020 58 22 36 0.6 37.9%
Need New LOA 0 2021 62 33 29 1.1 53.2%
Need New LOA 0 2022 25 16 9 1.8 64.0%
Need New LOA 1 2019 2 1 1 1.0 50.0%
Need New LOA 1 2020 6 4 2 2.0 66.7%
Need New LOA 1 2021 10 9 1 9.0 90.0%
Need New LOA 1 2022 1 0 1 0.0 0.0%
Opt Out 0 2019 9 8 1 8.0 88.9%
Opt Out 0 2020 16 12 4 3.0 75.0%
Opt Out 0 2021 17 14 3 4.7 82.4%
Opt Out 0 2022 8 8 0 Inf 100.0%
Opt Out 1 2019 1 1 0 Inf 100.0%
Opt Out 1 2020 2 2 0 Inf 100.0%
Opt Out 1 2021 1 1 0 Inf 100.0%
Opt Out 1 2022 3 3 0 Inf 100.0%
Renewal by Expert Call Consumption
  1. [NNLOA] Besides there being high penetration, this type of impact interaction will help a little with distinguishing healthy vs. not healthy partners.
  2. [Opt Out] Inversion Here. Again, small number of drops, so no cause for concern.
Renewal Ratio by Expert Call Consumption
DecisionType II_ExpertCall_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 70 30 40 0.8 42.9%
Need New LOA 1 112 63 49 1.3 56.2%
Opt Out 0 21 19 2 9.5 90.5%
Opt Out 1 36 30 6 5.0 83.3%
Expert Call Volume & Renewal
  1. This is where we are seeing a lot of impact interaction volume.
  2. You see drops at 1, 2, 3, & 4.
  3. 2+ might be where we start to see some benefit.

Renewal by Expert Call Consumption OT
  1. NNLOA: Consistent outperformance. Not much increase in renewal rate across the years.
Renewal Ratio by Expert Call Consumption
DecisionType II_ExpertCall_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 9 3 6 0.5 33.3%
Need New LOA 0 2020 28 8 20 0.4 28.6%
Need New LOA 0 2021 24 14 10 1.4 58.3%
Need New LOA 0 2022 9 5 4 1.2 55.6%
Need New LOA 1 2019 11 6 5 1.2 54.5%
Need New LOA 1 2020 36 18 18 1.0 50.0%
Need New LOA 1 2021 48 28 20 1.4 58.3%
Need New LOA 1 2022 17 11 6 1.8 64.7%
Opt Out 0 2019 6 6 0 Inf 100.0%
Opt Out 0 2020 7 5 2 2.5 71.4%
Opt Out 0 2021 6 6 0 Inf 100.0%
Opt Out 0 2022 2 2 0 Inf 100.0%
Opt Out 1 2019 4 3 1 3.0 75.0%
Opt Out 1 2020 11 9 2 4.5 81.8%
Opt Out 1 2021 12 9 3 3.0 75.0%
Opt Out 1 2022 9 9 0 Inf 100.0%

Finer Grain Look at What Was Consumed

Event Category and Event Purpose

  1. Collaboratives look strong.
  2. Career Services Web Audit is solid.
  3. Benchmarking survey.
Renewal Ratio by Event Category and Event Purpose
Event_Category EventPurpose N ATL Dropped Ratio Perc_Renewed
Benchmarking Walkthrough Benchmarking Walkthrough 1 1 0 Inf 100.0%
Collaborative AAF Experiential Major Maps Collaborative: Overview and Implementation Process 6 5 1 5.0 83.3%
Collaborative Experiential Major Maps Collaborative 3 3 0 Inf 100.0%
Collaborative Financial Sustainability Collaborative 4 3 1 3.0 75.0%
Collaborative Financial Sustainability Engagement 1 1 0 Inf 100.0%
Collaborative Teaching and Learning Functional Collaborative 10 7 3 2.3 70.0%
COVID Working Group Session AAF COVID-19 Working Group Session - Provosts: Impact on Academy 12 8 4 2.0 66.7%
COVID Working Group Session BIPOC Faculty Recruitment Working Groups for Chief Academic Officers: Designing Academic Hiring Stra, 2 2 0 Inf 100.0%
Diagnostic or Audit Career Services Web Audit (AAF) 17 14 3 4.7 82.4%
Diagnostic or Audit Prospective Faculty Experience Web Audit (AAF) 1 1 0 Inf 100.0%
Diagnostic or Audit User Experience Audit (AAF) 2 2 0 Inf 100.0%
Evergreen Action Evergreen Action 13 4 9 0.4 30.8%
Executive Update Executive Update 3 1 2 0.5 33.3%
Expert Center Expert Center 93 59 37 1.6 63.4%
Expert Center Expert Center Call 46 28 18 1.6 60.9%
Market Research NA 7 4 3 1.3 57.1%
National Meeting “We Removed the Statue. Now What?”: A Conversation Among College Leaders about Institutional History, 1 0 1 0.0 0.0%
National Meeting 2017-2018 Academic Affairs Forum, Washington, DC 2 1 1 1.0 50.0%
National Meeting 2018-2019 Academic Affairs Forum National Meetings, 7 5 2 2.5 71.4%
National Meeting 2018-2019 Academic Affairs Forum National Meetings, Dana Point, CA 1 1 0 Inf 100.0%
National Meeting 2018-2019 Academic Affairs Forum National Meetings, Rancho Palos Verdes, CA 1 1 0 Inf 100.0%
National Meeting 2018-2019 Academic Affairs Forum National Meetings, Washington, DC 29 15 14 1.1 51.7%
National Meeting 2020 Academic Affairs Forum National Meeting, 36 24 12 2.0 66.7%
National Meeting 2020 Academic Affairs Forum National Meeting, Dana Point, CA 2 1 1 1.0 50.0%
National Meeting 2020 Academic Affairs Forum National Meeting, Washington, DC 6 6 0 Inf 100.0%
National Meeting 2020 New Provosts Virtual Intensive, 6 5 1 5.0 83.3%
National Meeting 5 Critical To Dos for Academic Leaders To Support Student Success and Mental Health, 4 4 0 Inf 100.0%
National Meeting AAF Executive Pop-Ups, 3 3 0 Inf 100.0%
National Meeting Academic Cost Containment: Ensuring Financial Sustainability in the Wake of COVID-19, 16 12 4 3.0 75.0%
National Meeting Adult Degree Completion: Market Realities in a COVID Era, 6 5 1 5.0 83.3%
National Meeting Career Services Virtual Working Session: Supporting Career Needs Through and Beyond COVID-19, 11 9 2 4.5 81.8%
National Meeting Engaging Faculty in Addressing the New Financial Reality, 4 4 0 Inf 100.0%
National Meeting Financial Sustainability Collaborative, 2 1 1 1.0 50.0%
National Meeting Financial Sustainability Collaborative: Assessing Academic Programs, 3 2 1 2.0 66.7%
National Meeting Financial Sustainability Collaborative: Developing New Programs to Reach New Students, 3 2 1 2.0 66.7%
National Meeting Financial Sustainability Collaborative: Improving Retention and Persistence, 2 1 1 1.0 50.0%
National Meeting Financial Sustainability Collaborative: Realizing Academic Efficiencies, 3 2 1 2.0 66.7%
National Meeting Growth Opportunities in Professional, Adult and Online Education, 2 2 0 Inf 100.0%
National Meeting Higher Education’s DEIJ Moment, 1 1 0 Inf 100.0%
National Meeting How To Make Real Progress on DEIJ Efforts: An Advisory Session with R1 and U15 Universities, 1 0 1 0.0 0.0%
National Meeting New Imperatives for Student Success, 3 3 0 Inf 100.0%
National Meeting New Provosts Intensive, 5 4 1 4.0 80.0%
National Meeting Serving the Students of the Pandemic, 2 2 0 Inf 100.0%
National Meeting State of the Union: Imperatives for the Post-Vaccination Institution for Provosts, 2 2 0 Inf 100.0%
National Meeting Strategic Partnerships for Selective Institutions, 1 1 0 Inf 100.0%
National Meeting The Changing Landscape of Higher Education Post-COVID, 4 4 0 Inf 100.0%
National Meeting The Future of Undergrad Enrollment, 2 1 1 1.0 50.0%
National Meeting The Future of Work Has Arrived: Strategic Imperatives for Higher Ed in the Digital Economy, 7 6 1 6.0 85.7%
National Meeting The New Landscape for Master’s Degree Competition: The Future of Growth and Countercyclical Trends, 8 8 0 Inf 100.0%
National Meeting The New World of Undergraduate Enrollment, 4 4 0 Inf 100.0%
National Meeting Unpacking the Lessons from Fall Repopulation, 9 6 3 2.0 66.7%
National Meeting Virtual Working Session AAF: Provost Roundtable on COVID19: Addressing the near and long term impact, 9 7 2 3.5 77.8%
National Meeting Virtual Working Session Joint AAF, SAF, GRP: Support Student Persistence Despite COVID-related Disru, 10 9 1 9.0 90.0%
National Meeting Why Don’t Graduate Certificate Programs Take Off? Sizing Risks and Opportunities, 4 4 0 Inf 100.0%
National Meeting Work-Integrated Learning for Alberta Institutions, 1 1 0 Inf 100.0%
National Meeting Pre-Wire National Meeting Pre-Wire 2 2 0 Inf 100.0%
Onsite Onsite | AAF | 01/30/2019 1 0 1 0.0 0.0%
Onsite Onsite | AAF | 01/31/2019 1 0 1 0.0 0.0%
Onsite Onsite | AAF | 04/09/2019 1 1 0 Inf 100.0%
Onsite Onsite | AAF | 04/30/2019 1 0 1 0.0 0.0%
Onsite Onsite | AAF | 08/28/2019 1 0 1 0.0 0.0%
Onsite Onsite | AAF | 09/17/2019 1 1 0 Inf 100.0%
Onsite Onsite | AAF | 09/19/2019 1 1 0 Inf 100.0%
Onsite Onsite | AAF | 10/11/2018 1 1 0 Inf 100.0%
Onsite Onsite | AAF | 11/06/2018 1 1 0 Inf 100.0%
Onsite Onsite | AAF | Presentation Date: 01/20/20 1 0 1 0.0 0.0%
Onsite Onsite | AAF | Presentation Date: 02/12/2019 1 1 0 Inf 100.0%
Onsite Onsite | AAF | Presentation Date: 02/23/2019 1 1 0 Inf 100.0%
Onsite Onsite | AAF | Presentation Date: 02/25/2020 1 1 0 Inf 100.0%
Onsite Onsite | AAF | Presentation Date: 03/11/2019 1 1 0 Inf 100.0%
Onsite Onsite | AAF | Presentation Date: 09/03/2019 1 0 1 0.0 0.0%
Onsite Onsite | AAF | Presentation Date: 10/10/19 1 0 1 0.0 0.0%
Onsite Onsite | AAF | Presentation Date: 10/16/2018 1 0 1 0.0 0.0%
Onsite Onsite | AAF | Presentation Date: 11/19/2019 1 0 1 0.0 0.0%
Onsite Onsite | AAF| 1/23/2019 1 1 0 Inf 100.0%
Onsite Onsite | BAF | June 13th 2019 1 1 0 Inf 100.0%
Onsite Onsite | Experiential Major Maps - AAF | Presentation Date: 3/9/20 1 1 0 Inf 100.0%
Onsite Onsite l AAF l Presentation date: 2/7/2018 1 1 0 Inf 100.0%
Onsite Onsite l AAF l Presentation Date: 7/19/2018 1 1 0 Inf 100.0%
Onsite Partner Intensive | AAF | Defining the Faculty Role in Student Success 1 1 0 Inf 100.0%
Onsite NA 7 4 3 1.3 57.1%
Research Initial 2019 Future of Learning 5 4 1 4.0 80.0%
Research Initial 2019 Future of the Faculty 9 4 5 0.8 44.4%
Research Initial 2021 Chief Diversity Officer 1 1 0 Inf 100.0%
Research Initial AAF Achievement Gap 4 3 1 3.0 75.0%
Research Initial Academic Redesign 2018 9 5 4 1.2 55.6%
Research Initial BIPOC Faculty Recruitment 1 1 0 Inf 100.0%
Research Initial Blueprint for Growth 2 2 0 Inf 100.0%
Research Initial Experiential Major Maps Collaborative 5 4 1 4.0 80.0%
Research Initial Faculty Workload at Small Institutions 1 1 0 Inf 100.0%
Research Initial Future of the Hybrid Campus 1 1 0 Inf 100.0%
Research Initial Hallmarks of an Antiracist Institution 1 1 0 Inf 100.0%
Research Initial Institutional Reckoning 1 1 0 Inf 100.0%
Research Initial Non-Tenure Track Faculty 1 1 0 Inf 100.0%
Research Initial Program-Level Learning Outcomes 3 2 1 2.0 66.7%
Research Initial Research Initial 1 0 1 0.0 0.0%
Research Initial Teaching and Learning Functional Collaborative 2 2 0 Inf 100.0%
Research SL Impact Research SL Impact - 07/22/2021 - Pricing and Financial Aid Strategy - EDEM 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - 08/12/2021 - The New World of Enrollment Communications - EDEM 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - AAF Action Planning Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - AAF and PAE Planning Discussion with Casey Funderburk, Channon Campbell, and Jacob Breland 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - AAF Collaborative 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - AAF Collaborative Discussion 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - AAF Collaborative Webinar Participation 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - AAF Discussion 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - AAF In Person Meeting 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - AAF Review 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Academic Affairs Forum Overview 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Academic Affairs Forum Research Presentation 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - BluePrint for Growth - Multidisciplinary Reorganization Discussion 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Call 4 2 2 1.0 50.0%
Research SL Impact Research SL Impact - Campus Visit 2 1 1 1.0 50.0%
Research SL Impact Research SL Impact - Career Services Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Check In Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Class Sizing 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - COVID19 AAF Diagnostic Walk Thru 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Dean’s Council 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - DII Presentation 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - ET - Virtual - NEI EMF - Event - 8/5/21 to 8/5/21 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Expert call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Expert Call 2 2 0 Inf 100.0%
Research SL Impact Research SL Impact - Fall Planning Discussion 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - FSC follow up call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Future of PSU Online 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - GRP Welcome Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Impact Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Impact Lab 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Impact Visit 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - In-person meeting 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In-Person Visit with Shelby Newport 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - In Person Lunch 2 1 1 1.0 50.0%
Research SL Impact Research SL Impact - In Person Visit-Research SL Impact-Carol Burton 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Visit-Research SL Impact-Casey Maugh Funderburk 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Visit-Research SL Impact-Jeffrey Lewis 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Visit-Research SL Impact-Justine DiNardo-Lim 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Visit-Research SL Impact-Thomas Nenon 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - in person visit + dinner 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Intro/Check-in 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - IPM with Provost Berner- SS Assessment 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Leadership Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Major Maps Collaborative Debrief 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting 9 6 3 2.0 66.7%
Research SL Impact Research SL Impact - Meeting - Baylor - AAF - Nancy Brickhouse (Provost) 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting - CMU - AAF - Jim Garrett 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Meeting - UT Austin - AAF - Dave Wolcott 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting - UT Austin - AAF - Rose Martinelli 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting at Meeting – Cathy Koshland 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting at Meeting – Tom Matthews 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting at Meeting - Charles Rozek 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Multidisciplinary Academic Structures and Future Online Strategy 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - New Student Connectedness Working Session 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - NJCU Provost visit 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - On Campus Meeting with Stephen Turner 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Onsite Request and Research Call with Ed Venit and Ken Hon 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Panel Discussion on COVID-19 on HBCU institutions 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Partnership Overview 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Phone Appointment-Expert Center Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Preparing for the 2020 Election 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Provost Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Research Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Research Call With Stephen Turner 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Research Partnership Discussion 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Research SL Impact 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Second Exec Roundtable Topic 27 23 4 5.8 85.2%
Research SL Impact Research SL Impact - Self-Assessment Walk Through 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SF MS AAF Workshop 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SF MS AAF Workshop Follow-up 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SL Impact - SAF student activism mtg 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SL Impact call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - SL Impact Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SL Impact interaction - AAfFPop Up Event 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - SL Impact Interaction Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SL Impact Visit call with U of St. Francis 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - sl research visit 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SL visit - Baylor Univ - Nancy Brickhouse at SOTF Summit 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Student Affairs Discussion with Kris Winter 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Student Affairs Onsite Planning Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Student Completion Policy Audit 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Student of the Future Discussion 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Student of the Future Summit Discussion 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Support Student Persistence Despite COVID-related Distractions 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Touching Base on AAF 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - U15 Presentation 2 1 1 1.0 50.0%
Research SL Impact Research SL Impact - UCM AAF PA w Ken 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - UNLV AAF Budget Remodel 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - UNLV Staff Meeting Presentation 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - uOttowa AAF Intro Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - USF AAF - New provost Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - USF AAF Updates 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - UT Austin - in-person meeting - David Platt 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - UTC Provost visit 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - VIP Day 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - VIP Day Meeting 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Virtual Meeting - Serving Students of the Pandemic 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Visit - UC Berkeley - AAF - Andrea Lambert 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Walkthrough Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact Visit 33 21 13 1.6 63.6%
Scoping Academic Cost Cutting 2 2 0 Inf 100.0%
Scoping Blueprint for Growth 1 0 1 0.0 0.0%
Scoping Blueprint for Growth: Future of Low-Cost and Free 1 1 0 Inf 100.0%
Survey Walkthrough Academic Affairs Organizational Benchmarking Survey 12 8 4 2.0 66.7%
Tool’s Walkthrough Tool’s Walk Through 14 7 7 1.0 50.0%
Tool’s Walkthrough Tool’s Walk Through Call 1 0 1 0.0 0.0%
VIP Day NC State University Virtual Impact Workshops 1 1 0 Inf 100.0%
VIP Day VIP Day 1 1 0 Inf 100.0%
Webinar Call / Webinar | Integrating Academic and Career Development - AAF| Presentation Date: 4/28/20 1 1 0 Inf 100.0%
Webinar Onsite | Instilling Equity and Inclusion in Departmental Practices - AAF | Presentation Date: 4/16/20 1 1 0 Inf 100.0%
Webinar Onsite State of the Union: Preparing for the Volatile Decade Ahead 3/13 1 0 1 0.0 0.0%
Webinar Partner Intensive | AAF | Align Budget Models with Strategic Goals 1 1 0 Inf 100.0%
Webinar Partner Intensive | AAF | Customized Presentation 1 1 0 Inf 100.0%
Webinar Partner Intensive | AAF | Resilience Leadership Workshop| Date of Presentation: 9/20/21 1 1 0 Inf 100.0%
Webinar Partner Intensive | AAF | The Pandemic’s Impact on Student Needs and Preferences | Presentation Date: 08/17/21 1 1 0 Inf 100.0%
Webinar PLW | AAF | Presentation Date: 06/27/2019 1 1 0 Inf 100.0%
Webinar PLW | AAF | Presentation Date: 08/23/2019 1 0 1 0.0 0.0%
Webinar PLW | SOU | 02/08/2019 1 1 0 Inf 100.0%
Webinar PLW l AAF l Presentation date: 4/6/2018 1 0 1 0.0 0.0%
Webinar PLW: Academic Vital Signs - AAF - 4/23/2020 1 0 1 0.0 0.0%
Webinar PLW: Scenario Planning Session with Academic and Student Affairs Teams 1 1 0 Inf 100.0%
Webinar U15 Webinar 1 1 0 Inf 100.0%
Webinar Virtual Meeting | AAF | Academic Strategy Session | Presentation date: 10/6/20 1 0 1 0.0 0.0%
Webinar Virtual Meeting | AAF | Academic Vital Signs | Presentation Date: 01/15/21 1 1 0 Inf 100.0%
Webinar Virtual Meeting | AAF | Academic Vital Signs | Presentation Date: 02/12/21 1 1 0 Inf 100.0%
Webinar Virtual Meeting | AAF | Blueprint for Growth: The Future of Adult and Graduate Education | Presentation Date: 11/13/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | AAF | Customized Presentation 1 1 0 Inf 100.0%
Webinar Virtual Meeting | AAF | Faculty Diversity | Presentation Date: 03/19/21 1 0 1 0.0 0.0%
Webinar Virtual Meeting | AAF | Meeting the Escalating Demand of Mental Health Services | Presentation date: 11/10/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | AAF | Preparing for a Transformational Future | Presentation date: 11/17/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | AAF | Promoting Timely Degree Completion 1 1 0 Inf 100.0%
Webinar Virtual Meeting | AAF | Reinventing Higher Ed in the Shadow of Covid-19 | Presentation Date: 01/19/21 1 1 0 Inf 100.0%
Webinar Virtual Meeting | AAF | State of the Sector | Presentation Date: 02/23/21 1 1 0 Inf 100.0%
Webinar Virtual Meeting | AAF | State of the Sector | Presentation Date: 03/22/2021 1 0 1 0.0 0.0%
Webinar Virtual Meeting | AAF | State of the Union Board Presentation | Presentation Date: 11/05/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | AAF | State of the Union: Preparing for the Volatile Decade Ahead | Presentation Date: 10/22/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | AAF | State of the Union: Preparing for the Volatile Decade Ahead | Presentation Date: 10/28/20 1 1 0 Inf 100.0%
Webinar NA 6 3 3 1.0 50.0%
NA NA 19 6 14 0.4 31.6%
Correlation betwen Event Groupings, and Renewal
  1. Events looks most correlated with Renewal.
  2. Events and Experience appear to have highest correlations with other interactions.

Multivariate Regression (still kind of simple)

Note: Looking at all decision types.

  1. Events, Service, and Research Interviews are the two designated as significance.
  2. In a more complicated model which controls for Account Segment and Decision Type, the results suggest only Events are significant and the type of Decision is significant.
  Target_Binary
Predictors Odds Ratios CI p
(Intercept) 130607.45 0.00 – NA 0.989
II Events Volume 1.60 1.22 – 2.17 0.001
II SLLed Volume 1.08 0.84 – 1.42 0.545
II ResearchInterview
Volume 		1.79 0.96 – 3.62 0.084
II PLW Onsite Volume 0.84 0.48 – 1.49 0.553
II ExpertCall Volume 1.24 0.97 – 1.53 0.094
II Service Volume 1.89 0.94 – 3.51 0.097
AccountSegment [Canada] 0.00 NA – 5882185971491051701628242444244640268204402020206628246486600628602264808.00 0.989
AccountSegment [Large
Public & Private] 		0.00 NA – 3802578513138739781068088826488404884280486468266446286228880480040806480.00 0.989
AccountSegment [Regional
Private] 		0.00 NA – 1336574839876020534668248402404644884402064020282222644288884884464886068.00 0.988
AccountSegment [Regional
Public] 		0.00 NA – 1788342291901770798088280022280264426002006466604266022282268244862646846.00 0.988
AccountSegment
[Selective] 		0.00 NA – 3534825878772378634082440686864626644862206804222260068026864600646204682.00 0.989
DecisionType [Opt Out] 7.18 3.13 – 14.78 <0.001
Observations 239
R2 Tjur 0.247