Impact Interaction Analyses - SASR

SASR Analysis

The purpose of this analysis is to understand the variable effect of impact interactions on the likelihood of a partner to renew their partnership. Simply, which service levers matter more for partnership renewal.

Executive Summary

Methodological Considerations

1. The data set consists of decisions from FY19 through February of FY22.

2. Similar to previous analyses, we are primarily looking at the year leading up to a decision.

3. We are not looking at ‘integrated’ partnerships. That is, we are focusing on utilization at the account where the renewal decision is made.

4. Lastly, we are looking at unit renewal rates instead of $ renewal rates. This allows us to treat impact interactions equitably across partnerships.

Renewal by Decision Type

The below table should not come as a surprise. Opt Outs tend to perform well very well while NNLOA can be quite mixed. Also note that we are leaning much more heavily towards opt outs than NNLOA in the data.

1. Remember the Ratios: 1.4 for NNLOA, 4.0 for Opt Outs.
2. This matches, almost exactly, data presented by Julia - important to emphasize the alignment!

Renewal Ratio by Decision Type

DecisionType	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	34	20	14	1.4	58.8%
Opt Out	75	60	15	4.0	80.0%
Total	109	80	29	2.8	73.4%

Renewals by Decision Type and Year

Since we are combining multiple years of data, we will frequently take a look at whether there are differences across the years.

1. Very few of the total decisions occurred in FY19. We should be careful to make sure that these units are not abnormal compared to others, in utilization.
2. Nearly 50% of the decisions occurred in FY21: the NNLOA for those units looks much better than in the other FYs.
3. Opt Outs have been relatively consistent, with this current FY being the best.

Renewal Ratio by Decision Type

DecisionType	FiscalYear	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	2020	3	1	2	0.5	33.3%
Need New LOA	2021	21	14	7	2.0	66.7%
Need New LOA	2022	10	5	5	1.0	50.0%
Opt Out	2019	5	4	1	4.0	80.0%
Opt Out	2020	19	15	4	3.8	78.9%
Opt Out	2021	36	28	8	3.5	77.8%
Opt Out	2022	15	13	2	6.5	86.7%
Total	NA	109	80	29	2.8	73.4%

Renewal Rate by Account Segment

I was surprised to see SASR present in segments other than the Regional.

0. The bulk of the decisions are in the ‘Regional’ space.
1. As has been discussed previously, Regional Private is the lowest performing of the segments.
2. Canada and Selective are fantastic and very small N.

Renewal Ratio by Account Segment

AccountSegment	N	ATL	Dropped	Ratio	Perc_Renewed
Canada	5	5	0	Inf	100.0%
Large Public & Private	10	8	2	4.0	80.0%
Regional Private	58	39	19	2.1	67.2%
Regional Public	33	25	8	3.1	75.8%
Selective	3	3	0	Inf	100.0%

Renewal Rate by Account Segment & Fiscal Year

1. The Renewal Rate in Regional Private appears to be improving from FY20 - FY22.
2. Inversely, the renewal rate in Regional Publics is decreasing from FY20 -FY22.

Renewal Ratio by Account Segment

AccountSegment	FiscalYear	N	ATL	Dropped	Ratio	Perc_Renewed
Canada	2020	2	2	0	Inf	100.0%
Canada	2021	3	3	0	Inf	100.0%
Large Public & Private	2020	3	3	0	Inf	100.0%
Large Public & Private	2021	6	4	2	2.0	66.7%
Large Public & Private	2022	1	1	0	Inf	100.0%
Regional Private	2019	4	3	1	3.0	75.0%
Regional Private	2020	10	5	5	1.0	50.0%
Regional Private	2021	25	17	8	2.1	68.0%
Regional Private	2022	19	14	5	2.8	73.7%
Regional Public	2019	1	1	0	Inf	100.0%
Regional Public	2020	6	5	1	5.0	83.3%
Regional Public	2021	21	16	5	3.2	76.2%
Regional Public	2022	5	3	2	1.5	60.0%
Selective	2020	1	1	0	Inf	100.0%
Selective	2021	2	2	0	Inf	100.0%

Renewal by Decision Type & Segment

1. Opt Out performance in Regional Private is not buoying the overall rate in that segment, as it is in Regional Publics.

Renewal Ratio by Account Segment

AccountSegment	DecisionType	N	ATL	Dropped	Ratio	Perc_Renewed
Canada	Need New LOA	1	1	0	Inf	100.0%
Canada	Opt Out	4	4	0	Inf	100.0%
Large Public & Private	Need New LOA	1	1	0	Inf	100.0%
Large Public & Private	Opt Out	9	7	2	3.5	77.8%
Regional Private	Need New LOA	19	11	8	1.4	57.9%
Regional Private	Opt Out	39	28	11	2.5	71.8%
Regional Public	Need New LOA	13	7	6	1.2	53.8%
Regional Public	Opt Out	20	18	2	9.0	90.0%
Selective	Opt Out	3	3	0	Inf	100.0%

Justin Greeves Analyses 2021, as related to Renewal Rates

Executive Sponsor - 2021

1. Most of the Exec Sponsors are Presidents and Provosts.
2. Exec Sponsors in the Other and NA are suggestive of weaker relationships and outcomes.

Renewal Ratio by Executive Sponsor

Executive_Sponsor	N	ATL	Dropped	Ratio	Perc_Renewed
CBO/CFO	1	1	0	Inf	100.0%
None	1	1	0	Inf	100.0%
Other	2	0	2	0.0	0.0%
President	10	9	1	9.0	90.0%
Provost	7	6	1	6.0	85.7%
NA	4	1	3	0.3	25.0%

Exec Sponsor Turnover - 2021

1. Where there was turnover, we didn’t see a surplus of drops.

Renewal Ratio by Executive Sponsor

Exec_Sponsor_Turnover	N	ATL	Dropped	Ratio	Perc_Renewed
FALSE	12	11	1	11.0	91.7%
TRUE	5	4	1	4.0	80.0%
NA	8	3	5	0.6	37.5%

EAB Plan Involvement - 2021

Renewal Ratio by Executive Sponsor

EAB_Plan_Involvement	N	ATL	Dropped	Ratio	Perc_Renewed
We are executing on their strategic plan	11	9	2	4.5	81.8%
We have little or no involvement in their plan	10	8	2	4.0	80.0%
NA	4	1	3	0.3	25.0%

Success Plan Level - 2021

1. It’s nice to see that the highest couple of levels are associated with high renewal rates.

Renewal Ratio by Executive Sponsor

Success_Plan_Level	N	ATL	Dropped	Ratio	Perc_Renewed
1 - no plan/reactive service	3	3	0	Inf	100.0%
2 - I have a list of resources the partner might like	3	2	1	2.0	66.7%
3 - I have a plan but need to get the partner to review/approve it	3	1	2	0.5	33.3%
4- They have an approved plan and working on engagement/buy-in	5	4	1	4.0	80.0%
5- They have a plan and are executing on it	7	7	0	Inf	100.0%
NA	4	1	3	0.3	25.0%

Justin Greeves Analyses 2020, as related to Renewal Rates

Methodological Note: The information in the spreadsheet was dated as July 2020. I then looked at all decisions which occurred within a year, so all of FY21.

Executive Sponsor - 2020

1. Most of the Exec Sponsors are Presidents.
2. CBO/CFO Exec Sponsors are at the bottom of the renewal rate bucket.

Renewal Ratio by Executive Sponsor

Exec_Sponsor	N	ATL	Dropped	Ratio	Perc_Renewed
CBO/CFO	11	7	4	1.8	63.6%
NA	6	4	2	2.0	66.7%
Provost	8	6	2	3.0	75.0%
President	21	16	5	3.2	76.2%
No	10	8	2	4.0	80.0%

Success Plan Level - 2020

1. The more proactive we are on delivering services, the better. Although the small unresponsive N weakens the generalization a little bit.

Renewal Ratio by Service Type

Service_Type	N	ATL	Dropped	Ratio	Perc_Renewed
We are conducting reactive service (they call/email when needed)	15	9	6	1.5	60.0%
NA	8	5	3	1.7	62.5%
We have an established success/service plan	27	22	5	4.4	81.5%
They are generally non-responsive to EAB/SL outreach	6	5	1	5.0	83.3%

Success Plan Involvement - 2020

1. The more involvement in the success plan, the higher the likelihood to renew. This one is monotonic, so we can feel a bit safer in this generalization.

Renewal Ratio by Strategic Plan Involvement

Involvement_in_Strategic_Plan	N	ATL	Dropped	Ratio	Perc_Renewed
We are helping/helped create it	4	4	0	Inf	100.0%
NA	9	5	4	1.2	55.6%
Very little or no involvement	28	19	9	2.1	67.9%
We are helping/helped execute it	15	13	2	6.5	86.7%

Viewed as Consultants - 2020

1. If we are viewed as consultants, the renewal rate drops.

Renewal Ratio by View of EAB

Consultants	N	ATL	Dropped	Ratio	Perc_Renewed
FALSE	34	26	8	3.2	76.5%
TRUE	15	10	5	2.0	66.7%
NA	7	5	2	2.5	71.4%

Health - 2020

1. Health Grades are decent predictor.

Renewal Ratio by Health

Health	N	ATL	Dropped	Ratio	Perc_Renewed
Healthy	31	25	6	4.2	80.6%
Not Healthy	18	12	6	2.0	66.7%
NA	7	4	3	1.3	57.1%

Renewal Ratio by SL & Missing Values

SL_Research	N	ATL	Dropped	Ratio	Perc_Renewed
Kate Milani	3	2	1	2	66.7%
Paul Gunther	1	1	0	Inf	100.0%
NA	2	1	1	1	50.0%

Impact Interaction Volume Histogram

1. Utilization is largely located between 8 and 17.
2. There is long tail with heavy utilizers.
3. There is also a decent number of lower utilizers.

Impact Interaction Volume Histogram Split by Decision

1. Super users definitively renew at a pretty high rate.
2. Lower utilization still has some partners who renew.
3. Between 8 and 17, there is a decent mix of renewals and drops.

Impact Interaction Volume Histogram Split by Pool Date FY

1. Many of the high bars are comprised of multiple FY decisions, which can provide some measure of comfort in making conclusions which are more general.
2. A few more decisions from 2021 and 2022 reside in the long tail, as compared to 2019 and 2020.

Renewal by Interaction Volume and Decision Type, Unbinned

1. NNLOA appear to have lower utilization, with drops peppered throughout.
2. Opt Outs have much higher utilization and the higher utilization has fewer drops.

Renewal Ratio by Impact Interaction Volume

DecisionType	II_Credited_Volume	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	2	0	2	0.0	0.0%
Need New LOA	2	1	1	0	Inf	100.0%
Need New LOA	3	5	2	3	0.7	40.0%
Need New LOA	4	1	1	0	Inf	100.0%
Need New LOA	5	2	0	2	0.0	0.0%
Need New LOA	8	4	2	2	1.0	50.0%
Need New LOA	9	1	1	0	Inf	100.0%
Need New LOA	10	2	2	0	Inf	100.0%
Need New LOA	11	5	5	0	Inf	100.0%
Need New LOA	12	3	1	2	0.5	33.3%
Need New LOA	13	1	0	1	0.0	0.0%
Need New LOA	14	2	2	0	Inf	100.0%
Need New LOA	15	2	1	1	1.0	50.0%
Need New LOA	16	1	0	1	0.0	0.0%
Need New LOA	17	1	1	0	Inf	100.0%
Need New LOA	20	1	1	0	Inf	100.0%
Opt Out	2	3	1	2	0.5	33.3%
Opt Out	3	4	1	3	0.3	25.0%
Opt Out	4	1	0	1	0.0	0.0%
Opt Out	5	2	1	1	1.0	50.0%
Opt Out	6	4	4	0	Inf	100.0%
Opt Out	7	1	0	1	0.0	0.0%
Opt Out	8	5	4	1	4.0	80.0%
Opt Out	9	5	4	1	4.0	80.0%
Opt Out	10	5	4	1	4.0	80.0%
Opt Out	11	3	2	1	2.0	66.7%
Opt Out	12	4	4	0	Inf	100.0%
Opt Out	13	5	4	1	4.0	80.0%
Opt Out	14	3	3	0	Inf	100.0%
Opt Out	15	3	3	0	Inf	100.0%
Opt Out	16	3	2	1	2.0	66.7%
Opt Out	17	2	2	0	Inf	100.0%
Opt Out	18	1	1	0	Inf	100.0%
Opt Out	19	2	2	0	Inf	100.0%
Opt Out	20	1	1	0	Inf	100.0%
Opt Out	21	1	1	0	Inf	100.0%
Opt Out	22	4	4	0	Inf	100.0%
Opt Out	23	1	1	0	Inf	100.0%
Opt Out	24	1	1	0	Inf	100.0%
Opt Out	26	1	1	0	Inf	100.0%
Opt Out	30	2	1	1	1.0	50.0%
Opt Out	31	1	1	0	Inf	100.0%
Opt Out	34	2	2	0	Inf	100.0%
Opt Out	35	2	2	0	Inf	100.0%
Opt Out	37	1	1	0	Inf	100.0%
Opt Out	42	1	1	0	Inf	100.0%
Opt Out	46	1	1	0	Inf	100.0%

Renewal by Impact Interaction Volume and Decision Type, (Binned)

Adjusted the binning to better capture the high volume present in SASR.

1. For both NNLOA and Opt Outs, increased impact interaction volume does tend to be associated with increased likelihood to renew.
2. For NNLOA, the presence of a decent number of drops in the 12-16 range attenuates the conclusion from 1 a little bit.
3. For Opt Out, the monotonic increase in renewal across impact interaction consumption, strengthens the conclusion from 1.

Renewal Ratio by Impact Interaction Volume (Binned)

DecisionType	II_Volume_Bins	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	2	0	2	0.0	0.0%
Need New LOA	1-6	9	4	5	0.8	44.4%
Need New LOA	7-11	12	10	2	5.0	83.3%
Need New LOA	12-16	9	4	5	0.8	44.4%
Need New LOA	17+	2	2	0	Inf	100.0%
Opt Out	1-6	14	7	7	1.0	50.0%
Opt Out	7-11	19	14	5	2.8	73.7%
Opt Out	12-16	18	16	2	8.0	88.9%
Opt Out	17+	24	23	1	23.0	95.8%

Renewal by Impact Interaction Volume and Account Segment, (Binned)

1. It is pretty clear that low engagement is a warning sign.
2. Regional Private is supplying all of the 12-16 drops which we saw above.
3. The case for increased impact interactions remains, regardless of segment, although the size of the effect appears to be larger for Regional Publics.

Renewal Ratio by Impact Interaction Volume (Binned)

AccountSegment	II_Volume_Bins	N	ATL	Dropped	Ratio	Perc_Renewed
Regional Private	1-6	12	5	7	0.7	41.7%
Regional Private	7-11	18	13	5	2.6	72.2%
Regional Private	12-16	18	11	7	1.6	61.1%
Regional Private	17+	10	10	0	Inf	100.0%
Regional Public	0	2	0	2	0.0	0.0%
Regional Public	1-6	8	5	3	1.7	62.5%
Regional Public	7-11	7	5	2	2.5	71.4%
Regional Public	12-16	6	6	0	Inf	100.0%
Regional Public	17+	10	9	1	9.0	90.0%

Regional Private Renewal Ratio by Impact Interaction Volume (Binned) & Opex

1. In the lowest Opex Band, it takes the most amount of impact interactions to see any improvement in Decision Rate.
2. The rest of the OpEx Bands, show relatively decent lift beyond the initial bin of activity.

Regional Private Renewal Ratio by Impact Interaction Volume (Binned) & Opex

OpEx_Bins_Private	II_Volume_Bins	N	ATL	Dropped	Ratio	Perc_Renewed
0 to 38M	1-6	6	3	3	1.0	50.0%
0 to 38M	7-11	9	5	4	1.2	55.6%
0 to 38M	12-16	9	5	4	1.2	55.6%
0 to 38M	17+	5	5	0	Inf	100.0%
38M to 71M	1-6	5	2	3	0.7	40.0%
38M to 71M	7-11	6	6	0	Inf	100.0%
38M to 71M	12-16	4	3	1	3.0	75.0%
38M to 71M	17+	3	3	0	Inf	100.0%
71M to 127M	1-6	1	0	1	0.0	0.0%
71M to 127M	7-11	3	2	1	2.0	66.7%
71M to 127M	12-16	5	3	2	1.5	60.0%
71M to 127M	17+	2	2	0	Inf	100.0%

Regional Public Renewal Ratio by Impact Interaction Volume(Binned) & Opex

1. Not as clean as the Regional Private data, because the data is spread so thing across the two categories.
2. Still seems like there is mild support for increased impact interactions being connected to healthier partners.

Regional Public Renewal Ratio by Impact Interaction Volume(Binned) & Opex

OpEx_Bins_Public	II_Volume_Bins	N	ATL	Dropped	Ratio	Perc_Renewed
0 to 50M	0	2	0	2	0.0	0.0%
0 to 50M	1-6	3	1	2	0.5	33.3%
0 to 50M	7-11	2	2	0	Inf	100.0%
0 to 50M	12-16	1	1	0	Inf	100.0%
50M to 90M	1-6	1	1	0	Inf	100.0%
50M to 90M	7-11	2	2	0	Inf	100.0%
50M to 90M	17+	3	2	1	2.0	66.7%
90M to 131M	1-6	3	2	1	2.0	66.7%
90M to 131M	7-11	1	0	1	0.0	0.0%
90M to 131M	12-16	2	2	0	Inf	100.0%
90M to 131M	17+	3	3	0	Inf	100.0%
131M+	1-6	1	1	0	Inf	100.0%
131M+	7-11	2	1	1	1.0	50.0%
131M+	12-16	3	3	0	Inf	100.0%
131M+	17+	4	4	0	Inf	100.0%

#####Simple Regression for Impact Interaction Volume

1. The Estimate for Impact Interaction Volume is Positive -> increased consumption means increased likelihood to renew.
2. This is statistically significant.

	Target_Binary
Predictors	Odds Ratios	CI	p
(Intercept)	0.56	0.21 – 1.35	0.208
II Credited Volume	1.16	1.07 – 1.28	0.001
Observations	109
R2 Tjur	0.162

Penetration by Event Grouping

1. Expert Calls, Service, and SL Led are the highest penetration.
2. Vast differences between the decision types on Events, with smaller differences for research interviews, service/tool, and experience.

Reminder: 1. Experience = VIP Days & Collaboratives 2. Service = Benchmarking, Audits, Secret Shopper, Customer Research Projects, Market Insights, and Survey Walkthroughs 3. Expert Call = Expert Center, Benchmarking Walkthrough, Tool’s Walkthrough 4. SL Led = Research SL Impact, Evergreen Action, Exec Update, National Meeting Pre-wire 5. Research Interview = Research Initial & Scoping 6. Events = National Meeting, COVID Working Group 7. PLW/Onsite = Onsite, PLW

Percent of Renewals w/ At Least 1 Interaction in a Group

DecisionType	Perc_Events	Perc_Service	Perc_SLLed	Perc_ResearchInt	Perc_PLW_Onsite	Perc_Experience	Perc_ExpertCall	Perc_MrktInsights
Need New LOA	11.8%	55.9%	61.8%	8.8%	44.1%	5.9%	94.1%	44.1%
Opt Out	64.0%	77.3%	68.0%	25.3%	46.7%	20.0%	93.3%	64.0%

Renewal by Event Consumption

1. [NNLOA] The N is small, although there is some evidence to suggest benefit.
2. [Opt Out] Get them to an event! Very meaningful difference in performance, with and without an event.

Renewal Ratio by Event Consumption

DecisionType	II_Events_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	30	17	13	1.3	56.7%
Need New LOA	1	4	3	1	3.0	75.0%
Opt Out	0	27	13	14	0.9	48.1%
Opt Out	1	48	47	1	47.0	97.9%

Renewal by Event Consumption Volume

Renewal by Event, OT

1. Not seeing an increase in Event Consumption.
2. Conversion for those who attend events has increased and maxed out.

Renewal Ratio by Event Consumption

FiscalYear	II_Events_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
2019	0	4	3	1	3.0	75.0%
2019	1	1	1	0	Inf	100.0%
2020	0	9	5	4	1.2	55.6%
2020	1	13	11	2	5.5	84.6%
2021	0	31	16	15	1.1	51.6%
2021	1	26	26	0	Inf	100.0%
2022	0	13	6	7	0.9	46.2%
2022	1	12	12	0	Inf	100.0%

Renewal by Service Consumption

1. [NNLOA] Not a large difference between consumption and renewal rates.
2. [Opt Out] A nice bump if this type of impact interaction is consumed.

Renewal Ratio by Service Consumption

DecisionType	II_Service_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	15	9	6	1.5	60.0%
Need New LOA	1	19	11	8	1.4	57.9%
Opt Out	0	17	12	5	2.4	70.6%
Opt Out	1	58	48	10	4.8	82.8%

Renewal by Service Consumption Volume

Renewal by Service Consumption, OT

1. Consumption has decreased in FY22 from FY21.
2. Renewal has remained strong.

Renewal Ratio by Service Consumption

II_Service_Binary	FiscalYear	N	ATL	Dropped	Ratio	Perc_Renewed
0	2019	4	3	1	3.0	75.0%
0	2020	6	4	2	2.0	66.7%
0	2021	18	13	5	2.6	72.2%
0	2022	4	1	3	0.3	25.0%
1	2019	1	1	0	Inf	100.0%
1	2020	16	12	4	3.0	75.0%
1	2021	39	29	10	2.9	74.4%
1	2022	21	17	4	4.2	81.0%

Renewal by SL Consumption

1. [NNLOA] A similar distribution to Service; not much of a difference maker.
2. [Opt Out] More of an effect here than with Service touches: a decent lift from this interaction.

Renewal Ratio by SL-Led Consumption

DecisionType	II_SLLed_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	13	8	5	1.6	61.5%
Need New LOA	1	21	12	9	1.3	57.1%
Opt Out	0	24	16	8	2.0	66.7%
Opt Out	1	51	44	7	6.3	86.3%

SL Consumption Volume & Renewal

Renewal by SL Consumption, OT

1. Those who haven’t had an interaction are getting worse over time.
2. Those who have haven’t shown renewal improvement.

Renewal Ratio by SL-Led Consumption

II_SLLed_Binary	FiscalYear	N	ATL	Dropped	Ratio	Perc_Renewed
0	2019	2	1	1	1.0	50.0%
0	2020	7	5	2	2.5	71.4%
0	2021	20	13	7	1.9	65.0%
0	2022	8	5	3	1.7	62.5%
1	2019	3	3	0	Inf	100.0%
1	2020	15	11	4	2.8	73.3%
1	2021	37	29	8	3.6	78.4%
1	2022	17	13	4	3.2	76.5%

Research Interview Volume & Renewal

Renewal by Research Interview Consumption

1. [NNLOA] Almost no consumption of this impact interaction.
2. [Opt Out] Those who did engage in this interaction renewed at a very high rate.

Renewal Ratio by Research Interview Consumption

DecisionType	II_ResearchInterview_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	31	18	13	1.4	58.1%
Need New LOA	1	3	2	1	2.0	66.7%
Opt Out	0	56	42	14	3.0	75.0%
Opt Out	1	19	18	1	18.0	94.7%

Renewal By Research Interview Consumption, OT

1. Some weakness in FY22 for those who consume…but N is small.
2. Roughly stable rate of renewal for those who do not consume this interaction.

Renewal Ratio by Research Interview Consumption

II_ResearchInterview_Binary	FiscalYear	N	ATL	Dropped	Ratio	Perc_Renewed
0	2019	4	3	1	3.0	75.0%
0	2020	16	10	6	1.7	62.5%
0	2021	50	35	15	2.3	70.0%
0	2022	17	12	5	2.4	70.6%
1	2019	1	1	0	Inf	100.0%
1	2020	6	6	0	Inf	100.0%
1	2021	7	7	0	Inf	100.0%
1	2022	8	6	2	3.0	75.0%

Renewal by PLW OR Onsite Consumption

1. [NNLOA] Showing some lift from this type of impact interaction.
2. [Opt Out] A small lift, especially in comparison to the other interactions.

Renewal Ratio by PLW OR Onsite Consumption

DecisionType	II_PLW_Onsite_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	19	10	9	1.1	52.6%
Need New LOA	1	15	10	5	2.0	66.7%
Opt Out	0	40	31	9	3.4	77.5%
Opt Out	1	35	29	6	4.8	82.9%

PLW / Onsite Volume & Renewal

Renewal by PLW/Onsite OT

1. Lots of variability. No clear pattern on renewal rate.
2. Seeing a small increase in decisions with this type of utilization.

Renewal Ratio by PLW OR Onsite Consumption

II_PLW_Onsite_Binary	FiscalYear	N	ATL	Dropped	Ratio	Perc_Renewed
0	2019	2	2	0	Inf	100.0%
0	2020	13	8	5	1.6	61.5%
0	2021	32	23	9	2.6	71.9%
0	2022	12	8	4	2.0	66.7%
1	2019	3	2	1	2.0	66.7%
1	2020	9	8	1	8.0	88.9%
1	2021	25	19	6	3.2	76.0%
1	2022	13	10	3	3.3	76.9%

Renewal by Experience Consumption

1. [NNLOA] Almost no consumption of this type of interaction. Even so, perfect renewal rate!
2. [Opt Out] Lower penetration on Experience - high reward.

Renewal Ratio by Experience Consumption

DecisionType	II_Experience_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	32	18	14	1.3	56.2%
Need New LOA	1	2	2	0	Inf	100.0%
Opt Out	0	60	45	15	3.0	75.0%
Opt Out	1	15	15	0	Inf	100.0%

Experience Volume & Renewal

Renewal by Experience Consumption OT

1. Small jump in FY21 consumption.
2. Excellent renewal rate.

Renewal Ratio by Experience Consumption

II_Experience_Binary	FiscalYear	N	ATL	Dropped	Ratio	Perc_Renewed
0	2019	4	3	1	3.0	75.0%
0	2020	20	14	6	2.3	70.0%
0	2021	47	32	15	2.1	68.1%
0	2022	21	14	7	2.0	66.7%
1	2019	1	1	0	Inf	100.0%
1	2020	2	2	0	Inf	100.0%
1	2021	10	10	0	Inf	100.0%
1	2022	4	4	0	Inf	100.0%

Renewal by Expert Call Consumption

1. Besides there being high penetration, this type of impact interaction will not help distinguish healthy vs. not healthy partners.

Renewal Ratio by Expert Call Consumption

DecisionType	II_ExpertCall_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	2	0	2	0.0	0.0%
Need New LOA	1	32	20	12	1.7	62.5%
Opt Out	0	5	4	1	4.0	80.0%
Opt Out	1	70	56	14	4.0	80.0%

Expert Call Volume & Renewal

Renewal by Expert Call Consumption OT

1. Always high consumption.
2. Some variability in the renewal rate. Likely regression to the mean at work.

Renewal Ratio by Expert Call Consumption

II_ExpertCall_Binary	FiscalYear	N	ATL	Dropped	Ratio	Perc_Renewed
0	2019	1	0	1	0.0	0.0%
0	2020	1	1	0	Inf	100.0%
0	2021	3	1	2	0.5	33.3%
0	2022	2	2	0	Inf	100.0%
1	2019	4	4	0	Inf	100.0%
1	2020	21	15	6	2.5	71.4%
1	2021	54	41	13	3.2	75.9%
1	2022	23	16	7	2.3	69.6%

Renewal by Market Insights Consumption

1. Many of our partners use this functionality, but the benefit is not so clear.
2. [NNLOA] Usage is roughly 50/50 and the difference in renewal is rather low.
3. [Opt Out] Usage is roughly 2/3rds and those who consume renew at a slightly lower rate!

Renewal Ratio by Market Insights Consumption

DecisionType	II_MarketResearch_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	19	11	8	1.4	57.9%
Need New LOA	1	15	9	6	1.5	60.0%
Opt Out	0	27	22	5	4.4	81.5%
Opt Out	1	48	38	10	3.8	79.2%

Market Insights Volume & Renewal

1. You see drops at all levels of consumption, without an abatement in that pattern.

Renewal by Market Insights Consumption OT

1. Always moderate amount consumption.
2. Looks like small improvement in renewal rate over time, that might have stabilized.

Renewal Ratio by Market Insights Consumption

II_MarketResearch_Binary	FiscalYear	N	ATL	Dropped	Ratio	Perc_Renewed
0	2019	4	3	1	3.0	75.0%
0	2020	9	7	2	3.5	77.8%
0	2021	24	17	7	2.4	70.8%
0	2022	9	6	3	2.0	66.7%
1	2019	1	1	0	Inf	100.0%
1	2020	13	9	4	2.2	69.2%
1	2021	33	25	8	3.1	75.8%
1	2022	16	12	4	3.0	75.0%

Renewel by APR Presence

1. [NNLOA] APR presence for NNLOA is a strong indication of health. Although, there might be some selection bias at play.
2. [Opt Out] It is also the case that APR presence is a strong positive indicator.

Renewal Ratio by APR Presence

DecisionType	APR_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	25	11	14	0.8	44.0%
Need New LOA	1	9	9	0	Inf	100.0%
Opt Out	0	58	44	14	3.1	75.9%
Opt Out	1	17	16	1	16.0	94.1%

Finer Grain Look at What Was Consumed

Event Category and Event Purpose

1. The data becomes so sparse it is harder for me to draw meaningful conclusions.
2. It does appear that FSC related content has some outsized value.
3. Diagnostics are a bit all over the place.
4. Collaboratives seems to be an effective delivery mechanism.

Renewal Ratio by Event Category and Event Purpose

Event_Category	EventPurpose	N	ATL	Dropped	Ratio	Perc_Renewed
Benchmark	Advancement Investment and Performance Initiative FY2018	2	2	0	Inf	100.0%
Benchmark	COE Org Benchmarking Survey COEB2012-2016	1	1	0	Inf	100.0%
Benchmark	Enrollment Strategy Gap Analysis	4	4	0	Inf	100.0%
Benchmarking Walkthrough	Benchmarking Walkthrough	2	2	0	Inf	100.0%
Benchmarking Walkthrough	Enrollment Strategy Gap Analysis	1	1	0	Inf	100.0%
Collaborative	2019-2020 Facilities Leadership Development Fellowship	2	2	0	Inf	100.0%
Collaborative	AAF Experiential Major Maps Collaborative: Overview and Implementation Process	1	1	0	Inf	100.0%
Collaborative	Financial Sustainability Collaborative	13	13	0	Inf	100.0%
Collaborative	How to Mitigate the Impact of Controversial Campus Events	1	1	0	Inf	100.0%
COVID Working Group Session	AAF COVID-19 Working Group Session - Provosts: Impact on Academy	6	6	0	Inf	100.0%
COVID Working Group Session	AF COVID-19 Working Group - Rethinking the Work of Major Gift Officers	1	1	0	Inf	100.0%
COVID Working Group Session	BAF COVID-19 Working Group - How are Finance and Admin Leaders Responding	1	1	0	Inf	100.0%
COVID Working Group Session	BIPOC Faculty Recruitment Working Groups for Chief Academic Officers: Designing Academic Hiring Stra,	1	1	0	Inf	100.0%
COVID Working Group Session	EMF COVID-19 Working Group - Mitigating the Enrollment Impacts of COVID-19	2	2	0	Inf	100.0%
COVID Working Group Session	FF COVID-19 Research Interactions	2	2	0	Inf	100.0%
COVID Working Group Session	FF COVID-19 Working Group - COVID Response for Facilities Leaders	1	1	0	Inf	100.0%
COVID Working Group Session	GRP COVID-19 Working Group - Small Private Institutions	5	5	0	Inf	100.0%
COVID Working Group Session	How to Save Your MBA: Working Session to Understand the Changing MBA Landscape and How to Adapt,	1	1	0	Inf	100.0%
COVID Working Group Session	PAE COVID-19 Working Group - Responding to Impact on Marketing and Recruitment	2	2	0	Inf	100.0%
COVID Working Group Session	PAE COVID-19 Working Group - Supporting Transition to Remote Instruction	1	1	0	Inf	100.0%
COVID Working Group Session	Summer 2020 ITF COVID Research	1	1	0	Inf	100.0%
Diagnostic or Audit	Academic Affairs Organizational Benchmarking Survey	1	1	0	Inf	100.0%
Diagnostic or Audit	Advancement Investment and Performance Initiative FY2019	4	4	0	Inf	100.0%
Diagnostic or Audit	Advancement Investment and Performance Initiative FY2020	16	15	1	15.0	93.8%
Diagnostic or Audit	Advancement Website Optimization Audit	10	8	2	4.0	80.0%
Diagnostic or Audit	Career Services Web Audit (AAF)	7	6	1	6.0	85.7%
Diagnostic or Audit	Career Services Web Audit (SAF)	2	2	0	Inf	100.0%
Diagnostic or Audit	COE Org Benchmarking Survey COEB2012-2016	1	1	0	Inf	100.0%
Diagnostic or Audit	Diagnostic or Audit	8	5	3	1.7	62.5%
Diagnostic or Audit	Enrollment Strategy Gap Analysis	7	7	0	Inf	100.0%
Diagnostic or Audit	Orientation Web Audit (SAF)	2	2	0	Inf	100.0%
Diagnostic or Audit	User Experience Audit (GRP)	3	3	0	Inf	100.0%
Evergreen Action	Evergreen Action	1	1	0	Inf	100.0%
Executive Update	Executive Update	40	30	11	2.7	75.0%
Expert Center	Expert Center	86	64	26	2.5	74.4%
Expert Center	Expert Center Call	19	15	4	3.8	78.9%
Expert Center	Financial Sustainability Collaborative	3	3	0	Inf	100.0%
Market Research	NA	60	43	18	2.4	71.7%
National Meeting	2018-2019 Academic Affairs Forum National Meetings, Washington, DC	1	1	0	Inf	100.0%
National Meeting	2018-2019 Advancement Forum National Meeting, Washington, DC	1	1	0	Inf	100.0%
National Meeting	2019-2020 Advancement Forum National Meeting, Washington, DC	4	4	0	Inf	100.0%
National Meeting	2019-2020 Enrollment Management Forum National Meeting,	3	3	0	Inf	100.0%
National Meeting	2019-2020 Enrollment Management Forum National Meeting, Washington, DC	1	1	0	Inf	100.0%
National Meeting	2019-2020 IT Forum National Meeting Series,	1	1	0	Inf	100.0%
National Meeting	2019-2020 IT Forum National Meeting Series, Los Angeles, CA	1	1	0	Inf	100.0%
National Meeting	2019-2020 IT Forum National Meeting Series, Washington, DC	1	1	0	Inf	100.0%
National Meeting	2019 COE Forum Executive Summit, Washington, DC	2	2	0	Inf	100.0%
National Meeting	2019 Strategy Forum National Meeting, Washington, DC	1	1	0	Inf	100.0%
National Meeting	2019 Student Affairs Forum National Meeting, Santa Monica, CA	1	1	0	Inf	100.0%
National Meeting	2019 Student Affairs Forum National Meeting, Washington, DC	2	2	0	Inf	100.0%
National Meeting	2020-2021 Advancement Forum National Meeting,	10	10	0	Inf	100.0%
National Meeting	2020 Academic Affairs Forum National Meeting,	3	3	0	Inf	100.0%
National Meeting	2020 Academic Affairs Forum National Meeting, Dana Point, CA	2	2	0	Inf	100.0%
National Meeting	2020 Academic Affairs Forum National Meeting, Washington, DC	1	1	0	Inf	100.0%
National Meeting	2020 Business Affairs Forum National Meeting,	1	1	0	Inf	100.0%
National Meeting	2020 Business Affairs Forum National Meeting, Washington, DC	1	1	0	Inf	100.0%
National Meeting	2020 Chief of Staff Leadership Virtual Series,	2	2	0	Inf	100.0%
National Meeting	2020 Facilities Forum National Meeting,	1	1	0	Inf	100.0%
National Meeting	2020 HESF Series,	5	5	0	Inf	100.0%
National Meeting	2020 HESF Series, San Jose, CA	1	1	0	Inf	100.0%
National Meeting	2020 New Presidents Virtual Intensive,	1	1	0	Inf	100.0%
National Meeting	2020 New Provosts Virtual Intensive,	1	1	0	Inf	100.0%
National Meeting	2020 Professional & Adult Education Forum National Meeting Series,	6	6	0	Inf	100.0%
National Meeting	2021 Presidential Experience Lab: Disruption in Our Midst,	1	1	0	Inf	100.0%
National Meeting	2021 Presidential Experience Lab: The Future of Work Post-Pandemic and Implications for Higher Ed,	5	5	0	Inf	100.0%
National Meeting	Academic Cost Containment: Ensuring Financial Sustainability in the Wake of COVID-19,	5	5	0	Inf	100.0%
National Meeting	AF Pop-Ups,	1	1	0	Inf	100.0%
National Meeting	Aligning Administrative Office Space with Hybrid Workplaces,	2	1	1	1.0	50.0%
National Meeting	Breaking the 3 Constraints on Fundraising Growth: A Data-Driven Playbook for Peak Performance,	3	2	1	2.0	66.7%
National Meeting	Breaking the Stalemate: How Institutions Are Overcoming Entrenched Org Structures and Outdated Advis,	1	0	1	0.0	0.0%
National Meeting	Business Model Transformation Roundtable,	9	8	1	8.0	88.9%
National Meeting	Campus Repopulation: Lessons from the Fall, Planning for the Spring,	1	1	0	Inf	100.0%
National Meeting	Career Services Virtual Working Session: Supporting Career Needs Through and Beyond COVID-19,	3	3	0	Inf	100.0%
National Meeting	Cultivate an International Partnership Portfolio,	2	2	0	Inf	100.0%
National Meeting	Designing Programs for the Adult Degree Completer,	1	1	0	Inf	100.0%
National Meeting	EAB’s Rising Higher Education Leaders Fellowship | Kickoff Meeting,	1	1	0	Inf	100.0%
National Meeting	EAB’s Rising Higher Education Leaders Fellowship | Professional Development: Change Management,	1	1	0	Inf	100.0%
National Meeting	EAB’s Rising Higher Education Leaders Fellowship | Professional Development: Communication and Prese,	1	1	0	Inf	100.0%
National Meeting	EAB’s Rising Higher Education Leaders Fellowship | Professional Development: Unconscious Bias,	1	1	0	Inf	100.0%
National Meeting	EAB’s Rising Higher Education Leaders Fellowship | Subject-Matter Expertise by Functional Area: Budg,	1	1	0	Inf	100.0%
National Meeting	EAB’s Rising Higher Education Leaders Fellowship | Subject-Matter Expertise by Functional Area: Stud,	1	1	0	Inf	100.0%
National Meeting	EAB’s Rising Higher Education Leaders Fellowship | Subject-Matter Expertise for Academic Affairs: Ac,	1	1	0	Inf	100.0%
National Meeting	EAB’s Rising Higher Education Leaders Fellowship | Subject-Matter Expertise for all: Funding the Fut,	1	1	0	Inf	100.0%
National Meeting	EAB’s Rising Higher Education Leaders Fellowship | Subject-Matter Expertise for Business Affairs: Ad,	1	1	0	Inf	100.0%
National Meeting	EAB’s Rising Higher Education Leaders Fellowship: Kickoff Meeting,	3	3	0	Inf	100.0%
National Meeting	Emerging Trends in Advancement Performance: Analysis and Discussion of Regional Privates Fundraising,	2	2	0	Inf	100.0%
National Meeting	Emerging Trends in Advancement Performance: Analysis and Discussion of Regional Publics Fundraising,,	1	1	0	Inf	100.0%
National Meeting	Emerging Trends in Advancement Performance: Reviewing FY2021 to Plan for FY2022,	3	3	0	Inf	100.0%
National Meeting	EMF Executive Pop-ups,	1	1	0	Inf	100.0%
National Meeting	EMF Working Session: Fall Admissions Planning,	4	4	0	Inf	100.0%
National Meeting	Empower Faculty and Unit Leaders to Make Smarter Partnership Decisions,	2	2	0	Inf	100.0%
National Meeting	Engaging Faculty in Addressing the New Financial Reality,	1	1	0	Inf	100.0%
National Meeting	Enrolling and Serving the Students of the Pandemic: What Higher Ed Leaders Need to Know About Tomorr,	4	4	0	Inf	100.0%
National Meeting	ET - Virtual - SAF,	2	2	0	Inf	100.0%
National Meeting	Evaluating Your Team,	1	1	0	Inf	100.0%
National Meeting	Fall 2021 Symposium: Cultivating a Sense of Ownership Among Mid-Level Donors,	1	0	1	0.0	0.0%
National Meeting	Financial Sustainability Collaborative | Assessing Academic Programs,	1	1	0	Inf	100.0%
National Meeting	Financial Sustainability Collaborative | Improving Retention and Persistence,	1	1	0	Inf	100.0%
National Meeting	Financial Sustainability Collaborative | Kickoff,	2	2	0	Inf	100.0%
National Meeting	Financial Sustainability Collaborative | Realizing Academic Efficiencies,	2	2	0	Inf	100.0%
National Meeting	Financial Sustainability Collaborative,	5	5	0	Inf	100.0%
National Meeting	Financial Sustainability Collaborative: Assessing Academic Programs,	11	9	2	4.5	81.8%
National Meeting	Financial Sustainability Collaborative: Collaborative Kick-Off,	2	2	0	Inf	100.0%
National Meeting	Financial Sustainability Collaborative: Developing New Programs to Reach New Students,	9	6	3	2.0	66.7%
National Meeting	Financial Sustainability Collaborative: Improving Retention and Persistence,	9	6	3	2.0	66.7%
National Meeting	Financial Sustainability Collaborative: Prioritizing Academic Programs,	1	1	0	Inf	100.0%
National Meeting	Financial Sustainability Collaborative: Realizing Academic Efficiencies,	10	8	2	4.0	80.0%
National Meeting	HESF GRP Executive Pop-Up,	4	4	0	Inf	100.0%
National Meeting	HESF Working Sessions,	1	1	0	Inf	100.0%
National Meeting	Higher Education’s DEIJ Moment,	1	1	0	Inf	100.0%
National Meeting	How Higher Education Can Keep Pace with Growing Sustainability Aspirations: Lessons on Building a Be,	5	5	0	Inf	100.0%
National Meeting	Identify New Partnership Opportunities and Expansions,	1	1	0	Inf	100.0%
National Meeting	ITF Fall Term Troubleshooting Sessions: Learn How CIOs are Navigating Fall Term during COVID-19,	2	2	0	Inf	100.0%
National Meeting	Joint Virtual Working Session EMF and SAF: Crafting a Compelling Virtual Orientation,	4	4	0	Inf	100.0%
National Meeting	Looking Back at the Fall and Looking Ahead to the Future,	1	1	0	Inf	100.0%
National Meeting	Managing Across and Up in a Rapidly Evolving Enrollment Landscape,	1	1	0	Inf	100.0%
National Meeting	Managing the Enrollment Budget,	1	1	0	Inf	100.0%
National Meeting	Meeting Advancement’s DEIJ Moment,	4	3	1	3.0	75.0%
National Meeting	Microcredentials: Higher Ed’s Path Forward or False Promise?,	1	1	0	Inf	100.0%
National Meeting	More Than Financial Resources: Strategic Opportunities and Threats Presented by the American Rescue ,	9	9	0	Inf	100.0%
National Meeting	New Enrollment Leaders Intensive Reunion 1,	1	1	0	Inf	100.0%
National Meeting	New Presidents Intensive,	1	1	0	Inf	100.0%
National Meeting	New Provosts Intensive,	1	1	0	Inf	100.0%
National Meeting	PAE Virtual Working Group: Program Development to Aid the Pandemic Economic Recovery,	1	1	0	Inf	100.0%
National Meeting	Re-imagining Finance and Operations Strategy: A Virtual Working Group for CBOs,	6	6	0	Inf	100.0%
National Meeting	Re-sizing the Adult Degree Completion Market: A Roundtable for Professional and Adult Education Lead,	7	7	0	Inf	100.0%
National Meeting	Reconciling Mission and Margin, Washington, DC	1	0	1	0.0	0.0%
National Meeting	Reimagining Major Gift Strategy for a New Era: Innovations in Prospect Development,	2	1	1	1.0	50.0%
National Meeting	Research Advisory Council,	4	2	2	1.0	50.0%
National Meeting	Returning to the Office: A Discussion for Advancement Leaders on Post-Pandemic Work Arrangements,	2	2	0	Inf	100.0%
National Meeting	Sizing the Short- and Long-Term Consequences of the Covid-19 Pandemic on International Undergraduate,	1	0	1	0.0	0.0%
National Meeting	State of the Union: Imperatives for the Post-Vaccination Institution for Presidents,	2	2	0	Inf	100.0%
National Meeting	State of the Union: Imperatives for the Post-Vaccination Institution for Provosts,	3	3	0	Inf	100.0%
National Meeting	Supporting Student Mental Health and Wellness in Spring 2021: A Facilitated Conversation with EAB,	1	1	0	Inf	100.0%
National Meeting	The Changing Landscape of Higher Education Post-COVID,	3	2	1	2.0	66.7%
National Meeting	The Future of Undergrad Enrollment for Private Institutions,	2	2	0	Inf	100.0%
National Meeting	The Future of Undergrad Enrollment,	3	3	0	Inf	100.0%
National Meeting	The New Landscape for Master’s Degree Competition: The Future of Growth and Countercyclical Trends,	1	1	0	Inf	100.0%
National Meeting	The New World of Enrollment Communications,	1	1	0	Inf	100.0%
National Meeting	Unpacking the Responsibility and Opportunities for Economic Justice Initiatives in Higher Education,	3	3	0	Inf	100.0%
National Meeting	Untethering the Administrative Workforce: Strategies to Support Remote Operations Now and Post-Pande,	1	1	0	Inf	100.0%
National Meeting	Virtual Working Session AAF: Provost Roundtable on COVID19: Addressing the near and long term impact,	7	7	0	Inf	100.0%
National Meeting	Virtual Working Session AF: The Next Phase of COVID19 Response: What Advancement Leaders are Focusin,	1	1	0	Inf	100.0%
National Meeting	Virtual Working Session BAF: How are Finance and Admin Leaders are Responding to COVID19,	1	1	0	Inf	100.0%
National Meeting	Virtual Working Session BAF: Workforce Planning During COVID-19: A Virtual Working Group for Senior,	2	2	0	Inf	100.0%
National Meeting	Virtual Working Session EMF: Mitigating the Enrollment Impacts of COVID19,	3	3	0	Inf	100.0%
National Meeting	Virtual Working Session FF: COVID Response for Facilities Leaders,	2	2	0	Inf	100.0%
National Meeting	Virtual Working Session GRP: Regional Public Institutions,	3	2	1	2.0	66.7%
National Meeting	Virtual Working Session GRP: Small Private Institutions,	2	2	0	Inf	100.0%
National Meeting	Virtual Working Session HESF: Responding to COVID19: Organizational Resiliency,	2	2	0	Inf	100.0%
National Meeting	Virtual Working Session ITF: Responding to COVID19: IT Leaders Virtual Roundtable,	1	1	0	Inf	100.0%
National Meeting	Virtual Working Session Joint AAF, SAF, GRP: Support Student Persistence Despite COVID-related Disru,	2	2	0	Inf	100.0%
National Meeting	Virtual Working Session PAE: Program Development and Planning During COVID19,	3	3	0	Inf	100.0%
National Meeting	Virtual Working Session PAE: Responding to COVID19’s Impact on Marketing and Recruitement,	2	2	0	Inf	100.0%
National Meeting	Virtual Working Session PAE: Supporting Transition to Remote Instruction,	1	1	0	Inf	100.0%
National Meeting	Why Don’t Graduate Certificate Programs Take Off? Sizing Risks and Opportunities,	1	1	0	Inf	100.0%
Onsite	Onsite | AAF | 02/20/2019	1	1	0	Inf	100.0%
Onsite	Onsite | AAF | 05/10/2019	1	0	1	0.0	0.0%
Onsite	Onsite | COE | Presentation Date: 06/27/2019	1	1	0	Inf	100.0%
Onsite	Onsite | COE | Presentation Date: 07/16/2019	1	1	0	Inf	100.0%
Onsite	Onsite | GRP | 04/05/2019	1	0	1	0.0	0.0%
Onsite	Onsite | GRP | 05/06/2019	1	1	0	Inf	100.0%
Onsite	Onsite | GRP | 09/03/2019	1	1	0	Inf	100.0%
Onsite	Onsite | GRP | 09/05/2019	1	1	0	Inf	100.0%
Onsite	Onsite | GRP | 09/17/2019	1	1	0	Inf	100.0%
Onsite	Onsite | GRP | Customized Presentation| Date of Presentation: 7/29/21	1	1	0	Inf	100.0%
Onsite	Onsite | HESF | 10/17/2019	1	1	0	Inf	100.0%
Onsite	Onsite| Custom Presentation | Presentation Date:6/4/2020	1	1	0	Inf	100.0%
Onsite	Partner Intensive | GRP | Resilience Leadership Workshop	1	1	0	Inf	100.0%
Onsite	Partner Intensive | GRP | State of the Union: Imperatives for the Post-Vaccine Institution	1	1	0	Inf	100.0%
Onsite	NA	5	4	1	4.0	80.0%
Research Initial	2019 BAF Blue Sky Administration	1	1	0	Inf	100.0%
Research Initial	2019 Future of Learning	1	1	0	Inf	100.0%
Research Initial	2019 IT Org Design	2	2	0	Inf	100.0%
Research Initial	2020-21 DEI Study	1	1	0	Inf	100.0%
Research Initial	2020 Advancement Health Index Study	1	1	0	Inf	100.0%
Research Initial	BIPOC Faculty Recruitment	1	1	0	Inf	100.0%
Research Initial	BIPOC Faculty Retention	1	0	1	0.0	0.0%
Research Initial	Blueprint for Growth	2	2	0	Inf	100.0%
Research Initial	Columbia College Chicago Nonfiction	1	1	0	Inf	100.0%
Research Initial	Competitor Profiles for Master’s-Level Applied Science Programs	1	1	0	Inf	100.0%
Research Initial	Critical Conversation: Coordinating Cross-Campus Response to Flashpoints	1	1	0	Inf	100.0%
Research Initial	Future of the Hybrid Campus	2	2	0	Inf	100.0%
Research Initial	Hallmarks of an Antiracist Institution	2	2	0	Inf	100.0%
Research Initial	Industry Futures 2021	1	0	1	0.0	0.0%
Research Initial	Market Viability of Graduate-Level English Teaching Programs	1	1	0	Inf	100.0%
Research Initial	PAE 2020 National Meeting Series	1	1	0	Inf	100.0%
Research Initial	Radical Business Models Discovery Research	3	3	0	Inf	100.0%
Research Initial	Remote Work Sprint	1	0	1	0.0	0.0%
Research Initial	Student Debt Crisis	3	3	0	Inf	100.0%
Research SL Impact	Research SL Impact - APR/Diagonstic Call with Jennifer Pearce	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Call	4	4	0	Inf	100.0%
Research SL Impact	Research SL Impact - Call - SL impact	1	0	1	0.0	0.0%
Research SL Impact	Research SL Impact - Call with Erica Fichter	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Campus Visit	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Campus Visit/Welcome Orientation	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Capilano	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Chadron State Welcome Call	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Check in Call with Bellarmine	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Check in/ Climate Survey	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Customized EMF Working Group Attendance	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - EMF Custom Round Table Attendance	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Equity Discussion	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Expert Call	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Expert Center Call with Shari Schwartz and Carolina Nutt	1	0	1	0.0	0.0%
Research SL Impact	Research SL Impact - Fall Planning Discussion	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Financial Sustainability Collaborative Discussion	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Follow-Up Student Success Call	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - GRP Bi-Monthly Call	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - GRP Check-in	4	2	2	1.0	50.0%
Research SL Impact	Research SL Impact - In-Person Visit	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - In-Person Visit with Rodney Trapp	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - In Person Visit-Research SL Impact-Arrick Jackson	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - In Person Visit-Research SL Impact-Bonnie Johnson	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - In Person Visit-Research SL Impact-Dawn Remmers	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - In Person Visit-Research SL Impact-Leslie Krueger	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - In Person Visit-Research SL Impact-Raaj Kurapati	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - In Person Visit-Research SL Impact-Randy Smith	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - In Person Visit-Research SL Impact-Rob Hornberger	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - In Person Visit-Research SL Impact-Thomas Morrison	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - In Person Visit-SME-Paul Dangerfield	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - INT Coppin FSE FU call	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - INT CSC VPA call	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - INT PA President Rames	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - INT UNK GRP SOF call	1	0	1	0.0	0.0%
Research SL Impact	Research SL Impact - Lunch	1	0	1	0.0	0.0%
Research SL Impact	Research SL Impact - Meeting	2	2	0	Inf	100.0%
Research SL Impact	Research SL Impact - MI Call	1	0	1	0.0	0.0%
Research SL Impact	Research SL Impact - Networking	1	0	1	0.0	0.0%
Research SL Impact	Research SL Impact - NMT AAF Intro Call and Research Discussion	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - On Campus Meeting with Tanya Baskin	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - PAE Roundtable Debrief	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Procurement Process Scoping Session	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Research SL Impact Check-in with Onie Mackenzie	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Second Exec Roundtable Topic	2	1	1	1.0	50.0%
Research SL Impact	Research SL Impact - SF GRP MI Scoping	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - SF MN State System SL impact	1	0	1	0.0	0.0%
Research SL Impact	Research SL Impact - SF MTech new CBO call	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - SF WSC retreat discussion	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Student Journey Mapping	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Student Success Call	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Success Plan Review	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - UNK AF MR tracking	1	0	1	0.0	0.0%
Research SL Impact	Research SL Impact - VIP Day visit	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact - Winthrop University - GRP - Toolkit Walkthrough and Check-in	1	1	0	Inf	100.0%
Research SL Impact	Research SL Impact Visit	11	9	2	4.5	81.8%
Scoping	2020 Scoping	1	1	0	Inf	100.0%
Scoping	Academic Cost Cutting	1	1	0	Inf	100.0%
Scoping	AF Scoping-Summer 2021	1	1	0	Inf	100.0%
Scoping	Blueprint for Growth	1	0	1	0.0	0.0%
Scoping	Econ Recovery and Development, Discovery Project	1	1	0	Inf	100.0%
Scoping	ITF 2021 Topic Scoping Conversations	1	1	0	Inf	100.0%
Scoping	Radical Business Models Discovery Research	1	0	1	0.0	0.0%
Survey Walkthrough	Academic Affairs Organizational Benchmarking Survey	12	10	2	5.0	83.3%
Tool’s Walkthrough	Tool’s Walk Through	15	11	4	2.8	73.3%
VIP Day	VIP Day	1	1	0	Inf	100.0%
Web & Moble Audit	2 Program Webpages	1	0	1	0.0	0.0%
Web & Moble Audit	3 Pages	1	1	0	Inf	100.0%
Web & Moble Audit	Social Work and History Web Audits	1	1	0	Inf	100.0%
Web & Moble Audit	Web and Mobile Audit	1	1	0	Inf	100.0%
Web & Moble Audit	Web/Mobile Presence Audit	1	1	0	Inf	100.0%
Webinar	Partner Intensive | EDSF | Resilience Leadership Workshop| Date of Presentation: 7/27/21	1	1	0	Inf	100.0%
Webinar	Partner Intensive | EMF | Toward an Effective Aid Strategy	1	0	1	0.0	0.0%
Webinar	Partner Intensive | GRP | BIPOC Faculty Recruitment	1	0	1	0.0	0.0%
Webinar	Partner Intensive | GRP | Customized Presentation	1	0	1	0.0	0.0%
Webinar	Partner Intensive | GRP | Customized Presentation | Presentation Date: 08/25/21	1	0	1	0.0	0.0%
Webinar	Partner Intensive | GRP | Customized Presentation| Date of Presentation: 9/20/21	1	1	0	Inf	100.0%
Webinar	Partner Intensive | GRP | Future Visioning | Presentation Date: 11/1/21	1	1	0	Inf	100.0%
Webinar	Partner Intensive | GRP | Modern Student Experience	1	0	1	0.0	0.0%
Webinar	Partner Intensive | GRP | Resilience Leadership Workshop	1	0	1	0.0	0.0%
Webinar	Partner Intensive | GRP | Winning the Future of Undergrad Enrollment	1	0	1	0.0	0.0%
Webinar	Partner Intensive | SAS | How Well Do you Measure Up on “Return on Experience?”	1	1	0	Inf	100.0%
Webinar	PLW | GRP | 05/15/2019	1	0	1	0.0	0.0%
Webinar	PLW | GRP | 08/15/19	1	1	0	Inf	100.0%
Webinar	PLW | GRP | Presentation date: 12/11/2018	1	1	0	Inf	100.0%
Webinar	PLW: *Customized Presentation - PAE - 3/27/2020	1	1	0	Inf	100.0%
Webinar	PLW: Employer Partnerships in the Post-Recession Era - PAE - 4/9/2020	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Blueprint for Growth	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | AAF | Defining the Faculty Role in Student Success	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | AAF | Future Visioning (Part 1) | Presentation Date: 11/23/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | AAF | Future Visioning (Part 2) | Presentation Date: 12/21/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | AAF | Program Design Workshop | Presentation Date: 01/25/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | AF | Advancement Org Model Review | 2/23/21	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | AF | The Impact of COVID-19 on Advancement	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | COVID -19 Scenario Planning - GRP | Presentation Date: 6/10/2020	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Aligning Departmental Level Performance Metrics with Institutional Strategy | Presentation Date: 02/26/21	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Academic Vital Signs | Presentation Date 03/03/21	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Academic Vital Signs | Presentation Date: 03/09/21	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Achieving Guided Pathways With Student-Centered Design	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Blueprint for Growth	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Blueprint for Growth | Presentation Date: 03/24/21	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Career Development Workshop | Presentation date: 8/27/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Creating a Culture of Well Being through Faculty and Staff Student Support	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Creating a Shared Understanding of Institutional Racism	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Crisis Thinking Workshop | Presentation date: 8/6/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Customized Presentation	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Customized Presentation | 6/3/21	1	0	1	0.0	0.0%
Webinar	Virtual Meeting | GRP | Customized Presentation: Presentation Date: 03/05/21	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Future Visioning | Presentation Date: 03/23/21	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Future Visioning | Presentation Date: 04/28/21	1	0	1	0.0	0.0%
Webinar	Virtual Meeting | GRP | Future Visioning | Presentation Date: 11/23/2020	1	0	1	0.0	0.0%
Webinar	Virtual Meeting | GRP | Future Visioning | Presentation date: 9/2/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Future Visioning Session | Presentation date: 8/18/20	1	0	1	0.0	0.0%
Webinar	Virtual Meeting | GRP | HARI and Creating a Shared Understanding of Institutional Racism Customized Session with UNTHSC	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Initiative Prioritization Workshop | Presentation Date: 05/20/21	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Integrating Academic and Career Development | Presentation Date: 04/22/21	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Professional Development Playbook| 11/6	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Program Innovation Workshop | Presentation Date: 04/20/21	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Realizing the Promise of Process Improvement	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Rightsizing the Program Portfolio | Presentation date: 10/27/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | State of the Union (Updated for Covid-19) | Presentation date: 10/21/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | State of the Union: Preparing for the Volatile Decade Ahead | Presentation Date: 02/05/21	1	0	1	0.0	0.0%
Webinar	Virtual Meeting | GRP | State of the Union: Preparing for the Volatile Decade Ahead | Presentation Date: 03/19/21	1	0	1	0.0	0.0%
Webinar	Virtual Meeting | GRP | State of the Union: Preparing for the Volatile Decade Ahead | Presentation Date: 10/01/2020	1	0	1	0.0	0.0%
Webinar	Virtual Meeting | GRP | Strategic Planning | Presentation Date: 11/6/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | Student Enrollment Experience | Presentation Date: 12/03/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | GRP | The New Science of Enrollment| Date of Presentation: 7/07/21	1	0	1	0.0	0.0%
Webinar	Virtual Meeting | HESF | Future Visioning | Presentation Date: 02/03/21	1	0	1	0.0	0.0%
Webinar	Virtual Meeting | HESF | Future Visioning | Presentation Date: 12/08/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | HESF | Future Visioning | Presentation date: 8/4/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | HESF | Market-Responsive Strategy Pivot | Presentation Date: 11/04/2020	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | HESF | Preparing for the 2020 Election | Presentation Date: 10/28/2020	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | HESF | State of the Sector: Forecasting the Impact of Covid-19 | Presentation Date: 10/07/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | HESF | State of the Sector: Forecasting the Impact of Covid-19 | Presentation Date: 11/2/20	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | ITF | Building a Digital University | 2/4/21	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | ITF | Data Governance at Tech Steering Committee | 2/1/21	1	1	0	Inf	100.0%
Webinar	Virtual Meeting | PAE | Certificates Innovation Workshop	1	1	0	Inf	100.0%
Webinar	VIRTUAL MEETING | PAE | Org Workshop| TBD	1	1	0	Inf	100.0%
Webinar	Virtual Meetings | PAE | Blueprint for Growth | 2/10/21	1	1	0	Inf	100.0%
Webinar	Vitual Presentation: “Custom Presentation* - on Differential Tuition Strategies” - GRP (Public) - 7/18/2020	1	1	0	Inf	100.0%
Webinar	NA	4	3	1	3.0	75.0%
NA	NA	2	0	2	0.0	0.0%

Event Grouping and Forum Content

1. We see a smattering of consumption across programs.
2. AF and GRP are the heaviest in the distribution, and towards the lower end of the renewal spectrum.
3. PAE, ITF, EMF all show very high renewal ratios.

Renewal Ratio by Event Program

EventProgram	N	ATL	Dropped	Ratio	Perc_Renewed
AF	43	38	6	6.3	88.4%
BAF	3	3	0	Inf	100.0%
EMF	22	21	1	21.0	95.5%
FF	20	18	2	9.0	90.0%
GRP	48	35	14	2.5	72.9%
HESF	13	12	1	12.0	92.3%
ITF	9	9	0	Inf	100.0%
PAE	18	18	0	Inf	100.0%
NA	93	69	32	2.2	74.2%

Accounts & Forum Content

Renewal Ratio by Service Consumption

AccountFormalName	EventProgram	N	ATL	Dropped	Ratio	Perc_Renewed
Albertus Magnus College	NA	17	1	0	Inf	100.0%
Ashland University	GRP	2	0	1	0.0	0.0%
Ashland University	NA	13	0	1	0.0	0.0%
Assumption University	NA	2	1	0	Inf	100.0%
Athens State University	EMF	1	1	0	Inf	100.0%
Athens State University	GRP	1	1	0	Inf	100.0%
Athens State University	NA	13	1	0	Inf	100.0%
Augustana College	GRP	1	1	0	Inf	100.0%
Augustana College	NA	10	1	0	Inf	100.0%
Averett University	NA	15	1	0	Inf	100.0%
Bellarmine University	AF	3	1	0	Inf	100.0%
Bellarmine University	EMF	4	1	0	Inf	100.0%
Bellarmine University	GRP	2	1	0	Inf	100.0%
Bellarmine University	PAE	2	1	0	Inf	100.0%
Bellarmine University	NA	12	1	0	Inf	100.0%
Bemidji State University	AF	1	1	0	Inf	100.0%
Bemidji State University	EMF	1	1	0	Inf	100.0%
Bemidji State University	GRP	1	1	0	Inf	100.0%
Bemidji State University	ITF	1	1	0	Inf	100.0%
Bemidji State University	NA	30	1	0	Inf	100.0%
Benedictine College	AF	5	1	0	Inf	100.0%
Benedictine College	GRP	1	1	0	Inf	100.0%
Benedictine College	NA	7	1	0	Inf	100.0%
Biola University	AF	8	1	0	Inf	100.0%
Biola University	BAF	4	1	0	Inf	100.0%
Biola University	EMF	1	1	0	Inf	100.0%
Biola University	FF	1	1	0	Inf	100.0%
Biola University	GRP	2	1	0	Inf	100.0%
Biola University	ITF	1	1	0	Inf	100.0%
Biola University	PAE	2	1	0	Inf	100.0%
Biola University	NA	29	1	0	Inf	100.0%
Bob Jones University	GRP	2	0	1	0.0	0.0%
Bryan College	AF	1	0	1	0.0	0.0%
Bryan College	GRP	1	0	1	0.0	0.0%
Bryan College	NA	9	0	1	0.0	0.0%
Capilano University	HESF	3	1	0	Inf	100.0%
Capilano University	ITF	2	1	0	Inf	100.0%
Capilano University	NA	21	1	0	Inf	100.0%
Centre College	AF	5	1	0	Inf	100.0%
Centre College	EMF	1	1	0	Inf	100.0%
Centre College	GRP	1	1	0	Inf	100.0%
Centre College	HESF	3	1	0	Inf	100.0%
Centre College	NA	25	1	0	Inf	100.0%
Chadron State College	HESF	1	1	0	Inf	100.0%
Chadron State College	PAE	1	1	0	Inf	100.0%
Chadron State College	NA	15	1	1	1.0	100.0%
Clarke University	NA	12	0	1	0.0	0.0%
College of Our Lady of the Elms	AF	1	1	0	Inf	100.0%
College of Our Lady of the Elms	EMF	1	1	0	Inf	100.0%
College of Our Lady of the Elms	NA	14	1	0	Inf	100.0%
Columbia College	NA	7	0	1	0.0	0.0%
Concordia University - St. Paul	GRP	3	1	0	Inf	100.0%
Concordia University - St. Paul	NA	6	1	0	Inf	100.0%
Converse University	NA	12	1	0	Inf	100.0%
Coppin State University	NA	10	1	0	Inf	100.0%
Corban University	AF	2	1	0	Inf	100.0%
Corban University	EMF	3	1	0	Inf	100.0%
Corban University	FF	3	1	0	Inf	100.0%
Corban University	GRP	1	1	0	Inf	100.0%
Corban University	PAE	1	1	0	Inf	100.0%
Corban University	NA	28	1	0	Inf	100.0%
Dallas Baptist University	AF	1	1	0	Inf	100.0%
Dallas Baptist University	FF	3	1	0	Inf	100.0%
Dallas Baptist University	HESF	1	1	0	Inf	100.0%
Dallas Baptist University	NA	22	1	0	Inf	100.0%
Dickinson State University	NA	5	0	1	0.0	0.0%
Eastern Mennonite University	NA	18	1	0	Inf	100.0%
Eastern Oregon University	NA	30	0	1	0.0	0.0%
Edward Waters University	AF	1	0	1	0.0	0.0%
Edward Waters University	NA	15	0	1	0.0	0.0%
Emory & Henry College	GRP	1	1	0	Inf	100.0%
Emory & Henry College	NA	9	1	0	Inf	100.0%
Fielding Graduate University	GRP	1	1	0	Inf	100.0%
Fielding Graduate University	HESF	1	1	0	Inf	100.0%
Fielding Graduate University	PAE	2	1	0	Inf	100.0%
Fielding Graduate University	NA	6	1	0	Inf	100.0%
Fisk University	NA	11	1	1	1.0	100.0%
Fitchburg State University	AF	9	1	0	Inf	100.0%
Fitchburg State University	EMF	3	1	0	Inf	100.0%
Fitchburg State University	GRP	3	1	0	Inf	100.0%
Fitchburg State University	ITF	1	1	0	Inf	100.0%
Fitchburg State University	PAE	3	1	0	Inf	100.0%
Fitchburg State University	NA	21	1	0	Inf	100.0%
Florida Southern College	NA	9	0	1	0.0	0.0%
Fresno Pacific University	NA	12	0	1	0.0	0.0%
Gallaudet University	GRP	2	1	0	Inf	100.0%
Gallaudet University	NA	9	1	0	Inf	100.0%
Gordon-Conwell Theological Seminary	AF	1	1	0	Inf	100.0%
Gordon-Conwell Theological Seminary	NA	5	1	0	Inf	100.0%
Gordon State College	GRP	1	1	0	Inf	100.0%
Gordon State College	NA	10	1	0	Inf	100.0%
Grace College	GRP	1	0	1	0.0	0.0%
Grace College	NA	15	1	1	1.0	100.0%
Greensboro College	AF	1	1	0	Inf	100.0%
Greensboro College	EMF	1	1	0	Inf	100.0%
Greensboro College	NA	6	1	0	Inf	100.0%
Hardin-Simmons University	NA	3	1	0	Inf	100.0%
Harrisburg University of Science and Technology	AF	2	1	0	Inf	100.0%
Harrisburg University of Science and Technology	NA	9	1	0	Inf	100.0%
Hastings College	GRP	1	0	1	0.0	0.0%
Hastings College	NA	9	0	1	0.0	0.0%
Hawai’i Pacific University	AF	6	1	0	Inf	100.0%
Hawai’i Pacific University	EMF	1	1	0	Inf	100.0%
Hawai’i Pacific University	FF	4	1	0	Inf	100.0%
Hawai’i Pacific University	NA	14	1	0	Inf	100.0%
Hilbert College	AF	2	1	0	Inf	100.0%
Hilbert College	GRP	2	1	0	Inf	100.0%
Hilbert College	NA	10	1	0	Inf	100.0%
Houston Baptist University	GRP	1	0	1	0.0	0.0%
Houston Baptist University	NA	20	0	1	0.0	0.0%
Iona College	AF	6	1	0	Inf	100.0%
Iona College	GRP	3	1	0	Inf	100.0%
Iona College	NA	3	1	0	Inf	100.0%
Longwood University	AF	2	1	0	Inf	100.0%
Longwood University	FF	13	1	0	Inf	100.0%
Longwood University	GRP	4	1	0	Inf	100.0%
Longwood University	NA	23	1	0	Inf	100.0%
Lynn University	AF	1	1	0	Inf	100.0%
Lynn University	NA	25	1	0	Inf	100.0%
Mercy College	AF	7	1	0	Inf	100.0%
Mercy College	EMF	1	1	0	Inf	100.0%
Mercy College	FF	1	1	0	Inf	100.0%
Mercy College	GRP	1	1	0	Inf	100.0%
Mercy College	HESF	2	1	0	Inf	100.0%
Mercy College	PAE	1	1	0	Inf	100.0%
Mercy College	NA	24	1	0	Inf	100.0%
Methodist University	NA	4	0	1	0.0	0.0%
MGH Institute of Health Professions	NA	3	0	1	0.0	0.0%
Minnesota State System	AF	2	0	1	0.0	0.0%
Minnesota State System	EMF	1	0	1	0.0	0.0%
Minnesota State System	FF	2	0	1	0.0	0.0%
Minnesota State System	GRP	4	0	1	0.0	0.0%
Minnesota State System	NA	10	0	1	0.0	0.0%
Minnesota State University Moorhead	AF	4	1	0	Inf	100.0%
Minnesota State University Moorhead	FF	2	1	0	Inf	100.0%
Minnesota State University Moorhead	GRP	4	1	0	Inf	100.0%
Minnesota State University Moorhead	PAE	1	1	0	Inf	100.0%
Minnesota State University Moorhead	NA	42	1	0	Inf	100.0%
Montana Technological University	AF	2	1	0	Inf	100.0%
Montana Technological University	FF	2	1	0	Inf	100.0%
Montana Technological University	GRP	2	1	0	Inf	100.0%
Montana Technological University	HESF	1	1	0	Inf	100.0%
Montana Technological University	NA	48	1	0	Inf	100.0%
Mount Royal University	AF	4	1	0	Inf	100.0%
Mount Royal University	GRP	1	1	0	Inf	100.0%
Mount Royal University	PAE	1	1	0	Inf	100.0%
Mount Royal University	NA	5	1	0	Inf	100.0%
Mount St. Mary’s University	AF	12	1	0	Inf	100.0%
Mount St. Mary’s University	GRP	2	1	0	Inf	100.0%
Mount St. Mary’s University	HESF	2	1	0	Inf	100.0%
Mount St. Mary’s University	ITF	1	1	0	Inf	100.0%
Mount St. Mary’s University	PAE	1	1	0	Inf	100.0%
Mount St. Mary’s University	NA	36	1	0	Inf	100.0%
Multnomah University	NA	8	1	0	Inf	100.0%
New Mexico Inst. of Mining and Tech	AF	1	1	0	Inf	100.0%
New Mexico Inst. of Mining and Tech	EMF	1	1	0	Inf	100.0%
New Mexico Inst. of Mining and Tech	GRP	3	1	0	Inf	100.0%
New Mexico Inst. of Mining and Tech	HESF	1	1	0	Inf	100.0%
New Mexico Inst. of Mining and Tech	ITF	2	1	0	Inf	100.0%
New Mexico Inst. of Mining and Tech	PAE	1	1	0	Inf	100.0%
New Mexico Inst. of Mining and Tech	NA	10	1	0	Inf	100.0%
Northern Vermont University	NA	1	0	1	0.0	0.0%
Northland College	AF	1	1	0	Inf	100.0%
Northland College	FF	3	1	0	Inf	100.0%
Northland College	NA	12	1	0	Inf	100.0%
Oklahoma Baptist University	EMF	2	1	0	Inf	100.0%
Oklahoma Baptist University	NA	10	1	0	Inf	100.0%
Park University	GRP	2	0	1	0.0	0.0%
Park University	NA	14	0	1	0.0	0.0%
Pennsylvania State System of Higher Education	NA	4	1	1	1.0	100.0%
Point Loma Nazarene University	AF	3	1	0	Inf	100.0%
Point Loma Nazarene University	EMF	2	1	0	Inf	100.0%
Point Loma Nazarene University	FF	1	1	0	Inf	100.0%
Point Loma Nazarene University	NA	12	1	0	Inf	100.0%
Prairie View A&M University	ITF	1	1	0	Inf	100.0%
Prairie View A&M University	NA	5	1	0	Inf	100.0%
Rhode Island College	GRP	1	0	1	0.0	0.0%
Rhode Island College	NA	16	1	1	1.0	100.0%
Salem State University	AF	2	1	0	Inf	100.0%
Salem State University	GRP	2	1	0	Inf	100.0%
Salem State University	NA	22	1	0	Inf	100.0%
Samford University	AF	8	1	0	Inf	100.0%
Samford University	BAF	1	1	0	Inf	100.0%
Samford University	FF	1	1	0	Inf	100.0%
Samford University	GRP	1	1	0	Inf	100.0%
Samford University	PAE	1	1	0	Inf	100.0%
Samford University	NA	8	1	0	Inf	100.0%
Shaw University	NA	3	0	1	0.0	0.0%
Sheridan College	FF	2	1	0	Inf	100.0%
Sheridan College	GRP	2	1	0	Inf	100.0%
Sheridan College	NA	5	1	0	Inf	100.0%
Simmons University	AF	9	1	0	Inf	100.0%
Simmons University	HESF	1	1	0	Inf	100.0%
Simmons University	NA	15	1	0	Inf	100.0%
Southern Alberta Institute of Technology	AF	3	1	0	Inf	100.0%
Southern Alberta Institute of Technology	PAE	1	1	0	Inf	100.0%
Southern Alberta Institute of Technology	NA	10	1	0	Inf	100.0%
Spalding University	GRP	2	1	1	1.0	100.0%
Spalding University	NA	17	1	1	1.0	100.0%
St. Francis College	NA	11	1	0	Inf	100.0%
Texas A&M University-San Antonio	EMF	1	1	0	Inf	100.0%
Texas A&M University-San Antonio	FF	1	1	0	Inf	100.0%
Trinity University	NA	3	0	1	0.0	0.0%
Union College (NY)	GRP	1	1	0	Inf	100.0%
Union College (NY)	NA	4	1	0	Inf	100.0%
Union University	AF	2	1	0	Inf	100.0%
Union University	EMF	1	1	0	Inf	100.0%
Union University	FF	1	1	0	Inf	100.0%
Union University	GRP	1	1	0	Inf	100.0%
Union University	NA	22	1	0	Inf	100.0%
University of Colorado System	NA	2	0	1	0.0	0.0%
University of Dallas	AF	1	1	0	Inf	100.0%
University of Dallas	BAF	1	1	0	Inf	100.0%
University of Dallas	EMF	3	1	0	Inf	100.0%
University of Dallas	ITF	3	1	0	Inf	100.0%
University of Dallas	NA	12	1	0	Inf	100.0%
University of Nebraska at Kearney	AF	1	0	1	0.0	0.0%
University of Nebraska at Kearney	GRP	2	0	1	0.0	0.0%
University of Nebraska at Kearney	HESF	1	0	1	0.0	0.0%
University of Nebraska at Kearney	NA	7	1	1	1.0	100.0%
University of North Texas Health Science Center	AF	3	1	0	Inf	100.0%
University of North Texas Health Science Center	GRP	4	1	0	Inf	100.0%
University of North Texas Health Science Center	NA	10	1	0	Inf	100.0%
University of South Florida St. Petersburg	GRP	1	0	1	0.0	0.0%
University of South Florida St. Petersburg	NA	2	0	1	0.0	0.0%
University of St. Thomas	AF	3	1	0	Inf	100.0%
University of St. Thomas	GRP	3	1	0	Inf	100.0%
University of St. Thomas	HESF	1	1	0	Inf	100.0%
University of St. Thomas	PAE	1	1	0	Inf	100.0%
University of St. Thomas	NA	5	1	0	Inf	100.0%
University of the District of Columbia	AF	4	1	1	1.0	100.0%
University of the District of Columbia	EMF	3	1	0	Inf	100.0%
University of the District of Columbia	FF	4	0	1	0.0	0.0%
University of the District of Columbia	GRP	1	0	1	0.0	0.0%
University of the District of Columbia	ITF	3	1	0	Inf	100.0%
University of the District of Columbia	PAE	1	1	0	Inf	100.0%
University of the District of Columbia	NA	27	1	1	1.0	100.0%
University of the Ozarks	AF	4	1	0	Inf	100.0%
University of the Ozarks	EMF	6	1	0	Inf	100.0%
University of the Ozarks	FF	8	1	0	Inf	100.0%
University of the Ozarks	NA	26	1	0	Inf	100.0%
Vermont Technical College	NA	3	0	1	0.0	0.0%
Wartburg College	NA	5	0	1	0.0	0.0%
Washburn University	AF	5	1	0	Inf	100.0%
Washburn University	FF	6	1	0	Inf	100.0%
Washburn University	GRP	2	1	0	Inf	100.0%
Washburn University	PAE	1	1	0	Inf	100.0%
Washburn University	NA	43	1	0	Inf	100.0%
Washington Adventist University	AF	2	1	0	Inf	100.0%
Washington Adventist University	EMF	2	1	0	Inf	100.0%
Washington Adventist University	FF	5	1	0	Inf	100.0%
Washington Adventist University	GRP	2	1	0	Inf	100.0%
Washington Adventist University	HESF	1	1	0	Inf	100.0%
Washington Adventist University	PAE	1	1	0	Inf	100.0%
Washington Adventist University	NA	20	1	0	Inf	100.0%
Wayne State College	GRP	1	1	0	Inf	100.0%
Wayne State College	NA	11	1	0	Inf	100.0%
Wheeling University	NA	4	0	1	0.0	0.0%
William Penn University	FF	3	1	0	Inf	100.0%
William Penn University	NA	25	1	0	Inf	100.0%
Wilson College	AF	1	0	1	0.0	0.0%
Wilson College	GRP	1	0	1	0.0	0.0%
Wilson College	NA	11	0	1	0.0	0.0%
Wingate University	NA	10	1	0	Inf	100.0%
Winthrop University	AF	8	1	0	Inf	100.0%
Winthrop University	EMF	1	1	0	Inf	100.0%
Winthrop University	GRP	4	1	0	Inf	100.0%
Winthrop University	PAE	2	1	0	Inf	100.0%
Winthrop University	NA	19	1	0	Inf	100.0%

Correlation betwen Event Groupings, and Renewal

1. Because we have higher consumption overall, we are seeing higher correlations.
2. Renewals is relatively correlated with Events and Expert CAlls
3. Expert Calls and Events tend to be positively correlated with the other Impact Interaction categories.
4. Unlikely correlations - we tend to see SL Led and Research Interviews as highly correlated.

Multivariate Regression (still kind of simple)

Note: Looking at all decision types.

1. Events are the only interaction deemed significant.
2. In a more complicated model which controls for Account Segment and Decision Type, the results are strikingly similar.
3. If APR is included, it also pops as significant.

	Target_Binary
Predictors	Odds Ratios	CI	p
(Intercept)	0.51	0.16 – 1.50	0.232
II Events Volume	6.90	2.04 – 65.43	0.029
II SLLed Volume	1.21	0.71 – 2.12	0.491
II ResearchInterview Volume	3.71	0.51 – 37.89	0.219
II PLW Onsite Volume	1.01	0.50 – 2.26	0.971
II ExpertCall Volume	1.10	0.94 – 1.31	0.268
II Service Volume	0.81	0.59 – 1.06	0.142
APR Binary	15.07	2.01 – 331.36	0.024
Observations	109
R2 Tjur	0.384

MPOC & Contact Engagement

1. MPOC engagement appears to matter for NNLOAs more so than it does for Opt Outs.
2. MPOCs tend to be present for SL Led and Expert Calls, and these interactions have lift
3. Unrealized value appears to lie in Events and Onsites. Perhaps onsites can be used surgically in this manner -> not necessarily goaled.
4. The total number of engaged contacts is associated with higher likelihood to renew.
5. If the MPOC is not engaged, you can try and up the overall number of engaged contacts to make up the difference.

Impact Interactions Penetration for MPOCs

1. SL Led and Expert Calls have the highest engagement amongst MPOCs.
2. Larger differences between NNLOA and Opt Outs, for Events and Service, is unexpected.

Percent of Renewals w/ At Least 1 MPOC Interaction in a Group

DecisionType	Perc_Events	Perc_Service	Perc_SLLed	Perc_ResearchInt	Perc_PLW_Onsite	Perc_Experience	Perc_ExpertCall	Perc_MrktInsights
Need New LOA	8.8%	11.8%	41.2%	0.0%	17.6%	2.9%	55.9%	8.8%
Opt Out	30.7%	26.7%	40.0%	6.7%	18.7%	8.0%	57.3%	16.0%

Renewal by MPOC Egnagement

1. Most MPOCs are Engaged, one way or another.
2. [NNLOA] The effect of MPOC engagement on NNLOA is significantly larger than the effect we see in Opt Outs.
3. [Opt Outs] The effect size is smaller for Opt Outs and not significant.

Renewal Ratio by MPOC Engagement

DecisionType	II_MPOC	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	11	5	6	0.8	45.5%
Need New LOA	1	23	15	8	1.9	65.2%
Opt Out	0	17	13	4	3.2	76.5%
Opt Out	1	58	47	11	4.3	81.0%

Renewal by MPOC Volume

Total Contact Engagement

1. Besides the blip at 1, it would seem that the more contacts engaged with our research, the higher the likelihood to renew.

Renewal Ratio by Total Contact Engagement

II_Contacts_Bins	N	ATL	Dropped	Ratio	Perc_Renewed
0	2	0	2	0.0	0.0%
1	4	3	1	3.0	75.0%
2	10	5	5	1.0	50.0%
3-4	39	23	16	1.4	59.0%
5-6	26	22	4	5.5	84.6%
7+	28	27	1	27.0	96.4%

Total Contact Engagement w/ and w/o MPOC

If you cannot get the MPOC engaged, is there a certain number of other contact which would cover the spread?

1. The evidence is not strong enough to be unimpeachably confident. At best it is suggestive, and the number would be 5+ people.
2. Having the MPOC engaged appears to mean you can have fewer overall contacts engaged. The margin on this is small, 3-4 instead of 5+. You still need a decent number of contacts engaged, even with MPOC engagement.

Renewal Ratio by Total Contact Engagement by MPOC Engagement

II_MPOC	II_Contacts_Bins	N	ATL	Dropped	Ratio	Perc_Renewed
0	0	2	0	2	0.0	0.0%
0	1	2	2	0	Inf	100.0%
0	2	4	3	1	3.0	75.0%
0	3-4	9	4	5	0.8	44.4%
0	5-6	5	4	1	4.0	80.0%
0	7+	6	5	1	5.0	83.3%
1	1	2	1	1	1.0	50.0%
1	2	6	2	4	0.5	33.3%
1	3-4	30	19	11	1.7	63.3%
1	5-6	21	18	3	6.0	85.7%
1	7+	22	22	0	Inf	100.0%

Renewal by MPOC Engagement in Events

1. [NNLOA] Majority are NOT attending events in the final year of their contract.
2. [Opt Out] Overwhelmingly positive effect on renewal of MPOC engagement in events.

Renewal Ratio by MPOC Event Engagement

DecisionType	II_Events_MPOC_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	31	18	13	1.4	58.1%
Need New LOA	1	3	2	1	2.0	66.7%
Opt Out	0	52	37	15	2.5	71.2%
Opt Out	1	23	23	0	Inf	100.0%

Renewal by MPOC Engagement in Service

1. [NNLOA] Low N and again, almost no engagement.
2. [Opt Out] No difference in the effect on renewals.

Renewal Ratio by MPOC Service Engagement

DecisionType	II_Service_MPOC_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	30	17	13	1.3	56.7%
Need New LOA	1	4	3	1	3.0	75.0%
Opt Out	0	55	44	11	4.0	80.0%
Opt Out	1	20	16	4	4.0	80.0%

Renewal by MPOC Engagement in SL Led Impact Interactions

1. [NNLOA] Moderate engagement with a small positive effect.
2. [Opt Out] Moderate engagement with a small positive effect.

Renewal Ratio by MPOC SL Led Engagement

DecisionType	II_SLLed_MPOC_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	20	11	9	1.2	55.0%
Need New LOA	1	14	9	5	1.8	64.3%
Opt Out	0	45	35	10	3.5	77.8%
Opt Out	1	30	25	5	5.0	83.3%

Renewal by MPOC Engagement in Expert Call Engagement

1. [NNLOA] Moderate engagement with a small positive effect.
2. [Opt Out] Moderate engagement with a small positive effect.

Renewal Ratio by MPOC Expert Call Engagement

DecisionType	II_ExpertCall_MPOC_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	15	7	8	0.9	46.7%
Need New LOA	1	19	13	6	2.2	68.4%
Opt Out	0	32	27	5	5.4	84.4%
Opt Out	1	43	33	10	3.3	76.7%

Renewal by MPOC Engagement in Market Insights

1. [NNLOA] very low engagement, although small positive effect.
2. [Opt Out] First instance of a negative effect when an impact interaction is consumed.

Renewal Ratio by MPOC Market Insight Engagement

DecisionType	II_MarketResearch_MPOC_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	31	18	13	1.4	58.1%
Need New LOA	1	3	2	1	2.0	66.7%
Opt Out	0	63	52	11	4.7	82.5%
Opt Out	1	12	8	4	2.0	66.7%

Renewal by MPOC Engagement with Market Insights - Opex

Renewal Ratio by MPOC Market Insight Engagement & OpEx

OpEx_Bins_Public	II_MarketResearch_MPOC_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
0 to 50M	0	34	19	15	1.3	55.9%
0 to 50M	1	7	5	2	2.5	71.4%
50M to 90M	0	22	19	3	6.3	86.4%
50M to 90M	1	5	3	2	1.5	60.0%
90M to 131M	0	20	17	3	5.7	85.0%
90M to 131M	1	1	0	1	0.0	0.0%
131M+	0	18	15	3	5.0	83.3%
131M+	1	2	2	0	Inf	100.0%

Renewal by MPOC Engagement in PLW / Onsite

1. [NNLOA] Solid renewal rate, albeit with a lower N. Suggests potential surgical application of this intensive type of interaction.
2. [Opt Out] Second instance of a negative effect when an impact interaction is consumed…although the effect is almost negligible.

Renewal Ratio by MPOC Onsite Engagement

DecisionType	II_PLW_Onsite_MPOC_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	28	15	13	1.2	53.6%
Need New LOA	1	6	5	1	5.0	83.3%
Opt Out	0	61	49	12	4.1	80.3%
Opt Out	1	14	11	3	3.7	78.6%

Renewal by MPOC Engagement in Experience

1. [NNLOA] Very low engagement.
2. [Opt Out] Small N but seriously positive effect.

Renewal Ratio by MPOC Experience Engagement

DecisionType	II_Experience_MPOC_Binary	N	ATL	Dropped	Ratio	Perc_Renewed
Need New LOA	0	33	19	14	1.4	57.6%
Need New LOA	1	1	1	0	Inf	100.0%
Opt Out	0	69	54	15	3.6	78.3%
Opt Out	1	6	6	0	Inf	100.0%