CCEF Analysis

The purpose of this analysis is to understand the variable effect of impact interactions on the likelihood of a partner to renew their partnership. Simply, which service levers matter more for partnership renewal.

Executive Summary

Methodological Considerations

  1. The data set consists of decisions from FY19 through March of FY22.

  2. Similar to previous analyses, we are primarily looking at the year leading up to a decision.

  3. We are not looking at ‘integrated’ partnerships. That is, we are focusing on utilization at the account where the renewal decision is made.

  4. Lastly, we are looking at unit renewal rates instead of $ renewal rates. This allows us to treat impact interactions equitably across partnerships.

Renewal by Decision Type

The below table should not come as a surprise. Opt Outs tend to perform very well while NNLOA can be quite mixed.

  1. Typical high renewal performance from opt outs. Roughly 50% renewal for NNLOA.
  2. 33% of decisions are opt outs; most are NNLOA.
Renewal Ratio by Decision Type
DecisionType N ATL Dropped Ratio Perc_Renewed
Need New LOA 114 58 56 1.0 50.9%
Opt Out 57 50 7 7.1 87.7%
Total 171 108 63 1.7 63.2%

Renewals by Decision Type and Year

Since we are combining multiple years of data, we will frequently take a look at whether there are differences across the years.

  1. NNLOA performance in FY21 and FY22 stronger than the average. Fewer unit drops in FY22, with a lower total N.
  2. Opt Out performance down in FY22, but that equates to single incremental unit drop.
Renewal Ratio by Decision Type
DecisionType FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 2019 15 0 15 0.0 0.0%
Need New LOA 2020 33 15 18 0.8 45.5%
Need New LOA 2021 40 27 13 2.1 67.5%
Need New LOA 2022 26 16 10 1.6 61.5%
Opt Out 2019 8 7 1 7.0 87.5%
Opt Out 2020 19 17 2 8.5 89.5%
Opt Out 2021 14 13 1 13.0 92.9%
Opt Out 2022 16 13 3 4.3 81.2%
Total NA 171 108 63 1.7 63.2%
Placeholder in case we want to look at Navigate Partners.

Ignore results for now.

Renewal Ratio by CRP Inclusion
N ATL Dropped Ratio Perc_Renewed
171 108 63 1.7 63.2%
Impact Interaction Volume Histogram
  1. Central tendency is around 7.
  2. Two utilization peaks between 3-4 and 7-8.
  3. Not many low utilizers in the 0-2 bucket.
  4. Another peak at 7 and then a longish tail.

Impact Interaction Volume Histogram Split by Decision
  1. Below 3 looks like a definitive drop.
  2. Drops still present in 3-7, but definitely decreased.
  3. 8+ looks fantastic.

Impact Interaction Volume Histogram Split by Pool Date FY
  1. FY22 has very few in the lowest utilization buckets. Looks uniformly distributed (almost) across Impact Interaction volumes.
  2. FY19 might be a very different year based on how how many are in the <=4 range.

Renewal by Interaction Volume and Decision Type, Unbinned
  1. [NNLOA] Low regions perform significantly worse. High volume engagement is great. Middle is average.
  2. [Opt Out] No pattern. Too few drops.
Renewal Ratio by Impact Interaction Volume
DecisionType II_Credited_Volume N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 9 1 8 0.1 11.1%
Need New LOA 1 6 1 5 0.2 16.7%
Need New LOA 2 5 0 5 0.0 0.0%
Need New LOA 3 13 6 7 0.9 46.2%
Need New LOA 4 15 7 8 0.9 46.7%
Need New LOA 5 7 4 3 1.3 57.1%
Need New LOA 6 13 6 7 0.9 46.2%
Need New LOA 7 18 9 9 1.0 50.0%
Need New LOA 8 8 7 1 7.0 87.5%
Need New LOA 9 4 3 1 3.0 75.0%
Need New LOA 10 3 3 0 Inf 100.0%
Need New LOA 11 6 6 0 Inf 100.0%
Need New LOA 12 2 1 1 1.0 50.0%
Need New LOA 15 2 2 0 Inf 100.0%
Need New LOA 16 1 1 0 Inf 100.0%
Need New LOA 19 1 0 1 0.0 0.0%
Need New LOA 23 1 1 0 Inf 100.0%
Opt Out 1 2 1 1 1.0 50.0%
Opt Out 2 1 1 0 Inf 100.0%
Opt Out 3 6 6 0 Inf 100.0%
Opt Out 4 5 5 0 Inf 100.0%
Opt Out 5 8 8 0 Inf 100.0%
Opt Out 6 4 4 0 Inf 100.0%
Opt Out 7 2 2 0 Inf 100.0%
Opt Out 8 10 7 3 2.3 70.0%
Opt Out 9 6 5 1 5.0 83.3%
Opt Out 10 2 2 0 Inf 100.0%
Opt Out 11 2 1 1 1.0 50.0%
Opt Out 12 2 2 0 Inf 100.0%
Opt Out 13 2 2 0 Inf 100.0%
Opt Out 14 1 1 0 Inf 100.0%
Opt Out 16 1 1 0 Inf 100.0%
Opt Out 17 2 1 1 1.0 50.0%
Opt Out 19 1 1 0 Inf 100.0%
Renewal by Impact Interaction Volume and Decision Type, (Binned)

Adjusted the binning to better capture the high volume present in URF.

  1. For NNLOA, significant gains from getting partners into the next bin! 7+ is very good!
  2. For Opt Out, drops are coming from higher utilizers.
Renewal Ratio by Impact Interaction Volume (Binned)
DecisionType II_Volume_Bins N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 9 1 8 0.1 11.1%
Need New LOA 1 6 1 5 0.2 16.7%
Need New LOA 2-3 18 6 12 0.5 33.3%
Need New LOA 4-6 35 17 18 0.9 48.6%
Need New LOA 7+ 46 33 13 2.5 71.7%
Opt Out 1 2 1 1 1.0 50.0%
Opt Out 2-3 7 7 0 Inf 100.0%
Opt Out 4-6 17 17 0 Inf 100.0%
Opt Out 7+ 31 25 6 4.2 80.6%

#####Simple Regression for Impact Interaction Volume - NNLOA

  1. The Estimate for Impact Interaction Volume is Positive -> increased consumption means increased likelihood to renew.
  2. This is statistically significant.
  Target_Binary
Predictors Odds Ratios CI p
(Intercept) 0.23 0.10 – 0.51 0.001
II Credited Volume 1.31 1.15 – 1.51 <0.001
Observations 114
R2 Tjur 0.174
Penetration by Event Grouping

Reminder: 1. Experience = VIP Days & Collaboratives

  1. Service = Benchmarking, Audits, Secret Shopper, Customer Research Projects, Market Insights, and Survey Walkthroughs

  2. Expert Call = Expert Center, Benchmarking Walkthrough, Tool’s Walkthrough

  3. SL Led = Research SL Impact, Evergreen Action, Exec Update, National Meeting Pre-wire

  4. Research Interview = Research Initial & Scoping

  5. Events = National Meeting, COVID Working Group

  6. PLW/Onsite = Onsite, PLW

  7. SL Led, Expert Calls, and Events are the highest penetration.

  8. SL Led and Expert Calls favor Opt Outs, while only Onsites favor NNLOA.

Percent of Renewals w/ At Least 1 Interaction in a Group
DecisionType Perc_Events Perc_Service Perc_SLLed Perc_ResearchInt Perc_PLW_Onsite Perc_Experience Perc_ExpertCall
Need New LOA 62.3% 37.7% 66.7% 11.4% 36.8% 0.0% 73.7%
Opt Out 71.9% 45.6% 80.7% 12.3% 26.3% 0.0% 91.2%
Renewal by Event Consumption
  1. [NNLOA] 10% bump above the average. Giant leap above not consuming - 26%.
  2. [Opt Out] Drops will favor the utilizers, so this is unsurprising.
Renewal Ratio by Event Consumption
DecisionType II_Events_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 43 15 28 0.5 34.9%
Need New LOA 1 71 43 28 1.5 60.6%
Opt Out 0 16 16 0 Inf 100.0%
Opt Out 1 41 34 7 4.9 82.9%
Renewal by Event Consumption Volume
  1. 1 Event seems slightly better than 0, and 2+ combined look strong.

Renewal by Event, OT

  1. [NNLOA] Ignore FY22, since nearly all NNLOA attended!
  2. [NNLOA] Events were showing a nice bump from FY20 to FY21.
Renewal Ratio by Event Consumption
DecisionType II_Events_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 9 0 9 0.0 0.0%
Need New LOA 0 2020 20 9 11 0.8 45.0%
Need New LOA 0 2021 12 6 6 1.0 50.0%
Need New LOA 0 2022 2 0 2 0.0 0.0%
Need New LOA 1 2019 6 0 6 0.0 0.0%
Need New LOA 1 2020 13 6 7 0.9 46.2%
Need New LOA 1 2021 28 21 7 3.0 75.0%
Need New LOA 1 2022 24 16 8 2.0 66.7%
Opt Out 0 2019 2 2 0 Inf 100.0%
Opt Out 0 2020 8 8 0 Inf 100.0%
Opt Out 0 2021 5 5 0 Inf 100.0%
Opt Out 0 2022 1 1 0 Inf 100.0%
Opt Out 1 2019 6 5 1 5.0 83.3%
Opt Out 1 2020 11 9 2 4.5 81.8%
Opt Out 1 2021 9 8 1 8.0 88.9%
Opt Out 1 2022 15 12 3 4.0 80.0%
Renewal by Service Consumption
  1. [NNLOA] Decent lift above the average - 10%. 15% bump vs. not consuming.
  2. [Opt Out] Drops will favor the utilizers, so this is unsurprising.
Renewal Ratio by Service Consumption
DecisionType II_Service_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 71 32 39 0.8 45.1%
Need New LOA 1 43 26 17 1.5 60.5%
Opt Out 0 31 28 3 9.3 90.3%
Opt Out 1 26 22 4 5.5 84.6%
Renewal by Service Consumption Volume
  1. You start to see some benefit from consuming 1 service.
  2. More considerable renewal benefit from 2+, although data becomes more sparse.

Renewal by Service Consumption, OT

  1. [NNLOA] Consistent overperformance across the years.
  2. [NNLOA] Positive gap in consuming got a little bit better in FY22.
Renewal Ratio by Service Consumption
DecisionType II_Service_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 11 0 11 0.0 0.0%
Need New LOA 0 2020 23 10 13 0.8 43.5%
Need New LOA 0 2021 24 15 9 1.7 62.5%
Need New LOA 0 2022 13 7 6 1.2 53.8%
Need New LOA 1 2019 4 0 4 0.0 0.0%
Need New LOA 1 2020 10 5 5 1.0 50.0%
Need New LOA 1 2021 16 12 4 3.0 75.0%
Need New LOA 1 2022 13 9 4 2.2 69.2%
Opt Out 0 2019 3 3 0 Inf 100.0%
Opt Out 0 2020 11 10 1 10.0 90.9%
Opt Out 0 2021 10 10 0 Inf 100.0%
Opt Out 0 2022 7 5 2 2.5 71.4%
Opt Out 1 2019 5 4 1 4.0 80.0%
Opt Out 1 2020 8 7 1 7.0 87.5%
Opt Out 1 2021 4 3 1 3.0 75.0%
Opt Out 1 2022 9 8 1 8.0 88.9%
Renewal by SL Consumption
  1. [NNLOA] 9% lift above the average. 25% lift vs. not consuming.
  2. [Opt Out] Same as previous category types.
Renewal Ratio by SL-Led Consumption
DecisionType II_SLLed_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 38 13 25 0.5 34.2%
Need New LOA 1 76 45 31 1.5 59.2%
Opt Out 0 11 10 1 10.0 90.9%
Opt Out 1 46 40 6 6.7 87.0%

SL Consumption Volume & Renewal

  1. Marginal benefit in the 1-3 bins.

Renewal by SL Consumption, OT
  1. [NNLOA] FY21 really lifting up the total. FY22, you see a reversal in the trend. Although low N in the non-consumption bin.
Renewal Ratio by SL-Led Consumption
DecisionType II_SLLed_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 11 0 11 0.0 0.0%
Need New LOA 0 2020 9 2 7 0.3 22.2%
Need New LOA 0 2021 12 6 6 1.0 50.0%
Need New LOA 0 2022 6 5 1 5.0 83.3%
Need New LOA 1 2019 4 0 4 0.0 0.0%
Need New LOA 1 2020 24 13 11 1.2 54.2%
Need New LOA 1 2021 28 21 7 3.0 75.0%
Need New LOA 1 2022 20 11 9 1.2 55.0%
Opt Out 0 2019 3 3 0 Inf 100.0%
Opt Out 0 2020 2 2 0 Inf 100.0%
Opt Out 0 2021 2 2 0 Inf 100.0%
Opt Out 0 2022 4 3 1 3.0 75.0%
Opt Out 1 2019 5 4 1 4.0 80.0%
Opt Out 1 2020 17 15 2 7.5 88.2%
Opt Out 1 2021 12 11 1 11.0 91.7%
Opt Out 1 2022 12 10 2 5.0 83.3%
Renewal by Research Interview Consumption
  1. [NNLOA] Inversion here. Small N.
  2. [Opt out] Same as Opt Out in other Categories - lower renewal favors the utilizers.
Renewal Ratio by Research Interview Consumption
DecisionType II_ResearchInterview_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 101 55 46 1.2 54.5%
Need New LOA 1 13 3 10 0.3 23.1%
Opt Out 0 50 44 6 7.3 88.0%
Opt Out 1 7 6 1 6.0 85.7%
Research Interview Volume & Renewal
  1. Increasing consumption in this category does seem to improve unit rate.

Renewal By Research Interview Consumption, OT
  1. [NNLOA] Doesn’t look like this was delivered in the past 2 years and FY19 was abysmal performance.
Renewal Ratio by Research Interview Consumption
DecisionType II_ResearchInterview_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 12 0 12 0.0 0.0%
Need New LOA 0 2020 23 12 11 1.1 52.2%
Need New LOA 0 2021 40 27 13 2.1 67.5%
Need New LOA 0 2022 26 16 10 1.6 61.5%
Need New LOA 1 2019 3 0 3 0.0 0.0%
Need New LOA 1 2020 10 3 7 0.4 30.0%
Opt Out 0 2019 7 7 0 Inf 100.0%
Opt Out 0 2020 13 11 2 5.5 84.6%
Opt Out 0 2021 14 13 1 13.0 92.9%
Opt Out 0 2022 16 13 3 4.3 81.2%
Opt Out 1 2019 1 0 1 0.0 0.0%
Opt Out 1 2020 6 6 0 Inf 100.0%
Renewal by PLW OR Onsite Consumption
  1. [NNLOA] Largest lift yet, 19% above the average. 29% lift against not consuming.
  2. [Opt Out] Same as above.
Renewal Ratio by PLW OR Onsite Consumption
DecisionType II_PLW_Onsite_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 72 29 43 0.7 40.3%
Need New LOA 1 42 29 13 2.2 69.0%
Opt Out 0 42 37 5 7.4 88.1%
Opt Out 1 15 13 2 6.5 86.7%
PLW / Onsite Volume & Renewal
  1. 1 seems sufficient.

Renewal by PLW/Onsite OT
  1. [NNLOA] Fantastic success in FY22. FY21 more mixed.
Renewal Ratio by PLW OR Onsite Consumption
DecisionType II_PLW_Onsite_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 11 0 11 0.0 0.0%
Need New LOA 0 2020 21 7 14 0.5 33.3%
Need New LOA 0 2021 24 16 8 2.0 66.7%
Need New LOA 0 2022 16 6 10 0.6 37.5%
Need New LOA 1 2019 4 0 4 0.0 0.0%
Need New LOA 1 2020 12 8 4 2.0 66.7%
Need New LOA 1 2021 16 11 5 2.2 68.8%
Need New LOA 1 2022 10 10 0 Inf 100.0%
Opt Out 0 2019 5 4 1 4.0 80.0%
Opt Out 0 2020 12 11 1 11.0 91.7%
Opt Out 0 2021 11 10 1 10.0 90.9%
Opt Out 0 2022 14 12 2 6.0 85.7%
Opt Out 1 2019 3 3 0 Inf 100.0%
Opt Out 1 2020 7 6 1 6.0 85.7%
Opt Out 1 2021 3 3 0 Inf 100.0%
Opt Out 1 2022 2 1 1 1.0 50.0%
Renewal by Experience Consumption

No utilization

Renewal Ratio by Experience Consumption
DecisionType II_Experience_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 114 58 56 1.0 50.9%
Opt Out 0 57 50 7 7.1 87.7%
Experience Volume & Renewal

No utilization

Renewal by Experience Consumption OT

No utilization

Renewal Ratio by Experience Consumption
DecisionType II_Experience_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 15 0 15 0.0 0.0%
Need New LOA 0 2020 33 15 18 0.8 45.5%
Need New LOA 0 2021 40 27 13 2.1 67.5%
Need New LOA 0 2022 26 16 10 1.6 61.5%
Opt Out 0 2019 8 7 1 7.0 87.5%
Opt Out 0 2020 19 17 2 8.5 89.5%
Opt Out 0 2021 14 13 1 13.0 92.9%
Opt Out 0 2022 16 13 3 4.3 81.2%
Renewal by Expert Call Consumption
  1. [NNLOA] 12% lift above the average. 42% above not consuming. Definitely a risk factor if this isn’t consumed.
  2. [Opt Out] Same as above.
Renewal Ratio by Expert Call Consumption
DecisionType II_ExpertCall_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 30 6 24 0.2 20.0%
Need New LOA 1 84 52 32 1.6 61.9%
Opt Out 0 5 4 1 4.0 80.0%
Opt Out 1 52 46 6 7.7 88.5%
Expert Call Volume & Renewal
  1. 1 is a good start. Don’t see improved rates until 5+.

Renewal by Expert Call Consumption OT
  1. [NNLOA] Consistent number of non-utilizers each year.
  2. [NNLOA] Performance is consistently better with utilzation vs. not.
Renewal Ratio by Expert Call Consumption
DecisionType II_ExpertCall_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 7 0 7 0.0 0.0%
Need New LOA 0 2020 9 1 8 0.1 11.1%
Need New LOA 0 2021 6 3 3 1.0 50.0%
Need New LOA 0 2022 8 2 6 0.3 25.0%
Need New LOA 1 2019 8 0 8 0.0 0.0%
Need New LOA 1 2020 24 14 10 1.4 58.3%
Need New LOA 1 2021 34 24 10 2.4 70.6%
Need New LOA 1 2022 18 14 4 3.5 77.8%
Opt Out 0 2020 1 1 0 Inf 100.0%
Opt Out 0 2021 1 1 0 Inf 100.0%
Opt Out 0 2022 3 2 1 2.0 66.7%
Opt Out 1 2019 8 7 1 7.0 87.5%
Opt Out 1 2020 18 16 2 8.0 88.9%
Opt Out 1 2021 13 12 1 12.0 92.3%
Opt Out 1 2022 13 11 2 5.5 84.6%

Finer Grain Look at What Was Consumed

Event Category and Event Purpose

  1. Web audit and virtual enrollment audits look good.
  2. Tool’s walkthrough is pretty strong.
  3. A few of the national meetings - Building Pathways; Enrollment.
Renewal Ratio by Event Category and Event Purpose
Event_Category EventPurpose N ATL Dropped Ratio Perc_Renewed
COVID Working Group Session BIPOC Faculty Recruitment Working Groups for Chief Academic Officers: Designing Academic Hiring Stra, 2 2 0 Inf 100.0%
COVID Working Group Session CCEF COVID-19 Working Group - Critical Conversations: Community Colleges 11 8 3 2.7 72.7%
Diagnostic or Audit CCEF Web Audit 17 12 5 2.4 70.6%
Diagnostic or Audit Diagnostic or Audit 1 1 0 Inf 100.0%
Diagnostic or Audit Diversity, Equity, Inclusion, and Justice Plan Review (CCEF) 1 1 0 Inf 100.0%
Diagnostic or Audit Guided Pathways Diagnostic 7 4 3 1.3 57.1%
Diagnostic or Audit User Experience Audit (CCEF) 4 4 0 Inf 100.0%
Diagnostic or Audit Virtual Enrollment Audit 32 24 8 3.0 75.0%
Evergreen Action Evergreen Action 11 6 5 1.2 54.5%
Executive Update Executive Update 32 21 11 1.9 65.6%
Expert Center Expert Center 81 61 22 2.8 75.3%
Expert Center Expert Center Call 38 23 15 1.5 60.5%
Market Research NA 2 0 2 0.0 0.0%
National Meeting 2018 Community College Executive Forum National Meeting Series, 8 6 2 3.0 75.0%
National Meeting 2018 Community College Executive Forum National Meeting Series, Marina del Rey, CA 5 2 3 0.7 40.0%
National Meeting 2018 Community College Executive Forum National Meeting Series, Nashville, TN 2 0 2 0.0 0.0%
National Meeting 2018 Community College Executive Forum National Meeting Series, Washington, DC 3 1 2 0.5 33.3%
National Meeting 2019 Community College Executive Forum National Meeting Series, Chicago, IL 5 2 3 0.7 40.0%
National Meeting 2019 Community College Executive Forum National Meeting Series, Los Angeles, CA 4 1 3 0.3 25.0%
National Meeting 2019 Community College Executive Forum National Meeting Series, Washington, DC 9 9 0 Inf 100.0%
National Meeting Blueprint for Growth: Opportunities and Challenges for Community and Technical College Recruitment, 8 8 0 Inf 100.0%
National Meeting Breaking the Stalemate: How Institutions Are Overcoming Entrenched Org Structures and Outdated Advis, 1 1 0 Inf 100.0%
National Meeting Building Pathways Between Credit and Noncredit Coursework, 21 17 4 4.2 81.0%
National Meeting CCEF Working Sessions, 13 11 2 5.5 84.6%
National Meeting Conquering the Enrollment Challenges of Rural Community Colleges, 2 2 0 Inf 100.0%
National Meeting Expert Q&A: How to build a thriving virtual campus for your community college, 3 3 0 Inf 100.0%
National Meeting How Prepared Are You for the World of Hybrid Work?, 2 2 0 Inf 100.0%
National Meeting Imperatives for the Post-Vaccination Institution: A State of the Union for Community College Preside, 4 4 0 Inf 100.0%
National Meeting Industry Futures 2021: The Technological Advancements of the Digital Revolution for Community Colleg, 3 3 0 Inf 100.0%
National Meeting Research Advisory Council for Community Colleges (Presidents Cohort), 1 1 0 Inf 100.0%
National Meeting Serving the Students of the Pandemic: Community College Leadership Roundtable, 20 17 3 5.7 85.0%
National Meeting Serving the Students of the Pandemic: Community College Presidential Roundtable, 18 13 5 2.6 72.2%
National Meeting Strategic Enrollment Management Planning for the COVID Era: A CCEF Virtual Working Group, 14 12 2 6.0 85.7%
National Meeting Supporting Community College Fundraising: A Conversation Facilitated by EAB, 12 9 3 3.0 75.0%
National Meeting The Changing Landscape of Higher Education Post-COVID, 1 1 0 Inf 100.0%
National Meeting Top 5 Pitfalls of Institutional DEIJ Plans – and How to Avoid Them, 1 1 0 Inf 100.0%
National Meeting Unpacking the Responsibility and Opportunities for Economic Justice Initiatives for Community Colleg, 9 7 2 3.5 77.8%
National Meeting Virtual Working Session CCEF: Critical Conversations: Community Colleges COVID19, 10 5 5 1.0 50.0%
National Meeting Virtual Working Session CCEF: Presidential Leadership Circle: Organizational Resiliency and Leading, 8 4 4 1.0 50.0%
Onsite Onsite (Closed) | CCEF | Presentation Date: 9/26/2018 1 1 0 Inf 100.0%
Onsite Onsite | Achieving Pathways Goals Through Student Centric Design | 11/14 1 0 1 0.0 0.0%
Onsite Onsite | CCEF | 06/27/2019 1 1 0 Inf 100.0%
Onsite Onsite | CCEF | 09/20/18 1 0 1 0.0 0.0%
Onsite Onsite | CCEF | 11/12/2019 1 0 1 0.0 0.0%
Onsite Onsite | CCEF | 12/07/2018 1 1 0 Inf 100.0%
Onsite Onsite | CCEF | Presentation Date: 02/07/2019 1 1 0 Inf 100.0%
Onsite Onsite | CCEF | Presentation Date: 03/07/2019 1 1 0 Inf 100.0%
Onsite Onsite | CCEF | Presentation Date: 05/02/2019 1 1 0 Inf 100.0%
Onsite Onsite | CCEF | Presentation Date: 05/17/2019 1 0 1 0.0 0.0%
Onsite Onsite | CCEF | Presentation Date: 06/06/2019 1 1 0 Inf 100.0%
Onsite Onsite | CCEF | Presentation Date: 06/20/19 1 1 0 Inf 100.0%
Onsite Onsite | CCEF | Presentation Date: 08/15/2019 2 1 1 1.0 50.0%
Onsite Onsite | CCEF | Presentation Date: 08/23/2019 1 1 0 Inf 100.0%
Onsite Onsite | CCEF | Presentation Date: 09/04/2019 1 0 1 0.0 0.0%
Onsite Onsite | CCEF | Presentation Date: 10/1/2019 1 1 0 Inf 100.0%
Onsite Onsite | CCEF | Presentation Date: 11/13/2018 1 1 0 Inf 100.0%
Onsite Onsite | CCEF | Top Strategic Opportunities | 08/20/2019 1 1 0 Inf 100.0%
Onsite Onsite | Customized Presentation | 12/5 1 0 1 0.0 0.0%
Onsite Onsite Hidden Enemies to Strategy 3/19 1 1 0 Inf 100.0%
Onsite Onsite l CCEF l Presentation date: 11/15/18 1 0 1 0.0 0.0%
Onsite Onsite l CCEF l Presentation date: 12/14/18 1 0 1 0.0 0.0%
Onsite Onsite l CCEF l Presentation date: 6/7/2018 1 0 1 0.0 0.0%
Onsite Onsite Strategies to Enroll the Next Generation of Students 2/27 1 1 0 Inf 100.0%
Onsite Onsite: Closing the Part-Time Student Success Gap - CCEF | 1 0 1 0.0 0.0%
Onsite Onsite: CCEF- Closing the Part-Time Student Success Gap | Presentation Date: 1/22/2020 1 1 0 Inf 100.0%
Onsite Onsite: Closing the Part-Time Student Success Gap - CCF - 9/25/2019 1 1 0 Inf 100.0%
Onsite Onsite: Preventing Early Attrition 1 1 0 Inf 100.0%
Onsite Partner Intensive | CCF | Customized Presentation 1 1 0 Inf 100.0%
Onsite NA 3 2 1 2.0 66.7%
Research Initial CCEF Career Development Study 2019 15 7 8 0.9 46.7%
Research Initial CCEF Predictive Enrollment Analytics 6 5 1 5.0 83.3%
Research Initial CCEF Program Review 2018 2 0 2 0.0 0.0%
Research Initial CCEF Strategic Planning 6 5 1 5.0 83.3%
Research SL Impact Research SL Impact - 2020 Onsite Planning 2 1 1 1.0 50.0%
Research SL Impact Research SL Impact - 2020 Planning Call 4 3 1 3.0 75.0%
Research SL Impact Research SL Impact - 2020 Planning Conversation 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Call 25 13 12 1.1 52.0%
Research SL Impact Research SL Impact - CCEF Enrollment Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - CCEF National Meeting Sit Down 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - CCEF Overview and Executive Update 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Check-in, Resource Overview 2 0 2 0.0 0.0%
Research SL Impact Research SL Impact - Check-in, Service Planning 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Check In - CCEF Meeting 5 3 2 1.5 60.0%
Research SL Impact Research SL Impact - Check In Call 4 3 1 3.0 75.0%
Research SL Impact Research SL Impact - Dinner 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - EAB.com Overview 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Expert Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Expert Call - CARES Act conversation 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Meeting - DREAM 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Visit-Research SL Impact-Slack Presidential Experience Lab 4 2 2 1.0 50.0%
Research SL Impact Research SL Impact - Lunch 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - March 2021 League & EAB Strategy Summit 3 2 1 2.0 66.7%
Research SL Impact Research SL Impact - Meeting 4 3 1 3.0 75.0%
Research SL Impact Research SL Impact - Onsite 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Onsite Planning Call 2 0 2 0.0 0.0%
Research SL Impact Research SL Impact - Onsite Prep Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Research Interview- Blueprint for Growth 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Resource Walk Through 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Second Exec Roundtable Topic 9 9 0 Inf 100.0%
Research SL Impact Research SL Impact - Service Planning 4 4 0 Inf 100.0%
Research SL Impact Research SL Impact - Service Planning call 8 5 3 1.7 62.5%
Research SL Impact Research SL Impact - Service Planning Call 8 3 5 0.6 37.5%
Research SL Impact Research SL Impact - SL Impact Call 12 8 4 2.0 66.7%
Research SL Impact Research SL Impact - Strategic Planning Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Webinar Planning Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Welcome Call 3 3 0 Inf 100.0%
Research SL Impact Research SL Impact Visit 35 23 13 1.8 65.7%
Secret Shopper Hold Exp. 11/1 | Secret Shopper - CCEF | Alamance Community College - Graham - NC 1 0 1 0.0 0.0%
Secret Shopper Onsite | Secret Shopper - CCEF | Presentation Date: 1/13/20 1 1 0 Inf 100.0%
Secret Shopper Secret Shopper - CCEF | Date: 12/20/2018 1 1 0 Inf 100.0%
Secret Shopper Secret Shopper | CCEF | 01/25/2019 1 1 0 Inf 100.0%
Secret Shopper Secret Shopper | CCEF | Date: 07/18/2019 1 1 0 Inf 100.0%
Secret Shopper Secret Shopper | CCEF | Date: 8/13-15| 1 1 0 Inf 100.0%
Secret Shopper Secret Shopper | CCEF | Presentation Date: 02/06/2019 1 0 1 0.0 0.0%
Secret Shopper Secret Shopper | CCEF | Presentation Date: 03/14/2019 1 0 1 0.0 0.0%
Secret Shopper Secret Shopper | CCEF | Presentation Date: 06/13/2019 1 1 0 Inf 100.0%
Secret Shopper Secret Shopper | CCEF | Presentation Date: 08/20/2019 1 1 0 Inf 100.0%
Secret Shopper Secret Shopper | CCEF | Presentation Date: 12/07/2019 1 0 1 0.0 0.0%
Secret Shopper Secret Shopper | Date: 08/06/19 1 1 0 Inf 100.0%
Secret Shopper Secret Shopper Case | CCEF | Presentation Date: 8/30 1 0 1 0.0 0.0%
Secret Shopper Secret Shopper: Los Angeles Trade Technical College - CCF - 2/13/2020 1 0 1 0.0 0.0%
Secret Shopper Secret Shopper: Los Angeles Southwest College - CCF - 2/14/2020 1 0 1 0.0 0.0%
Secret Shopper NA 6 4 2 2.0 66.7%
Tool’s Walkthrough Tool’s Walk Through 47 34 15 2.3 72.3%
Tool’s Walkthrough Tool’s Walk Through Call 3 1 2 0.5 33.3%
Webinar Hold Exp. 3/20 Onsite: Strategies to Enroll the Next Generation of Students - CCF -5/19/2020 1 1 0 Inf 100.0%
Webinar Partner Intensive | CCF | BIPOC Faculty Recruitment 1 1 0 Inf 100.0%
Webinar Partner Intensive | CCF | Closing the Gaps in Student Success 1 1 0 Inf 100.0%
Webinar Partner Intensive | CCF | Closing the Part-Time Student Success Gap 1 1 0 Inf 100.0%
Webinar Partner Intensive | CCF | Customized Presentation 2 2 0 Inf 100.0%
Webinar Partner Intensive | CCF | Defining the Faculty Role in Student Success 1 1 0 Inf 100.0%
Webinar Partner Intensive | CCF | Persona Recruitment Workshop | Presentation Date: 9/16/21 1 1 0 Inf 100.0%
Webinar Partner Intensive | CCF | Resilience Leadership Workshop 1 1 0 Inf 100.0%
Webinar Partner Intensive | CCF | Systems Thinking Applications to Advance Racial Justice 1 1 0 Inf 100.0%
Webinar Partner Intensive | SAS | Meta-Major Building Workshop 1 1 0 Inf 100.0%
Webinar PLW | CCEF | 01/31/2019 1 0 1 0.0 0.0%
Webinar PLW | CCEF | 02/25/2019 1 0 1 0.0 0.0%
Webinar PLW | CCEF | 08/20/2018 1 1 0 Inf 100.0%
Webinar PLW | CCEF | Presentation Date: 02/14/2019 1 0 1 0.0 0.0%
Webinar PLW | CCEF | Presentation Date: 02/20/2019 1 1 0 Inf 100.0%
Webinar PLW | Preventing Early Attrition - CCEF -Holyoke Community College - Holyoke - MA 1 1 0 Inf 100.0%
Webinar PLW: CCEF - Closing the Part-Time Student Success Gap | Presentation Date: 2/19/2020 1 1 0 Inf 100.0%
Webinar PLW: Market-Responsive Strategy Pivot - CCF - 6/1/2020 1 0 1 0.0 0.0%
Webinar Virtual Meeting | CCEF | Customized Presentation | Presentation date: 10/17/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCEF | Future Visioning | Presentation Dates: 01/12/21 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCEF | Hidden Enemies to Strategy | 2/16/21 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCEF | Market-Responsive Strategy Pivot | Presentation date: 9/10/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCEF | Market-Responsive Strategy Pivot | Presentation date: 9/9/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCEF | Setting an Institutional Vision | Presentation date: 10/20/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCEF | State of the Sector | Presentation Date: 01/12/21 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCEF | State of the Sector | Presentation Date: 12/08/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCEF | Student Engagement and Equity: Strategies for Supporting, Teaching and Engaging Students Remotely | Presentation date: 8/24/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCEF | Student Success and Recruiting the Next Generation of Students | Presentation date: 8/20/20 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCF | Achieving Guided Pathways Goals with Student Centered Design 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCF | Closing the Part-Time Student Success Gap 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCF | Custom Session 1 0 1 0.0 0.0%
Webinar Virtual MEeting | CCF | Customized Presentation 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCF | Future Visioning | Presentation Date: 02/11/21 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCF | Future Visioning Workshop | Presentation Date: 02/17/21 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCF | Hidden Enemies to Strategy | 2/15/21 1 1 0 Inf 100.0%
Webinar Virtual Meeting | CCF | Serving Students of the Pandemic 1 1 0 Inf 100.0%
Webinar NA 9 7 2 3.5 77.8%
NA NA 9 1 8 0.1 11.1%
Correlation betwen Event Groupings, and Renewal
  1. Events, Onsites, and Expert Calls are most correlated with renewal.
  2. Positive Correlations: Expert Calls appear to be the most halo-ey.
  3. Negative Correlations: Research Interviews have negative association, but that is due to timing.

Multivariate Regression (still kind of simple) - NNLOA

Note: Looking at all decision types.

  1. For NNLOAs, Events, Onsites, and Expert Calls all show positive statistically significant benefit.
  2. Onsites have the highest effect, followed by Events and Expert Calls.
  Target_Binary
Predictors Odds Ratios CI p
(Intercept) 0.24 0.09 – 0.56 0.002
II Events Volume 1.77 1.16 – 2.89 0.014
II SLLed Volume 1.12 0.79 – 1.61 0.532
II ResearchInterview
Volume 		0.21 0.03 – 0.93 0.072
II PLW Onsite Volume 1.83 0.95 – 3.77 0.082
II ExpertCall Volume 1.24 0.97 – 1.62 0.091
II Service Volume 1.34 0.83 – 2.75 0.390
Observations 114
R2 Tjur 0.255