ITF Analysis

The purpose of this analysis is to understand the variable effect of impact interactions on the likelihood of a partner to renew their partnership. Simply, which service levers matter more for partnership renewal.

Executive Summary

Methodological Considerations

  1. The data set consists of decisions from FY19 through March of FY22.

  2. Similar to previous analyses, we are primarily looking at the year leading up to a decision.

  3. We are not looking at ‘integrated’ partnerships. That is, we are focusing on utilization at the account where the renewal decision is made.

  4. Lastly, we are looking at unit renewal rates instead of $ renewal rates. This allows us to treat impact interactions equitably across partnerships.

Renewal by Decision Type

The below table should not come as a surprise. Opt Outs tend to perform very well while NNLOA can be quite mixed.

  1. Remember the Ratios: 0.5 for NNLOA, 3.9 for Opt Outs.
  2. NNLOA and Opt Outs are the lowest we’ve seen amongst the individual forums.
Renewal Ratio by Decision Type
DecisionType N ATL Dropped Ratio Perc_Renewed
Need New LOA 113 39 74 0.5 34.5%
Opt Out 76 61 15 4.1 80.3%
Total 189 100 89 1.1 52.9%

Renewals by Decision Type and Year

Since we are combining multiple years of data, we will frequently take a look at whether there are differences across the years.

  1. NNLOA performance was climbing in small steps from FY19 to FY21, FY22 is a decent jump!
  2. Opt Outs have been variable, with FY19 and FY22 looking similar on performance.
Renewal Ratio by Decision Type
DecisionType FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 2019 16 4 12 0.3 25.0%
Need New LOA 2020 41 11 30 0.4 26.8%
Need New LOA 2021 42 15 27 0.6 35.7%
Need New LOA 2022 14 9 5 1.8 64.3%
Opt Out 2019 22 17 5 3.4 77.3%
Opt Out 2020 24 20 4 5.0 83.3%
Opt Out 2021 17 14 3 4.7 82.4%
Opt Out 2022 13 10 3 3.3 76.9%
Total NA 189 100 89 1.1 52.9%
Renewal Rate by Account Segment
  1. Roughly 50% of the decisions lie with Large P&P; performance has been so-so.
  2. Selectives have the second most decisions and very low unit rate.
  3. Regional Publics are relatively healthy!
Renewal Ratio by Account Segment
AccountSegment N ATL Dropped Ratio Perc_Renewed
Canada 8 3 5 0.6 37.5%
Large Public & Private 85 56 29 1.9 65.9%
Regional Private 17 6 11 0.5 35.3%
Regional Public 32 18 14 1.3 56.2%
Selective 47 17 30 0.6 36.2%
Renewal Rate by Account Segment & Fiscal Year
  1. FY22 shows positive momentum across all the segments.
  2. Large P&P has had a substantial increase in renewals this FY, even on a smaller N.
Renewal Ratio by Account Segment
AccountSegment FiscalYear N ATL Dropped Ratio Perc_Renewed
Canada 2019 2 1 1 1.0 50.0%
Canada 2020 2 1 1 1.0 50.0%
Canada 2021 1 0 1 0.0 0.0%
Canada 2022 3 1 2 0.5 33.3%
Large Public & Private 2019 13 8 5 1.6 61.5%
Large Public & Private 2020 23 16 7 2.3 69.6%
Large Public & Private 2021 36 21 15 1.4 58.3%
Large Public & Private 2022 13 11 2 5.5 84.6%
Regional Private 2019 1 0 1 0.0 0.0%
Regional Private 2020 10 4 6 0.7 40.0%
Regional Private 2021 6 2 4 0.5 33.3%
Regional Public 2019 11 7 4 1.8 63.6%
Regional Public 2020 11 5 6 0.8 45.5%
Regional Public 2021 7 4 3 1.3 57.1%
Regional Public 2022 3 2 1 2.0 66.7%
Selective 2019 11 5 6 0.8 45.5%
Selective 2020 19 5 14 0.4 26.3%
Selective 2021 9 2 7 0.3 22.2%
Selective 2022 8 5 3 1.7 62.5%
Renewal by Decision Type & Segment
  1. NNLOA on Large P&P is the most surprising result…we tend to see this well above 50%.
  2. Selective Opt Outs are potentially pulling the avg. down a bit. Not by much, but by enough.
Renewal Ratio by Account Segment
AccountSegment DecisionType N ATL Dropped Ratio Perc_Renewed
Canada Need New LOA 5 1 4 0.2 20.0%
Canada Opt Out 3 2 1 2.0 66.7%
Large Public & Private Need New LOA 45 22 23 1.0 48.9%
Large Public & Private Opt Out 40 34 6 5.7 85.0%
Regional Private Need New LOA 11 2 9 0.2 18.2%
Regional Private Opt Out 6 4 2 2.0 66.7%
Regional Public Need New LOA 19 7 12 0.6 36.8%
Regional Public Opt Out 13 11 2 5.5 84.6%
Selective Need New LOA 33 7 26 0.3 21.2%
Selective Opt Out 14 10 4 2.5 71.4%
CRP Inclusion
  1. Renewal Rate for ITF within CRP is great.
Renewal Ratio by CRP Inclusion
GRP3-4 N ATL Dropped Ratio Perc_Renewed
0 159 71 88 0.8 44.7%
1 30 29 1 29.0 96.7%
Impact Interaction Volume Histogram
  1. Central tendency is around 3.3.
  2. A large proportion of partners are below 3 interactions.
  3. There is long tail with heavy utilizers.

Impact Interaction Volume Histogram Split by Decision
  1. Super users definitively renew at a pretty high rate; the cut off could be around 4+ for this forum.
  2. 0-2 is likely the most concerning data.

Impact Interaction Volume Histogram Split by Pool Date FY
  1. FY22 utilization looks strong: could be part of the reason we might be seeing higher FY22 unit rates.
  2. many of the lower utilizers are FY20 and FY21 partners.

Renewal by Interaction Volume and Decision Type, Unbinned
  1. [NNLOA] Lots of variation: drops even in at the higher utilization. Seems clear that <=2 interactions is not a healthy partner.
  2. [Opt Out] The first forum where it seems Opt Out utilization might make a difference for renewal! 3+ like for NNLOA.
Renewal Ratio by Impact Interaction Volume
DecisionType II_Credited_Volume N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 15 2 13 0.2 13.3%
Need New LOA 1 20 3 17 0.2 15.0%
Need New LOA 2 19 3 16 0.2 15.8%
Need New LOA 3 25 14 11 1.3 56.0%
Need New LOA 4 9 4 5 0.8 44.4%
Need New LOA 5 8 6 2 3.0 75.0%
Need New LOA 6 8 2 6 0.3 25.0%
Need New LOA 7 3 1 2 0.5 33.3%
Need New LOA 8 1 1 0 Inf 100.0%
Need New LOA 9 2 1 1 1.0 50.0%
Need New LOA 10 3 2 1 2.0 66.7%
Opt Out 0 11 9 2 4.5 81.8%
Opt Out 1 11 10 1 10.0 90.9%
Opt Out 2 15 9 6 1.5 60.0%
Opt Out 3 9 7 2 3.5 77.8%
Opt Out 4 6 4 2 2.0 66.7%
Opt Out 5 1 1 0 Inf 100.0%
Opt Out 6 5 5 0 Inf 100.0%
Opt Out 7 5 4 1 4.0 80.0%
Opt Out 8 5 5 0 Inf 100.0%
Opt Out 9 4 3 1 3.0 75.0%
Opt Out 10 1 1 0 Inf 100.0%
Opt Out 11 1 1 0 Inf 100.0%
Opt Out 13 2 2 0 Inf 100.0%
Renewal by Impact Interaction Volume and Decision Type, (Binned)

Adjusted the binning to better capture the high volume present in AAF.

  1. For NNLOA, increased impact interaction volume does tend to be associated with increased likelihood to renew, even if those rates are low.
  2. For NNLOA, 4+ is where this binning suggests there is a cutoff - although if re-binned we might say 3+.
  3. For Opt Out, the drop in the 2-3 bucket is glaring. Seems like utilization and renewal would continue to climb past 3+.
Renewal Ratio by Impact Interaction Volume (Binned)
DecisionType II_Volume_Bins N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 15 2 13 0.2 13.3%
Need New LOA 1 20 3 17 0.2 15.0%
Need New LOA 2-3 44 17 27 0.6 38.6%
Need New LOA 4-6 25 12 13 0.9 48.0%
Need New LOA 7+ 9 5 4 1.2 55.6%
Opt Out 0 11 9 2 4.5 81.8%
Opt Out 1 11 10 1 10.0 90.9%
Opt Out 2-3 24 16 8 2.0 66.7%
Opt Out 4-6 12 10 2 5.0 83.3%
Opt Out 7+ 18 16 2 8.0 88.9%

Renewal by Impact Interaction Volume and Account Segment, (Binned)

  1. Selectives driving that 2-3 bucket result.
  2. For Large P&P, and the Regionals, you see 4+ as a nice demarcation.
Renewal Ratio by Impact Interaction Volume (Binned)
AccountSegment II_Volume_Bins N ATL Dropped Ratio Perc_Renewed
Canada 0 1 0 1 0.0 0.0%
Canada 2-3 4 1 3 0.3 25.0%
Canada 7+ 3 2 1 2.0 66.7%
Large Public & Private 0 10 7 3 2.3 70.0%
Large Public & Private 1 13 8 5 1.6 61.5%
Large Public & Private 2-3 28 16 12 1.3 57.1%
Large Public & Private 4-6 21 15 6 2.5 71.4%
Large Public & Private 7+ 13 10 3 3.3 76.9%
Regional Private 0 3 0 3 0.0 0.0%
Regional Private 1 3 0 3 0.0 0.0%
Regional Private 2-3 9 5 4 1.2 55.6%
Regional Private 4-6 2 1 1 1.0 50.0%
Regional Public 0 7 3 4 0.8 42.9%
Regional Public 1 9 5 4 1.2 55.6%
Regional Public 2-3 9 5 4 1.2 55.6%
Regional Public 4-6 5 4 1 4.0 80.0%
Regional Public 7+ 2 1 1 1.0 50.0%
Selective 0 5 1 4 0.2 20.0%
Selective 1 6 0 6 0.0 0.0%
Selective 2-3 18 6 12 0.5 33.3%
Selective 4-6 9 2 7 0.3 22.2%
Selective 7+ 9 8 1 8.0 88.9%

Selective Renewal by Impact Interaction Volume (Binned) & Decision Type

  1. For Selectives, 7+ might be necessary.
  2. 2-6 you see a ton of variation across the years.
Selective Renewal Ratio by Impact Interaction Volume (Binned) & FY
II_Volume_Bins FiscalYear N ATL Dropped Ratio Perc_Renewed
0 2019 1 0 1 0.0 0.0%
0 2020 2 0 2 0.0 0.0%
0 2021 1 1 0 Inf 100.0%
0 2022 1 0 1 0.0 0.0%
1 2019 1 0 1 0.0 0.0%
1 2020 3 0 3 0.0 0.0%
1 2021 2 0 2 0.0 0.0%
2-3 2019 3 2 1 2.0 66.7%
2-3 2020 6 1 5 0.2 16.7%
2-3 2021 4 0 4 0.0 0.0%
2-3 2022 5 3 2 1.5 60.0%
4-6 2019 3 0 3 0.0 0.0%
4-6 2020 4 1 3 0.3 25.0%
4-6 2021 1 0 1 0.0 0.0%
4-6 2022 1 1 0 Inf 100.0%
7+ 2019 3 3 0 Inf 100.0%
7+ 2020 4 3 1 3.0 75.0%
7+ 2021 1 1 0 Inf 100.0%
7+ 2022 1 1 0 Inf 100.0%

#####Simple Regression for Impact Interaction Volume

  1. The Estimate for Impact Interaction Volume is Positive -> increased consumption means increased likelihood to renew.
  2. This is statistically significant.
  3. Controlling for account segment shows that Impact Interactions seem to matter more for Large P&P and Regional Publics
  Target_Binary
Predictors Odds Ratios CI p
(Intercept) 0.20 0.03 – 1.00 0.061
II Credited Volume 1.26 1.11 – 1.44 <0.001
AccountSegment [Large
Public & Private]
4.60 0.93 – 27.51 0.069
AccountSegment [Regional
Private]
1.70 0.26 – 12.47 0.584
AccountSegment [Regional
Public]
3.91 0.72 – 25.91 0.128
AccountSegment
[Selective]
1.15 0.22 – 7.06 0.867
Observations 189
R2 Tjur 0.146
Penetration by Event Grouping
  1. Events, SL Led, and Expert Calls, are the highest penetration.
  2. Some differences between NNLOA and Opt Outs - Research Interviews and Services.

Reminder:

  1. Experience = VIP Days & Collaboratives

  2. Service = Benchmarking, Audits, Secret Shopper, Customer Research Projects, Market Insights, and Survey Walkthroughs

  3. Expert Call = Expert Center, Benchmarking Walkthrough, Tool’s Walkthrough

  4. SL Led = Research SL Impact, Evergreen Action, Exec Update, National Meeting Pre-wire

  5. Research Interview = Research Initial & Scoping

  6. Events = National Meeting, COVID Working Group

  7. PLW/Onsite = Onsite, PLW

Percent of Renewals w/ At Least 1 Interaction in a Group
DecisionType Perc_Events Perc_Service Perc_SLLed Perc_ResearchInt Perc_PLW_Onsite Perc_Experience Perc_ExpertCall
Need New LOA 48.7% 2.7% 41.6% 29.2% 15.0% 0.0% 53.1%
Opt Out 51.3% 11.8% 43.4% 43.4% 18.4% 0.0% 51.3%
Renewal by Event Consumption
  1. [NNLOA] Get NNLOA to events! The renewal rate when they do not attend is dramatically smaller than when they do.
  2. [Opt Out] Relatively similar results regardless of attendance.
Renewal Ratio by Event Consumption
DecisionType II_Events_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 58 11 47 0.2 19.0%
Need New LOA 1 55 28 27 1.0 50.9%
Opt Out 0 37 29 8 3.6 78.4%
Opt Out 1 39 32 7 4.6 82.1%
Renewal by Event Consumption Volume
  1. You see drops at all ends of the spectrum, just at a decreasing rate with utilization of this service.
  2. 0 is where we don’t want partners.

Renewal by Event & DecisionType, OT

  1. NNLOA who do not attend events are consistently on the very low end.
  2. NNLOA who DO ATTEND are higher, and this FY, extraordinarily higher.
  3. The effect for opt outs is not as pronounced. It bounces up and down across the years.
Renewal Ratio by Event Consumption
DecisionType II_Events_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 2019 13 2 11 0.2 15.4%
Need New LOA 0 2020 25 4 21 0.2 16.0%
Need New LOA 0 2021 15 4 11 0.4 26.7%
Need New LOA 0 2022 5 1 4 0.2 20.0%
Need New LOA 1 2019 3 2 1 2.0 66.7%
Need New LOA 1 2020 16 7 9 0.8 43.8%
Need New LOA 1 2021 27 11 16 0.7 40.7%
Need New LOA 1 2022 9 8 1 8.0 88.9%
Opt Out 0 2019 10 8 2 4.0 80.0%
Opt Out 0 2020 13 10 3 3.3 76.9%
Opt Out 0 2021 6 4 2 2.0 66.7%
Opt Out 0 2022 8 7 1 7.0 87.5%
Opt Out 1 2019 12 9 3 3.0 75.0%
Opt Out 1 2020 11 10 1 10.0 90.9%
Opt Out 1 2021 11 10 1 10.0 90.9%
Opt Out 1 2022 5 3 2 1.5 60.0%
Renewal by Service Consumption
  1. [NNLOA] N too low to draw conclusions.
  2. [Opt Out] N still low, but between NNLOA and Opt Outs, some positive indications.
Renewal Ratio by Service Consumption
DecisionType II_Service_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 110 37 73 0.5 33.6%
Need New LOA 1 3 2 1 2.0 66.7%
Opt Out 0 67 53 14 3.8 79.1%
Opt Out 1 9 8 1 8.0 88.9%
Renewal by Service Consumption Volume

See above.

Renewal by Service Consumption, OT

Curious what they are consuming, since there isn’t much of a pattern.

Renewal Ratio by Service Consumption
II_Service_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
0 2019 32 17 15 1.1 53.1%
0 2020 62 28 34 0.8 45.2%
0 2021 57 27 30 0.9 47.4%
0 2022 26 18 8 2.2 69.2%
1 2019 6 4 2 2.0 66.7%
1 2020 3 3 0 Inf 100.0%
1 2021 2 2 0 Inf 100.0%
1 2022 1 1 0 Inf 100.0%
Renewal by SL Consumption
  1. [NNLOA] SL Led impact interactions seem to have a small lift above the mean.
  2. [Opt Out] No practical difference.
Renewal Ratio by SL-Led Consumption
DecisionType II_SLLed_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 66 20 46 0.4 30.3%
Need New LOA 1 47 19 28 0.7 40.4%
Opt Out 0 43 34 9 3.8 79.1%
Opt Out 1 33 27 6 4.5 81.8%

SL Consumption Volume & Renewal

  1. 2+ interactions seems less peppered with drops.

Renewal by SL Consumption, OT
  1. Consumption: Consistently outperforms no consumption. FY22 pretty strong relative to previous years.
  2. No Consumption: No distinct pattern, but again FY22 appears to be a decent lift above the previous years.
Renewal Ratio by SL-Led Consumption
II_SLLed_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
0 2019 15 7 8 0.9 46.7%
0 2020 31 13 18 0.7 41.9%
0 2021 42 20 22 0.9 47.6%
0 2022 21 14 7 2.0 66.7%
1 2019 23 14 9 1.6 60.9%
1 2020 34 18 16 1.1 52.9%
1 2021 17 9 8 1.1 52.9%
1 2022 6 5 1 5.0 83.3%
Renewal by Research Interview Consumption
  1. [NNLOA] Most of the partners are not engaging in this type of activity. Although, when they do engage, it has relatively high returns.
  2. [Opt Out] No practical difference.
Renewal Ratio by Research Interview Consumption
DecisionType II_ResearchInterview_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 80 22 58 0.4 27.5%
Need New LOA 1 33 17 16 1.1 51.5%
Opt Out 0 43 34 9 3.8 79.1%
Opt Out 1 33 27 6 4.5 81.8%
Research Interview Volume & Renewal
  1. Higher consumption in this category than in the others.
  2. Even 1 interaction in this bucket seems to have benefit.

Renewal By Research Interview Consumption, OT
  1. Consumption: FY19-21 driving a decent portion of these results.
  2. Consumption: FY22 gap has closed. Seeing similar results with and without research interviews.
Renewal Ratio by Research Interview Consumption
II_ResearchInterview_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
0 2019 16 6 10 0.6 37.5%
0 2020 37 14 23 0.6 37.8%
0 2021 53 24 29 0.8 45.3%
0 2022 17 12 5 2.4 70.6%
1 2019 22 15 7 2.1 68.2%
1 2020 28 17 11 1.5 60.7%
1 2021 6 5 1 5.0 83.3%
1 2022 10 7 3 2.3 70.0%
Renewal by PLW OR Onsite Consumption
  1. [NNLOA] Decent lift from getting an Onsite/PLW. Most are not getting this service.
  2. [Opt Out] Seeing some lift from Opt Outs who consume this service.
Renewal Ratio by PLW OR Onsite Consumption
DecisionType II_PLW_Onsite_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 96 31 65 0.5 32.3%
Need New LOA 1 17 8 9 0.9 47.1%
Opt Out 0 62 49 13 3.8 79.0%
Opt Out 1 14 12 2 6.0 85.7%
PLW / Onsite Volume & Renewal
  1. This service is rarely delivered more than one time in a year preceding a decision.

Renewal by PLW/Onsite OT
  1. Besides FY21, the results support the value of this service across the years.
Renewal Ratio by PLW OR Onsite Consumption
II_PLW_Onsite_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
0 2019 30 16 14 1.1 53.3%
0 2020 56 24 32 0.8 42.9%
0 2021 51 26 25 1.0 51.0%
0 2022 21 14 7 2.0 66.7%
1 2019 8 5 3 1.7 62.5%
1 2020 9 7 2 3.5 77.8%
1 2021 8 3 5 0.6 37.5%
1 2022 6 5 1 5.0 83.3%
Renewal by Experience Consumption

No consumption.

Renewal Ratio by Experience Consumption
DecisionType II_Experience_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 113 39 74 0.5 34.5%
Opt Out 0 76 61 15 4.1 80.3%
Experience Volume & Renewal

No Consumption.

Renewal by Experience Consumption OT

No Consumption.

Renewal Ratio by Experience Consumption
II_Experience_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
0 2019 38 21 17 1.2 55.3%
0 2020 65 31 34 0.9 47.7%
0 2021 59 29 30 1.0 49.2%
0 2022 27 19 8 2.4 70.4%
Renewal by Expert Call Consumption
  1. [NNLOA] Not seeing much lift from these types of interactions.
  2. [Opt Out] Inversion. Albeit, not by much, as both consumption and not are close to the mean.
Renewal Ratio by Expert Call Consumption
DecisionType II_ExpertCall_Binary N ATL Dropped Ratio Perc_Renewed
Need New LOA 0 53 18 35 0.5 34.0%
Need New LOA 1 60 21 39 0.5 35.0%
Opt Out 0 37 30 7 4.3 81.1%
Opt Out 1 39 31 8 3.9 79.5%
Expert Call Volume & Renewal
  1. This is another area where we are seeing a lot of impact interaction volume. At 3+, there are fewer drops.
  2. You see relatively similar proportion of drops for 0-2, maybe even more at 2.

Renewal by Expert Call Consumption OT
  1. FY22 is showing that Expert Calls are providing some lift.
  2. FY21 likely pulling the average down for utilization and unit rate.
Renewal Ratio by Expert Call Consumption
II_ExpertCall_Binary FiscalYear N ATL Dropped Ratio Perc_Renewed
0 2019 18 10 8 1.2 55.6%
0 2020 37 17 20 0.8 45.9%
0 2021 26 15 11 1.4 57.7%
0 2022 9 6 3 2.0 66.7%
1 2019 20 11 9 1.2 55.0%
1 2020 28 14 14 1.0 50.0%
1 2021 33 14 19 0.7 42.4%
1 2022 18 13 5 2.6 72.2%

Finer Grain Look at What Was Consumed

Event Category and Event Purpose

  1. COVID working group sessions seemed to be successful.
  2. National Meetings here and there show some success, with small Ns.
  3. Project management Collaborative looks solid!
Renewal Ratio by Event Category and Event Purpose
Event_Category EventPurpose N ATL Dropped Ratio Perc_Renewed
Benchmark IT Cybersecurity Benchmarking Initiative 3 1 2 0.5 33.3%
Benchmark Research Computing Functional Collaborative 4 4 0 Inf 100.0%
COVID Working Group Session ITF COVID-19 Working Group - Responding to COVID19: IT Leaders Roundtable 5 5 0 Inf 100.0%
COVID Working Group Session Summer 2020 ITF COVID Research 19 13 6 2.2 68.4%
Diagnostic or Audit Custom Research Projects 1 1 0 Inf 100.0%
Diagnostic or Audit EAB IT Functional Diagnostic 4 4 0 Inf 100.0%
Evergreen Action Evergreen Action 20 11 9 1.2 55.0%
Executive Update Executive Update 3 2 1 2.0 66.7%
Expert Center Expert Center 62 33 31 1.1 53.2%
Expert Center Expert Center Call 31 14 17 0.8 45.2%
Market Research NA 1 1 0 Inf 100.0%
National Meeting 2017-2018 IT Forum, Chicago, IL 1 0 1 0.0 0.0%
National Meeting 2018 IT Forum National Member meeting, Chicago, IL 4 4 0 Inf 100.0%
National Meeting 2018 IT Forum National Member meeting, Los Angeles, CA 3 2 1 2.0 66.7%
National Meeting 2018 IT Forum National Member meeting, Washington, DC 17 12 5 2.4 70.6%
National Meeting 2018 IT Forum Special Session, Washington, DC 1 0 1 0.0 0.0%
National Meeting 2019-2020 IT Forum National Meeting Series, 9 3 6 0.5 33.3%
National Meeting 2019-2020 IT Forum National Meeting Series, Chicago, IL 1 0 1 0.0 0.0%
National Meeting 2019-2020 IT Forum National Meeting Series, Los Angeles, CA 10 5 5 1.0 50.0%
National Meeting 2019-2020 IT Forum National Meeting Series, Washington, DC 9 5 4 1.2 55.6%
National Meeting Addressing the Burgeoning Demand for Data, 1 1 0 Inf 100.0%
National Meeting Build Agility and Stamina for Continuous Innovation – A Conversation with Connie Atchley, CIO at Ore, 3 2 1 2.0 66.7%
National Meeting CIO Advisory Group - Future Modifications to Teaching & Learning Strategies, 1 1 0 Inf 100.0%
National Meeting CIO Advisory Group on Cybersecurity, 4 3 1 3.0 75.0%
National Meeting Confront the Mandate for Change – a Conversation with Mario Lebar, CIO at University of Manitoba, 7 5 2 2.5 71.4%
National Meeting How IT Leaders are Adapting to Remote Work: A Conversation with Peers, 2 2 0 Inf 100.0%
National Meeting IT Executive Working Session: Rationalizing Your Vendor Portfolio Amid COVID-19, 4 3 1 3.0 75.0%
National Meeting ITF Fall Term Troubleshooting Sessions: Learn How CIOs are Navigating Fall Term during COVID-19, 16 9 7 1.3 56.2%
National Meeting Optimizing the IT Vendor Portfolio in an Era of Constrained Budgets, 9 6 3 2.0 66.7%
National Meeting Q&A Panel: Navigating CMMC in Higher Education, 5 4 1 4.0 80.0%
National Meeting Strategies to Optimize Remote Work: Preparing the Campus and the Workforce for a New Era of Flexibil, 12 7 5 1.4 58.3%
National Meeting Virtual Working Session ITF: Responding to COVID19: IT Leaders Virtual Roundtable, 7 7 0 Inf 100.0%
National Meeting Where is Technology Stifling Innovation? – a Conversation with Michael Cato, CIO at Bowdoin College, 6 5 1 5.0 83.3%
National Meeting Pre-Wire National Meeting Pre-Wire 3 0 3 0.0 0.0%
Onsite Hold exp. 9/18 | Onsite | ITF | Presentation Date: 11/21/2019 1 1 0 Inf 100.0%
Onsite Onsite | ITF | 01/10/2018 1 1 0 Inf 100.0%
Onsite Onsite | ITF | 01/24/2019 1 1 0 Inf 100.0%
Onsite Onsite | ITF | 06/19/18 1 1 0 Inf 100.0%
Onsite Onsite | ITF | 09/25/2018 1 0 1 0.0 0.0%
Onsite Onsite | ITF | Presentation Date: 03/21/2019 1 1 0 Inf 100.0%
Onsite Onsite | ITF | Presentation Date: 06/04/2019 1 0 1 0.0 0.0%
Onsite Onsite | ITF | Presentation Date: 06/20/2019 1 1 0 Inf 100.0%
Onsite Onsite | ITF | Presentation Date: 06/28/2019 1 1 0 Inf 100.0%
Onsite Onsite | ITF | Presentation Date: 09/24/2019 1 1 0 Inf 100.0%
Onsite Onsite | ITF |11/29/2018 1 0 1 0.0 0.0%
Onsite Onsite | ITF |12/13/2018 1 1 0 Inf 100.0%
Onsite Onsite: *Customized Presentation - ITF - 11/19/2019 1 0 1 0.0 0.0%
Research Initial 2019 Digital Projects Compendium 6 6 0 Inf 100.0%
Research Initial 2019 IT Org Design 27 16 12 1.3 59.3%
Research Initial 2020-2021 ITF Scoping 3 1 2 0.5 33.3%
Research Initial 2021 - Cybersecurity Refresh 11 9 2 4.5 81.8%
Research Initial Digital Transformation 2018-19 6 3 3 1.0 50.0%
Research Initial Enterprise Systems Functional Collaborative 3 1 2 0.5 33.3%
Research Initial IT Financial Operations 1 1 0 Inf 100.0%
Research Initial IT Metrics 2018-19 6 5 1 5.0 83.3%
Research Initial IT Risk Management 2 1 1 1.0 50.0%
Research Initial ITSM Functional Collaborative 1 1 0 Inf 100.0%
Research Initial Project Management Functional Collaborative 15 12 3 4.0 80.0%
Research Initial Research Computing Functional Collaborative 4 3 1 3.0 75.0%
Research SL Impact Research SL Impact - Arne Almquist In Person Meeting 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Call 2 1 1 1.0 50.0%
Research SL Impact Research SL Impact - Check In 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Check In Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - CLAC IT Webinar Attendance 2 1 1 1.0 50.0%
Research SL Impact Research SL Impact - Connie Atchley In Person Meeting 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Duplicate event- Joint renewal & service call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - EAB Expert Call re: digital strategy and innovation 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Expert Call 3 1 2 0.5 33.3%
Research SL Impact Research SL Impact - In Person Meeting 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - In Person Visit 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - in person visit at meeting 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - INT UCCS ITF Visit 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - IT Forum Discussion 2 1 1 1.0 50.0%
Research SL Impact Research SL Impact - IT Team Leadership Meeting 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - ITF call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - ITF Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Leadership Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Market Insights Case 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Meeting - UCSB - ITF - Matt Hall 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - Meeting at ITF Meeting 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - MSU ITF Quarterly Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Networking Conversation 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Second Exec Roundtable Topic 7 3 4 0.8 42.9%
Research SL Impact Research SL Impact - SF TU ITF benchmarking PA 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - SL Impact Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - SL Impact Interaction with Beth Barrie and Team 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - Transition Call 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact - UA EDH Call 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - User Group and resource explanation 1 1 0 Inf 100.0%
Research SL Impact Research SL Impact - VIP Day Meeting 1 0 1 0.0 0.0%
Research SL Impact Research SL Impact Visit 29 20 9 2.2 69.0%
Scoping 2020-2021 ITF Scoping 3 3 0 Inf 100.0%
Scoping ITF 2021 Topic Scoping Conversations 6 4 2 2.0 66.7%
Tool’s Walkthrough Tool’s Walk Through 9 7 2 3.5 77.8%
Tool’s Walkthrough Tool’s Walk Through Call 1 0 1 0.0 0.0%
Webinar Onsite | Customized Presentation - BAF | Presentation Date: 5/14-5/15 1 0 1 0.0 0.0%
Webinar Onsite: Building a Digital University - ITF - 2/7/2020 1 0 1 0.0 0.0%
Webinar PLW | ITF | Presentation Date: 05/16/2019 1 1 0 Inf 100.0%
Webinar PLW | ITF | 06/11/2018 1 1 0 Inf 100.0%
Webinar PLW | ITF | Presentation Date: 03/26/2019 1 1 0 Inf 100.0%
Webinar PLW | ITF | Presentation Date: 05/07/2019 1 0 1 0.0 0.0%
Webinar PLW | ITF | Presentation Date: 05/09/2019 1 1 0 Inf 100.0%
Webinar PLW | ITF | Presentation Date: 05/21/2019 1 1 0 Inf 100.0%
Webinar PLW: Aligning Form and Function - ITF - 2/27/2020 1 1 0 Inf 100.0%
Webinar PLW: Driving Digital Transformation - ITF - 4/16/2020 1 1 0 Inf 100.0%
Webinar Virtual Meeting | IT Strategic Planning - ITF | Presentation Date: 9/17/2020 1 0 1 0.0 0.0%
Webinar Virtual Meeting | ITF | Building a Digital University | 4/5/21 1 0 1 0.0 0.0%
Webinar Virtual Meeting | ITF | Creating a Data-Driven University | Presentation Date: 07/12/21 1 1 0 Inf 100.0%
Webinar Virtual Meeting | ITF | Data Governance 1 1 0 Inf 100.0%
Webinar Virtual Meeting | ITF | IT COVID 19 Response Assessment | 2/11/21 1 1 0 Inf 100.0%
Webinar Virtual Meeting | ITF | IT Governance 2.0 1 1 0 Inf 100.0%
Webinar Virtual Meeting | ITF | IT Governance 2.0 | 3/11/21 1 0 1 0.0 0.0%
Webinar Virtual Meeting | ITF | IT Strategic Planning 1 1 0 Inf 100.0%
Webinar Virtual Meeting | ITF | IT Strategy Pivot Workshop 1 0 1 0.0 0.0%
Webinar Virtual Meeting | ITF | Strategies to Optimize Remote Work 1 1 0 Inf 100.0%
Webinar Virtual Meeting | ITF | Talent Management 1 1 0 Inf 100.0%
Webinar Virtual Meeting | ITF | Untethering the Workforce 1 1 0 Inf 100.0%
Webinar Virtual Presentation | ITF | Sunsetting Technologies | Presentation Date: 10/20/20 1 0 1 0.0 0.0%
Webinar NA 1 1 0 Inf 100.0%
NA NA 22 9 14 0.6 40.9%
Correlation betwen Event Groupings, and Renewal
  1. Events and Research Interviews are most correlated with renewal.
  2. Research Interviews have a halo effect; events also seem to have a halo.

Multivariate Regression (still kind of simple)

Note: Looking at all decision types.

  1. Events and Research Interviews pop as significant.
  2. Service is close.
  Target_Binary
Predictors Odds Ratios CI p
(Intercept) 0.62 0.39 – 0.99 0.047
II Events Volume 1.40 1.06 – 1.92 0.025
II SLLed Volume 1.02 0.70 – 1.50 0.904
II ResearchInterview
Volume
1.44 1.03 – 2.10 0.041
II PLW Onsite Volume 1.36 0.67 – 2.89 0.403
II ExpertCall Volume 0.95 0.74 – 1.23 0.684
II Service Volume 3.72 1.12 – 23.18 0.073
Observations 189
R2 Tjur 0.103

Combinations of Impact Interactions

Renewal Ratio by Impact Interaction Combos
II_Combo_Text N ATL Dropped Ratio Perc_Renewed
NA 22 9 14 0.6 40.9%
SL-Led Impact 10 3 7 0.4 30.0%
Expert Call; Expert Call 7 0 7 0.0 0.0%
Events 6 3 3 1.0 50.0%
Expert Call 6 3 4 0.8 50.0%
Events; Expert Call 4 1 3 0.3 25.0%
Events; SL-Led Impact 4 1 3 0.3 25.0%
Research Interview 3 2 1 2.0 66.7%
Research Interview; SL-Led Impact 3 2 1 2.0 66.7%
Events; Events 2 0 2 0.0 0.0%
Events; PLW/Onsite; Research Interview 2 2 0 Inf 100.0%
Expert Call; Expert Call; Expert Call 2 0 2 0.0 0.0%
Expert Call; Expert Call; Expert Call; Events 2 2 0 Inf 100.0%
PLW/Onsite 2 1 1 1.0 50.0%
PLW/Onsite; Expert Call 2 1 1 1.0 50.0%
SL-Led Impact; Expert Call 2 0 2 0.0 0.0%
SL-Led Impact; Expert Call; SL-Led Impact 2 2 0 Inf 100.0%
Events; Events; Events 1 1 0 Inf 100.0%
Events; Events; Events; PLW/Onsite; PLW/Onsite; SL-Led Impact; Research Interview 1 1 0 Inf 100.0%
Events; Events; Events; Research Interview 1 1 0 Inf 100.0%
Events; Events; Events; Service/Tool; Expert Call; Expert Call; Expert Call; Service/Tool 1 1 0 Inf 100.0%
Events; Events; Events; SL-Led Impact; Events; SL-Led Impact; Expert Call; SL-Led Impact; PLW/Onsite 1 0 1 0.0 0.0%
Events; Events; Events; SL-Led Impact; SL-Led Impact; SL-Led Impact; Events; Research Interview; Events 1 1 0 Inf 100.0%
Events; Events; Research Interview; SL-Led Impact; Events; Expert Call; Expert Call 1 0 1 0.0 0.0%
Events; Events; Research Interview; SL-Led Impact; SL-Led Impact; PLW/Onsite; Research Interview; Expert Call 1 1 0 Inf 100.0%
Events; Expert Call; Events 1 0 1 0.0 0.0%
Events; Expert Call; Events; Events; Events; Events; Research Interview; Events 1 1 0 Inf 100.0%
Events; Expert Call; Expert Call 1 1 0 Inf 100.0%
Events; Expert Call; Expert Call; Events 1 0 1 0.0 0.0%
Events; Expert Call; Expert Call; Expert Call; Expert Call; Events 1 0 1 0.0 0.0%
Events; Expert Call; Expert Call; SL-Led Impact 1 1 0 Inf 100.0%
Events; Expert Call; SL-Led Impact 1 1 0 Inf 100.0%
Events; Expert Call; SL-Led Impact; Expert Call; Events; SL-Led Impact 1 0 1 0.0 0.0%
Events; PLW/Onsite; Events; Expert Call; PLW/Onsite; Expert Call; Events; Research Interview; Expert Call 1 0 1 0.0 0.0%
Events; PLW/Onsite; SL-Led Impact; Events; Events; Events; Events 1 0 1 0.0 0.0%
Events; Research Interview 1 1 0 Inf 100.0%
Events; Research Interview; Expert Call 1 1 0 Inf 100.0%
Events; Research Interview; Expert Call; Research Interview; SL-Led Impact; Events; Events 1 1 0 Inf 100.0%
Events; Research Interview; Research Interview; Expert Call; SL-Led Impact; SL-Led Impact; PLW/Onsite 1 0 1 0.0 0.0%
Events; SL-Led Impact; Events 1 1 0 Inf 100.0%
Events; SL-Led Impact; Events; Expert Call; Events; Expert Call 1 1 0 Inf 100.0%
Events; SL-Led Impact; Expert Call; Events; Service/Tool 1 1 0 Inf 100.0%
Events; SL-Led Impact; Expert Call; Service/Tool; Research Interview; Research Interview 1 1 0 Inf 100.0%
Events; SL-Led Impact; SL-Led Impact; Events; Expert Call; Events; Events; SL-Led Impact; Events 1 1 0 Inf 100.0%
Events; SL-Led Impact; SL-Led Impact; Expert Call; SL-Led Impact; SL-Led Impact 1 0 1 0.0 0.0%
Expert Call; Events 1 1 0 Inf 100.0%
Expert Call; Events; Events 1 1 0 Inf 100.0%
Expert Call; Events; Events; Events; Events 1 0 1 0.0 0.0%
Expert Call; Expert Call; Events 1 0 1 0.0 0.0%
Expert Call; Expert Call; Expert Call; Expert Call; Events; Events 1 1 0 Inf 100.0%
Expert Call; Expert Call; Expert Call; Expert Call; PLW/Onsite; Expert Call; Research Interview; Expert Call 1 1 0 Inf 100.0%
Expert Call; Expert Call; Expert Call; Expert Call; SL-Led Impact; Expert Call 1 0 1 0.0 0.0%
Expert Call; Expert Call; PLW/Onsite; Expert Call 1 0 1 0.0 0.0%
Expert Call; Expert Call; PLW/Onsite; SL-Led Impact; Events; Expert Call; PLW/Onsite; Research Interview 1 1 0 Inf 100.0%
Expert Call; Expert Call; Service/Tool; Events; Events; Events 1 1 0 Inf 100.0%
Expert Call; Expert Call; SL-Led Impact 1 0 1 0.0 0.0%
Expert Call; Research Interview; Events 1 0 1 0.0 0.0%
Expert Call; Research Interview; Expert Call; Expert Call; Expert Call; SL-Led Impact; Events; Expert Call; Research Interview; Research Interview; Research Interview; Expert Call; Expert Call 1 1 0 Inf 100.0%
Expert Call; Research Interview; Research Interview 1 1 0 Inf 100.0%
Expert Call; Service/Tool; SL-Led Impact 1 1 0 Inf 100.0%
Expert Call; SL-Led Impact 1 1 0 Inf 100.0%
Expert Call; SL-Led Impact; Events; Expert Call; Expert Call; Expert Call; Expert Call; PLW/Onsite; Expert Call; Research Interview; Research Interview 1 1 0 Inf 100.0%
Expert Call; SL-Led Impact; Events; Research Interview 1 0 1 0.0 0.0%
Expert Call; SL-Led Impact; Events; SL-Led Impact; Events; Events 1 1 0 Inf 100.0%
Expert Call; SL-Led Impact; Expert Call; Events; SL-Led Impact 1 1 0 Inf 100.0%
Expert Call; SL-Led Impact; SL-Led Impact; Events; Events; SL-Led Impact 1 0 1 0.0 0.0%
Expert Call; SL-Led Impact; SL-Led Impact; SL-Led Impact 1 1 0 Inf 100.0%
PLW/Onsite; Events 1 0 1 0.0 0.0%
PLW/Onsite; Events; Events; Events 1 1 0 Inf 100.0%
PLW/Onsite; Expert Call; PLW/Onsite 1 1 0 Inf 100.0%
PLW/Onsite; Expert Call; Research Interview 1 0 1 0.0 0.0%
PLW/Onsite; Expert Call; SL-Led Impact; PLW/Onsite; Research Interview; Events; Events; Research Interview; Events 1 1 0 Inf 100.0%
PLW/Onsite; PLW/Onsite 1 1 0 Inf 100.0%
PLW/Onsite; Research Interview 1 0 1 0.0 0.0%
PLW/Onsite; Research Interview; Research Interview; Events; SL-Led Impact; SL-Led Impact; SL-Led Impact; Expert Call; Research Interview; Research Interview 1 1 0 Inf 100.0%
Research Interview; Events 1 0 1 0.0 0.0%
Research Interview; Events; Events; Events; Expert Call; Events; Expert Call; Research Interview; Expert Call; Events 1 1 0 Inf 100.0%
Research Interview; Events; Events; Expert Call; Events; Events; Expert Call 1 1 0 Inf 100.0%
Research Interview; Events; Expert Call; Expert Call; Expert Call; PLW/Onsite 1 1 0 Inf 100.0%
Research Interview; Events; Expert Call; SL-Led Impact 1 0 1 0.0 0.0%
Research Interview; Events; PLW/Onsite 1 1 0 Inf 100.0%
Research Interview; Events; SL-Led Impact 1 1 0 Inf 100.0%
Research Interview; Expert Call; Expert Call 1 1 0 Inf 100.0%
Research Interview; Expert Call; Expert Call; Expert Call; SL-Led Impact; Research Interview 1 0 1 0.0 0.0%
Research Interview; Expert Call; SL-Led Impact 1 0 1 0.0 0.0%
Research Interview; Research Interview 1 1 0 Inf 100.0%
Research Interview; Research Interview; Events; Expert Call; SL-Led Impact 1 0 1 0.0 0.0%
Research Interview; Research Interview; Events; Research Interview; SL-Led Impact; PLW/Onsite; Events 1 1 0 Inf 100.0%
Research Interview; Research Interview; Expert Call 1 0 1 0.0 0.0%
Research Interview; Research Interview; Expert Call; Events; Events 1 1 0 Inf 100.0%
Research Interview; Research Interview; Expert Call; Expert Call 1 0 1 0.0 0.0%
Research Interview; Research Interview; Expert Call; Expert Call; Expert Call; Events; Expert Call; PLW/Onsite; SL-Led Impact; Events 1 1 0 Inf 100.0%
Research Interview; Research Interview; Research Interview 1 1 0 Inf 100.0%
Research Interview; Research Interview; Research Interview; PLW/Onsite; Expert Call; Research Interview; Events; Research Interview; SL-Led Impact; Service/Tool; Research Interview; Research Interview; Research Interview 1 1 0 Inf 100.0%
Research Interview; Research Interview; Research Interview; Research Interview; Expert Call; Events 1 0 1 0.0 0.0%
Research Interview; Research Interview; Research Interview; SL-Led Impact 1 1 0 Inf 100.0%
Research Interview; Research Interview; Service/Tool 1 1 0 Inf 100.0%
Research Interview; Research Interview; SL-Led Impact; Events 1 1 0 Inf 100.0%
Research Interview; Research Interview; SL-Led Impact; Events; Research Interview 1 1 0 Inf 100.0%
Research Interview; Research Interview; SL-Led Impact; Research Interview; PLW/Onsite; SL-Led Impact; PLW/Onsite; Events 1 1 0 Inf 100.0%
Research Interview; Research Interview; SL-Led Impact; Research Interview; SL-Led Impact; Events; Expert Call 1 1 0 Inf 100.0%
Research Interview; SL-Led Impact; Research Interview 1 1 0 Inf 100.0%
Service/Tool; Research Interview; Research Interview; Events; Expert Call; Expert Call; Expert Call; SL-Led Impact; Expert Call 1 1 0 Inf 100.0%
Service/Tool; Research Interview; Research Interview; Research Interview; Service/Tool; Expert Call 1 1 0 Inf 100.0%
Service/Tool; Service/Tool 1 0 1 0.0 0.0%
SL-Led Impact; Events 1 1 0 Inf 100.0%
SL-Led Impact; Events; Expert Call 1 1 0 Inf 100.0%
SL-Led Impact; Events; Research Interview; Expert Call 1 0 1 0.0 0.0%
SL-Led Impact; Events; Research Interview; SL-Led Impact 1 0 1 0.0 0.0%
SL-Led Impact; Events; SL-Led Impact 1 1 0 Inf 100.0%
SL-Led Impact; Expert Call; Expert Call 1 0 1 0.0 0.0%
SL-Led Impact; Research Interview 1 0 1 0.0 0.0%
SL-Led Impact; Research Interview; Events; SL-Led Impact; Expert Call 1 1 0 Inf 100.0%
SL-Led Impact; Service/Tool; Research Interview 1 0 1 0.0 0.0%
SL-Led Impact; SL-Led Impact; Events 1 0 1 0.0 0.0%
SL-Led Impact; SL-Led Impact; Research Interview; Expert Call; SL-Led Impact; PLW/Onsite; Research Interview; Research Interview; Research Interview; Research Interview 1 0 1 0.0 0.0%
SL-Led Impact; SL-Led Impact; Service/Tool; SL-Led Impact; Service/Tool 1 1 0 Inf 100.0%
SL-Led Impact; SL-Led Impact; SL-Led Impact; Events; SL-Led Impact 1 1 0 Inf 100.0%

Looking At Combinations of Different Groupings

Renewal Ratio by Impact Interaction Combos Slim
II_Combo_Text_Slim N ATL Dropped Ratio Perc_Renewed
NA 22 9 14 0.6 40.9%
Expert Call 15 3 13 0.2 20.0%
SL-Led Impact 10 3 7 0.4 30.0%
Events 9 4 5 0.8 44.4%
Expert Call; Events 8 4 4 1.0 50.0%
Events; Expert Call 6 2 4 0.5 33.3%
Events; SL-Led Impact 6 4 2 2.0 66.7%
Research Interview 5 4 1 4.0 80.0%
Research Interview; SL-Led Impact 5 3 2 1.5 60.0%
SL-Led Impact; Expert Call 5 2 3 0.7 40.0%
Expert Call; PLW/Onsite 4 2 2 1.0 50.0%
Expert Call; SL-Led Impact 4 2 2 1.0 50.0%
PLW/Onsite 3 2 1 2.0 66.7%
SL-Led Impact; Events; Expert Call 3 1 2 0.5 33.3%
Events; Expert Call; Research Interview 2 2 0 Inf 100.0%
Events; PLW/Onsite 2 1 1 1.0 50.0%
Events; PLW/Onsite; Research Interview 2 2 0 Inf 100.0%
Events; Research Interview 2 2 0 Inf 100.0%
Events; Research Interview; Expert Call 2 2 0 Inf 100.0%
Events; SL-Led Impact; Expert Call 2 2 0 Inf 100.0%
Expert Call; Events; SL-Led Impact 2 1 1 1.0 50.0%
Expert Call; Research Interview 2 1 1 1.0 50.0%
Expert Call; Research Interview; Events; SL-Led Impact 2 0 2 0.0 0.0%
Research Interview; Expert Call 2 1 1 1.0 50.0%
Research Interview; Expert Call; Events 2 1 1 1.0 50.0%
SL-Led Impact; Events 2 0 2 0.0 0.0%
SL-Led Impact; Events; Research Interview 2 2 0 Inf 100.0%
SL-Led Impact; Expert Call; Events 2 2 0 Inf 100.0%
Events; Expert Call; SL-Led Impact 1 1 0 Inf 100.0%
Events; PLW/Onsite; SL-Led Impact; Expert Call; Research Interview 1 1 0 Inf 100.0%
Events; Research Interview; SL-Led Impact 1 1 0 Inf 100.0%
Events; Research Interview; SL-Led Impact; Expert Call 1 0 1 0.0 0.0%
Events; Research Interview; SL-Led Impact; PLW/Onsite; Expert Call 1 0 1 0.0 0.0%
Events; Research Interview; SL-Led Impact; Service/Tool; Expert Call 1 1 0 Inf 100.0%
Events; Service/Tool; Expert Call 1 1 0 Inf 100.0%
Events; SL-Led Impact; Research Interview 1 0 1 0.0 0.0%
Expert Call; Events; PLW/Onsite; SL-Led Impact 1 0 1 0.0 0.0%
Expert Call; Events; Research Interview; SL-Led Impact; PLW/Onsite 1 1 0 Inf 100.0%
Expert Call; PLW/Onsite; Research Interview 1 1 0 Inf 100.0%
Expert Call; Research Interview; Events 1 0 1 0.0 0.0%
Expert Call; Research Interview; SL-Led Impact; Events 1 0 1 0.0 0.0%
Expert Call; Service/Tool; Research Interview; SL-Led Impact; Events 1 1 0 Inf 100.0%
Expert Call; Service/Tool; SL-Led Impact 1 1 0 Inf 100.0%
Expert Call; Service/Tool; SL-Led Impact; Events 1 1 0 Inf 100.0%
Expert Call; SL-Led Impact; PLW/Onsite; Research Interview; Events 1 1 0 Inf 100.0%
Expert Call; SL-Led Impact; Research Interview; Events 1 1 0 Inf 100.0%
PLW/Onsite; Events; Expert Call; Research Interview 1 1 0 Inf 100.0%
PLW/Onsite; Events; SL-Led Impact 1 0 1 0.0 0.0%
PLW/Onsite; Expert Call; Events; Research Interview 1 0 1 0.0 0.0%
PLW/Onsite; Research Interview 1 0 1 0.0 0.0%
PLW/Onsite; Research Interview; Events 1 1 0 Inf 100.0%
PLW/Onsite; Research Interview; Events; Expert Call; SL-Led Impact 1 1 0 Inf 100.0%
PLW/Onsite; Research Interview; SL-Led Impact; Events 1 1 0 Inf 100.0%
Research Interview; Events 1 0 1 0.0 0.0%
Research Interview; Events; Expert Call; PLW/Onsite; SL-Led Impact 1 1 0 Inf 100.0%
Research Interview; Events; Expert Call; SL-Led Impact 1 1 0 Inf 100.0%
Research Interview; Expert Call; PLW/Onsite; SL-Led Impact; Events; Service/Tool 1 1 0 Inf 100.0%
Research Interview; Expert Call; Service/Tool 1 1 0 Inf 100.0%
Research Interview; Expert Call; SL-Led Impact 1 0 1 0.0 0.0%
Research Interview; PLW/Onsite; Expert Call 1 0 1 0.0 0.0%
Research Interview; PLW/Onsite; SL-Led Impact; Events 1 1 0 Inf 100.0%
Research Interview; Service/Tool 1 1 0 Inf 100.0%
Research Interview; SL-Led Impact; Events 1 1 0 Inf 100.0%
Research Interview; SL-Led Impact; Expert Call; Events 1 1 0 Inf 100.0%
Research Interview; SL-Led Impact; Expert Call; PLW/Onsite 1 0 1 0.0 0.0%
Service/Tool 1 0 1 0.0 0.0%
Service/Tool; Events; Expert Call 1 1 0 Inf 100.0%
Service/Tool; SL-Led Impact 1 1 0 Inf 100.0%
Service/Tool; SL-Led Impact; Research Interview 1 0 1 0.0 0.0%
SL-Led Impact; Events; Research Interview; Expert Call 1 1 0 Inf 100.0%
SL-Led Impact; Events; Research Interview; Expert Call; PLW/Onsite 1 1 0 Inf 100.0%
SL-Led Impact; Expert Call; Research Interview 1 0 1 0.0 0.0%
SL-Led Impact; Expert Call; Research Interview; Events 1 0 1 0.0 0.0%
SL-Led Impact; PLW/Onsite; Events; Research Interview 1 1 0 Inf 100.0%
SL-Led Impact; Research Interview 1 1 0 Inf 100.0%