A brief overview of The statistical engine behind ProBio

Mini retreat - Sept 26, 2022

Outline

International Investigator’s meeting

Outline

Probio design

Study definition

ProBio - An

  • Outcome-adaptive randomized

  • Multi-arm

  • Biomarker-driven

  • Platform-trial

in patients with advanced prostate cancer

Changes in the theapeutic landscape

Traditional vs platform trials

Technical solutions

  • Open ended: new hypotheses can be tested perpetually

  • Master protocol, ideally a central IRB and approval process

  • Leverage design, statistical engine, infrastructure, logistics, IT, …

  • Universal consent process

  • New hypotheses described in amendments

  • Enables a common control arm (increased efficiency)

  • Standing infrastructure for research

Platform-trial design

ProBio Life cycle

Biomarker subgroups vs signatures

Biomarker subgroup (combination)

A genetic biomarker: specific driver mutations or multiple gene alterations.

Color Biomarker Definition Value Prevalence
AR Androgen receptor - (wild) / + (mutated) ~20%
HRD Homologous recombination repair deficiency - (wild) / + (mutated) ~20%
TP53 TP53 - (wild) / + (mutated) ~40%
TEfus TMPRSS2-ERG gene fusion - (wild) / + (mutated) ~30%

The biomarker subgroup of a subject is given by the combination of the binary genetic biomarkers.

Biomarker ---- ---+ --+- --++ -+-- -+-+ -++- -+++ +--- +--+ +-+- +-++ ++-- ++-+ +++-
AR - - - - - - - - + + + + + + +
HRD - - - - + + + + - - - - + + +
TP53 - - + + - - + + - - + + - - +
TEfus - + - + - + - + - + - + - + -
Prevalence 32% 7% 17% 11% 7% 5% 2% 1% 5% 4% 1% 4% 3% 1% 1%

Biomarker signatures

A biomarker signature: specific and complex combination of biomarkers, grouping of previous biomarker subgroups.

Signature ---- ---+ --+- --++ -+-- -+-+ -++- -+++ +--- +--+ +-+- +-++ ++-- ++-+ +++- ++++ Prevalence
all X X X X X X X X X X X X X X X X 100%
TP53- & AR- X X X X 40%
TP53+ X X X X X X X X 45%
HRD+ X X X X X X X X 28%
TEfus+ X X X X X X X X 37%

Observations:
- Each patient belongs to one and only one biomarker subgroup.
- Patients may belong to more than one biomarker signature.

Note:
- Prevalence of some biomarker subgroups is too low for meaningful analysis.

Randomization & Therapies evaluation

Key points

  • Patients are stratified based on their biomarker subgroup combination, and only then randomized to either the control (standard of care) or one of the active arms.

  • Outcome-adaptive randomization is implemented to assign more patients to more promising (effective) therapies within the biomarker subgroup combinations.

  • Therapies are constantly (monthly) evaluated within the biomarker signatures.

Adaptive randomization

Adaptive randomization (subgroup)

  • Depend upon the patient’s biomarker subgroup combination and treatment history.

  • Men with too little tumor burden will be excluded.

  • Adaptive:

    • Fixed before enrolling 50 patients in the active arms.
    • Thereafter, randomization probabilities are updated monthly based on the accumulated data, i.e. based how long subjects respond within the subgroup.
    • How to measure the effectiveness of a therapy vs the control in a biomarker subgroup?

How to compare therapies?

Bayesian survival model

\[S_{lis}(t) = \exp \left(-t^\gamma \lambda_{lis} \right)\]

Scale parameter \(\lambda_{lis} = \exp \left( -\gamma \eta_{lis} \right)\); shape parameter \(\gamma > 0\)

Linear predictor: \(\eta_lis = {\bf{X}}_{lis}\beta_{is}\)

Probability of superiority: \(\pi_{is} = P \left( \beta_{is} > 0 \right)\)

Chosen prior:

  • \(\beta_{is} \sim N \left(0, .5 \right)\)

  • \(\gamma \sim \textrm{Exp} \left( 1 \right)\)

  • \(\beta_0 \sim N \left(3, 1\right)\)

Prior quantities

Probability of superiority

Rule of adaptation

Randomization adaptation

Evaluation of therapies

Evaluation of therapies (signature)

  • Therapies are compared within the biomarker signatures of interest using a common control group as comparator.

  • The main outcome is a survival time (PFS). We will use Bayesian parametric model to contrast the distributions of the mean PFS.

  • Monthly, we will decide if continuing enrollment of new patients to a therapy-signature combination, or to early stop (graduation, futility, max patients).

  • Expert in the Data Safety and Monitoring Board will advice on the action to take.

Comparative analyses within ProBio

Decision rules for therapy \(i\) in the biomarker signature \(s\)

  • graduation:
    • \(n_{is} \ge 20\)
    • \(\pi_{is} \ge .85\)
    • \(\pi_{ij} \ge .65\), with \(j \in s\)
  • stop futility:
    • \(n_{is} \ge 20\)
    • \(\pi_{is} \le .15\)
    • \(\pi_{ij} \le .25\), with \(j \in s\)
  • stop max patients:
    • \(n_{is} \ge 150\)

Evaluation pf therapies over time

Evaluation Therapies

https://stweb.meb.ki.se/

Automatic Report

Operating characteristics

Operating characteristics

  • Key operating characteristics include error and power.

  • Complicated design and assessment of operating characteristics.

  • Errors:

    • strict: graduating a therapy only in a signature where it was not superior to standard-of-care;
    • liberal: graduating a therapy only in subgroups where it was not superior to standard-of-care.
  • Power:

    • strict: graduating a therapy for the signature where it was superior to standard-of-care;
    • liberal: graduating a therapy for any of the subgroups where it was superior to standard-of-care.

Results

  • Overall error rate ~35%-40%, <15% for individual therapies (reduced in the liberal definition).

  • Overall power was ~95% and ranged from 45% to 80% for individual therapies (increased in the liberal definition).

  • Discovery trial, relatively liberal graduation criteria.

  • Graduated combinations will be validated in a side trial nested within the ProBio platform.

Statistical simulations

Simulations ProBio

Simulation Example
ARSi and TP53- & AR-

Assumptions

  • 4 active treatments, 4 biomarker signatures (16 subgroups).

  • Enrollment of 30 patients/month for an evaluation period of 3 years.

  • Standard-of-care mixed of therapies (ARSi: 40%; Taxane: 35%; Other: Other = 25%).

  • Different possible treatment effects.

  • Additional model assumptions.

Assumed treatment effect

ARSi Taxane_CT
TP53- & AR-
mean = 23.4, median = 16.9 mean = 8.8, median = 6.3
af = 2.67, hr = 0.36 af = 1, hr = 1
TP53+
mean = 8.8, median = 6.3 mean = 8.8, median = 6.3
af = 1, hr = 1 af = 1, hr = 1
TEfus+
mean = 10.5, median = 7.6 mean = 8.8, median = 6.3
af = 1.2, hr = 0.83 af = 1, hr = 1

Errors and Power

signature ARSi Taxane_CT Platinum_CT PARPi
all 29 (6%) 2 (0%) 1 (0%) 0 (0%)
TP53- & AR- 414 (83%) 6 (1%) 3 (1%) 2 (0%)
TP53+ 6 (1%) 0 (0%) 3 (1%) 2 (0%)
HRD+ 5 (1%) 0 (0%) 1 (0%) 1 (0%)
TEfus+ 8 (2%) 3 (1%) 2 (0%) 3 (1%)


Oper Char ARSi Taxane_CT Platinum_CT PARPi Overall
Error 0.044 0.022 0.02 0.016 0.090
Power 0.828 0.000 0.00 0.000 0.828

var Control ARSi Taxane_CT Platinum_CT PARPi
TP53- & AR-
graduation 0 414 6 3 2
futility 0 1 386 405 401
max_n 0 50 18 19 25
n 175 (109, 205) 35 (25, 151) 43 (25, 126) 41 (26, 130) 46 (26, 137)
time_trial 36 (36, 36) 11 (7, 36) 24 (14, 36) 23 (13, 36) 23 (14, 36)
TP53+
graduation 0 6 0 3 2
futility 0 31 39 26 26
max_n 0 4 11 10 7
n 181 (159, 204) 83 (34, 120) 88 (52, 125) 85 (57, 123) 87 (55, 125)
time_trial 36 (36, 36) 36 (36, 36) 36 (36, 36) 36 (36, 36) 36 (36, 36)
TEfus+
graduation 0 8 3 2 3
futility 0 6 61 43 40
max_n 0 1 0 0 0
n 147 (126, 168) 58 (29, 88) 75 (43, 101) 70 (45, 95) 71 (48, 96)
time_trial 36 (36, 36) 36 (36, 36) 36 (30, 36) 36 (36, 36) 36 (36, 36)

Results over time

Summary

  • Aim: to identify effective therapies in different biomarker signatures.

  • Biomarker subgroup (randomization) vs signatures (evaluation of therapies).

  • Adaptive randomization: new patients more likely to receive an effective therapy for their biomarker signature.

  • Evaluation of therapies: monthly evaluation to early identify promising therapies in a biomarker signatures.

  • Discovery trial (signals will be further tested in a validation side trial).