Item-by-item medians

Median values for each item of the PQAYS, from 2019-2021, by program.

These item-by-item medians primarily serve as a reference and are provided for completion. I think reviewing the data at a sub-scale level is much more informative as 1) more data are aggregated and therefore there is more data to support the finding, 2) there are fewer data points to consider which is helpful in understanding higher-level program insights, and 3) looking at the original scale, I am not sure it was intended be used at an item-by-item level (i.e., it seems as though the intent was to measure program performance based on the 8 sub-scales).

In my mind this would serve as an appendix doc or an internal reference document if needed.

The one thing to note I think – there seems to be, across many programs and individual items/sub-scales, a dip in 2021.

– After speaking to MW & BH, this is likely related to 2021 programming being virtual. As such, the last section of this report compares PQAYS scores, by sub-scale, between in-person and virtual settings.

1a - Physical safety

PQAYS data for sub-scale 1a, grouped by year and program.

## `summarise()` has grouped output by 'program.clean'. You can override using the
## `.groups` argument.
Program Year 1.1a - Hazard free 1.2a - Appropriate space 1.3a - Supervision provided 1.4a - First aid available 1.5a - Appropriate equipment 1.6a - Positive health 1.7a - Distraction free 1.8a - Injury response
Ball hockey 2019 5.0 5.0 5.0 5 4.0 3.0 3.0 3.5
Ball hockey 2020 5.0 5.0 5.0 5 5.0 4.0 NA NA
Basketball 2019 3.0 5.0 5.0 5 5.0 4.0 4.5 NA
Basketball 2020 5.0 5.0 5.0 5 5.0 5.0 NA NA
Boxing 2020 4.5 5.0 5.0 5 5.0 5.0 NA NA
Fuel for Fun 2019 5.0 5.0 5.0 5 5.0 4.0 5.0 0.0
Fuel for Fun 2020 5.0 5.0 5.0 5 5.0 5.0 NA NA
Fuel for Fun 2021 3.5 3.5 3.5 2 2.0 3.5 NA NA
Girls Multisport 2019 5.0 5.0 4.5 5 5.0 4.5 0.0 0.0
Girls Multisport 2020 5.0 5.0 5.0 5 5.0 3.5 NA NA
Girls Multisport 2021 4.5 4.0 5.0 2 4.0 5.0 NA NA
Healthy Me 2019 5.0 4.5 5.0 5 4.0 4.5 3.5 NA
Healthy Me 2020 4.0 4.0 4.0 5 4.5 4.0 NA NA
Healthy Me 2021 3.0 3.5 4.5 1 4.5 5.0 NA NA
Multisport 2019 4.5 4.5 5.0 5 5.0 5.0 2.0 0.0
Multisport 2020 5.0 5.0 5.0 5 5.0 4.0 NA NA
Multisport 2021 5.0 4.0 5.0 3 4.0 5.0 NA NA
Npower 2020 5.0 5.0 5.0 5 5.0 3.5 NA NA
Npower 2021 4.0 4.0 2.0 2 3.0 5.0 NA NA
Pathways 2020 5.0 5.0 5.0 5 5.0 5.0 5.0 NA
QSLA 2019 4.5 4.5 5.0 5 5.0 3.5 2.5 0.0
Sharing dance 2019 3.5 3.0 5.0 4 5.0 3.5 4.0 0.0
Sharing dance 2020 3.0 3.5 5.0 5 4.0 5.0 4.0 NA
Social circus 2019 5.0 5.0 5.0 5 2.0 5.0 5.0 0.0
Sport and Stem 2019 5.0 5.0 5.0 5 5.0 4.5 5.0 0.0
Sport and Stem 2020 5.0 5.0 5.0 5 5.0 4.0 NA NA
Sport and Stem 2021 3.5 3.5 2.0 2 2.0 3.5 NA NA
Square circle 2019 5.0 5.0 5.0 5 5.0 5.0 5.0 0.0
Square circle 2020 5.0 5.0 5.0 5 5.0 5.0 4.5 NA
Volleyball 2019 4.5 4.0 5.0 5 4.0 4.0 2.0 NA
Volleyball 2020 5.0 5.0 5.0 5 5.0 3.5 NA NA
NA 2019 5.0 5.0 5.0 5 4.0 3.5 0.0 0.0

1b - Phychological safety

PQAYS data for sub-scale 1b, grouped by year and program.

## `summarise()` has grouped output by 'program.clean'. You can override using the
## `.groups` argument.
Program Year 1.1b - Positive emotional climate 1.2b - Respectful environment 1.3b - Conflict mediation
Ball hockey 2019 4.0 3.5 3.0
Ball hockey 2020 4.5 4.5 NA
Basketball 2019 4.5 4.5 4.5
Basketball 2020 4.5 4.0 NA
Boxing 2020 5.0 5.0 NA
Fuel for Fun 2019 4.0 5.0 0.0
Fuel for Fun 2020 5.0 4.0 NA
Fuel for Fun 2021 4.5 4.5 3.0
Girls Multisport 2019 4.5 4.0 2.0
Girls Multisport 2020 4.5 4.0 NA
Girls Multisport 2021 4.5 4.5 4.0
Healthy Me 2019 4.5 4.5 5.0
Healthy Me 2020 4.0 4.0 NA
Healthy Me 2021 5.0 5.0 3.0
Multisport 2019 5.0 5.0 2.5
Multisport 2020 4.5 4.5 NA
Multisport 2021 5.0 4.0 3.0
Npower 2020 5.0 4.5 NA
Npower 2021 5.0 5.0 3.0
Pathways 2020 5.0 5.0 NA
QSLA 2019 5.0 5.0 0.0
Sharing dance 2019 5.0 5.0 1.5
Sharing dance 2020 5.0 4.5 NA
Social circus 2019 5.0 5.0 0.0
Sport and Stem 2019 5.0 5.0 0.0
Sport and Stem 2020 4.5 4.5 NA
Sport and Stem 2021 4.0 4.0 4.0
Square circle 2019 5.0 5.0 0.0
Square circle 2020 5.0 4.5 NA
Volleyball 2019 5.0 4.5 1.5
Volleyball 2020 4.0 4.0 NA
NA 2019 5.0 4.5 0.0

2 - Appropriate structure

PQAYS data for sub-scale 2, grouped by year and program.

## `summarise()` has grouped output by 'program.clean'. You can override using the
## `.groups` argument.
Program Year 2.1 - On time 2.2 - Engaged staff 2.3 - Clear expectations 2.4 - Clear purpose 2.5 - Engaged youth 2.6 - Well organized 2.7 - Staff support
Ball hockey 2019 NA 5.0 3.5 3.0 4.0 4.0 4.0
Ball hockey 2020 5.0 5.0 4.5 4.5 4.5 4.0 NA
Basketball 2019 5.0 4.5 4.5 5.0 4.5 4.5 4.5
Basketball 2020 5.0 4.5 4.0 5.0 4.0 4.5 NA
Boxing 2020 4.5 5.0 5.0 5.0 4.5 3.5 5.0
Fuel for Fun 2019 5.0 4.0 4.0 4.0 3.0 4.0 4.0
Fuel for Fun 2020 4.5 5.0 4.5 5.0 5.0 5.0 NA
Fuel for Fun 2021 5.0 5.0 5.0 5.0 5.0 4.5 5.0
Girls Multisport 2019 5.0 4.5 4.0 4.0 4.0 4.0 4.5
Girls Multisport 2020 3.0 4.5 3.5 4.5 5.0 4.0 NA
Girls Multisport 2021 5.0 5.0 4.0 4.0 4.5 4.5 4.5
Healthy Me 2019 NA 4.5 4.0 5.0 4.5 4.5 5.0
Healthy Me 2020 4.0 4.0 4.0 4.0 4.0 3.5 NA
Healthy Me 2021 3.5 3.5 4.5 4.0 NA 3.0 5.0
Multisport 2019 5.0 4.5 5.0 4.5 4.5 5.0 4.5
Multisport 2020 5.0 3.5 4.0 3.5 4.0 3.0 4.0
Multisport 2021 5.0 5.0 4.0 4.0 5.0 4.0 5.0
Npower 2020 4.0 5.0 4.5 5.0 4.5 4.0 5.0
Npower 2021 5.0 5.0 5.0 5.0 NA 5.0 3.0
Pathways 2020 5.0 5.0 5.0 5.0 5.0 5.0 NA
QSLA 2019 5.0 4.5 5.0 4.5 5.0 4.5 5.0
Sharing dance 2019 5.0 5.0 4.5 4.0 4.0 5.0 0.0
Sharing dance 2020 4.5 5.0 4.0 4.0 4.5 4.0 2.5
Social circus 2019 4.0 5.0 5.0 5.0 5.0 4.0 5.0
Sport and Stem 2019 4.5 5.0 5.0 4.0 4.0 5.0 5.0
Sport and Stem 2020 5.0 5.0 4.5 5.0 5.0 5.0 4.5
Sport and Stem 2021 5.0 4.0 4.0 4.0 3.5 4.0 3.5
Square circle 2019 5.0 4.5 NA 4.5 4.0 4.0 5.0
Square circle 2020 5.0 5.0 4.5 4.0 5.0 4.5 4.5
Volleyball 2019 3.0 5.0 4.5 4.0 4.0 3.5 4.5
Volleyball 2020 3.5 4.0 4.0 4.0 4.5 4.0 NA
NA 2019 4.0 3.5 4.0 4.0 NA 3.5 3.5

3 - Supportive relationships

PQAYS data for sub-scale 3, grouped by year and program.

## `summarise()` has grouped output by 'program.clean'. You can override using the
## `.groups` argument.
Program Year 3.1 - Warm environment 3.2 - Staff-youth interact 3.3 - Youth trust staff 3.4 - Positive youth relationships 3.5 - Development encouraged
Ball hockey 2019 3.0 4.0 5.0 4.0 4.0
Ball hockey 2020 4.0 4.0 5.0 5.0 3.5
Basketball 2019 4.5 4.0 4.0 4.5 2.5
Basketball 2020 4.0 4.0 5.0 4.0 4.0
Boxing 2020 5.0 4.5 5.0 5.0 4.0
Fuel for Fun 2019 5.0 5.0 4.0 5.0 4.0
Fuel for Fun 2020 5.0 4.5 5.0 4.0 4.0
Fuel for Fun 2021 4.5 4.5 4.5 4.0 4.5
Girls Multisport 2019 4.0 3.5 4.0 4.0 4.0
Girls Multisport 2020 4.5 3.5 5.0 4.5 4.0
Girls Multisport 2021 5.0 5.0 5.0 5.0 5.0
Healthy Me 2019 5.0 4.0 5.0 5.0 3.5
Healthy Me 2020 4.0 4.0 4.5 4.0 4.0
Healthy Me 2021 3.5 3.5 3.5 2.5 3.5
Multisport 2019 5.0 4.5 5.0 5.0 4.5
Multisport 2020 3.0 4.0 4.5 3.5 4.0
Multisport 2021 4.0 5.0 5.0 4.0 3.0
Npower 2020 5.0 4.0 4.0 4.5 4.5
Npower 2021 5.0 2.5 2.5 2.5 2.5
Pathways 2020 5.0 5.0 5.0 5.0 5.0
QSLA 2019 5.0 4.5 5.0 4.5 5.0
Sharing dance 2019 4.5 3.5 5.0 4.0 4.0
Sharing dance 2020 5.0 4.5 4.5 5.0 5.0
Social circus 2019 5.0 5.0 5.0 5.0 5.0
Sport and Stem 2019 5.0 3.0 4.0 4.5 5.0
Sport and Stem 2020 5.0 5.0 4.5 4.0 4.5
Sport and Stem 2021 5.0 4.5 3.5 3.0 3.5
Square circle 2019 5.0 4.5 5.0 5.0 4.0
Square circle 2020 5.0 5.0 5.0 4.5 4.5
Volleyball 2019 4.5 4.0 4.0 5.0 3.5
Volleyball 2020 4.0 3.5 4.5 4.0 4.0
NA 2019 5.0 4.0 4.5 5.0 4.0

4 - Opportunities to belong

PQAYS data for sub-scale 4, grouped by year and program.

## `summarise()` has grouped output by 'program.clean'. You can override using the
## `.groups` argument.
Program Year 4.1 - Positive associations 4.2 - Inclusive youth 4.3 - Additional activities
Ball hockey 2019 3.5 3.0 1.0
Ball hockey 2020 5.0 4.0 1.0
Basketball 2019 4.0 4.0 2.0
Basketball 2020 5.0 5.0 3.0
Boxing 2020 5.0 4.5 1.5
Fuel for Fun 2019 5.0 5.0 1.0
Fuel for Fun 2020 4.5 4.5 3.5
Fuel for Fun 2021 5.0 5.0 4.5
Girls Multisport 2019 4.0 3.5 3.0
Girls Multisport 2020 4.5 4.0 1.0
Girls Multisport 2021 4.5 4.0 2.5
Healthy Me 2019 4.0 5.0 1.0
Healthy Me 2020 4.0 4.0 3.0
Healthy Me 2021 3.0 3.0 3.0
Multisport 2019 5.0 4.5 3.0
Multisport 2020 4.5 4.5 1.0
Multisport 2021 4.0 4.0 1.0
Npower 2020 5.0 5.0 3.0
Npower 2021 2.5 2.5 2.5
Pathways 2020 5.0 5.0 4.5
QSLA 2019 4.5 4.5 1.0
Sharing dance 2019 5.0 4.0 1.0
Sharing dance 2020 5.0 4.0 2.5
Social circus 2019 5.0 5.0 5.0
Sport and Stem 2019 4.5 4.0 NA
Sport and Stem 2020 4.5 5.0 1.0
Sport and Stem 2021 3.5 3.0 3.5
Square circle 2019 5.0 4.5 NA
Square circle 2020 4.5 4.5 3.0
Volleyball 2019 4.0 4.0 3.0
Volleyball 2020 4.5 4.0 1.0
NA 2019 4.5 5.0 1.0

5 - Positive social norms

PQAYS data for sub-scale 5, grouped by year and program.

## `summarise()` has grouped output by 'program.clean'. You can override using the
## `.groups` argument.
Program Year 5.1 - Positive social norms 5.2 - Fair play 5.3 - Sportspersonship
Ball hockey 2019 4.5 4.0 3.0
Ball hockey 2020 5.0 5.0 3.0
Basketball 2019 4.5 4.5 4.0
Basketball 2020 5.0 5.0 4.0
Boxing 2020 5.0 5.0 4.5
Fuel for Fun 2019 4.0 5.0 5.0
Fuel for Fun 2020 5.0 5.0 4.0
Fuel for Fun 2021 3.5 4.0 4.0
Girls Multisport 2019 3.5 3.5 3.5
Girls Multisport 2020 5.0 4.0 5.0
Girls Multisport 2021 4.5 4.0 4.5
Healthy Me 2019 4.5 4.5 4.5
Healthy Me 2020 4.0 4.0 3.0
Healthy Me 2021 5.0 4.0 3.0
Multisport 2019 5.0 5.0 5.0
Multisport 2020 4.5 4.5 4.5
Multisport 2021 4.0 4.0 4.0
Npower 2020 4.5 4.5 5.0
Npower 2021 5.0 4.5 4.0
Pathways 2020 5.0 5.0 5.0
QSLA 2019 5.0 5.0 4.5
Sharing dance 2019 4.5 4.0 4.5
Sharing dance 2020 5.0 4.5 4.5
Social circus 2019 5.0 NA 5.0
Sport and Stem 2019 5.0 4.5 3.5
Sport and Stem 2020 4.5 4.5 3.5
Sport and Stem 2021 5.0 3.0 3.0
Square circle 2019 5.0 5.0 3.5
Square circle 2020 4.5 5.0 4.5
Volleyball 2019 5.0 5.0 4.0
Volleyball 2020 4.5 4.0 5.0
NA 2019 5.0 5.0 5.0

6 - Support for efficacy and mattering

PQAYS data for sub-scale 6, grouped by year and program.

## `summarise()` has grouped output by 'program.clean'. You can override using the
## `.groups` argument.
Program Year 6.1 - Developmental focus 6.2 - Youth given choices 6.3 - Acheivements acknowledged 6.4 - Mentorship opportunities 6.5 - Positive feedback 6.6 - Constructive feedback 6.7 - Contributions recognized 6.8 - Staff listen
Ball hockey 2019 4.0 2.0 3.0 3.0 3.5 3.5 3.5 4.0
Ball hockey 2020 3.0 2.5 4.0 2.5 4.5 3.5 3.5 4.0
Basketball 2019 4.5 3.5 4.0 2.5 4.5 4.0 4.5 4.5
Basketball 2020 4.0 3.5 4.0 4.0 4.5 4.5 5.0 4.0
Boxing 2020 4.0 4.0 3.5 4.5 4.0 3.5 4.5 4.0
Fuel for Fun 2019 3.0 1.0 4.0 0.0 5.0 5.0 4.0 5.0
Fuel for Fun 2020 4.5 3.5 5.0 4.0 4.5 4.5 4.0 4.5
Fuel for Fun 2021 4.0 4.0 4.0 3.0 4.0 3.0 3.0 3.0
Girls Multisport 2019 3.5 3.0 3.0 1.5 4.0 3.0 4.0 4.0
Girls Multisport 2020 4.0 3.0 3.5 3.0 4.0 3.5 4.0 4.0
Girls Multisport 2021 4.0 3.5 4.5 3.0 5.0 4.0 4.5 4.0
Healthy Me 2019 2.5 3.0 4.0 3.0 4.0 4.0 4.0 4.5
Healthy Me 2020 4.0 3.5 4.0 3.0 4.0 4.5 4.0 4.0
Healthy Me 2021 3.5 3.0 3.5 2.0 4.0 4.0 4.0 4.0
Multisport 2019 5.0 2.5 5.0 3.5 5.0 5.0 5.0 5.0
Multisport 2020 3.5 2.0 3.5 2.5 3.5 3.5 3.0 3.5
Multisport 2021 3.0 2.0 4.0 2.0 5.0 4.0 3.0 4.0
Npower 2020 4.0 3.5 4.5 4.5 4.5 4.0 4.0 5.0
Npower 2021 5.0 3.0 5.0 2.5 5.0 2.0 2.5 2.0
Pathways 2020 5.0 4.5 5.0 4.5 5.0 5.0 5.0 5.0
QSLA 2019 4.0 1.5 4.0 3.0 4.0 4.5 5.0 5.0
Sharing dance 2019 3.5 4.5 4.0 3.0 NA 4.0 4.0 NA
Sharing dance 2020 4.0 4.5 3.0 3.0 3.0 2.5 4.0 4.5
Social circus 2019 4.0 NA 5.0 5.0 5.0 5.0 5.0 5.0
Sport and Stem 2019 4.5 3.0 4.5 0.0 4.0 3.5 3.5 4.5
Sport and Stem 2020 4.0 3.0 4.0 3.5 4.5 4.0 4.0 4.0
Sport and Stem 2021 4.0 3.0 4.0 3.0 4.0 4.0 4.0 4.0
Square circle 2019 NA 4.0 4.0 4.5 4.5 5.0 5.0 4.5
Square circle 2020 4.0 2.5 4.5 4.5 4.5 5.0 4.5 4.5
Volleyball 2019 3.5 1.5 3.5 1.5 4.5 4.0 4.0 4.0
Volleyball 2020 4.0 3.0 3.5 3.0 4.0 3.5 4.0 4.0
NA 2019 3.5 1.5 4.0 4.0 4.0 2.5 2.0 4.5

7a - Opportunities for sport building - Sport skills

PQAYS data for sub-scale 7a, grouped by year and program.

## `summarise()` has grouped output by 'program.clean'. You can override using the
## `.groups` argument.
Program Year 7.1a - Staff understand fundamentals 7.2a - Staff promote learning 7.3a - Staff model skills 7.4a - Opportunities to practice 7.5a - Opportunities to reflect
Ball hockey 2019 4.5 2.0 3.0 2.5 1.0
Ball hockey 2020 5.0 3.0 5.0 3.5 2.5
Basketball 2019 4.5 3.0 4.5 4.0 2.5
Basketball 2020 5.0 4.0 4.0 4.5 4.0
Boxing 2020 5.0 3.0 4.5 4.5 3.0
Fuel for Fun 2019 5.0 2.0 4.0 5.0 1.0
Fuel for Fun 2020 5.0 4.5 5.0 4.0 4.0
Fuel for Fun 2021 4.0 3.0 4.0 3.0 3.0
Girls Multisport 2019 5.0 1.5 4.5 4.5 2.5
Girls Multisport 2020 4.5 2.5 4.0 4.0 3.0
Girls Multisport 2021 4.0 3.5 4.0 4.0 3.0
Healthy Me 2019 5.0 3.0 4.5 3.5 2.0
Healthy Me 2020 4.0 3.0 3.5 4.0 3.0
Healthy Me 2021 4.0 4.0 4.0 3.5 4.0
Multisport 2019 5.0 4.5 5.0 5.0 3.5
Multisport 2020 4.0 3.5 3.5 4.5 3.0
Multisport 2021 5.0 2.0 4.0 4.0 3.0
Npower 2020 5.0 4.0 5.0 4.5 4.0
Npower 2021 5.0 3.5 5.0 5.0 2.0
Pathways 2020 5.0 5.0 5.0 5.0 4.5
QSLA 2019 5.0 3.0 5.0 4.5 3.0
Sharing dance 2019 4.5 2.0 4.0 3.5 3.0
Sharing dance 2020 5.0 3.0 3.5 4.0 2.0
Social circus 2019 NA 3.0 5.0 5.0 3.0
Sport and Stem 2019 5.0 NA 5.0 5.0 NA
Sport and Stem 2020 5.0 3.5 4.0 4.0 3.5
Sport and Stem 2021 4.0 4.0 4.0 4.0 4.0
Square circle 2019 5.0 2.5 NA NA 2.5
Square circle 2020 5.0 4.5 5.0 5.0 3.0
Volleyball 2019 4.5 2.5 4.5 4.5 2.5
Volleyball 2020 4.0 3.0 4.0 4.0 3.0
NA 2019 4.0 3.0 3.0 2.5 1.0

7b - Opportunities for sport building - Life skills

PQAYS data for sub-scale 7b, grouped by year and program.

## `summarise()` has grouped output by 'program.clean'. You can override using the
## `.groups` argument.
Program Year 7.1b - Life skills discussed 7.2b - Life skills modeled 7.3b - Opportunities to improve life skills 7.4b - Life skills debriefed
Ball hockey 2019 NA 2.5 1.5 3.5
Ball hockey 2020 3.0 3.5 3.0 3.0
Basketball 2019 2.5 2.5 2.5 2.5
Basketball 2020 4.0 4.0 3.5 4.5
Boxing 2020 2.0 1.5 2.5 2.5
Fuel for Fun 2019 1.0 1.0 1.0 1.0
Fuel for Fun 2020 4.0 4.5 4.0 3.5
Fuel for Fun 2021 4.0 4.0 3.0 4.0
Girls Multisport 2019 2.5 2.0 2.0 1.5
Girls Multisport 2020 3.0 3.0 2.0 2.0
Girls Multisport 2021 2.5 3.5 3.5 3.0
Healthy Me 2019 3.0 3.0 NA 2.5
Healthy Me 2020 4.0 3.5 3.5 3.5
Healthy Me 2021 3.5 3.5 4.0 4.5
Multisport 2019 2.0 2.0 2.0 2.0
Multisport 2020 3.5 4.0 4.0 4.5
Multisport 2021 2.0 4.0 2.0 2.0
Npower 2020 5.0 3.5 4.0 5.0
Npower 2021 2.5 2.5 2.0 2.0
Pathways 2020 4.0 4.0 4.0 4.0
QSLA 2019 2.5 1.5 1.5 1.0
Sharing dance 2019 2.0 2.0 1.0 1.0
Sharing dance 2020 3.0 3.5 3.5 2.5
Social circus 2019 1.0 NA NA NA
Sport and Stem 2019 NA NA NA NA
Sport and Stem 2020 3.5 3.0 3.0 2.0
Sport and Stem 2021 4.0 4.0 3.0 3.0
Square circle 2019 1.5 NA NA NA
Square circle 2020 3.0 4.0 3.0 2.5
Volleyball 2019 1.5 2.0 1.5 1.5
Volleyball 2020 3.0 3.0 3.0 2.5
NA 2019 3.5 4.0 3.5 3.0

8 - Integration of family, school, and community

PQAYS data for sub-scale 8, grouped by year and program.

## `summarise()` has grouped output by 'program.clean'. You can override using the
## `.groups` argument.
Program Year 8.1 - Families welcome 8.2 - Families involved 8.3 - Staff-school communication 8.4 - Community opportunities 8.5 - Coach-parent communication
Ball hockey 2019 3.5 1.0 1.0 1.0 0.0
Ball hockey 2020 1.0 1.0 1.0 1.0 NA
Basketball 2019 4.0 2.0 3.0 2.5 1.5
Basketball 2020 1.0 1.0 1.0 1.0 NA
Boxing 2020 2.0 1.5 2.5 2.0 NA
Fuel for Fun 2019 1.0 1.0 1.0 1.0 1.0
Fuel for Fun 2020 1.0 1.0 4.0 2.0 NA
Fuel for Fun 2021 3.0 3.0 3.0 3.0 3.0
Girls Multisport 2019 4.0 2.0 2.0 2.0 0.0
Girls Multisport 2020 2.0 1.0 1.0 1.0 NA
Girls Multisport 2021 1.5 1.5 1.5 1.5 2.0
Healthy Me 2019 1.5 1.0 1.5 1.5 0.5
Healthy Me 2020 1.0 1.0 1.0 1.0 NA
Healthy Me 2021 5.0 5.0 3.0 3.0 3.5
Multisport 2019 5.0 2.5 3.5 2.5 2.5
Multisport 2020 1.0 1.0 1.0 1.0 NA
Multisport 2021 1.0 1.0 1.0 1.0 1.0
Npower 2020 1.0 1.0 1.0 2.0 NA
Npower 2021 2.5 2.0 1.5 2.0 3.0
Pathways 2020 1.0 1.0 1.0 1.0 1.0
QSLA 2019 1.0 1.0 1.0 1.0 1.0
Sharing dance 2019 1.0 1.0 1.0 NA 0.5
Sharing dance 2020 2.5 2.0 2.0 2.0 NA
Social circus 2019 NA NA NA NA NA
Sport and Stem 2019 NA NA NA NA NA
Sport and Stem 2020 1.0 1.0 1.0 1.0 NA
Sport and Stem 2021 3.0 3.0 4.0 3.0 3.0
Square circle 2019 NA NA NA 1.0 1.0
Square circle 2020 1.0 1.0 1.0 1.0 5.0
Volleyball 2019 3.0 1.0 2.0 2.5 1.0
Volleyball 2020 1.0 1.0 1.0 1.0 NA
NA 2019 1.0 1.0 1.0 1.0 0.5

9 - Scale fidelity

PQAYS data for sub-scale 9, grouped by year and program.

## `summarise()` has grouped output by 'program.clean'. You can override using the
## `.groups` argument.
Program Year 9.1 - Activity-program consistency 9.2 - Activity-objective support
Ball hockey 2019 NA NA
Ball hockey 2020 5.0 4.0
Basketball 2019 NA NA
Basketball 2020 5.0 4.0
Boxing 2020 4.5 5.0
Fuel for Fun 2019 NA NA
Fuel for Fun 2020 3.5 5.0
Fuel for Fun 2021 4.0 4.0
Girls Multisport 2019 NA NA
Girls Multisport 2020 4.5 4.5
Girls Multisport 2021 4.5 4.0
Healthy Me 2019 NA NA
Healthy Me 2020 5.0 5.0
Healthy Me 2021 5.0 5.0
Multisport 2019 NA NA
Multisport 2020 5.0 5.0
Multisport 2021 4.5 4.5
Npower 2020 5.0 5.0
Npower 2021 3.5 3.0
Pathways 2020 5.0 5.0
QSLA 2019 NA NA
Sharing dance 2019 NA NA
Sharing dance 2020 5.0 5.0
Social circus 2019 NA NA
Sport and Stem 2019 NA NA
Sport and Stem 2020 4.0 4.0
Sport and Stem 2021 4.0 4.0
Square circle 2019 NA NA
Square circle 2020 4.0 4.0
Volleyball 2019 NA NA
Volleyball 2020 4.0 4.5
NA 2019 NA NA

Sub-scale medians

Median values for each sub-scale of the PQAYS, by program.

I started here by aggregating across years, so data is displayed by program only. This is just to get a sense of whether, on a given sub-scale, some programs are performing better/worse than others.

There is some variability here program-to-program, but it does not seem too far out of the norm (as shown in the upcoming KW and Wilcoxon tests). The most variability program-to-program is observed on subscale 6 onwards.

What is notable is that different sub-scales perform quite differently. For example, the first 5 sub-scales perform quite well, and many of these relate to infrastructure and staffing/coaching. The worst performing scale is #8 (Integration of family, community, and school efforts) across all programs.

Program 1a - Physical Safety 1b - Psychological Safety 2 - Appropriate Structure 3 - Supportive Relationships 4 - Opportunities to Belong 5 - Positive Social Norms 6 - Support for Efficacy and Mattering 7a - Opportunities for Skill-building – Sport Skills 7b - Opportunities for Skill-building – Life Skills 8 - Integration of Family, School and Community Efforts 9 - Program fidelity
Ball hockey 5.00 4.25 4.00 4.0 4.00 4.5 3.50 3.5 3.00 1.00 NA
Basketball 5.00 4.50 4.00 4.0 5.00 5.0 4.00 4.0 4.00 1.00 NA
Boxing 5.00 5.00 5.00 5.0 4.50 5.0 4.00 4.0 2.25 1.75 4.75
Fuel for Fun 5.00 4.00 5.00 5.0 5.00 5.0 4.00 4.0 4.00 2.00 NA
Girls Multisport 5.00 4.00 4.75 4.5 4.00 4.5 4.00 4.0 2.75 1.00 NA
Healthy Me 4.00 4.50 4.00 4.0 4.00 4.0 4.00 4.0 3.75 1.25 NA
Multisport 4.75 4.50 5.00 4.0 4.00 4.0 3.50 4.0 3.00 1.00 NA
Npower 5.00 5.00 5.00 3.5 4.00 4.5 4.00 5.0 3.25 1.00 5.00
Pathways 5.00 5.00 5.00 5.0 5.00 5.0 5.00 5.0 4.00 1.00 5.00
QSLA 4.25 5.00 5.00 5.0 4.50 5.0 4.25 4.5 2.00 1.00 NA
Sharing dance 4.00 4.50 4.00 4.5 4.00 5.0 3.75 3.5 2.25 1.00 NA
Social circus 5.00 5.00 5.00 5.0 5.00 5.0 5.00 5.0 1.00 NA NA
Sport and Stem 5.00 5.00 5.00 4.0 4.25 4.0 4.00 4.5 NA NA NA
Square circle 5.00 5.00 4.00 5.0 4.00 5.0 5.00 5.0 2.75 1.00 NA
Volleyball 5.00 4.00 4.00 4.0 4.00 5.0 3.75 4.0 3.00 1.00 NA
NA 4.50 4.50 4.00 4.5 4.50 5.0 3.50 3.0 3.50 1.00 NA

Median values for each sub-scale of the PQAYS, from 2019-2021, by program.

Here we are moving into program by year. As alluded to above, the main thing of note here on the yearly analysis is that there is a dip for many programs in 2021 (which is suspected to be related to 2021 programming being virutally delivered).

## `summarise()` has grouped output by 'program.clean'. You can override using the
## `.groups` argument.
Program Year 1a - Physical Safety 1b - Psychological Safety 2 - Appropriate Structure 3 - Supportive Relationships 4 - Opportunities to Belong 5 - Positive Social Norms 6 - Support for Efficacy and Mattering 7a - Opportunities for Skill-building – Sport Skills 7b - Opportunities for Skill-building – Life Skills 8 - Integration of Family, School and Community Efforts 9 - Program fidelity
Ball hockey 2019 4.75 3.50 4.00 3.5 3.00 4.0 3.25 3.0 2.75 1.00 NA
Ball hockey 2020 5.00 4.50 4.50 4.0 4.00 5.0 3.75 4.0 3.00 1.00 4.50
Basketball 2019 5.00 4.50 4.50 4.0 4.00 4.5 4.25 3.5 2.50 2.50 NA
Basketball 2020 5.00 4.50 4.00 4.0 5.00 5.0 4.00 4.0 4.00 1.00 4.50
Boxing 2020 5.00 5.00 5.00 5.0 4.50 5.0 4.00 4.0 2.25 1.75 4.75
Fuel for Fun 2019 5.00 4.00 4.00 5.0 5.00 5.0 3.50 4.0 1.00 1.00 NA
Fuel for Fun 2020 5.00 4.25 5.00 4.5 4.00 5.0 4.00 4.5 4.00 1.50 4.00
Fuel for Fun 2021 3.50 4.50 5.00 4.5 5.00 4.0 3.50 3.0 4.00 3.00 4.00
Girls Multisport 2019 5.00 4.00 4.00 4.0 3.50 3.5 3.50 4.5 2.00 2.00 NA
Girls Multisport 2020 5.00 4.00 4.75 4.5 4.00 5.0 3.75 4.0 2.75 1.00 4.50
Girls Multisport 2021 4.25 4.00 5.00 5.0 4.00 4.5 4.50 4.0 3.25 1.50 4.25
Healthy Me 2019 4.75 4.50 5.00 4.5 4.00 5.0 4.00 3.5 3.00 1.00 NA
Healthy Me 2020 4.00 4.00 4.00 4.0 4.00 4.0 4.00 3.5 4.00 1.00 5.00
Healthy Me 2021 4.25 5.00 3.75 3.5 3.00 4.0 3.75 4.0 3.75 4.00 5.00
Multisport 2019 4.75 5.00 5.00 5.0 4.50 5.0 5.00 5.0 2.00 3.00 NA
Multisport 2020 5.00 4.50 4.00 4.0 4.50 4.5 3.00 4.0 4.00 1.00 5.00
Multisport 2021 4.50 4.00 5.00 4.0 4.00 4.0 3.50 4.0 2.00 1.00 4.50
Npower 2020 5.00 4.75 4.50 4.5 5.00 4.5 4.50 4.5 4.25 1.00 5.00
Npower 2021 3.50 5.00 5.00 2.5 2.50 4.5 2.75 5.0 2.25 2.00 3.25
Pathways 2020 5.00 5.00 5.00 5.0 5.00 5.0 5.00 5.0 4.00 1.00 5.00
QSLA 2019 4.25 5.00 5.00 5.0 4.50 5.0 4.25 4.5 2.00 1.00 NA
Sharing dance 2019 4.00 4.50 4.50 4.0 3.50 4.5 4.00 3.5 1.25 1.00 NA
Sharing dance 2020 4.75 4.50 4.00 5.0 4.00 5.0 3.50 3.5 3.25 2.00 5.00
Social circus 2019 5.00 5.00 5.00 5.0 5.00 5.0 5.00 5.0 1.00 NA NA
Sport and Stem 2019 5.00 5.00 5.00 4.0 4.25 4.5 3.75 5.0 NA NA NA
Sport and Stem 2020 5.00 4.50 5.00 4.5 4.50 4.5 4.00 4.0 3.00 1.00 4.00
Sport and Stem 2021 2.75 4.00 4.00 3.5 3.50 3.0 4.00 4.0 3.50 3.00 4.00
Square circle 2019 5.00 5.00 4.00 5.0 4.50 5.0 5.00 5.0 1.50 1.00 NA
Square circle 2020 5.00 4.75 4.50 5.0 4.00 4.5 4.50 4.5 3.50 1.00 4.00
Volleyball 2019 4.50 4.50 4.00 4.0 4.00 5.0 3.75 4.5 1.50 2.00 NA
Volleyball 2020 5.00 4.00 4.00 4.0 4.00 4.5 3.75 4.0 3.00 1.00 4.25
NA 2019 4.50 4.50 4.00 4.5 4.50 5.0 3.50 3.0 3.50 1.00 NA

Year-over-year comparisons

Median values for each sub-scale of the PQAYS, from 2019-2021, by program type (Sport Plus vs. Plus Sport)

This next table provides a more digestible overview of Sport Plus vs Plus Sport performance on the PQAYS. In general, Plus Sport programs maybe performing slightly better than Sport Plus. Again, there is a dip in performance in 2021, which will be further explored in the next section.

## `summarise()` has grouped output by 'program.type'. You can override using the
## `.groups` argument.
## `summarise()` has grouped output by 'program.type'. You can override using the
## `.groups` argument.
Program type Year 1a - Physical Safety 1b - Psychological Safety 2 - Appropriate Structure 3 - Supportive Relationships 4 - Opportunities to Belong 5 - Positive Social Norms 6 - Support for Efficacy and Mattering 7a - Opportunities for Skill-building – Sport Skills 7b - Opportunities for Skill-building – Life Skills 8 - Integration of Family, School and Community Efforts 9 - Program fidelity Overall
Plus Sport 2019 5.00 5.0 5 5.0 5 5.0 4.00 5 NA NA NA 4
Plus Sport 2020 5.00 4.5 5 4.5 4 5.0 4.00 4 4.00 1 5.00 4
Plus Sport 2021 3.50 5.0 5 3.5 3 4.0 3.00 4 3.25 3 4.75 4
Sport Plus 2019 4.75 4.0 4 4.0 4 4.5 4.00 4 2.00 1 NA 4
Sport Plus 2020 5.00 4.0 4 4.0 4 5.0 3.75 4 3.00 1 4.50 4
Sport Plus 2021 4.50 4.0 5 4.0 4 4.0 3.50 4 2.50 1 4.50 4

Kruskall-Wallis tests comparing year-over-year medians, for Sport Plus and Plus Sport programs. Wilcoxon tests follow for KW tests that are significant to show pairwise differences.

There is change across more sub-scales when considering Plus Sport programs vs. Sport Plus programs. This could perhaps be because sport-focused programs already have strong infrastructure (which presumably did not change?), while plus-sport programs, being less focused on sport, could be impacted more by changing staff/coaches, COVID sentiment, sport culture, etc. The impact of setting (in-person vs. virtual) is further explored in the next section.

Sport Plus

Across all sub-scales, for Sport Plus programs, significant differences were observed for subscales …

1a - Physical safety (2021 < 2019 < 2020) and
7b - Opportunities for sport building - Life skills (2019 < 2021 < 2020).

1a - Physical safety

Significant difference 2019 vs. 2020, 2020 vs. 2021, but NOT 2019 vs. 2021.

kw.sp = filter(pqays.n, program.type == "Sport Plus")

#Significant.

kruskal.test(median.1a ~ year.cat, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.1a by year.cat
## Kruskal-Wallis chi-squared = 18.694, df = 2, p-value = 8.722e-05
pairwise.wilcox.test(kw.sp$median.1a, kw.sp$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.sp$median.1a and kw.sp$year.cat 
## 
##      2019   2020   
## 2020 0.0041 -      
## 2021 0.3534 5.8e-05
## 
## P value adjustment method: holm

1b - Psychological safety

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.1b ~ year.cat, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.1b by year.cat
## Kruskal-Wallis chi-squared = 0.96495, df = 2, p-value = 0.6173
pairwise.wilcox.test(kw.sp$median.1b, kw.sp$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.sp$median.1b and kw.sp$year.cat 
## 
##      2019 2020
## 2020 1    -   
## 2021 1    1   
## 
## P value adjustment method: holm

2 - Appropriate structure

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.2 ~ year.cat, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.2 by year.cat
## Kruskal-Wallis chi-squared = 5.8517, df = 2, p-value = 0.05362
pairwise.wilcox.test(kw.sp$median.2, kw.sp$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.sp$median.2 and kw.sp$year.cat 
## 
##      2019  2020 
## 2020 0.821 -    
## 2021 0.092 0.051
## 
## P value adjustment method: holm

3 - Supportive relationships

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.3 ~ year.cat, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.3 by year.cat
## Kruskal-Wallis chi-squared = 1.2573, df = 2, p-value = 0.5333
pairwise.wilcox.test(kw.sp$median.3, kw.sp$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.sp$median.3 and kw.sp$year.cat 
## 
##      2019 2020
## 2020 0.84 -   
## 2021 1.00 1.00
## 
## P value adjustment method: holm

4 - Opportunities to belong

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.4 ~ year.cat, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.4 by year.cat
## Kruskal-Wallis chi-squared = 5.2048, df = 2, p-value = 0.0741
pairwise.wilcox.test(kw.sp$median.4, kw.sp$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.sp$median.4 and kw.sp$year.cat 
## 
##      2019  2020 
## 2020 0.095 -    
## 2021 0.349 0.584
## 
## P value adjustment method: holm

5 - Positive social norms

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.5 ~ year.cat, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.5 by year.cat
## Kruskal-Wallis chi-squared = 4.5108, df = 2, p-value = 0.1048
pairwise.wilcox.test(kw.sp$median.5, kw.sp$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.sp$median.5 and kw.sp$year.cat 
## 
##      2019 2020
## 2020 0.40 -   
## 2021 0.52 0.14
## 
## P value adjustment method: holm

6 - Support for efficacy and mattering

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.6 ~ year.cat, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.6 by year.cat
## Kruskal-Wallis chi-squared = 0.11943, df = 2, p-value = 0.942
pairwise.wilcox.test(kw.sp$median.6, kw.sp$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.sp$median.6 and kw.sp$year.cat 
## 
##      2019 2020
## 2020 1    -   
## 2021 1    1   
## 
## P value adjustment method: holm

7a - Opportunities for sport building - Sport skills

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.7a ~ year.cat, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.7a by year.cat
## Kruskal-Wallis chi-squared = 1.1682, df = 2, p-value = 0.5576
pairwise.wilcox.test(kw.sp$median.7a, kw.sp$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.sp$median.7a and kw.sp$year.cat 
## 
##      2019 2020
## 2020 1.00 -   
## 2021 1.00 0.81
## 
## P value adjustment method: holm

7b - Opportunities for sport building - Life skills

Significant difference from 2019-2020 but NOT 2020-2021 or 2019-2021.

# Significant.

kruskal.test(median.7b ~ year.cat, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.7b by year.cat
## Kruskal-Wallis chi-squared = 9.8346, df = 2, p-value = 0.007319
pairwise.wilcox.test(kw.sp$median.7b, kw.sp$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.sp$median.7b and kw.sp$year.cat 
## 
##      2019   2020  
## 2020 0.0094 -     
## 2021 0.2918 0.2918
## 
## P value adjustment method: holm

8 - Integration of family, school, and community

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.8 ~ year.cat, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.8 by year.cat
## Kruskal-Wallis chi-squared = 3.1133, df = 2, p-value = 0.2108
pairwise.wilcox.test(kw.sp$median.8, kw.sp$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.sp$median.8 and kw.sp$year.cat 
## 
##      2019 2020
## 2020 0.30 -   
## 2021 0.80 0.54
## 
## P value adjustment method: holm

9 - Program fidelity

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.9 ~ year.cat, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.9 by year.cat
## Kruskal-Wallis chi-squared = 0.21907, df = 1, p-value = 0.6398

Overall

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.total ~ year.cat, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.total by year.cat
## Kruskal-Wallis chi-squared = 1.1096, df = 2, p-value = 0.5742
pairwise.wilcox.test(kw.sp$median.total, kw.sp$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.sp$median.total and kw.sp$year.cat 
## 
##      2019 2020
## 2020 1.0  -   
## 2021 1.0  0.8 
## 
## P value adjustment method: holm

Plus Sport

Across all sub-scales, for Plus Sport programs, significant differences were observed for for sub-scales…

1a - Physical safety (2021 < 2019/2020)
3 - Supportive relationships (2021 < 2020 < 2019)
5 - Positive social norms (2021 < 2019/2020)
6 - Support for efficacy and mattering (2021 < 2019/2021)
7b - Opportunities for sport building - Life skills (2021 < 2020)
8 - Integration of family, school, and community (2020 < 2021)

1a - Physical safety

Significant difference 2019 vs. 2021, 2020 vs. 2021, but NOT 2019 vs. 2020.

kw.ps = filter(pqays.n, program.type == "Plus Sport")

#Significant.

kruskal.test(median.1a ~ year.cat, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.1a by year.cat
## Kruskal-Wallis chi-squared = 14.615, df = 2, p-value = 0.0006703
pairwise.wilcox.test(kw.ps$median.1a, kw.ps$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.ps$median.1a and kw.ps$year.cat 
## 
##      2019   2020  
## 2020 0.1597 -     
## 2021 0.0077 0.0014
## 
## P value adjustment method: holm

1b - Psychological safety

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.1b ~ year.cat, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.1b by year.cat
## Kruskal-Wallis chi-squared = 2.5369, df = 2, p-value = 0.2813
pairwise.wilcox.test(kw.ps$median.1b, kw.ps$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.ps$median.1b and kw.ps$year.cat 
## 
##      2019 2020
## 2020 0.38 -   
## 2021 0.85 0.62
## 
## P value adjustment method: holm

2 - Appropriate structure

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.2 ~ year.cat, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.2 by year.cat
## Kruskal-Wallis chi-squared = 1.1939, df = 2, p-value = 0.5505
pairwise.wilcox.test(kw.ps$median.2, kw.ps$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.ps$median.2 and kw.ps$year.cat 
## 
##      2019 2020
## 2020 0.79 -   
## 2021 1.00 1.00
## 
## P value adjustment method: holm

3 - Supportive relationships

Significant differences from 2019-2021, 2020-2021, but NOT 2019-2020.

# Significant.

kruskal.test(median.3 ~ year.cat, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.3 by year.cat
## Kruskal-Wallis chi-squared = 11.66, df = 2, p-value = 0.002939
pairwise.wilcox.test(kw.ps$median.3, kw.ps$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.ps$median.3 and kw.ps$year.cat 
## 
##      2019   2020  
## 2020 0.2237 -     
## 2021 0.0044 0.0268
## 
## P value adjustment method: holm

4 - Opportunities to belong

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.4 ~ year.cat, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.4 by year.cat
## Kruskal-Wallis chi-squared = 5.4515, df = 2, p-value = 0.0655
pairwise.wilcox.test(kw.ps$median.4, kw.ps$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.ps$median.4 and kw.ps$year.cat 
## 
##      2019 2020
## 2020 0.8  -   
## 2021 0.1  0.1 
## 
## P value adjustment method: holm

5 - Positive social norms

Significant differences between 2019-2021, 2020-2021, but NOT 2019-2020.

# Significant.

kruskal.test(median.5 ~ year.cat, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.5 by year.cat
## Kruskal-Wallis chi-squared = 12.183, df = 2, p-value = 0.002262
pairwise.wilcox.test(kw.ps$median.5, kw.ps$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.ps$median.5 and kw.ps$year.cat 
## 
##      2019   2020  
## 2020 0.1114 -     
## 2021 0.0031 0.0427
## 
## P value adjustment method: holm

6 - Support for efficacy and mattering

Significant differences 2019-2021, 2020-2021, but NOT 2019-2020.

# Significant.

kruskal.test(median.6 ~ year.cat, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.6 by year.cat
## Kruskal-Wallis chi-squared = 6.3279, df = 2, p-value = 0.04226
pairwise.wilcox.test(kw.ps$median.6, kw.ps$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.ps$median.6 and kw.ps$year.cat 
## 
##      2019  2020 
## 2020 0.977 -    
## 2021 0.071 0.071
## 
## P value adjustment method: holm

7a - Opportunities for sport building - Sport skills

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.7a ~ year.cat, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.7a by year.cat
## Kruskal-Wallis chi-squared = 1.6426, df = 2, p-value = 0.4399
pairwise.wilcox.test(kw.ps$median.7a, kw.ps$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.ps$median.7a and kw.ps$year.cat 
## 
##      2019 2020
## 2020 0.7  -   
## 2021 0.7  0.7 
## 
## P value adjustment method: holm

7b - Opportunities for sport building - Life skills

Significant difference from 2019-2020, 2019-2021 but NOT 2020-2021.

# Significant.

kruskal.test(median.7b ~ year.cat, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.7b by year.cat
## Kruskal-Wallis chi-squared = 14.365, df = 2, p-value = 0.0007598
pairwise.wilcox.test(kw.ps$median.7b, kw.ps$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.ps$median.7b and kw.ps$year.cat 
## 
##      2019   2020  
## 2020 0.0015 -     
## 2021 0.0151 0.4328
## 
## P value adjustment method: holm

8 - Integration of family, school, and community

Significant differences from 2019-2021, 2020-2021, but NOT 2019-2020.

# Significant.

kruskal.test(median.8 ~ year.cat, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.8 by year.cat
## Kruskal-Wallis chi-squared = 29.5, df = 2, p-value = 3.927e-07
pairwise.wilcox.test(kw.ps$median.8, kw.ps$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.ps$median.8 and kw.ps$year.cat 
## 
##      2019    2020   
## 2020 1       -      
## 2021 8.4e-05 8.6e-07
## 
## P value adjustment method: holm

9 - Program fidelity

No significant differences year-over-year.

# Non-significant.

kruskal.test(median.9 ~ year.cat, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.9 by year.cat
## Kruskal-Wallis chi-squared = 1.5238, df = 1, p-value = 0.217

Overall

Significant differences from 2019-2021, 2020-2021, but NOT 2019-2020.

# Significant.

kruskal.test(median.total ~ year.cat, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.total by year.cat
## Kruskal-Wallis chi-squared = 8.9476, df = 2, p-value = 0.0114
pairwise.wilcox.test(kw.ps$median.total, kw.ps$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.ps$median.total and kw.ps$year.cat 
## 
##      2019  2020 
## 2020 0.809 -    
## 2021 0.020 0.027
## 
## P value adjustment method: holm

In-person vs. virtual comparison

Median values for each sub-scale of the PQAYS, in-person (2019-2020) and virtual (2021), by program type (Sport Plus vs. Plus Sport)

## `summarise()` has grouped output by 'program.type'. You can override using the
## `.groups` argument.
## `summarise()` has grouped output by 'program.type'. You can override using the
## `.groups` argument.
Program type Year 1a - Physical Safety 1b - Psychological Safety 2 - Appropriate Structure 3 - Supportive Relationships 4 - Opportunities to Belong 5 - Positive Social Norms 6 - Support for Efficacy and Mattering 7a - Opportunities for Skill-building – Sport Skills 7b - Opportunities for Skill-building – Life Skills 8 - Integration of Family, School and Community Efforts 9 - Program fidelity Overall
Plus Sport In person 5.0 5 5 5.0 4.75 5 4.0 4 NA NA NA 4
Plus Sport Virtual 3.5 5 5 3.5 3.00 4 3.0 4 3.25 3 4.75 4
Sport Plus In person 5.0 4 4 4.0 4.00 5 4.0 4 3.00 1 NA 4
Sport Plus Virtual 4.5 4 5 4.0 4.00 4 3.5 4 2.50 1 4.50 4

Kruskall-Wallis tests comparing year-over-year medians, for Sport Plus and Plus Sport programs, by setting (in-person vs. virtual).

As above, there is change in more sub-scales when considering Plus Sport programs vs. Sport Plus programs. For Sport Plus programs, performance was comparable for almost all sub-scales, except 1a (Physical safety, rated higher in person) and 2 (Appropriate structure, rated higher virtually). There are many Plus Sport programs that perform better in person than virtually. Together, this may suggest that, at least per PQAYS assessment, Plus Sport programs are a better option for in-person, and if to be scaled virtually, there may need to be more of a community aspect that needs to be built.

Sport Plus

Across all sub-scales, for Sport Plus programs, significant differences were observed for subscales …

1a - Physical safety (In person > Virtual) and
2 - Appropriate structure (Virual > In person)

1a - Physical safety

Significant difference, higher performance in-person.

kw.setting.sp = filter(pqays.n, program.type == "Sport Plus")

#Significant.

kruskal.test(median.1a ~ setting, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.1a by setting
## Kruskal-Wallis chi-squared = 10.412, df = 1, p-value = 0.001252
#pairwise.wilcox.test(kw.setting.sp$median.1a, kw.setting.sp$setting, paired = FALSE)

1b - Psychological safety

No significant differences between settings.

# Non-significant.

kruskal.test(median.1b ~ setting, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.1b by setting
## Kruskal-Wallis chi-squared = 0.52475, df = 1, p-value = 0.4688
pairwise.wilcox.test(kw.sp$median.1b, kw.sp$year.cat, paired = FALSE)
## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties

## Warning in wilcox.test.default(xi, xj, paired = paired, ...): cannot compute
## exact p-value with ties
## 
##  Pairwise comparisons using Wilcoxon rank sum test with continuity correction 
## 
## data:  kw.sp$median.1b and kw.sp$year.cat 
## 
##      2019 2020
## 2020 1    -   
## 2021 1    1   
## 
## P value adjustment method: holm

2 - Appropriate structure

Significant difference, higher performance virtually.

# Significant.

kruskal.test(median.2 ~ setting, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.2 by setting
## Kruskal-Wallis chi-squared = 5.791, df = 1, p-value = 0.01611
#pairwise.wilcox.test(kw.sp$median.2, kw.sp$year.cat, paired = FALSE)

3 - Supportive relationships

No significant differences between settings.

# Non-significant.

kruskal.test(median.3 ~ setting, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.3 by setting
## Kruskal-Wallis chi-squared = 0.014524, df = 1, p-value = 0.9041
#pairwise.wilcox.test(kw.sp$median.3, kw.sp$year.cat, paired = FALSE)

4 - Opportunities to belong

No significant differences between settings.

# Non-significant.

kruskal.test(median.4 ~ setting, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.4 by setting
## Kruskal-Wallis chi-squared = 0.011841, df = 1, p-value = 0.9133
#pairwise.wilcox.test(kw.sp$median.4, kw.sp$year.cat, paired = FALSE)

5 - Positive social norms

No significant differences between settings.

# Non-significant.

kruskal.test(median.5 ~ setting, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.5 by setting
## Kruskal-Wallis chi-squared = 2.7866, df = 1, p-value = 0.09506
#pairwise.wilcox.test(kw.sp$median.5, kw.sp$year.cat, paired = FALSE)

6 - Support for efficacy and mattering

No significant differences between settings.

# Non-significant.

kruskal.test(median.6 ~ setting, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.6 by setting
## Kruskal-Wallis chi-squared = 0.066178, df = 1, p-value = 0.797
#pairwise.wilcox.test(kw.sp$median.6, kw.sp$year.cat, paired = FALSE)

7a - Opportunities for sport building - Sport skills

No significant differences between settings.

# Non-significant.

kruskal.test(median.7a ~ setting, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.7a by setting
## Kruskal-Wallis chi-squared = 0.7817, df = 1, p-value = 0.3766
#pairwise.wilcox.test(kw.sp$median.7a, kw.sp$year.cat, paired = FALSE)

7b - Opportunities for sport building - Life skills

No significant differences between settings.

# Non-significant.

kruskal.test(median.7b ~ setting, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.7b by setting
## Kruskal-Wallis chi-squared = 0.33134, df = 1, p-value = 0.5649
#pairwise.wilcox.test(kw.sp$median.7b, kw.sp$year.cat, paired = FALSE)

8 - Integration of family, school, and community

No significant differences between settings.

# Non-significant.

kruskal.test(median.8 ~ setting, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.8 by setting
## Kruskal-Wallis chi-squared = 0.39669, df = 1, p-value = 0.5288
#pairwise.wilcox.test(kw.sp$median.8, kw.sp$year.cat, paired = FALSE)

9 - Program fidelity

No significant differences between settings.

# Non-significant.

kruskal.test(median.9 ~ setting, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.9 by setting
## Kruskal-Wallis chi-squared = 0.21907, df = 1, p-value = 0.6398

Overall

No significant differences between settings.

# Non-significant.

kruskal.test(median.total ~ setting, data = pqays.n, subset = program.type == "Sport Plus")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.total by setting
## Kruskal-Wallis chi-squared = 0.7016, df = 1, p-value = 0.4022
#pairwise.wilcox.test(kw.sp$median.total, kw.sp$year.cat, paired = FALSE)

Plus Sport

Across all sub-scales, for Plus Sport programs, significant differences were observed for for sub-scales…

1a - Physical safety (In person > Virtual)
3 - Supportive relationships (In person > Virtual)
4 - Opportunities to belong (In person > Virtual)
5 - Positive social norms (In person > Virtual)
6 - Support for efficacy and mattering (In person > Virtual)
8 - Integration of family, school, and community (In person > Virtual, but data are limited)

1a - Physical safety

Significant difference, higher performance in person.

kw.setting.ps = filter(pqays.n, program.type == "Plus Sport")

#Significant.

kruskal.test(median.1a ~ setting, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.1a by setting
## Kruskal-Wallis chi-squared = 13.3, df = 1, p-value = 0.0002654
#pairwise.wilcox.test(kw.ps$median.1a, kw.ps$year.cat, paired = FALSE)

1b - Psychological safety

No significant differences between settings.

# Non-significant.

kruskal.test(median.1b ~ setting, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.1b by setting
## Kruskal-Wallis chi-squared = 0.1815, df = 1, p-value = 0.6701
#pairwise.wilcox.test(kw.ps$median.1b, kw.ps$year.cat, paired = FALSE)

2 - Appropriate structure

No significant differences between settings.

# Non-significant.

kruskal.test(median.2 ~ setting, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.2 by setting
## Kruskal-Wallis chi-squared = 0.0042231, df = 1, p-value = 0.9482
#pairwise.wilcox.test(kw.ps$median.2, kw.ps$year.cat, paired = FALSE)

3 - Supportive relationships

Significant differences, higher performance in person.

# Significant.

kruskal.test(median.3 ~ setting, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.3 by setting
## Kruskal-Wallis chi-squared = 10.594, df = 1, p-value = 0.001134
#pairwise.wilcox.test(kw.ps$median.3, kw.ps$year.cat, paired = FALSE)

4 - Opportunities to belong

No significant differences, higher performance in person.

# Significant.

kruskal.test(median.4 ~ setting, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.4 by setting
## Kruskal-Wallis chi-squared = 5.4084, df = 1, p-value = 0.02004
#pairwise.wilcox.test(kw.ps$median.4, kw.ps$year.cat, paired = FALSE)

5 - Positive social norms

Significant differences, higher performance in person.

# Significant.

kruskal.test(median.5 ~ setting, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.5 by setting
## Kruskal-Wallis chi-squared = 10.353, df = 1, p-value = 0.001293
#pairwise.wilcox.test(kw.ps$median.5, kw.ps$year.cat, paired = FALSE)

6 - Support for efficacy and mattering

Significant differences, higher performance in person.

# Significant.

kruskal.test(median.6 ~ setting, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.6 by setting
## Kruskal-Wallis chi-squared = 6.3274, df = 1, p-value = 0.01189
#pairwise.wilcox.test(kw.ps$median.6, kw.ps$year.cat, paired = FALSE)

7a - Opportunities for sport building - Sport skills

No significant differences between settings.

# Non-significant.

kruskal.test(median.7a ~ setting, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.7a by setting
## Kruskal-Wallis chi-squared = 1.513, df = 1, p-value = 0.2187
#pairwise.wilcox.test(kw.ps$median.7a, kw.ps$year.cat, paired = FALSE)

7b - Opportunities for sport building - Life skills

Significant difference, but limited data for in-person.

# Significant.

kruskal.test(median.7b ~ year.cat, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.7b by year.cat
## Kruskal-Wallis chi-squared = 14.365, df = 2, p-value = 0.0007598
#pairwise.wilcox.test(kw.ps$median.7b, kw.ps$year.cat, paired = FALSE)

8 - Integration of family, school, and community

Significant differences, but limited data for in-person.

# Significant.

kruskal.test(median.8 ~ setting, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.8 by setting
## Kruskal-Wallis chi-squared = 29.409, df = 1, p-value = 5.861e-08
#pairwise.wilcox.test(kw.ps$median.8, kw.ps$year.cat, paired = FALSE)

9 - Program fidelity

No significant differences between settings.

# Non-significant.

kruskal.test(median.9 ~ setting, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.9 by setting
## Kruskal-Wallis chi-squared = 1.5238, df = 1, p-value = 0.217

Overall

Significant differences, higher performance in person.

# Significant.

kruskal.test(median.total ~ setting, data = pqays.n, subset = program.type == "Plus Sport")
## 
##  Kruskal-Wallis rank sum test
## 
## data:  median.total by setting
## Kruskal-Wallis chi-squared = 8.8977, df = 1, p-value = 0.002855
#pairwise.wilcox.test(kw.ps$median.total, kw.ps$year.cat, paired = FALSE)