Publication Bias in the Relationship between Childhood Maltreatment and Mental Health
Setup
library(pacman); p_load(ggplot2, DT, meta, metafor, dmetar, DescTools, tools, metasens)
datatable(data, extensions = c("Buttons", "FixedColumns"), options = list(dom = 'Bfrtip', buttons = c('copy', 'csv', 'print'), scrollX = T, fixedColumns = list(leftColumns = 3)))d2rpb <- function(d, n1, n2){
m = n1 + n2 - 2
h = m/n1 + m/n2
rpb = (d * sqrt(d^2 + h))/(d^2 + h)
return(rpb)}
d2rpb(.31, n1 = 1000, n2 = 1000) #Balanced numbers## [1] 0.1532458Internalizing, Externalizing, and Other might be off in the data above. GPT-3 did the classification for that column because I didn’t want to and Baldwin et al. (2023) didn’t provide the classifications by estimate or study. Misclassifications by quasi-experimental design are also the fault of GPT-3 and Baldwin et al. not providing a marker for design by provided estimates in their supplement.
Rationale
Baldwin et al. meta-analyzed plausibly quasi-causal studies of the relationship between childhood maltreatment and mental health problems. They found a moderate effect (r = .15) and claimed they accounted for publication bias after finding evidence for it, but their corrections were poor. Their method of accounting for publication bias was to leave out estimates from cohorts/studies in turn and then recalculate the meta-analytic estimate (jackknifing), but this obviously shouldn’t do much given the very large number of effect sizes. A real correction, like trim-and-fill or PET-PEESE would correct for many studies at once if bias were severe. The used method was insufficient so, below, I have provided the trim-and-fill estimates for the data that was extracted from the supplementary materials by GPT-3.
Analysis
Meta-Analysis
MalMeta <- metagen(
TE = d,
seTE = SE,
sm = "SMD",
studlab = Study,
backtrans = T,
data = data,
hakn = T,
method.tau = "SJ",
title = "Effects of Childhood Maltreatment on Mental Health"); summary(MalMeta)## Review: Effects of Childhood Maltreatment on Mental Health
##
## SMD 95%-CI %W(common) %W(random)
## Dinwiddie et al. 2000 0.1970 [-0.1813; 0.5753] 0.2 0.6
## Dinwiddie et al. 2000 0.2520 [-0.0655; 0.5695] 0.2 0.7
## Dinwiddie et al. 2000 0.4660 [-0.2807; 1.2127] 0.0 0.3
## Dinwiddie et al. 2000 0.3820 [-0.2119; 0.9759] 0.1 0.4
## Dinwiddie et al. 2000 0.2240 [-0.4757; 0.9237] 0.0 0.3
## Dinwiddie et al. 2000 0.5050 [-0.0164; 1.0264] 0.1 0.4
## Dinwiddie et al. 2000 0.1230 [-0.5983; 0.8443] 0.0 0.3
## Dinwiddie et al. 2000 0.2420 [-0.0696; 0.5536] 0.2 0.7
## Dinwiddie et al. 2000 0.2240 [-0.4757; 0.9237] 0.0 0.3
## Dinwiddie et al. 2000 0.9400 [ 0.1109; 1.7691] 0.0 0.2
## Dinwiddie et al. 2000 0.0000 [-0.8859; 0.8859] 0.0 0.2
## Dinwiddie et al. 2000 0.3820 [-0.3824; 1.1464] 0.0 0.2
## Dinwiddie et al. 2000 0.3820 [-0.2805; 1.0445] 0.1 0.3
## Kendler et al. 2000 0.1860 [-0.0943; 0.4663] 0.3 0.7
## Kendler et al. 2000 0.2120 [-0.1447; 0.5687] 0.2 0.6
## Kendler et al. 2000 0.5740 [ 0.0664; 1.0816] 0.1 0.4
## Kendler et al. 2000 0.3820 [-0.2119; 0.9759] 0.1 0.4
## Kendler et al. 2000 0.1570 [-0.6642; 0.9782] 0.0 0.2
## Beckett et al. 2002 1.2190 [ 0.0842; 2.3538] 0.0 0.1
## Nelson et al. 2002 0.2450 [ 0.0333; 0.4567] 0.5 0.8
## Nelson et al. 2002 0.5540 [ 0.1738; 0.9342] 0.2 0.6
## Nelson et al. 2002 0.6060 [ 0.1650; 1.0470] 0.1 0.5
## Nelson et al. 2002 0.2450 [ 0.0059; 0.4841] 0.4 0.8
## Nelson et al. 2002 0.4660 [ 0.1308; 0.8012] 0.2 0.6
## Riggins-Caspers et al. 2003 0.3870 [ 0.0597; 0.7143] 0.2 0.7
## Riggins-Caspers et al. 2003 0.5160 [ 0.1828; 0.8492] 0.2 0.6
## Lynch et al. 2006 0.3030 [ 0.1795; 0.4265] 1.6 0.9
## Lynch et al. 2006 0.3430 [ 0.2195; 0.4665] 1.6 0.9
## Lynch et al. 2006 0.1650 [ 0.0415; 0.2885] 1.6 0.9
## Nelson et al. 2006 0.1360 [-0.1521; 0.4241] 0.3 0.7
## Nelson et al. 2006 1.0320 [ 0.2127; 1.8513] 0.0 0.2
## Nelson et al. 2006 0.8290 [-0.0157; 1.6737] 0.0 0.2
## Nelson et al. 2006 0.3020 [-0.1076; 0.7116] 0.1 0.5
## Nelson et al. 2006 0.3820 [-0.3824; 1.1464] 0.0 0.2
## Nelson et al. 2006 0.3180 [ 0.0358; 0.6002] 0.3 0.7
## Nelson et al. 2006 0.4300 [ 0.0360; 0.8240] 0.2 0.6
## Thornberry et al. 2010 0.2430 [-0.0059; 0.4919] 0.4 0.8
## Thornberry et al. 2010 0.3690 [ 0.0672; 0.6708] 0.3 0.7
## Thornberry et al. 2010 0.2090 [ 0.0052; 0.4128] 0.6 0.8
## Thornberry et al. 2010 0.4080 [ 0.1042; 0.7118] 0.3 0.7
## Thornberry et al. 2010 0.4960 [ 0.1491; 0.8429] 0.2 0.6
## Thornberry et al. 2010 0.1970 [-0.0441; 0.4381] 0.4 0.8
## Young-Wolff et al. 2011 -0.0460 [-0.4909; 0.3989] 0.1 0.5
## Magnusson et al. 2012 0.0320 [-0.3306; 0.3946] 0.2 0.6
## Magnusson et al. 2012 0.2010 [-0.2674; 0.6694] 0.1 0.5
## Magnusson et al. 2012 0.4660 [-0.0612; 0.9932] 0.1 0.4
## Alemany et al. 2013 0.3810 [ 0.0772; 0.6848] 0.3 0.7
## Alemany et al. 2013 0.3900 [ 0.0862; 0.6938] 0.3 0.7
## Berenz et al. 2013 0.0630 [-0.0958; 0.2218] 0.9 0.9
## Berenz et al. 2013 0.0900 [-0.0688; 0.2488] 0.9 0.9
## Berenz et al. 2013 0.0630 [-0.0958; 0.2218] 0.9 0.9
## Berenz et al. 2013 0.0630 [-0.0958; 0.2218] 0.9 0.9
## Berenz et al. 2013 0.1270 [-0.0318; 0.2858] 0.9 0.9
## Berenz et al. 2013 0.1550 [-0.0038; 0.3138] 0.9 0.9
## Berenz et al. 2013 0.1550 [-0.0038; 0.3138] 0.9 0.9
## Berenz et al. 2013 0.0000 [-0.1588; 0.1588] 0.9 0.9
## Berenz et al. 2013 0.1270 [-0.0318; 0.2858] 0.9 0.9
## Bornovalova et al. 2013 0.0900 [-0.0864; 0.2664] 0.8 0.9
## Bornovalova et al. 2013 0.1900 [-0.0452; 0.4252] 0.4 0.8
## Bornovalova et al. 2013 0.1300 [-0.0660; 0.3260] 0.6 0.8
## Bornovalova et al. 2013 -0.0500 [-0.3440; 0.2440] 0.3 0.7
## Voith et al. 2014 0.1500 [ 0.0618; 0.2382] 3.1 1.0
## Voith et al. 2014 0.1180 [ 0.0298; 0.2062] 3.1 1.0
## Barrigon et al. 2015 1.0960 [ 0.0337; 2.1583] 0.0 0.1
## Capusan et al. 2016 0.1800 [ 0.1055; 0.2545] 4.3 1.0
## Capusan et al. 2016 0.1900 [ 0.1155; 0.2645] 4.3 1.0
## Capusan et al. 2016 0.2500 [-0.0401; 0.5401] 0.3 0.7
## Capusan et al. 2016 0.0800 [-0.0650; 0.2250] 1.1 0.9
## Capusan et al. 2016 0.2000 [ 0.0197; 0.3803] 0.7 0.9
## Capusan et al. 2016 0.1900 [ 0.0646; 0.3154] 1.5 0.9
## Capusan et al. 2016 0.2400 [ 0.0146; 0.4654] 0.5 0.8
## Capusan et al. 2016 0.1500 [-0.0048; 0.3048] 1.0 0.9
## Dinkler et al. 2017 0.2600 [-0.0654; 0.5854] 0.2 0.7
## Dinkler et al. 2017 0.5000 [ 0.2001; 0.7999] 0.3 0.7
## Schaefer et al. 2017 0.6440 [ 0.3853; 0.9027] 0.4 0.8
## Schaefer et al. 2017 0.6550 [ 0.4492; 0.8608] 0.6 0.8
## Schaefer et al. 2017 0.6760 [ 0.4878; 0.8642] 0.7 0.9
## Schaefer et al. 2017 0.6980 [ 0.4746; 0.9214] 0.5 0.8
## Sonuga-Barke et al. 2017 0.7720 [ 0.3408; 1.2032] 0.1 0.5
## Sonuga-Barke et al. 2017 1.3780 [ 0.8370; 1.9190] 0.1 0.4
## Sonuga-Barke et al. 2017 0.9370 [ 0.2883; 1.5857] 0.1 0.3
## Sonuga-Barke et al. 2017 0.9370 [ 0.2883; 1.5857] 0.1 0.3
## Sonuga-Barke et al. 2017 0.8270 [ 0.2860; 1.3680] 0.1 0.4
## Sonuga-Barke et al. 2017 0.5510 [ 0.0100; 1.0920] 0.1 0.4
## Sonuga-Barke et al. 2017 0.8820 [ 0.3410; 1.4230] 0.1 0.4
## Sonuga-Barke et al. 2017 1.0480 [ 0.3993; 1.6967] 0.1 0.3
## Sonuga-Barke et al. 2017 0.0000 [-0.6487; 0.6487] 0.1 0.3
## Sonuga-Barke et al. 2017 0.1650 [-0.3760; 0.7060] 0.1 0.4
## Sonuga-Barke et al. 2017 0.5510 [-0.2055; 1.3075] 0.0 0.3
## Sonuga-Barke et al. 2017 1.0480 [ 0.3993; 1.6967] 0.1 0.3
## Sonuga-Barke et al. 2017 0.0550 [-0.3762; 0.4862] 0.1 0.5
## Sonuga-Barke et al. 2017 0.2210 [-0.2122; 0.6542] 0.1 0.5
## Sonuga-Barke et al. 2017 0.1650 [-0.3760; 0.7060] 0.1 0.4
## Sonuga-Barke et al. 2017 0.5510 [-0.2055; 1.3075] 0.0 0.3
## Sonuga-Barke et al. 2017 1.0480 [ 0.3993; 1.6967] 0.1 0.3
## Sonuga-Barke et al. 2017 0.0550 [-0.3762; 0.4862] 0.1 0.5
## Sonuga-Barke et al. 2017 0.2210 [-0.2122; 0.6542] 0.1 0.5
## Sonuga-Barke et al. 2017 0.7170 [ 0.1760; 1.2580] 0.1 0.4
## Sonuga-Barke et al. 2017 0.2760 [-0.3727; 0.9247] 0.1 0.3
## Sonuga-Barke et al. 2017 1.1580 [ 0.4015; 1.9145] 0.0 0.3
## Sonuga-Barke et al. 2017 0.4410 [-0.1000; 0.9820] 0.1 0.4
## Sonuga-Barke et al. 2017 0.0550 [-0.4860; 0.5960] 0.1 0.4
## Sonuga-Barke et al. 2017 -0.2210 [-0.7620; 0.3200] 0.1 0.4
## Zvara et al. 2017 0.2900 [ 0.0156; 0.5644] 0.3 0.7
## Ma et al. 2018 0.7040 [ 0.5119; 0.8961] 0.6 0.9
## Obikane et al. 2018 0.5320 [ 0.2968; 0.7672] 0.4 0.8
## Obikane et al. 2018 0.2580 [-0.3163; 0.8323] 0.1 0.4
## Obikane et al. 2018 0.4390 [ 0.2038; 0.6742] 0.4 0.8
## Obikane et al. 2018 0.5760 [ 0.3643; 0.7877] 0.5 0.8
## Obikane et al. 2018 0.5670 [ 0.1554; 0.9786] 0.1 0.5
## Obikane et al. 2018 0.5390 [ 0.3391; 0.7389] 0.6 0.8
## Obikane et al. 2018 0.4620 [ 0.0994; 0.8246] 0.2 0.6
## Obikane et al. 2018 0.1670 [-0.4367; 0.7707] 0.1 0.3
## Obikane et al. 2018 0.3960 [ 0.0608; 0.7312] 0.2 0.6
## Obikane et al. 2018 0.4470 [ 0.1118; 0.7822] 0.2 0.6
## Obikane et al. 2018 0.3140 [-0.1701; 0.7981] 0.1 0.5
## Obikane et al. 2018 0.4630 [ 0.1357; 0.7903] 0.2 0.7
## Obikane et al. 2018 0.5100 [ 0.0592; 0.9608] 0.1 0.5
## Obikane et al. 2018 -0.3480 [-1.3221; 0.6261] 0.0 0.2
## Obikane et al. 2018 0.3580 [-0.1261; 0.8421] 0.1 0.5
## Obikane et al. 2018 0.6510 [ 0.3786; 0.9234] 0.3 0.7
## Obikane et al. 2018 0.9610 [ 0.4005; 1.5215] 0.1 0.4
## Obikane et al. 2018 0.6590 [ 0.3944; 0.9236] 0.3 0.7
## Stern et al. 2018 0.1400 [ 0.0224; 0.2576] 1.7 1.0
## Stern et al. 2018 0.3450 [ 0.2254; 0.4646] 1.7 0.9
## Baldwin et al. 2019 0.2050 [ 0.0521; 0.3579] 1.0 0.9
## Baldwin et al. 2019 0.2240 [ 0.0907; 0.3573] 1.3 0.9
## Baldwin et al. 2019 0.1360 [-0.1031; 0.3751] 0.4 0.8
## Gerin et al. 2019 0.6200 [ 0.3260; 0.9140] 0.3 0.7
## Kugler et al. 2019 0.3620 [ 0.1562; 0.5678] 0.6 0.8
## Kugler et al. 2019 0.2350 [ 0.0292; 0.4408] 0.6 0.8
## Lecei et al. 2019 0.2950 [ 0.0539; 0.5361] 0.4 0.8
## Lecei et al. 2019 0.2700 [ 0.0289; 0.5111] 0.4 0.8
## Lecei et al. 2019 0.3860 [ 0.1430; 0.6290] 0.4 0.8
## Lecei et al. 2019 0.2540 [ 0.0129; 0.4951] 0.4 0.8
## Schwartz et al. 2019 0.1160 [-0.0173; 0.2493] 1.3 0.9
## Schwartz et al. 2019 0.2260 [ 0.0927; 0.3593] 1.3 0.9
## Schwartz et al. 2019 0.1070 [ 0.0364; 0.1776] 4.8 1.0
## Alvanzo et al. 2020 -0.0900 [-0.3291; 0.1491] 0.4 0.8
## Alvanzo et al. 2020 0.0050 [-0.2224; 0.2324] 0.5 0.8
## Alvanzo et al. 2020 0.0670 [-0.1074; 0.2414] 0.8 0.9
## Alvanzo et al. 2020 0.1360 [-0.0286; 0.3006] 0.9 0.9
## Golm et al. 2020 0.4800 [ 0.0880; 0.8720] 0.2 0.6
## Golm et al. 2020 0.4900 [ 0.0980; 0.8820] 0.2 0.6
## Golm et al. 2020 0.4100 [-0.0016; 0.8216] 0.1 0.5
## Golm et al. 2020 0.3800 [-0.0316; 0.7916] 0.1 0.5
## Kullberg et al. 2020 0.5090 [ 0.3502; 0.6678] 0.9 0.9
## Kullberg et al. 2020 -0.0020 [-0.1568; 0.1528] 1.0 0.9
## Kullberg et al. 2020 0.0680 [-0.0868; 0.2228] 1.0 0.9
## Kullberg et al. 2020 0.2920 [ 0.1352; 0.4488] 1.0 0.9
## Kullberg et al. 2020 0.0730 [-0.0818; 0.2278] 1.0 0.9
## Kullberg et al. 2020 0.1040 [-0.0508; 0.2588] 1.0 0.9
## Capusan et al. 2021 0.7710 [ 0.4888; 1.0532] 0.3 0.7
## Isumi et al. 2021 0.3330 [ 0.2820; 0.3840] 9.2 1.0
## Li et al. 2021 0.1000 [ 0.0373; 0.1627] 6.1 1.0
## Li et al. 2021 0.0800 [ 0.0173; 0.1427] 6.1 1.0
##
## Number of studies combined: k = 156
##
## SMD 95%-CI z|t p-value
## Common effect model 0.2237 [0.2082; 0.2391] 28.39 < 0.0001
## Random effects model (HK) 0.3107 [0.2713; 0.3502] 15.55 < 0.0001
##
## Quantifying heterogeneity:
## tau^2 = 0.0492 [0.0208; 0.0498]; tau = 0.2217 [0.1444; 0.2231]
## I^2 = 68.2% [62.5%; 73.0%]; H = 1.77 [1.63; 1.93]
##
## Test of heterogeneity:
## Q d.f. p-value
## 487.64 155 < 0.0001
##
## Details on meta-analytical method:
## - Inverse variance method
## - Sidik-Jonkman estimator for tau^2
## - Q-Profile method for confidence interval of tau^2 and tau
## - Hartung-Knapp (HK) adjustment for random effects model (df = 155)forest.meta(
MalMeta,
layout = "JAMA",
sortvar = TE,
print.tau2 = T)
Publication Bias
Egger’s method.
metabias(MalMeta, method.bias = "linreg")## Review: Effects of Childhood Maltreatment on Mental Health
##
## Linear regression test of funnel plot asymmetry
##
## Test result: t = 5.88, df = 154, p-value < 0.0001
##
## Sample estimates:
## bias se.bias intercept se.intercept
## 1.2572 0.2138 0.1249 0.0210
##
## Details:
## - multiplicative residual heterogeneity variance (tau^2 = 2.5858)
## - predictor: standard error
## - weight: inverse variance
## - reference: Egger et al. (1997), BMJBiased! Now for the trim-and-fill.
TF <- trimfill(MalMeta); summary(TF)## Review: Effects of Childhood Maltreatment on Mental Health
##
## SMD 95%-CI %W(random)
## Dinwiddie et al. 2000 0.1970 [-0.1813; 0.5753] 0.5
## Dinwiddie et al. 2000 0.2520 [-0.0655; 0.5695] 0.5
## Dinwiddie et al. 2000 0.4660 [-0.2807; 1.2127] 0.3
## Dinwiddie et al. 2000 0.3820 [-0.2119; 0.9759] 0.4
## Dinwiddie et al. 2000 0.2240 [-0.4757; 0.9237] 0.3
## Dinwiddie et al. 2000 0.5050 [-0.0164; 1.0264] 0.4
## Dinwiddie et al. 2000 0.1230 [-0.5983; 0.8443] 0.3
## Dinwiddie et al. 2000 0.2420 [-0.0696; 0.5536] 0.5
## Dinwiddie et al. 2000 0.2240 [-0.4757; 0.9237] 0.3
## Dinwiddie et al. 2000 0.9400 [ 0.1109; 1.7691] 0.3
## Dinwiddie et al. 2000 0.0000 [-0.8859; 0.8859] 0.2
## Dinwiddie et al. 2000 0.3820 [-0.3824; 1.1464] 0.3
## Dinwiddie et al. 2000 0.3820 [-0.2805; 1.0445] 0.3
## Kendler et al. 2000 0.1860 [-0.0943; 0.4663] 0.6
## Kendler et al. 2000 0.2120 [-0.1447; 0.5687] 0.5
## Kendler et al. 2000 0.5740 [ 0.0664; 1.0816] 0.4
## Kendler et al. 2000 0.3820 [-0.2119; 0.9759] 0.4
## Kendler et al. 2000 0.1570 [-0.6642; 0.9782] 0.3
## Beckett et al. 2002 1.2190 [ 0.0842; 2.3538] 0.2
## Nelson et al. 2002 0.2450 [ 0.0333; 0.4567] 0.6
## Nelson et al. 2002 0.5540 [ 0.1738; 0.9342] 0.5
## Nelson et al. 2002 0.6060 [ 0.1650; 1.0470] 0.5
## Nelson et al. 2002 0.2450 [ 0.0059; 0.4841] 0.6
## Nelson et al. 2002 0.4660 [ 0.1308; 0.8012] 0.5
## Riggins-Caspers et al. 2003 0.3870 [ 0.0597; 0.7143] 0.5
## Riggins-Caspers et al. 2003 0.5160 [ 0.1828; 0.8492] 0.5
## Lynch et al. 2006 0.3030 [ 0.1795; 0.4265] 0.6
## Lynch et al. 2006 0.3430 [ 0.2195; 0.4665] 0.6
## Lynch et al. 2006 0.1650 [ 0.0415; 0.2885] 0.6
## Nelson et al. 2006 0.1360 [-0.1521; 0.4241] 0.6
## Nelson et al. 2006 1.0320 [ 0.2127; 1.8513] 0.3
## Nelson et al. 2006 0.8290 [-0.0157; 1.6737] 0.3
## Nelson et al. 2006 0.3020 [-0.1076; 0.7116] 0.5
## Nelson et al. 2006 0.3820 [-0.3824; 1.1464] 0.3
## Nelson et al. 2006 0.3180 [ 0.0358; 0.6002] 0.6
## Nelson et al. 2006 0.4300 [ 0.0360; 0.8240] 0.5
## Thornberry et al. 2010 0.2430 [-0.0059; 0.4919] 0.6
## Thornberry et al. 2010 0.3690 [ 0.0672; 0.6708] 0.5
## Thornberry et al. 2010 0.2090 [ 0.0052; 0.4128] 0.6
## Thornberry et al. 2010 0.4080 [ 0.1042; 0.7118] 0.5
## Thornberry et al. 2010 0.4960 [ 0.1491; 0.8429] 0.5
## Thornberry et al. 2010 0.1970 [-0.0441; 0.4381] 0.6
## Young-Wolff et al. 2011 -0.0460 [-0.4909; 0.3989] 0.5
## Magnusson et al. 2012 0.0320 [-0.3306; 0.3946] 0.5
## Magnusson et al. 2012 0.2010 [-0.2674; 0.6694] 0.4
## Magnusson et al. 2012 0.4660 [-0.0612; 0.9932] 0.4
## Alemany et al. 2013 0.3810 [ 0.0772; 0.6848] 0.5
## Alemany et al. 2013 0.3900 [ 0.0862; 0.6938] 0.5
## Berenz et al. 2013 0.0630 [-0.0958; 0.2218] 0.6
## Berenz et al. 2013 0.0900 [-0.0688; 0.2488] 0.6
## Berenz et al. 2013 0.0630 [-0.0958; 0.2218] 0.6
## Berenz et al. 2013 0.0630 [-0.0958; 0.2218] 0.6
## Berenz et al. 2013 0.1270 [-0.0318; 0.2858] 0.6
## Berenz et al. 2013 0.1550 [-0.0038; 0.3138] 0.6
## Berenz et al. 2013 0.1550 [-0.0038; 0.3138] 0.6
## Berenz et al. 2013 0.0000 [-0.1588; 0.1588] 0.6
## Berenz et al. 2013 0.1270 [-0.0318; 0.2858] 0.6
## Bornovalova et al. 2013 0.0900 [-0.0864; 0.2664] 0.6
## Bornovalova et al. 2013 0.1900 [-0.0452; 0.4252] 0.6
## Bornovalova et al. 2013 0.1300 [-0.0660; 0.3260] 0.6
## Bornovalova et al. 2013 -0.0500 [-0.3440; 0.2440] 0.6
## Voith et al. 2014 0.1500 [ 0.0618; 0.2382] 0.6
## Voith et al. 2014 0.1180 [ 0.0298; 0.2062] 0.6
## Barrigon et al. 2015 1.0960 [ 0.0337; 2.1583] 0.2
## Capusan et al. 2016 0.1800 [ 0.1055; 0.2545] 0.7
## Capusan et al. 2016 0.1900 [ 0.1155; 0.2645] 0.7
## Capusan et al. 2016 0.2500 [-0.0401; 0.5401] 0.6
## Capusan et al. 2016 0.0800 [-0.0650; 0.2250] 0.6
## Capusan et al. 2016 0.2000 [ 0.0197; 0.3803] 0.6
## Capusan et al. 2016 0.1900 [ 0.0646; 0.3154] 0.6
## Capusan et al. 2016 0.2400 [ 0.0146; 0.4654] 0.6
## Capusan et al. 2016 0.1500 [-0.0048; 0.3048] 0.6
## Dinkler et al. 2017 0.2600 [-0.0654; 0.5854] 0.5
## Dinkler et al. 2017 0.5000 [ 0.2001; 0.7999] 0.5
## Schaefer et al. 2017 0.6440 [ 0.3853; 0.9027] 0.6
## Schaefer et al. 2017 0.6550 [ 0.4492; 0.8608] 0.6
## Schaefer et al. 2017 0.6760 [ 0.4878; 0.8642] 0.6
## Schaefer et al. 2017 0.6980 [ 0.4746; 0.9214] 0.6
## Sonuga-Barke et al. 2017 0.7720 [ 0.3408; 1.2032] 0.5
## Sonuga-Barke et al. 2017 1.3780 [ 0.8370; 1.9190] 0.4
## Sonuga-Barke et al. 2017 0.9370 [ 0.2883; 1.5857] 0.3
## Sonuga-Barke et al. 2017 0.9370 [ 0.2883; 1.5857] 0.3
## Sonuga-Barke et al. 2017 0.8270 [ 0.2860; 1.3680] 0.4
## Sonuga-Barke et al. 2017 0.5510 [ 0.0100; 1.0920] 0.4
## Sonuga-Barke et al. 2017 0.8820 [ 0.3410; 1.4230] 0.4
## Sonuga-Barke et al. 2017 1.0480 [ 0.3993; 1.6967] 0.3
## Sonuga-Barke et al. 2017 0.0000 [-0.6487; 0.6487] 0.3
## Sonuga-Barke et al. 2017 0.1650 [-0.3760; 0.7060] 0.4
## Sonuga-Barke et al. 2017 0.5510 [-0.2055; 1.3075] 0.3
## Sonuga-Barke et al. 2017 1.0480 [ 0.3993; 1.6967] 0.3
## Sonuga-Barke et al. 2017 0.0550 [-0.3762; 0.4862] 0.5
## Sonuga-Barke et al. 2017 0.2210 [-0.2122; 0.6542] 0.5
## Sonuga-Barke et al. 2017 0.1650 [-0.3760; 0.7060] 0.4
## Sonuga-Barke et al. 2017 0.5510 [-0.2055; 1.3075] 0.3
## Sonuga-Barke et al. 2017 1.0480 [ 0.3993; 1.6967] 0.3
## Sonuga-Barke et al. 2017 0.0550 [-0.3762; 0.4862] 0.5
## Sonuga-Barke et al. 2017 0.2210 [-0.2122; 0.6542] 0.5
## Sonuga-Barke et al. 2017 0.7170 [ 0.1760; 1.2580] 0.4
## Sonuga-Barke et al. 2017 0.2760 [-0.3727; 0.9247] 0.3
## Sonuga-Barke et al. 2017 1.1580 [ 0.4015; 1.9145] 0.3
## Sonuga-Barke et al. 2017 0.4410 [-0.1000; 0.9820] 0.4
## Sonuga-Barke et al. 2017 0.0550 [-0.4860; 0.5960] 0.4
## Sonuga-Barke et al. 2017 -0.2210 [-0.7620; 0.3200] 0.4
## Zvara et al. 2017 0.2900 [ 0.0156; 0.5644] 0.6
## Ma et al. 2018 0.7040 [ 0.5119; 0.8961] 0.6
## Obikane et al. 2018 0.5320 [ 0.2968; 0.7672] 0.6
## Obikane et al. 2018 0.2580 [-0.3163; 0.8323] 0.4
## Obikane et al. 2018 0.4390 [ 0.2038; 0.6742] 0.6
## Obikane et al. 2018 0.5760 [ 0.3643; 0.7877] 0.6
## Obikane et al. 2018 0.5670 [ 0.1554; 0.9786] 0.5
## Obikane et al. 2018 0.5390 [ 0.3391; 0.7389] 0.6
## Obikane et al. 2018 0.4620 [ 0.0994; 0.8246] 0.5
## Obikane et al. 2018 0.1670 [-0.4367; 0.7707] 0.4
## Obikane et al. 2018 0.3960 [ 0.0608; 0.7312] 0.5
## Obikane et al. 2018 0.4470 [ 0.1118; 0.7822] 0.5
## Obikane et al. 2018 0.3140 [-0.1701; 0.7981] 0.4
## Obikane et al. 2018 0.4630 [ 0.1357; 0.7903] 0.5
## Obikane et al. 2018 0.5100 [ 0.0592; 0.9608] 0.5
## Obikane et al. 2018 -0.3480 [-1.3221; 0.6261] 0.2
## Obikane et al. 2018 0.3580 [-0.1261; 0.8421] 0.4
## Obikane et al. 2018 0.6510 [ 0.3786; 0.9234] 0.6
## Obikane et al. 2018 0.9610 [ 0.4005; 1.5215] 0.4
## Obikane et al. 2018 0.6590 [ 0.3944; 0.9236] 0.6
## Stern et al. 2018 0.1400 [ 0.0224; 0.2576] 0.6
## Stern et al. 2018 0.3450 [ 0.2254; 0.4646] 0.6
## Baldwin et al. 2019 0.2050 [ 0.0521; 0.3579] 0.6
## Baldwin et al. 2019 0.2240 [ 0.0907; 0.3573] 0.6
## Baldwin et al. 2019 0.1360 [-0.1031; 0.3751] 0.6
## Gerin et al. 2019 0.6200 [ 0.3260; 0.9140] 0.6
## Kugler et al. 2019 0.3620 [ 0.1562; 0.5678] 0.6
## Kugler et al. 2019 0.2350 [ 0.0292; 0.4408] 0.6
## Lecei et al. 2019 0.2950 [ 0.0539; 0.5361] 0.6
## Lecei et al. 2019 0.2700 [ 0.0289; 0.5111] 0.6
## Lecei et al. 2019 0.3860 [ 0.1430; 0.6290] 0.6
## Lecei et al. 2019 0.2540 [ 0.0129; 0.4951] 0.6
## Schwartz et al. 2019 0.1160 [-0.0173; 0.2493] 0.6
## Schwartz et al. 2019 0.2260 [ 0.0927; 0.3593] 0.6
## Schwartz et al. 2019 0.1070 [ 0.0364; 0.1776] 0.7
## Alvanzo et al. 2020 -0.0900 [-0.3291; 0.1491] 0.6
## Alvanzo et al. 2020 0.0050 [-0.2224; 0.2324] 0.6
## Alvanzo et al. 2020 0.0670 [-0.1074; 0.2414] 0.6
## Alvanzo et al. 2020 0.1360 [-0.0286; 0.3006] 0.6
## Golm et al. 2020 0.4800 [ 0.0880; 0.8720] 0.5
## Golm et al. 2020 0.4900 [ 0.0980; 0.8820] 0.5
## Golm et al. 2020 0.4100 [-0.0016; 0.8216] 0.5
## Golm et al. 2020 0.3800 [-0.0316; 0.7916] 0.5
## Kullberg et al. 2020 0.5090 [ 0.3502; 0.6678] 0.6
## Kullberg et al. 2020 -0.0020 [-0.1568; 0.1528] 0.6
## Kullberg et al. 2020 0.0680 [-0.0868; 0.2228] 0.6
## Kullberg et al. 2020 0.2920 [ 0.1352; 0.4488] 0.6
## Kullberg et al. 2020 0.0730 [-0.0818; 0.2278] 0.6
## Kullberg et al. 2020 0.1040 [-0.0508; 0.2588] 0.6
## Capusan et al. 2021 0.7710 [ 0.4888; 1.0532] 0.6
## Isumi et al. 2021 0.3330 [ 0.2820; 0.3840] 0.7
## Li et al. 2021 0.1000 [ 0.0373; 0.1627] 0.7
## Li et al. 2021 0.0800 [ 0.0173; 0.1427] 0.7
## Filled: Obikane et al. 2018 -0.1046 [-0.4319; 0.2228] 0.5
## Filled: Dinwiddie et al. 2000 -0.1076 [-0.8543; 0.6392] 0.3
## Filled: Nelson et al. 2002 -0.1076 [-0.4427; 0.2276] 0.5
## Filled: Magnusson et al. 2012 -0.1076 [-0.6348; 0.4197] 0.4
## Filled: Golm et al. 2020 -0.1216 [-0.5136; 0.2704] 0.5
## Filled: Golm et al. 2020 -0.1316 [-0.5236; 0.2604] 0.5
## Filled: Thornberry et al. 2010 -0.1376 [-0.4845; 0.2094] 0.5
## Filled: Dinkler et al. 2017 -0.1416 [-0.4414; 0.1583] 0.5
## Filled: Dinwiddie et al. 2000 -0.1466 [-0.6679; 0.3748] 0.4
## Filled: Kullberg et al. 2020 -0.1506 [-0.3093; 0.0082] 0.6
## Filled: Obikane et al. 2018 -0.1516 [-0.6024; 0.2992] 0.5
## Filled: Riggins-Caspers et al. 2003 -0.1576 [-0.4908; 0.1756] 0.5
## Filled: Obikane et al. 2018 -0.1736 [-0.4088; 0.0616] 0.6
## Filled: Obikane et al. 2018 -0.1806 [-0.3805; 0.0194] 0.6
## Filled: Sonuga-Barke et al. 2017 -0.1926 [-0.7335; 0.3484] 0.4
## Filled: Sonuga-Barke et al. 2017 -0.1926 [-0.9491; 0.5640] 0.3
## Filled: Sonuga-Barke et al. 2017 -0.1926 [-0.9491; 0.5640] 0.3
## Filled: Nelson et al. 2002 -0.1956 [-0.5758; 0.1847] 0.5
## Filled: Obikane et al. 2018 -0.2086 [-0.6202; 0.2030] 0.5
## Filled: Kendler et al. 2000 -0.2156 [-0.7232; 0.2921] 0.4
## Filled: Obikane et al. 2018 -0.2176 [-0.4292; -0.0059] 0.6
## Filled: Nelson et al. 2002 -0.2476 [-0.6886; 0.1934] 0.5
## Filled: Gerin et al. 2019 -0.2616 [-0.5556; 0.0324] 0.6
## Filled: Schaefer et al. 2017 -0.2856 [-0.5443; -0.0268] 0.6
## Filled: Obikane et al. 2018 -0.2926 [-0.5650; -0.0201] 0.6
## Filled: Schaefer et al. 2017 -0.2966 [-0.5024; -0.0908] 0.6
## Filled: Obikane et al. 2018 -0.3006 [-0.5652; -0.0360] 0.6
## Filled: Schaefer et al. 2017 -0.3176 [-0.5057; -0.1294] 0.6
## Filled: Schaefer et al. 2017 -0.3396 [-0.5630; -0.1161] 0.6
## Filled: Ma et al. 2018 -0.3456 [-0.5376; -0.1535] 0.6
## Filled: Sonuga-Barke et al. 2017 -0.3586 [-0.8995; 0.1824] 0.4
## Filled: Capusan et al. 2021 -0.4126 [-0.6948; -0.1303] 0.6
## Filled: Sonuga-Barke et al. 2017 -0.4136 [-0.8448; 0.0176] 0.5
## Filled: Sonuga-Barke et al. 2017 -0.4686 [-1.0095; 0.0724] 0.4
## Filled: Nelson et al. 2006 -0.4706 [-1.3153; 0.3742] 0.3
## Filled: Sonuga-Barke et al. 2017 -0.5236 [-1.0645; 0.0174] 0.4
## Filled: Sonuga-Barke et al. 2017 -0.5786 [-1.2273; 0.0702] 0.3
## Filled: Sonuga-Barke et al. 2017 -0.5786 [-1.2273; 0.0702] 0.3
## Filled: Dinwiddie et al. 2000 -0.5816 [-1.4106; 0.2475] 0.3
## Filled: Obikane et al. 2018 -0.6026 [-1.1631; -0.0420] 0.4
## Filled: Nelson et al. 2006 -0.6736 [-1.4928; 0.1457] 0.3
## Filled: Sonuga-Barke et al. 2017 -0.6896 [-1.3383; -0.0408] 0.3
## Filled: Sonuga-Barke et al. 2017 -0.6896 [-1.3383; -0.0408] 0.3
## Filled: Sonuga-Barke et al. 2017 -0.6896 [-1.3383; -0.0408] 0.3
## Filled: Barrigon et al. 2015 -0.7376 [-1.7999; 0.3247] 0.2
## Filled: Sonuga-Barke et al. 2017 -0.7996 [-1.5561; -0.0430] 0.3
## Filled: Beckett et al. 2002 -0.8606 [-1.9954; 0.2743] 0.2
## Filled: Sonuga-Barke et al. 2017 -1.0196 [-1.5605; -0.4786] 0.4
##
## Number of studies combined: k = 204 (with 48 added studies)
##
## SMD 95%-CI t p-value
## Random effects model (HK) 0.1911 [0.1404; 0.2418] 7.43 < 0.0001
##
## Quantifying heterogeneity:
## tau^2 = 0.1144 [0.0674; 0.1276]; tau = 0.3382 [0.2596; 0.3572]
## I^2 = 76.8% [73.6%; 79.7%]; H = 2.08 [1.94; 2.22]
##
## Test of heterogeneity:
## Q d.f. p-value
## 876.04 203 < 0.0001
##
## Details on meta-analytical method:
## - Inverse variance method
## - Sidik-Jonkman estimator for tau^2
## - Q-Profile method for confidence interval of tau^2 and tau
## - Hartung-Knapp (HK) adjustment for random effects model (df = 203)
## - Trim-and-fill method to adjust for funnel plot asymmetryAnd a limit meta for good measure.
limit <- limitmeta(MalMeta); summary(limit)## Results for individual studies
## (left: original data; right: shrunken estimates)
##
## SMD 95%-CI SMD
## Dinwiddie et al. 2000 0.1970 [-0.1813; 0.5753] 0.1053
## Dinwiddie et al. 2000 0.2520 [-0.0655; 0.5695] 0.1695
## Dinwiddie et al. 2000 0.4660 [-0.2807; 1.2127] 0.1467
## Dinwiddie et al. 2000 0.3820 [-0.2119; 0.9759] 0.1534
## Dinwiddie et al. 2000 0.2240 [-0.4757; 0.9237] 0.0349
## Dinwiddie et al. 2000 0.5050 [-0.0164; 1.0264] 0.2599
## Dinwiddie et al. 2000 0.1230 [-0.5983; 0.8443] -0.0219
## Dinwiddie et al. 2000 0.2420 [-0.0696; 0.5536] 0.1636
## Dinwiddie et al. 2000 0.2240 [-0.4757; 0.9237] 0.0349
## Dinwiddie et al. 2000 0.9400 [ 0.1109; 1.7691] 0.3419
## Dinwiddie et al. 2000 0.0000 [-0.8859; 0.8859] -0.0987
## Dinwiddie et al. 2000 0.3820 [-0.3824; 1.1464] 0.0996
## Dinwiddie et al. 2000 0.3820 [-0.2805; 1.0445] 0.1299
## Kendler et al. 2000 0.1860 [-0.0943; 0.4663] 0.1282
## Kendler et al. 2000 0.2120 [-0.1447; 0.5687] 0.1238
## Kendler et al. 2000 0.5740 [ 0.0664; 1.0816] 0.3116
## Kendler et al. 2000 0.3820 [-0.2119; 0.9759] 0.1534
## Kendler et al. 2000 0.1570 [-0.6642; 0.9782] -0.0204
## Beckett et al. 2002 1.2190 [ 0.0842; 2.3538] 0.3226
## Nelson et al. 2002 0.2450 [ 0.0333; 0.4567] 0.2024
## Nelson et al. 2002 0.5540 [ 0.1738; 0.9342] 0.3733
## Nelson et al. 2002 0.6060 [ 0.1650; 1.0470] 0.3728
## Nelson et al. 2002 0.2450 [ 0.0059; 0.4841] 0.1928
## Nelson et al. 2002 0.4660 [ 0.1308; 0.8012] 0.3323
## Riggins-Caspers et al. 2003 0.3870 [ 0.0597; 0.7143] 0.2736
## Riggins-Caspers et al. 2003 0.5160 [ 0.1828; 0.8492] 0.3731
## Lynch et al. 2006 0.3030 [ 0.1795; 0.4265] 0.2847
## Lynch et al. 2006 0.3430 [ 0.2195; 0.4665] 0.3232
## Lynch et al. 2006 0.1650 [ 0.0415; 0.2885] 0.1520
## Nelson et al. 2006 0.1360 [-0.1521; 0.4241] 0.0840
## Nelson et al. 2006 1.0320 [ 0.2127; 1.8513] 0.3898
## Nelson et al. 2006 0.8290 [-0.0157; 1.6737] 0.2835
## Nelson et al. 2006 0.3020 [-0.1076; 0.7116] 0.1717
## Nelson et al. 2006 0.3820 [-0.3824; 1.1464] 0.0996
## Nelson et al. 2006 0.3180 [ 0.0358; 0.6002] 0.2382
## Nelson et al. 2006 0.4300 [ 0.0360; 0.8240] 0.2729
## Thornberry et al. 2010 0.2430 [-0.0059; 0.4919] 0.1875
## Thornberry et al. 2010 0.3690 [ 0.0672; 0.6708] 0.2715
## Thornberry et al. 2010 0.2090 [ 0.0052; 0.4128] 0.1725
## Thornberry et al. 2010 0.4080 [ 0.1042; 0.7118] 0.3026
## Thornberry et al. 2010 0.4960 [ 0.1491; 0.8429] 0.3491
## Thornberry et al. 2010 0.1970 [-0.0441; 0.4381] 0.1501
## Young-Wolff et al. 2011 -0.0460 [-0.4909; 0.3989] -0.0853
## Magnusson et al. 2012 0.0320 [-0.3306; 0.3946] -0.0164
## Magnusson et al. 2012 0.2010 [-0.2674; 0.6694] 0.0803
## Magnusson et al. 2012 0.4660 [-0.0612; 0.9932] 0.2322
## Alemany et al. 2013 0.3810 [ 0.0772; 0.6848] 0.2804
## Alemany et al. 2013 0.3900 [ 0.0862; 0.6938] 0.2878
## Berenz et al. 2013 0.0630 [-0.0958; 0.2218] 0.0485
## Berenz et al. 2013 0.0900 [-0.0688; 0.2488] 0.0738
## Berenz et al. 2013 0.0630 [-0.0958; 0.2218] 0.0485
## Berenz et al. 2013 0.0630 [-0.0958; 0.2218] 0.0485
## Berenz et al. 2013 0.1270 [-0.0318; 0.2858] 0.1086
## Berenz et al. 2013 0.1550 [-0.0038; 0.3138] 0.1349
## Berenz et al. 2013 0.1550 [-0.0038; 0.3138] 0.1349
## Berenz et al. 2013 0.0000 [-0.1588; 0.1588] -0.0107
## Berenz et al. 2013 0.1270 [-0.0318; 0.2858] 0.1086
## Bornovalova et al. 2013 0.0900 [-0.0864; 0.2664] 0.0704
## Bornovalova et al. 2013 0.1900 [-0.0452; 0.4252] 0.1458
## Bornovalova et al. 2013 0.1300 [-0.0660; 0.3260] 0.1029
## Bornovalova et al. 2013 -0.0500 [-0.3440; 0.2440] -0.0717
## Voith et al. 2014 0.1500 [ 0.0618; 0.2382] 0.1435
## Voith et al. 2014 0.1180 [ 0.0298; 0.2062] 0.1121
## Barrigon et al. 2015 1.0960 [ 0.0337; 2.1583] 0.3054
## Capusan et al. 2016 0.1800 [ 0.1055; 0.2545] 0.1749
## Capusan et al. 2016 0.1900 [ 0.1155; 0.2645] 0.1847
## Capusan et al. 2016 0.2500 [-0.0401; 0.5401] 0.1783
## Capusan et al. 2016 0.0800 [-0.0650; 0.2250] 0.0668
## Capusan et al. 2016 0.2000 [ 0.0197; 0.3803] 0.1713
## Capusan et al. 2016 0.1900 [ 0.0646; 0.3154] 0.1756
## Capusan et al. 2016 0.2400 [ 0.0146; 0.4654] 0.1932
## Capusan et al. 2016 0.1500 [-0.0048; 0.3048] 0.1311
## Dinkler et al. 2017 0.2600 [-0.0654; 0.5854] 0.1729
## Dinkler et al. 2017 0.5000 [ 0.2001; 0.7999] 0.3803
## Schaefer et al. 2017 0.6440 [ 0.3853; 0.9027] 0.5285
## Schaefer et al. 2017 0.6550 [ 0.4492; 0.8608] 0.5750
## Schaefer et al. 2017 0.6760 [ 0.4878; 0.8642] 0.6058
## Schaefer et al. 2017 0.6980 [ 0.4746; 0.9214] 0.6012
## Sonuga-Barke et al. 2017 0.7720 [ 0.3408; 1.2032] 0.4968
## Sonuga-Barke et al. 2017 1.3780 [ 0.8370; 1.9190] 0.7971
## Sonuga-Barke et al. 2017 0.9370 [ 0.2883; 1.5857] 0.4432
## Sonuga-Barke et al. 2017 0.9370 [ 0.2883; 1.5857] 0.4432
## Sonuga-Barke et al. 2017 0.8270 [ 0.2860; 1.3680] 0.4520
## Sonuga-Barke et al. 2017 0.5510 [ 0.0100; 1.0920] 0.2792
## Sonuga-Barke et al. 2017 0.8820 [ 0.3410; 1.4230] 0.4864
## Sonuga-Barke et al. 2017 1.0480 [ 0.3993; 1.6967] 0.5050
## Sonuga-Barke et al. 2017 0.0000 [-0.6487; 0.6487] -0.0782
## Sonuga-Barke et al. 2017 0.1650 [-0.3760; 0.7060] 0.0374
## Sonuga-Barke et al. 2017 0.5510 [-0.2055; 1.3075] 0.1859
## Sonuga-Barke et al. 2017 1.0480 [ 0.3993; 1.6967] 0.5050
## Sonuga-Barke et al. 2017 0.0550 [-0.3762; 0.4862] -0.0121
## Sonuga-Barke et al. 2017 0.2210 [-0.2122; 0.6542] 0.1051
## Sonuga-Barke et al. 2017 0.1650 [-0.3760; 0.7060] 0.0374
## Sonuga-Barke et al. 2017 0.5510 [-0.2055; 1.3075] 0.1859
## Sonuga-Barke et al. 2017 1.0480 [ 0.3993; 1.6967] 0.5050
## Sonuga-Barke et al. 2017 0.0550 [-0.3762; 0.4862] -0.0121
## Sonuga-Barke et al. 2017 0.2210 [-0.2122; 0.6542] 0.1051
## Sonuga-Barke et al. 2017 0.7170 [ 0.1760; 1.2580] 0.3831
## Sonuga-Barke et al. 2017 0.2760 [-0.3727; 0.9247] 0.0754
## Sonuga-Barke et al. 2017 1.1580 [ 0.4015; 1.9145] 0.4882
## Sonuga-Barke et al. 2017 0.4410 [-0.1000; 0.9820] 0.2103
## Sonuga-Barke et al. 2017 0.0550 [-0.4860; 0.5960] -0.0315
## Sonuga-Barke et al. 2017 -0.2210 [-0.7620; 0.3200] -0.2043
## Zvara et al. 2017 0.2900 [ 0.0156; 0.5644] 0.2180
## Ma et al. 2018 0.7040 [ 0.5119; 0.8961] 0.6288
## Obikane et al. 2018 0.5320 [ 0.2968; 0.7672] 0.4466
## Obikane et al. 2018 0.2580 [-0.3163; 0.8323] 0.0857
## Obikane et al. 2018 0.4390 [ 0.2038; 0.6742] 0.3648
## Obikane et al. 2018 0.5760 [ 0.3643; 0.7877] 0.5000
## Obikane et al. 2018 0.5670 [ 0.1554; 0.9786] 0.3633
## Obikane et al. 2018 0.5390 [ 0.3391; 0.7389] 0.4735
## Obikane et al. 2018 0.4620 [ 0.0994; 0.8246] 0.3138
## Obikane et al. 2018 0.1670 [-0.4367; 0.7707] 0.0242
## Obikane et al. 2018 0.3960 [ 0.0608; 0.7312] 0.2769
## Obikane et al. 2018 0.4470 [ 0.1118; 0.7822] 0.3172
## Obikane et al. 2018 0.3140 [-0.1701; 0.7981] 0.1512
## Obikane et al. 2018 0.4630 [ 0.1357; 0.7903] 0.3343
## Obikane et al. 2018 0.5100 [ 0.0592; 0.9608] 0.3000
## Obikane et al. 2018 -0.3480 [-1.3221; 0.6261] -0.2463
## Obikane et al. 2018 0.3580 [-0.1261; 0.8421] 0.1806
## Obikane et al. 2018 0.6510 [ 0.3786; 0.9234] 0.5246
## Obikane et al. 2018 0.9610 [ 0.4005; 1.5215] 0.5205
## Obikane et al. 2018 0.6590 [ 0.3944; 0.9236] 0.5371
## Stern et al. 2018 0.1400 [ 0.0224; 0.2576] 0.1290
## Stern et al. 2018 0.3450 [ 0.2254; 0.4646] 0.3263
## Baldwin et al. 2019 0.2050 [ 0.0521; 0.3579] 0.1834
## Baldwin et al. 2019 0.2240 [ 0.0907; 0.3573] 0.2064
## Baldwin et al. 2019 0.1360 [-0.1031; 0.3751] 0.0973
## Gerin et al. 2019 0.6200 [ 0.3260; 0.9140] 0.4832
## Kugler et al. 2019 0.3620 [ 0.1562; 0.5678] 0.3102
## Kugler et al. 2019 0.2350 [ 0.0292; 0.4408] 0.1954
## Lecei et al. 2019 0.2950 [ 0.0539; 0.5361] 0.2358
## Lecei et al. 2019 0.2700 [ 0.0289; 0.5111] 0.2140
## Lecei et al. 2019 0.3860 [ 0.1430; 0.6290] 0.3145
## Lecei et al. 2019 0.2540 [ 0.0129; 0.4951] 0.2000
## Schwartz et al. 2019 0.1160 [-0.0173; 0.2493] 0.1031
## Schwartz et al. 2019 0.2260 [ 0.0927; 0.3593] 0.2083
## Schwartz et al. 2019 0.1070 [ 0.0364; 0.1776] 0.1033
## Alvanzo et al. 2020 -0.0900 [-0.3291; 0.1491] -0.1007
## Alvanzo et al. 2020 0.0050 [-0.2224; 0.2324] -0.0157
## Alvanzo et al. 2020 0.0670 [-0.1074; 0.2414] 0.0495
## Alvanzo et al. 2020 0.1360 [-0.0286; 0.3006] 0.1157
## Golm et al. 2020 0.4800 [ 0.0880; 0.8720] 0.3110
## Golm et al. 2020 0.4900 [ 0.0980; 0.8820] 0.3184
## Golm et al. 2020 0.4100 [-0.0016; 0.8216] 0.2493
## Golm et al. 2020 0.3800 [-0.0316; 0.7916] 0.2276
## Kullberg et al. 2020 0.5090 [ 0.3502; 0.6678] 0.4674
## Kullberg et al. 2020 -0.0020 [-0.1568; 0.1528] -0.0121
## Kullberg et al. 2020 0.0680 [-0.0868; 0.2228] 0.0538
## Kullberg et al. 2020 0.2920 [ 0.1352; 0.4488] 0.2642
## Kullberg et al. 2020 0.0730 [-0.0818; 0.2278] 0.0585
## Kullberg et al. 2020 0.1040 [-0.0508; 0.2588] 0.0877
## Capusan et al. 2021 0.7710 [ 0.4888; 1.0532] 0.6181
## Isumi et al. 2021 0.3330 [ 0.2820; 0.3840] 0.3295
## Li et al. 2021 0.1000 [ 0.0373; 0.1627] 0.0972
## Li et al. 2021 0.0800 [ 0.0173; 0.1427] 0.0774
## 95%-CI
## Dinwiddie et al. 2000 [-0.2730; 0.4835]
## Dinwiddie et al. 2000 [-0.1480; 0.4870]
## Dinwiddie et al. 2000 [-0.6000; 0.8935]
## Dinwiddie et al. 2000 [-0.4405; 0.7472]
## Dinwiddie et al. 2000 [-0.6648; 0.7346]
## Dinwiddie et al. 2000 [-0.2615; 0.7812]
## Dinwiddie et al. 2000 [-0.7431; 0.6994]
## Dinwiddie et al. 2000 [-0.1480; 0.4752]
## Dinwiddie et al. 2000 [-0.6648; 0.7346]
## Dinwiddie et al. 2000 [-0.4872; 1.1710]
## Dinwiddie et al. 2000 [-0.9846; 0.7872]
## Dinwiddie et al. 2000 [-0.6648; 0.8640]
## Dinwiddie et al. 2000 [-0.5326; 0.7924]
## Kendler et al. 2000 [-0.1521; 0.4084]
## Kendler et al. 2000 [-0.2329; 0.4805]
## Kendler et al. 2000 [-0.1960; 0.8192]
## Kendler et al. 2000 [-0.4405; 0.7472]
## Kendler et al. 2000 [-0.8417; 0.8008]
## Beckett et al. 2002 [-0.8122; 1.4574]
## Nelson et al. 2002 [-0.0092; 0.4141]
## Nelson et al. 2002 [-0.0069; 0.7535]
## Nelson et al. 2002 [-0.0682; 0.8138]
## Nelson et al. 2002 [-0.0463; 0.4319]
## Nelson et al. 2002 [-0.0029; 0.6674]
## Riggins-Caspers et al. 2003 [-0.0537; 0.6009]
## Riggins-Caspers et al. 2003 [ 0.0399; 0.7063]
## Lynch et al. 2006 [ 0.1613; 0.4082]
## Lynch et al. 2006 [ 0.1997; 0.4467]
## Lynch et al. 2006 [ 0.0285; 0.2755]
## Nelson et al. 2006 [-0.2041; 0.3721]
## Nelson et al. 2006 [-0.4294; 1.2091]
## Nelson et al. 2006 [-0.5612; 1.1283]
## Nelson et al. 2006 [-0.2379; 0.5814]
## Nelson et al. 2006 [-0.6648; 0.8640]
## Nelson et al. 2006 [-0.0440; 0.5205]
## Nelson et al. 2006 [-0.1211; 0.6668]
## Thornberry et al. 2010 [-0.0614; 0.4364]
## Thornberry et al. 2010 [-0.0303; 0.5734]
## Thornberry et al. 2010 [-0.0313; 0.3764]
## Thornberry et al. 2010 [-0.0012; 0.6064]
## Thornberry et al. 2010 [ 0.0022; 0.6960]
## Thornberry et al. 2010 [-0.0910; 0.3912]
## Young-Wolff et al. 2011 [-0.5302; 0.3596]
## Magnusson et al. 2012 [-0.3790; 0.3462]
## Magnusson et al. 2012 [-0.3881; 0.5487]
## Magnusson et al. 2012 [-0.2950; 0.7594]
## Alemany et al. 2013 [-0.0234; 0.5842]
## Alemany et al. 2013 [-0.0160; 0.5916]
## Berenz et al. 2013 [-0.1103; 0.2072]
## Berenz et al. 2013 [-0.0849; 0.2326]
## Berenz et al. 2013 [-0.1103; 0.2072]
## Berenz et al. 2013 [-0.1103; 0.2072]
## Berenz et al. 2013 [-0.0502; 0.2673]
## Berenz et al. 2013 [-0.0239; 0.2936]
## Berenz et al. 2013 [-0.0239; 0.2936]
## Berenz et al. 2013 [-0.1695; 0.1480]
## Berenz et al. 2013 [-0.0502; 0.2673]
## Bornovalova et al. 2013 [-0.1060; 0.2468]
## Bornovalova et al. 2013 [-0.0894; 0.3810]
## Bornovalova et al. 2013 [-0.0931; 0.2989]
## Bornovalova et al. 2013 [-0.3657; 0.2223]
## Voith et al. 2014 [ 0.0553; 0.2317]
## Voith et al. 2014 [ 0.0239; 0.2003]
## Barrigon et al. 2015 [-0.7569; 1.3677]
## Capusan et al. 2016 [ 0.1004; 0.2494]
## Capusan et al. 2016 [ 0.1103; 0.2592]
## Capusan et al. 2016 [-0.1118; 0.4683]
## Capusan et al. 2016 [-0.0782; 0.2119]
## Capusan et al. 2016 [-0.0091; 0.3516]
## Capusan et al. 2016 [ 0.0502; 0.3011]
## Capusan et al. 2016 [-0.0322; 0.4186]
## Capusan et al. 2016 [-0.0238; 0.2859]
## Dinkler et al. 2017 [-0.1524; 0.4983]
## Dinkler et al. 2017 [ 0.0804; 0.6802]
## Schaefer et al. 2017 [ 0.2698; 0.7872]
## Schaefer et al. 2017 [ 0.3692; 0.7808]
## Schaefer et al. 2017 [ 0.4177; 0.7940]
## Schaefer et al. 2017 [ 0.3778; 0.8247]
## Sonuga-Barke et al. 2017 [ 0.0656; 0.9280]
## Sonuga-Barke et al. 2017 [ 0.2561; 1.3380]
## Sonuga-Barke et al. 2017 [-0.2055; 1.0920]
## Sonuga-Barke et al. 2017 [-0.2055; 1.0920]
## Sonuga-Barke et al. 2017 [-0.0889; 0.9930]
## Sonuga-Barke et al. 2017 [-0.2618; 0.8201]
## Sonuga-Barke et al. 2017 [-0.0545; 1.0274]
## Sonuga-Barke et al. 2017 [-0.1437; 1.1538]
## Sonuga-Barke et al. 2017 [-0.7270; 0.5705]
## Sonuga-Barke et al. 2017 [-0.5035; 0.5784]
## Sonuga-Barke et al. 2017 [-0.5706; 0.9425]
## Sonuga-Barke et al. 2017 [-0.1437; 1.1538]
## Sonuga-Barke et al. 2017 [-0.4433; 0.4191]
## Sonuga-Barke et al. 2017 [-0.3281; 0.5382]
## Sonuga-Barke et al. 2017 [-0.5035; 0.5784]
## Sonuga-Barke et al. 2017 [-0.5706; 0.9425]
## Sonuga-Barke et al. 2017 [-0.1437; 1.1538]
## Sonuga-Barke et al. 2017 [-0.4433; 0.4191]
## Sonuga-Barke et al. 2017 [-0.3281; 0.5382]
## Sonuga-Barke et al. 2017 [-0.1578; 0.9241]
## Sonuga-Barke et al. 2017 [-0.5734; 0.7241]
## Sonuga-Barke et al. 2017 [-0.2683; 1.2448]
## Sonuga-Barke et al. 2017 [-0.3307; 0.7512]
## Sonuga-Barke et al. 2017 [-0.5724; 0.5095]
## Sonuga-Barke et al. 2017 [-0.7453; 0.3366]
## Zvara et al. 2017 [-0.0564; 0.4924]
## Ma et al. 2018 [ 0.4368; 0.8209]
## Obikane et al. 2018 [ 0.2114; 0.6818]
## Obikane et al. 2018 [-0.4885; 0.6600]
## Obikane et al. 2018 [ 0.1296; 0.6000]
## Obikane et al. 2018 [ 0.2883; 0.7117]
## Obikane et al. 2018 [-0.0483; 0.7749]
## Obikane et al. 2018 [ 0.2736; 0.6734]
## Obikane et al. 2018 [-0.0488; 0.6764]
## Obikane et al. 2018 [-0.5794; 0.6279]
## Obikane et al. 2018 [-0.0583; 0.6120]
## Obikane et al. 2018 [-0.0179; 0.6524]
## Obikane et al. 2018 [-0.3329; 0.6353]
## Obikane et al. 2018 [ 0.0070; 0.6616]
## Obikane et al. 2018 [-0.1508; 0.7508]
## Obikane et al. 2018 [-1.2204; 0.7278]
## Obikane et al. 2018 [-0.3035; 0.6647]
## Obikane et al. 2018 [ 0.2522; 0.7971]
## Obikane et al. 2018 [-0.0401; 1.0810]
## Obikane et al. 2018 [ 0.2725; 0.8017]
## Stern et al. 2018 [ 0.0114; 0.2466]
## Stern et al. 2018 [ 0.2068; 0.4459]
## Baldwin et al. 2019 [ 0.0305; 0.3363]
## Baldwin et al. 2019 [ 0.0731; 0.3397]
## Baldwin et al. 2019 [-0.1418; 0.3364]
## Gerin et al. 2019 [ 0.1892; 0.7772]
## Kugler et al. 2019 [ 0.1044; 0.5160]
## Kugler et al. 2019 [-0.0104; 0.4012]
## Lecei et al. 2019 [-0.0053; 0.4769]
## Lecei et al. 2019 [-0.0271; 0.4550]
## Lecei et al. 2019 [ 0.0714; 0.5575]
## Lecei et al. 2019 [-0.0411; 0.4410]
## Schwartz et al. 2019 [-0.0301; 0.2364]
## Schwartz et al. 2019 [ 0.0750; 0.3416]
## Schwartz et al. 2019 [ 0.0328; 0.1739]
## Alvanzo et al. 2020 [-0.3398; 0.1384]
## Alvanzo et al. 2020 [-0.2430; 0.2117]
## Alvanzo et al. 2020 [-0.1250; 0.2239]
## Alvanzo et al. 2020 [-0.0489; 0.2804]
## Golm et al. 2020 [-0.0810; 0.7030]
## Golm et al. 2020 [-0.0736; 0.7104]
## Golm et al. 2020 [-0.1622; 0.6609]
## Golm et al. 2020 [-0.1840; 0.6392]
## Kullberg et al. 2020 [ 0.3086; 0.6261]
## Kullberg et al. 2020 [-0.1670; 0.1427]
## Kullberg et al. 2020 [-0.1010; 0.2087]
## Kullberg et al. 2020 [ 0.1074; 0.4210]
## Kullberg et al. 2020 [-0.0963; 0.2134]
## Kullberg et al. 2020 [-0.0671; 0.2426]
## Capusan et al. 2021 [ 0.3359; 0.9004]
## Isumi et al. 2021 [ 0.2786; 0.3805]
## Li et al. 2021 [ 0.0344; 0.1599]
## Li et al. 2021 [ 0.0147; 0.1401]
##
## Result of limit meta-analysis:
##
## Random effects model SMD 95%-CI z pval
## Adjusted estimate 0.2181 [0.1590; 0.2772] 7.23 < 0.0001
## Unadjusted estimate 0.3107 [0.2713; 0.3502] 15.55 < 0.0001
##
## Quantifying heterogeneity:
## tau^2 = 0.0492; I^2 = 68.2% [62.5%; 73.0%]; G^2 = 65.9%
##
## Test of heterogeneity:
## Q d.f. p-value
## 487.64 155 0
##
## Test of small-study effects:
## Q-Q' d.f. p-value
## 89.43 1 0
##
## Test of residual heterogeneity beyond small-study effects:
## Q' d.f. p-value
## 398.21 154 0
##
## Details on adjustment method:
## - expectation (beta0)The p-curve for all estimates rather than study-averaged effect sizes.
pcurve(MalMeta)
## P-curve analysis
## -----------------------
## - Total number of provided studies: k = 156
## - Total number of p<0.05 studies included into the analysis: k = 83 (53.21%)
## - Total number of studies with p<0.025: k = 67 (42.95%)
##
## Results
## -----------------------
## pBinomial zFull pFull zHalf pHalf
## Right-skewness test 0.00 -16.290 0 -15.786 0
## Flatness test 0.98 9.293 1 16.188 1
## Note: p-values of 0 or 1 correspond to p<0.001 and p>0.999, respectively.
## Power Estimate: 87% (80.5%-90.9%)
##
## Evidential value
## -----------------------
## - Evidential value present: yes
## - Evidential value absent/inadequate: noThe funnel plot with filled in studies (clear circles) versus the used studies (gray circles) and then funnel plot for the limit meta-analysis with original and then adjusted estimates (gray then white).
funnel(TF, legend = T)
funnel.limitmeta(limit, shrunken = T)
Effect sizes for the meta-analysis broken out by the design used.
MalQual <- subgroup.analysis.mixed.effects(MalMeta, data$Designs); MalQual## Subgroup Results:
## --------------
## k SMD SE LLCI ULCI p
## Adoption 2 0.4503932 0.06449050 0.324 0.577 0.0000000000028716147040470
## COT 3 0.2703333 0.05391763 0.165 0.376 0.0000005335976142607456337
## FE 4 0.3163833 0.13113664 0.059 0.573 0.0158381959581947173720806
## IPW 24 0.3684723 0.05036549 0.270 0.467 0.0000000000002555334921263
## MZ 33 0.2682498 0.03290957 0.204 0.333 0.0000000000000003605757644
## NE 30 0.5227638 0.07395546 0.378 0.668 0.0000000000015647071150957
## PSM 8 0.3329578 0.05225962 0.231 0.435 0.0000000001875244911387694
## RICLPM 2 0.0900000 0.01000000 0.070 0.110 0.0000000000000000002257177
## Sibling 9 0.2571726 0.09937606 0.062 0.452 0.0096570638597426351756869
## Twin 41 0.2215844 0.02784569 0.167 0.276 0.0000000000000017543230033
## Q I2 I2.lower I2.upper
## Adoption 0.2930321 0.00 NA NA
## COT 4.3947258 0.54 0.00 0.87
## FE 43.9976174 0.93 0.86 0.97
## IPW 69.7103823 0.67 0.49 0.78
## MZ 97.1606275 0.67 0.53 0.77
## NE 58.7557859 0.51 0.25 0.68
## PSM 7.9649652 0.12 0.00 0.72
## RICLPM 0.1953125 0.00 NA NA
## Sibling 49.0548204 0.84 0.71 0.91
## Twin 46.3459142 0.14 0.00 0.42
##
## Test for subgroup differences (mixed/fixed-effects (plural) model):
## --------------
## Q df p
## Between groups 141.3144 9 0.00000000000000000000000005522156
##
## - Total number of studies included in subgroup analysis: 156
## - Tau estimator used for within-group pooling: SJA repeat of the trim-and-fill with the results rounded out to four decimal places followed by the effect sizes by design used with trim-and-fill. This may not be admissible because the filling was done with all studies instead of by design. The result trimmed-and-filled by design isn’t very different but it’s less reliable because the sample sizes for some designs are very small.
TF <- metagen(
TE = d,
seTE = SE,
sm = "SMD",
studlab = Study,
backtrans = T,
data = filleddata,
hakn = T,
method.tau = "SJ",
title = "Effects of Childhood Maltreatment on Mental Health"); summary(TF)## Review: Effects of Childhood Maltreatment on Mental Health
##
## SMD 95%-CI %W(common) %W(random)
## Alemany et al. 2013 0.3810 [ 0.0772; 0.6848] 0.2 0.5
## Alemany et al. 2013 0.3900 [ 0.0862; 0.6938] 0.2 0.5
## Alvanzo et al. 2020 -0.0900 [-0.3291; 0.1491] 0.4 0.6
## Alvanzo et al. 2020 0.0050 [-0.2224; 0.2324] 0.4 0.6
## Alvanzo et al. 2020 0.0670 [-0.1074; 0.2414] 0.7 0.6
## Alvanzo et al. 2020 0.1360 [-0.0286; 0.3006] 0.8 0.6
## Baldwin et al. 2019 0.2050 [ 0.0521; 0.3579] 0.9 0.6
## Baldwin et al. 2019 0.2240 [ 0.0907; 0.3573] 1.2 0.6
## Baldwin et al. 2019 0.1360 [-0.1031; 0.3751] 0.4 0.6
## Barrigon et al. 2015 1.0960 [ 0.0337; 2.1583] 0.0 0.2
## Barrigon et al. 2015 -0.7376 [-1.4745; -0.0007] 0.0 0.3
## Beckett et al. 2002 1.2190 [ 0.0842; 2.3538] 0.0 0.2
## Beckett et al. 2002 -0.8606 [-1.7210; -0.0002] 0.0 0.2
## Berenz et al. 2013 0.0630 [-0.0958; 0.2218] 0.9 0.6
## Berenz et al. 2013 0.0900 [-0.0688; 0.2488] 0.9 0.6
## Berenz et al. 2013 0.0630 [-0.0958; 0.2218] 0.9 0.6
## Berenz et al. 2013 0.0630 [-0.0958; 0.2218] 0.9 0.6
## Berenz et al. 2013 0.1270 [-0.0318; 0.2858] 0.9 0.6
## Berenz et al. 2013 0.1550 [-0.0038; 0.3138] 0.9 0.6
## Berenz et al. 2013 0.1550 [-0.0038; 0.3138] 0.9 0.6
## Berenz et al. 2013 0.0000 [-0.1588; 0.1588] 0.9 0.6
## Berenz et al. 2013 0.1270 [-0.0318; 0.2858] 0.9 0.6
## Bornovalova et al. 2013 0.0900 [-0.0864; 0.2664] 0.7 0.6
## Bornovalova et al. 2013 0.1900 [-0.0452; 0.4252] 0.4 0.6
## Bornovalova et al. 2013 0.1300 [-0.0660; 0.3260] 0.6 0.6
## Bornovalova et al. 2013 -0.0500 [-0.3440; 0.2440] 0.3 0.5
## Capusan et al. 2016 0.1800 [ 0.1055; 0.2545] 3.9 0.6
## Capusan et al. 2016 0.1900 [ 0.1155; 0.2645] 3.9 0.6
## Capusan et al. 2016 0.2500 [-0.0401; 0.5401] 0.3 0.5
## Capusan et al. 2016 0.0800 [-0.0650; 0.2250] 1.0 0.6
## Capusan et al. 2016 0.2000 [ 0.0197; 0.3803] 0.7 0.6
## Capusan et al. 2016 0.1900 [ 0.0646; 0.3154] 1.4 0.6
## Capusan et al. 2016 0.2400 [ 0.0146; 0.4654] 0.4 0.6
## Capusan et al. 2016 0.1500 [-0.0048; 0.3048] 0.9 0.6
## Capusan et al. 2021 0.7710 [ 0.4888; 1.0532] 0.3 0.6
## Capusan et al. 2021 -0.4126 [-0.6948; -0.1304] 0.3 0.6
## Dinkler et al. 2017 0.2600 [-0.0654; 0.5854] 0.2 0.5
## Dinkler et al. 2017 0.5000 [ 0.2001; 0.7999] 0.2 0.5
## Dinkler et al. 2017 -0.1416 [-0.4415; 0.1583] 0.2 0.5
## Dinwiddie et al. 2000 0.1970 [-0.1813; 0.5753] 0.2 0.5
## Dinwiddie et al. 2000 0.2520 [-0.0655; 0.5695] 0.2 0.5
## Dinwiddie et al. 2000 0.4660 [-0.2807; 1.2127] 0.0 0.3
## Dinwiddie et al. 2000 0.3820 [-0.2119; 0.9759] 0.1 0.4
## Dinwiddie et al. 2000 0.2240 [-0.4757; 0.9237] 0.0 0.3
## Dinwiddie et al. 2000 0.5050 [-0.0164; 1.0264] 0.1 0.4
## Dinwiddie et al. 2000 0.1230 [-0.5983; 0.8443] 0.0 0.3
## Dinwiddie et al. 2000 0.2420 [-0.0696; 0.5536] 0.2 0.5
## Dinwiddie et al. 2000 0.2240 [-0.4757; 0.9237] 0.0 0.3
## Dinwiddie et al. 2000 0.9400 [ 0.1109; 1.7691] 0.0 0.3
## Dinwiddie et al. 2000 0.0000 [-0.8859; 0.8859] 0.0 0.2
## Dinwiddie et al. 2000 0.3820 [-0.3824; 1.1464] 0.0 0.3
## Dinwiddie et al. 2000 0.3820 [-0.2805; 1.0445] 0.0 0.3
## Dinwiddie et al. 2000 -0.1076 [-0.8543; 0.6391] 0.0 0.3
## Dinwiddie et al. 2000 -0.1466 [-0.6680; 0.3748] 0.1 0.4
## Dinwiddie et al. 2000 -0.5816 [-1.1637; 0.0005] 0.1 0.4
## Gerin et al. 2019 0.6200 [ 0.3260; 0.9140] 0.3 0.5
## Gerin et al. 2019 -0.2616 [-0.5556; 0.0324] 0.3 0.5
## Golm et al. 2020 0.4800 [ 0.0880; 0.8720] 0.1 0.5
## Golm et al. 2020 0.4900 [ 0.0980; 0.8820] 0.1 0.5
## Golm et al. 2020 0.4100 [-0.0016; 0.8216] 0.1 0.5
## Golm et al. 2020 0.3800 [-0.0316; 0.7916] 0.1 0.5
## Golm et al. 2020 -0.1216 [-0.5136; 0.2704] 0.1 0.5
## Golm et al. 2020 -0.1316 [-0.5236; 0.2604] 0.1 0.5
## Isumi et al. 2021 0.3330 [ 0.2820; 0.3840] 8.3 0.6
## Kendler et al. 2000 0.1860 [-0.0943; 0.4663] 0.3 0.6
## Kendler et al. 2000 0.2120 [-0.1447; 0.5687] 0.2 0.5
## Kendler et al. 2000 0.5740 [ 0.0664; 1.0816] 0.1 0.4
## Kendler et al. 2000 0.3820 [-0.2119; 0.9759] 0.1 0.4
## Kendler et al. 2000 0.1570 [-0.6642; 0.9782] 0.0 0.3
## Kendler et al. 2000 -0.2156 [-0.6272; 0.1960] 0.1 0.5
## Kugler et al. 2019 0.3620 [ 0.1562; 0.5678] 0.5 0.6
## Kugler et al. 2019 0.2350 [ 0.0292; 0.4408] 0.5 0.6
## Kullberg et al. 2020 0.5090 [ 0.3502; 0.6678] 0.9 0.6
## Kullberg et al. 2020 -0.0020 [-0.1568; 0.1528] 0.9 0.6
## Kullberg et al. 2020 0.0680 [-0.0868; 0.2228] 0.9 0.6
## Kullberg et al. 2020 0.2920 [ 0.1352; 0.4488] 0.9 0.6
## Kullberg et al. 2020 0.0730 [-0.0818; 0.2278] 0.9 0.6
## Kullberg et al. 2020 0.1040 [-0.0508; 0.2588] 0.9 0.6
## Kullberg et al. 2020 -0.1506 [-0.3094; 0.0082] 0.9 0.6
## Lecei et al. 2019 0.2950 [ 0.0539; 0.5361] 0.4 0.6
## Lecei et al. 2019 0.2700 [ 0.0289; 0.5111] 0.4 0.6
## Lecei et al. 2019 0.3860 [ 0.1430; 0.6290] 0.4 0.6
## Lecei et al. 2019 0.2540 [ 0.0129; 0.4951] 0.4 0.6
## Li et al. 2021 0.1000 [ 0.0373; 0.1627] 5.5 0.6
## Li et al. 2021 0.0800 [ 0.0173; 0.1427] 5.5 0.6
## Lynch et al. 2006 0.3030 [ 0.1795; 0.4265] 1.4 0.6
## Lynch et al. 2006 0.3430 [ 0.2195; 0.4665] 1.4 0.6
## Lynch et al. 2006 0.1650 [ 0.0415; 0.2885] 1.4 0.6
## Ma et al. 2018 0.7040 [ 0.5119; 0.8961] 0.6 0.6
## Ma et al. 2018 -0.3456 [-0.5377; -0.1535] 0.6 0.6
## Magnusson et al. 2012 0.0320 [-0.3306; 0.3946] 0.2 0.5
## Magnusson et al. 2012 0.2010 [-0.2674; 0.6694] 0.1 0.4
## Magnusson et al. 2012 0.4660 [-0.0612; 0.9932] 0.1 0.4
## Magnusson et al. 2012 -0.1076 [-0.6348; 0.4196] 0.1 0.4
## Nelson et al. 2002 0.2450 [ 0.0333; 0.4567] 0.5 0.6
## Nelson et al. 2002 0.5540 [ 0.1738; 0.9342] 0.1 0.5
## Nelson et al. 2002 0.6060 [ 0.1650; 1.0470] 0.1 0.5
## Nelson et al. 2002 0.2450 [ 0.0059; 0.4841] 0.4 0.6
## Nelson et al. 2002 0.4660 [ 0.1308; 0.8012] 0.2 0.5
## Nelson et al. 2002 -0.1076 [-0.4428; 0.2276] 0.2 0.5
## Nelson et al. 2002 -0.1956 [-0.9521; 0.5609] 0.0 0.3
## Nelson et al. 2002 -0.2476 [-0.6886; 0.1934] 0.1 0.5
## Nelson et al. 2006 0.1360 [-0.1521; 0.4241] 0.3 0.6
## Nelson et al. 2006 1.0320 [ 0.2127; 1.8513] 0.0 0.3
## Nelson et al. 2006 0.8290 [-0.0157; 1.6737] 0.0 0.3
## Nelson et al. 2006 0.3020 [-0.1076; 0.7116] 0.1 0.5
## Nelson et al. 2006 0.3820 [-0.3824; 1.1464] 0.0 0.3
## Nelson et al. 2006 0.3180 [ 0.0358; 0.6002] 0.3 0.6
## Nelson et al. 2006 0.4300 [ 0.0360; 0.8240] 0.1 0.5
## Nelson et al. 2006 -0.4706 [-0.9410; -0.0002] 0.1 0.4
## Nelson et al. 2006 -0.6736 [-1.3478; 0.0006] 0.0 0.3
## Obikane et al. 2018 0.5320 [ 0.2968; 0.7672] 0.4 0.6
## Obikane et al. 2018 0.2580 [-0.3163; 0.8323] 0.1 0.4
## Obikane et al. 2018 0.4390 [ 0.2038; 0.6742] 0.4 0.6
## Obikane et al. 2018 0.5760 [ 0.3643; 0.7877] 0.5 0.6
## Obikane et al. 2018 0.5670 [ 0.1554; 0.9786] 0.1 0.5
## Obikane et al. 2018 0.5390 [ 0.3391; 0.7389] 0.5 0.6
## Obikane et al. 2018 0.4620 [ 0.0994; 0.8246] 0.2 0.5
## Obikane et al. 2018 0.1670 [-0.4367; 0.7707] 0.1 0.4
## Obikane et al. 2018 0.3960 [ 0.0608; 0.7312] 0.2 0.5
## Obikane et al. 2018 0.4470 [ 0.1118; 0.7822] 0.2 0.5
## Obikane et al. 2018 0.3140 [-0.1701; 0.7981] 0.1 0.4
## Obikane et al. 2018 0.4630 [ 0.1357; 0.7903] 0.2 0.5
## Obikane et al. 2018 0.5100 [ 0.0592; 0.9608] 0.1 0.4
## Obikane et al. 2018 -0.3480 [-1.3221; 0.6261] 0.0 0.2
## Obikane et al. 2018 0.3580 [-0.1261; 0.8421] 0.1 0.4
## Obikane et al. 2018 0.6510 [ 0.3786; 0.9234] 0.3 0.6
## Obikane et al. 2018 0.9610 [ 0.4005; 1.5215] 0.1 0.4
## Obikane et al. 2018 0.6590 [ 0.3944; 0.9236] 0.3 0.6
## Obikane et al. 2018 -0.1046 [-0.4319; 0.2227] 0.2 0.5
## Obikane et al. 2018 -0.1516 [-0.6024; 0.2992] 0.1 0.4
## Obikane et al. 2018 -0.1736 [-0.4088; 0.0616] 0.4 0.6
## Obikane et al. 2018 -0.1806 [-0.3805; 0.0193] 0.5 0.6
## Obikane et al. 2018 -0.2086 [-0.5888; 0.1716] 0.1 0.5
## Obikane et al. 2018 -0.2176 [-0.7252; 0.2900] 0.1 0.4
## Obikane et al. 2018 -0.2926 [-0.5650; -0.0202] 0.3 0.6
## Obikane et al. 2018 -0.3006 [-0.5652; -0.0360] 0.3 0.6
## Obikane et al. 2018 -0.6026 [-1.1631; -0.0421] 0.1 0.4
## Riggins-Caspers et al. 2003 0.3870 [ 0.0597; 0.7143] 0.2 0.5
## Riggins-Caspers et al. 2003 0.5160 [ 0.1828; 0.8492] 0.2 0.5
## Riggins-Caspers et al. 2003 -0.1576 [-0.4908; 0.1756] 0.2 0.5
## Schaefer et al. 2017 0.6440 [ 0.3853; 0.9027] 0.3 0.6
## Schaefer et al. 2017 0.6550 [ 0.4492; 0.8608] 0.5 0.6
## Schaefer et al. 2017 0.6760 [ 0.4878; 0.8642] 0.6 0.6
## Schaefer et al. 2017 0.6980 [ 0.4746; 0.9214] 0.4 0.6
## Schaefer et al. 2017 -0.2856 [-0.5443; -0.0269] 0.3 0.6
## Schaefer et al. 2017 -0.2966 [-0.5024; -0.0908] 0.5 0.6
## Schaefer et al. 2017 -0.3176 [-0.5058; -0.1294] 0.6 0.6
## Schaefer et al. 2017 -0.3396 [-0.5630; -0.1162] 0.4 0.6
## Schwartz et al. 2019 0.1160 [-0.0173; 0.2493] 1.2 0.6
## Schwartz et al. 2019 0.2260 [ 0.0927; 0.3593] 1.2 0.6
## Schwartz et al. 2019 0.1070 [ 0.0364; 0.1776] 4.3 0.6
## Sonuga-Barke et al. 2017 0.7720 [ 0.3408; 1.2032] 0.1 0.5
## Sonuga-Barke et al. 2017 1.3780 [ 0.8370; 1.9190] 0.1 0.4
## Sonuga-Barke et al. 2017 0.9370 [ 0.2883; 1.5857] 0.1 0.3
## Sonuga-Barke et al. 2017 0.9370 [ 0.2883; 1.5857] 0.1 0.3
## Sonuga-Barke et al. 2017 0.8270 [ 0.2860; 1.3680] 0.1 0.4
## Sonuga-Barke et al. 2017 0.5510 [ 0.0100; 1.0920] 0.1 0.4
## Sonuga-Barke et al. 2017 0.8820 [ 0.3410; 1.4230] 0.1 0.4
## Sonuga-Barke et al. 2017 1.0480 [ 0.3993; 1.6967] 0.1 0.3
## Sonuga-Barke et al. 2017 0.0000 [-0.6487; 0.6487] 0.1 0.3
## Sonuga-Barke et al. 2017 0.1650 [-0.3760; 0.7060] 0.1 0.4
## Sonuga-Barke et al. 2017 0.5510 [-0.2055; 1.3075] 0.0 0.3
## Sonuga-Barke et al. 2017 1.0480 [ 0.3993; 1.6967] 0.1 0.3
## Sonuga-Barke et al. 2017 0.0550 [-0.3762; 0.4862] 0.1 0.5
## Sonuga-Barke et al. 2017 0.2210 [-0.2122; 0.6542] 0.1 0.5
## Sonuga-Barke et al. 2017 0.1650 [-0.3760; 0.7060] 0.1 0.4
## Sonuga-Barke et al. 2017 0.5510 [-0.2055; 1.3075] 0.0 0.3
## Sonuga-Barke et al. 2017 1.0480 [ 0.3993; 1.6967] 0.1 0.3
## Sonuga-Barke et al. 2017 0.0550 [-0.3762; 0.4862] 0.1 0.5
## Sonuga-Barke et al. 2017 0.2210 [-0.2122; 0.6542] 0.1 0.5
## Sonuga-Barke et al. 2017 0.7170 [ 0.1760; 1.2580] 0.1 0.4
## Sonuga-Barke et al. 2017 0.2760 [-0.3727; 0.9247] 0.1 0.3
## Sonuga-Barke et al. 2017 1.1580 [ 0.4015; 1.9145] 0.0 0.3
## Sonuga-Barke et al. 2017 0.4410 [-0.1000; 0.9820] 0.1 0.4
## Sonuga-Barke et al. 2017 0.0550 [-0.4860; 0.5960] 0.1 0.4
## Sonuga-Barke et al. 2017 -0.2210 [-0.7620; 0.3200] 0.1 0.4
## Sonuga-Barke et al. 2017 -0.1926 [-0.3925; 0.0073] 0.5 0.6
## Sonuga-Barke et al. 2017 -0.1926 [-0.7336; 0.3484] 0.1 0.4
## Sonuga-Barke et al. 2017 -0.1926 [-0.9491; 0.5639] 0.0 0.3
## Sonuga-Barke et al. 2017 -0.3586 [-0.7173; 0.0001] 0.2 0.5
## Sonuga-Barke et al. 2017 -0.4136 [-0.8272; -0.0000] 0.1 0.5
## Sonuga-Barke et al. 2017 -0.4686 [-0.9370; -0.0002] 0.1 0.4
## Sonuga-Barke et al. 2017 -0.5236 [-1.0469; -0.0003] 0.1 0.4
## Sonuga-Barke et al. 2017 -0.5786 [-1.1568; -0.0004] 0.1 0.4
## Sonuga-Barke et al. 2017 -0.5786 [-1.1568; -0.0004] 0.1 0.4
## Sonuga-Barke et al. 2017 -0.6896 [-1.3383; -0.0409] 0.1 0.3
## Sonuga-Barke et al. 2017 -0.6896 [-1.3383; -0.0409] 0.1 0.3
## Sonuga-Barke et al. 2017 -0.6896 [-1.3383; -0.0409] 0.1 0.3
## Sonuga-Barke et al. 2017 -0.7996 [-1.5561; -0.0431] 0.0 0.3
## Sonuga-Barke et al. 2017 -1.0196 [-1.5606; -0.4786] 0.1 0.4
## Stern et al. 2018 0.1400 [ 0.0224; 0.2576] 1.6 0.6
## Stern et al. 2018 0.3450 [ 0.2254; 0.4646] 1.5 0.6
## Thornberry et al. 2010 0.2430 [-0.0059; 0.4919] 0.3 0.6
## Thornberry et al. 2010 0.3690 [ 0.0672; 0.6708] 0.2 0.5
## Thornberry et al. 2010 0.2090 [ 0.0052; 0.4128] 0.5 0.6
## Thornberry et al. 2010 0.4080 [ 0.1042; 0.7118] 0.2 0.5
## Thornberry et al. 2010 0.4960 [ 0.1491; 0.8429] 0.2 0.5
## Thornberry et al. 2010 0.1970 [-0.0441; 0.4381] 0.4 0.6
## Thornberry et al. 2010 -0.1376 [-0.4845; 0.2093] 0.2 0.5
## Voith et al. 2014 0.1500 [ 0.0618; 0.2382] 2.8 0.6
## Voith et al. 2014 0.1180 [ 0.0298; 0.2062] 2.8 0.6
## Young-Wolff et al. 2011 -0.0460 [-0.4909; 0.3989] 0.1 0.5
## Zvara et al. 2017 0.2900 [ 0.0156; 0.5644] 0.3 0.6
##
## Number of studies combined: k = 204
##
## SMD 95%-CI z|t p-value
## Common effect model 0.1770 [0.1623; 0.1917] 23.60 < 0.0001
## Random effects model (HK) 0.1850 [0.1335; 0.2365] 7.08 < 0.0001
##
## Quantifying heterogeneity:
## tau^2 = 0.1180 [0.0722; 0.1343]; tau = 0.3435 [0.2687; 0.3664]
## I^2 = 77.5% [74.4%; 80.3%]; H = 2.11 [1.98; 2.25]
##
## Test of heterogeneity:
## Q d.f. p-value
## 902.53 203 < 0.0001
##
## Details on meta-analytical method:
## - Inverse variance method
## - Sidik-Jonkman estimator for tau^2
## - Q-Profile method for confidence interval of tau^2 and tau
## - Hartung-Knapp (HK) adjustment for random effects model (df = 203)TFQual <- subgroup.analysis.mixed.effects(TF, filleddata$Designs); TFQual## Subgroup Results:
## --------------
## k SMD SE LLCI ULCI p
## Adoption 3 0.2488439 0.20620210 -0.155 0.653 0.2275105934741054325431975
## COT 3 0.2703333 0.05391763 0.165 0.376 0.0000005335976142607456337
## FE 5 0.1924413 0.16734444 -0.136 0.520 0.2501555788950054481922791
## IPW 33 0.2063467 0.06178053 0.085 0.327 0.0008377947796609307553120
## MZ 39 0.1931891 0.04189189 0.111 0.275 0.0000039956130421394165405
## NE 47 0.1667382 0.08990031 -0.009 0.343 0.0636389631962496898909265
## PSM 10 0.2431515 0.08304985 0.080 0.406 0.0034139348968335557488185
## RICLPM 2 0.0900000 0.01000000 0.070 0.110 0.0000000000000000002257177
## Sibling 12 0.1239513 0.11917307 -0.110 0.358 0.2982957935439311536462981
## Twin 50 0.1734296 0.03857426 0.098 0.249 0.0000069245587961611604942
## Q I2 I2.lower I2.upper
## Adoption 8.8700037 0.77 0.27 0.93
## COT 4.3947258 0.54 0.00 0.87
## FE 82.1157025 0.95 0.91 0.97
## IPW 162.8289777 0.80 0.73 0.86
## MZ 195.7681214 0.81 0.74 0.85
## NE 210.2853471 0.78 0.71 0.83
## PSM 26.4586574 0.66 0.33 0.83
## RICLPM 0.1953125 0.00 NA NA
## Sibling 84.5684872 0.87 0.79 0.92
## Twin 75.3441353 0.35 0.08 0.54
##
## Test for subgroup differences (mixed/fixed-effects (plural) model):
## --------------
## Q df p
## Between groups 25.59939 9 0.002374984
##
## - Total number of studies included in subgroup analysis: 204
## - Tau estimator used for within-group pooling: SJConclusions
Properly correcting for publication bias substantially reduced the aggregate and by-design meta-analytic effects, rendering some of the effects by design nonsignificant. Some of the estimates differed by design from the authors’ originally-provided baseline estimates by design, which I can only assume was due to an error by GPT-3 that I can’t find or the fact that a marker for “quasi-causal estimate” versus “not quasi-causal estimate” was not provided in the supplementary materials. The corrected meta-analytic d was 0.19, an r of 0.095, indicating that less than 1% of the variance in mental health is explained by childhood maltreatment. I avoided PET-PEESE because it indicated an effect of -.04, which seemed unrealistic. Perhaps it isn’t, but I don’t really know.
References
Baldwin, J. R., Wang, B., Karwatowska, L., Schoeler, T., Tsaligopoulou, A., Munafo, M. R., & Pingault, J.-B. (2023). Childhood Maltreatment and Mental Health Problems: A Systematic Review and Meta-Analysis of Quasi-Experimental Studies. American Journal of Psychiatry, appi.ajp.20220174. https://doi.org/10.1176/appi.ajp.20220174