New Analysis for MVS UV Study

Workspace doc: https://docs.google.com/document/d/1g52pl-0JyEO26bFEJ9aE295dL7oZSOU1wrVXvVbd2lg/edit

Items

In general…

1. I think this course is an interesting subject. (Int)
2. What I am learning in this class is relevant to my life. (UV)
3. I consider this topic to be one of my best subjects. (PC)
4. I am not interested in this course. (Int - Rev)
5. I think I will like learning about this topic. (Int)
6. I think what we are studying in this course is useful for me to know. (UV)
7. I don’t feel comfortable when it comes to answering questions in this area. (PC - Rev)
8. I think this subject is interesting. (Int)
9. I find the content of this course to be personally meaningful. (UV)
10. I’ve always wanted to learn more about this subject. (Int)

Int: 1, 4, 5, 8, 10 UV: 2, 6, 9 PC: 3, 7

CFA

Pre-post analysis of the analysis

Using multi-level models by course.

Just looking at pre-post changes in interest and UV and grades

		post_int
		B	CI	p
Fixed Parts
(Intercept)		4.29	3.35 – 5.23	<.001
intervention_dummy		-0.62	-1.67 – 0.44	.270
Random Parts
σ2		0.762
τ00, course_ID		0.286
Ncourse_ID		11
ICCcourse_ID		0.273
Observations		95
R2 / Ω02		.018 / .286

		post_uv
		B	CI	p
Fixed Parts
(Intercept)		3.75	2.81 – 4.69	<.001
intervention_dummy		-0.47	-1.51 – 0.56	.381
Random Parts
σ2		0.879
τ00, course_ID		0.204
Ncourse_ID		11
ICCcourse_ID		0.189
Observations		95
R2 / Ω02		.010 / .197

		final_grade
		B	CI	p
Fixed Parts
(Intercept)		76.07	72.69 – 79.45	<.001
intervention_dummy		1.83	-2.81 – 6.47	.454
Random Parts
σ2		442.712
τ00, course_ID		15.906
Ncourse_ID		36
ICCcourse_ID		0.035
Observations		634
R2 / Ω02		.002 / .036

No effect of the intervention upon interest, utility value, or grades (see intervention_dummy in the output above).

6B. With pre-values added (pre per-comp for final grades)

		post_int
		B	CI	p
Fixed Parts
(Intercept)		0.68	-0.61 – 1.96	.317
pre_int		0.80	0.56 – 1.03	<.001
intervention_dummy		-0.17	-0.89 – 0.55	.643
Random Parts
σ2		0.582
τ00, course_ID		0.021
Ncourse_ID		11
ICCcourse_ID		0.035
Observations		94
R2 / Ω02		.328 / .352

		post_uv
		B	CI	p
Fixed Parts
(Intercept)		0.77	-0.37 – 1.91	.195
pre_uv		0.76	0.54 – 0.98	<.001
intervention_dummy		-0.14	-0.97 – 0.70	.756
Random Parts
σ2		0.596
τ00, course_ID		0.120
Ncourse_ID		11
ICCcourse_ID		0.168
Observations		94
R2 / Ω02		.321 / .435

		final_grade
		B	CI	p
Fixed Parts
(Intercept)		65.08	55.64 – 74.53	<.001
pre_percomp		3.06	0.63 – 5.48	.014
intervention_dummy		1.51	-3.11 – 6.13	.534
Random Parts
σ2		438.364
τ00, course_ID		15.461
Ncourse_ID		36
ICCcourse_ID		0.034
Observations		627
R2 / Ω02		.011 / .045

No effect of the intervention upon interest, utility value, or grades, wehen controlling for pre-values (pre perceived competence in the case of final grade) (see intervention_dummy in the output above).

6C. With pre-values added + interactions with pre perceived competence

		post_int
		B	CI	p
Fixed Parts
(Intercept)		0.12	-4.17 – 4.41	.955
pre_int		0.71	0.41 – 1.01	<.001
intervention_dummy		0.21	-4.23 – 4.65	.928
pre_percomp		0.23	-0.85 – 1.31	.679
intervention_dummy:pre_percomp		-0.08	-1.16 – 1.00	.882
Random Parts
σ2		0.588
τ00, course_ID		0.025
Ncourse_ID		11
ICCcourse_ID		0.041
Observations		94
R2 / Ω02		.329 / .356

		post_uv
		B	CI	p
Fixed Parts
(Intercept)		0.63	-4.05 – 5.31	.793
pre_uv		0.70	0.45 – 0.95	<.001
intervention_dummy		-0.35	-5.11 – 4.40	.886
pre_percomp		0.09	-1.03 – 1.22	.874
intervention_dummy:pre_percomp		0.07	-1.08 – 1.22	.907
Random Parts
σ2		0.601
τ00, course_ID		0.123
Ncourse_ID		11
ICCcourse_ID		0.170
Observations		94
R2 / Ω02		.321 / .437

		final_grade
		B	CI	p
Fixed Parts
(Intercept)		61.31	47.11 – 75.51	<.001
pre_uv		0.05	-2.66 – 2.75	.973
intervention_dummy		9.09	-9.24 – 27.41	.333
pre_percomp		4.05	0.28 – 7.82	.036
intervention_dummy:pre_percomp		-2.02	-6.89 – 2.85	.417
Random Parts
σ2		436.011
τ00, course_ID		16.184
Ncourse_ID		36
ICCcourse_ID		0.036
Observations		624
R2 / Ω02		.012 / .047

No effect of the intervention or the intervention by perceived competence interaction upon interest, utility value, or grades, when controlling for pre-values (pre perceived competence in the case of final grade) (see intervention_dummy in the output above).

6D. With all variables added

		post_uv
		B	CI	p
Fixed Parts
(Intercept)		0.28	-1.21 – 1.77	.718
pre_uv		0.69	0.43 – 0.96	<.001
pre_int		0.08	-0.26 – 0.41	.669
pre_percomp		0.10	-0.24 – 0.44	.564
intervention_dummy		-0.07	-0.92 – 0.77	.872
Random Parts
σ2		0.607
τ00, course_ID		0.110
Ncourse_ID		11
ICCcourse_ID		0.153
Observations		93
R2 / Ω02		.328 / .431

		post_int
		B	CI	p
Fixed Parts
(Intercept)		0.29	-1.10 – 1.69	.686
pre_uv		0.19	-0.06 – 0.44	.151
pre_int		0.63	0.32 – 0.95	<.001
pre_percomp		0.09	-0.24 – 0.42	.597
intervention_dummy		-0.13	-0.87 – 0.61	.733
Random Parts
σ2		0.578
τ00, course_ID		0.028
Ncourse_ID		11
ICCcourse_ID		0.046
Observations		93
R2 / Ω02		.341 / .372

		final_grade
		B	CI	p
Fixed Parts
(Intercept)		53.26	40.00 – 66.51	<.001
pre_uv		-1.55	-4.46 – 1.36	.304
pre_int		5.75	1.98 – 9.53	.003
pre_percomp		1.08	-2.01 – 4.16	.494
intervention_dummy		1.74	-2.92 – 6.40	.478
Random Parts
σ2		434.151
τ00, course_ID		15.909
Ncourse_ID		36
ICCcourse_ID		0.035
Observations		616
R2 / Ω02		.026 / .061

No effect of the intervention upon interest, utility value, or grades, when controlling for all of the time 1 values (see intervention_dummy in the output above).