Assessing How Virtual Reality Enhances Learning Outcomes Compared to Traditional Teaching Methods

Project Background

The purpose of this study was to examine the impact of virtual reality (VR) technology on students' cognitive 
performance in an educational environment. We used two sample t tests to assess whether students who used VR as 
part of their educational experience were more likely to use VR as part of their educational experience. The 
findings of this analysis provide valuable insights into the role of emerging technologies in increasing 
educational effectiveness and informing future teaching strategies.

Problem Significance

1. Advancing Educational Strategies: Assessing the impact of VR on perceived learning performance helps educators 
and institutions make informed decisions about integrating new technologies to improve student outcomes.

2. Resource Optimization: Understanding whether VR provides measurable benefits This allows for the efficient 
allocation of resources to technology that demonstrably improves the educational experience.

Objective

Our project aims to provide actionable insights to help educators evaluate the effectiveness of virtual reality 
(VR) as a teaching tool compared to traditional methods. Specifically, we seek to determine whether integrating VR 
into classrooms has a significant impact on student learning outcomes. By leveraging the dataset “Impact of 
Virtual Reality on Education,” our analysis focuses on the perceived effectiveness of people who do use versus 
those who don't use VR for education. Our goal is to demonstrate that virtual reality not only has the potential 
to make the learning process more interesting and easier but also to enhance overall educational experiences and 
outcomes.

Load the packages

library(readxl)
library(tidyr)
library(tidyverse)
## ── Attaching core tidyverse packages ──────────────────────── tidyverse 2.0.0 ──
## ✔ dplyr     1.1.4     ✔ purrr     1.0.2
## ✔ forcats   1.0.0     ✔ readr     2.1.5
## ✔ ggplot2   3.5.1     ✔ stringr   1.5.1
## ✔ lubridate 1.9.3     ✔ tibble    3.2.1
## ── Conflicts ────────────────────────────────────────── tidyverse_conflicts() ──
## ✖ dplyr::filter() masks stats::filter()
## ✖ dplyr::lag()    masks stats::lag()
## ℹ Use the conflicted package (<http://conflicted.r-lib.org/>) to force all conflicts to become errors
library(ggplot2)

Upload the Data

data <- read_excel(file.choose())

Summarize the Data

summary(data)
##   Student_ID             Age           Gender          Grade_Level       
##  Length:5000        Min.   :12.00   Length:5000        Length:5000       
##  Class :character   1st Qu.:16.00   Class :character   Class :character  
##  Mode  :character   Median :21.00   Mode  :character   Mode  :character  
##                     Mean   :21.18                                        
##                     3rd Qu.:26.00                                        
##                     Max.   :30.00                                        
##  Field_of_Study     Usage_of_VR_in_Education Hours_of_VR_Usage_Per_Week
##  Length:5000        Length:5000              Min.   : 0.000            
##  Class :character   Class :character         1st Qu.: 2.000            
##  Mode  :character   Mode  :character         Median : 5.000            
##                                              Mean   : 5.025            
##                                              3rd Qu.: 8.000            
##                                              Max.   :10.000            
##  Engagement_Level Improvement_in_Learning_Outcomes   Subject         
##  Min.   :1.000    Length:5000                      Length:5000       
##  1st Qu.:2.000    Class :character                 Class :character  
##  Median :3.000    Mode  :character                 Mode  :character  
##  Mean   :3.021                                                       
##  3rd Qu.:4.000                                                       
##  Max.   :5.000                                                       
##  Instructor_VR_Proficiency Perceived_Effectiveness_of_VR Access_to_VR_Equipment
##  Length:5000               Min.   :1.000                 Length:5000           
##  Class :character          1st Qu.:2.000                 Class :character      
##  Mode  :character          Median :3.000                 Mode  :character      
##                            Mean   :2.952                                       
##                            3rd Qu.:4.000                                       
##                            Max.   :5.000                                       
##  Impact_on_Creativity Stress_Level_with_VR_Usage
##  Min.   :1.00         Length:5000               
##  1st Qu.:2.00         Class :character          
##  Median :3.00         Mode  :character          
##  Mean   :3.02                                   
##  3rd Qu.:4.00                                   
##  Max.   :5.00                                   
##  Collaboration_with_Peers_via_VR Feedback_from_Educators_on_VR
##  Length:5000                     Length:5000                  
##  Class :character                Class :character             
##  Mode  :character                Mode  :character             
##                                                               
##                                                               
##                                                               
##  Interest_in_Continuing_VR_Based_Learning    Region         
##  Length:5000                              Length:5000       
##  Class :character                         Class :character  
##  Mode  :character                         Mode  :character  
##                                                             
##                                                             
##                                                             
##  School_Support_for_VR_in_Curriculum
##  Length:5000                        
##  Class :character                   
##  Mode  :character                   
##                                     
##                                     
## 
We want to focus on the Perceived Effectiveness scores between people who use VR vs people who don't use VR.

Method: Paired T-test for mean perceived effectiveness for VR and non VR

Parameters: μ1 = Mean effectiveness of Students using VR for educational purposes.
            μ2 = Mean effectiveness Students not using VR for educational purposes.
H0: μ1 = μ2
H1: μ1 ≠ μ2
Assumptions: Level of significance (α) = 0.05. The data for each should follow an approximately normal 
distribution with roughly equal variation. Additionally, the VR and non VR groups should be independent.

Choose the data we want to analyze

datafocus <- select(data, `Usage_of_VR_in_Education`, `Perceived_Effectiveness_of_VR`)

Transform the data for analyzation

Yes <- datafocus$Perceived_Effectiveness_of_VR[datafocus$Usage_of_VR_in_Education == "Yes"]
No <- datafocus$Perceived_Effectiveness_of_VR[datafocus$Usage_of_VR_in_Education == "No"]

transform_data <- data.frame(
  Yes = c(Yes, rep(NA, max(0, length(No) - length(Yes)))),
  No = c(No, rep(NA, max(0, length(Yes) - length(No))))
)

Descriptive analytics on transformed data

summary(transform_data)
##       Yes              No       
##  Min.   :1.000   Min.   :1.000  
##  1st Qu.:2.000   1st Qu.:2.000  
##  Median :3.000   Median :3.000  
##  Mean   :2.953   Mean   :2.951  
##  3rd Qu.:4.000   3rd Qu.:4.000  
##  Max.   :5.000   Max.   :5.000  
##                  NA's   :56
Interpretation: The mean perceived effectiveness for people who use VR for education is 2.95 and the mean 
perceived effectiveness for people who don't use VR for education is also 2.95

Prepare for Data Visualization

yes_mean <- mean(transform_data$Yes)
no_mean <- mean(transform_data$No, na.rm = TRUE)

mean_data <- data.frame(
  Usage_of_VR = c("Yes", "No"),
  Mean_Effectiveness = c(yes_mean, no_mean)
)

Data visualization

ggplot(mean_data, aes(x = Usage_of_VR, y = Mean_Effectiveness, fill = Usage_of_VR)) +
  geom_bar(stat = "identity") +
  geom_text(aes(label = round(Mean_Effectiveness, 3)), vjust = -0.3) + # Add labels with rounded values
  labs(title = "Comparison of Means for Yes and No", x = "Usage of VR", y = "Mean Perceived Effectiveness Value") +
  theme_minimal()

Perform a paired T-Test for comparing means

t.test(transform_data$Yes, transform_data$No, paired = TRUE, alternative = "two.sided")
## 
##  Paired t-test
## 
## data:  transform_data$Yes and transform_data$No
## t = -0.13089, df = 2471, p-value = 0.8959
## alternative hypothesis: true mean difference is not equal to 0
## 95 percent confidence interval:
##  -0.08404675  0.07352895
## sample estimates:
## mean difference 
##      -0.0052589
The assumptions were reasonably met with the distribution being normal and the two groups (VR and non VR) being 
independent of eachother
P-value = 0.9 > 0.05. We do not reject H0.
Interpretation: Both VR and non-VR groups are independent. We have set a null hypothesis as both of the groups are equal. On the contrary, the alternative hypothesis shows that both of the groups are different. After doing two 
sample t-tests, we find that null hypothesis is true. The perceived effectiveness of using VR for education versus not using VR for education is equal. 

Conclusion and Recommendations

Conclusion: In order to fully explore the educational value of virtual reality in the future, we need to create 
immersive, hands-on experiences in areas where real world practice can be difficult, such as surgery, aviation, 
and marine biology. VR combined with traditional methods of instruction provides the best of both worlds, while 
data driven monitoring of performance allows learners to see their progress and make changes. Future developments should focus on lowering the cost of VR, keeping exciting and interactive content, and consistently requesting 
feedback from students to improve the experience. We can raise everyone's experience with learning in this way, 
improving its quality, inclusivity, and engagement.