This report summarizes the analysis workflow and results of an analysis of SNPs from the 1000 Genomes Project.
Single Nucleotide Polymorphism (SNPs) data in VCF format were obtained from the 1000 Genomes Project.
SNPs were downloaded using the Ensembl Data Slicer from chromosome 7 between genomic coordinates 7,000 and 24,700. This represents 0.47% of the chromosome. A total of 8,981 variants genotyped in 2,513 individuals were downloaded.
The VCF file was loaded into R using the vcfR package
(function read.vcfR) and converted to counts of the minor
allele using the function vcfR::extract.gt().
Metadata obtained from merging the data using the with the population meta data from the 1000 genomes_people_info2.csv file. This file contains the information about the population codes, super population, sample, sex, latitude and longitude.
These SNPs were then screened for any SNPs that were
invariant (fixed), resulting in removal of
2,085 SNPs (features). This was done using the
invar_omit() function by Nathan Brouwer.
NOTE: The original workflow code for removing
invariant SNPs contained and error that resulted in no
columns actually being removed (Brouwer, personal
communication). The code was updated and a reduction in the size of
the dataframe after omitting invariant columns confirmed by checking the
dimensions of the dataframes before and after this process using
dim().
The data were then screened for rows (people) with >50% NAs. There were no NAs in the data, so no rows were removed due to the presence of excessive NAs. Similarly, because no NAs were present no imputation was required.
The data were then centered and scaled using R’s
scale() function. (Alternatively a SNP-specific centering
technique common in other studies could have been applied).
The data were then saved in .csv format using
write.csv() for PCA analysis.
After final processing the data contained 6,896 SNPS and 2,513 samples (people).
The code below carries out a PCA on the data and presents the results. The key steps are:
read.csv().prcomp().The following packages were used in this analysis:
# plotting:
library(ggplot2)
library(ggpubr)
# scores() function
library(vegan)
## Loading required package: permute
## Loading required package: lattice
## This is vegan 2.6-4
# 3D scatter plot
library(scatterplot3d)
Load the fully processed data:
NOTE: with 6,896 SNPs, this CSV is ~254.8 megabytes. There are more specialized packages for doing PCA with datasets this big. I do not recommend working with more than 10,000 SNPs with basic R functions as we have done in class.
vcf_scaled <- read.csv(file = "vcf_scaled_final.csv")
Check the dimensions of the data to confirm this is the correct data:
dim(vcf_scaled)
## [1] 2504 6902
The data are scaled and ready for analysis. Only the first size column contains character data and needs to be omitted.
head(vcf_scaled[,1:10])
## sample pop super_pop sex lat lng X1 X2
## 1 HG00096 GBR EUR male 52.48624 -1.890401 -0.1367733 -0.1828012
## 2 HG00097 GBR EUR female 52.48624 -1.890401 -0.1367733 -0.1828012
## 3 HG00099 GBR EUR female 52.48624 -1.890401 -0.1367733 -0.1828012
## 4 HG00100 GBR EUR female 52.48624 -1.890401 -0.1367733 -0.1828012
## 5 HG00101 GBR EUR male 52.48624 -1.890401 -0.1367733 -0.1828012
## 6 HG00102 GBR EUR female 52.48624 -1.890401 -0.1367733 -0.1828012
## X3 X5
## 1 -0.01998402 -0.03999201
## 2 -0.01998402 -0.03999201
## 3 -0.01998402 -0.03999201
## 4 -0.01998402 -0.03999201
## 5 -0.01998402 -0.03999201
## 6 -0.01998402 -0.03999201
Principal Components Analysis was run using
prcomp().
vcf_pca <- prcomp(vcf_scaled[,-c(1:6)])
warning("If this didn't work, you may not have omitted the proper number of columns. ")
## Warning: If this didn't work, you may not have omitted the proper number of
## columns.
Get the PCA scores, which will be plotted.:
vcf_pca_scores <- vegan::scores(vcf_pca)
Combine the scores with the sample information into a dataframe.
# call data.frame()
vcf_pca_scores2 <- data.frame(population = vcf_scaled$super_pop, #TODO
vcf_pca_scores)
# set as a factor
vcf_pca_scores2$population <- factor(vcf_pca_scores2$population)
warning("If this didn't work, you may not have set of the column for sample data correctly")
## Warning: If this didn't work, you may not have set of the column for sample data
## correctly
The following steps help us understand the PCA output and determine how many PCs should be plotted and/or used in further analyses such as scans for natural selection, cluster analysis, and GWAS.
A default R scree plot was created with screeplot().
This plot does not provide extra information for assessing the
importance of the PCs.
screeplot(vcf_pca,
xlab = "Principal Components")
The original workflow and function for making a more advanced scree plot lacked flexibility (Brouwer, personal communication). The following function and workflow simplifies things
PCA_variation() (below) on PCA
output.screeplot_snps() on the output of
PCA_variation() to make an advanced scree plotPCA_cumulative_var_plot() to show the
cumulative variation explained as more PCs are consideredThis function extracts information needed to make a more advanced, annotated scree plot.
# This is a NEW function
PCA_variation <- function(pca){
# get summary information from PCA
pca_summary <- summary(pca)
# extract information from summary
## raw variance for each PC
variance <- pca_summary$importance[1,]
## % variance explained by each PC
var_explained <- pca_summary$importance[2,]*100
var_explained <- round(var_explained,3)
## cumulative % variance
var_cumulative <- pca_summary$importance[3,]*100
var_cumulative <- round(var_cumulative,3)
# prepare output
N.PCs <- length(var_explained)
var_df <- data.frame(PC = 1:N.PCs,
var_raw = variance,
var_percent = var_explained,
cumulative_percent = var_cumulative)
# return output
return(var_df)
}
This functions makes a more advanced scree plot better suited for PCS on for SNPs.
# This is a NEW function
screeplot_snps <- function(var_df){
total_var <- sum(var_df$var_raw)
N <- length(var_df$var_raw)
var_cutoff <- total_var/N
var_cut_percent <- var_cutoff/total_var*100
var_cut_percent_rnd <- round(var_cut_percent,2)
i_above_cut <- which(var_df$var_percent > var_cut_percent)
i_cut <- max(i_above_cut)
ti <- paste0("Cutoff = ",
var_cut_percent_rnd,
"%\n","Useful PCs = ",i_cut)
plot(var_df$var_percent,
main =ti, type = "l",
xlab = "PC",
ylab = "Percent variation",
col = 0)
segments(x0 = var_df$PC,
x1 = var_df$PC,
y0 = 0,
y1 = var_df$var_percent,
col = 1)
segments(x0 = 0,
x1 = N,
y0 = var_cut_percent,
y1 = var_cut_percent,
col = 2)
}
This makes a plot complementary to a scree plot. A scree plot plots the amount of variation explained by each PC. This plot plots a curve of cumulative amount of variation explained by the PCs.
# This is a NEW function
PCA_cumulative_var_plot <- function(var_df){
plot(cumulative_percent ~ PC,
data = var_out,
main = "Cumulative percent variation\n explained by PCs",
xlab = "PC",
ylab = "Cumulative %",
type = "l")
total_var <- sum(var_df$var_raw)
N <- length(var_df$var_raw)
var_cutoff <- total_var/N
var_cut_percent <- var_cutoff/total_var*100
var_cut_percent_rnd <- round(var_cut_percent,2)
i_above_cut <- which(var_df$var_percent > var_cut_percent)
i_cut <- max(i_above_cut)
percent_cut_i <- which(var_out$PC == i_cut )
percent_cut <- var_out$cumulative_percent[percent_cut_i]
segments(x0 = i_cut,
x1 = i_cut,
y0 = 0,
y1 = 100,
col = 2)
segments(x0 = -10,
x1 = N,
y0 = percent_cut,
y1 = percent_cut,
col = 2)
}
Extract information on the variance explained by each PC.
var_out <- PCA_variation(vcf_pca)
Look at the output of PCA_variation()
head(var_out)
## PC var_raw var_percent cumulative_percent
## PC1 1 10.869964 1.713 1.713
## PC2 2 10.421917 1.575 3.288
## PC3 3 9.784612 1.388 4.677
## PC4 4 8.912234 1.152 5.829
## PC5 5 8.454771 1.037 6.865
## PC6 6 8.240014 0.985 7.850
This advanced scree plot shows the amount of variation explained by all PCs. It marks with a horizontal line what the cutoff is for the amount of Percent variation explained that is useful, and a vertical line for where that line interacts the curve of the scree plot. The title indicates the percentage value of the cutoff and which PC is the last PC below that value. Though only the first few PCs can be plotted, PCs below the cut off value (“useful PCs) should probably used for further machine learning algorithms.
Make the scree plot with screeplot_snps()
screeplot_snps(var_out)
The cumulative variation plot shows how much variation in the data explained in total as more and more PCs are considered. The vertical red line shows the cutoff value from the scree plot (above). The horizontal line indicates what the total percentage of variation explained by these useful PCs is.
Make cumulative variation plot with
PCA_cumulative_var_plot()
PCA_cumulative_var_plot(var_out)
The object created above var_out indicates how much
variation is explained by each of the Principal components. This
information is often added to the axes of scatterplots of PCA
output.
head(var_out)
## PC var_raw var_percent cumulative_percent
## PC1 1 10.869964 1.713 1.713
## PC2 2 10.421917 1.575 3.288
## PC3 3 9.784612 1.388 4.677
## PC4 4 8.912234 1.152 5.829
## PC5 5 8.454771 1.037 6.865
## PC6 6 8.240014 0.985 7.850
PC 1 explains 1.71% percent of the variation, PC2 explains. 1.58%, and PC3 explains 1.39%. In total, the first 3 PCs explain only ~4.7% of the variability in the data. The scree plot indicate that the first ~644 PCs are useful explain ~74.71% of the variation in the data. In further analysis such as GWAS the first 644 PCs should therefore be used.
Plot the scores, with super-population color-coded
ggpubr::ggscatter(data = vcf_pca_scores2,
y = "PC2",
x = "PC1",
color = "population",
shape = "population",
main = "PCA Scatterplot",
ylab = "PC2 (1.58% of variation)",
xlab = "PC1 (1.71% of variation)")
Note how in the plot the amount of variation explained by each PC is shown in the axis labels.
Plot the scores, with super population color-coded
ggpubr::ggscatter(data = vcf_pca_scores2,
y = "PC3",
x = "PC2",
color = "population",
shape = "population",
main = "PCA Scatterplot",
ylab = "PC3 (1.39% of variation)",
xlab = "PC2 1.58% of variation)")
Note how in the plot the amount of variation explained by each PC is shown in the axis labels.
Plot the scores, with super population color-coded
ggpubr::ggscatter(data = vcf_pca_scores2,
y = "PC3",
x = "PC1",
ellipse = T,
color = "population",
shape = "population",
main = "PCA Scatterplot",
ylab = "PC3 (1.39% of variation)",
xlab = "PC1 (1.71% of variation)")
Note how in the plot the amount of variation explained by each PC is shown in the axis labels.
The first 3 principal components can be presented as a 3D scatterplot.
colors_use <- as.numeric(vcf_pca_scores2$population)
scatterplot3d(x = vcf_pca_scores2$PC1,
y = vcf_pca_scores2$PC2,
z = vcf_pca_scores2$PC3,
color = colors_use,
xlab = "PC1 (1.71%)",
ylab = "PC2 (1.58%)",
zlab = "PC3 (1.39%)")
In general, most of the super populations were not readily identifiable amongst the others. Looking at PC2 vs. PC1, the EAS population was the most apparent on the left side of the plot, even though parts of it were mixed in with the other populations all around. In PC3 vs. PC2, the AFR population was the most distinguishable, and tended to cluster together in contrast to the other populations which were distributed everywhere. For PC3 vs. PC1, again the AFR super population was the most apparent, as shown in a little red circle towards the middle bottom of the plot while the other populations were all on top of each other. Looking at the 3D scatterplot of PC1, PC2, and PC3, there was no apparent population indicated. There was, however, a large black group towards the bottom of the plot, but I am unclear as to which population it corresponds to - it may also represent a mixture of multiple populations. This may be attributed to there not being large differences in variability between these PCs.