In the following notes, you will load data directly from a URL, directly from pre-build datasets in R, and finally from a file you save in your own folder.
Load Data Method 1: Load Data from a URL
You can load data from a folder or you can load data directly from a URL. The next example loads the dataset, “Test Scores”, directly from the URL where it resides.
library(tidyverse) # you will use the readr package in tidyverse to read in this data
Warning: package 'ggplot2' was built under R version 4.5.1
Warning: package 'tibble' was built under R version 4.5.1
Warning: package 'purrr' was built under R version 4.5.1
Warning: package 'stringr' was built under R version 4.5.1
allscores <-read_csv("https://goo.gl/MJyzNs") # do not use read.csv()head(allscores)
Notice R interprets the variable “group” as continuous values (col_double). We will fix this later. The command “dim” provides the dimensions of the data, which are 22 observations (rows) by 4 variables (columns).
Use Side-by-Side Boxplots – Done Incorrectly (at first!)
Here is some easy code to create 3 groups of boxplots with some easy-to-access data, filled by group. Since the groups are discrete, you can get rid of the shading.
boxpl <- allscores |>ggplot(aes(y=diff, group = group, fill = group)) +geom_boxplot()boxpl
Notice that the legend give a continuous range of values for the scores, even though the scores are only 1, 2, or 3. The code guides(fill = FALSE) will get rid of the legend. Also, the x-axis labels make no sense. We will deal with that later.
Try to correct for the misrepresenting legend
boxpl2 <- boxpl +guides(fill =FALSE)
Warning: The `<scale>` argument of `guides()` cannot be `FALSE`. Use "none" instead as
of ggplot2 3.3.4.
boxpl2
Add your own color choices for the 3 different boxes
Ensure that the groups are considered as factors, rather than numbers.
Use as.factor as another way to ensure numerical values are read as categorical
Then manually fill with the 3 colors: white, light gray, and dark gray. Make the boxplots orient horizontally.
boxpl3 <- allscores |>ggplot() +geom_boxplot(aes(y=diff, group=group, fill=group)) +scale_fill_manual(values=c("white","lightgray","darkgray")) +theme(axis.text.y=element_blank()) +# Remove the useless y-axis tick values.labs(title ="Score Improvements Across Three Groups",y ="Difference in Pre and Post Test Scores") +coord_flip()boxpl3
Another way to convert to factor levels
Use the factor function:
mutate creates a new variable “1” categorical factor not a
boxpl3 <- allscores |>mutate(group=factor(group, levels=c("1","2","3"), ordered=TRUE)) |>ggplot() +geom_boxplot(aes(y=diff, group=group, fill=group)) +scale_fill_manual(values=c("white","lightgreen","lightpink")) +theme(axis.text.y=element_blank()) +labs(title ="Score Improvements Across Three Groups",y ="Difference in Pre and Post Test Scores") +coord_flip()boxpl3
Load Data Method 2: Use prebuilt dataset
We will use the penguins dataset that is pre-build in the “palmerpenguins” package to create scatterplots.
Load the package and feed data into global environment
library(palmerpenguins)
Attaching package: 'palmerpenguins'
The following objects are masked from 'package:datasets':
penguins, penguins_raw
data("penguins") # loads the penguins dataset into your global environment
It is essential to recognize that variables may be: int (integer), num (numeric), or double vs char (character) and factor (for categories)
Typically, chr or factor are used for discrete variables and int, dbl, or num for continuous variables.
Use head() function to view the tibble and variable types
head(penguins)
# A tibble: 6 × 8
species island bill_length_mm bill_depth_mm flipper_length_mm body_mass_g
<fct> <fct> <dbl> <dbl> <int> <int>
1 Adelie Torgersen 39.1 18.7 181 3750
2 Adelie Torgersen 39.5 17.4 186 3800
3 Adelie Torgersen 40.3 18 195 3250
4 Adelie Torgersen NA NA NA NA
5 Adelie Torgersen 36.7 19.3 193 3450
6 Adelie Torgersen 39.3 20.6 190 3650
# ℹ 2 more variables: sex <fct>, year <int>
Combine fig.cap for the Figure label and fig.alt for the alt text
fig.cap and fig.alt are YAML code embedded in chunks - these are tags for screen readers to improve accessibility in your document. The colors darkorange, purple, and cyan4 improve visibility of colors for colorblind access.
Example of using fig.cap and fig.alt in the next chunk:
{r fig.cap=“Bigger flippers, bigger bills”, fig.alt = “Scatterplot of flipper length by bill length of 3 penguin species, where we show penguins with bigger flippers have bigger bills.”}
This command shows you (in your console below) the path to your directory. My current path is: [1] “C:/Users/rsaidi/Dropbox/Rachel/MontColl/DATA110/Notes”
If you want to change the path, there are several ways to do so. I find the easiest way to change it is to click the “Session” tab at the top of R Studio. Select “Set Working Directory”, and then arrow over to “Choose Directory”. At this point, it will take you to your computer folders, and you need to select where your data is held. I suggest you create a folder called “Datasets” and keep all the data you load for this class in that folder.
Notice that down in the console below, it will show the new path you have chosen: setwd(“C:/Users/rsaidi/Dropbox/Rachel/MontColl/Datasets/Datasets”). At this point, I copy that command and put it directly into a new chunk.
Load the libraries
Zoo is an abbreviation used in time series analysis, which stands for “Z’s ordered observations”
# install.packages("zoo")library(zoo) # this package will help us re-format the period to be a useable date.
Attaching package: 'zoo'
The following objects are masked from 'package:base':
as.Date, as.Date.numeric
Load the data
The following data comes from New York Fed (https://www.newyorkfed.org/microeconomics/hhdc.html) regarding household debt for housing and non-housing expenses. Debt amounts are in $ trillions for all US households.
Download this dataset, Household_debt, from http://bit.ly/2P3084E and save it in your dataset folder. Change your working directory to load the dataset from YOUR folder. Then run this code.
# be sure to change this to your own directorysetwd("C:/Users/rsaidi/Dropbox/Rachel/MontColl/Datasets/Datasets")household <-read_csv("household_debt.csv")
Rows: 64 Columns: 8
── Column specification ────────────────────────────────────────────────────────
Delimiter: ","
chr (1): Period
dbl (7): Mortgage, HE Revolving, Auto Loan, Credit Card, Student Loan, Other...
ℹ Use `spec()` to retrieve the full column specification for this data.
ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.
Very soon, you will find data from other sources. The data will require some cleaning. Here are some important points to check: 1. Be sure the format is .csv 2. Be sure there are no spaces between variable names (headers). 3. Set all variable names to lowercase so you do not have to keep track of capitalizing.
Here are some useful cleaning commands:
Make all headings (column names) lowercase. Remove all spaces between words in headings and replace them with underscores with the gsub command. Then look at it with “head”.
names(household) <-tolower(names(household))names(household) <-gsub(" ","_",names(household))# gsub will remove spaces in between words in the headers and replace them with underscorehead(household)
Mutate is a powerful command in tidyverse. It creates a new variable (column) in your dataset. In our dataset, “period” is not anything useful if we want to plot chronological data. So we will use mutate from “tidyverse” with the package “zoo” to create a useable date format.
summary(household$mortgage)
Min. 1st Qu. Median Mean 3rd Qu. Max.
4.940 7.923 8.265 8.041 8.762 9.290
create two new variables
Use mutate to create a variable “mortgage_ratio” that computes each mortgage in proportion to the total.
Use mutate to create a variable “mortgage_highlow” that makes a dichotomous variable that is “low” if lower than the median and “high” otherwise.
You should see that there are 64 observations and 8 variables. All variables are “col_double” (continuous values) except “period”, which is interpreted as characters.We need to use the library “zoo” package to fix the unusual format of the “period”. We will mutate it to create a new variable, date.
household_debt <- house |>mutate(date =as.Date(as.yearqtr(period, format ="%y:Q%q")))head(household_debt)
