Principles of Data Visualization and Introduction to ggplot2

I have provided you with data about the 5,000 fastest growing companies in the US, as compiled by Inc. magazine. lets read this in:

inc <- read.csv("https://raw.githubusercontent.com/charleyferrari/CUNY_DATA_608/master/module1/Data/inc5000_data.csv", header= TRUE)

And lets preview this data:

head(inc)
##   Rank                         Name Growth_Rate   Revenue
## 1    1                         Fuhu      421.48 1.179e+08
## 2    2        FederalConference.com      248.31 4.960e+07
## 3    3                The HCI Group      245.45 2.550e+07
## 4    4                      Bridger      233.08 1.900e+09
## 5    5                       DataXu      213.37 8.700e+07
## 6    6 MileStone Community Builders      179.38 4.570e+07
##                       Industry Employees         City State
## 1 Consumer Products & Services       104   El Segundo    CA
## 2          Government Services        51     Dumfries    VA
## 3                       Health       132 Jacksonville    FL
## 4                       Energy        50      Addison    TX
## 5      Advertising & Marketing       220       Boston    MA
## 6                  Real Estate        63       Austin    TX
summary(inc)
##       Rank                          Name       Growth_Rate     
##  Min.   :   1   (Add)ventures         :   1   Min.   :  0.340  
##  1st Qu.:1252   @Properties           :   1   1st Qu.:  0.770  
##  Median :2502   1-Stop Translation USA:   1   Median :  1.420  
##  Mean   :2502   110 Consulting        :   1   Mean   :  4.612  
##  3rd Qu.:3751   11thStreetCoffee.com  :   1   3rd Qu.:  3.290  
##  Max.   :5000   123 Exteriors         :   1   Max.   :421.480  
##                 (Other)               :4995                    
##     Revenue                                  Industry      Employees      
##  Min.   :2.000e+06   IT Services                 : 733   Min.   :    1.0  
##  1st Qu.:5.100e+06   Business Products & Services: 482   1st Qu.:   25.0  
##  Median :1.090e+07   Advertising & Marketing     : 471   Median :   53.0  
##  Mean   :4.822e+07   Health                      : 355   Mean   :  232.7  
##  3rd Qu.:2.860e+07   Software                    : 342   3rd Qu.:  132.0  
##  Max.   :1.010e+10   Financial Services          : 260   Max.   :66803.0  
##                      (Other)                     :2358   NA's   :12       
##             City          State     
##  New York     : 160   CA     : 701  
##  Chicago      :  90   TX     : 387  
##  Austin       :  88   NY     : 311  
##  Houston      :  76   VA     : 283  
##  San Francisco:  75   FL     : 282  
##  Atlanta      :  74   IL     : 273  
##  (Other)      :4438   (Other):2764

Load Libraries

library(knitr)
library(kableExtra)
library(ggplot2)
library(dplyr)

Think a bit on what these summaries mean. Use the space below to add some more relevant non-visual exploratory information you think helps you understand this data:

Dimensions

dim(inc)
## [1] 5001    8

Names

names(inc)
## [1] "Rank"        "Name"        "Growth_Rate" "Revenue"     "Industry"   
## [6] "Employees"   "City"        "State"

Descriptive statistics by Group

#(http://www.sthda.com/english/wiki/descriptive-statistics-and-graphics)
stat <- head(group_by(inc, Industry) %>% 
  summarise(count = n(), 
            mean(Revenue),
            sd = sd(Revenue)))
kable(stat)%>% kable_styling()
Industry count mean(Revenue) sd
Advertising & Marketing 471 16528662 29927748
Business Products & Services 482 54705187 187054187
Computer Hardware 44 270129545 1517135530
Construction 187 70450802 399588001
Consumer Products & Services 203 73676847 424610811
Education 83 13726506 21729221

Question 1

Create a graph that shows the distribution of companies in the dataset by State (ie how many are in each state). There are a lot of States, so consider which axis you should use. This visualization is ultimately going to be consumed on a ‘portrait’ oriented screen (ie taller than wide), which should further guide your layout choices.

Data Table

StateCount <-group_by(inc, State) %>%
  summarise(count=n()) %>% arrange(desc(count)) 
#https://dplyr.tidyverse.org/reference/desc.html
kable(head(StateCount))%>% kable_styling()
State count
CA 701
TX 387
NY 311
VA 283
FL 282
IL 273

Graph

#http://www.sthda.com/english/wiki/ggplot2-barplots-quick-start-guide-r-software-and-data-visualization
ggplot(data=StateCount, aes(x=reorder(State,count),y=count)) + geom_bar(stat="identity",width = .7) +
theme(text=element_text(size=7)) +
  ylim(0,750)+
coord_flip()+ xlab("")+ylab("")+ggtitle("Count of Companies By State")

Quesiton 2

Lets dig in on the state with the 3rd most companies in the data set. Imagine you work for the state and are interested in how many people are employed by companies in different industries. Create a plot that shows the average and/or median employment by industry for companies in this state (only use cases with full data, use R’s complete.cases() function.) In addition to this, your graph should show how variable the ranges are, and you should deal with outliers.

Data Table

#https://dplyr.tidyverse.org/reference/filter.html
#https://datacarpentry.org/R-ecology-lesson/03-dplyr.html
EmplbyInd <-inc %>% 
  filter(State=='NY')%>%
  group_by(Industry) %>% 
  select(Industry,Employees)%>%
  summarise(Average = mean(Employees), Employees = sum(Employees))
CCEmplbyInd <- EmplbyInd[complete.cases(EmplbyInd),]
kable(head(CCEmplbyInd)) %>% kable_styling()
Industry Average Employees
Advertising & Marketing 58.43860 3331
Business Products & Services 1492.46154 38804
Computer Hardware 44.00000 44
Construction 61.00000 366
Consumer Products & Services 626.29412 10647
Education 59.85714 838

Graph

inc%>%
  filter(State=='NY') %>%
  group_by(Industry) %>%
  ggplot(aes(x = reorder(Industry, Employees), y = Employees)) +
  geom_boxplot() +
  coord_flip() + 
  ylim(0,1000)+
  xlab("")+ylab("")+ggtitle("Average Employment per Industry for New York")

Question 3

Now imagine you work for an investor and want to see which industries generate the most revenue per employee. Create a chart that makes this information clear. Once again, the distribution per industry should be shown.

Data Table

#https://cran.r-project.org/web/packages/kableExtra/vignettes/awesome_table_in_html.html
IndRev <-inc %>% 
  filter(State=='NY')%>%
  group_by(Industry) %>% 
  select(Industry,Employees,Revenue)%>%
  summarise(Employees = sum(Employees), Revenue = sum(Revenue)) %>%
  mutate(Revenue_Per_Employee = Revenue/Employees)
  CCIndRev <- IndRev[complete.cases(IndRev),]
  kable(head(CCIndRev)) %>%kable_styling()
Industry Employees Revenue Revenue_Per_Employee
Advertising & Marketing 3331 949000000 284899.43
Business Products & Services 38804 2549900000 65712.30
Computer Hardware 44 22900000 520454.55
Construction 366 82300000 224863.39
Consumer Products & Services 10647 4799300000 450765.47
Education 838 70800000 84486.87

Graph

inc %>% 
  filter(State == "NY") %>% 
  group_by(Industry) %>% 
  summarise(Employees = sum(Employees),
            Revenue = sum(Revenue)) %>% 
  mutate(revenue_employee = Revenue/Employees) %>% 
  ggplot(aes(x = reorder(Industry, revenue_employee), y = revenue_employee)) +
  geom_bar(stat = "identity") +
  coord_flip()+
  ylim(0,650000)+
  xlab("")+ylab("")+ggtitle("Revenue per Employee By Industry for New York")+
  theme_minimal()