DATA624 - HW10
Diego Correa
12/4/2021
Overview
*Imagine 10000 receipts sitting on your table. Each receipt represents a transaction with items that were purchased. The receipt is a representation of stuff that went into a customer’s basket - and therefore ‘Market Basket Analysis’.
That is exactly what the Groceries Data Set contains: a collection of receipts with each line representing 1 receipt and the items purchased. Each line is called a transaction and each column in a row represents an item. The data set is attached.
Your assignment is to use R to mine the data for association rules. You should report support, confidence and lift and your top 10 rules by lift.
Extra credit: do a simple cluster analysis on the data as well. Use whichever packages you like. Due May 3 before midnight.*
Loading the market basket analysis dataset.
df <- read.transactions('GroceryDataSet.csv', format = 'basket', header = FALSE, sep =',')
summary(df)## transactions as itemMatrix in sparse format with
## 9835 rows (elements/itemsets/transactions) and
## 169 columns (items) and a density of 0.02609146
##
## most frequent items:
## whole milk other vegetables rolls/buns soda
## 2513 1903 1809 1715
## yogurt (Other)
## 1372 34055
##
## element (itemset/transaction) length distribution:
## sizes
## 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
## 2159 1643 1299 1005 855 645 545 438 350 246 182 117 78 77 55 46
## 17 18 19 20 21 22 23 24 26 27 28 29 32
## 29 14 14 9 11 4 6 1 1 1 1 3 1
##
## Min. 1st Qu. Median Mean 3rd Qu. Max.
## 1.000 2.000 3.000 4.409 6.000 32.000
##
## includes extended item information - examples:
## labels
## 1 abrasive cleaner
## 2 artif. sweetener
## 3 baby cosmeticsVisualizing the frequency of the items in the dataset.
itemFrequencyPlot(df, type = 'relative', topN = 20, horiz = TRUE)
Market Basket Analysis
Finding the support, confidence, and lift of the grocery dataset and placing in a table.
rules <- apriori(df, parameter=list(supp=0.001, conf=0.5), control=list(verbose=FALSE)) %>%
DATAFRAME()
rules %>%
arrange(desc(lift)) %>%
top_n(10) %>%
kable() %>% kable_styling(bootstrap_options = c("striped", "hover", "condensed", "responsive")) %>% scroll_box(width="100%",height="400px")## Selecting by count| LHS | RHS | support | confidence | coverage | lift | count |
|---|---|---|---|---|---|---|
| {root vegetables,tropical fruit} | {other vegetables} | 0.0123030 | 0.5845411 | 0.0210473 | 3.020999 | 121 |
| {rolls/buns,root vegetables} | {other vegetables} | 0.0122013 | 0.5020921 | 0.0243010 | 2.594890 | 120 |
| {root vegetables,yogurt} | {other vegetables} | 0.0129131 | 0.5000000 | 0.0258261 | 2.584078 | 127 |
| {root vegetables,yogurt} | {whole milk} | 0.0145399 | 0.5629921 | 0.0258261 | 2.203354 | 143 |
| {domestic eggs,other vegetables} | {whole milk} | 0.0123030 | 0.5525114 | 0.0222674 | 2.162336 | 121 |
| {rolls/buns,root vegetables} | {whole milk} | 0.0127097 | 0.5230126 | 0.0243010 | 2.046888 | 125 |
| {other vegetables,pip fruit} | {whole milk} | 0.0135231 | 0.5175097 | 0.0261312 | 2.025351 | 133 |
| {tropical fruit,yogurt} | {whole milk} | 0.0151500 | 0.5173611 | 0.0292832 | 2.024770 | 149 |
| {other vegetables,yogurt} | {whole milk} | 0.0222674 | 0.5128806 | 0.0434164 | 2.007235 | 219 |
| {other vegetables,whipped/sour cream} | {whole milk} | 0.0146416 | 0.5070423 | 0.0288765 | 1.984385 | 144 |
Graphing the results.
# arulesViz not working correctly?
head(rules, n = 10, by = 'lift') %>%
plot(method = 'graph')## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in plot.xy(xy.coords(x, y), type = type, ...): "method" is not a
## graphical parameter## Warning in plot.window(...): "method" is not a graphical parameter## Warning in plot.xy(xy, type, ...): "method" is not a graphical parameter## Warning in title(...): "method" is not a graphical parameter## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter
## Warning in axis(side = side, at = at, labels = labels, ...): "method" is not a
## graphical parameter
Clustering
Performing a simply cluster analysis on the dataset with variables frequency equal to or greater than 5%. We use the dissimilarity function of teh arules library to perform the analysis.
df <- df[,itemFrequency(df) >= 0.05]
cluster <- dissimilarity(df, which = 'items')
plot(hclust(cluster, method = 'ward.D2'))