title: “CS695： Week 3 wordCloud Notebook” output: html_document df_print: paged
This is an R Markdown Notebook. When you execute code within the notebook, the results appear beneath the code.
Try executing this chunk by clicking the Run button within the chunk or by placing your cursor inside it and pressing Cmd+Shift+Enter.
Install necessary packages. Comment after installation
#install.packages('tm')
#install.packages('RColorBrewer')
#install.packages('wordcloud')
#install.packages("slam", type = "binary")Include the packages.
library('tm')## Loading required package: NLPlibrary('RColorBrewer')
library('wordcloud')
library('slam')Process data
zyngaData <- readRDS("zynga.RDS")
tweets <- zyngaData$text
# swap out all non-alphanumeric characters
# Note that the definition of what constitutes a letter or a number or a punctuatution mark varies slightly depending upon your locale, so you may need to experiment a little to get exactly what you want.
# str_replace_all(tweets, "[^[:alnum:]]", " ")
# iconv(tweets, from = 'UTF-8', to = 'ASCII//TRANSLIT')
# Encoding(tweets) <- "UTF-8"
# Function to clean tweets
clean.text = function(x)
{
# remove rt
x = gsub("rt", "", x)
# remove at
x = gsub("@\\w+", "", x)
# remove punctuation
x = gsub("[[:punct:]]", "", x)
# remove numbers
x = gsub("[[:digit:]]", "", x)
# remove links http
x = gsub("http\\w+", "", x)
# remove tabs
x = gsub("[ |\t]{2,}", "", x)
# remove blank spaces at the beginning
x = gsub("^ ", "", x)
# remove blank spaces at the end
x = gsub(" $", "", x)
# tolower
# x = tolower(x)
return(x)
}
# clean tweets
tweets = clean.text(tweets)Create word cloud of tweets
corpus = Corpus(VectorSource(tweets))
# create term-document matrix
tdm = TermDocumentMatrix(
corpus,
control = list(
wordLengths=c(3,20),
removePunctuation = TRUE,
stopwords = c("the", "a", stopwords("english")),
removeNumbers = TRUE,
# tolower may cause trouble on Window because UTF-8 encoding, changed to FALSE
tolower = FALSE) )
# convert as matrix. It may consume near 1g of your RAM
tdm = as.matrix(tdm)
# get word counts in decreasing order
word_freqs = sort(rowSums(tdm), decreasing=TRUE)
#check top 50 most mentioned words
head(word_freqs, 50)## Zynga needs Poker just card
## 895 591 545 500 469
## sent raised Deborah Scott looking
## 469 401 311 264 257
## Prized now can Petra adult
## 219 213 198 187 186
## Jeneva found rewards trees Play
## 174 166 159 158 157
## How car bit video sponsorship
## 143 141 140 139 139
## RTHeres needing shook gotas Points
## 138 138 138 137 129
## Betty Fruit Kathryn FarmVilleOnWeb The
## 125 113 112 111 108
## Career Spring get Corner ️
## 105 104 102 102 98
## Game You County use Hat
## 98 94 94 92 92
## Black game King win Check
## 92 88 88 87 86#remove the top words which don’t generate insights such as "the", "a", "and", etc.
word_freqs = word_freqs[-(1:5)] #Here “1:5” is 1st-5th words in the list we want to remove
# create a data frame with words and their frequencies
dm = data.frame(word=names(word_freqs), freq=word_freqs)
#Plot corpus in a clored graph; need RColorBrewer package
wordcloud(head(dm$word, 50), head(dm$freq, 50), random.order=FALSE, colors=brewer.pal(8, "Dark2"))
#check top 50 most mentioned words
head(word_freqs, 50)## sent raised Deborah Scott looking
## 469 401 311 264 257
## Prized now can Petra adult
## 219 213 198 187 186
## Jeneva found rewards trees Play
## 174 166 159 158 157
## How car bit video sponsorship
## 143 141 140 139 139
## RTHeres needing shook gotas Points
## 138 138 138 137 129
## Betty Fruit Kathryn FarmVilleOnWeb The
## 125 113 112 111 108
## Career Spring get Corner ️
## 105 104 102 102 98
## Game You County use Hat
## 98 94 94 92 92
## Black game King win Check
## 92 88 88 87 86
## FarmVille Nesting Horse Dolls Mobile
## 83 83 82 82 82# I see some words I don't know or understand, so I retrieve the tweets that have the words
# I retrieve all the tweets that have "nigeria" in it
index = grep("help", tweets)
tweets[index]## [1] "Suzanne is out of power and could use a helping hand"
## [2] "Suzanne is out of fuel and could use a helping hand"
## [3] "Force closingyour game may help improve your gameplay experience Also c"
## [4] "Michael is out of power and could use a helping hand"
## [5] "Grace is out of power and could use a helping hand"
## [6] "Grace is out of fuel and could use a helping hand"
## [7] "Petra is out of fuel and could use a helping hand"
## [8] "Jeneva is out of fuel and could use a helping hand"
## [9] "RTFridayFeeling excited to take home Zynga the Bulldog Get help from Beahday Bearand the FarmVille Mascot as they ar"
## [10] "Candy is out of power and could use a helping hand"
## [11] "Deborah helped out on Maries farm"
## [12] "Deborah is out of fuel and could use a helping hand"
## [13] "Deborah is out of power and could use a helping hand"
## [14] "Peter is out of fuel and could use a helping hand"
## [15] "Peter helped out on Maries farm"
## [16] "RTHowdy farmers Heresfree waterto help you build your Career Corner on FarmVilleOnWeb C"
## [17] "Betty is out of power and could use a helping hand"
## [18] "Muhammad Ummar is out of power and could use a helping hand"
## [19] "Amy is out of fuel and could use a helping hand"
## [20] "Shawn is out of power and could use a helping hand"
## [21] "Petra is out of fuel and could use a helping hand"
## [22] "Barbara helped out on Walters farm"
## [23] "Barbara helped out on Barbaras farm"
## [24] "Marya helped out on Maries farm"
## [25] "Deborah helped out on Maries farm"
## [26] "Deborah is out of power and could use a helping hand"
## [27] "Deborah is out of fuel and could use a helping hand"
## [28] "Karen is out of fuel and could use a helping hand"
## [29] "Jeneva is out of power and could use a helping hand"
## [30] "RTFridayFeeling excited to take home Zynga the Bulldog Get help from Beahday Bearand the FarmVille Mascot as they ar"
## [31] "We apologize for the inconvenience Please try these stepsthat may help to l"
## [32] "RTAsk for your panershelp in feeding\U0001f963your Sheep or thankthem for a job well done ThursdayThoughts FarmVilleCountryE"
## [33] "Karen is out of power and could use a helping hand"
## [34] "Billy is out of fuel and could use a helping hand"
## [35] "RTFridayFeeling excited to take home Zynga the Bulldog Get help from Beahday Bearand the FarmVille Mascot as they ar"
## [36] "FridayFeeling excited to take home Zynga the Bulldog Get help from Beahday Bearand the FarmVille Mascot as"
## [37] "Appreciate the repo To help you with your Gin Rummy Plus account please fill out this formThank you"
## [38] "Hi Force closing the app helps you access the Solo Series again For instructions please refer to t"
## [39] "Appreciate the repoPlease try the troubleshooting steps on these aicles that will help resto"
## [40] "can you help me guess this picture on Draw Somethingdrawsomething\n"
## [41] "RTHaving difficulty feeding\U0001f963of your ShowAnimals Invite a friendfor help and share rewards TuesdayThoughts FarmVilleCo"
## [42] "Deborah helped out on Maries farm"
## [43] "Deborah is out of power and could use a helping hand"
## [44] "can you help me guess this picture on Draw Somethingdrawsomething"
## [45] "Hi Adjusting and optimizing your Flash Player settings and choosing other browser may help you pla"
## [46] "Deborah is out of fuel and could use a helping hand"
## [47] "Suzanne is out of fuel and could use a helping hand"
## [48] "RTFridayFeeling \U0001f929The Golden and Silver Bihday Candle Boosts \U0001f56f️will help increase your Pay Points to climb the Farmville"
## [49] "FridayFeeling \U0001f929The Golden and Silver Bihday Candle Boosts \U0001f56f️will help increase your Pay Points to climb the F"
## [50] "Roselyn is out of fuel and could use a helping hand"
## [51] "RTHowdy farmers Heresfree waterto help you build your Career Corner on FarmVilleOnWeb C"
## [52] "RTHowdy farmers Heresfree waterto help you build your Career Corner on FarmVilleOnWeb C"
## [53] "Betty is out of fuel and could use a helping hand"
## [54] "Deborah is out of power and could use a helping hand"
## [55] "RTAsk for your panershelp in feeding\U0001f963your Sheep or thankthem for a job well done ThursdayThoughts FarmVilleCountryE"
## [56] "Billy is out of fuel and could use a helping hand"
## [57] "RTHowdy farmers Heresfree waterto help you build your Career Corner on FarmVilleOnWeb C"
## [58] "Deborah helped out on Maries farm"
## [59] "Deborah is out of fuel and could use a helping hand"
## [60] "How many Buddies do you currently have We suggest to remove some inactive ones to help optimize your fri"
## [61] "Howdy farmers Heresfree \U0001f4a6water \U0001f449to help you build your Career Corner \U0001f44don"
## [62] "Ask for your panershelp in feeding\U0001f963your Sheep or thankthem for a job well done ThursdayThoughts"
## [63] "Suzanne is out of fuel and could use a helping hand"
## [64] "Peter is out of fuel and could use a helping hand"
## [65] "its impoant to enjoy all games venues \nPlease help it outand thanks for the joyment Zynga provides"
## [66] "Deborah is out of power and could use a helping hand"
## [67] "Billy is out of fuel and could use a helping hand"
## [68] "Jeneva is out of fuel and could use a helping hand"
## [69] "Betty is out of fuel and could use a helping hand"
## [70] "You may try performing these basic troubleshooting stepsto help you get"
## [71] "Deborah is out of fuel and could use a helping hand"
## [72] "Suzanne is out of fuel and could use a helping hand"
## [73] "Barbara helped out on Maries farm"
## [74] "Barbara is out of fuel and could use a helping hand"
## [75] "RTMaries New Upgrades can help you greatly speed ️ things up in your farm and more TuesdayThoughts\U0001f914 FarmVilleCountr"
## [76] "RTHaving difficulty feeding\U0001f963of your ShowAnimals Invite a friendfor help and share rewards TuesdayThoughts FarmVilleCo"
## [77] "RTItsaSHEEPthing ASK for help in feeding youror THANK them for a job well doneFarmVilleCountryEscape"
## [78] "RTTuesdayThoughts Have you visited the Prospectors Corner\U0001f3de️Goldie ️will help you find awesome rewards on FarmVilleC"
## [79] "RTHaving difficulty feeding\U0001f963of your ShowAnimals Invite a friendfor help and share rewards TuesdayThoughts FarmVilleCo"
## [80] "Karina is out of power and could use a helping hand"
## [81] "Candy helped out on Maries farm"
## [82] "I thanked zynga for helping you last week"
## [83] "RTHaving difficulty feeding\U0001f963of your ShowAnimals Invite a friendfor help and share rewards TuesdayThoughts FarmVilleCo"
## [84] "Deborah helped out on Maries farm"
## [85] "Joining a \U0001f3d6Beach Club can \U0001f91dhelp you with difficult tasks Your members can also send you Guests that you can use at"
## [86] "Deborah is out of fuel and could use a helping hand"
## [87] "Deborah is out of power and could use a helping hand"
## [88] "RTHaving difficulty feeding\U0001f963of your ShowAnimals Invite a friendfor help and share rewards TuesdayThoughts FarmVilleCo"
## [89] "Having difficulty feeding\U0001f963of your Show\U0001f437\U0001f40fAnimals Invite a friend\U0001f46bfor help and share rewards TuesdayThoughts"
## [90] "Roselyn helped out on Maries farm"
## [91] "RTMaries New Upgrades can help you greatly speed ️ things up in your farm and more TuesdayThoughts\U0001f914 FarmVilleCountr"
## [92] "RTMaries New Upgrades can help you greatly speed ️ things up in your farm and more TuesdayThoughts\U0001f914 FarmVilleCountr"
## [93] "Maries \U0001f469\U0001f33e New Upgrades can help you greatly speed ️ things up in your farm and more TuesdayThoughts\U0001f914"
## [94] "Peter helped out on Maries farm"
## [95] "Peter is out of fuel and could use a helping hand"
## [96] "Suzanne is out of fuel and could use a helping hand"
## [97] "Petra helped out on Maries farm"
## [98] "Petra is out of fuel and could use a helping hand"
## [99] "Zynga commits to helping female game devsMobile World Live"
## [100] "can you help me guess this picture on Draw Somethingdrawsomething\n"
## [101] "Petra is out of power and could use a helping hand"
## [102] "Nevaeh helped out on Maries farm"
## [103] "This should be fixed by now Force closing the app helps you get back on track Apologies for the inconve"
## [104] "This should be fixed by now We suggest to force close the app to help you get back to your farm Apologie"
## [105] "Nevaeh is out of power and could use a helping hand"
## [106] "It is now fixedPlease try this steps againto help you g"
## [107] "Its already fixedYou may now perform this stepsto help you get"
## [108] "This concern is now fixedHeres the stepsthat will help you g"
## [109] "Brittany is out of power and could use a helping hand"
## [110] "Suzanne is out of power and could use a helping hand"
## [111] "Deborah is out of power and could use a helping hand"
## [112] "Deborah is out of fuel and could use a helping hand"
## [113] "Suzanne is out of fuel and could use a helping hand"
## [114] "Jeneva is out of power and could use a helping hand"
## [115] "Michael is out of power and could use a helping hand"
## [116] "Jeneva is out of fuel and could use a helping hand"
## [117] "can you help me guess this picture on Draw Somethingdrawsomething"
## [118] "Brittany is out of power and could use a helping hand"
## [119] "Deborah helped out on Maries farm"
## [120] "Petra helped out on Maries farm"
## [121] "Karan is out of fuel and could use a helping hand"
## [122] "Adeline is out of power and could use a helping hand"
## [123] "Deborah is out of power and could use a helping hand"
## [124] "Deborah is out of fuel and could use a helping hand"
## [125] "Roselyn is out of fuel and could use a helping hand"
## [126] "Candy is out of fuel and could use a helping hand"
## [127] "Sarah is out of fuel and could use a helping hand"
## [128] "Peter is out of fuel and could use a helping hand"
## [129] "can you help me guess this picture on Draw Somethingdrawsomething"
## [130] "Betty is out of power and could use a helping hand"
## [131] "Karan is out of power and could use a helping hand"
## [132] "Having a ShoutoutSaturday\U0001f631 on FarmVilleTropicEscape\U0001f3dd️ Fret not Luis is here to help\U0001f4aa Explore the Smugglers Cave"
## [133] "Karan is out of fuel and could use a helping hand"
## [134] "RTWin yourself a baby Mottled Pekin Chicken this FridayMorningas you help Marie record️the growth of natureon FarmVill"
## [135] "SaturdayMotivation Share your rare ingredients with your CoOp \U0001f468\U0001f469\U0001f467\U0001f466 and help one another \U0001f91d to complete the Chin"
## [136] "RTFridayMorning Guess what Cornelius is here to help you build one for \U0001f9da️yourself Design the Fairy Garden Bridge\U0001f9da️an"
## [137] "Here are some troubleshooting steps to perform that will help you get back in the game"
## [138] "Petra helped out on Maries farm"
## [139] "Indiana is out of power and could use a helping hand"
## [140] "Barbara helped out on Maries farm"
## [141] "RTFridayMorning Hows your Rich Order Board goals going Come to FarmVilleOnWeb and help Captain Jack\u2693️strengthen the coun"
## [142] "RTFridayMorning Guess what Cornelius is here to help you build one for \U0001f9da️yourself Design the Fairy Garden Bridge\U0001f9da️an"
## [143] "Muhammad Ummar is out of power and could use a helping hand"
## [144] "RTFridayFeeling Collect rewards that may help you complete orders or tasks on FarmVilleCountryEscapeVisit the Prosp"
## [145] "Deborah helped out on Maries farm"
## [146] "RTProud of our Women at Zynga effos to help bridge the gap for women in gaming and empower them to succeed and become lead"
## [147] "RTFridayMorning Guess what Cornelius is here to help you build one for \U0001f9da️yourself Design the Fairy Garden Bridge\U0001f9da️an"
## [148] "Deborah is out of power and could use a helping hand"
## [149] "FridayMorning Hows your Rich Order Board goals going Come to FarmVilleOnWeb and help Captain Jack\u2693️strengthen"
## [150] "FridayMorning\U0001f304 Guess what Cornelius is here to help you build one for \U0001f9da️yourself Design the Fairy Garden Bridg"
## [151] "Deborah is out of fuel and could use a helping hand"
## [152] "Jeneva is out of power and could use a helping hand"
## [153] "Christine is out of power and could use a helping hand"
## [154] "can you help me guess this picture on Draw Somethingdrawsomething\n"
## [155] "can you help me guess this picture on Draw Somethingdrawsomething\n"
## [156] "Suzanne is out of power and could use a helping hand"
## [157] "Suzanne is out of fuel and could use a helping hand"
## [158] "Connecting to your Google PlayGame Center account then playing through the tutorial may help you g"
## [159] "RTFridayFeeling Collect rewards that may help you complete orders or tasks on FarmVilleCountryEscapeVisit the Prosp"
## [160] "Jeneva is out of fuel and could use a helping hand"
## [161] "Huge thanks to Zynga Poker for helping puton track this week gomatt"Add a new chunk by clicking the Insert Chunk button on the toolbar or by pressing Cmd+Option+I.
When you save the notebook, an HTML file containing the code and output will be saved alongside it (click the Preview button or press Cmd+Shift+K to preview the HTML file).
The preview shows you a rendered HTML copy of the contents of the editor. Consequently, unlike Knit, Preview does not run any R code chunks. Instead, the output of the chunk when it was last run in the editor is displayed.