Factor Analysis
YASHWANTH K SURUNENI
2021-03-14
Load the libraries + functions
Load all the libraries or functions that you will use to for the rest of the assignment. It is helpful to define your libraries and functions at the top of a report, so that others can know what they need for the report to compile correctly. May need to install the paran package first.
##r chunk
install.packages("paran")## Installing package into '/home/yashwanth_suruneni/R/x86_64-pc-linux-gnu-library/4.0'
## (as 'lib' is unspecified)install.packages("GPArotation")## Installing package into '/home/yashwanth_suruneni/R/x86_64-pc-linux-gnu-library/4.0'
## (as 'lib' is unspecified)library(paran)## Loading required package: MASSlibrary(psych)
library(GPArotation) The Data
The data for this assignment is tweets from US governors at the beginning of the pandemic like last week’s assignment. The dataset for this assignment includes basic info about each governor (state, name, party) and word frequencies for most frequent 500 terms in the corpora. Make sure to only use column 7:507 for PCA. The goal of the current assignment is to explore the themes/topics in governors’ tweets about COVID.
##r chunk
df <- read.csv("Gov Tweets_MEM.csv")How many factors?
- Explore how many factors you should use.
- Include a parallel analysis and scree plot.
- How many components does the parallel analysis recommend?
- ANSWER: The Parallel analysis recommends about 13 components.
- How many components would make sense based on the scree plot?
- ANSWER: The scree plot recommends about 5 components.
##r chunk
paran(df[,7:507], iterations = 100, centile = 95)##
## Using eigendecomposition of correlation matrix.
## Computing: 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
##
##
## Results of Horn's Parallel Analysis for component retention
## 100 iterations, using the 95 centile estimate
##
## --------------------------------------------------
## Component Adjusted Unadjusted Estimated
## Eigenvalue Eigenvalue Bias
## --------------------------------------------------
## 1 20.109781 37.068761 16.958979
## 2 5.926551 22.027479 16.100927
## 3 5.591926 21.023141 15.431215
## 4 4.797940 19.816368 15.018428
## 5 3.887106 18.449219 14.562113
## 6 2.691719 16.886234 14.194515
## 7 2.859175 16.676265 13.817089
## 8 2.248274 15.751470 13.503196
## 9 2.209934 15.370526 13.160592
## 10 1.845082 14.702398 12.857316
## 11 1.165859 13.712912 12.547052
## 12 1.306565 13.557384 12.250819
## 13 1.164185 13.214897 12.050711
## --------------------------------------------------
##
## Adjusted eigenvalues > 1 indicate dimensions to retain.
## (13 components retained)comp1 = principal(df[,7:507], nfactors=5, rotate = 'oblimin') ## Warning in cor.smooth(r): Matrix was not positive definite, smoothing was done## The determinant of the smoothed correlation was zero.
## This means the objective function is not defined.
## Chi square is based upon observed residuals.## The determinant of the smoothed correlation was zero.
## This means the objective function is not defined for the null model either.
## The Chi square is thus based upon observed correlations.## Warning in principal(df[, 7:507], nfactors = 5, rotate = "oblimin"): The matrix
## is not positive semi-definite, scores found from Structure loadingsplot(comp1$values[1:20])
Simple structure - run the PCA
- Run a least two PCA solutions in R
- Note: Given the sample size, should limit number of components to 10 at most.
- Include the saved
principalcode, but then be sure to print out the results, so the summary is on your report.
##r chunk
loadings5 = as.data.frame(comp1$loadings[1:500,1:5])
theme1 = subset(loadings5[order(loadings5$TC1, decreasing = T),], TC1 >= 0.15, select = c(TC1))
theme2 = subset(loadings5[order(loadings5$TC2, decreasing = T),], TC2 >= 0.15, select = c(TC2))
theme3 = subset(loadings5[order(loadings5$TC3, decreasing = T),], TC3 >= 0.15, select = c(TC3))
theme4 = subset(loadings5[order(loadings5$TC4, decreasing = T),], TC4 >= 0.15, select = c(TC4))
theme5 = subset(loadings5[order(loadings5$TC5, decreasing = T),], TC5 >= 0.15, select = c(TC5))
theme1## TC1
## rainy 0.9098451
## committee 0.9085357
## forecast 0.8733865
## X165 0.8733302
## reflect 0.8530849
## media 0.8397376
## X118 0.8131414
## examine 0.8076527
## passage 0.7931488
## resurgence 0.7868400
## peak 0.7700376
## liability 0.7700241
## walking 0.7699225
## responsive 0.7680901
## fashion 0.7637082
## native 0.7507558
## bear 0.7192107
## commend 0.7142631
## extraordinary 0.7126979
## central 0.6867880
## consistent 0.6867788
## spring 0.6703417
## fellowship 0.6542501
## provide 0.6539541
## symptomatic 0.6275613
## initiative 0.6253027
## lower 0.6036980
## suggestion 0.5814534
## fought 0.5812689
## fish 0.5713597
## X1.30 0.5659564
## hike 0.5645596
## evaluate 0.5537343
## article 0.5466407
## chairman 0.5460218
## organize 0.5442311
## session 0.5411478
## daughter 0.5336594
## out.of.state 0.5290535
## leverage 0.5263159
## governor 0.5058801
## surplus 0.5056176
## quest 0.5053413
## X1.500 0.4959115
## suspect 0.4946822
## park 0.4846807
## advisory 0.4771963
## adequate 0.4746685
## circumstance 0.4694508
## X.2020census 0.4669082
## X500 0.4658241
## midnight 0.4635158
## creation 0.4591963
## fever 0.4581360
## breath 0.4541206
## frequently 0.4417559
## tornado 0.4341532
## strategy 0.4291753
## tweet 0.4273523
## longer 0.4268211
## news 0.4257791
## X.fema 0.4236828
## X1st 0.4206131
## X1.3 0.4147036
## pm 0.4130122
## X2.3 0.4116098
## congregation 0.4093793
## hold 0.4089534
## project 0.4082482
## propose 0.4077493
## heal 0.4025016
## assist 0.4011871
## mail 0.3877502
## louis 0.3863074
## short 0.3846604
## conference 0.3815947
## foot 0.3755845
## X1.4 0.3632970
## participate 0.3621728
## discourage 0.3620125
## outdoor 0.3564595
## party 0.3549871
## week 0.3367525
## short.term 0.3365356
## current 0.3315965
## throw 0.3312057
## response 0.3311888
## X4.4 0.3286109
## institute 0.3254970
## careful 0.3208201
## remotely 0.3169421
## represent 0.3164638
## lift 0.3124243
## procure 0.3121917
## arrive 0.3105584
## sample 0.3095745
## radio 0.3066436
## year 0.2936027
## present 0.2929911
## imminent 0.2912158
## campaign 0.2905701
## X2.2 0.2884825
## surface 0.2872950
## nationwide 0.2837663
## behalf 0.2822801
## spirit 0.2820997
## update 0.2796177
## designate 0.2782788
## recommendation 0.2762668
## X250 0.2748653
## finish 0.2733719
## diagnostic 0.2711199
## accord 0.2698938
## question 0.2671528
## phone 0.2644915
## today 0.2599135
## guideline 0.2551479
## institution 0.2546626
## task 0.2533716
## pursue 0.2532840
## commercial 0.2496037
## portal 0.2491824
## X2.500 0.2485829
## exceed 0.2479345
## veteran 0.2466759
## mind 0.2451283
## negatively 0.2425634
## shortness 0.2423831
## operation 0.2421356
## attend 0.2417274
## X.walmart 0.2412398
## locate 0.2401808
## condolence 0.2366690
## gathering 0.2344891
## space 0.2342584
## bill 0.2329554
## birthday 0.2325986
## touch 0.2305183
## reach 0.2291805
## customer 0.2242575
## X1.000 0.2238343
## reply 0.2228146
## telehealth 0.2222502
## industry 0.2210164
## number 0.2206968
## X27 0.2203921
## crisis 0.2195318
## revenue 0.2191355
## burden 0.2168729
## X3.3 0.2133578
## blood 0.2120099
## select 0.2102777
## count 0.2099641
## america 0.2089534
## large 0.2081710
## member 0.2068364
## senate 0.2052093
## break. 0.2036535
## fully 0.2012791
## thought 0.1978414
## happy 0.1958451
## contract 0.1938331
## rise 0.1924446
## national 0.1911644
## cough 0.1869109
## approve 0.1864624
## cdc 0.1859514
## mindful 0.1836407
## mean 0.1822769
## answer 0.1808063
## covid 0.1797761
## house 0.1793885
## activity 0.1792291
## tourism 0.1788171
## X24 0.1739992
## avoid 0.1733951
## administer 0.1679372
## delegation 0.1679215
## isolation 0.1676101
## proposal 0.1673243
## faith 0.1669383
## directly 0.1658797
## live 0.1652565
## qualify 0.1615671
## restore 0.1608470
## officer 0.1596944
## confidence 0.1588978
## outbreak 0.1560880
## accurate 0.1538665
## directive 0.1525370
## watch 0.1524573
## church 0.1511510
## collection 0.1508351theme2## TC2
## time 0.3218742
## plan 0.2541016
## right 0.2499639
## thank 0.2485554
## family 0.2399451
## pandemic 0.2293122
## business 0.2286060
## join 0.2222082
## protect 0.2197271
## great 0.2122982
## worker 0.2101114
## tomorrow 0.2075473
## word 0.2025527
## place 0.1978838
## information 0.1973554
## talk 0.1966825
## hallway 0.1966055
## X2nd 0.1952088
## safe 0.1889758
## answer 0.1870614
## visit 0.1851775
## order 0.1842134
## change 0.1834357
## social 0.1831209
## issue 0.1824886
## spread 0.1822001
## citizen 0.1817753
## public 0.1803205
## sign 0.1777533
## X.vp 0.1773004
## private 0.1717531
## week 0.1710962
## resource 0.1698880
## guidance 0.1698123
## task 0.1694645
## top 0.1677041
## stay 0.1667934
## see 0.1658278
## question 0.1656738
## due 0.1643984
## hard 0.1613368
## healthy 0.1607621
## member 0.1596397
## face 0.1596164
## community 0.1592720
## file 0.1588913
## X1.5 0.1587805
## town 0.1577624
## country 0.1576170
## important 0.1575061
## slow 0.1565369
## live 0.1549658
## best 0.1543998
## number 0.1538671
## call 0.1536713
## maintain 0.1536240
## unemployment 0.1533592
## state 0.1532913
## vulnerable 0.1532091
## watch 0.1530254
## faith 0.1527694
## attend 0.1522769
## step 0.1521105
## close 0.1514776
## X3.3 0.1500446theme3## TC3
## serve 0.7501581
## respond 0.7183305
## expand 0.6738790
## minimize 0.6075744
## capacity 0.5991760
## work 0.5657139
## option 0.5568613
## access 0.5489708
## safety 0.5384733
## open 0.5304984
## restore 0.5263171
## house 0.5248230
## leader 0.5222992
## federal 0.5191658
## commit 0.5026103
## mitigate 0.4996512
## facility 0.4868001
## protocol 0.4856891
## small 0.4852448
## issue 0.4816372
## prepare 0.4786114
## resource 0.4759085
## ensure 0.4707869
## support 0.4685025
## telemedicine 0.4663885
## employment 0.4453244
## collection 0.4407934
## hard 0.4405821
## strategy 0.4403452
## partnership 0.4351206
## meet 0.4310450
## force 0.4211754
## customer 0.4176304
## delegation 0.4139781
## continue 0.4016149
## burden 0.3975005
## relief 0.3973523
## thanks 0.3940150
## care 0.3928146
## worker 0.3827491
## business 0.3675441
## base 0.3644864
## allow 0.3643525
## gathering 0.3628458
## proposal 0.3530429
## administer 0.3522750
## worship 0.3491807
## launch 0.3426582
## service 0.3415489
## town 0.3413766
## cdc 0.3394797
## partner 0.3389653
## safe 0.3368107
## long.term 0.3365503
## drive.through 0.3364527
## reduce 0.3334998
## model 0.3326051
## X2.2 0.3302668
## free 0.3282288
## health 0.3222482
## year 0.3204239
## vulnerable 0.3202975
## activity 0.3185417
## locate 0.3157797
## measure 0.3157112
## hope 0.3135447
## priority 0.3015480
## child 0.2989878
## legislation 0.2962686
## top 0.2956385
## assist 0.2945536
## effect 0.2924780
## nurse 0.2919565
## contract 0.2913643
## bill 0.2884278
## personal 0.2858023
## deadline 0.2853224
## fully 0.2790084
## affect 0.2766337
## enhance 0.2753372
## surge 0.2740949
## require 0.2715440
## future 0.2697252
## telehealth 0.2680843
## protect 0.2669860
## site 0.2663371
## rural 0.2660245
## national 0.2633875
## opening 0.2604707
## timely 0.2549283
## recovery 0.2547279
## present 0.2542914
## institution 0.2542529
## senate 0.2527421
## country 0.2522064
## economic 0.2511692
## guidance 0.2497505
## prioritize 0.2448561
## submit 0.2441760
## X1st 0.2429306
## X4.4 0.2429052
## guard 0.2428292
## pay 0.2337300
## fellow 0.2334060
## face 0.2332324
## implement 0.2325601
## goal 0.2280419
## industry 0.2273413
## church 0.2243119
## president 0.2241988
## grateful 0.2200118
## doctor 0.2185462
## thought 0.2064140
## risk 0.2055489
## weekend 0.2040415
## request 0.1984138
## in.person 0.1974798
## private 0.1969252
## population 0.1966018
## family 0.1958542
## combat 0.1936495
## save 0.1907845
## quest 0.1902588
## learn 0.1893834
## increase 0.1893241
## front.line 0.1891058
## people 0.1867680
## reach 0.1867342
## cough 0.1861731
## assistance 0.1861444
## team 0.1856776
## hardship 0.1842746
## pursue 0.1800883
## activate 0.1792129
## exceed 0.1790397
## sacrifice 0.1788986
## unnecessary 0.1751911
## select 0.1742741
## emergency 0.1711951
## foot 0.1709788
## provider 0.1707003
## workforce 0.1667252
## threat 0.1665378
## ongoing 0.1648855
## guideline 0.1641404
## due 0.1617211
## healthy 0.1596115
## employee 0.1573741
## lift 0.1571790
## important 0.1559748
## large 0.1552920
## online 0.1533103theme4## TC4
## communication 0.6769118
## expose 0.6721337
## physician 0.6561766
## appreciate 0.6542771
## faucus 0.6519786
## successful 0.6444230
## X5.00 0.6386964
## X.nationaldoctorsday 0.6280421
## dedication 0.5948067
## meeting 0.5905205
## opening 0.5713472
## X.potus 0.5288928
## effort 0.5274752
## effect 0.5147339
## consider 0.5127507
## urllink 0.5038333
## X7pm 0.5030853
## drive.thru 0.4984089
## site 0.4956079
## significant 0.4918680
## approve 0.4490218
## disaster 0.4484608
## X.covid19 0.4434579
## pm 0.4333970
## activate 0.4316696
## form 0.4307972
## dr 0.4281605
## today 0.4227364
## drive.through 0.4076010
## self.quarantine 0.4031069
## regard 0.3973159
## great 0.3960002
## afternoon 0.3952654
## full 0.3923322
## watch 0.3913825
## news 0.3713321
## improve 0.3505871
## update 0.3415078
## individual 0.3351985
## combat 0.3288809
## discuss 0.3221021
## test 0.3194178
## thanks 0.3134441
## doctor 0.3005386
## direct 0.2820497
## read 0.2796936
## require 0.2794004
## fight 0.2772080
## conference 0.2767304
## recovery 0.2758046
## worship 0.2749603
## extend 0.2749418
## phone 0.2642121
## provider 0.2626239
## establish 0.2520315
## serve 0.2510697
## X.realdonaldtrump 0.2507929
## recommendation 0.2474211
## cdc 0.2391337
## expand 0.2295267
## federal 0.2281026
## executive 0.2254799
## center 0.2216414
## population 0.2202652
## additional 0.2191010
## X2.30 0.2177326
## tomorrow 0.2174751
## encourage 0.2168914
## tornado 0.2121776
## burden 0.2105838
## activity 0.2094247
## cough 0.2072251
## team 0.2057065
## operation 0.2051730
## president 0.2048096
## lab 0.2029602
## provide 0.2006786
## resource 0.1989937
## economic 0.1989040
## hold 0.1950501
## free 0.1939427
## conduct 0.1876787
## vulnerable 0.1820631
## visit 0.1808444
## week 0.1784059
## rural 0.1725399
## pursue 0.1723818
## institute 0.1717418
## guideline 0.1714824
## educator 0.1654274
## employment 0.1654266
## customer 0.1648146
## assist 0.1635885
## fellowship 0.1587092
## assistance 0.1558914
## project 0.1540898
## live 0.1532142
## revenue 0.1519456
## front.line 0.1518293
## response 0.1511286
## imminent 0.1509169theme5## TC5
## pass 0.6449887
## X1.2 0.6100567
## service 0.5944180
## assembly 0.5828859
## temporarily 0.5741065
## virus 0.5692186
## suspend 0.5395287
## general 0.5368777
## X1.3 0.5219760
## response 0.5171185
## emergency 0.4831816
## order 0.4810481
## direct 0.4778378
## request 0.4579868
## crowd 0.4553124
## prevent 0.4533090
## win 0.4417405
## combat 0.4392185
## develop 0.4336304
## school 0.4102414
## X.vp 0.4009258
## visitor 0.3704477
## official 0.3695836
## sign 0.3684667
## student 0.3654662
## thank 0.3509316
## executive 0.3485154
## employee 0.3405025
## public 0.3394917
## state 0.3378370
## issue 0.3374490
## join 0.3222319
## ensure 0.3207262
## neighbor 0.3051038
## answer 0.2978820
## agency 0.2964333
## question 0.2920868
## allow 0.2845935
## website 0.2745955
## behalf 0.2742277
## X1.5 0.2668279
## economy 0.2660449
## implement 0.2628816
## ongoing 0.2613304
## tomorrow 0.2560039
## leave 0.2559274
## educator 0.2523679
## benefit 0.2515355
## effort 0.2502827
## attend 0.2484115
## X2.3 0.2432559
## town 0.2430277
## tonight 0.2291135
## provide 0.2269566
## due 0.2243956
## reply 0.2228696
## employment 0.2227919
## represent 0.2115342
## talk 0.2086050
## throw 0.2082946
## short.term 0.2080841
## business 0.2074617
## noon 0.2041801
## crisis 0.2028811
## spirit 0.2018978
## fund 0.1981737
## period 0.1975265
## support 0.1970939
## department 0.1940270
## dr 0.1874137
## team 0.1855706
## burden 0.1851008
## hallway 0.1844237
## affect 0.1836100
## follow 0.1755139
## resource 0.1715570
## confidence 0.1671552
## conference 0.1640413
## bill 0.1623286
## discuss 0.1616307
## news 0.1589761
## disaster 0.1578845
## mitigation 0.1546213
## outbreak 0.1539060
## work 0.1537163
## full 0.1514419
## tax 0.1511198
## submit 0.1501954##r chunk
comp10 = principal(df[,7:507], nfactors=10, rotate = 'oblimin')
loadings10 = as.data.frame(comp10$loadings[1:500,1:10])
theme1 = subset(loadings10[order(loadings10$TC1, decreasing = T),], TC1 >= 0.15, select = c(TC1))
theme2 = subset(loadings10[order(loadings10$TC2, decreasing = T),], TC2 >= 0.15, select = c(TC2))
theme3 = subset(loadings10[order(loadings10$TC3, decreasing = T),], TC3 >= 0.15, select = c(TC3))
theme4 = subset(loadings10[order(loadings10$TC4, decreasing = T),], TC4 >= 0.15, select = c(TC4))
theme5 = subset(loadings10[order(loadings10$TC5, decreasing = T),], TC5 >= 0.15, select = c(TC5))
theme6 = subset(loadings10[order(loadings10$TC6, decreasing = T),], TC6 >= 0.15, select = c(TC6))
theme7 = subset(loadings10[order(loadings10$TC7, decreasing = T),], TC7 >= 0.15, select = c(TC7))
theme8 = subset(loadings10[order(loadings10$TC8, decreasing = T),], TC8 >= 0.15, select = c(TC8))
theme9 = subset(loadings10[order(loadings10$TC9, decreasing = T),], TC9 >= 0.15, select = c(TC9))
theme10 = subset(loadings10[order(loadings10$TC10, decreasing = T),], TC10 >= 0.15, select = c(TC10))
theme1## TC1
## committee 0.9235511
## rainy 0.9099071
## forecast 0.8846307
## X165 0.8741737
## reflect 0.8730880
## media 0.8570526
## passage 0.8207627
## X118 0.8203670
## examine 0.8059649
## fashion 0.7950601
## resurgence 0.7939747
## liability 0.7897083
## walking 0.7870835
## responsive 0.7858201
## native 0.7655008
## bear 0.7185270
## extraordinary 0.7183093
## consistent 0.7109974
## peak 0.7063759
## commend 0.7008545
## central 0.6985779
## fellowship 0.6740634
## spring 0.6547824
## initiative 0.6443359
## provide 0.6241185
## lower 0.6110852
## symptomatic 0.6066153
## fish 0.6065055
## hike 0.6064798
## fought 0.5969328
## suggestion 0.5726204
## evaluate 0.5724752
## article 0.5671166
## organize 0.5618500
## X1.30 0.5521812
## out.of.state 0.5458904
## chairman 0.5402482
## quest 0.5312648
## session 0.5299650
## suspect 0.5296934
## advisory 0.5213500
## fever 0.4978400
## breath 0.4970064
## governor 0.4893340
## circumstance 0.4856991
## leverage 0.4856025
## creation 0.4848888
## daughter 0.4825866
## surplus 0.4723382
## frequently 0.4718626
## X.2020census 0.4706096
## midnight 0.4661450
## tornado 0.4600202
## X1.500 0.4600007
## longer 0.4473658
## congregation 0.4460634
## X1.3 0.4414450
## discourage 0.4277715
## park 0.4253462
## news 0.4250854
## adequate 0.4248586
## tweet 0.4227929
## propose 0.4165586
## X500 0.4099902
## strategy 0.4023321
## X.fema 0.3977733
## pm 0.3972669
## mail 0.3946889
## short 0.3933434
## hold 0.3893264
## X2.3 0.3889840
## assist 0.3855911
## louis 0.3844091
## outdoor 0.3756018
## foot 0.3603343
## heal 0.3578446
## X1st 0.3475667
## conference 0.3451570
## party 0.3388413
## arrive 0.3375924
## participate 0.3361283
## procure 0.3355978
## careful 0.3328847
## X1.4 0.3250078
## lift 0.3191986
## short.term 0.3140846
## project 0.3136215
## imminent 0.3064819
## present 0.3039568
## institute 0.3035059
## surface 0.3008627
## X250 0.2964916
## accord 0.2891952
## pursue 0.2868636
## portal 0.2837805
## designate 0.2836476
## response 0.2831205
## shortness 0.2816404
## X4.4 0.2797471
## current 0.2796804
## X2.2 0.2791292
## today 0.2788559
## industry 0.2783997
## campaign 0.2747404
## guideline 0.2739242
## spirit 0.2721200
## radio 0.2694623
## sample 0.2692736
## nationwide 0.2671973
## phone 0.2652549
## exceed 0.2641595
## behalf 0.2639902
## remotely 0.2624279
## update 0.2561553
## week 0.2557456
## mind 0.2494608
## touch 0.2452865
## negatively 0.2424818
## cough 0.2410131
## avoid 0.2407269
## count 0.2379312
## senate 0.2372405
## X.walmart 0.2252666
## mindful 0.2231704
## institution 0.2217586
## finish 0.2172246
## condolence 0.2171807
## X3.3 0.2163225
## diagnostic 0.2143557
## veteran 0.2134546
## year 0.2114182
## number 0.2114096
## X27 0.2105569
## commercial 0.2100531
## space 0.2061080
## rise 0.2060659
## unnecessary 0.2059877
## operation 0.2024573
## covid 0.2020026
## customer 0.2011545
## throw 0.2010048
## birthday 0.1990925
## sector 0.1961158
## burden 0.1945697
## cdc 0.1943055
## represent 0.1891735
## locate 0.1883746
## recommendation 0.1880186
## directly 0.1867743
## telemedicine 0.1867694
## member 0.1858209
## prioritize 0.1848967
## reach 0.1846716
## blood 0.1831136
## break. 0.1808238
## thought 0.1807290
## large 0.1797397
## officer 0.1796591
## gathering 0.1791939
## crisis 0.1782513
## isolation 0.1707016
## tourism 0.1693021
## revenue 0.1682543
## threat 0.1673434
## X24 0.1657561
## administer 0.1656161
## task 0.1647201
## activity 0.1626721
## safety 0.1614650
## select 0.1608357
## fully 0.1592769
## front.line 0.1576683
## reply 0.1554210
## contract 0.1533864
## develop 0.1533143
## mandate 0.1515803
## guard 0.1513017
## approve 0.1507148
## special 0.1506254
## watch 0.1500058theme2## TC2
## time 0.2793061
## thank 0.2180960
## pandemic 0.2156158
## spread 0.2130738
## close 0.2098678
## visit 0.2034540
## week 0.1999497
## social 0.1941404
## business 0.1919161
## family 0.1913542
## plan 0.1910088
## school 0.1873392
## call 0.1848707
## right 0.1836375
## protect 0.1825469
## public 0.1820694
## issue 0.1818899
## due 0.1818241
## measure 0.1784687
## order 0.1772306
## member 0.1742753
## important 0.1727117
## give 0.1721096
## extend 0.1703708
## slow 0.1683907
## X3.3 0.1683288
## number 0.1680799
## information 0.1678048
## stay 0.1650246
## vulnerable 0.1643226
## join 0.1639973
## state 0.1629361
## distance 0.1626994
## economic 0.1621696
## learn 0.1607847
## worker 0.1602289
## X2nd 0.1580645
## disaster 0.1579498
## place 0.1572853
## face 0.1571506
## case 0.1555368
## count 0.1535280
## guidance 0.1533407
## friend 0.1528992
## community 0.1521827
## urllink 0.1519785
## task 0.1510410
## surge 0.1503788theme3## TC3
## open 0.6118101
## employment 0.5850899
## partnership 0.5787658
## leader 0.5497330
## resource 0.5457966
## expand 0.5456781
## worship 0.5372199
## activity 0.5361261
## protocol 0.5358835
## serve 0.5349622
## customer 0.5348469
## restore 0.5327388
## burden 0.5248908
## business 0.5177687
## child 0.4977995
## facility 0.4922627
## access 0.4756194
## thanks 0.4660702
## safety 0.4514753
## drive.through 0.4475316
## site 0.4268192
## recovery 0.4227494
## collection 0.4191807
## free 0.4174380
## economic 0.4049981
## support 0.3999632
## telemedicine 0.3956569
## guidance 0.3931545
## strategy 0.3866400
## hard 0.3843199
## effect 0.3811637
## assistance 0.3801835
## unemployment 0.3770816
## urllink 0.3720494
## opening 0.3669173
## capacity 0.3640066
## service 0.3608567
## team 0.3607239
## commit 0.3603178
## assist 0.3496527
## work 0.3467347
## continue 0.3449352
## church 0.3425068
## long.term 0.3412234
## respond 0.3401854
## allow 0.3378850
## small 0.3358875
## pursue 0.3292118
## exceed 0.3250711
## guideline 0.3222258
## administer 0.3209916
## locate 0.3149877
## partner 0.3144304
## institution 0.3126484
## benefit 0.3113538
## front.line 0.3064795
## weekend 0.3046761
## spirit 0.3025727
## force 0.3024908
## protection 0.3016029
## rural 0.2939945
## priority 0.2938321
## disaster 0.2931539
## issue 0.2916757
## threat 0.2873702
## faith 0.2863241
## town 0.2841728
## model 0.2812551
## minimize 0.2785398
## option 0.2757923
## request 0.2757165
## online 0.2744757
## sacrifice 0.2730906
## tornado 0.2710449
## select 0.2684962
## owner 0.2659840
## gathering 0.2656962
## ensure 0.2635402
## affect 0.2629644
## submit 0.2625452
## change 0.2610020
## offer 0.2600041
## group 0.2592127
## federal 0.2569941
## launch 0.2560566
## executive 0.2525276
## ongoing 0.2490591
## contract 0.2489299
## restaurant 0.2458906
## department 0.2445133
## worker 0.2443087
## base 0.2434251
## implement 0.2423199
## year 0.2417359
## encourage 0.2385373
## quest 0.2378352
## house 0.2361780
## portal 0.2298835
## school 0.2262469
## short.term 0.2259477
## telehealth 0.2257799
## happy 0.2227375
## develop 0.2192919
## blood 0.2185843
## vulnerable 0.2184132
## effort 0.2175277
## restriction 0.2160106
## imminent 0.2131584
## employee 0.2116802
## fully 0.2111937
## safe 0.2104389
## provide 0.2097835
## combat 0.2064397
## timely 0.2053630
## face 0.2034092
## initiative 0.2027852
## industry 0.2023102
## veteran 0.2008273
## social 0.1966928
## health 0.1962939
## bill 0.1956870
## website 0.1953211
## lift 0.1947477
## care 0.1937099
## X2.3 0.1933163
## X250 0.1929939
## top 0.1928701
## learn 0.1892926
## ease 0.1867502
## birthday 0.1859660
## guard 0.1821129
## unnecessary 0.1815114
## inform 0.1792058
## pandemic 0.1785937
## clean 0.1767585
## senate 0.1767224
## mitigate 0.1761776
## approve 0.1727273
## in.person 0.1721029
## fellowship 0.1674706
## crisis 0.1674143
## consider 0.1663581
## drive.thru 0.1632662
## hallway 0.1611399
## special 0.1601992
## start 0.1592376
## order 0.1525616
## surge 0.1520136theme4## TC4
## X5.00 0.8230090
## expose 0.8156934
## successful 0.8131082
## X.nationaldoctorsday 0.8065400
## dedication 0.7795046
## communication 0.7464719
## physician 0.7202490
## meeting 0.7167441
## faucus 0.7096199
## appreciate 0.6963272
## form 0.6717344
## X7pm 0.6168400
## drive.thru 0.5710901
## consider 0.5601908
## doctor 0.5304305
## self.quarantine 0.5081550
## pm 0.4902106
## improve 0.4860222
## significant 0.4713876
## activate 0.4675321
## regard 0.4632331
## effect 0.4516859
## afternoon 0.4372804
## site 0.4271170
## news 0.4250206
## opening 0.4219682
## effort 0.4045383
## cough 0.4022625
## great 0.3952195
## president 0.3942565
## approve 0.3906942
## direct 0.3886679
## provider 0.3701089
## dr 0.3640048
## cdc 0.3551027
## X.potus 0.3549168
## recommendation 0.3517660
## require 0.3515012
## X.realdonaldtrump 0.3453502
## today 0.3421164
## fight 0.3266989
## individual 0.3220383
## educator 0.3139656
## drive.through 0.2985053
## full 0.2803312
## discuss 0.2780507
## thank 0.2749472
## serve 0.2718065
## combat 0.2622332
## healthy 0.2550454
## urllink 0.2470100
## establish 0.2410114
## disaster 0.2397475
## test 0.2338745
## population 0.2324685
## extend 0.2301198
## responder 0.2295129
## grateful 0.2265262
## X.covid19 0.2125295
## resource 0.2103048
## thanks 0.2060604
## day 0.2055801
## travel 0.2054850
## visit 0.2053435
## watch 0.2005344
## prevent 0.1976005
## executive 0.1939342
## tomorrow 0.1862428
## right 0.1848753
## expand 0.1848748
## symptom 0.1815999
## current 0.1703285
## encourage 0.1629344
## general 0.1518144
## project 0.1506395
## vulnerable 0.1504189theme5## TC5
## pass 0.8446224
## assembly 0.8347631
## suspend 0.8267246
## temporarily 0.8077751
## general 0.8032281
## virus 0.7974891
## prevent 0.7155267
## win 0.6733110
## X1.2 0.6700936
## service 0.6553060
## crowd 0.6506801
## order 0.6467309
## develop 0.6291922
## visitor 0.6109350
## X1.3 0.6059650
## direct 0.5910693
## request 0.5669645
## student 0.5272288
## leave 0.5179894
## executive 0.4682407
## agency 0.4475494
## nurse 0.4401217
## school 0.4133453
## combat 0.4030880
## emergency 0.4025811
## response 0.4024937
## ensure 0.3962064
## due 0.3753147
## neighbor 0.3491202
## employee 0.3483910
## X.realdonaldtrump 0.3458692
## X.vp 0.3346776
## state 0.3294944
## follow 0.3217332
## department 0.3209054
## allow 0.3138780
## public 0.3020305
## period 0.2967917
## thank 0.2894872
## issue 0.2894826
## create 0.2747442
## official 0.2674908
## website 0.2522942
## relate 0.2310377
## report 0.2296213
## family 0.2226370
## effort 0.2114478
## arrive 0.2036950
## sign 0.2027972
## save 0.1983148
## educator 0.1962448
## confidence 0.1881508
## close 0.1805024
## qualify 0.1752443
## covid 0.1603105
## tax 0.1600549
## fund 0.1581823
## day 0.1507919theme6## TC6
## enhance 0.6926909
## prioritize 0.6523564
## discourage 0.6081112
## private 0.5961493
## timely 0.5959202
## population 0.5808907
## X.realdonaldtrump 0.5377254
## doctor 0.5270455
## partner 0.5231561
## vulnerable 0.5149907
## future 0.5004789
## medical 0.4891682
## surge 0.4690389
## sector 0.4679933
## rural 0.4654426
## industry 0.4556290
## safe 0.4555097
## reduce 0.4297915
## nurse 0.4075829
## family 0.4009275
## healthy 0.3933003
## hospital 0.3819743
## great 0.3781951
## patient 0.3649056
## work 0.3621721
## join 0.3474860
## capacity 0.3443964
## country 0.3429948
## president 0.3423263
## ensure 0.3316890
## town 0.3292591
## grateful 0.3206255
## top 0.3126524
## expand 0.3108270
## number 0.3060584
## safety 0.3058619
## test 0.3013824
## gt 0.2950642
## guard 0.2836674
## win 0.2824957
## long.term 0.2739711
## close 0.2698969
## fully 0.2692868
## leader 0.2656228
## begin 0.2578022
## guide 0.2572488
## administer 0.2564005
## X.vp 0.2545591
## isolate 0.2521765
## continue 0.2507008
## facility 0.2478533
## large 0.2467535
## student 0.2452800
## hope 0.2443504
## self.quarantine 0.2382233
## free 0.2372889
## avoid 0.2368002
## accord 0.2367591
## citizen 0.2283238
## officer 0.2273154
## count 0.2220649
## thanks 0.2120993
## leverage 0.2026939
## data 0.2008792
## mind 0.2005162
## flatten 0.1989318
## federal 0.1932761
## night 0.1929967
## health 0.1927669
## increase 0.1925862
## outdoor 0.1893438
## sample 0.1881131
## workforce 0.1873698
## X1st 0.1863857
## organize 0.1823079
## america 0.1797633
## delegation 0.1785076
## reopening 0.1752913
## guidance 0.1717527
## room 0.1683584
## mandate 0.1677869
## prepare 0.1658367
## hospitalize 0.1645660
## drive.through 0.1636135
## day 0.1581940
## site 0.1574446
## economy 0.1531350
## procure 0.1526200
## impact 0.1502784
## diagnostic 0.1501489theme7## TC7
## proposal 0.7229290
## respond 0.7199661
## legislation 0.7199496
## meet 0.6763463
## mitigate 0.6378406
## minimize 0.6362278
## relief 0.6352707
## X4.4 0.6243777
## option 0.6158809
## prepare 0.6043606
## reach 0.5701980
## X2.2 0.5576719
## people 0.5451878
## delegation 0.5374914
## measure 0.5185409
## cdc 0.5173126
## deadline 0.5107590
## serve 0.4965902
## federal 0.4900247
## emergency 0.4803986
## house 0.4800999
## present 0.4674419
## thought 0.4666079
## goal 0.4546693
## personal 0.4296083
## commit 0.4119056
## pay 0.3938299
## country 0.3898070
## issue 0.3861294
## radio 0.3509543
## mean 0.3499761
## answer 0.3438292
## support 0.3434732
## operation 0.3427492
## hope 0.3404706
## small 0.3387671
## crowd 0.3261444
## responsibility 0.3252888
## senate 0.3199722
## launch 0.3087067
## national 0.3082347
## capacity 0.3039335
## year 0.3012246
## risk 0.2938200
## bill 0.2875524
## require 0.2863350
## X1.4 0.2861243
## affect 0.2845560
## president 0.2660477
## work 0.2528823
## grateful 0.2507836
## expand 0.2430653
## X1st 0.2426086
## gathering 0.2414614
## ensure 0.2403569
## large 0.2391428
## address 0.2358525
## care 0.2352466
## protect 0.2352262
## activate 0.2313529
## in.person 0.2281921
## fellow 0.2181180
## access 0.2142430
## telemedicine 0.2072134
## tonight 0.2039898
## leverage 0.1963871
## advisory 0.1950539
## burden 0.1931860
## hard 0.1919959
## diagnostic 0.1912252
## X2.500 0.1910119
## directive 0.1899508
## health 0.1880443
## result 0.1870837
## reduce 0.1854109
## service 0.1840578
## base 0.1833275
## individual 0.1797176
## time 0.1789910
## X500 0.1740564
## important 0.1715786
## restore 0.1704923
## future 0.1700852
## commercial 0.1700394
## daughter 0.1675259
## ongoing 0.1667003
## sample 0.1654166
## today 0.1618220
## lab 0.1602654
## administer 0.1587046
## call 0.1548831
## center 0.1538910
## safety 0.1528935
## announce 0.1519157
## covid 0.1511983
## spread 0.1511137theme8## TC8
## effective 0.3956302
## additional 0.3922965
## week 0.3908084
## update 0.3635717
## X1.000 0.3626176
## isolate 0.3588291
## positive 0.3486871
## federal 0.3425817
## X1st 0.3417997
## case 0.3328582
## conduct 0.3299301
## lab 0.3275584
## center 0.3175119
## X2.500 0.3171741
## operation 0.3054134
## base 0.2945606
## X.potus 0.2942927
## test 0.2922853
## fully 0.2872669
## implement 0.2868298
## full 0.2865331
## tomorrow 0.2822581
## total 0.2763400
## patient 0.2739554
## effort 0.2732077
## ongoing 0.2714554
## leverage 0.2701456
## X.covid19 0.2637733
## team 0.2625166
## force 0.2621727
## commercial 0.2539442
## conference 0.2535850
## daughter 0.2501696
## hold 0.2471096
## X500 0.2403055
## disaster 0.2397999
## recovery 0.2394282
## X24 0.2377300
## discuss 0.2373403
## opening 0.2358044
## diagnostic 0.2350680
## dr 0.2340692
## sample 0.2299781
## phone 0.2294579
## live 0.2292888
## recommendation 0.2281325
## join 0.2223835
## data 0.2202261
## plan 0.2182647
## urgent 0.2139743
## afternoon 0.2134826
## hospitalize 0.2089760
## burden 0.2081891
## response 0.2076229
## lost 0.2056827
## behalf 0.2056240
## approve 0.2035914
## task 0.1983072
## night 0.1974287
## affect 0.1971031
## room 0.1962500
## america 0.1943313
## member 0.1925717
## activate 0.1925187
## X2.30 0.1850621
## visitor 0.1837832
## provide 0.1827344
## directive 0.1825255
## school 0.1808201
## project 0.1800520
## locate 0.1793332
## confirm 0.1787324
## collection 0.1779048
## model 0.1771224
## attend 0.1768300
## significant 0.1764324
## watch 0.1757133
## break. 0.1748394
## condolence 0.1746662
## combat 0.1734466
## require 0.1729291
## mitigation 0.1721960
## represent 0.1703163
## number 0.1700275
## online 0.1677737
## increase 0.1674154
## guideline 0.1660227
## administer 0.1600066
## in.person 0.1597059
## report 0.1572628
## activity 0.1572072
## worship 0.1570116
## individual 0.1564732
## read 0.1542237
## contract 0.1535953
## economic 0.1530489
## mind 0.1513727
## request 0.1502409
## assist 0.1500841theme9## TC9
## throw 0.6807898
## answer 0.6615521
## represent 0.6379130
## attend 0.6358260
## question 0.5936175
## telehealth 0.5711106
## country 0.5679468
## X1.5 0.5317475
## X.vp 0.5152852
## top 0.5144504
## tomorrow 0.5118783
## talk 0.5111774
## model 0.5065269
## unemployment 0.4856789
## reply 0.4799110
## pay 0.4729934
## project 0.4720702
## president 0.4665682
## accurate 0.4659619
## peak 0.4602704
## X2.500 0.4348402
## benefit 0.4104417
## hope 0.4101491
## crisis 0.4014661
## sign 0.3977815
## afternoon 0.3918525
## implement 0.3776894
## word 0.3766734
## meeting 0.3753908
## small 0.3715498
## base 0.3670778
## bill 0.3566579
## plan 0.3494547
## sure 0.3458535
## noon 0.3365103
## right 0.3362621
## discuss 0.3360179
## join 0.3216443
## happy 0.3095313
## look 0.3083454
## resource 0.2969876
## healthy 0.2962070
## time 0.2900204
## america 0.2828135
## mean 0.2810159
## hallway 0.2780613
## dr 0.2778298
## birthday 0.2714332
## business 0.2710429
## veteran 0.2677152
## people 0.2630799
## file 0.2611105
## national 0.2592557
## town 0.2550208
## X1.000 0.2521818
## safe 0.2507560
## X2nd 0.2453571
## recommendation 0.2363971
## owner 0.2170100
## house 0.2163252
## select 0.2141794
## pm 0.2035159
## X1.500 0.2035141
## surplus 0.2023008
## foot 0.2013791
## adequate 0.1963624
## finish 0.1961816
## gathering 0.1899414
## issue 0.1894380
## follow 0.1840999
## mail 0.1836775
## post 0.1793686
## change 0.1752939
## economy 0.1743098
## priority 0.1718639
## employee 0.1703150
## share 0.1673770
## great 0.1666849
## propose 0.1662591
## strategy 0.1637406
## faith 0.1622870
## screen 0.1576815
## submit 0.1566753
## response 0.1564521
## negatively 0.1552010
## campaign 0.1533243theme10## TC10
## urgent 0.6890968
## symptom 0.5469890
## task 0.5057978
## remotely 0.4943919
## X1st 0.4789604
## force 0.4682223
## payment 0.4585178
## demand 0.4584400
## recommendation 0.4325700
## pay 0.4196174
## travel 0.4015248
## heal 0.3958152
## test 0.3894650
## increase 0.3766675
## directive 0.3673875
## year 0.3543821
## treat 0.3535905
## party 0.3498658
## finish 0.3438387
## patient 0.3406216
## form 0.3394274
## data 0.3375184
## capacity 0.3338721
## isolate 0.3314039
## social 0.3258954
## close 0.3202292
## room 0.3199797
## park 0.3161656
## distance 0.3115149
## daughter 0.3099398
## see 0.3005867
## require 0.3003063
## time 0.2925271
## risk 0.2875402
## group 0.2854845
## sure 0.2789627
## sample 0.2787490
## reduce 0.2735455
## diagnostic 0.2713572
## symptomatic 0.2705214
## covid 0.2676916
## follow 0.2676562
## owner 0.2676026
## start 0.2670775
## current 0.2644545
## locate 0.2639408
## qualify 0.2616474
## surplus 0.2600849
## collection 0.2560417
## word 0.2535094
## X1.500 0.2512358
## campaign 0.2503133
## save 0.2484252
## happy 0.2462900
## drive.through 0.2454749
## leverage 0.2413501
## X500 0.2410835
## sick 0.2392034
## maintain 0.2348751
## free 0.2323913
## place 0.2300290
## X2.500 0.2260354
## veteran 0.2244926
## trend 0.2237455
## cough 0.2222017
## adequate 0.2202796
## employee 0.2197575
## doctor 0.2186463
## hospital 0.2172593
## worker 0.2166053
## population 0.2149592
## important 0.2137313
## lift 0.2120754
## deadline 0.2119904
## birthday 0.2118516
## visit 0.2108118
## model 0.2102432
## house 0.2089139
## practice 0.2061924
## large 0.2042692
## X.fema 0.1995157
## mail 0.1976531
## activate 0.1960744
## tax 0.1942386
## family 0.1939291
## X24 0.1898723
## effective 0.1891981
## order 0.1880062
## hope 0.1879042
## confidence 0.1850612
## learn 0.1838996
## create 0.1832500
## day 0.1829161
## unnecessary 0.1776827
## expand 0.1703095
## participate 0.1665359
## contract 0.1658719
## select 0.1638828
## due 0.1635011
## surface 0.1622835
## personal 0.1617117
## protection 0.1615922
## condolence 0.1570123
## right 0.1526924
## guide 0.1503560
## prevent 0.1500048Adequate solution
- Examine the fit indices of your two solutions. Which solution has better fit indices?
- ANSWER: The 10 component solution better fits with the indices, The RMS value for 10 components (0.102) is lower than 5 component solution (0.122). The TLI ( Tucker lewis index ) is for 10 component solution is higher than 5 component solution.
# RMS
fa.stats(df[,7:ncol(df)],f = comp1)$rms## [1] 0.1222371fa.stats(df[,7:ncol(df)],f = comp10)$rms## [1] 0.102106# RMSEA
fa.stats(df[,7:ncol(df)],f = comp1)$RMSEA ## RMSEA lower upper confidence
## 0.00 0.00 0.00 0.95fa.stats(df[,7:ncol(df)],f = comp10)$RMSEA ## RMSEA lower upper confidence
## 0.00 0.00 0.00 0.95#TLI
fa.stats(df[,7:ncol(df)],f = comp1)$TLI## [1] 0.3634197fa.stats(df[,7:ncol(df)],f = comp10)$TLI## [1] 0.5139971Themes
Pick what you think is the best solution (based primarily on interpretability). Print the themes in the r chunk below. What labels would you give the themes? How would you describe each theme? Provide both a label for each theme and a longer description of what each seems to be capturing.
- ANSWER: Theme1 ( forecast ): Since the theme-1 has words like forecast , peak , resurgence , consistent etc, which are more about predicting the pandemic. Theme2 (social distance) : Since the theme-2 has words like social , distance , spread , visit , week etc. This talks more about the spread of the pandemic. Theme3 ( activity ) : Since the theme-3 has words like activity , business , restore ,customer , economic , telemedicine etc Theme4 ( health care ): As it has words like physician , doctor , cough , improve , self quarantine , drive thru Theme5 ( professions ): As it has words like student, executive , agency , nurse , department , official etc.Most of these represent various sectors of people. Theme6 ( patient priority ) : As it has words like patient , prioritize , healthy , vulnerable etc. This talks more about people who are more vulnerable Theme7 ( mitigation ) : As it has words like mitigate , minimize , relief , respond , serve , measure etc Theme8 ( diagnostics) : As it has words like lab , base , test , recovery etc Theme9 ( covid questions and answers ): It has questions about covid statistics like telehealth, model , unemployment and words like questions, answers. Theme10 ( covid expenditure) : As it has words like pay , payment , task , demand etc.
##r chunk
theme1 #forecast ## TC1
## committee 0.9235511
## rainy 0.9099071
## forecast 0.8846307
## X165 0.8741737
## reflect 0.8730880
## media 0.8570526
## passage 0.8207627
## X118 0.8203670
## examine 0.8059649
## fashion 0.7950601
## resurgence 0.7939747
## liability 0.7897083
## walking 0.7870835
## responsive 0.7858201
## native 0.7655008
## bear 0.7185270
## extraordinary 0.7183093
## consistent 0.7109974
## peak 0.7063759
## commend 0.7008545
## central 0.6985779
## fellowship 0.6740634
## spring 0.6547824
## initiative 0.6443359
## provide 0.6241185
## lower 0.6110852
## symptomatic 0.6066153
## fish 0.6065055
## hike 0.6064798
## fought 0.5969328
## suggestion 0.5726204
## evaluate 0.5724752
## article 0.5671166
## organize 0.5618500
## X1.30 0.5521812
## out.of.state 0.5458904
## chairman 0.5402482
## quest 0.5312648
## session 0.5299650
## suspect 0.5296934
## advisory 0.5213500
## fever 0.4978400
## breath 0.4970064
## governor 0.4893340
## circumstance 0.4856991
## leverage 0.4856025
## creation 0.4848888
## daughter 0.4825866
## surplus 0.4723382
## frequently 0.4718626
## X.2020census 0.4706096
## midnight 0.4661450
## tornado 0.4600202
## X1.500 0.4600007
## longer 0.4473658
## congregation 0.4460634
## X1.3 0.4414450
## discourage 0.4277715
## park 0.4253462
## news 0.4250854
## adequate 0.4248586
## tweet 0.4227929
## propose 0.4165586
## X500 0.4099902
## strategy 0.4023321
## X.fema 0.3977733
## pm 0.3972669
## mail 0.3946889
## short 0.3933434
## hold 0.3893264
## X2.3 0.3889840
## assist 0.3855911
## louis 0.3844091
## outdoor 0.3756018
## foot 0.3603343
## heal 0.3578446
## X1st 0.3475667
## conference 0.3451570
## party 0.3388413
## arrive 0.3375924
## participate 0.3361283
## procure 0.3355978
## careful 0.3328847
## X1.4 0.3250078
## lift 0.3191986
## short.term 0.3140846
## project 0.3136215
## imminent 0.3064819
## present 0.3039568
## institute 0.3035059
## surface 0.3008627
## X250 0.2964916
## accord 0.2891952
## pursue 0.2868636
## portal 0.2837805
## designate 0.2836476
## response 0.2831205
## shortness 0.2816404
## X4.4 0.2797471
## current 0.2796804
## X2.2 0.2791292
## today 0.2788559
## industry 0.2783997
## campaign 0.2747404
## guideline 0.2739242
## spirit 0.2721200
## radio 0.2694623
## sample 0.2692736
## nationwide 0.2671973
## phone 0.2652549
## exceed 0.2641595
## behalf 0.2639902
## remotely 0.2624279
## update 0.2561553
## week 0.2557456
## mind 0.2494608
## touch 0.2452865
## negatively 0.2424818
## cough 0.2410131
## avoid 0.2407269
## count 0.2379312
## senate 0.2372405
## X.walmart 0.2252666
## mindful 0.2231704
## institution 0.2217586
## finish 0.2172246
## condolence 0.2171807
## X3.3 0.2163225
## diagnostic 0.2143557
## veteran 0.2134546
## year 0.2114182
## number 0.2114096
## X27 0.2105569
## commercial 0.2100531
## space 0.2061080
## rise 0.2060659
## unnecessary 0.2059877
## operation 0.2024573
## covid 0.2020026
## customer 0.2011545
## throw 0.2010048
## birthday 0.1990925
## sector 0.1961158
## burden 0.1945697
## cdc 0.1943055
## represent 0.1891735
## locate 0.1883746
## recommendation 0.1880186
## directly 0.1867743
## telemedicine 0.1867694
## member 0.1858209
## prioritize 0.1848967
## reach 0.1846716
## blood 0.1831136
## break. 0.1808238
## thought 0.1807290
## large 0.1797397
## officer 0.1796591
## gathering 0.1791939
## crisis 0.1782513
## isolation 0.1707016
## tourism 0.1693021
## revenue 0.1682543
## threat 0.1673434
## X24 0.1657561
## administer 0.1656161
## task 0.1647201
## activity 0.1626721
## safety 0.1614650
## select 0.1608357
## fully 0.1592769
## front.line 0.1576683
## reply 0.1554210
## contract 0.1533864
## develop 0.1533143
## mandate 0.1515803
## guard 0.1513017
## approve 0.1507148
## special 0.1506254
## watch 0.1500058theme2 # social distance## TC2
## time 0.2793061
## thank 0.2180960
## pandemic 0.2156158
## spread 0.2130738
## close 0.2098678
## visit 0.2034540
## week 0.1999497
## social 0.1941404
## business 0.1919161
## family 0.1913542
## plan 0.1910088
## school 0.1873392
## call 0.1848707
## right 0.1836375
## protect 0.1825469
## public 0.1820694
## issue 0.1818899
## due 0.1818241
## measure 0.1784687
## order 0.1772306
## member 0.1742753
## important 0.1727117
## give 0.1721096
## extend 0.1703708
## slow 0.1683907
## X3.3 0.1683288
## number 0.1680799
## information 0.1678048
## stay 0.1650246
## vulnerable 0.1643226
## join 0.1639973
## state 0.1629361
## distance 0.1626994
## economic 0.1621696
## learn 0.1607847
## worker 0.1602289
## X2nd 0.1580645
## disaster 0.1579498
## place 0.1572853
## face 0.1571506
## case 0.1555368
## count 0.1535280
## guidance 0.1533407
## friend 0.1528992
## community 0.1521827
## urllink 0.1519785
## task 0.1510410
## surge 0.1503788theme3 # activity ## TC3
## open 0.6118101
## employment 0.5850899
## partnership 0.5787658
## leader 0.5497330
## resource 0.5457966
## expand 0.5456781
## worship 0.5372199
## activity 0.5361261
## protocol 0.5358835
## serve 0.5349622
## customer 0.5348469
## restore 0.5327388
## burden 0.5248908
## business 0.5177687
## child 0.4977995
## facility 0.4922627
## access 0.4756194
## thanks 0.4660702
## safety 0.4514753
## drive.through 0.4475316
## site 0.4268192
## recovery 0.4227494
## collection 0.4191807
## free 0.4174380
## economic 0.4049981
## support 0.3999632
## telemedicine 0.3956569
## guidance 0.3931545
## strategy 0.3866400
## hard 0.3843199
## effect 0.3811637
## assistance 0.3801835
## unemployment 0.3770816
## urllink 0.3720494
## opening 0.3669173
## capacity 0.3640066
## service 0.3608567
## team 0.3607239
## commit 0.3603178
## assist 0.3496527
## work 0.3467347
## continue 0.3449352
## church 0.3425068
## long.term 0.3412234
## respond 0.3401854
## allow 0.3378850
## small 0.3358875
## pursue 0.3292118
## exceed 0.3250711
## guideline 0.3222258
## administer 0.3209916
## locate 0.3149877
## partner 0.3144304
## institution 0.3126484
## benefit 0.3113538
## front.line 0.3064795
## weekend 0.3046761
## spirit 0.3025727
## force 0.3024908
## protection 0.3016029
## rural 0.2939945
## priority 0.2938321
## disaster 0.2931539
## issue 0.2916757
## threat 0.2873702
## faith 0.2863241
## town 0.2841728
## model 0.2812551
## minimize 0.2785398
## option 0.2757923
## request 0.2757165
## online 0.2744757
## sacrifice 0.2730906
## tornado 0.2710449
## select 0.2684962
## owner 0.2659840
## gathering 0.2656962
## ensure 0.2635402
## affect 0.2629644
## submit 0.2625452
## change 0.2610020
## offer 0.2600041
## group 0.2592127
## federal 0.2569941
## launch 0.2560566
## executive 0.2525276
## ongoing 0.2490591
## contract 0.2489299
## restaurant 0.2458906
## department 0.2445133
## worker 0.2443087
## base 0.2434251
## implement 0.2423199
## year 0.2417359
## encourage 0.2385373
## quest 0.2378352
## house 0.2361780
## portal 0.2298835
## school 0.2262469
## short.term 0.2259477
## telehealth 0.2257799
## happy 0.2227375
## develop 0.2192919
## blood 0.2185843
## vulnerable 0.2184132
## effort 0.2175277
## restriction 0.2160106
## imminent 0.2131584
## employee 0.2116802
## fully 0.2111937
## safe 0.2104389
## provide 0.2097835
## combat 0.2064397
## timely 0.2053630
## face 0.2034092
## initiative 0.2027852
## industry 0.2023102
## veteran 0.2008273
## social 0.1966928
## health 0.1962939
## bill 0.1956870
## website 0.1953211
## lift 0.1947477
## care 0.1937099
## X2.3 0.1933163
## X250 0.1929939
## top 0.1928701
## learn 0.1892926
## ease 0.1867502
## birthday 0.1859660
## guard 0.1821129
## unnecessary 0.1815114
## inform 0.1792058
## pandemic 0.1785937
## clean 0.1767585
## senate 0.1767224
## mitigate 0.1761776
## approve 0.1727273
## in.person 0.1721029
## fellowship 0.1674706
## crisis 0.1674143
## consider 0.1663581
## drive.thru 0.1632662
## hallway 0.1611399
## special 0.1601992
## start 0.1592376
## order 0.1525616
## surge 0.1520136theme4 # health care## TC4
## X5.00 0.8230090
## expose 0.8156934
## successful 0.8131082
## X.nationaldoctorsday 0.8065400
## dedication 0.7795046
## communication 0.7464719
## physician 0.7202490
## meeting 0.7167441
## faucus 0.7096199
## appreciate 0.6963272
## form 0.6717344
## X7pm 0.6168400
## drive.thru 0.5710901
## consider 0.5601908
## doctor 0.5304305
## self.quarantine 0.5081550
## pm 0.4902106
## improve 0.4860222
## significant 0.4713876
## activate 0.4675321
## regard 0.4632331
## effect 0.4516859
## afternoon 0.4372804
## site 0.4271170
## news 0.4250206
## opening 0.4219682
## effort 0.4045383
## cough 0.4022625
## great 0.3952195
## president 0.3942565
## approve 0.3906942
## direct 0.3886679
## provider 0.3701089
## dr 0.3640048
## cdc 0.3551027
## X.potus 0.3549168
## recommendation 0.3517660
## require 0.3515012
## X.realdonaldtrump 0.3453502
## today 0.3421164
## fight 0.3266989
## individual 0.3220383
## educator 0.3139656
## drive.through 0.2985053
## full 0.2803312
## discuss 0.2780507
## thank 0.2749472
## serve 0.2718065
## combat 0.2622332
## healthy 0.2550454
## urllink 0.2470100
## establish 0.2410114
## disaster 0.2397475
## test 0.2338745
## population 0.2324685
## extend 0.2301198
## responder 0.2295129
## grateful 0.2265262
## X.covid19 0.2125295
## resource 0.2103048
## thanks 0.2060604
## day 0.2055801
## travel 0.2054850
## visit 0.2053435
## watch 0.2005344
## prevent 0.1976005
## executive 0.1939342
## tomorrow 0.1862428
## right 0.1848753
## expand 0.1848748
## symptom 0.1815999
## current 0.1703285
## encourage 0.1629344
## general 0.1518144
## project 0.1506395
## vulnerable 0.1504189theme5 # professions## TC5
## pass 0.8446224
## assembly 0.8347631
## suspend 0.8267246
## temporarily 0.8077751
## general 0.8032281
## virus 0.7974891
## prevent 0.7155267
## win 0.6733110
## X1.2 0.6700936
## service 0.6553060
## crowd 0.6506801
## order 0.6467309
## develop 0.6291922
## visitor 0.6109350
## X1.3 0.6059650
## direct 0.5910693
## request 0.5669645
## student 0.5272288
## leave 0.5179894
## executive 0.4682407
## agency 0.4475494
## nurse 0.4401217
## school 0.4133453
## combat 0.4030880
## emergency 0.4025811
## response 0.4024937
## ensure 0.3962064
## due 0.3753147
## neighbor 0.3491202
## employee 0.3483910
## X.realdonaldtrump 0.3458692
## X.vp 0.3346776
## state 0.3294944
## follow 0.3217332
## department 0.3209054
## allow 0.3138780
## public 0.3020305
## period 0.2967917
## thank 0.2894872
## issue 0.2894826
## create 0.2747442
## official 0.2674908
## website 0.2522942
## relate 0.2310377
## report 0.2296213
## family 0.2226370
## effort 0.2114478
## arrive 0.2036950
## sign 0.2027972
## save 0.1983148
## educator 0.1962448
## confidence 0.1881508
## close 0.1805024
## qualify 0.1752443
## covid 0.1603105
## tax 0.1600549
## fund 0.1581823
## day 0.1507919theme6 # patient priority ## TC6
## enhance 0.6926909
## prioritize 0.6523564
## discourage 0.6081112
## private 0.5961493
## timely 0.5959202
## population 0.5808907
## X.realdonaldtrump 0.5377254
## doctor 0.5270455
## partner 0.5231561
## vulnerable 0.5149907
## future 0.5004789
## medical 0.4891682
## surge 0.4690389
## sector 0.4679933
## rural 0.4654426
## industry 0.4556290
## safe 0.4555097
## reduce 0.4297915
## nurse 0.4075829
## family 0.4009275
## healthy 0.3933003
## hospital 0.3819743
## great 0.3781951
## patient 0.3649056
## work 0.3621721
## join 0.3474860
## capacity 0.3443964
## country 0.3429948
## president 0.3423263
## ensure 0.3316890
## town 0.3292591
## grateful 0.3206255
## top 0.3126524
## expand 0.3108270
## number 0.3060584
## safety 0.3058619
## test 0.3013824
## gt 0.2950642
## guard 0.2836674
## win 0.2824957
## long.term 0.2739711
## close 0.2698969
## fully 0.2692868
## leader 0.2656228
## begin 0.2578022
## guide 0.2572488
## administer 0.2564005
## X.vp 0.2545591
## isolate 0.2521765
## continue 0.2507008
## facility 0.2478533
## large 0.2467535
## student 0.2452800
## hope 0.2443504
## self.quarantine 0.2382233
## free 0.2372889
## avoid 0.2368002
## accord 0.2367591
## citizen 0.2283238
## officer 0.2273154
## count 0.2220649
## thanks 0.2120993
## leverage 0.2026939
## data 0.2008792
## mind 0.2005162
## flatten 0.1989318
## federal 0.1932761
## night 0.1929967
## health 0.1927669
## increase 0.1925862
## outdoor 0.1893438
## sample 0.1881131
## workforce 0.1873698
## X1st 0.1863857
## organize 0.1823079
## america 0.1797633
## delegation 0.1785076
## reopening 0.1752913
## guidance 0.1717527
## room 0.1683584
## mandate 0.1677869
## prepare 0.1658367
## hospitalize 0.1645660
## drive.through 0.1636135
## day 0.1581940
## site 0.1574446
## economy 0.1531350
## procure 0.1526200
## impact 0.1502784
## diagnostic 0.1501489theme7 # mitigation ## TC7
## proposal 0.7229290
## respond 0.7199661
## legislation 0.7199496
## meet 0.6763463
## mitigate 0.6378406
## minimize 0.6362278
## relief 0.6352707
## X4.4 0.6243777
## option 0.6158809
## prepare 0.6043606
## reach 0.5701980
## X2.2 0.5576719
## people 0.5451878
## delegation 0.5374914
## measure 0.5185409
## cdc 0.5173126
## deadline 0.5107590
## serve 0.4965902
## federal 0.4900247
## emergency 0.4803986
## house 0.4800999
## present 0.4674419
## thought 0.4666079
## goal 0.4546693
## personal 0.4296083
## commit 0.4119056
## pay 0.3938299
## country 0.3898070
## issue 0.3861294
## radio 0.3509543
## mean 0.3499761
## answer 0.3438292
## support 0.3434732
## operation 0.3427492
## hope 0.3404706
## small 0.3387671
## crowd 0.3261444
## responsibility 0.3252888
## senate 0.3199722
## launch 0.3087067
## national 0.3082347
## capacity 0.3039335
## year 0.3012246
## risk 0.2938200
## bill 0.2875524
## require 0.2863350
## X1.4 0.2861243
## affect 0.2845560
## president 0.2660477
## work 0.2528823
## grateful 0.2507836
## expand 0.2430653
## X1st 0.2426086
## gathering 0.2414614
## ensure 0.2403569
## large 0.2391428
## address 0.2358525
## care 0.2352466
## protect 0.2352262
## activate 0.2313529
## in.person 0.2281921
## fellow 0.2181180
## access 0.2142430
## telemedicine 0.2072134
## tonight 0.2039898
## leverage 0.1963871
## advisory 0.1950539
## burden 0.1931860
## hard 0.1919959
## diagnostic 0.1912252
## X2.500 0.1910119
## directive 0.1899508
## health 0.1880443
## result 0.1870837
## reduce 0.1854109
## service 0.1840578
## base 0.1833275
## individual 0.1797176
## time 0.1789910
## X500 0.1740564
## important 0.1715786
## restore 0.1704923
## future 0.1700852
## commercial 0.1700394
## daughter 0.1675259
## ongoing 0.1667003
## sample 0.1654166
## today 0.1618220
## lab 0.1602654
## administer 0.1587046
## call 0.1548831
## center 0.1538910
## safety 0.1528935
## announce 0.1519157
## covid 0.1511983
## spread 0.1511137theme8 # diagnostics## TC8
## effective 0.3956302
## additional 0.3922965
## week 0.3908084
## update 0.3635717
## X1.000 0.3626176
## isolate 0.3588291
## positive 0.3486871
## federal 0.3425817
## X1st 0.3417997
## case 0.3328582
## conduct 0.3299301
## lab 0.3275584
## center 0.3175119
## X2.500 0.3171741
## operation 0.3054134
## base 0.2945606
## X.potus 0.2942927
## test 0.2922853
## fully 0.2872669
## implement 0.2868298
## full 0.2865331
## tomorrow 0.2822581
## total 0.2763400
## patient 0.2739554
## effort 0.2732077
## ongoing 0.2714554
## leverage 0.2701456
## X.covid19 0.2637733
## team 0.2625166
## force 0.2621727
## commercial 0.2539442
## conference 0.2535850
## daughter 0.2501696
## hold 0.2471096
## X500 0.2403055
## disaster 0.2397999
## recovery 0.2394282
## X24 0.2377300
## discuss 0.2373403
## opening 0.2358044
## diagnostic 0.2350680
## dr 0.2340692
## sample 0.2299781
## phone 0.2294579
## live 0.2292888
## recommendation 0.2281325
## join 0.2223835
## data 0.2202261
## plan 0.2182647
## urgent 0.2139743
## afternoon 0.2134826
## hospitalize 0.2089760
## burden 0.2081891
## response 0.2076229
## lost 0.2056827
## behalf 0.2056240
## approve 0.2035914
## task 0.1983072
## night 0.1974287
## affect 0.1971031
## room 0.1962500
## america 0.1943313
## member 0.1925717
## activate 0.1925187
## X2.30 0.1850621
## visitor 0.1837832
## provide 0.1827344
## directive 0.1825255
## school 0.1808201
## project 0.1800520
## locate 0.1793332
## confirm 0.1787324
## collection 0.1779048
## model 0.1771224
## attend 0.1768300
## significant 0.1764324
## watch 0.1757133
## break. 0.1748394
## condolence 0.1746662
## combat 0.1734466
## require 0.1729291
## mitigation 0.1721960
## represent 0.1703163
## number 0.1700275
## online 0.1677737
## increase 0.1674154
## guideline 0.1660227
## administer 0.1600066
## in.person 0.1597059
## report 0.1572628
## activity 0.1572072
## worship 0.1570116
## individual 0.1564732
## read 0.1542237
## contract 0.1535953
## economic 0.1530489
## mind 0.1513727
## request 0.1502409
## assist 0.1500841theme9 # covid questions and answers## TC9
## throw 0.6807898
## answer 0.6615521
## represent 0.6379130
## attend 0.6358260
## question 0.5936175
## telehealth 0.5711106
## country 0.5679468
## X1.5 0.5317475
## X.vp 0.5152852
## top 0.5144504
## tomorrow 0.5118783
## talk 0.5111774
## model 0.5065269
## unemployment 0.4856789
## reply 0.4799110
## pay 0.4729934
## project 0.4720702
## president 0.4665682
## accurate 0.4659619
## peak 0.4602704
## X2.500 0.4348402
## benefit 0.4104417
## hope 0.4101491
## crisis 0.4014661
## sign 0.3977815
## afternoon 0.3918525
## implement 0.3776894
## word 0.3766734
## meeting 0.3753908
## small 0.3715498
## base 0.3670778
## bill 0.3566579
## plan 0.3494547
## sure 0.3458535
## noon 0.3365103
## right 0.3362621
## discuss 0.3360179
## join 0.3216443
## happy 0.3095313
## look 0.3083454
## resource 0.2969876
## healthy 0.2962070
## time 0.2900204
## america 0.2828135
## mean 0.2810159
## hallway 0.2780613
## dr 0.2778298
## birthday 0.2714332
## business 0.2710429
## veteran 0.2677152
## people 0.2630799
## file 0.2611105
## national 0.2592557
## town 0.2550208
## X1.000 0.2521818
## safe 0.2507560
## X2nd 0.2453571
## recommendation 0.2363971
## owner 0.2170100
## house 0.2163252
## select 0.2141794
## pm 0.2035159
## X1.500 0.2035141
## surplus 0.2023008
## foot 0.2013791
## adequate 0.1963624
## finish 0.1961816
## gathering 0.1899414
## issue 0.1894380
## follow 0.1840999
## mail 0.1836775
## post 0.1793686
## change 0.1752939
## economy 0.1743098
## priority 0.1718639
## employee 0.1703150
## share 0.1673770
## great 0.1666849
## propose 0.1662591
## strategy 0.1637406
## faith 0.1622870
## screen 0.1576815
## submit 0.1566753
## response 0.1564521
## negatively 0.1552010
## campaign 0.1533243theme10 # covid expenditure ## TC10
## urgent 0.6890968
## symptom 0.5469890
## task 0.5057978
## remotely 0.4943919
## X1st 0.4789604
## force 0.4682223
## payment 0.4585178
## demand 0.4584400
## recommendation 0.4325700
## pay 0.4196174
## travel 0.4015248
## heal 0.3958152
## test 0.3894650
## increase 0.3766675
## directive 0.3673875
## year 0.3543821
## treat 0.3535905
## party 0.3498658
## finish 0.3438387
## patient 0.3406216
## form 0.3394274
## data 0.3375184
## capacity 0.3338721
## isolate 0.3314039
## social 0.3258954
## close 0.3202292
## room 0.3199797
## park 0.3161656
## distance 0.3115149
## daughter 0.3099398
## see 0.3005867
## require 0.3003063
## time 0.2925271
## risk 0.2875402
## group 0.2854845
## sure 0.2789627
## sample 0.2787490
## reduce 0.2735455
## diagnostic 0.2713572
## symptomatic 0.2705214
## covid 0.2676916
## follow 0.2676562
## owner 0.2676026
## start 0.2670775
## current 0.2644545
## locate 0.2639408
## qualify 0.2616474
## surplus 0.2600849
## collection 0.2560417
## word 0.2535094
## X1.500 0.2512358
## campaign 0.2503133
## save 0.2484252
## happy 0.2462900
## drive.through 0.2454749
## leverage 0.2413501
## X500 0.2410835
## sick 0.2392034
## maintain 0.2348751
## free 0.2323913
## place 0.2300290
## X2.500 0.2260354
## veteran 0.2244926
## trend 0.2237455
## cough 0.2222017
## adequate 0.2202796
## employee 0.2197575
## doctor 0.2186463
## hospital 0.2172593
## worker 0.2166053
## population 0.2149592
## important 0.2137313
## lift 0.2120754
## deadline 0.2119904
## birthday 0.2118516
## visit 0.2108118
## model 0.2102432
## house 0.2089139
## practice 0.2061924
## large 0.2042692
## X.fema 0.1995157
## mail 0.1976531
## activate 0.1960744
## tax 0.1942386
## family 0.1939291
## X24 0.1898723
## effective 0.1891981
## order 0.1880062
## hope 0.1879042
## confidence 0.1850612
## learn 0.1838996
## create 0.1832500
## day 0.1829161
## unnecessary 0.1776827
## expand 0.1703095
## participate 0.1665359
## contract 0.1658719
## select 0.1638828
## due 0.1635011
## surface 0.1622835
## personal 0.1617117
## protection 0.1615922
## condolence 0.1570123
## right 0.1526924
## guide 0.1503560
## prevent 0.1500048Group Differences
Create theme scores for your best solution.
Examine the differences between Democrats and Republicans. Include summary statistics and t-test results. Be sure to interpret the t-test results in the following question
What themes are used more often by either Democratic or Republican governors?
- ANSWER: Though there is no big difference in the usage of the themes , Theme1 , Theme2 , Theme3 , Theme4 , Theme5 , Theme6 , Theme8 , Theme9 are more used by republicans , where as Theme7 and Theme10 are more used by democrats. But the difference is very little in either ways. May be with this we could say that democrats were talking about mitigation plan and the expenditure associated with the pandemic little more compared to republicans.
df$Theme1 = apply(df[,row.names(theme1)], MARGIN = 1, sum)
df$Theme2 = apply(df[,row.names(theme2)], MARGIN = 1, sum)
df$Theme3 = apply(df[,row.names(theme3)], MARGIN = 1, sum)
df$Theme4 = apply(df[,row.names(theme4)], MARGIN = 1, sum)
df$Theme5 = apply(df[,row.names(theme5)], MARGIN = 1, sum)
df$Theme6 = apply(df[,row.names(theme6)], MARGIN = 1, sum)
df$Theme7 = apply(df[,row.names(theme7)], MARGIN = 1, sum)
df$Theme8 = apply(df[,row.names(theme8)], MARGIN = 1, sum)
df$Theme9 = apply(df[,row.names(theme9)], MARGIN = 1, sum)
df$Theme10 = apply(df[,row.names(theme10)], MARGIN = 1, sum)
wilcox.test(df$Theme1~df$Party)##
## Wilcoxon rank sum exact test
##
## data: df$Theme1 by df$Party
## W = 227, p-value = 0.1533
## alternative hypothesis: true location shift is not equal to 0wilcox.test(df$Theme2~df$Party)##
## Wilcoxon rank sum exact test
##
## data: df$Theme2 by df$Party
## W = 269, p-value = 0.5578
## alternative hypothesis: true location shift is not equal to 0wilcox.test(df$Theme3~df$Party)##
## Wilcoxon rank sum exact test
##
## data: df$Theme3 by df$Party
## W = 219, p-value = 0.1118
## alternative hypothesis: true location shift is not equal to 0wilcox.test(df$Theme4~df$Party)##
## Wilcoxon rank sum exact test
##
## data: df$Theme4 by df$Party
## W = 161, p-value = 0.005146
## alternative hypothesis: true location shift is not equal to 0wilcox.test(df$Theme5~df$Party)##
## Wilcoxon rank sum exact test
##
## data: df$Theme5 by df$Party
## W = 313, p-value = 0.7887
## alternative hypothesis: true location shift is not equal to 0wilcox.test(df$Theme6~df$Party)##
## Wilcoxon rank sum exact test
##
## data: df$Theme6 by df$Party
## W = 308, p-value = 0.866
## alternative hypothesis: true location shift is not equal to 0wilcox.test(df$Theme7~df$Party)##
## Wilcoxon rank sum exact test
##
## data: df$Theme7 by df$Party
## W = 342, p-value = 0.3979
## alternative hypothesis: true location shift is not equal to 0wilcox.test(df$Theme8~df$Party)##
## Wilcoxon rank sum exact test
##
## data: df$Theme8 by df$Party
## W = 179, p-value = 0.0157
## alternative hypothesis: true location shift is not equal to 0wilcox.test(df$Theme9~df$Party)##
## Wilcoxon rank sum exact test
##
## data: df$Theme9 by df$Party
## W = 241, p-value = 0.2519
## alternative hypothesis: true location shift is not equal to 0wilcox.test(df$Theme10~df$Party)##
## Wilcoxon rank sum exact test
##
## data: df$Theme10 by df$Party
## W = 362, p-value = 0.2126
## alternative hypothesis: true location shift is not equal to 0describeBy(df[,c('Theme1','Theme2','Theme3','Theme4','Theme5','Theme6','Theme7','Theme8','Theme9','Theme10')], df$Party)##
## Descriptive statistics by group
## group: D
## vars n mean sd median trimmed mad min max range skew kurtosis
## Theme1 1 23 4.71 1.41 4.81 4.73 1.10 1.98 7.28 5.30 -0.14 -0.69
## Theme2 2 23 8.05 2.26 8.54 8.14 1.94 1.59 13.33 11.75 -0.49 1.52
## Theme3 3 23 8.25 1.87 8.62 8.30 2.24 4.63 11.13 6.50 -0.19 -1.11
## Theme4 4 23 6.85 2.40 6.44 6.61 2.13 3.56 13.13 9.58 0.92 0.30
## Theme5 5 23 5.23 1.48 5.84 5.43 0.76 1.48 6.67 5.20 -1.15 0.05
## Theme6 6 23 4.38 1.03 4.25 4.38 1.03 2.50 6.22 3.72 -0.02 -0.85
## Theme7 7 23 7.24 2.76 7.41 7.03 1.40 3.03 16.84 13.81 1.47 3.94
## Theme8 8 23 5.66 2.97 5.25 5.61 3.36 0.44 11.35 10.91 0.19 -1.18
## Theme9 9 23 2.92 1.17 3.12 2.97 1.52 0.44 4.76 4.31 -0.25 -0.74
## Theme10 10 23 5.35 1.48 5.17 5.31 1.31 2.87 8.54 5.67 0.22 -0.67
## se
## Theme1 0.29
## Theme2 0.47
## Theme3 0.39
## Theme4 0.50
## Theme5 0.31
## Theme6 0.21
## Theme7 0.58
## Theme8 0.62
## Theme9 0.24
## Theme10 0.31
## ------------------------------------------------------------
## group: R
## vars n mean sd median trimmed mad min max range skew kurtosis
## Theme1 1 26 5.91 3.40 5.51 5.43 1.92 2.71 20.97 18.26 3.22 11.85
## Theme2 2 26 8.40 1.53 7.93 8.36 1.80 6.46 11.14 4.68 0.29 -1.56
## Theme3 3 26 9.81 3.13 8.96 9.38 1.89 5.59 19.44 13.85 1.51 1.88
## Theme4 4 26 9.41 3.46 9.16 9.02 3.22 4.92 19.32 14.39 1.04 0.86
## Theme5 5 26 5.68 2.81 5.45 5.36 1.22 2.20 17.72 15.52 2.85 10.23
## Theme6 6 26 4.65 2.15 4.27 4.39 1.87 2.18 12.13 9.96 1.57 3.11
## Theme7 7 26 6.55 1.88 6.75 6.50 1.66 3.55 10.37 6.82 0.11 -0.89
## Theme8 8 26 8.30 3.45 7.64 8.10 1.80 2.56 18.71 16.15 0.91 1.22
## Theme9 9 26 3.47 1.48 3.40 3.30 0.94 1.48 9.40 7.92 2.32 7.21
## Theme10 10 26 4.85 2.18 4.68 4.70 2.38 1.33 10.99 9.66 0.72 0.37
## se
## Theme1 0.67
## Theme2 0.30
## Theme3 0.61
## Theme4 0.68
## Theme5 0.55
## Theme6 0.42
## Theme7 0.37
## Theme8 0.68
## Theme9 0.29
## Theme10 0.43Discussion Questions
How do the results of this analysis compare to the cluster analysis with the same data? Would you draw the same conclusions?
- ANSWER: Though the themes are used by the governors of both parties , theme7 (mitigation) and theme10 (covid expenditure) is little excessively used by democratic governers. where as the repubican governors are talking more about forecast , social distancing , activity , healthcare etc. In this case though i was able to reduce the dimension of comparision , we could still not conclude that the tweets are biased. I would still go with the same conclusion that the tweets are unbiased.
Describe a set of texts and research question that interests you that could be explored using this method.
- ANSWER: For a company which does insurance for the products in amazon which is worlds largest retailer, with millions of products in the catalog and thousands of new products coming in, it is tough to decide the insurance cost of each product just based on the price of the product, we can reduce the dimensions and categorize the products based on brand, type , size, ratings, previous claims etc. Though we may not be able to predict the exact insurance price, it would be simpler for us to apply PCA and apply machine learning techniques to decide the insurance price which reduces the size of the dataset and thus reduces the workload on the servers . If we run the Machine learning algorithms on the entire dataset, it consumes lot of compute power ( our cloud infrastructure cost increases ).