library(tidyverse)
## Warning: package 'tidyverse' was built under R version 4.4.3
## Warning: package 'ggplot2' was built under R version 4.4.3
## Warning: package 'tibble' was built under R version 4.4.3
## Warning: package 'tidyr' was built under R version 4.4.3
## Warning: package 'readr' was built under R version 4.4.3
## Warning: package 'purrr' was built under R version 4.4.3
## Warning: package 'dplyr' was built under R version 4.4.3
## Warning: package 'stringr' was built under R version 4.4.3
## Warning: package 'forcats' was built under R version 4.4.3
## Warning: package 'lubridate' was built under R version 4.4.3
## ── Attaching core tidyverse packages ──────────────────────── tidyverse 2.0.0 ──
## ✔ dplyr 1.1.4 ✔ readr 2.1.5
## ✔ forcats 1.0.0 ✔ stringr 1.5.1
## ✔ ggplot2 3.5.2 ✔ tibble 3.2.1
## ✔ lubridate 1.9.4 ✔ tidyr 1.3.1
## ✔ purrr 1.0.4
## ── Conflicts ────────────────────────────────────────── tidyverse_conflicts() ──
## ✖ dplyr::filter() masks stats::filter()
## ✖ dplyr::lag() masks stats::lag()
## ℹ Use the conflicted package (<http://conflicted.r-lib.org/>) to force all conflicts to become errors
library(tm)
## Warning: package 'tm' was built under R version 4.4.3
## Loading required package: NLP
##
## Attaching package: 'NLP'
##
## The following object is masked from 'package:ggplot2':
##
## annotate
docs <- Corpus(DirSource("C:/Users/shann/OneDrive/Documents/Alice_in_Wonderland"))
docs
## <<SimpleCorpus>>
## Metadata: corpus specific: 1, document level (indexed): 0
## Content: documents: 11
docs[[2]]
## <<PlainTextDocument>>
## Metadata: 7
## Content: chars: 12710
content(docs[[2]])[1:3]
## [1] "CHAPTER X.\nThe Lobster Quadrille\n\n\n\"The Mock Turtle sighed deeply, and drew the back of one flapper across his eyes. He looked at Alice, and tried to speak, but for a minute or two sobs choked his voice. <93>Same as if he had a bone in his throat,<94> said the Gryphon: and it set to work shaking him and punching him in the back. At last the Mock Turtle recovered his voice, and, with tears running down his cheeks, he went on again:<97>\"\n\"<93>You may not have lived much under the sea<97><94> (<93>I haven<92>t,<94> said Alice)<97><93>and perhaps you were never even introduced to a lobster<97><94> (Alice began to say <93>I once tasted<97><94> but checked herself hastily, and said <93>No, never<94>) <93><97>so you can have no idea what a delightful thing a Lobster Quadrille is!<94>\"\n\"<93>No, indeed,<94> said Alice. <93>What sort of a dance is it?<94>\"\n\"<93>Why,<94> said the Gryphon, <93>you first form into a line along the sea-shore<97><94>\"\n\"<93>Two lines!<94> cried the Mock Turtle. <93>Seals, turtles, salmon, and so on; then, when you<92>ve cleared all the jelly-fish out of the way<97><94>\"\n\"<93>That<a0>generally takes some time,<94> interrupted the Gryphon.\"\n<93><97>you advance twice<97><94>\n<93>Each with a lobster as a partner!<94> cried the Gryphon.\n\"<93>Of course,<94> the Mock Turtle said: <93>advance twice, set to partners<97><94>\"\n\"<93><97>change lobsters, and retire in same order,<94> continued the Gryphon.\"\n\"<93>Then, you know,<94> the Mock Turtle went on, <93>you throw the<97><94>\"\n\"<93>The lobsters!<94> shouted the Gryphon, with a bound into the air.\"\n<93><97>as far out to sea as you can<97><94>\n<93>Swim after them!<94> screamed the Gryphon.\n\"<93>Turn a somersault in the sea!<94> cried the Mock Turtle, capering wildly about.\"\n<93>Change lobsters again!<94> yelled the Gryphon at the top of its voice.\n\"<93>Back to land again, and that<92>s all the first figure,<94> said the Mock Turtle, suddenly dropping his voice; and the two creatures, who had been jumping about like mad things all this time, sat down again very sadly and quietly, and looked at Alice.\"\n\"<93>It must be a very pretty dance,<94> said Alice timidly.\"\n<93>Would you like to see a little of it?<94> said the Mock Turtle.\n\"<93>Very much indeed,<94> said Alice.\"\n\"<93>Come, let<92>s try the first figure!<94> said the Mock Turtle to the Gryphon. <93>We can do without lobsters, you know. Which shall sing?<94>\"\n\"<93>Oh,<a0>you<a0>sing,<94> said the Gryphon. <93>I<92>ve forgotten the words.<94>\"\n\"So they began solemnly dancing round and round Alice, every now and then treading on her toes when they passed too close, and waving their forepaws to mark the time, while the Mock Turtle sang this, very slowly and sadly:<97>\"\n\n<93>Will you walk a little faster?<94> said a whiting to a snail.\n\"<93>There<92>s a porpoise close behind us, and he<92>s treading on my tail.\"\nSee how eagerly the lobsters and the turtles all advance!\nThey are waiting on the shingle<97>will you come and join the dance?\n\"Will you, won<92>t you, will you, won<92>t you, will you join the dance?\"\n\"Will you, won<92>t you, will you, won<92>t you, won<92>t you join the dance?\"\n\n<93>You can really have no notion how delightful it will be\n\"When they take us up and throw us, with the lobsters, out to sea!<94>\"\n\"But the snail replied <93>Too far, too far!<94> and gave a look askance<97>\"\n\"Said he thanked the whiting kindly, but he would not join the dance.\"\n\"Would not, could not, would not, could not, would not join the dance.\"\n\"Would not, could not, would not, could not, could not join the dance.\"\n\n<93>What matters it how far we go?<94> his scaly friend replied.\n\"<93>There is another shore, you know, upon the other side.\"\nThe further off from England the nearer is to France<97>\n\"Then turn not pale, beloved snail, but come and join the dance.\"\n\"Will you, won<92>t you, will you, won<92>t you, will you join the dance?\"\n\"Will you, won<92>t you, will you, won<92>t you, won<92>t you join the dance?<94>\"\n\n\"<93>Thank you, it<92>s a very interesting dance to watch,<94> said Alice, feeling very glad that it was over at last: <93>and I do so like that curious song about the whiting!<94>\"\n\"<93>Oh, as to the whiting,<94> said the Mock Turtle, <93>they<97>you<92>ve seen them, of course?<94>\"\n\"<93>Yes,<94> said Alice, <93>I<92>ve often seen them at dinn<97><94> she checked herself hastily.\"\n\"<93>I don<92>t know where Dinn may be,<94> said the Mock Turtle, <93>but if you<92>ve seen them so often, of course you know what they<92>re like.<94>\"\n\"<93>I believe so,<94> Alice replied thoughtfully. <93>They have their tails in their mouths<97>and they<92>re all over crumbs.<94>\"\n\"<93>You<92>re wrong about the crumbs,<94> said the Mock Turtle: <93>crumbs would all wash off in the sea. But they<a0>have<a0>their tails in their mouths; and the reason is<97><94> here the Mock Turtle yawned and shut his eyes.<97><93>Tell her about the reason and all that,<94> he said to the Gryphon.\"\n\"<93>The reason is,<94> said the Gryphon, <93>that they<a0>would<a0>go with the lobsters to the dance. So they got thrown out to sea. So they had to fall a long way. So they got their tails fast in their mouths. So they couldn<92>t get them out again. That<92>s all.<94>\"\n\"<93>Thank you,<94> said Alice, <93>it<92>s very interesting. I never knew so much about a whiting before.<94>\"\n\"<93>I can tell you more than that, if you like,<94> said the Gryphon. <93>Do you know why it<92>s called a whiting?<94>\"\n\"<93>I never thought about it,<94> said Alice. <93>Why?<94>\"\n\"<93>It does the boots and shoes,<94> the Gryphon replied very solemnly.\"\nAlice was thoroughly puzzled. <93>Does the boots and shoes!<94> she repeated in a wondering tone.\n\"<93>Why, what are<a0>your<a0>shoes done with?<94> said the Gryphon. <93>I mean, what makes them so shiny?<94>\"\n\"Alice looked down at them, and considered a little before she gave her answer. <93>They<92>re done with blacking, I believe.<94>\"\n\"<93>Boots and shoes under the sea,<94> the Gryphon went on in a deep voice, <93>are done with a whiting. Now you know.<94>\"\n<93>And what are they made of?<94> Alice asked in a tone of great curiosity.\n\"<93>Soles and eels, of course,<94> the Gryphon replied rather impatiently: <93>any shrimp could have told you that.<94>\"\n\"<93>If I<92>d been the whiting,<94> said Alice, whose thoughts were still running on the song, <93>I<92>d have said to the porpoise, <91>Keep back, please: we don<92>t want<a0>you<a0>with us!<92><94>\"\n\"<93>They were obliged to have him with them,<94> the Mock Turtle said: <93>no wise fish would go anywhere without a porpoise.<94>\"\n<93>Wouldn<92>t it really?<94> said Alice in a tone of great surprise.\n\"<93>Of course not,<94> said the Mock Turtle: <93>why, if a fish came to<a0>me, and told me he was going a journey, I should say <91>With what porpoise?<92><94>\"\n<93>Don<92>t you mean <91>purpose<92>?<94> said Alice.\n\"<93>I mean what I say,<94> the Mock Turtle replied in an offended tone. And the Gryphon added <93>Come, let<92>s hear some of<a0>your<a0>adventures.<94>\"\n\"<93>I could tell you my adventures<97>beginning from this morning,<94> said Alice a little timidly: <93>but it<92>s no use going back to yesterday, because I was a different person then.<94>\"\n\"<93>Explain all that,<94> said the Mock Turtle.\"\n\"<93>No, no! The adventures first,<94> said the Gryphon in an impatient tone: <93>explanations take such a dreadful time.<94>\"\n\"So Alice began telling them her adventures from the time when she first saw the White Rabbit. She was a little nervous about it just at first, the two creatures got so close to her, one on each side, and opened their eyes and mouths so<a0>very<a0>wide, but she gained courage as she went on. Her listeners were perfectly quiet till she got to the part about her repeating <93>You are old, Father William,<94> to the Caterpillar, and the words all coming different, and then the Mock Turtle drew a long breath, and said <93>That<92>s very curious.<94>\"\n\"<93>It<92>s all about as curious as it can be,<94> said the Gryphon.\"\n<93>It all came different!<94> the Mock Turtle repeated thoughtfully. <93>I should like to hear her try and repeat something now. Tell her to begin.<94> He looked at the Gryphon as if he thought it had some kind of authority over Alice.\n\"<93>Stand up and repeat <91><92>Tis the voice of the sluggard,<92><94> said the Gryphon.\"\n\"<93>How the creatures order one about, and make one repeat lessons!<94> thought Alice; <93>I might as well be at school at once.<94> However, she got up, and began to repeat it, but her head was so full of the Lobster Quadrille, that she hardly knew what she was saying, and the words came very queer indeed:<97>\"\n\n\"<93><92>Tis the voice of the Lobster; I heard him declare,\"\n\"<93>You have baked me too brown, I must sugar my hair.<94>\"\n\"As a duck with its eyelids, so he with his nose\"\n\"Trims his belt and his buttons, and turns out his toes.<94>\"\n\n[later editions continued as follows\n\"When the sands are all dry, he is gay as a lark,\"\n\"And will talk in contemptuous tones of the Shark,\"\n\"But, when the tide rises and sharks are around,\"\nHis voice has a timid and tremulous sound.]\n\n\"<93>That<92>s different from what<a0>I<a0>used to say when I was a child,<94> said the Gryphon.\"\n\"<93>Well, I never heard it before,<94> said the Mock Turtle; <93>but it sounds uncommon nonsense.<94>\"\n\"Alice said nothing; she had sat down with her face in her hands, wondering if anything would<a0>ever<a0>happen in a natural way again.\"\n\"<93>I should like to have it explained,<94> said the Mock Turtle.\"\n\"<93>She can<92>t explain it,<94> said the Gryphon hastily. <93>Go on with the next verse.<94>\"\n\"<93>But about his toes?<94> the Mock Turtle persisted. <93>How<a0>could<a0>he turn them out with his nose, you know?<94>\"\n\"<93>It<92>s the first position in dancing.<94> Alice said; but was dreadfully puzzled by the whole thing, and longed to change the subject.\"\n\"<93>Go on with the next verse,<94> the Gryphon repeated impatiently: <93>it begins <91>I passed by his garden.<92><94>\"\n\"Alice did not dare to disobey, though she felt sure it would all come wrong, and she went on in a trembling voice:<97>\"\n\n\"<93>I passed by his garden, and marked, with one eye,\"\nHow the Owl and the Panther were sharing a pie<97><94>\n\n[later editions continued as follows\n\"The Panther took pie-crust, and gravy, and meat,\"\nWhile the Owl had the dish as its share of the treat.\n\"When the pie was all finished, the Owl, as a boon,\"\nWas kindly permitted to pocket the spoon:\n\"While the Panther received knife and fork with a growl,\"\nAnd concluded the banquet<97>]\n\n\"<93>What<a0>is<a0>the use of repeating all that stuff,<94> the Mock Turtle interrupted, <93>if you don<92>t explain it as you go on? It<92>s by far the most confusing thing<a0>I<a0>ever heard!<94>\"\n\"<93>Yes, I think you<92>d better leave off,<94> said the Gryphon: and Alice was only too glad to do so.\"\n<93>Shall we try another figure of the Lobster Quadrille?<94> the Gryphon went on. <93>Or would you like the Mock Turtle to sing you a song?<94>\n\"<93>Oh, a song, please, if the Mock Turtle would be so kind,<94> Alice replied, so eagerly that the Gryphon said, in a rather offended tone, <93>Hm! No accounting for tastes! Sing her <91>Turtle Soup,<92> will you, old fellow?<94>\"\n\"The Mock Turtle sighed deeply, and began, in a voice sometimes choked with sobs, to sing this:<97>\"\n\n\"<93>Beautiful Soup, so rich and green,\"\nWaiting in a hot tureen!\nWho for such dainties would not stoop?\n\"Soup of the evening, beautiful Soup!\"\n\"Soup of the evening, beautiful Soup!\"\n<a0><a0><a0><a0>Beau<97>ootiful Soo<97>oop!\n<a0><a0><a0><a0>Beau<97>ootiful Soo<97>oop!\n\"Soo<97>oop of the e<97>e<97>evening,\"\n\"<a0><a0><a0><a0>Beautiful, beautiful Soup!\"\n\n\"<93>Beautiful Soup! Who cares for fish,\"\n\"Game, or any other dish?\"\nWho would not give all else for two p\nennyworth only of beautiful Soup?\nPennyworth only of beautiful Soup?\n<a0><a0><a0><a0>Beau<97>ootiful Soo<97>oop!\n<a0><a0><a0><a0>Beau<97>ootiful Soo<97>oop!\n\"Soo<97>oop of the e<97>e<97>evening,\"\n\"<a0><a0><a0><a0>Beautiful, beauti<97>FUL SOUP!<94>\"\n\n\"<93>Chorus again!<94> cried the Gryphon, and the Mock Turtle had just begun to repeat it, when a cry of <93>The trial<92>s beginning!<94> was heard in the distance.\"\n\"<93>Come on!<94> cried the Gryphon, and, taking Alice by the hand, it hurried off, without waiting for the end of the song.\"\n\"<93>What trial is it?<94> Alice panted as she ran; but the Gryphon only answered <93>Come on!<94> and ran the faster, while more and more faintly came, carried on the breeze that followed them, the melancholy words:<97>\"\n\n\"<93>Soo<97>oop of the e<97>e<97>evening,\"\n\"<a0><a0><a0><a0>Beautiful, beautiful Soup!<94>\""
## [2] NA
## [3] NA
docs <- docs %>%
tm_map(removePunctuation) %>%
tm_map(content_transformer(tolower)) %>%
tm_map(removeNumbers) %>%
tm_map(removeWords, stopwords("en")) %>%
tm_map(stripWhitespace) %>%
tm_map(stemDocument)
content(docs[[2]])[1:3]
## [1] "chapter x lobster quadrill mock turtl sigh deepli drew back one flapper across eye look alic tri speak minut two sob choke voic bone throat said gryphon set work shake punch back last mock turtl recov voic tear run cheek went may live much sea havent said aliceand perhap never even introduc lobster alic began say tast check hastili said never can idea delight thing lobster quadrill inde said alic sort danc said gryphon first form line along seashor two line cri mock turtl seal turtl salmon youv clear jellyfish way thatagener take time interrupt gryphon advanc twice lobster partner cri gryphon cours mock turtl said advanc twice set partner chang lobster retir order continu gryphon know mock turtl went throw lobster shout gryphon bound air far sea can swim scream gryphon turn somersault sea cri mock turtl caper wild chang lobster yell gryphon top voic back land that first figur said mock turtl sudden drop voic two creatur jump like mad thing time sat sad quiet look alic must pretti danc said alic timid like see littl said mock turtl much inde said alic come let tri first figur said mock turtl gryphon can without lobster know shall sing ohayouas said gryphon ive forgotten word began solemn danc round round alic everi now tread toe pass close wave forepaw mark time mock turtl sang slowli sad will walk littl faster said white snail there porpois close behind us hes tread tail see eager lobster turtl advanc wait shinglewil come join danc will wont will wont will join danc will wont will wont wont join danc can realli notion delight will take us throw us lobster sea snail repli far far gave look askanc said thank white kind join danc join danc join danc matter far go scali friend repli anoth shore know upon side england nearer franc turn pale belov snail come join danc will wont will wont will join danc will wont will wont wont join danc thank interest danc watch said alic feel glad last like curious song white oh white said mock turtl theyyouv seen cours yes said alic ive often seen dinn check hastili dont know dinn may said mock turtl youv seen often cours know theyr like believ alic repli thought tail mouthsand theyr crumb your wrong crumb said mock turtl crumb wash sea theyahaveatheir tail mouth reason mock turtl yawn shut eyestel reason said gryphon reason said gryphon theyawouldago lobster danc got thrown sea fall long way got tail fast mouth couldnt get that thank said alic interest never knew much white can tell like said gryphon know call white never thought said alic boot shoe gryphon repli solemn alic thorough puzzl boot shoe repeat wonder tone areayourasho done said gryphon mean make shini alic look consid littl gave answer theyr done black believ boot shoe sea gryphon went deep voic done white now know made alic ask tone great curios sole eel cours gryphon repli rather impati shrimp told id white said alic whose thought still run song id said porpois keep back pleas dont wantayouawith us oblig mock turtl said wise fish go anywher without porpois wouldnt realli said alic tone great surpris cours said mock turtl fish came toam told go journey say porpois dont mean purpos said alic mean say mock turtl repli offend tone gryphon ad come let hear ofayouraadventur tell adventuresbegin morn said alic littl timid use go back yesterday differ person explain said mock turtl adventur first said gryphon impati tone explan take dread time alic began tell adventur time first saw white rabbit littl nervous just first two creatur got close one side open eye mouth soaveryawid gain courag went listen perfect quiet till got part repeat old father william caterpillar word come differ mock turtl drew long breath said that curious curious can said gryphon came differ mock turtl repeat thought like hear tri repeat someth now tell begin look gryphon thought kind author alic stand repeat tis voic sluggard said gryphon creatur order one make one repeat lesson thought alic might well school howev got began repeat head full lobster quadrill hard knew say word came queer inde tis voic lobster heard declar bake brown must sugar hair duck eyelid nose trim belt button turn toe later edit continu follow sand dri gay lark will talk contemptu tone shark tide rise shark around voic timid tremul sound that differ whataiaus say child said gryphon well never heard said mock turtl sound uncommon nonsens alic said noth sat face hand wonder anyth wouldaeverahappen natur way like explain said mock turtl cant explain said gryphon hastili go next vers toe mock turtl persist howacouldah turn nose know first posit danc alic said dread puzzl whole thing long chang subject go next vers gryphon repeat impati begin pass garden alic dare disobey though felt sure come wrong went trembl voic pass garden mark one eye owl panther share pie later edit continu follow panther took piecrust gravi meat owl dish share treat pie finish owl boon kind permit pocket spoon panther receiv knife fork growl conclud banquet whataisath use repeat stuff mock turtl interrupt dont explain go far confus thingaiaev heard yes think youd better leav said gryphon alic glad shall tri anoth figur lobster quadrill gryphon went like mock turtl sing song oh song pleas mock turtl kind alic repli eager gryphon said rather offend tone hm account tast sing turtl soup will old fellow mock turtl sigh deepli began voic sometim choke sob sing beauti soup rich green wait hot tureen dainti stoop soup even beauti soup soup even beauti soup aaaabeauooti soooop aaaabeauooti soooop soooop eeeven aaaabeauti beauti soup beauti soup care fish game dish give els two p ennyworth beauti soup pennyworth beauti soup aaaabeauooti soooop aaaabeauooti soooop soooop eeeven aaaabeauti beauti soup chorus cri gryphon mock turtl just begun repeat cri trial begin heard distanc come cri gryphon take alic hand hurri without wait end song trial alic pant ran gryphon answer come ran faster faint came carri breez follow melancholi word soooop eeeven aaaabeauti beauti soup"
## [2] NA
## [3] NA
data <- DocumentTermMatrix(docs, control=list(weighting=weightTfIdf))
## Warning in TermDocumentMatrix.SimpleCorpus(x, control): custom functions are
## ignored
data
## <<DocumentTermMatrix (documents: 11, terms: 2057)>>
## Non-/sparse entries: 4720/17907
## Sparsity : 79%
## Maximal term length: 36
## Weighting : term frequency - inverse document frequency (normalized) (tf-idf)
inspect(data[1:2,1:5])
## <<DocumentTermMatrix (documents: 2, terms: 5)>>
## Non-/sparse entries: 6/4
## Sparsity : 40%
## Maximal term length: 6
## Weighting : term frequency - inverse document frequency (normalized) (tf-idf)
## Sample :
## Terms
## Docs across actual advic advis afraid
## A in W ch1.csv 0.003905144 0.003603575 0.002561908 0.002561908 0.0006792466
## A in W ch10.csv 0.001880109 0.000000000 0.000000000 0.000000000 0.0000000000
findFreqTerms(data,0.9)
## character(0)