Webscraping #2
ASWIN JANUARSJAF
16 Juli 2021
source: www.imdb.com/search/title/?at=0&num_votes=25000,&sort=moviemeter&title_type=feature
Web Scraping
Web Scraping digunakan untuk mengambil data-data dari website agar data tersebut bisa kita olah untuk analisis lebih lanjut.
Gunakan library rvest dan tidyverse
library(rvest)
library(tidyverse)## -- Attaching packages --------------------------------------- tidyverse 1.3.1 --## v ggplot2 3.3.3 v purrr 0.3.4
## v tibble 3.1.1 v dplyr 1.0.7
## v tidyr 1.1.3 v stringr 1.4.0
## v readr 1.4.0 v forcats 0.5.1## -- Conflicts ------------------------------------------ tidyverse_conflicts() --
## x dplyr::filter() masks stats::filter()
## x readr::guess_encoding() masks rvest::guess_encoding()
## x dplyr::lag() masks stats::lag()library(knitr)Begini caranya…
Tarik data-data yang dianggap penting, caranya mengaktifkan websitenya, kemudian menggunakan program Selector Gadget memilih data-data penting yang akan kita ambil.
link = "https://www.imdb.com/search/title/?at=0&num_votes=25000,&sort=moviemeter&title_type=feature"
page=read_html(link)name = page %>% html_nodes(".lister-item-header a") %>% html_text()
name## [1] "The Tomorrow War"
## [2] "Black Widow"
## [3] "Fear Street: 1994"
## [4] "F9"
## [5] "Luca"
## [6] "A Quiet Place Part II"
## [7] "In the Heights"
## [8] "Independence Day"
## [9] "Cruella"
## [10] "Nobody"
## [11] "Once Upon a Time... in Hollywood"
## [12] "Raya and the Last Dragon"
## [13] "Midsommar"
## [14] "Yesterday"
## [15] "Wrath of Man"
## [16] "Mother's Day"
## [17] "A Quiet Place"
## [18] "The Conjuring: The Devil Made Me Do It"
## [19] "Tenet"
## [20] "Bill & Ted Face the Music"
## [21] "Mortal Kombat"
## [22] "Army of the Dead"
## [23] "Godzilla vs. Kong"
## [24] "The Godfather"
## [25] "Avengers: Endgame"
## [26] "365 dni"
## [27] "Harry Potter and the Sorcerer's Stone"
## [28] "The Little Things"
## [29] "Zack Snyder's Justice League"
## [30] "Fast & Furious Presents: Hobbs & Shaw"
## [31] "The Shawshank Redemption"
## [32] "Warcraft"
## [33] "Promising Young Woman"
## [34] "Thor: Ragnarok"
## [35] "Pulp Fiction"
## [36] "The Fast and the Furious"
## [37] "Don't Breathe"
## [38] "The Sandlot"
## [39] "The Hitman's Bodyguard"
## [40] "The Hunt"
## [41] "Jaws"
## [42] "Boogie Nights"
## [43] "Nomadland"
## [44] "Druk"
## [45] "Independence Day: Resurgence"
## [46] "The Father"
## [47] "The Goonies"
## [48] "Clash of the Titans"
## [49] "Terminator 2: Judgment Day"
## [50] "Guardians of the Galaxy"year = page %>% html_nodes(".text-muted.unbold") %>% html_text()
year## [1] "(2021)" "(2021)" "(2021)" "(2021)" "(2021)"
## [6] "(2020)" "(2021)" "(1996)" "(2021)" "(I) (2021)"
## [11] "(2019)" "(2021)" "(2019)" "(III) (2019)" "(2021)"
## [16] "(I) (2016)" "(2018)" "(2021)" "(2020)" "(2020)"
## [21] "(2021)" "(2021)" "(2021)" "(1972)" "(2019)"
## [26] "(2020)" "(2001)" "(2021)" "(2021)" "(2019)"
## [31] "(1994)" "(2016)" "(2020)" "(2017)" "(1994)"
## [36] "(2001)" "(2016)" "(1993)" "(2017)" "(II) (2020)"
## [41] "(1975)" "(1997)" "(2020)" "(2020)" "(2016)"
## [46] "(I) (2020)" "(1985)" "(1981)" "(1991)" "(2014)"rating = page %>% html_nodes(".ratings-imdb-rating strong") %>% html_text()
rating## [1] "6.6" "7.0" "6.2" "5.5" "7.5" "7.4" "7.5" "7.0" "7.4" "7.4" "7.6" "7.4"
## [13] "7.1" "6.8" "7.2" "5.7" "7.5" "6.3" "7.4" "6.0" "6.2" "5.8" "6.4" "9.2"
## [25] "8.4" "3.3" "7.6" "6.3" "8.1" "6.4" "9.3" "6.8" "7.5" "7.9" "8.9" "6.8"
## [37] "7.1" "7.8" "6.9" "6.5" "8.0" "7.9" "7.4" "7.8" "5.2" "8.3" "7.8" "6.9"
## [49] "8.5" "8.0"sinopsis = page %>% html_nodes(".ratings-bar+ .text-muted") %>% html_text()
sinopsis## [1] "\nA family man is drafted to fight in a future war where the fate of humanity relies on his ability to confront the past."
## [2] "\nA film about Natasha Romanoff in her quests between the films Civil War and Infinity War."
## [3] "\nA circle of teenage friends accidentally encounter the ancient evil responsible for a series of brutal murders that have plagued their town for over 300 years. Welcome to Shadyside."
## [4] "\nCipher enlists the help of Jakob, Dom's younger brother to take revenge on Dom and his team."
## [5] "\nOn the Italian Riviera, an unlikely but strong friendship grows between a human being and a sea monster disguised as a human."
## [6] "\nFollowing the events at home, the Abbott family now face the terrors of the outside world. Forced to venture into the unknown, they realize the creatures that hunt by sound are not the only threats lurking beyond the sand path."
## [7] "\nA film version of the Broadway musical in which Usnavi, a sympathetic New York bodega owner, saves every penny every day as he imagines and sings about a better life."
## [8] "\nThe aliens are coming and their goal is to invade and destroy Earth. Fighting superior technology, mankind's best weapon is the will to survive."
## [9] "\nA live-action prequel feature film following a young Cruella de Vil."
## [10] "\nA bystander who intervenes to help a woman being harassed by a group of men becomes the target of a vengeful drug lord."
## [11] "\nA faded television actor and his stunt double strive to achieve fame and success in the final years of Hollywood's Golden Age in 1969 Los Angeles."
## [12] "\nIn a realm known as Kumandra, a re-imagined Earth inhabited by an ancient civilization, a warrior named Raya is determined to find the last dragon."
## [13] "\nA couple travels to Scandinavia to visit a rural hometown's fabled Swedish mid-summer festival. What begins as an idyllic retreat quickly devolves into an increasingly violent and bizarre competition at the hands of a pagan cult."
## [14] "\nA struggling musician realizes he's the only person on Earth who can remember The Beatles after waking up in an alternate timeline where they never existed."
## [15] "\nThe plot follows H, a cold and mysterious character working at a cash truck company responsible for moving hundreds of millions of dollars around Los Angeles each week."
## [16] "\nThree generations come together in the week leading up to Mother's Day."
## [17] "\nIn a post-apocalyptic world, a family is forced to live in silence while hiding from monsters with ultra-sensitive hearing."
## [18] "\nThe Warrens investigate a murder that may be linked to a demonic possession."
## [19] "\nArmed with only one word, Tenet, and fighting for the survival of the entire world, a Protagonist journeys through a twilight world of international espionage on a mission that will unfold in something beyond real time."
## [20] "\nOnce told they'd save the universe during a time-traveling adventure, 2 would-be rockers from San Dimas, California find themselves as middle-aged dads still trying to crank out a hit song and fulfill their destiny."
## [21] "\nMMA fighter Cole Young seeks out Earth's greatest champions in order to stand against the enemies of Outworld in a high stakes battle for the universe."
## [22] "\nFollowing a zombie outbreak in Las Vegas, a group of mercenaries take the ultimate gamble, venturing into the quarantine zone to pull off the greatest heist ever attempted."
## [23] "\nThe epic next chapter in the cinematic Monsterverse pits two of the greatest icons in motion picture history against one another - the fearsome Godzilla and the mighty Kong - with humanity caught in the balance."
## [24] "\nAn organized crime dynasty's aging patriarch transfers control of his clandestine empire to his reluctant son."
## [25] "\nAfter the devastating events of Avengers: Infinity War (2018), the universe is in ruins. With the help of remaining allies, the Avengers assemble once more in order to reverse Thanos' actions and restore balance to the universe."
## [26] "\nMassimo is a member of the Sicilian Mafia family and Laura is a sales director. She does not expect that on a trip to Sicily trying to save her relationship, Massimo will kidnap her and give her 365 days to fall in love with him."
## [27] "\nAn orphaned boy enrolls in a school of wizardry, where he learns the truth about himself, his family and the terrible evil that haunts the magical world."
## [28] "\nKern County Deputy Sheriff Joe Deacon is sent to Los Angeles for what should have been a quick evidence-gathering assignment. Instead, he becomes embroiled in the search for a serial killer who is terrorizing the city."
## [29] "\nDetermined to ensure Superman's ultimate sacrifice was not in vain, Bruce Wayne aligns forces with Diana Prince with plans to recruit a team of metahumans to protect the world from an approaching threat of catastrophic proportions."
## [30] "\nLawman Luke Hobbs (Dwayne \"The Rock\" Johnson) and outcast Deckard Shaw (Jason Statham) form an unlikely alliance when a cyber-genetically enhanced villain threatens the future of humanity."
## [31] "\nTwo imprisoned men bond over a number of years, finding solace and eventual redemption through acts of common decency."
## [32] "\nAs an Orc horde invades the planet Azeroth using a magic portal, a few human heroes and dissenting Orcs must attempt to stop the true evil behind this war."
## [33] "\nA young woman, traumatized by a tragic event in her past, seeks out vengeance against those who crossed her path."
## [34] "\nImprisoned on the planet Sakaar, Thor must race against time to return to Asgard and stop Ragnarök, the destruction of his world, at the hands of the powerful and ruthless villain Hela."
## [35] "\nThe lives of two mob hitmen, a boxer, a gangster and his wife, and a pair of diner bandits intertwine in four tales of violence and redemption."
## [36] "\nLos Angeles police officer Brian O'Conner must decide where his loyalty really lies when he becomes enamored with the street racing world he has been sent undercover to destroy."
## [37] "\nHoping to walk away with a massive fortune, a trio of thieves break into the house of a blind man who isn't as helpless as he seems."
## [38] "\nIn the summer of 1962, a new kid in town is taken under the wing of a young baseball prodigy and his rowdy team, resulting in many adventures."
## [39] "\nThe world's top bodyguard gets a new client, a hitman who must testify at the International Criminal Court. They must put their differences aside and work together to make it to the trial on time."
## [40] "\nTwelve strangers wake up in a clearing. They don't know where they are, or how they got there. They don't know they've been chosen - for a very specific purpose - The Hunt."
## [41] "\nWhen a killer shark unleashes chaos on a beach community, it's up to a local sheriff, a marine biologist, and an old seafarer to hunt the beast down."
## [42] "\nBack when sex was safe, pleasure was a business and business was booming, an idealistic porn producer aspires to elevate his craft to an art when he discovers a hot young talent."
## [43] "\nA woman in her sixties, after losing everything in the Great Recession, embarks on a journey through the American West, living as a van-dwelling modern-day nomad."
## [44] "\nFour high school teachers consume alcohol on a daily basis to see how it affects their social and professional lives."
## [45] "\nTwo decades after the first Independence Day invasion, Earth is faced with a new extra-Solar threat. But will mankind's new space defenses be enough?"
## [46] "\nA man refuses all assistance from his daughter as he ages. As he tries to make sense of his changing circumstances, he begins to doubt his loved ones, his own mind and even the fabric of his reality."
## [47] "\nA group of young misfits called The Goonies discover an ancient map and set out on an adventure to find a legendary pirate's long-lost treasure."
## [48] "\nPerseus must battle Medusa and the Kraken to save the Princess Andromeda."
## [49] "\nA cyborg, identical to the one who failed to kill Sarah Connor, must now protect her ten year old son, John Connor, from a more advanced and powerful cyborg."
## [50] "\nA group of intergalactic criminals must pull together to stop a fanatical warrior with plans to purge the universe."Pada tahap ini kita akan mengambil judul film (name), tahun (year), peringkat (rating) dan cerita singkat tentang film tersebut (sinopsis)
movies=data.frame(name,year,rating,sinopsis,stringsAsFactors=FALSE)Seluruh data yang ditarik tadi disimpan dalam bentuk data frame
write.csv(movies,"file=movies.csv")
head(movies)## name year rating
## 1 The Tomorrow War (2021) 6.6
## 2 Black Widow (2021) 7.0
## 3 Fear Street: 1994 (2021) 6.2
## 4 F9 (2021) 5.5
## 5 Luca (2021) 7.5
## 6 A Quiet Place Part II (2020) 7.4
## sinopsis
## 1 \nA family man is drafted to fight in a future war where the fate of humanity relies on his ability to confront the past.
## 2 \nA film about Natasha Romanoff in her quests between the films Civil War and Infinity War.
## 3 \nA circle of teenage friends accidentally encounter the ancient evil responsible for a series of brutal murders that have plagued their town for over 300 years. Welcome to Shadyside.
## 4 \nCipher enlists the help of Jakob, Dom's younger brother to take revenge on Dom and his team.
## 5 \nOn the Italian Riviera, an unlikely but strong friendship grows between a human being and a sea monster disguised as a human.
## 6 \nFollowing the events at home, the Abbott family now face the terrors of the outside world. Forced to venture into the unknown, they realize the creatures that hunt by sound are not the only threats lurking beyond the sand path.referensinya dari sini: https://www.youtube.com/watch?v=v8Yh_4oE-Fs
Semoga bermanfaat.