Trying to work my way through the code provided in Week 3: Scraping in R Module One.
I am going to attempt to scrape movie reivews manually from Rotten Tomatoes.
First: establish the url. I am interested in user reviews of the movie Captain America: The Winter Soldier.
url <- "https://www.rottentomatoes.com/m/captain_america_the_winter_soldier_2014/reviews?type=user"
Now to try and use the SelectorGadget to identidy the specific css selector needed:
# use SelectorGadget to find the info
css_selector <- ".reviews-movie"
Okay, let’s see if that worked!
Well it’s pulled something:
head(reviews)
[1] "\n \n \n\nMovie Reviews By Reviewer Type\n \n All Critics\n \n \n Top Critics\n \n \n \n All Audience\n \n \n \n \n \n Verified Audience\n \n \n \n \n \n Audience\n \n Movie Reviews By Reviewer Type\n \n All Critics\n \n \n Top Critics\n \n \n \n All Audience\n \n \n \n \n \n Verified Audience\n \n \n \n \n Prev\n \n \n Next\n \n\n \n \n Why are you flagging this review?\n \n ×\n Close\n \n \n\n \n \n We encourage our community to report abusive content and/ or spam. Our team will review flagged items and determine whether or not they meet our community guidelines.\n \n It is offensive and/or threatening.\n \n \n \n It contains inappropriate language.\n \n \n \n It is spam.\n \n \n \n It contains spoilers.\n \n \n \n It contains a link.\n \n \n Please choose best explanation for why you are flagging this review.\n Submit\n \n\n \n Thank you for your submission. This post has been submitted for our review.\n Sincerely, The Rotten Tomatoes Team\n Go Back\n \n\n \n \n \n\n \n \n Why are you flagging this review?\n \n ×\n Close\n \n \n\n \n \n We encourage our community to report abusive content and/ or spam. Our team will review flagged items and determine whether or not they meet our community guidelines.\n \n It is offensive and/or threatening.\n \n \n \n It contains inappropriate language.\n \n \n \n It is spam.\n \n \n \n It contains spoilers.\n \n \n \n It contains a link.\n \n \n Please choose best explanation for why you are flagging this review.\n Submit\n \n\n \n Thank you for your submission. This post has been submitted for our review.\n Sincerely, The Rotten Tomatoes Team\n Go Back\n \n\n \n \n \n\n \n\n \n \n \n \n \n \n \n \n \n \n \n \n Andrew D\n \n \n \n \n \n \n \n \n \n \n \n \n Feb 16, 2022\n \n It really developed the character of captian american a lot\n It really developed the character of captian american a lot\n \n Flag this review\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n Jose R\n \n \n \n \n \n \n \n \n \n \n \n \n Feb 07, 2022\n \n This movie is absolutely perfect. One of Marvel's masterpieces.\n This movie is absolutely perfect. One of Marvel's masterpieces.\n \n Flag this review\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n Caco C\n \n \n \n \n \n \n \n \n \n \n \n \n Jan 30, 2022\n \n TOP 5 MCU Movie of all time and my favorite movie of all time. I was a kid I couldn't google but when Bucky showed his face I was like OH MY GOD HES ALIVE. And the suit has to be the best. The Friendship between Steve and Nat is amazing, and The Falcon really deserved the shield in the end\n TOP 5 MCU Movie of all time and my favorite movie of all time. I was a kid I couldn't google but when Bucky showed his face I was like OH MY GOD HES ALIVE. And the suit has to be the best. The Friendship between Steve and Nat is amazing, and The Falcon really deserved the shield in the end\n \n Flag this review\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n Matthew D\n \n \n \n \n \n \n \n \n \n \n \n \n Jan 29, 2022\n \n Captain America takes on spies!\n\nDirectors Anthony Russo and Joe Russo's superhero espionage thriller Captain America: The Winter Soldier (2014) is very enthralling. I finally get the hype around the majority of audiences saying that The Winter Soldier is one of Marvel's greatest movies. The Russo Brothers capture thrilling action sequences with complex hand to hand combat for both Captain America and Black Widow that makes them look like excellently trained fighters. \n\nProducers Stan Lee and Kevin Feige were smart to entrust The Russo's with Captain America's second solo film. I loved that most of The Winter Soldier focuses on Captain America and Black Widow as these two Avengers superheroes make for the most interesting and believable spies for America through S.H.I.E.L.D.\n\nI personally appreciate Anthony and Joe Russo making a proper espionage thriller with real spy work and political intrigue as Hydra invades S.H.I.E.L.D. with covert tactics, hidden computers, and secretive files. It's very cool to see Marvel's Cinematic Universe give Captain America a chance to defend America with modern espionage skills alongside his awesome combat prowess. \n\nWriters Christopher Markus and Stephen McFeely really came up with a neat spy narrative of Hydra's layered infiltration of S.H.I.E.L.D. from senators to soldiers alike. Their intricate spy story is fascinating as they blend sleeper cell agents like The Winter Soldier with Hydra's human experimentation and war mongering. They breathe life into Captain America's values as a patriotic American and moral man desiring a peaceful life. I was sincerely touched by the Steve Rogers segments where he goes to the Captain America museum exhibit to reminisce on old familiar sights, while deciding if he could ever date a woman that is not Agent Peggy Carter.\n\nChris Evans is really heartfelt as Steve Rogers and inspiring as ever as Captain America. Evans plays up Rogers' emotions seeing Hayley Atwell's Peggy Carter once more alongside Bucky in unfavorable circumstances. You completely understand and empathize with his conflicted ideals and feelings. Chris Evans embodies Captain America's kind spirit, steadfast bravery, and inspiring perseverance. Chris Evans is handsome, charming, funny, gentle, moving, strong, and likable as Captain America. Clearly a career defining role and performance from him.\n\nScarlett Johansson is breathtakingly gorgeous as Black Widow as he takes out men like they're nothing in battle after battle. Scarlett's Natasha Romanoff charms with her sultry flirting and playful teasing of Steve Rogers. She's got great chemistry with Chris Evans and fits the espionage information seeking and cute romantic flirting. I am amazed by her Black Widow fight sequences with crazy acrobatic combat choreography besides her cool gadgets and quick thinking. Scarlett is simply charming and lovable as the former Soviet spy, who admires and befriends Captain America. Scarlett's Natasha Romanoff feels genuine, friendly, funny, and intelligent with her serious dramatic acting and subtle facial nuances. Scarlett Johansson will forever be one of Hollywood's finest actresses. I love her Black Widow in every Marvel movie thus far including Iron Man 2, The Avengers, and Captain America: The Winter Soldier.\n\nHayley Atwell is genuine as ever as Peggy Carter with a wondrously touching scene with Chris Evans. I wish Marvel had given Agent Carter a proper role. Robert Redford is captivating as Alexander Pierce as he monologues about human safety and spy necessity. He feels right back in place with his subtle espionage acting like in 3 Days of the Condor or All the President's Men. Samuel L. Jackson is fantastically gripping as S.H.I.E.L.D. Director Nick Fury with his ethics speeches and motivational guidance for Captain America. His action scenes are really clever too. Toby Jones could not be more fun with just his distinct voice. Jones is always a staple of spy thrillers.\n\nSebastian Stan is fearsome and brooding as The Winter Soldier. You can feel Bucky's confusion and determination as he kills person after person, while wondering who Captain America is to him. Anthony Mackie's Sam Wilson is funny and sincere as a patient veteran counselor, while also coming across as helpful and cool as Falcon. \n\nCobie Smulders is wonderful as S.H.I.E.L.D's stalwart Agent Maria Hill with her sharpshooting and natural gravitas as a leader. Emily VanCamp is lovely and sweet as Sharon Carter. Her Agent 13 feels skillful and reliable with honest morals like Cap. Frank Grillo is easy to hate as Brock Rumlow. Garry Shandling's cameo is very funny. Stan Lee and Joe Russo's cameos are neat. Cool to see Elizabeth Olsen and Aaron Taylor-Johnson already before Age of Ultron.\n\nEditors Jeffrey Ford and Matthew Schmidt continue a fast pace for 136 minutes of sharp cuts. The action flows nicely and the heavy dialogue of espionage exposition never lets you get lost with their natural edits. Cinematographer Trent Opaloch gives us steadfast wide shots for action and conversations so we see everything. I loved all the close-up shots and medium shots here with a real sleek look. All the sets, props, CGI, and sound design is impressive.\n\nComposer Henry Jackman's score for The Winter Soldier is an adrenaline rush for the action sequences, while creating a moody atmosphere for all the spy thriller elements. The espionage is the main plot and Jackman's tense music contributes a lot of emotion. Costume designer Judianna Makovsky creates slick uniforms for Black Widow, Captain America, and The Winter Soldier.\n\nIn all, Captain America: The Winter Soldier remains thought provoking about government power extending too far and shadow games carried out by assassins and spies alike. I love the character development for Steve Rogers and Natasha Romanoff. The Russo Brothers pull off some of Marvel's most engaging action scenes with Captain America and Black Widow. The Winter Soldier stayed with me as a formidable espionage thriller and well made film.\n Captain America takes on spies!\n\nDirectors Anthony Russo and Joe Russo's superhero espionage thriller Captain America: The Winter Soldier (2014) is very enthralling. I finally get the hype around the majority of audiences saying that The Winter Soldier is one of Marvel's greatest movies. The Russo Brothers capture thrilling action sequences with complex hand to hand combat for both Captain America and Black Widow that makes them look like excellently trained fighters. \n\nProducers Stan Lee and Kevin Feige were smart to entrust The Russo's with Captain America's second solo film. I loved that most of The Winter Soldier focuses on Captain America and Black Widow as these two Avengers superheroes make for the most interesting and believable spies for America through S.H.I.E.L.D.\n\nI personally appreciate Anthony and Joe Russo making a proper espionage thriller with real spy work and political intrigue as Hydra invades S.H.I.E.L.D. with covert tactics, hidden computers, and secretive files. It's very cool to see Marvel's Cinematic Universe give Captain America a chance to defend America with modern espionage skills alongside his awesome combat prowess. \n\nWriters Christopher Markus and Stephen McFeely really came up with a neat spy narrative of Hydra's layered infiltration of S.H.I.E.L.D. from senators to soldiers alike. Their intricate spy story is fascinating as they blend sleeper cell agents like The Winter Soldier with Hydra's human experimentation and war mongering. They breathe life into Captain America's values as a patriotic American and moral man desiring a peaceful life. I was sincerely touched by the Steve Rogers segments where he goes to the Captain America museum exhibit to reminisce on old familiar sights, while deciding if he could ever date a woman that is not Agent Peggy Carter.\n\nChris Evans is really heartfelt as Steve Rogers and inspiring as ever as Captain America. Evans plays up Rogers' emotions seeing Hayley Atwell's Peggy Carter once more alongside Bucky in unfavorable circumstances. You completely understand and empathize with his conflicted ideals and feelings. Chris Evans embodies Captain America's kind spirit, steadfast bravery, and inspiring perseverance. Chris Evans is handsome, charming, funny, gentle, moving, strong, and likable as Captain America. Clearly a career defining role and performance from him.\n\nScarlett Johansson is breathtakingly gorgeous as Black Widow as he takes out men like they're nothing in battle after battle. Scarlett's Natasha Romanoff charms with her sultry flirting and playful teasing of Steve Rogers. She's got great chemistry with Chris Evans and fits the espionage information seeking and cute romantic flirting. I am amazed by her Black Widow fight sequences with crazy acrobatic combat choreography besides her cool gadgets and quick thinking. Scarlett is simply charming and lovable as the former Soviet spy, who admires and befriends Captain America. Scarlett's Natasha Romanoff feels genuine, friendly, funny, and intelligent with her serious dramatic acting and subtle facial nuances. Scarlett Johansson will forever be one of Hollywood's finest actresses. I love her Black Widow in every Marvel movie thus far including Iron Man 2, The Avengers, and Captain America: The Winter Soldier.\n\nHayley Atwell is genuine as ever as Peggy Carter with a wondrously touching scene with Chris Evans. I wish Marvel had given Agent Carter a proper role. Robert Redford is captivating as Alexander Pierce as he monologues about human safety and spy necessity. He feels right back in place with his subtle espionage acting like in 3 Days of the Condor or All the President's Men. Samuel L. Jackson is fantastically gripping as S.H.I.E.L.D. Director Nick Fury with his ethics speeches and motivational guidance for Captain America. His action scenes are really clever too. Toby Jones could not be more fun with just his distinct voice. Jones is always a staple of spy thrillers.\n\nSebastian Stan is fearsome and brooding as The Winter Soldier. You can feel Bucky's confusion and determination as he kills person after person, while wondering who Captain America is to him. Anthony Mackie's Sam Wilson is funny and sincere as a patient veteran counselor, while also coming across as helpful and cool as Falcon. \n\nCobie Smulders is wonderful as S.H.I.E.L.D's stalwart Agent Maria Hill with her sharpshooting and natural gravitas as a leader. Emily VanCamp is lovely and sweet as Sharon Carter. Her Agent 13 feels skillful and reliable with honest morals like Cap. Frank Grillo is easy to hate as Brock Rumlow. Garry Shandling's cameo is very funny. Stan Lee and Joe Russo's cameos are neat. Cool to see Elizabeth Olsen and Aaron Taylor-Johnson already before Age of Ultron.\n\nEditors Jeffrey Ford and Matthew Schmidt continue a fast pace for 136 minutes of sharp cuts. The action flows nicely and the heavy dialogue of espionage exposition never lets you get lost with their natural edits. Cinematographer Trent Opaloch gives us steadfast wide shots for action and conversations so we see everything. I loved all the close-up shots and medium shots here with a real sleek look. All the sets, props, CGI, and sound design is impressive.\n\nComposer Henry Jackman's score for The Winter Soldier is an adrenaline rush for the action sequences, while creating a moody atmosphere for all the spy thriller elements. The espionage is the main plot and Jackman's tense music contributes a lot of emotion. Costume designer Judianna Makovsky creates slick uniforms for Black Widow, Captain America, and The Winter Soldier.\n\nIn all, Captain America: The Winter Soldier remains thought provoking about government power extending too far and shadow games carried out by assassins and spies alike. I love the character development for Steve Rogers and Natasha Romanoff. The Russo Brothers pull off some of Marvel's most engaging action scenes with Captain America and Black Widow. The Winter Soldier stayed with me as a formidable espionage thriller and well made film.\n \n Flag this review\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n Jan 15, 2022\n \n An outstanding film, one of Marvel studio's best works of art. \n An outstanding film, one of Marvel studio's best works of art. \n \n Flag this review\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n Marco C\n \n \n \n \n \n \n \n \n \n \n \n \n Jan 15, 2022\n \n i think it may be the best mcu movie\n i think it may be the best mcu movie\n \n Flag this review\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n Alexander H\n \n \n \n \n \n \n \n \n \n \n \n \n Jan 14, 2022\n \n MY FAVORITE MOVIE OF ALL TIME!! I really really like this movie. It was tad bit different than the other movies (in a good way) and had such a cool backstory for the Winter Soldier. I really like how they brought back aspects from ‘Captain America: The First Avenger' which none of the other movie series in the MCU did.\n MY FAVORITE MOVIE OF ALL TIME!! I really really like this movie. It was tad bit different than the other movies (in a good way) and had such a cool backstory for the Winter Soldier. I really like how they brought back aspects from ‘Captain America: The First Avenger' which none of the other movie series in the MCU did.\n \n Flag this review\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n Owen P\n \n \n \n \n \n \n \n \n \n \n \n \n Jan 13, 2022\n \n 10/10 not going to say anything else, but this movie was awesome.\n 10/10 not going to say anything else, but this movie was awesome.\n \n Flag this review\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n Wiz D\n \n \n \n \n \n \n \n \n \n \n \n \n Jan 12, 2022\n \n This movie is almost perfect in every way, a must watch for everyone.\n This movie is almost perfect in every way, a must watch for everyone.\n \n Flag this review\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n Rick W\n \n \n \n \n \n \n \n \n \n \n \n \n Jan 12, 2022\n \n This movie is a real turning point in the MCU timeline. Very well done by the directors, because the movie kept all the charms and heroic moments what Captain America is about. Great action combined with personal drama makes this an awesome movie.\n This movie is a real turning point in the MCU timeline. Very well done by the directors, because the movie kept all the charms and heroic moments what Captain America is about. Great action combined with personal drama makes this an awesome movie.\n \n Flag this review\n \n \n \n \n\n \n\n Prev\n \n \n Next\n \n"While the reviews are there - there is a lot of stuff there we don’t want. Trying with a slightly different css selector:
# use SelectorGadget to find the info
css_selector2 <- ".js-clamp , .audience-reviews__user-wrap"
Okay, let’s see if that worked!
So we’ve pulled something again, let’s look at it:
head(reviews2)
[1] "\n \n \n \n \n \n \n \n \n \n \n \n Andrew D\n \n \n \n \n \n "
[2] "It really developed the character of captian american a lot"
[3] "It really developed the character of captian american a lot"
[4] "\n \n \n \n \n \n \n \n \n \n \n \n Jose R\n \n \n \n \n \n "
[5] "This movie is absolutely perfect. One of Marvel's masterpieces."
[6] "This movie is absolutely perfect. One of Marvel's masterpieces." That doesn’t look quite right - let’s look at the whole thing:
reviews2
[1] "\n \n \n \n \n \n \n \n \n \n \n \n Andrew D\n \n \n \n \n \n "
[2] "It really developed the character of captian american a lot"
[3] "It really developed the character of captian american a lot"
[4] "\n \n \n \n \n \n \n \n \n \n \n \n Jose R\n \n \n \n \n \n "
[5] "This movie is absolutely perfect. One of Marvel's masterpieces."
[6] "This movie is absolutely perfect. One of Marvel's masterpieces."
[7] "\n \n \n \n \n \n \n \n \n \n \n \n Caco C\n \n \n \n \n \n "
[8] "TOP 5 MCU Movie of all time and my favorite movie of all time. I was a kid I couldn't google but when Bucky showed his face I was like OH MY GOD HES ALIVE. And the suit has to be the best. The Friendship between Steve and Nat is amazing, and The Falcon really deserved the shield in the end"
[9] "TOP 5 MCU Movie of all time and my favorite movie of all time. I was a kid I couldn't google but when Bucky showed his face I was like OH MY GOD HES ALIVE. And the suit has to be the best. The Friendship between Steve and Nat is amazing, and The Falcon really deserved the shield in the end"
[10] "\n \n \n \n \n \n \n \n \n \n \n \n Matthew D\n \n \n \n \n \n "
[11] "Captain America takes on spies!\n\nDirectors Anthony Russo and Joe Russo's superhero espionage thriller Captain America: The Winter Soldier (2014) is very enthralling. I finally get the hype around the majority of audiences saying that The Winter Soldier is one of Marvel's greatest movies. The Russo Brothers capture thrilling action sequences with complex hand to hand combat for both Captain America and Black Widow that makes them look like excellently trained fighters. \n\nProducers Stan Lee and Kevin Feige were smart to entrust The Russo's with Captain America's second solo film. I loved that most of The Winter Soldier focuses on Captain America and Black Widow as these two Avengers superheroes make for the most interesting and believable spies for America through S.H.I.E.L.D.\n\nI personally appreciate Anthony and Joe Russo making a proper espionage thriller with real spy work and political intrigue as Hydra invades S.H.I.E.L.D. with covert tactics, hidden computers, and secretive files. It's very cool to see Marvel's Cinematic Universe give Captain America a chance to defend America with modern espionage skills alongside his awesome combat prowess. \n\nWriters Christopher Markus and Stephen McFeely really came up with a neat spy narrative of Hydra's layered infiltration of S.H.I.E.L.D. from senators to soldiers alike. Their intricate spy story is fascinating as they blend sleeper cell agents like The Winter Soldier with Hydra's human experimentation and war mongering. They breathe life into Captain America's values as a patriotic American and moral man desiring a peaceful life. I was sincerely touched by the Steve Rogers segments where he goes to the Captain America museum exhibit to reminisce on old familiar sights, while deciding if he could ever date a woman that is not Agent Peggy Carter.\n\nChris Evans is really heartfelt as Steve Rogers and inspiring as ever as Captain America. Evans plays up Rogers' emotions seeing Hayley Atwell's Peggy Carter once more alongside Bucky in unfavorable circumstances. You completely understand and empathize with his conflicted ideals and feelings. Chris Evans embodies Captain America's kind spirit, steadfast bravery, and inspiring perseverance. Chris Evans is handsome, charming, funny, gentle, moving, strong, and likable as Captain America. Clearly a career defining role and performance from him.\n\nScarlett Johansson is breathtakingly gorgeous as Black Widow as he takes out men like they're nothing in battle after battle. Scarlett's Natasha Romanoff charms with her sultry flirting and playful teasing of Steve Rogers. She's got great chemistry with Chris Evans and fits the espionage information seeking and cute romantic flirting. I am amazed by her Black Widow fight sequences with crazy acrobatic combat choreography besides her cool gadgets and quick thinking. Scarlett is simply charming and lovable as the former Soviet spy, who admires and befriends Captain America. Scarlett's Natasha Romanoff feels genuine, friendly, funny, and intelligent with her serious dramatic acting and subtle facial nuances. Scarlett Johansson will forever be one of Hollywood's finest actresses. I love her Black Widow in every Marvel movie thus far including Iron Man 2, The Avengers, and Captain America: The Winter Soldier.\n\nHayley Atwell is genuine as ever as Peggy Carter with a wondrously touching scene with Chris Evans. I wish Marvel had given Agent Carter a proper role. Robert Redford is captivating as Alexander Pierce as he monologues about human safety and spy necessity. He feels right back in place with his subtle espionage acting like in 3 Days of the Condor or All the President's Men. Samuel L. Jackson is fantastically gripping as S.H.I.E.L.D. Director Nick Fury with his ethics speeches and motivational guidance for Captain America. His action scenes are really clever too. Toby Jones could not be more fun with just his distinct voice. Jones is always a staple of spy thrillers.\n\nSebastian Stan is fearsome and brooding as The Winter Soldier. You can feel Bucky's confusion and determination as he kills person after person, while wondering who Captain America is to him. Anthony Mackie's Sam Wilson is funny and sincere as a patient veteran counselor, while also coming across as helpful and cool as Falcon. \n\nCobie Smulders is wonderful as S.H.I.E.L.D's stalwart Agent Maria Hill with her sharpshooting and natural gravitas as a leader. Emily VanCamp is lovely and sweet as Sharon Carter. Her Agent 13 feels skillful and reliable with honest morals like Cap. Frank Grillo is easy to hate as Brock Rumlow. Garry Shandling's cameo is very funny. Stan Lee and Joe Russo's cameos are neat. Cool to see Elizabeth Olsen and Aaron Taylor-Johnson already before Age of Ultron.\n\nEditors Jeffrey Ford and Matthew Schmidt continue a fast pace for 136 minutes of sharp cuts. The action flows nicely and the heavy dialogue of espionage exposition never lets you get lost with their natural edits. Cinematographer Trent Opaloch gives us steadfast wide shots for action and conversations so we see everything. I loved all the close-up shots and medium shots here with a real sleek look. All the sets, props, CGI, and sound design is impressive.\n\nComposer Henry Jackman's score for The Winter Soldier is an adrenaline rush for the action sequences, while creating a moody atmosphere for all the spy thriller elements. The espionage is the main plot and Jackman's tense music contributes a lot of emotion. Costume designer Judianna Makovsky creates slick uniforms for Black Widow, Captain America, and The Winter Soldier.\n\nIn all, Captain America: The Winter Soldier remains thought provoking about government power extending too far and shadow games carried out by assassins and spies alike. I love the character development for Steve Rogers and Natasha Romanoff. The Russo Brothers pull off some of Marvel's most engaging action scenes with Captain America and Black Widow. The Winter Soldier stayed with me as a formidable espionage thriller and well made film."
[12] "Captain America takes on spies!\n\nDirectors Anthony Russo and Joe Russo's superhero espionage thriller Captain America: The Winter Soldier (2014) is very enthralling. I finally get the hype around the majority of audiences saying that The Winter Soldier is one of Marvel's greatest movies. The Russo Brothers capture thrilling action sequences with complex hand to hand combat for both Captain America and Black Widow that makes them look like excellently trained fighters. \n\nProducers Stan Lee and Kevin Feige were smart to entrust The Russo's with Captain America's second solo film. I loved that most of The Winter Soldier focuses on Captain America and Black Widow as these two Avengers superheroes make for the most interesting and believable spies for America through S.H.I.E.L.D.\n\nI personally appreciate Anthony and Joe Russo making a proper espionage thriller with real spy work and political intrigue as Hydra invades S.H.I.E.L.D. with covert tactics, hidden computers, and secretive files. It's very cool to see Marvel's Cinematic Universe give Captain America a chance to defend America with modern espionage skills alongside his awesome combat prowess. \n\nWriters Christopher Markus and Stephen McFeely really came up with a neat spy narrative of Hydra's layered infiltration of S.H.I.E.L.D. from senators to soldiers alike. Their intricate spy story is fascinating as they blend sleeper cell agents like The Winter Soldier with Hydra's human experimentation and war mongering. They breathe life into Captain America's values as a patriotic American and moral man desiring a peaceful life. I was sincerely touched by the Steve Rogers segments where he goes to the Captain America museum exhibit to reminisce on old familiar sights, while deciding if he could ever date a woman that is not Agent Peggy Carter.\n\nChris Evans is really heartfelt as Steve Rogers and inspiring as ever as Captain America. Evans plays up Rogers' emotions seeing Hayley Atwell's Peggy Carter once more alongside Bucky in unfavorable circumstances. You completely understand and empathize with his conflicted ideals and feelings. Chris Evans embodies Captain America's kind spirit, steadfast bravery, and inspiring perseverance. Chris Evans is handsome, charming, funny, gentle, moving, strong, and likable as Captain America. Clearly a career defining role and performance from him.\n\nScarlett Johansson is breathtakingly gorgeous as Black Widow as he takes out men like they're nothing in battle after battle. Scarlett's Natasha Romanoff charms with her sultry flirting and playful teasing of Steve Rogers. She's got great chemistry with Chris Evans and fits the espionage information seeking and cute romantic flirting. I am amazed by her Black Widow fight sequences with crazy acrobatic combat choreography besides her cool gadgets and quick thinking. Scarlett is simply charming and lovable as the former Soviet spy, who admires and befriends Captain America. Scarlett's Natasha Romanoff feels genuine, friendly, funny, and intelligent with her serious dramatic acting and subtle facial nuances. Scarlett Johansson will forever be one of Hollywood's finest actresses. I love her Black Widow in every Marvel movie thus far including Iron Man 2, The Avengers, and Captain America: The Winter Soldier.\n\nHayley Atwell is genuine as ever as Peggy Carter with a wondrously touching scene with Chris Evans. I wish Marvel had given Agent Carter a proper role. Robert Redford is captivating as Alexander Pierce as he monologues about human safety and spy necessity. He feels right back in place with his subtle espionage acting like in 3 Days of the Condor or All the President's Men. Samuel L. Jackson is fantastically gripping as S.H.I.E.L.D. Director Nick Fury with his ethics speeches and motivational guidance for Captain America. His action scenes are really clever too. Toby Jones could not be more fun with just his distinct voice. Jones is always a staple of spy thrillers.\n\nSebastian Stan is fearsome and brooding as The Winter Soldier. You can feel Bucky's confusion and determination as he kills person after person, while wondering who Captain America is to him. Anthony Mackie's Sam Wilson is funny and sincere as a patient veteran counselor, while also coming across as helpful and cool as Falcon. \n\nCobie Smulders is wonderful as S.H.I.E.L.D's stalwart Agent Maria Hill with her sharpshooting and natural gravitas as a leader. Emily VanCamp is lovely and sweet as Sharon Carter. Her Agent 13 feels skillful and reliable with honest morals like Cap. Frank Grillo is easy to hate as Brock Rumlow. Garry Shandling's cameo is very funny. Stan Lee and Joe Russo's cameos are neat. Cool to see Elizabeth Olsen and Aaron Taylor-Johnson already before Age of Ultron.\n\nEditors Jeffrey Ford and Matthew Schmidt continue a fast pace for 136 minutes of sharp cuts. The action flows nicely and the heavy dialogue of espionage exposition never lets you get lost with their natural edits. Cinematographer Trent Opaloch gives us steadfast wide shots for action and conversations so we see everything. I loved all the close-up shots and medium shots here with a real sleek look. All the sets, props, CGI, and sound design is impressive.\n\nComposer Henry Jackman's score for The Winter Soldier is an adrenaline rush for the action sequences, while creating a moody atmosphere for all the spy thriller elements. The espionage is the main plot and Jackman's tense music contributes a lot of emotion. Costume designer Judianna Makovsky creates slick uniforms for Black Widow, Captain America, and The Winter Soldier.\n\nIn all, Captain America: The Winter Soldier remains thought provoking about government power extending too far and shadow games carried out by assassins and spies alike. I love the character development for Steve Rogers and Natasha Romanoff. The Russo Brothers pull off some of Marvel's most engaging action scenes with Captain America and Black Widow. The Winter Soldier stayed with me as a formidable espionage thriller and well made film."
[13] "\n \n \n \n \n \n \n \n \n \n "
[14] "An outstanding film, one of Marvel studio's best works of art. "
[15] "An outstanding film, one of Marvel studio's best works of art. "
[16] "\n \n \n \n \n \n \n \n \n \n \n \n Marco C\n \n \n \n \n \n "
[17] "i think it may be the best mcu movie"
[18] "i think it may be the best mcu movie"
[19] "\n \n \n \n \n \n \n \n \n \n \n \n Alexander H\n \n \n \n \n \n "
[20] "MY FAVORITE MOVIE OF ALL TIME!! I really really like this movie. It was tad bit different than the other movies (in a good way) and had such a cool backstory for the Winter Soldier. I really like how they brought back aspects from ‘Captain America: The First Avenger' which none of the other movie series in the MCU did."
[21] "MY FAVORITE MOVIE OF ALL TIME!! I really really like this movie. It was tad bit different than the other movies (in a good way) and had such a cool backstory for the Winter Soldier. I really like how they brought back aspects from ‘Captain America: The First Avenger' which none of the other movie series in the MCU did."
[22] "\n \n \n \n \n \n \n \n \n \n \n \n Owen P\n \n \n \n \n \n "
[23] "10/10 not going to say anything else, but this movie was awesome."
[24] "10/10 not going to say anything else, but this movie was awesome."
[25] "\n \n \n \n \n \n \n \n \n \n \n \n Wiz D\n \n \n \n \n \n "
[26] "This movie is almost perfect in every way, a must watch for everyone."
[27] "This movie is almost perfect in every way, a must watch for everyone."
[28] "\n \n \n \n \n \n \n \n \n \n \n \n Rick W\n \n \n \n \n \n "
[29] "This movie is a real turning point in the MCU timeline. Very well done by the directors, because the movie kept all the charms and heroic moments what Captain America is about. Great action combined with personal drama makes this an awesome movie."
[30] "This movie is a real turning point in the MCU timeline. Very well done by the directors, because the movie kept all the charms and heroic moments what Captain America is about. Great action combined with personal drama makes this an awesome movie." So for both of them, they appear to be pulling every review twice?
In any case, now I’ll try the looping to get more pages of reviews, using the second css selector I identified as it seems to have returned something close to what I wanted.
The immediate issue I see is that the url does not change when I click “next” for the next page of reviews. Unsure what to do about this.
Now I’ll play around a bit with making a word cloud from the first page of reviews:
# convert to corpus
CATWS_corpus <- corpus(reviews2)
# create a word cloud
CATWS_dfm <- tokens(CATWS_corpus, remove_punct=TRUE) %>%
tokens_select(pattern=stopwords("en"),
selection="remove") %>%
dfm()
textplot_wordcloud(CATWS_dfm)
It worked! Yay!