Following this piece we now scrap multiple search pages. The goal is to obtain the names and prices of all items on the “new in” tab on this webpage. The page displays 20 items, R will automatically read pages 1-9 of the “new in” tab.
library(rvest)## Loading required package: xml2library(dplyr)##
## Attaching package: 'dplyr'## The following objects are masked from 'package:stats':
##
## filter, lag## The following objects are masked from 'package:base':
##
## intersect, setdiff, setequal, unionlibrary(pander)
library(stringr)Read the data
Price <- lapply(paste0('https://www.schutz.com.br/store/c/newin?q=%3Acreation-time&page=', 0:9),
function(url){
url %>% read_html() %>%
html_nodes(".price-discount") %>%
html_text() %>%
gsub('[\r\n\t]', '', .)
})
Name <- lapply(paste0('https://www.schutz.com.br/store/c/newin?q=%3Acreation-time&page=', 0:9),
function(url){
url %>% read_html() %>%
html_nodes(".sch-category-products-item-name") %>%
html_text() %>%
gsub('[\r\n\t]', '', .)
})The next step is to unlist the results and fill the missing prices, as some items are not available.
Price <- unlist(Price)
Name <- unlist(Name)
addc <- rep("NA", 77)
Price <- append(Price, addc)Let’s merge the two vectors into a data frame.
DF <- as.data.frame(cbind(Name, Price))## Warning in cbind(Name, Price): number of rows of result is not a multiple
## of vector length (arg 2)Before printing out the results we’ll get them properly formated.
DF$Name <- str_replace(DF$Name, "é", "e")
DF$Name <- str_replace(DF$Name, "ç", "c")
DF$Name <- str_replace(DF$Name, "ã", "a")
DF$Name <- str_replace(DF$Name, "õ", "o")
DF$Name <- str_replace(DF$Name, "á", "a")
DF$Name <- str_replace(DF$Name, "ê", "e")
DF$Name <- str_replace(DF$Name, "PRÉ-VENDA", "")
DF$Name <- str_replace(DF$Name, "BEST SELLER", "")Now we can see the results using the pander function.
pander(DF, type = "text")| Name | Price |
|---|---|
| Kitten Heel Maxi Bow Tango Red | R$ 430 |
| Kitten Heel Cindy Maxi Bow Neutro | R$ 390 |
| Kitten Heel Cindy Maxi Bow Rose | R$ 390 |
| Stretch Boots Scarlet | R$ 450 |
| Kitten Heel Vamp Lace Up Black | R$ 390 |
| Kitten Heel Cindy Maxi Bow Dress Blue | R$ 390 |
| Stretch Boots Klein | R$ 450 |
| Strecht Boots High Scarlet | R$ 640 |
| Stretch Boots Dress Blue | R$ 450 |
| Stretch Boots Pink | R$ 450 |
| Sandalia Big Bow Pearl | R$ 440 |
| Sandalia Multi Strap Multicolour | R$ 530 |
| Sandalia Funky Multicolor | R$ 420 |
| Sandalia Big Bow Bright Rose | R$ 390 |
| Sandalia Big Bow Satin Black | R$ 390 |
| Ankle Boot Block Heel Black | R$ 540 |
| Bota Block Heel Black | R$ 490 |
| Bota Block Heel Tratorada Black | R$ 520 |
| Combat Boots Black | R$ 450 |
| Combat Boots Sola Tratorada Leather Black | R$ 490 |
| Coturno Studs Black | R$ 790 |
| Combat Boots Block Heel Black | R$ 490 |
| Combat Boots Sola Tratorada Wood | R$ 540 |
| Combat Boots Sola Tratorada Leather Mouse | R$ 490 |
| Combat Boots Truffle | R$ 590 |
| Mule Block Heel Black | R$ 340 |
| Mule Block Heel Pearl | R$ 340 |
| Mule High Heel Pearl | R$ 350 |
| Sandalia Slingback Salto Bloco Black | R$ 360 |
| Mule High Heel Black | R$ 350 |
| Mule Croco Pearl | R$ 360 |
| Mule Croco Black | R$ 360 |
| Mule Vamp Croco Black | R$ 330 |
| Mule Vamp Croco Pearl | R$ 330 |
| Mule High Heel Bellini | R$ 380 |
| Sandalia Mika Pearl | R$ 390 |
| Sandalia Mika Black | R$ 420 |
| Sandalia Mika Lace Up Toasted Nut | R$ 390 |
| Sandalia Mika Dress Blue | R$ 390 |
| Sandalia Mika Medium Heel Aspen Green | R$ 390 |
| Scarpin Vibrant Green | R$ 370 |
| Scarpin Sport Blue | R$ 370 |
| Scarpin Bright Rose | R$ 370 |
| Scarpin Bright Orange | R$ 370 |
| Scarpin Tango Red | R$ 340 |
| Peep Toe Vamp Salto Bloco Desert | R$ 370 |
| Peep Toe Vamp Salto Bloco Bright Rose | R$ 370 |
| Peep Toe Vamp Salto Bloco Black | R$ 370 |
| Peep Toe Vamp Slingback Black | R$ 350 |
| Peep Toe Vamp Salto Bloco Tango Red | R$ 370 |
| Bota Bico Fino Black | R$ 510 |
| Bota River Black | R$ 490 |
| Skinny Boots Black | R$ 510 |
| Bota Slim Black | R$ 490 |
| Ankle Boot Triple Belt Black | R$ 590 |
| Flat Minimal Verniz Pearl | R$ 290 |
| Sandalia Zip Pearl | R$ 390 |
| Scarpin Lace Up Pearl | R$ 390 |
| Peep Toe Vamp Slingback Pearl | R$ 350 |
| Flat Slinback Pearl | R$ 290 |
| Baby Crossbody Kate Patches Black | R$ 350 |
| Baby Crossbody Kate Verniz Black | R$ 290 |
| Crossbody Black Malevola | R$ 490 |
| Baby Crossbody Kate Verniz Scarlet | R$ 290 |
| Sandalia Lace Up Black | R$ 380 |
| Sandalia Block Heel Lace Up Black | R$ 420 |
| Sandalia Block Heel Lace Up Bright Rose | R$ 420 |
| Sandalia Single Salto Bloco Jeans | R$ 350 |
| Sandalia Block Heel Lace Up Bellini | R$ 420 |
| Plataforma Maxi Satin Dress Blue | R$ 390 |
| Plataforma Sisal Heel Black | R$ 490 |
| Plataforma Braid Dress Blue | R$ 380 |
| Plataforma Maxi Satin Bright Rose | R$ 390 |
| Plataforma Slingback New Ethnic Black | R$ 520 |
| Sandalia Maxi Lace Verniz Black | R$ 450 |
| Sandalia Bow Tie Black | R$ 590 |
| Sandalia Lace Up Tango Red | R$ 380 |
| Sandalia Meia Pata New Goat | R$ 350 |
| Sandalia Mika Toasted Nut | R$ 420 |
| Flat Lace Up Aspen Green | R$ 320 |
| Flat Lace Up Aspen Green | R$ 290 |
| Flat Slinback Raw | R$ 330 |
| Flat Lace Up Jeans | R$ 320 |
| Flat Slinback Black | R$ 290 |
| Bota Zip Tratorada Wood | R$ 490 |
| Triangle Belt Pearl | R$ 190 |
| Basic Belt Desert | R$ 190 |
| Basic Belt Black | R$ 190 |
| Studs Belt Tango Red | R$ 280 |
| Thin Belt Tango Red | R$ 220 |
| Ankle Boot Maxi Plataform Black | R$ 520 |
| Mini Lorena Pins Black | R$ 990 |
| Lorie Media Black | R$ 490 |
| Lorie Media Tanino | R$ 490 |
| Tote Lorena Pins Black | R$ 1.350 |
| Mini Tote Monique Croco Wood | R$ 490 |
| Bota Zip Me Black | R$ 520 |
| Ankle Boot Studs Black | R$ 490 |
| Plataforma Braid Natural Black | R$ 430 |
| Plataforma Open Toe Toasted Nut | R$ 390 |
| Plataforma Open Toe Black | R$ 390 |
| Sandalia Slingback Salto Bloco Desert | R$ 360 |
| Sandalia Zip Black | R$ 390 |
| Sandalia Stripes Bright Rose | R$ 390 |
| Sandalia Stripes Bellini | R$ 390 |
| Sandalia Stripes Poppy Rose | R$ 380 |
| Sandalia Multi Strap Desert | R$ 530 |
| Bota Maxi Plataforma Black | R$ 580 |
| Crossbody Triangle Black | R$ 550 |
| Plataforma Natural Neutral | R$ 430 |
| Sandalia Wedge New Goat | R$ 390 |
| Plataforma Braid Ethnic Black | R$ 430 |
| Plataforma Embroidery Desert | R$ 490 |
| Plataforma Braid Desert | R$ 430 |
| Flat Maxi Knot Bright Rose | R$ 240 |
| Flat Minimal Black | R$ 190 |
| Flat Crystal Natural | R$ 390 |
| Fat Maxi Knot Poppy Rose | R$ 240 |
| Slide High Summer Black | R$ 290 |
| Sandalia Big Bow Tango Red | R$ 440 |
| Sandalia Big Bow Black | R$ 440 |
| Lorie Bowling Bag Tanino | R$ 450 |
| Lorie Crossbody Wood | R$ 290 |
| Lorie Bowling Bag Black | R$ 450 |
| Bolsa Bianca Black | R$ 990 |
| Lorie Crossbody Black | R$ 290 |
| Bota Western Studs Scarlet | R$ 590 |
| Bota Block Heel Scarlet | R$ 480 |
| Bolsa Joy Desert Ethnic | R$ 790 |
| Necessaire Pequena Bellini | R$ 190 |
| Kate Rafia Tango Red | R$ 290 |
| Bolsa Joy Black Ethnic | R$ 790 |
| Bolsa Abby Crossbody Media Black | R$ 490 |
| Slim Boots True Pink | R$ 480 |
| Bowling Triangle Black - Personalizacao Bag Charm | R$ 990 |
| Scarpin Sexy Heels Tanino | R$ 440 |
| Mochila Triangle Black | R$ 890 |
| Scarpin Sexy Heels Black | R$ 440 |
| Triangle Belt Black | R$ 190 |
| Thin Belt Belini | R$ 220 |
| Studs Belt Belini | R$ 280 |
| Scarpin Curves Bright Orange | R$ 350 |
| Sandalia Single Bright Orange | R$ 320 |
| Plataforma Open Toe New Goat | R$ 390 |
| Studs Belt Black | R$ 280 |
| Sandalia Ankle Strap Vibrant Green | R$ 320 |
| Kitten Heel Slingback Tango Red | R$ 320 |
| Scarpin Kitten Heel Toasted Nut | R$ 300 |
| Sandalia Meia Pata Tango Red | R$ 350 |
| Sapatilha Bico Fino Tango Red | R$ 270 |
| Sapatilha Bico Fino Verniz Black | R$ 270 |
| Scarpin Bellini | R$ 360 |
| Flat Minimal Bright Rose | R$ 290 |
| Flat Minimal Verniz Tango Rose | R$ 290 |
| Sandalia Lace Up Bellini | R$ 380 |
| Scarpin Lace Up Tango Red | R$ 420 |
| Flat Embroidery Raw | R$ 330 |
| Flat Slinback Dress Blue | R$ 330 |
| Bolsa Gil Black | R$ 590 |
| Slide High Summer Natural Desert | R$ 290 |
| Bolsa Bianca Media Black | R$ 890 |
| Scarpin Transparent Tango Red | R$ 340 |
| Bolsa 944 Media Studs Belini | R$ 890 |
| Bolsa Joy Black | R$ 690 |
| Plataforma Lace Up Desert | R$ 390 |
| Flat Espadrille Ballerina Toasted Nut | R$ 350 |
| Mochila Triangle Pearl | R$ 690 |
| Bolsa Abby Crossbody Media Wood | R$ 490 |
| Flat Stripes Dress Blue | R$ 180 |
| Triangle Belt Desert | R$ 190 |
| Scarpin Curves Bright Rose | R$ 350 |
| Sapatilha Bico Fino Raw | R$ 270 |
| Sandalia Organza Black | R$ 390 |
| Giovana Bucket Black | R$ 790 |
| Shopping Bag Giovana Black | R$ 850 |
| Mochila 944 Black | R$ 750 |
| Mochila Studs Red | R$ 790 |
| Bolsa Joy Tango Red | R$ 690 |
| Bolsa Joy Summer Jeans | R$ 790 |
| Bolsa Joy Prata | R$ 690 |
| Sandalia Flowers Jeans Blue | R$ 370 |
| Scarpin Ouro Rosa | R$ 360 |
| Sandalia Open Boot Black | R$ 420 |
| Flat Embroidery Black | R$ 330 |
| Bolsa Abby Crossbody Media Red | R$ 490 |
| Plataforma Crystal Desert | R$ 450 |
| Necessaire Pequena Tango Red | R$ 190 |
| Plataforma New Ethinic Colours | R$ 650 |
| Sandalia Wedge Desert | R$ 460 |
| Scarpin Transparent Dress Blue | R$ 340 |
| Flat Slingback Ethnic New Goat | R$ 410 |
| Mochila Studs Black | R$ 790 |
| Plataforma New Ethnic Multicolorido | R$ 430 |
| Plataforma New Ethnic Natural | R$ 430 |
| Flat Espadrille Ballerina Aspen Green | R$ 350 |
| Plataforma Lace Up Vibrant Green | R$ 390 |
| Sandalia Maxi Belt New Goat | R$ 420 |
| Thin Belt Black | R$ 220 |
| Bolsa Gil Tanino | R$ 590 |
| Plataforma Lace Up Bright Rose | R$ 390 |
| Mochila Triangle Black | R$ 690 |
| Flat Maxi Knot Vibrant Green | R$ 240 |
| Flat Lace Up Toasted Nut | R$ 290 |
| Scarpin Lace Up Black | R$ 420 |
| Flat Slinback Rose | R$ 330 |
| Ankle Boots Ziper Black | R$ 490 |
| Combat Boots Socks Black | R$ 570 |
| Bota New Western Studs Black | R$ 590 |
| Coturno Lines Wood | R$ 370 |
| Coturno Lines Black | R$ 370 |
| Bota Zip Me Leather Black | R$ 540 |
| Skinny Boots Strech Black | R$ 450 |
| Mini Emma Triangle Black - Personalizacao Bag Charm | NA |
| Baby Crossbody Kate Croco Black | NA |
| Crossbody Kate Tresse Black | NA |
| Shopping Valentina Borwine | NA |
| Mini Emma Triangle Black -Personalizacao Bag Charm | NA |
| Mala De Mao Triangle Black | NA |
| Bowling Triangle Pearl - Personalizacao Bag Charm | NA |
| Giovana Bucket Dress Blue | NA |
| Giovana Bucket Desert | NA |
| Plataforma Sino Wood | NA |
| Scarpin Satin Big Bow Poppy Rose | NA |
| Flat Embroidery Natural | NA |
| Sandalia Maxi Belt Dress Blue | NA |
| Mule Satin Glamour Black | NA |
| Mochila 944 Belini | NA |
| Bolsa Bianca Media Desert | NA |
| Karlie Studs Neutral Media | NA |
| Sandadlia Fringe Desert | NA |
| Giovana Pequena Dress Blue | NA |
| Flat Embroidery Black | NA |
| Flatform Braid Black | NA |
| Scarpin Verniz Big Bow Black | NA |
| Porta-Cartoes Desert | NA |
| Scarpin Tresse Poppy Rose | NA |
| Bolsa Karlie Bucket Black | NA |
| Mule Embroidery Black | NA |
| Flat Lace Up Desert | NA |
| Karlie Studs Neutral Media | NA |
| Plataforma Maxi Bow Jeans | NA |
| Bolsa Bianca Media Poppy Rose | NA |
| Sandalia Block Heel Wood | NA |
| Sandalia Braid Bow Toasted Nut | NA |
| Bolsa 944 Pequena Studs Black | NA |
| Bolsa Kate Laco Verniz Black | NA |
| Giovana Pequena Desert | NA |
| Bolsa 944 Baguette Belini | NA |
| Bolsa Media Black | NA |
| Bolsa Media Desert | NA |
| Bolsa Joy Black Pins | NA |
| Kitten Heel Tresse Poppy Rose | NA |
| Mule Maxi Barbicachos Multicolor | NA |
| Plataforma Sino Black | NA |
| Plataforma Sino Aspen Green | NA |
| Scarpin Natural Big Bow Raw | NA |
| Pochete Karlie Crossbody Black | NA |
| Bolsa Karlie Bucket Belini | NA |
| Plataforma Sino Heel Pearl | NA |
| Carteira Grande Studs Black | NA |
| Mule Satin Glamour Bright Rose | NA |
| Carteira Pequena Studs Black | NA |
| Carteira Pequena Studs Bellini | NA |
| Carteira Pequena Studs Tango Red | NA |
| Shopping Bag Giovana Dress Blue | NA |
| Flatform Crystals Black | NA |
| Flat Bow Tie Bellini | NA |
| Necessaire Pequena Studs Black | NA |
| Flatform Golden Black | NA |
| Flatform Braid Desert | NA |
| Karlie Desert Ethnic Bucket | NA |
| Porta-Cartoes Poppy Rose | NA |
| Mule Maxi Tassel Black | NA |
| Karlie Studs Neutral Media | NA |
| Mochila 944 | NA |
| Bolsa Gil Black | NA |
| Bolsa Kate Laco Verniz Red | NA |
| Bolsa Joy Poppy Rose | NA |
| Flat Lace Up Bright Rose | NA |
| Giovana Pequena Black | NA |
| Bolsa 944 Baguette Black | NA |
| Scarpin Lace Black | NA |
| Peep Toe Meia Pata Verniz Black | NA |
| Peep Toe Meia Pata Verniz Tanino | NA |
| Carteira Grande Tango Red | NA |
| Bolsa Bianca Desert | NA |
| Bolsa Joy Desert | NA |
| Shopping Bag Giovana Desert | NA |
| Scarpin Verniz Big Bow Tango Red | NA |
| Bolsa Gil Wood | R$ 430 |
At this point we could run some summary statistics or export our results to csv. But we’ll keep it short this time.