SEO Data Lab 6

SEO Data Scrape: L.L.Bean, Patagonia, Nike

urls <- c(
  "https://www.llbean.com",
  "https://www.patagonia.com",
  "https://www.nike.com"
)

results <- list()

for (i in seq_along(urls)) {
  Sys.sleep(1.5)
  page <- read_html(urls[i])

  title_tag <- page %>%
    html_element("title") %>%
    html_text2() %>%
    str_squish()

  meta_desc <- page %>%
    html_element("meta[name='description']") %>%
    html_attr("content") %>%
    str_squish()

  h1_tags <- page %>%
    html_elements("h1") %>%
    html_text2() %>%
    str_squish() %>%
    str_c(collapse = " | ")

  h2_tags <- page %>%
    html_elements("h2") %>%
    html_text2() %>%
    str_squish() %>%
    str_c(collapse = " | ")

  h3_tags <- page %>%
    html_elements("h3") %>%
    html_text2() %>%
    str_squish() %>%
    str_c(collapse = " | ")

  results[[i]] <- tibble(
    url = urls[i],
    title = title_tag,
    meta_description = meta_desc,
    h1 = h1_tags,
    h2 = h2_tags,
    h3 = h3_tags
  )
}

seo_data <- bind_rows(results)

Results

kable(seo_data, col.names = c("URL", "Title", "Meta Description", "H1", "H2", "H3"))

URL	Title	Meta Description	H1	H2	H3
https://www.llbean.com	L.L.Bean - Outside Together Since 1912	Enjoy Free Shipping with $75 purchase on clothing, shoes, outdoor gear and more, all made for the shared joy of the outdoors.	L.L.Bean - Outside Together Since 1912. Free Shipping with $75 purchase.	It’s time to upgrade your browser | Best Worn to Make Summer Memories | Best Worn to Make Summer Memories
https://www.patagonia.com	Hang Tight! Routing to checkout…	NA		Sit tight	U.S. & CANADA | EUROPE | JAPAN
https://www.nike.com	Nike. Just Do It. Nike.com	Inspiring the world’s athletes, Nike delivers innovative products, experiences and services.		Run Free, Play Forever | Nike Vapor Edge 360 “Untouchable” | Run Free, Play Forever | Nike Vapor Edge 360 “Untouchable” | Lock In. Level Up. | Lock In. Level Up. | TRENDING | TRENDING | Africa | Americas | Asia Pacific | Europe | Middle East	ROWING STRONG | HIS LEGEND LIVES ON | IRRATIONAL BELIEF | THREE LION HEARTED | ROWING STRONG | HIS LEGEND LIVES ON | SWEAT. PROOF. | SWEAT. PROOF. | ACG Radical AirFlow | Play outside the lines with Nike Free Ride’s flexible innovation, now in fresh new colors. | The cleat that took the world by storm, modernized with our greatest innovations. | Nothing sweet About it | A Striking Approach | One on Anyone | Play outside the lines with Nike Free Ride’s flexible innovation, now in fresh new colors. | The cleat that took the world by storm, modernized with our greatest innovations. | Nothing sweet About it | A Striking Approach | One on Anyone | Practice Ready | First Day Footwear | Classroom Ready | Bring serious style to their everyday game. | FULL HORSEPOWER | FULL HORSEPOWER