For the first DVN analysis, I thought I would have a play with this dataset, available from Kaggle, which contains scraped information about the trending YouTube videos in a number of countries starting from mid-November 2017 and ending mid-June 2018. I decided to focus just on the United States, Canada, and Great Britain’s data for simplicity. A large part of the desire to look at this stemmed from the fact that I find YouTube’s attempts to recommend videos to me pretty awful generally, so I wanted to see what other people found interesting.
Before we begin, it’s helpful to take a quick look at the rough shape of the data.
## Observations: 120,746
## Variables: 18
## $ country <chr> "CA", "CA", "CA", "CA", "CA", "CA", "CA...
## $ video_id <chr> "n1WpP7iowLc", "0dBIkQ4Mz1M", "5qpjK5Dg...
## $ trending_date <date> 2017-11-14, 2017-11-14, 2017-11-14, 20...
## $ title <chr> "Eminem - Walk On Water (Audio) ft. Bey...
## $ channel_title <chr> "EminemVEVO", "iDubbbzTV", "Rudy Mancus...
## $ category_id <int> 10, 23, 23, 24, 10, 25, 23, 22, 24, 22,...
## $ publish_time <dttm> 2017-11-10 17:00:03, 2017-11-13 17:00:...
## $ tags <chr> "Eminem\"|\"Walk\"|\"On\"|\"Water\"|\"A...
## $ views <int> 17158579, 1014651, 3191434, 2095828, 33...
## $ likes <int> 787425, 127794, 146035, 132239, 1634130...
## $ dislikes <int> 43420, 1688, 5339, 1989, 21082, 4613, 9...
## $ comment_count <int> 125882, 13030, 8181, 17518, 85067, 1214...
## $ thumbnail_link <chr> "https://i.ytimg.com/vi/n1WpP7iowLc/def...
## $ comments_disabled <lgl> FALSE, FALSE, FALSE, FALSE, FALSE, FALS...
## $ ratings_disabled <lgl> FALSE, FALSE, FALSE, FALSE, FALSE, FALS...
## $ video_error_or_removed <lgl> FALSE, FALSE, FALSE, FALSE, FALSE, FALS...
## $ description <chr> "Eminem's new track Walk on Water ft. B...
## $ category_name <chr> "Music", "Comedy", "Comedy", "Entertain...
The data includes a row each day the video trended, showing the video’s title, the date the video trended, the cumulative view count, and so on. If a video trended in multiple countries, there will be a row for each country. I also appended the name of the category the video was tagged under; this information was stored in JSON files that were included in the extract.
First, let’s find the videos with the highest view count for each country:
| country | title | category | start | end | days | views |
|---|---|---|---|---|---|---|
| CA | YouTube Rewind: The Shape of 2017 | #YouTubeRewind | Entertainment | 2017-12-07 | 2017-12-13 | 7 | 137843120 |
| CA | Childish Gambino - This Is America (Official Video) | Music | 2018-05-06 | 2018-05-13 | 8 | 98938809 |
| CA | Marvel Studios’ Avengers: Infinity War Official Trailer | Entertainment | 2017-11-30 | 2017-12-07 | 8 | 89930713 |
| CA | BTS () ‘FAKE LOVE’ Official MV | Music | 2018-05-19 | 2018-05-23 | 5 | 80738011 |
| CA | Nicky Jam x J. Balvin - X (EQUIS) | Video Oficial | Prod. Afro Bros & Jeon | Music | 2018-03-04 | 2018-03-06 | 3 | 61163906 |
| GB | Nicky Jam x J. Balvin - X (EQUIS) | Video Oficial | Prod. Afro Bros & Jeon | Music | 2018-03-04 | 2018-04-07 | 35 | 424538912 |
| GB | Te Bote Remix - Casper, Nio García, Darell, Nicky Jam, Bad Bunny, Ozuna | Video Oficial | Music | 2018-04-14 | 2018-05-18 | 35 | 337621571 |
| GB | Bad Bunny - Amorfoda | Video Oficial | Music | 2018-02-16 | 2018-03-23 | 36 | 328860380 |
| GB | Ozuna x Romeo Santos - El Farsante Remix | Music | 2018-02-01 | 2018-03-01 | 29 | 288811992 |
| GB | Childish Gambino - This Is America (Official Video) | Music | 2018-05-07 | 2018-06-11 | 36 | 259721696 |
| US | Childish Gambino - This Is America (Official Video) | Music | 2018-05-08 | 2018-06-02 | 26 | 225211923 |
| US | YouTube Rewind: The Shape of 2017 | #YouTubeRewind | Entertainment | 2017-12-07 | 2017-12-14 | 8 | 149376127 |
| US | Ariana Grande - No Tears Left To Cry | Music | 2018-04-21 | 2018-05-14 | 24 | 148689896 |
| US | Becky G, Natti Natasha - Sin Pijama (Official Video) | Music | 2018-04-21 | 2018-05-15 | 25 | 139334502 |
| US | BTS () ‘FAKE LOVE’ Official MV | Music | 2018-05-19 | 2018-06-01 | 14 | 123010920 |
As would make sense, the videos with the highest number of views are generally either music clips or ‘entertainment’ (often movie trailers). People generally don’t watch hour-long video essays over and over, but will quite happily loop music in the background.
Next, let’s shuffle things around a bit and find the videos with the longest days on the ‘trending’ list for each country:
| country | title | category | start | end | days | views |
|---|---|---|---|---|---|---|
| CA | NERF Robot Prison Escape Challenge! | Entertainment | 2017-11-28 | 2018-06-14 | 199 | 682992 |
| CA | NERF Stash Your Cash Challenge! | Entertainment | 2018-01-09 | 2018-06-08 | 151 | 474404 |
| CA | Mission: Impossible - Fallout (2018) - Official Trailer - Paramount Pictures | Film & Animation | 2018-02-05 | 2018-05-20 | 105 | 13942445 |
| CA | Most Popular Violin Covers of Popular Songs 2018 || Best Instrumental Violin Covers 2018 | People & Blogs | 2017-11-30 | 2018-03-14 | 105 | 1638037 |
| CA | lofi hip hop radio - beats to relax/study to | Music | 2017-12-04 | 2018-03-09 | 96 | 1072653 |
| GB | Maroon 5 - Wait | Music | 2018-02-06 | 2018-03-17 | 40 | 46205645 |
| GB | Jurassic World: Fallen Kingdom - Official Trailer #2 [HD] | Entertainment | 2018-02-05 | 2018-03-14 | 38 | 24293173 |
| GB | Justin Timberlakes FULL Pepsi Super Bowl LII Halftime Show! | NFL Highlights | Sports | 2018-02-05 | 2018-03-14 | 38 | 14251760 |
| GB | To Our Daughter | People & Blogs | 2018-02-05 | 2018-03-14 | 38 | 62338362 |
| GB | Whethan, Dua Lipa - High (Audio) | Music | 2018-02-09 | 2018-03-17 | 37 | 7285185 |
| US | Mission: Impossible - Fallout (2018) - Official Trailer - Paramount Pictures | Film & Animation | 2018-02-05 | 2018-06-05 | 121 | 16651726 |
| US | Selena Gomez, Marshmello - Wolves | Music | 2017-11-19 | 2017-12-29 | 41 | 20752341 |
| US | clickbait | Film & Animation | 2018-04-14 | 2018-05-15 | 32 | 1800130 |
| US | Maroon 5 - Wait | Music | 2018-01-18 | 2018-02-18 | 32 | 18312570 |
| US | Mirror-Polished Japanese Foil Ball Challenge Crushed in a Hydraulic Press-What’s Inside? | Entertainment | 2018-04-14 | 2018-05-15 | 32 | 18726265 |
It’s interesting that this seems to be a completely different list; sure, it’s still music and movie trailers in large part, but it looks like the videos with sustained interest tend to get lower view counts overall. It’s also worth noting that in a number of cases, the ‘category’ here feels a bit off; “Popular Violin Covers” is tagged as “People and Blogs”, but could just as easily (possibly more appropriately?) have been placed under “Music”.
Okay, so next we’ll look at the trends. Here are the cumulative views charted each day for the videos ending with more than 5 * 10 ^ 7 views: Colour here indicates the video - so if there are lines (at roughly the same time) with the same colour, they’re the same video.
The first thing I noticed here is that Canada has much lower volumes in general than the other two. Particularly Great Britain, but also the more recent trending data from the middle of April for the United States. The other thing that comes across is that there seems to be some missing data between the end of March and the middle of April. At a guess the scraper that was being used failed? Another thing to note is that one particular trend line in the data for Great Britain appears to go down, not up, which seems like an error. Maybe the video was deleted and then reuploaded?
Let’s rerun that static chart as an interactive plot.ly chart so we can play with it.
The interactive plot lets you mouse over individual points in the chart and identify them. It becomes clear that in many cases the same videos are trending in all three countries, but with different levels of enthusiasm. Ed Sheeran’s song “Perfect” trended everywhere, but it was on the top list for Canada for a mere two days, while Great Britain watched it for two weeks. On the other hand, many of the videos that were extremely popular in Britain (such as “Nicky Jam x J. Balvin - X (EQUIS)”) seem to have been barely a footnote in the other two countries. It also lets us discover that the weird “and now its volume has dropped again” video was titled ‘Cobra Kai Ep 2 - Strike First - The Karate Kid Saga Continues’. Maybe it was taken down for copyright infringement!
As a final thing, I wanted to run the charts again but removing all of the videos tagged with “Music” or “Entertainment”, to see the other types of videos that trend. Here’s that chart; the colouring here is the YouTube category applied to the video. Since there’s significantly fewer of them, I’ll drop the minimum view count filter to just 10^7 for this one.
Hey, look! It’s some different videos! How novel! Which lets us discover that many of the remaining items are also either music videos or movie trailers. Sigh. It also highlights that that possibly interesting-sounding video titled “To Our Daughter” is posted by Kylie Jenner and can probably be safely skipped. I guess we’ve discovered why these videos aren’t to my taste, haven’t we?