Cleaning Movie Data

Raw data information

Movie data it contains 4998 rows and 28 columns
Name Type No. Levels No. Missing No. Valid
actor_1_name Categorical 2097 7 4991
actor_2_name Categorical 3032 13 4985
actor_3_name Categorical 3521 23 4975
color Categorical 2 19 4979
content_rating Categorical 18 301 4697
country Categorical 65 5 4993
director_name Categorical 2398 103 4895
genres Categorical 914 0 4998
language Categorical 47 12 4986
movie_imdb_link Categorical 4919 0 4998
movie_title Categorical 4916 0 4998
plot_keywords Categorical 4760 152 4846
actor_1_facebook_likes Continuous NA 7 4991
actor_2_facebook_likes Continuous NA 13 4985
actor_3_facebook_likes Continuous NA 23 4975
aspect_ratio Continuous NA 327 4671
budget Continuous NA 491 4507
cast_total_facebook_likes Continuous NA 0 4998
director_facebook_likes Continuous NA 103 4895
duration Continuous NA 15 4983
facenumber_in_poster Continuous NA 13 4985
gross Continuous NA 874 4124
imdb_score Continuous NA 0 4998
movie_facebook_likes Continuous NA 0 4998
num_critic_for_reviews Continuous NA 49 4949
num_user_for_reviews Continuous NA 21 4977
num_voted_users Continuous NA 0 4998
title_year Continuous NA 107 4891

Categorical variables

Split movie genres variable

Spliting movie genres variable into many columns (Ten rows)
genres genre_1 genre_2 genre_3 genre_4 genre_5 genre_6 genre_7 genre_8
Action|Adventure|Fantasy|Sci-Fi Action Adventure Fantasy Sci-Fi NA NA NA NA
Action|Adventure|Fantasy Action Adventure Fantasy NA NA NA NA NA
Action|Adventure|Thriller Action Adventure Thriller NA NA NA NA NA
Action|Thriller Action Thriller NA NA NA NA NA NA
Documentary Documentary NA NA NA NA NA NA NA
Action|Adventure|Sci-Fi Action Adventure Sci-Fi NA NA NA NA NA
Action|Adventure|Romance Action Adventure Romance NA NA NA NA NA
Adventure|Animation|Comedy|Family|Fantasy|Musical|Romance Adventure Animation Comedy Family Fantasy Musical Romance NA
Action|Adventure|Sci-Fi Action Adventure Sci-Fi NA NA NA NA NA
Adventure|Family|Fantasy|Mystery Adventure Family Fantasy Mystery NA NA NA NA

Reduce dimension of content_rating variables

Variable content_rating befor binning
content_rating Frequency Proportion
R 2098 0.420
PG-13 1444 0.289
PG 698 0.140
NA 301 0.060
Not Rated 116 0.023
G 112 0.022
Unrated 60 0.012
Approved 55 0.011
TV-14 30 0.006
TV-MA 19 0.004
TV-PG 13 0.003
X 13 0.003
TV-G 10 0.002
Passed 9 0.002
NC-17 7 0.001
GP 6 0.001
M 5 0.001
TV-Y 1 0.000
TV-Y7 1 0.000
Variable content_rating after binning
content_rating Frequency Proportion
PG-13 2148 0.430
R 2098 0.420
NA 301 0.060
Unrated 176 0.035
G-M-X 130 0.026
TV > 14 81 0.016
Passed 64 0.013

Reduce dimension of country variables

Variable country befor binning (Top 10)
country Frequency Proportion
USA 3773 0.755
UK 443 0.089
France 154 0.031
Canada 124 0.025
Germany 96 0.019
Australia 55 0.011
India 34 0.007
Spain 33 0.007
China 28 0.006
Italy 23 0.005
Variable country after binning
country Frequency Proportion
USA 3773 0.755
Others 777 0.155
UK 443 0.089
NA 5 0.001

Reduce dimension of language variables

Variable language befor binning (Top 10)
language Frequency Proportion
English 4662 0.933
French 73 0.015
Spanish 40 0.008
Hindi 28 0.006
Mandarin 24 0.005
German 19 0.004
Japanese 17 0.003
NA 12 0.002
Cantonese 11 0.002
Italian 11 0.002
Russian 11 0.002
Variable language after binning
language Frequency Proportion
English 4662 0.933
Others 324 0.065
NA 12 0.002

Vizualisation

Movie genres level

Movie top actors and directors

Movies other variables

Continuous variables

Descriptive statistics

Descriptive statistics
name mean median min max
actor_1_facebook_likes 6556.94 984.00 0.00 640000.0
actor_2_facebook_likes 1643.00 595.00 0.00 137000.0
actor_3_facebook_likes 639.90 369.00 0.00 23000.0
aspect_ratio 2.22 2.35 1.18 16.0
budget 35053725.67 20000000.00 218.00 2127519898.0
cast_total_facebook_likes 9676.94 3085.50 0.00 656730.0
director_facebook_likes 688.68 49.00 0.00 23000.0
duration 107.21 103.00 7.00 511.0
facenumber_in_poster 1.37 1.00 0.00 43.0
gross 48325648.89 25445749.00 162.00 760505847.0
imdb_score 6.44 6.60 1.60 9.5
movie_facebook_likes 7487.43 162.50 0.00 349000.0
num_critic_for_reviews 139.89 110.00 1.00 813.0
num_user_for_reviews 272.01 156.00 1.00 5060.0
num_voted_users 83470.20 34260.50 5.00 1689764.0
Top 10 years
title_year Frequency Proportion
2009 258 0.052
2014 248 0.050
2006 238 0.048
2013 236 0.047
2010 229 0.046
2008 225 0.045
2011 225 0.045
2015 222 0.044
2005 221 0.044
2012 218 0.044