For this homework, we will investigate the Movie2.csv dataset located on D2L. The dataset contains information for movies since 2010. Be sure to download the file to your computer and import using “Import Dataset”, then “From Text File…”
Answer all questions completely. Explain in complete sentences, do not just submit code. See the Day4PracticeSolution.Rmd file for an example of what is expected. You may use any R functions to help answer the questions.
a) Using forward selection (with AIC), find the best subset of predictor variables to predict Box.Office.
## Start: AIC=21321.52
## Box.Office ~ 1
##
## Df Sum of Sq RSS AIC
## + Theatres 1 1.9800e+18 2.4584e+18 20979
## + Budget 1 1.9453e+18 2.4931e+18 20987
## + Sequel 1 6.4531e+17 3.7931e+18 21232
## + Action 1 4.9314e+17 3.9453e+18 21255
## + R 1 2.6847e+17 4.1699e+18 21287
## + Season2 1 2.2761e+17 4.2108e+18 21293
## + Writing 1 1.8902e+17 4.2494e+18 21298
## + Season1 1 1.2136e+17 4.3170e+18 21307
## + PG13 1 1.0624e+17 4.3322e+18 21309
## + Horror 1 8.2679e+16 4.3557e+18 21313
## + Comedy 1 6.4364e+16 4.3740e+18 21315
## + Drama 1 5.3374e+16 4.3850e+18 21317
## + Thriller 1 3.5588e+16 4.4028e+18 21319
## + G 1 2.5547e+16 4.4128e+18 21320
## + PG 1 1.9613e+16 4.4188e+18 21321
## + RealLife 1 1.9296e+16 4.4191e+18 21321
## + Season3 1 1.9031e+16 4.4194e+18 21321
## <none> 4.4384e+18 21322
## + GOther 1 3.4998e+15 4.4349e+18 21323
## + SOthers 1 8.8164e+14 4.4375e+18 21323
## + NonOriginal 1 7.4731e+13 4.4383e+18 21324
##
## Step: AIC=20979.08
## Box.Office ~ Theatres
##
## Df Sum of Sq RSS AIC
## + Budget 1 3.7618e+17 2.0822e+18 20884
## + Sequel 1 1.2168e+17 2.3367e+18 20952
## + Season1 1 4.4363e+16 2.4140e+18 20971
## + Season2 1 3.9151e+16 2.4192e+18 20972
## + Writing 1 2.7391e+16 2.4310e+18 20975
## + PG13 1 2.7183e+16 2.4312e+18 20975
## + R 1 1.6358e+16 2.4420e+18 20977
## + Action 1 1.6105e+16 2.4423e+18 20977
## + Horror 1 1.3496e+16 2.4449e+18 20978
## + Comedy 1 1.3367e+16 2.4450e+18 20978
## <none> 2.4584e+18 20979
## + RealLife 1 8.0290e+15 2.4503e+18 20979
## + PG 1 7.2926e+15 2.4511e+18 20979
## + G 1 4.9078e+15 2.4534e+18 20980
## + Drama 1 4.1396e+15 2.4542e+18 20980
## + NonOriginal 1 2.5414e+15 2.4558e+18 20981
## + SOthers 1 1.8631e+15 2.4565e+18 20981
## + GOther 1 1.5062e+15 2.4569e+18 20981
## + Thriller 1 2.2507e+14 2.4581e+18 20981
## + Season3 1 1.6799e+14 2.4582e+18 20981
##
## Step: AIC=20884.26
## Box.Office ~ Theatres + Budget
##
## Df Sum of Sq RSS AIC
## + Sequel 1 7.5366e+16 2.0068e+18 20865
## + Action 1 2.6413e+16 2.0558e+18 20879
## + Season2 1 1.6667e+16 2.0655e+18 20882
## + RealLife 1 1.5316e+16 2.0669e+18 20882
## + Season1 1 1.4044e+16 2.0681e+18 20882
## + Drama 1 9.7615e+15 2.0724e+18 20884
## + SOthers 1 7.5097e+15 2.0747e+18 20884
## <none> 2.0822e+18 20884
## + PG 1 6.7487e+15 2.0754e+18 20884
## + PG13 1 4.0048e+15 2.0782e+18 20885
## + Comedy 1 3.6590e+15 2.0785e+18 20885
## + G 1 3.4419e+15 2.0787e+18 20885
## + Horror 1 3.0851e+15 2.0791e+18 20885
## + Writing 1 2.0657e+15 2.0801e+18 20886
## + NonOriginal 1 1.4059e+15 2.0808e+18 20886
## + GOther 1 1.2000e+15 2.0810e+18 20886
## + Thriller 1 1.0118e+15 2.0812e+18 20886
## + R 1 1.9148e+14 2.0820e+18 20886
## + Season3 1 1.2725e+14 2.0821e+18 20886
##
## Step: AIC=20864.76
## Box.Office ~ Theatres + Budget + Sequel
##
## Df Sum of Sq RSS AIC
## + Action 1 3.4203e+16 1.9726e+18 20857
## + RealLife 1 1.7270e+16 1.9895e+18 20862
## + Season2 1 1.2653e+16 1.9942e+18 20863
## + Drama 1 1.2060e+16 1.9948e+18 20863
## + SOthers 1 1.1721e+16 1.9951e+18 20863
## + Season1 1 7.7574e+15 1.9991e+18 20865
## <none> 2.0068e+18 20865
## + Horror 1 6.0203e+15 2.0008e+18 20865
## + PG 1 5.1471e+15 2.0017e+18 20865
## + PG13 1 5.0657e+15 2.0017e+18 20865
## + Thriller 1 3.6615e+15 2.0032e+18 20866
## + Writing 1 3.1622e+15 2.0036e+18 20866
## + Comedy 1 2.9924e+15 2.0038e+18 20866
## + GOther 1 2.7233e+15 2.0041e+18 20866
## + G 1 1.6095e+15 2.0052e+18 20866
## + R 1 6.9548e+14 2.0061e+18 20867
## + Season3 1 6.4688e+14 2.0062e+18 20867
## + NonOriginal 1 4.3240e+14 2.0064e+18 20867
##
## Step: AIC=20856.74
## Box.Office ~ Theatres + Budget + Sequel + Action
##
## Df Sum of Sq RSS AIC
## + RealLife 1 1.4399e+16 1.9582e+18 20855
## + Season2 1 1.1799e+16 1.9608e+18 20855
## + Horror 1 1.0287e+16 1.9623e+18 20856
## + SOthers 1 9.8596e+15 1.9627e+18 20856
## + Writing 1 6.8384e+15 1.9658e+18 20857
## <none> 1.9726e+18 20857
## + Season1 1 4.6257e+15 1.9680e+18 20857
## + Drama 1 4.3096e+15 1.9683e+18 20858
## + PG 1 2.4235e+15 1.9702e+18 20858
## + PG13 1 2.2589e+15 1.9704e+18 20858
## + G 1 1.9193e+15 1.9707e+18 20858
## + Season3 1 1.7735e+15 1.9708e+18 20858
## + GOther 1 1.0008e+15 1.9716e+18 20858
## + NonOriginal 1 7.8074e+14 1.9718e+18 20859
## + R 1 4.6537e+14 1.9721e+18 20859
## + Comedy 1 4.4936e+14 1.9722e+18 20859
## + Thriller 1 2.0258e+14 1.9724e+18 20859
##
## Step: AIC=20854.47
## Box.Office ~ Theatres + Budget + Sequel + Action + RealLife
##
## Df Sum of Sq RSS AIC
## + Season2 1 1.1323e+16 1.9469e+18 20853
## + Writing 1 1.0725e+16 1.9475e+18 20853
## + SOthers 1 9.3394e+15 1.9489e+18 20854
## + Horror 1 9.0708e+15 1.9491e+18 20854
## <none> 1.9582e+18 20855
## + Season1 1 4.3799e+15 1.9538e+18 20855
## + PG 1 3.5897e+15 1.9546e+18 20855
## + PG13 1 2.2742e+15 1.9559e+18 20856
## + Season3 1 1.7377e+15 1.9565e+18 20856
## + G 1 1.7145e+15 1.9565e+18 20856
## + Thriller 1 1.0525e+15 1.9572e+18 20856
## + Drama 1 7.8146e+14 1.9574e+18 20856
## + GOther 1 6.3954e+14 1.9576e+18 20856
## + NonOriginal 1 1.9817e+14 1.9580e+18 20856
## + R 1 1.3426e+14 1.9581e+18 20856
## + Comedy 1 1.2589e+13 1.9582e+18 20857
##
## Step: AIC=20853.09
## Box.Office ~ Theatres + Budget + Sequel + Action + RealLife +
## Season2
##
## Df Sum of Sq RSS AIC
## + Writing 1 1.1872e+16 1.9350e+18 20852
## + Horror 1 9.7141e+15 1.9372e+18 20852
## + SOthers 1 8.5944e+15 1.9383e+18 20853
## <none> 1.9469e+18 20853
## + PG 1 2.8560e+15 1.9440e+18 20854
## + Thriller 1 1.7764e+15 1.9451e+18 20855
## + PG13 1 1.7426e+15 1.9451e+18 20855
## + G 1 1.3973e+15 1.9455e+18 20855
## + Drama 1 1.0408e+15 1.9458e+18 20855
## + GOther 1 6.0094e+14 1.9463e+18 20855
## + NonOriginal 1 2.9702e+14 1.9466e+18 20855
## + Season1 1 2.1482e+14 1.9467e+18 20855
## + Season3 1 2.1482e+14 1.9467e+18 20855
## + Comedy 1 1.6079e+14 1.9467e+18 20855
## + R 1 9.2312e+13 1.9468e+18 20855
##
## Step: AIC=20851.52
## Box.Office ~ Theatres + Budget + Sequel + Action + RealLife +
## Season2 + Writing
##
## Df Sum of Sq RSS AIC
## + Horror 1 8.5907e+15 1.9264e+18 20851
## <none> 1.9350e+18 20852
## + SOthers 1 6.2532e+15 1.9288e+18 20852
## + PG 1 2.7473e+15 1.9323e+18 20853
## + G 1 1.6158e+15 1.9334e+18 20853
## + Thriller 1 1.6046e+15 1.9334e+18 20853
## + PG13 1 6.1105e+14 1.9344e+18 20853
## + GOther 1 5.1228e+14 1.9345e+18 20853
## + NonOriginal 1 2.8096e+14 1.9347e+18 20853
## + Season1 1 1.2290e+14 1.9349e+18 20854
## + Season3 1 1.2290e+14 1.9349e+18 20854
## + Drama 1 1.1143e+14 1.9349e+18 20854
## + R 1 6.2471e+13 1.9350e+18 20854
## + Comedy 1 1.7933e+13 1.9350e+18 20854
##
## Step: AIC=20850.93
## Box.Office ~ Theatres + Budget + Sequel + Action + RealLife +
## Season2 + Writing + Horror
##
## Df Sum of Sq RSS AIC
## <none> 1.9264e+18 20851
## + SOthers 1 5.0447e+15 1.9214e+18 20851
## + PG 1 3.4823e+15 1.9229e+18 20852
## + G 1 1.3998e+15 1.9250e+18 20853
## + NonOriginal 1 8.5401e+14 1.9256e+18 20853
## + Comedy 1 6.8077e+14 1.9257e+18 20853
## + Thriller 1 6.5382e+14 1.9258e+18 20853
## + PG13 1 4.1324e+14 1.9260e+18 20853
## + R 1 3.8927e+14 1.9260e+18 20853
## + GOther 1 3.0601e+14 1.9261e+18 20853
## + Season1 1 1.5545e+14 1.9263e+18 20853
## + Season3 1 1.5545e+14 1.9263e+18 20853
## + Drama 1 1.7473e+13 1.9264e+18 20853
##
## Call:
## lm(formula = Box.Office ~ Theatres + Budget + Sequel + Action +
## RealLife + Season2 + Writing + Horror, data = Movie2)
##
## Residuals:
## Min 1Q Median 3Q Max
## -166838330 -32992802 -6237790 21913890 392411728
##
## Coefficients:
## Estimate Std. Error t value Pr(>|t|)
## (Intercept) -1.169e+08 1.352e+07 -8.644 < 2e-16 ***
## Theatres 5.022e+04 5.016e+03 10.011 < 2e-16 ***
## Budget 6.063e-01 6.244e-02 9.709 < 2e-16 ***
## Sequel 3.297e+07 6.460e+06 5.104 4.52e-07 ***
## Action -2.138e+07 6.282e+06 -3.404 0.00071 ***
## RealLife 2.013e+07 9.104e+06 2.211 0.02741 *
## Season2 1.021e+07 5.178e+06 1.972 0.04913 *
## Writing 9.865e+06 5.512e+06 1.790 0.07404 .
## Horror -1.683e+07 1.052e+07 -1.600 0.11017
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
## Residual standard error: 57930000 on 574 degrees of freedom
## Multiple R-squared: 0.566, Adjusted R-squared: 0.5599
## F-statistic: 93.56 on 8 and 574 DF, p-value: < 2.2e-16
The best subset of predictor variables to predict Box.Office based on forward selection (with AIC) is Theatres, Budget, Sequel, Action, RealLife, Season2, Writing, and Horror.
b) Using backward elimination (with AIC), find the best subset of predictor variables to predict Box.Office.
## Start: AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG +
## PG13 + R + Season1 + Season2 + Season3 + Action + Comedy +
## Drama + Horror + GOther + Thriller + RealLife + Writing +
## NonOriginal + Original + Screenplay + SOthers
##
##
## Step: AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG +
## PG13 + R + Season1 + Season2 + Season3 + Action + Comedy +
## Drama + Horror + GOther + Thriller + RealLife + Writing +
## NonOriginal + Original + SOthers
##
##
## Step: AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG +
## PG13 + R + Season1 + Season2 + Season3 + Action + Comedy +
## Drama + Horror + GOther + Thriller + RealLife + Writing +
## NonOriginal + SOthers
##
##
## Step: AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG +
## PG13 + R + Season1 + Season2 + Season3 + Action + Comedy +
## Drama + Horror + GOther + RealLife + Writing + NonOriginal +
## SOthers
##
##
## Step: AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG +
## PG13 + R + Season1 + Season2 + Action + Comedy + Drama +
## Horror + GOther + RealLife + Writing + NonOriginal + SOthers
##
##
## Step: AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG +
## PG13 + Season1 + Season2 + Action + Comedy + Drama + Horror +
## GOther + RealLife + Writing + NonOriginal + SOthers
##
##
## Step: AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + PG + PG13 + Season1 +
## Season2 + Action + Comedy + Drama + Horror + GOther + RealLife +
## Writing + NonOriginal + SOthers
##
## Df Sum of Sq RSS AIC
## - PG13 1 2.6415e+13 1.9149e+18 20863
## - GOther 1 8.1922e+13 1.9149e+18 20863
## - Drama 1 1.0319e+14 1.9150e+18 20864
## - Season1 1 2.7187e+14 1.9151e+18 20864
## - Comedy 1 5.0062e+14 1.9154e+18 20864
## - NonOriginal 1 5.4848e+14 1.9154e+18 20864
## - G 1 7.7291e+14 1.9156e+18 20864
## - PG 1 2.8300e+15 1.9177e+18 20864
## - SOthers 1 4.8018e+15 1.9197e+18 20865
## <none> 1.9149e+18 20865
## - Season2 1 7.0474e+15 1.9219e+18 20866
## - Horror 1 7.8770e+15 1.9227e+18 20866
## - Writing 1 8.3308e+15 1.9232e+18 20866
## - RealLife 1 1.4657e+16 1.9295e+18 20868
## - Action 1 2.0273e+16 1.9351e+18 20870
## - Sequel 1 8.5859e+16 2.0007e+18 20889
## - Budget 1 2.8985e+17 2.2047e+18 20946
## - Theatres 1 3.2892e+17 2.2438e+18 20956
##
## Step: AIC=20863.43
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season1 +
## Season2 + Action + Comedy + Drama + Horror + GOther + RealLife +
## Writing + NonOriginal + SOthers
##
## Df Sum of Sq RSS AIC
## - GOther 1 7.8120e+13 1.9150e+18 20862
## - Drama 1 1.1615e+14 1.9150e+18 20862
## - Season1 1 2.8009e+14 1.9152e+18 20862
## - Comedy 1 4.8913e+14 1.9154e+18 20862
## - NonOriginal 1 5.5771e+14 1.9154e+18 20862
## - G 1 8.7305e+14 1.9158e+18 20862
## - PG 1 3.4962e+15 1.9184e+18 20863
## - SOthers 1 4.7981e+15 1.9197e+18 20863
## <none> 1.9149e+18 20863
## - Season2 1 7.0222e+15 1.9219e+18 20864
## - Horror 1 7.8569e+15 1.9227e+18 20864
## - Writing 1 8.3340e+15 1.9232e+18 20864
## - RealLife 1 1.4652e+16 1.9295e+18 20866
## - Action 1 2.0274e+16 1.9352e+18 20868
## - Sequel 1 8.5914e+16 2.0008e+18 20887
## - Budget 1 2.9828e+17 2.2132e+18 20946
## - Theatres 1 3.3056e+17 2.2454e+18 20954
##
## Step: AIC=20861.45
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season1 +
## Season2 + Action + Comedy + Drama + Horror + RealLife + Writing +
## NonOriginal + SOthers
##
## Df Sum of Sq RSS AIC
## - Drama 1 2.1017e+14 1.9152e+18 20860
## - Season1 1 3.0130e+14 1.9153e+18 20860
## - NonOriginal 1 6.2939e+14 1.9156e+18 20860
## - Comedy 1 7.2702e+14 1.9157e+18 20860
## - G 1 9.2320e+14 1.9159e+18 20860
## - PG 1 3.4182e+15 1.9184e+18 20861
## - SOthers 1 4.7652e+15 1.9197e+18 20861
## <none> 1.9150e+18 20862
## - Season2 1 7.0318e+15 1.9220e+18 20862
## - Writing 1 8.4644e+15 1.9234e+18 20862
## - Horror 1 8.7477e+15 1.9237e+18 20862
## - RealLife 1 1.5122e+16 1.9301e+18 20864
## - Action 1 2.4012e+16 1.9390e+18 20867
## - Sequel 1 8.5865e+16 2.0008e+18 20885
## - Budget 1 2.9866e+17 2.2136e+18 20944
## - Theatres 1 3.3089e+17 2.2459e+18 20952
##
## Step: AIC=20859.51
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season1 +
## Season2 + Action + Comedy + Horror + RealLife + Writing +
## NonOriginal + SOthers
##
## Df Sum of Sq RSS AIC
## - Season1 1 3.0662e+14 1.9155e+18 20858
## - Comedy 1 5.1726e+14 1.9157e+18 20858
## - NonOriginal 1 6.0446e+14 1.9158e+18 20858
## - G 1 9.4522e+14 1.9161e+18 20858
## - PG 1 3.5675e+15 1.9187e+18 20859
## - SOthers 1 4.8166e+15 1.9200e+18 20859
## <none> 1.9152e+18 20860
## - Season2 1 6.9618e+15 1.9221e+18 20860
## - Writing 1 8.2628e+15 1.9234e+18 20860
## - Horror 1 8.8883e+15 1.9241e+18 20860
## - RealLife 1 1.5410e+16 1.9306e+18 20862
## - Action 1 2.9223e+16 1.9444e+18 20866
## - Sequel 1 8.5674e+16 2.0009e+18 20883
## - Budget 1 2.9883e+17 2.2140e+18 20942
## - Theatres 1 3.3253e+17 2.2477e+18 20951
##
## Step: AIC=20857.61
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season2 +
## Action + Comedy + Horror + RealLife + Writing + NonOriginal +
## SOthers
##
## Df Sum of Sq RSS AIC
## - Comedy 1 5.2868e+14 1.9160e+18 20856
## - NonOriginal 1 6.2339e+14 1.9161e+18 20856
## - G 1 9.3581e+14 1.9164e+18 20856
## - PG 1 3.3808e+15 1.9189e+18 20857
## - SOthers 1 4.8528e+15 1.9203e+18 20857
## <none> 1.9155e+18 20858
## - Writing 1 8.3843e+15 1.9239e+18 20858
## - Horror 1 8.8400e+15 1.9243e+18 20858
## - Season2 1 1.1484e+16 1.9270e+18 20859
## - RealLife 1 1.5428e+16 1.9309e+18 20860
## - Action 1 3.0388e+16 1.9459e+18 20865
## - Sequel 1 8.7957e+16 2.0034e+18 20882
## - Budget 1 3.0737e+17 2.2229e+18 20942
## - Theatres 1 3.3396e+17 2.2494e+18 20949
##
## Step: AIC=20855.77
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season2 +
## Action + Horror + RealLife + Writing + NonOriginal + SOthers
##
## Df Sum of Sq RSS AIC
## - NonOriginal 1 5.9736e+14 1.9166e+18 20854
## - G 1 8.7216e+14 1.9169e+18 20854
## - PG 1 3.6675e+15 1.9197e+18 20855
## - SOthers 1 4.8590e+15 1.9209e+18 20855
## <none> 1.9160e+18 20856
## - Horror 1 8.3477e+15 1.9244e+18 20856
## - Writing 1 9.3218e+15 1.9253e+18 20857
## - Season2 1 1.1119e+16 1.9271e+18 20857
## - RealLife 1 1.7320e+16 1.9333e+18 20859
## - Action 1 3.3657e+16 1.9497e+18 20864
## - Sequel 1 8.7429e+16 2.0034e+18 20880
## - Budget 1 3.1376e+17 2.2298e+18 20942
## - Theatres 1 3.3483e+17 2.2508e+18 20948
##
## Step: AIC=20853.95
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season2 +
## Action + Horror + RealLife + Writing + SOthers
##
## Df Sum of Sq RSS AIC
## - G 1 9.0703e+14 1.9175e+18 20852
## - PG 1 3.5162e+15 1.9201e+18 20853
## - SOthers 1 5.2746e+15 1.9219e+18 20854
## <none> 1.9166e+18 20854
## - Horror 1 7.8777e+15 1.9245e+18 20854
## - Writing 1 8.7580e+15 1.9254e+18 20855
## - Season2 1 1.1167e+16 1.9278e+18 20855
## - RealLife 1 1.6725e+16 1.9333e+18 20857
## - Action 1 3.3568e+16 1.9502e+18 20862
## - Sequel 1 8.6833e+16 2.0034e+18 20878
## - Budget 1 3.1620e+17 2.2328e+18 20941
## - Theatres 1 3.3694e+17 2.2536e+18 20946
##
## Step: AIC=20852.23
## Box.Office ~ Sequel + Budget + Theatres + PG + Season2 + Action +
## Horror + RealLife + Writing + SOthers
##
## Df Sum of Sq RSS AIC
## - PG 1 3.8614e+15 1.9214e+18 20851
## - SOthers 1 5.4239e+15 1.9229e+18 20852
## <none> 1.9175e+18 20852
## - Horror 1 8.0654e+15 1.9256e+18 20853
## - Writing 1 8.5847e+15 1.9261e+18 20853
## - Season2 1 1.1376e+16 1.9289e+18 20854
## - RealLife 1 1.6880e+16 1.9344e+18 20855
## - Action 1 3.3233e+16 1.9508e+18 20860
## - Sequel 1 8.8333e+16 2.0059e+18 20877
## - Budget 1 3.1609e+17 2.2336e+18 20939
## - Theatres 1 3.3832e+17 2.2558e+18 20945
##
## Step: AIC=20851.4
## Box.Office ~ Sequel + Budget + Theatres + Season2 + Action +
## Horror + RealLife + Writing + SOthers
##
## Df Sum of Sq RSS AIC
## - SOthers 1 5.0447e+15 1.9264e+18 20851
## <none> 1.9214e+18 20851
## - Horror 1 7.3822e+15 1.9288e+18 20852
## - Writing 1 8.8043e+15 1.9302e+18 20852
## - Season2 1 1.2266e+16 1.9336e+18 20853
## - RealLife 1 1.5713e+16 1.9371e+18 20854
## - Action 1 3.6624e+16 1.9580e+18 20860
## - Sequel 1 8.9711e+16 2.0111e+18 20876
## - Budget 1 3.1993e+17 2.2413e+18 20939
## - Theatres 1 3.3467e+17 2.2560e+18 20943
##
## Step: AIC=20850.93
## Box.Office ~ Sequel + Budget + Theatres + Season2 + Action +
## Horror + RealLife + Writing
##
## Df Sum of Sq RSS AIC
## <none> 1.9264e+18 20851
## - Horror 1 8.5907e+15 1.9350e+18 20852
## - Writing 1 1.0749e+16 1.9372e+18 20852
## - Season2 1 1.3047e+16 1.9395e+18 20853
## - RealLife 1 1.6411e+16 1.9428e+18 20854
## - Action 1 3.8894e+16 1.9653e+18 20861
## - Sequel 1 8.7444e+16 2.0139e+18 20875
## - Budget 1 3.1638e+17 2.2428e+18 20938
## - Theatres 1 3.3632e+17 2.2627e+18 20943
##
## Call:
## lm(formula = Box.Office ~ Sequel + Budget + Theatres + Season2 +
## Action + Horror + RealLife + Writing, data = Movie2)
##
## Residuals:
## Min 1Q Median 3Q Max
## -166838330 -32992802 -6237790 21913890 392411728
##
## Coefficients:
## Estimate Std. Error t value Pr(>|t|)
## (Intercept) -1.169e+08 1.352e+07 -8.644 < 2e-16 ***
## Sequel 3.297e+07 6.460e+06 5.104 4.52e-07 ***
## Budget 6.063e-01 6.244e-02 9.709 < 2e-16 ***
## Theatres 5.022e+04 5.016e+03 10.011 < 2e-16 ***
## Season2 1.021e+07 5.178e+06 1.972 0.04913 *
## Action -2.138e+07 6.282e+06 -3.404 0.00071 ***
## Horror -1.683e+07 1.052e+07 -1.600 0.11017
## RealLife 2.013e+07 9.104e+06 2.211 0.02741 *
## Writing 9.865e+06 5.512e+06 1.790 0.07404 .
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
## Residual standard error: 57930000 on 574 degrees of freedom
## Multiple R-squared: 0.566, Adjusted R-squared: 0.5599
## F-statistic: 93.56 on 8 and 574 DF, p-value: < 2.2e-16
The best subset of predictor variables to predict Box.Office based on backward elimination (with AIC) is Sequel, Budget, Theatres, Season2, Action, Horror, RealLife, and Writing.
c) Are the models in part (a) and part (b) the same?
d) Using forward selection (with BIC), find the best subset of predictor variables to predict Box.Office.
## Start: AIC=21325.88
## Box.Office ~ 1
##
## Df Sum of Sq RSS AIC
## + Theatres 1 1.9800e+18 2.4584e+18 20988
## + Budget 1 1.9453e+18 2.4931e+18 20996
## + Sequel 1 6.4531e+17 3.7931e+18 21241
## + Action 1 4.9314e+17 3.9453e+18 21264
## + R 1 2.6847e+17 4.1699e+18 21296
## + Season2 1 2.2761e+17 4.2108e+18 21302
## + Writing 1 1.8902e+17 4.2494e+18 21307
## + Season1 1 1.2136e+17 4.3170e+18 21316
## + PG13 1 1.0624e+17 4.3322e+18 21318
## + Horror 1 8.2679e+16 4.3557e+18 21321
## + Comedy 1 6.4364e+16 4.3740e+18 21324
## + Drama 1 5.3374e+16 4.3850e+18 21325
## <none> 4.4384e+18 21326
## + Thriller 1 3.5588e+16 4.4028e+18 21328
## + G 1 2.5547e+16 4.4128e+18 21329
## + PG 1 1.9613e+16 4.4188e+18 21330
## + RealLife 1 1.9296e+16 4.4191e+18 21330
## + Season3 1 1.9031e+16 4.4194e+18 21330
## + GOther 1 3.4998e+15 4.4349e+18 21332
## + SOthers 1 8.8164e+14 4.4375e+18 21332
## + NonOriginal 1 7.4731e+13 4.4383e+18 21332
##
## Step: AIC=20987.82
## Box.Office ~ Theatres
##
## Df Sum of Sq RSS AIC
## + Budget 1 3.7618e+17 2.0822e+18 20897
## + Sequel 1 1.2168e+17 2.3367e+18 20965
## + Season1 1 4.4363e+16 2.4140e+18 20984
## + Season2 1 3.9151e+16 2.4192e+18 20985
## + Writing 1 2.7391e+16 2.4310e+18 20988
## + PG13 1 2.7183e+16 2.4312e+18 20988
## <none> 2.4584e+18 20988
## + R 1 1.6358e+16 2.4420e+18 20990
## + Action 1 1.6105e+16 2.4423e+18 20990
## + Horror 1 1.3496e+16 2.4449e+18 20991
## + Comedy 1 1.3367e+16 2.4450e+18 20991
## + RealLife 1 8.0290e+15 2.4503e+18 20992
## + PG 1 7.2926e+15 2.4511e+18 20993
## + G 1 4.9078e+15 2.4534e+18 20993
## + Drama 1 4.1396e+15 2.4542e+18 20993
## + NonOriginal 1 2.5414e+15 2.4558e+18 20994
## + SOthers 1 1.8631e+15 2.4565e+18 20994
## + GOther 1 1.5062e+15 2.4569e+18 20994
## + Thriller 1 2.2507e+14 2.4581e+18 20994
## + Season3 1 1.6799e+14 2.4582e+18 20994
##
## Step: AIC=20897.36
## Box.Office ~ Theatres + Budget
##
## Df Sum of Sq RSS AIC
## + Sequel 1 7.5366e+16 2.0068e+18 20882
## + Action 1 2.6413e+16 2.0558e+18 20896
## <none> 2.0822e+18 20897
## + Season2 1 1.6667e+16 2.0655e+18 20899
## + RealLife 1 1.5316e+16 2.0669e+18 20899
## + Season1 1 1.4044e+16 2.0681e+18 20900
## + Drama 1 9.7615e+15 2.0724e+18 20901
## + SOthers 1 7.5097e+15 2.0747e+18 20902
## + PG 1 6.7487e+15 2.0754e+18 20902
## + PG13 1 4.0048e+15 2.0782e+18 20903
## + Comedy 1 3.6590e+15 2.0785e+18 20903
## + G 1 3.4419e+15 2.0787e+18 20903
## + Horror 1 3.0851e+15 2.0791e+18 20903
## + Writing 1 2.0657e+15 2.0801e+18 20903
## + NonOriginal 1 1.4059e+15 2.0808e+18 20903
## + GOther 1 1.2000e+15 2.0810e+18 20903
## + Thriller 1 1.0118e+15 2.0812e+18 20903
## + R 1 1.9148e+14 2.0820e+18 20904
## + Season3 1 1.2725e+14 2.0821e+18 20904
##
## Step: AIC=20882.23
## Box.Office ~ Theatres + Budget + Sequel
##
## Df Sum of Sq RSS AIC
## + Action 1 3.4203e+16 1.9726e+18 20879
## <none> 2.0068e+18 20882
## + RealLife 1 1.7270e+16 1.9895e+18 20884
## + Season2 1 1.2653e+16 1.9942e+18 20885
## + Drama 1 1.2060e+16 1.9948e+18 20885
## + SOthers 1 1.1721e+16 1.9951e+18 20885
## + Season1 1 7.7574e+15 1.9991e+18 20886
## + Horror 1 6.0203e+15 2.0008e+18 20887
## + PG 1 5.1471e+15 2.0017e+18 20887
## + PG13 1 5.0657e+15 2.0017e+18 20887
## + Thriller 1 3.6615e+15 2.0032e+18 20888
## + Writing 1 3.1622e+15 2.0036e+18 20888
## + Comedy 1 2.9924e+15 2.0038e+18 20888
## + GOther 1 2.7233e+15 2.0041e+18 20888
## + G 1 1.6095e+15 2.0052e+18 20888
## + R 1 6.9548e+14 2.0061e+18 20888
## + Season3 1 6.4688e+14 2.0062e+18 20888
## + NonOriginal 1 4.3240e+14 2.0064e+18 20889
##
## Step: AIC=20878.58
## Box.Office ~ Theatres + Budget + Sequel + Action
##
## Df Sum of Sq RSS AIC
## <none> 1.9726e+18 20879
## + RealLife 1 1.4399e+16 1.9582e+18 20881
## + Season2 1 1.1799e+16 1.9608e+18 20882
## + Horror 1 1.0287e+16 1.9623e+18 20882
## + SOthers 1 9.8596e+15 1.9627e+18 20882
## + Writing 1 6.8384e+15 1.9658e+18 20883
## + Season1 1 4.6257e+15 1.9680e+18 20884
## + Drama 1 4.3096e+15 1.9683e+18 20884
## + PG 1 2.4235e+15 1.9702e+18 20884
## + PG13 1 2.2589e+15 1.9704e+18 20884
## + G 1 1.9193e+15 1.9707e+18 20884
## + Season3 1 1.7735e+15 1.9708e+18 20884
## + GOther 1 1.0008e+15 1.9716e+18 20885
## + NonOriginal 1 7.8074e+14 1.9718e+18 20885
## + R 1 4.6537e+14 1.9721e+18 20885
## + Comedy 1 4.4936e+14 1.9722e+18 20885
## + Thriller 1 2.0258e+14 1.9724e+18 20885
##
## Call:
## lm(formula = Box.Office ~ Theatres + Budget + Sequel + Action,
## data = Movie2)
##
## Residuals:
## Min 1Q Median 3Q Max
## -169664977 -33263137 -4291410 22141604 400426367
##
## Coefficients:
## Estimate Std. Error t value Pr(>|t|)
## (Intercept) -1.126e+08 1.331e+07 -8.461 < 2e-16 ***
## Theatres 5.047e+04 5.028e+03 10.038 < 2e-16 ***
## Budget 6.347e-01 6.205e-02 10.229 < 2e-16 ***
## Sequel 3.193e+07 6.468e+06 4.936 1.04e-06 ***
## Action -1.970e+07 6.223e+06 -3.166 0.00163 **
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
## Residual standard error: 58420000 on 578 degrees of freedom
## Multiple R-squared: 0.5556, Adjusted R-squared: 0.5525
## F-statistic: 180.6 on 4 and 578 DF, p-value: < 2.2e-16
The best subset of predictor variables to predict Box.Office based on forward selection (with BIC) is Theatres, Budget, Sequel, and Action.
e) Using backward elimination (with BIC), find the best subset of predictor variables to predict Box.Office.
## Start: AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG +
## PG13 + R + Season1 + Season2 + Season3 + Action + Comedy +
## Drama + Horror + GOther + Thriller + RealLife + Writing +
## NonOriginal + Original + Screenplay + SOthers
##
##
## Step: AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG +
## PG13 + R + Season1 + Season2 + Season3 + Action + Comedy +
## Drama + Horror + GOther + Thriller + RealLife + Writing +
## NonOriginal + Original + SOthers
##
##
## Step: AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG +
## PG13 + R + Season1 + Season2 + Season3 + Action + Comedy +
## Drama + Horror + GOther + Thriller + RealLife + Writing +
## NonOriginal + SOthers
##
##
## Step: AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG +
## PG13 + R + Season1 + Season2 + Season3 + Action + Comedy +
## Drama + Horror + GOther + RealLife + Writing + NonOriginal +
## SOthers
##
##
## Step: AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG +
## PG13 + R + Season1 + Season2 + Action + Comedy + Drama +
## Horror + GOther + RealLife + Writing + NonOriginal + SOthers
##
##
## Step: AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG +
## PG13 + Season1 + Season2 + Action + Comedy + Drama + Horror +
## GOther + RealLife + Writing + NonOriginal + SOthers
##
##
## Step: AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + PG + PG13 + Season1 +
## Season2 + Action + Comedy + Drama + Horror + GOther + RealLife +
## Writing + NonOriginal + SOthers
##
## Df Sum of Sq RSS AIC
## - PG13 1 2.6415e+13 1.9149e+18 20938
## - GOther 1 8.1922e+13 1.9149e+18 20938
## - Drama 1 1.0319e+14 1.9150e+18 20938
## - Season1 1 2.7187e+14 1.9151e+18 20938
## - Comedy 1 5.0062e+14 1.9154e+18 20938
## - NonOriginal 1 5.4848e+14 1.9154e+18 20938
## - G 1 7.7291e+14 1.9156e+18 20938
## - PG 1 2.8300e+15 1.9177e+18 20939
## - SOthers 1 4.8018e+15 1.9197e+18 20939
## - Season2 1 7.0474e+15 1.9219e+18 20940
## - Horror 1 7.8770e+15 1.9227e+18 20940
## - Writing 1 8.3308e+15 1.9232e+18 20940
## - RealLife 1 1.4657e+16 1.9295e+18 20942
## - Action 1 2.0273e+16 1.9351e+18 20944
## <none> 1.9149e+18 20944
## - Sequel 1 8.5859e+16 2.0007e+18 20963
## - Budget 1 2.8985e+17 2.2047e+18 21020
## - Theatres 1 3.2892e+17 2.2438e+18 21030
##
## Step: AIC=20937.69
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season1 +
## Season2 + Action + Comedy + Drama + Horror + GOther + RealLife +
## Writing + NonOriginal + SOthers
##
## Df Sum of Sq RSS AIC
## - GOther 1 7.8120e+13 1.9150e+18 20931
## - Drama 1 1.1615e+14 1.9150e+18 20931
## - Season1 1 2.8009e+14 1.9152e+18 20931
## - Comedy 1 4.8913e+14 1.9154e+18 20932
## - NonOriginal 1 5.5771e+14 1.9154e+18 20932
## - G 1 8.7305e+14 1.9158e+18 20932
## - PG 1 3.4962e+15 1.9184e+18 20932
## - SOthers 1 4.7981e+15 1.9197e+18 20933
## - Season2 1 7.0222e+15 1.9219e+18 20934
## - Horror 1 7.8569e+15 1.9227e+18 20934
## - Writing 1 8.3340e+15 1.9232e+18 20934
## - RealLife 1 1.4652e+16 1.9295e+18 20936
## - Action 1 2.0274e+16 1.9352e+18 20938
## <none> 1.9149e+18 20938
## - Sequel 1 8.5914e+16 2.0008e+18 20957
## - Budget 1 2.9828e+17 2.2132e+18 21016
## - Theatres 1 3.3056e+17 2.2454e+18 21024
##
## Step: AIC=20931.34
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season1 +
## Season2 + Action + Comedy + Drama + Horror + RealLife + Writing +
## NonOriginal + SOthers
##
## Df Sum of Sq RSS AIC
## - Drama 1 2.1017e+14 1.9152e+18 20925
## - Season1 1 3.0130e+14 1.9153e+18 20925
## - NonOriginal 1 6.2939e+14 1.9156e+18 20925
## - Comedy 1 7.2702e+14 1.9157e+18 20925
## - G 1 9.2320e+14 1.9159e+18 20925
## - PG 1 3.4182e+15 1.9184e+18 20926
## - SOthers 1 4.7652e+15 1.9197e+18 20926
## - Season2 1 7.0318e+15 1.9220e+18 20927
## - Writing 1 8.4644e+15 1.9234e+18 20928
## - Horror 1 8.7477e+15 1.9237e+18 20928
## - RealLife 1 1.5122e+16 1.9301e+18 20930
## <none> 1.9150e+18 20931
## - Action 1 2.4012e+16 1.9390e+18 20932
## - Sequel 1 8.5865e+16 2.0008e+18 20951
## - Budget 1 2.9866e+17 2.2136e+18 21010
## - Theatres 1 3.3089e+17 2.2459e+18 21018
##
## Step: AIC=20925.04
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season1 +
## Season2 + Action + Comedy + Horror + RealLife + Writing +
## NonOriginal + SOthers
##
## Df Sum of Sq RSS AIC
## - Season1 1 3.0662e+14 1.9155e+18 20919
## - Comedy 1 5.1726e+14 1.9157e+18 20919
## - NonOriginal 1 6.0446e+14 1.9158e+18 20919
## - G 1 9.4522e+14 1.9161e+18 20919
## - PG 1 3.5675e+15 1.9187e+18 20920
## - SOthers 1 4.8166e+15 1.9200e+18 20920
## - Season2 1 6.9618e+15 1.9221e+18 20921
## - Writing 1 8.2628e+15 1.9234e+18 20921
## - Horror 1 8.8883e+15 1.9241e+18 20921
## - RealLife 1 1.5410e+16 1.9306e+18 20923
## <none> 1.9152e+18 20925
## - Action 1 2.9223e+16 1.9444e+18 20928
## - Sequel 1 8.5674e+16 2.0009e+18 20944
## - Budget 1 2.9883e+17 2.2140e+18 21003
## - Theatres 1 3.3253e+17 2.2477e+18 21012
##
## Step: AIC=20918.76
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season2 +
## Action + Comedy + Horror + RealLife + Writing + NonOriginal +
## SOthers
##
## Df Sum of Sq RSS AIC
## - Comedy 1 5.2868e+14 1.9160e+18 20913
## - NonOriginal 1 6.2339e+14 1.9161e+18 20913
## - G 1 9.3581e+14 1.9164e+18 20913
## - PG 1 3.3808e+15 1.9189e+18 20913
## - SOthers 1 4.8528e+15 1.9203e+18 20914
## - Writing 1 8.3843e+15 1.9239e+18 20915
## - Horror 1 8.8400e+15 1.9243e+18 20915
## - Season2 1 1.1484e+16 1.9270e+18 20916
## - RealLife 1 1.5428e+16 1.9309e+18 20917
## <none> 1.9155e+18 20919
## - Action 1 3.0388e+16 1.9459e+18 20922
## - Sequel 1 8.7957e+16 2.0034e+18 20939
## - Budget 1 3.0737e+17 2.2229e+18 20999
## - Theatres 1 3.3396e+17 2.2494e+18 21006
##
## Step: AIC=20912.56
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season2 +
## Action + Horror + RealLife + Writing + NonOriginal + SOthers
##
## Df Sum of Sq RSS AIC
## - NonOriginal 1 5.9736e+14 1.9166e+18 20906
## - G 1 8.7216e+14 1.9169e+18 20907
## - PG 1 3.6675e+15 1.9197e+18 20907
## - SOthers 1 4.8590e+15 1.9209e+18 20908
## - Horror 1 8.3477e+15 1.9244e+18 20909
## - Writing 1 9.3218e+15 1.9253e+18 20909
## - Season2 1 1.1119e+16 1.9271e+18 20910
## - RealLife 1 1.7320e+16 1.9333e+18 20911
## <none> 1.9160e+18 20913
## - Action 1 3.3657e+16 1.9497e+18 20916
## - Sequel 1 8.7429e+16 2.0034e+18 20932
## - Budget 1 3.1376e+17 2.2298e+18 20995
## - Theatres 1 3.3483e+17 2.2508e+18 21000
##
## Step: AIC=20906.37
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season2 +
## Action + Horror + RealLife + Writing + SOthers
##
## Df Sum of Sq RSS AIC
## - G 1 9.0703e+14 1.9175e+18 20900
## - PG 1 3.5162e+15 1.9201e+18 20901
## - SOthers 1 5.2746e+15 1.9219e+18 20902
## - Horror 1 7.8777e+15 1.9245e+18 20902
## - Writing 1 8.7580e+15 1.9254e+18 20903
## - Season2 1 1.1167e+16 1.9278e+18 20903
## - RealLife 1 1.6725e+16 1.9333e+18 20905
## <none> 1.9166e+18 20906
## - Action 1 3.3568e+16 1.9502e+18 20910
## - Sequel 1 8.6833e+16 2.0034e+18 20926
## - Budget 1 3.1620e+17 2.2328e+18 20989
## - Theatres 1 3.3694e+17 2.2536e+18 20994
##
## Step: AIC=20900.28
## Box.Office ~ Sequel + Budget + Theatres + PG + Season2 + Action +
## Horror + RealLife + Writing + SOthers
##
## Df Sum of Sq RSS AIC
## - PG 1 3.8614e+15 1.9214e+18 20895
## - SOthers 1 5.4239e+15 1.9229e+18 20896
## - Horror 1 8.0654e+15 1.9256e+18 20896
## - Writing 1 8.5847e+15 1.9261e+18 20897
## - Season2 1 1.1376e+16 1.9289e+18 20897
## - RealLife 1 1.6880e+16 1.9344e+18 20899
## <none> 1.9175e+18 20900
## - Action 1 3.3233e+16 1.9508e+18 20904
## - Sequel 1 8.8333e+16 2.0059e+18 20920
## - Budget 1 3.1609e+17 2.2336e+18 20983
## - Theatres 1 3.3832e+17 2.2558e+18 20989
##
## Step: AIC=20895.08
## Box.Office ~ Sequel + Budget + Theatres + Season2 + Action +
## Horror + RealLife + Writing + SOthers
##
## Df Sum of Sq RSS AIC
## - SOthers 1 5.0447e+15 1.9264e+18 20890
## - Horror 1 7.3822e+15 1.9288e+18 20891
## - Writing 1 8.8043e+15 1.9302e+18 20891
## - Season2 1 1.2266e+16 1.9336e+18 20892
## - RealLife 1 1.5713e+16 1.9371e+18 20894
## <none> 1.9214e+18 20895
## - Action 1 3.6624e+16 1.9580e+18 20900
## - Sequel 1 8.9711e+16 2.0111e+18 20915
## - Budget 1 3.1993e+17 2.2413e+18 20979
## - Theatres 1 3.3467e+17 2.2560e+18 20982
##
## Step: AIC=20890.24
## Box.Office ~ Sequel + Budget + Theatres + Season2 + Action +
## Horror + RealLife + Writing
##
## Df Sum of Sq RSS AIC
## - Horror 1 8.5907e+15 1.9350e+18 20887
## - Writing 1 1.0749e+16 1.9372e+18 20887
## - Season2 1 1.3047e+16 1.9395e+18 20888
## - RealLife 1 1.6411e+16 1.9428e+18 20889
## <none> 1.9264e+18 20890
## - Action 1 3.8894e+16 1.9653e+18 20896
## - Sequel 1 8.7444e+16 2.0139e+18 20910
## - Budget 1 3.1638e+17 2.2428e+18 20973
## - Theatres 1 3.3632e+17 2.2627e+18 20978
##
## Step: AIC=20886.47
## Box.Office ~ Sequel + Budget + Theatres + Season2 + Action +
## RealLife + Writing
##
## Df Sum of Sq RSS AIC
## - Writing 1 1.1872e+16 1.9469e+18 20884
## - Season2 1 1.2470e+16 1.9475e+18 20884
## - RealLife 1 1.7972e+16 1.9530e+18 20886
## <none> 1.9350e+18 20887
## - Action 1 3.5153e+16 1.9702e+18 20891
## - Sequel 1 8.3500e+16 2.0185e+18 20905
## - Budget 1 3.2123e+17 2.2562e+18 20970
## - Theatres 1 3.4137e+17 2.2764e+18 20975
##
## Step: AIC=20883.67
## Box.Office ~ Sequel + Budget + Theatres + Season2 + Action +
## RealLife
##
## Df Sum of Sq RSS AIC
## - Season2 1 1.1323e+16 1.9582e+18 20881
## - RealLife 1 1.3922e+16 1.9608e+18 20882
## <none> 1.9469e+18 20884
## - Action 1 3.0577e+16 1.9775e+18 20886
## - Sequel 1 8.0491e+16 2.0274e+18 20901
## - Theatres 1 3.4256e+17 2.2894e+18 20972
## - Budget 1 3.4265e+17 2.2895e+18 20972
##
## Step: AIC=20880.68
## Box.Office ~ Sequel + Budget + Theatres + Action + RealLife
##
## Df Sum of Sq RSS AIC
## - RealLife 1 1.4399e+16 1.9726e+18 20879
## <none> 1.9582e+18 20881
## - Action 1 3.1331e+16 1.9895e+18 20884
## - Sequel 1 8.4689e+16 2.0429e+18 20899
## - Theatres 1 3.5265e+17 2.3109e+18 20971
## - Budget 1 3.5968e+17 2.3179e+18 20973
##
## Step: AIC=20878.58
## Box.Office ~ Sequel + Budget + Theatres + Action
##
## Df Sum of Sq RSS AIC
## <none> 1.9726e+18 20879
## - Action 1 3.4203e+16 2.0068e+18 20882
## - Sequel 1 8.3156e+16 2.0558e+18 20896
## - Theatres 1 3.4385e+17 2.3165e+18 20966
## - Budget 1 3.5708e+17 2.3297e+18 20969
##
## Call:
## lm(formula = Box.Office ~ Sequel + Budget + Theatres + Action,
## data = Movie2)
##
## Residuals:
## Min 1Q Median 3Q Max
## -169664977 -33263137 -4291410 22141604 400426367
##
## Coefficients:
## Estimate Std. Error t value Pr(>|t|)
## (Intercept) -1.126e+08 1.331e+07 -8.461 < 2e-16 ***
## Sequel 3.193e+07 6.468e+06 4.936 1.04e-06 ***
## Budget 6.347e-01 6.205e-02 10.229 < 2e-16 ***
## Theatres 5.047e+04 5.028e+03 10.038 < 2e-16 ***
## Action -1.970e+07 6.223e+06 -3.166 0.00163 **
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
## Residual standard error: 58420000 on 578 degrees of freedom
## Multiple R-squared: 0.5556, Adjusted R-squared: 0.5525
## F-statistic: 180.6 on 4 and 578 DF, p-value: < 2.2e-16
The best subset of predictor variables to predict Box.Office based on backward elimination (with BIC) is Sequel, Budget, Theatres, and Action.
f) Are the models in part (a) and part (d) the same? Are the models in part (b) and part (e) the same?
g) Calculate \(PRESS_{p}\) for the models found in (a), (b), (d), and (e).
## [1] "Model (a): 1998001231737451776"
## [1] "Model (b): 1998001231737451776"
## [1] "Model (d): 2024868586000841472"
## [1] "Model (e): 2024868586000841472"
The best model based on having the lowest PRESS value is model a and b with 1998001231737451776.
h) Calculate Mallow’s \(C_p\) for the models found in (a), (b), (d), and (e).
## [1] "Model (a): 3.41104093258105"
## [1] "Model (b): 3.41104093258116"
## [1] "Model (d): 9.03822550665348"
## [1] "Model (e): 9.03822550665359"
The best model based on having the lowest C value is model a and b with value of 3.411 each.
i) Use regsubsets with nbest = 10 and nvars = 25. For all models, plot \(SSE\), \(R^2_{adj}\), AIC, BIC, PRESS, and Mallow’s \(C_p\) against \(p\). Use the last question from the Day4PracticeSolution.Rmd file as a reference.
## Warning: package 'leaps' was built under R version 3.5.3
## Warning: package 'ggplot2' was built under R version 3.5.3
## Warning: package 'cowplot' was built under R version 3.5.3
##
## Attaching package: 'cowplot'
## The following object is masked from 'package:ggplot2':
##
## ggsave
## Warning in leaps.setup(x, y, wt = wt, nbest = nbest, nvmax = nvmax,
## force.in = force.in, : 6 linear dependencies found
## Reordering variables and trying again:
## Subset selection object
## Call: regsubsets.formula(Box.Office ~ ., data = Movie2, nbest = 10,
## nvmax = 25)
## 23 Variables (and intercept)
## Forced in Forced out
## Sequel FALSE FALSE
## Budget FALSE FALSE
## Theatres FALSE FALSE
## G FALSE FALSE
## PG FALSE FALSE
## PG13 FALSE FALSE
## Season1 FALSE FALSE
## Season2 FALSE FALSE
## Action FALSE FALSE
## Comedy FALSE FALSE
## Drama FALSE FALSE
## Horror FALSE FALSE
## GOther FALSE FALSE
## RealLife FALSE FALSE
## Writing FALSE FALSE
## NonOriginal FALSE FALSE
## SOthers FALSE FALSE
## Not.Rated FALSE FALSE
## R FALSE FALSE
## Season3 FALSE FALSE
## Thriller FALSE FALSE
## Original FALSE FALSE
## Screenplay FALSE FALSE
## 10 subsets of each size up to 17
## Selection Algorithm: exhaustive
## Sequel Budget Theatres G Not.Rated PG PG13 R Season1
## 1 ( 1 ) " " " " "*" " " " " " " " " " " " "
## 1 ( 2 ) " " "*" " " " " " " " " " " " " " "
## 1 ( 3 ) "*" " " " " " " " " " " " " " " " "
## 1 ( 4 ) " " " " " " " " " " " " " " " " " "
## 1 ( 5 ) " " " " " " " " " " " " " " "*" " "
## 1 ( 6 ) " " " " " " " " " " " " " " " " " "
## 1 ( 7 ) " " " " " " " " " " " " " " " " " "
## 1 ( 8 ) " " " " " " " " " " " " " " " " "*"
## 1 ( 9 ) " " " " " " " " " " " " "*" " " " "
## 1 ( 10 ) " " " " " " " " " " " " " " " " " "
## 2 ( 1 ) " " "*" "*" " " " " " " " " " " " "
## 2 ( 2 ) "*" " " "*" " " " " " " " " " " " "
## 2 ( 3 ) "*" "*" " " " " " " " " " " " " " "
## 2 ( 4 ) " " " " "*" " " " " " " " " " " "*"
## 2 ( 5 ) " " " " "*" " " " " " " " " " " " "
## 2 ( 6 ) " " " " "*" " " " " " " " " " " " "
## 2 ( 7 ) " " " " "*" " " " " " " "*" " " " "
## 2 ( 8 ) " " " " "*" " " " " " " " " "*" " "
## 2 ( 9 ) " " " " "*" " " " " " " " " " " " "
## 2 ( 10 ) " " " " "*" " " " " " " " " " " " "
## 3 ( 1 ) "*" "*" "*" " " " " " " " " " " " "
## 3 ( 2 ) " " "*" "*" " " " " " " " " " " " "
## 3 ( 3 ) " " "*" "*" " " " " " " " " " " " "
## 3 ( 4 ) " " "*" "*" " " " " " " " " " " " "
## 3 ( 5 ) " " "*" "*" " " " " " " " " " " "*"
## 3 ( 6 ) " " "*" "*" " " " " " " " " " " " "
## 3 ( 7 ) " " "*" "*" " " " " " " " " " " " "
## 3 ( 8 ) " " "*" "*" " " " " "*" " " " " " "
## 3 ( 9 ) " " "*" "*" " " " " " " "*" " " " "
## 3 ( 10 ) " " "*" "*" " " " " " " " " " " " "
## 4 ( 1 ) "*" "*" "*" " " " " " " " " " " " "
## 4 ( 2 ) "*" "*" "*" " " " " " " " " " " " "
## 4 ( 3 ) "*" "*" "*" " " " " " " " " " " " "
## 4 ( 4 ) "*" "*" "*" " " " " " " " " " " " "
## 4 ( 5 ) "*" "*" "*" " " " " " " " " " " " "
## 4 ( 6 ) "*" "*" "*" " " " " " " " " " " "*"
## 4 ( 7 ) "*" "*" "*" " " " " " " " " " " " "
## 4 ( 8 ) "*" "*" "*" " " " " "*" " " " " " "
## 4 ( 9 ) "*" "*" "*" " " " " " " "*" " " " "
## 4 ( 10 ) "*" "*" "*" " " " " " " " " " " " "
## 5 ( 1 ) "*" "*" "*" " " " " " " " " " " " "
## 5 ( 2 ) "*" "*" "*" " " " " " " " " " " " "
## 5 ( 3 ) "*" "*" "*" " " " " " " " " " " " "
## 5 ( 4 ) "*" "*" "*" " " " " " " " " " " " "
## 5 ( 5 ) "*" "*" "*" " " " " " " " " " " " "
## 5 ( 6 ) "*" "*" "*" " " " " " " " " " " "*"
## 5 ( 7 ) "*" "*" "*" " " " " " " " " " " " "
## 5 ( 8 ) "*" "*" "*" " " " " "*" " " " " " "
## 5 ( 9 ) "*" "*" "*" " " " " " " "*" " " " "
## 5 ( 10 ) "*" "*" "*" "*" " " " " " " " " " "
## 6 ( 1 ) "*" "*" "*" " " " " " " " " " " " "
## 6 ( 2 ) "*" "*" "*" " " " " " " " " " " " "
## 6 ( 3 ) "*" "*" "*" " " " " " " " " " " " "
## 6 ( 4 ) "*" "*" "*" " " " " " " " " " " " "
## 6 ( 5 ) "*" "*" "*" " " " " " " " " " " " "
## 6 ( 6 ) "*" "*" "*" " " " " " " " " " " " "
## 6 ( 7 ) "*" "*" "*" " " " " " " " " " " " "
## 6 ( 8 ) "*" "*" "*" " " " " " " " " " " "*"
## 6 ( 9 ) "*" "*" "*" " " " " " " " " " " " "
## 6 ( 10 ) "*" "*" "*" " " " " "*" " " " " " "
## 7 ( 1 ) "*" "*" "*" " " " " " " " " " " " "
## 7 ( 2 ) "*" "*" "*" " " " " " " " " " " " "
## 7 ( 3 ) "*" "*" "*" " " " " " " " " " " " "
## 7 ( 4 ) "*" "*" "*" " " " " " " " " " " " "
## 7 ( 5 ) "*" "*" "*" " " " " " " " " " " " "
## 7 ( 6 ) "*" "*" "*" " " " " " " " " " " " "
## 7 ( 7 ) "*" "*" "*" " " " " " " " " " " " "
## 7 ( 8 ) "*" "*" "*" " " " " " " " " " " " "
## 7 ( 9 ) "*" "*" "*" " " " " " " " " " " "*"
## 7 ( 10 ) "*" "*" "*" " " " " "*" " " " " " "
## 8 ( 1 ) "*" "*" "*" " " " " " " " " " " " "
## 8 ( 2 ) "*" "*" "*" " " " " " " " " " " " "
## 8 ( 3 ) "*" "*" "*" " " " " " " " " " " " "
## 8 ( 4 ) "*" "*" "*" " " " " "*" " " " " " "
## 8 ( 5 ) "*" "*" "*" "*" " " " " " " " " " "
## 8 ( 6 ) "*" "*" "*" " " " " " " " " " " " "
## 8 ( 7 ) "*" "*" "*" " " " " "*" " " " " " "
## 8 ( 8 ) "*" "*" "*" " " " " " " " " " " " "
## 8 ( 9 ) "*" "*" "*" " " " " " " "*" " " " "
## 8 ( 10 ) "*" "*" "*" " " " " " " " " " " " "
## 9 ( 1 ) "*" "*" "*" " " " " " " " " " " " "
## 9 ( 2 ) "*" "*" "*" " " " " "*" " " " " " "
## 9 ( 3 ) "*" "*" "*" "*" " " " " " " " " " "
## 9 ( 4 ) "*" "*" "*" " " " " " " " " " " " "
## 9 ( 5 ) "*" "*" "*" " " " " "*" " " " " " "
## 9 ( 6 ) "*" "*" "*" " " " " " " " " " " " "
## 9 ( 7 ) "*" "*" "*" " " " " " " " " " " " "
## 9 ( 8 ) "*" "*" "*" " " " " " " "*" " " " "
## 9 ( 9 ) "*" "*" "*" " " " " " " " " "*" " "
## 9 ( 10 ) "*" "*" "*" " " " " "*" " " " " " "
## 10 ( 1 ) "*" "*" "*" " " " " "*" " " " " " "
## 10 ( 2 ) "*" "*" "*" "*" " " " " " " " " " "
## 10 ( 3 ) "*" "*" "*" " " " " " " " " " " " "
## 10 ( 4 ) "*" "*" "*" " " " " " " " " " " " "
## 10 ( 5 ) "*" "*" "*" " " " " " " "*" " " " "
## 10 ( 6 ) "*" "*" "*" " " " " " " " " " " " "
## 10 ( 7 ) "*" "*" "*" " " " " " " " " "*" " "
## 10 ( 8 ) "*" "*" "*" " " " " " " " " " " " "
## 10 ( 9 ) "*" "*" "*" " " " " " " " " " " " "
## 10 ( 10 ) "*" "*" "*" " " " " " " " " " " "*"
## 11 ( 1 ) "*" "*" "*" "*" " " "*" " " " " " "
## 11 ( 2 ) "*" "*" "*" " " " " "*" " " " " " "
## 11 ( 3 ) "*" "*" "*" " " " " "*" " " " " " "
## 11 ( 4 ) "*" "*" "*" " " " " "*" " " " " " "
## 11 ( 5 ) "*" "*" "*" " " " " "*" " " " " "*"
## 11 ( 6 ) "*" "*" "*" " " " " "*" " " " " " "
## 11 ( 7 ) "*" "*" "*" " " " " "*" " " " " "*"
## 11 ( 8 ) "*" "*" "*" " " " " "*" " " " " " "
## 11 ( 9 ) "*" "*" "*" " " " " "*" "*" " " " "
## 11 ( 10 ) "*" "*" "*" " " " " "*" " " " " " "
## 12 ( 1 ) "*" "*" "*" "*" " " "*" " " " " " "
## 12 ( 2 ) "*" "*" "*" "*" " " "*" " " " " " "
## 12 ( 3 ) "*" "*" "*" "*" " " "*" " " " " " "
## 12 ( 4 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 12 ( 5 ) "*" "*" "*" "*" " " "*" " " " " " "
## 12 ( 6 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 12 ( 7 ) "*" "*" "*" "*" " " "*" " " " " " "
## 12 ( 8 ) "*" "*" "*" " " " " "*" " " " " " "
## 12 ( 9 ) "*" "*" "*" " " " " "*" " " " " " "
## 12 ( 10 ) "*" "*" "*" " " " " "*" " " " " " "
## 13 ( 1 ) "*" "*" "*" "*" " " "*" " " " " " "
## 13 ( 2 ) "*" "*" "*" "*" " " "*" " " " " " "
## 13 ( 3 ) "*" "*" "*" "*" " " "*" " " " " " "
## 13 ( 4 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 13 ( 5 ) "*" "*" "*" "*" " " "*" " " " " " "
## 13 ( 6 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 13 ( 7 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 13 ( 8 ) "*" "*" "*" "*" " " "*" " " " " " "
## 13 ( 9 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 13 ( 10 ) "*" "*" "*" "*" " " "*" " " " " " "
## 14 ( 1 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 14 ( 2 ) "*" "*" "*" "*" " " "*" " " " " " "
## 14 ( 3 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 14 ( 4 ) "*" "*" "*" "*" " " "*" " " " " " "
## 14 ( 5 ) "*" "*" "*" "*" " " "*" " " " " " "
## 14 ( 6 ) "*" "*" "*" "*" " " "*" " " " " " "
## 14 ( 7 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 14 ( 8 ) "*" "*" "*" "*" " " "*" " " " " " "
## 14 ( 9 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 14 ( 10 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 15 ( 1 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 15 ( 2 ) "*" "*" "*" "*" " " "*" " " " " " "
## 15 ( 3 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 15 ( 4 ) "*" "*" "*" "*" " " "*" " " " " " "
## 15 ( 5 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 15 ( 6 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 15 ( 7 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 15 ( 8 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 15 ( 9 ) "*" "*" "*" "*" " " "*" " " " " " "
## 15 ( 10 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 16 ( 1 ) "*" "*" "*" "*" " " "*" " " " " " "
## 16 ( 2 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 16 ( 3 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 16 ( 4 ) "*" "*" "*" "*" " " "*" " " " " " "
## 16 ( 5 ) "*" "*" "*" "*" " " "*" " " " " " "
## 16 ( 6 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 16 ( 7 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 16 ( 8 ) "*" "*" "*" "*" " " "*" " " " " " "
## 16 ( 9 ) "*" "*" "*" "*" " " "*" " " " " "*"
## 16 ( 10 ) "*" "*" "*" "*" " " "*" " " " " " "
## 17 ( 1 ) "*" "*" "*" "*" " " "*" "*" " " "*"
## 17 ( 2 ) "*" "*" "*" "*" " " "*" "*" " " "*"
## 17 ( 3 ) "*" "*" "*" "*" " " "*" "*" " " "*"
## 17 ( 4 ) "*" "*" "*" "*" " " "*" "*" " " "*"
## 17 ( 5 ) "*" "*" "*" "*" " " "*" "*" " " "*"
## 17 ( 6 ) "*" "*" "*" "*" " " "*" "*" " " "*"
## 17 ( 7 ) "*" "*" "*" "*" " " "*" "*" " " "*"
## 17 ( 8 ) "*" "*" "*" "*" " " "*" "*" " " "*"
## 17 ( 9 ) "*" "*" "*" "*" " " "*" "*" " " "*"
## 17 ( 10 ) "*" "*" "*" "*" " " "*" "*" " " "*"
## Season2 Season3 Action Comedy Drama Horror GOther Thriller
## 1 ( 1 ) " " " " " " " " " " " " " " " "
## 1 ( 2 ) " " " " " " " " " " " " " " " "
## 1 ( 3 ) " " " " " " " " " " " " " " " "
## 1 ( 4 ) " " " " "*" " " " " " " " " " "
## 1 ( 5 ) " " " " " " " " " " " " " " " "
## 1 ( 6 ) "*" " " " " " " " " " " " " " "
## 1 ( 7 ) " " " " " " " " " " " " " " " "
## 1 ( 8 ) " " " " " " " " " " " " " " " "
## 1 ( 9 ) " " " " " " " " " " " " " " " "
## 1 ( 10 ) " " " " " " " " " " "*" " " " "
## 2 ( 1 ) " " " " " " " " " " " " " " " "
## 2 ( 2 ) " " " " " " " " " " " " " " " "
## 2 ( 3 ) " " " " " " " " " " " " " " " "
## 2 ( 4 ) " " " " " " " " " " " " " " " "
## 2 ( 5 ) "*" " " " " " " " " " " " " " "
## 2 ( 6 ) " " " " " " " " " " " " " " " "
## 2 ( 7 ) " " " " " " " " " " " " " " " "
## 2 ( 8 ) " " " " " " " " " " " " " " " "
## 2 ( 9 ) " " " " "*" " " " " " " " " " "
## 2 ( 10 ) " " " " " " " " " " "*" " " " "
## 3 ( 1 ) " " " " " " " " " " " " " " " "
## 3 ( 2 ) " " " " "*" " " " " " " " " " "
## 3 ( 3 ) "*" " " " " " " " " " " " " " "
## 3 ( 4 ) " " " " " " " " " " " " " " " "
## 3 ( 5 ) " " " " " " " " " " " " " " " "
## 3 ( 6 ) " " " " " " " " "*" " " " " " "
## 3 ( 7 ) " " " " " " " " " " " " " " " "
## 3 ( 8 ) " " " " " " " " " " " " " " " "
## 3 ( 9 ) " " " " " " " " " " " " " " " "
## 3 ( 10 ) " " " " " " "*" " " " " " " " "
## 4 ( 1 ) " " " " "*" " " " " " " " " " "
## 4 ( 2 ) " " " " " " " " " " " " " " " "
## 4 ( 3 ) "*" " " " " " " " " " " " " " "
## 4 ( 4 ) " " " " " " " " "*" " " " " " "
## 4 ( 5 ) " " " " " " " " " " " " " " " "
## 4 ( 6 ) " " " " " " " " " " " " " " " "
## 4 ( 7 ) " " " " " " " " " " "*" " " " "
## 4 ( 8 ) " " " " " " " " " " " " " " " "
## 4 ( 9 ) " " " " " " " " " " " " " " " "
## 4 ( 10 ) " " " " " " " " " " " " " " "*"
## 5 ( 1 ) " " " " "*" " " " " " " " " " "
## 5 ( 2 ) "*" " " "*" " " " " " " " " " "
## 5 ( 3 ) " " " " "*" " " " " "*" " " " "
## 5 ( 4 ) " " " " "*" " " " " " " " " " "
## 5 ( 5 ) " " " " "*" " " " " " " " " " "
## 5 ( 6 ) " " " " "*" " " " " " " " " " "
## 5 ( 7 ) " " " " "*" " " "*" " " " " " "
## 5 ( 8 ) " " " " "*" " " " " " " " " " "
## 5 ( 9 ) " " " " "*" " " " " " " " " " "
## 5 ( 10 ) " " " " "*" " " " " " " " " " "
## 6 ( 1 ) "*" " " "*" " " " " " " " " " "
## 6 ( 2 ) " " " " "*" " " " " " " " " " "
## 6 ( 3 ) " " " " "*" " " " " " " " " " "
## 6 ( 4 ) " " " " "*" " " " " "*" " " " "
## 6 ( 5 ) "*" " " "*" " " " " "*" " " " "
## 6 ( 6 ) "*" " " "*" " " " " " " " " " "
## 6 ( 7 ) "*" " " "*" " " " " " " " " " "
## 6 ( 8 ) " " " " "*" " " " " " " " " " "
## 6 ( 9 ) " " " " "*" " " " " "*" " " " "
## 6 ( 10 ) " " " " "*" " " " " " " " " " "
## 7 ( 1 ) "*" " " "*" " " " " " " " " " "
## 7 ( 2 ) "*" " " "*" " " " " "*" " " " "
## 7 ( 3 ) "*" " " "*" " " " " " " " " " "
## 7 ( 4 ) " " " " "*" " " " " "*" " " " "
## 7 ( 5 ) " " " " "*" " " " " " " " " " "
## 7 ( 6 ) " " " " "*" " " " " "*" " " " "
## 7 ( 7 ) "*" " " "*" " " " " "*" " " " "
## 7 ( 8 ) "*" " " "*" " " " " "*" " " " "
## 7 ( 9 ) " " " " "*" " " " " " " " " " "
## 7 ( 10 ) " " " " "*" " " " " " " " " " "
## 8 ( 1 ) "*" " " "*" " " " " "*" " " " "
## 8 ( 2 ) "*" " " "*" " " " " " " " " " "
## 8 ( 3 ) "*" " " "*" " " " " "*" " " " "
## 8 ( 4 ) "*" " " "*" " " " " " " " " " "
## 8 ( 5 ) "*" " " "*" " " " " " " " " " "
## 8 ( 6 ) "*" " " "*" " " " " " " " " "*"
## 8 ( 7 ) "*" " " "*" " " " " "*" " " " "
## 8 ( 8 ) " " " " "*" " " " " "*" " " " "
## 8 ( 9 ) "*" " " "*" " " " " " " " " " "
## 8 ( 10 ) "*" " " "*" " " " " " " "*" " "
## 9 ( 1 ) "*" " " "*" " " " " "*" " " " "
## 9 ( 2 ) "*" " " "*" " " " " "*" " " " "
## 9 ( 3 ) "*" " " "*" " " " " "*" " " " "
## 9 ( 4 ) "*" " " "*" " " " " "*" " " " "
## 9 ( 5 ) "*" " " "*" " " " " " " " " " "
## 9 ( 6 ) "*" " " "*" "*" " " "*" " " " "
## 9 ( 7 ) "*" " " "*" " " " " "*" " " "*"
## 9 ( 8 ) "*" " " "*" " " " " "*" " " " "
## 9 ( 9 ) "*" " " "*" " " " " "*" " " " "
## 9 ( 10 ) "*" " " "*" " " " " "*" " " " "
## 10 ( 1 ) "*" " " "*" " " " " "*" " " " "
## 10 ( 2 ) "*" " " "*" " " " " "*" " " " "
## 10 ( 3 ) "*" " " "*" "*" " " "*" " " " "
## 10 ( 4 ) "*" " " "*" " " " " "*" " " "*"
## 10 ( 5 ) "*" " " "*" " " " " "*" " " " "
## 10 ( 6 ) "*" " " "*" " " " " "*" " " " "
## 10 ( 7 ) "*" " " "*" " " " " "*" " " " "
## 10 ( 8 ) "*" " " "*" " " " " "*" "*" " "
## 10 ( 9 ) "*" "*" "*" " " " " "*" " " " "
## 10 ( 10 ) "*" " " "*" " " " " "*" " " " "
## 11 ( 1 ) "*" " " "*" " " " " "*" " " " "
## 11 ( 2 ) "*" " " "*" " " " " "*" " " " "
## 11 ( 3 ) "*" " " "*" " " " " "*" "*" " "
## 11 ( 4 ) "*" " " "*" "*" " " "*" " " " "
## 11 ( 5 ) "*" " " "*" " " " " "*" " " " "
## 11 ( 6 ) "*" "*" "*" " " " " "*" " " " "
## 11 ( 7 ) " " "*" "*" " " " " "*" " " " "
## 11 ( 8 ) "*" " " "*" " " " " "*" " " "*"
## 11 ( 9 ) "*" " " "*" " " " " "*" " " " "
## 11 ( 10 ) "*" " " "*" " " "*" "*" " " " "
## 12 ( 1 ) "*" " " "*" " " " " "*" " " " "
## 12 ( 2 ) "*" " " "*" "*" " " "*" " " " "
## 12 ( 3 ) "*" " " "*" " " " " "*" "*" " "
## 12 ( 4 ) " " "*" "*" " " " " "*" " " " "
## 12 ( 5 ) "*" "*" "*" " " " " "*" " " " "
## 12 ( 6 ) "*" " " "*" " " " " "*" " " " "
## 12 ( 7 ) "*" " " "*" " " " " "*" " " "*"
## 12 ( 8 ) "*" " " "*" "*" " " "*" " " " "
## 12 ( 9 ) "*" " " "*" " " " " "*" "*" " "
## 12 ( 10 ) "*" "*" "*" " " " " "*" " " " "
## 13 ( 1 ) "*" " " "*" "*" " " "*" " " " "
## 13 ( 2 ) "*" " " "*" " " " " "*" "*" " "
## 13 ( 3 ) "*" " " "*" " " " " "*" " " "*"
## 13 ( 4 ) " " "*" "*" " " " " "*" " " " "
## 13 ( 5 ) "*" "*" "*" " " " " "*" " " " "
## 13 ( 6 ) "*" " " "*" " " " " "*" " " " "
## 13 ( 7 ) " " "*" "*" "*" " " "*" " " " "
## 13 ( 8 ) "*" "*" "*" "*" " " "*" " " " "
## 13 ( 9 ) "*" " " "*" "*" " " "*" " " " "
## 13 ( 10 ) "*" " " "*" "*" " " "*" "*" " "
## 14 ( 1 ) " " "*" "*" "*" " " "*" " " " "
## 14 ( 2 ) "*" "*" "*" "*" " " "*" " " " "
## 14 ( 3 ) "*" " " "*" "*" " " "*" " " " "
## 14 ( 4 ) "*" " " "*" " " " " "*" "*" "*"
## 14 ( 5 ) "*" " " "*" "*" "*" "*" " " " "
## 14 ( 6 ) "*" " " "*" "*" " " "*" "*" " "
## 14 ( 7 ) "*" " " "*" " " " " "*" " " "*"
## 14 ( 8 ) "*" "*" "*" " " " " "*" " " "*"
## 14 ( 9 ) " " "*" "*" " " " " "*" " " "*"
## 14 ( 10 ) "*" " " "*" " " " " "*" "*" " "
## 15 ( 1 ) " " "*" "*" "*" "*" "*" " " " "
## 15 ( 2 ) "*" "*" "*" "*" "*" "*" " " " "
## 15 ( 3 ) "*" " " "*" "*" "*" "*" " " " "
## 15 ( 4 ) "*" "*" "*" " " " " "*" "*" "*"
## 15 ( 5 ) "*" " " "*" " " " " "*" "*" "*"
## 15 ( 6 ) " " "*" "*" " " " " "*" "*" "*"
## 15 ( 7 ) " " "*" "*" "*" " " "*" "*" " "
## 15 ( 8 ) "*" " " "*" "*" " " "*" "*" " "
## 15 ( 9 ) "*" "*" "*" "*" " " "*" "*" " "
## 15 ( 10 ) " " "*" " " "*" "*" " " "*" "*"
## 16 ( 1 ) "*" "*" "*" "*" "*" "*" " " "*"
## 16 ( 2 ) "*" " " "*" "*" "*" "*" " " "*"
## 16 ( 3 ) "*" " " "*" "*" "*" " " "*" "*"
## 16 ( 4 ) "*" "*" "*" "*" "*" " " "*" "*"
## 16 ( 5 ) "*" "*" "*" "*" "*" "*" "*" " "
## 16 ( 6 ) "*" " " "*" "*" "*" "*" "*" " "
## 16 ( 7 ) "*" " " " " "*" "*" "*" "*" "*"
## 16 ( 8 ) "*" "*" " " "*" "*" "*" "*" "*"
## 16 ( 9 ) "*" " " "*" "*" " " "*" "*" "*"
## 16 ( 10 ) "*" "*" "*" "*" " " "*" "*" "*"
## 17 ( 1 ) " " "*" " " "*" "*" "*" "*" "*"
## 17 ( 2 ) " " "*" "*" "*" "*" " " "*" "*"
## 17 ( 3 ) " " "*" "*" " " "*" "*" "*" "*"
## 17 ( 4 ) " " "*" "*" "*" " " "*" "*" "*"
## 17 ( 5 ) "*" " " " " "*" "*" "*" "*" "*"
## 17 ( 6 ) "*" " " "*" " " "*" "*" "*" "*"
## 17 ( 7 ) "*" " " "*" "*" " " "*" "*" "*"
## 17 ( 8 ) "*" " " "*" "*" "*" " " "*" "*"
## 17 ( 9 ) "*" " " "*" "*" "*" "*" " " "*"
## 17 ( 10 ) "*" " " "*" "*" "*" "*" "*" " "
## RealLife Writing NonOriginal Original Screenplay SOthers
## 1 ( 1 ) " " " " " " " " " " " "
## 1 ( 2 ) " " " " " " " " " " " "
## 1 ( 3 ) " " " " " " " " " " " "
## 1 ( 4 ) " " " " " " " " " " " "
## 1 ( 5 ) " " " " " " " " " " " "
## 1 ( 6 ) " " " " " " " " " " " "
## 1 ( 7 ) " " "*" " " " " " " " "
## 1 ( 8 ) " " " " " " " " " " " "
## 1 ( 9 ) " " " " " " " " " " " "
## 1 ( 10 ) " " " " " " " " " " " "
## 2 ( 1 ) " " " " " " " " " " " "
## 2 ( 2 ) " " " " " " " " " " " "
## 2 ( 3 ) " " " " " " " " " " " "
## 2 ( 4 ) " " " " " " " " " " " "
## 2 ( 5 ) " " " " " " " " " " " "
## 2 ( 6 ) " " "*" " " " " " " " "
## 2 ( 7 ) " " " " " " " " " " " "
## 2 ( 8 ) " " " " " " " " " " " "
## 2 ( 9 ) " " " " " " " " " " " "
## 2 ( 10 ) " " " " " " " " " " " "
## 3 ( 1 ) " " " " " " " " " " " "
## 3 ( 2 ) " " " " " " " " " " " "
## 3 ( 3 ) " " " " " " " " " " " "
## 3 ( 4 ) "*" " " " " " " " " " "
## 3 ( 5 ) " " " " " " " " " " " "
## 3 ( 6 ) " " " " " " " " " " " "
## 3 ( 7 ) " " " " " " " " " " "*"
## 3 ( 8 ) " " " " " " " " " " " "
## 3 ( 9 ) " " " " " " " " " " " "
## 3 ( 10 ) " " " " " " " " " " " "
## 4 ( 1 ) " " " " " " " " " " " "
## 4 ( 2 ) "*" " " " " " " " " " "
## 4 ( 3 ) " " " " " " " " " " " "
## 4 ( 4 ) " " " " " " " " " " " "
## 4 ( 5 ) " " " " " " " " " " "*"
## 4 ( 6 ) " " " " " " " " " " " "
## 4 ( 7 ) " " " " " " " " " " " "
## 4 ( 8 ) " " " " " " " " " " " "
## 4 ( 9 ) " " " " " " " " " " " "
## 4 ( 10 ) " " " " " " " " " " " "
## 5 ( 1 ) "*" " " " " " " " " " "
## 5 ( 2 ) " " " " " " " " " " " "
## 5 ( 3 ) " " " " " " " " " " " "
## 5 ( 4 ) " " " " " " " " " " "*"
## 5 ( 5 ) " " "*" " " " " " " " "
## 5 ( 6 ) " " " " " " " " " " " "
## 5 ( 7 ) " " " " " " " " " " " "
## 5 ( 8 ) " " " " " " " " " " " "
## 5 ( 9 ) " " " " " " " " " " " "
## 5 ( 10 ) " " " " " " " " " " " "
## 6 ( 1 ) "*" " " " " " " " " " "
## 6 ( 2 ) "*" "*" " " " " " " " "
## 6 ( 3 ) "*" " " " " " " " " "*"
## 6 ( 4 ) "*" " " " " " " " " " "
## 6 ( 5 ) " " " " " " " " " " " "
## 6 ( 6 ) " " " " " " " " " " "*"
## 6 ( 7 ) " " "*" " " " " " " " "
## 6 ( 8 ) "*" " " " " " " " " " "
## 6 ( 9 ) " " " " " " " " " " "*"
## 6 ( 10 ) "*" " " " " " " " " " "
## 7 ( 1 ) "*" "*" " " " " " " " "
## 7 ( 2 ) "*" " " " " " " " " " "
## 7 ( 3 ) "*" " " " " " " " " "*"
## 7 ( 4 ) "*" "*" " " " " " " " "
## 7 ( 5 ) "*" "*" " " " " " " "*"
## 7 ( 6 ) "*" " " " " " " " " "*"
## 7 ( 7 ) " " " " " " " " " " "*"
## 7 ( 8 ) " " "*" " " " " " " " "
## 7 ( 9 ) "*" "*" " " " " " " " "
## 7 ( 10 ) "*" "*" " " " " " " " "
## 8 ( 1 ) "*" "*" " " " " " " " "
## 8 ( 2 ) "*" "*" " " " " " " "*"
## 8 ( 3 ) "*" " " " " " " " " "*"
## 8 ( 4 ) "*" "*" " " " " " " " "
## 8 ( 5 ) "*" "*" " " " " " " " "
## 8 ( 6 ) "*" "*" " " " " " " " "
## 8 ( 7 ) "*" " " " " " " " " " "
## 8 ( 8 ) "*" "*" " " " " " " "*"
## 8 ( 9 ) "*" "*" " " " " " " " "
## 8 ( 10 ) "*" "*" " " " " " " " "
## 9 ( 1 ) "*" "*" " " " " " " "*"
## 9 ( 2 ) "*" "*" " " " " " " " "
## 9 ( 3 ) "*" "*" " " " " " " " "
## 9 ( 4 ) "*" "*" "*" " " " " " "
## 9 ( 5 ) "*" "*" " " " " " " "*"
## 9 ( 6 ) "*" "*" " " " " " " " "
## 9 ( 7 ) "*" "*" " " " " " " " "
## 9 ( 8 ) "*" "*" " " " " " " " "
## 9 ( 9 ) "*" "*" " " " " " " " "
## 9 ( 10 ) "*" " " " " " " " " "*"
## 10 ( 1 ) "*" "*" " " " " " " "*"
## 10 ( 2 ) "*" "*" " " " " " " "*"
## 10 ( 3 ) "*" "*" " " " " " " "*"
## 10 ( 4 ) "*" "*" " " " " " " "*"
## 10 ( 5 ) "*" "*" " " " " " " "*"
## 10 ( 6 ) "*" "*" "*" " " " " "*"
## 10 ( 7 ) "*" "*" " " " " " " "*"
## 10 ( 8 ) "*" "*" " " " " " " "*"
## 10 ( 9 ) "*" "*" " " " " " " "*"
## 10 ( 10 ) "*" "*" " " " " " " "*"
## 11 ( 1 ) "*" "*" " " " " " " "*"
## 11 ( 2 ) "*" "*" "*" " " " " "*"
## 11 ( 3 ) "*" "*" " " " " " " "*"
## 11 ( 4 ) "*" "*" " " " " " " "*"
## 11 ( 5 ) "*" "*" " " " " " " "*"
## 11 ( 6 ) "*" "*" " " " " " " "*"
## 11 ( 7 ) "*" "*" " " " " " " "*"
## 11 ( 8 ) "*" "*" " " " " " " "*"
## 11 ( 9 ) "*" "*" " " " " " " "*"
## 11 ( 10 ) "*" "*" " " " " " " "*"
## 12 ( 1 ) "*" "*" "*" " " " " "*"
## 12 ( 2 ) "*" "*" " " " " " " "*"
## 12 ( 3 ) "*" "*" " " " " " " "*"
## 12 ( 4 ) "*" "*" " " " " " " "*"
## 12 ( 5 ) "*" "*" " " " " " " "*"
## 12 ( 6 ) "*" "*" " " " " " " "*"
## 12 ( 7 ) "*" "*" " " " " " " "*"
## 12 ( 8 ) "*" "*" "*" " " " " "*"
## 12 ( 9 ) "*" "*" "*" " " " " "*"
## 12 ( 10 ) "*" "*" "*" " " " " "*"
## 13 ( 1 ) "*" "*" "*" " " " " "*"
## 13 ( 2 ) "*" "*" "*" " " " " "*"
## 13 ( 3 ) "*" "*" "*" " " " " "*"
## 13 ( 4 ) "*" "*" "*" " " " " "*"
## 13 ( 5 ) "*" "*" "*" " " " " "*"
## 13 ( 6 ) "*" "*" "*" " " " " "*"
## 13 ( 7 ) "*" "*" " " " " " " "*"
## 13 ( 8 ) "*" "*" " " " " " " "*"
## 13 ( 9 ) "*" "*" " " " " " " "*"
## 13 ( 10 ) "*" "*" " " " " " " "*"
## 14 ( 1 ) "*" "*" "*" " " " " "*"
## 14 ( 2 ) "*" "*" "*" " " " " "*"
## 14 ( 3 ) "*" "*" "*" " " " " "*"
## 14 ( 4 ) "*" "*" "*" " " " " "*"
## 14 ( 5 ) "*" "*" "*" " " " " "*"
## 14 ( 6 ) "*" "*" "*" " " " " "*"
## 14 ( 7 ) "*" "*" "*" " " " " "*"
## 14 ( 8 ) "*" "*" "*" " " " " "*"
## 14 ( 9 ) "*" "*" "*" " " " " "*"
## 14 ( 10 ) "*" "*" "*" " " " " "*"
## 15 ( 1 ) "*" "*" "*" " " " " "*"
## 15 ( 2 ) "*" "*" "*" " " " " "*"
## 15 ( 3 ) "*" "*" "*" " " " " "*"
## 15 ( 4 ) "*" "*" "*" " " " " "*"
## 15 ( 5 ) "*" "*" "*" " " " " "*"
## 15 ( 6 ) "*" "*" "*" " " " " "*"
## 15 ( 7 ) "*" "*" "*" " " " " "*"
## 15 ( 8 ) "*" "*" "*" " " " " "*"
## 15 ( 9 ) "*" "*" "*" " " " " "*"
## 15 ( 10 ) "*" "*" "*" " " " " "*"
## 16 ( 1 ) "*" "*" "*" " " " " "*"
## 16 ( 2 ) "*" "*" "*" " " " " "*"
## 16 ( 3 ) "*" "*" "*" " " " " "*"
## 16 ( 4 ) "*" "*" "*" " " " " "*"
## 16 ( 5 ) "*" "*" "*" " " " " "*"
## 16 ( 6 ) "*" "*" "*" " " " " "*"
## 16 ( 7 ) "*" "*" "*" " " " " "*"
## 16 ( 8 ) "*" "*" "*" " " " " "*"
## 16 ( 9 ) "*" "*" "*" " " " " "*"
## 16 ( 10 ) "*" "*" "*" " " " " "*"
## 17 ( 1 ) "*" "*" "*" " " " " "*"
## 17 ( 2 ) "*" "*" "*" " " " " "*"
## 17 ( 3 ) "*" "*" "*" " " " " "*"
## 17 ( 4 ) "*" "*" "*" " " " " "*"
## 17 ( 5 ) "*" "*" "*" " " " " "*"
## 17 ( 6 ) "*" "*" "*" " " " " "*"
## 17 ( 7 ) "*" "*" "*" " " " " "*"
## 17 ( 8 ) "*" "*" "*" " " " " "*"
## 17 ( 9 ) "*" "*" "*" " " " " "*"
## 17 ( 10 ) "*" "*" "*" " " " " "*"
Based on the 6 plots, it is recommended to build a model around 3-5 variables.