Submit your .rmd file on D2L by 12:30pm on May 14th

For this homework, we will investigate the Movie2.csv dataset located on D2L. The dataset contains information for movies since 2010. Be sure to download the file to your computer and import using “Import Dataset”, then “From Text File…”

Answer all questions completely. Explain in complete sentences, do not just submit code. See the Day4PracticeSolution.Rmd file for an example of what is expected. You may use any R functions to help answer the questions.

a) Using forward selection (with AIC), find the best subset of predictor variables to predict Box.Office.

## Start:  AIC=21321.52
## Box.Office ~ 1
## 
##               Df  Sum of Sq        RSS   AIC
## + Theatres     1 1.9800e+18 2.4584e+18 20979
## + Budget       1 1.9453e+18 2.4931e+18 20987
## + Sequel       1 6.4531e+17 3.7931e+18 21232
## + Action       1 4.9314e+17 3.9453e+18 21255
## + R            1 2.6847e+17 4.1699e+18 21287
## + Season2      1 2.2761e+17 4.2108e+18 21293
## + Writing      1 1.8902e+17 4.2494e+18 21298
## + Season1      1 1.2136e+17 4.3170e+18 21307
## + PG13         1 1.0624e+17 4.3322e+18 21309
## + Horror       1 8.2679e+16 4.3557e+18 21313
## + Comedy       1 6.4364e+16 4.3740e+18 21315
## + Drama        1 5.3374e+16 4.3850e+18 21317
## + Thriller     1 3.5588e+16 4.4028e+18 21319
## + G            1 2.5547e+16 4.4128e+18 21320
## + PG           1 1.9613e+16 4.4188e+18 21321
## + RealLife     1 1.9296e+16 4.4191e+18 21321
## + Season3      1 1.9031e+16 4.4194e+18 21321
## <none>                      4.4384e+18 21322
## + GOther       1 3.4998e+15 4.4349e+18 21323
## + SOthers      1 8.8164e+14 4.4375e+18 21323
## + NonOriginal  1 7.4731e+13 4.4383e+18 21324
## 
## Step:  AIC=20979.08
## Box.Office ~ Theatres
## 
##               Df  Sum of Sq        RSS   AIC
## + Budget       1 3.7618e+17 2.0822e+18 20884
## + Sequel       1 1.2168e+17 2.3367e+18 20952
## + Season1      1 4.4363e+16 2.4140e+18 20971
## + Season2      1 3.9151e+16 2.4192e+18 20972
## + Writing      1 2.7391e+16 2.4310e+18 20975
## + PG13         1 2.7183e+16 2.4312e+18 20975
## + R            1 1.6358e+16 2.4420e+18 20977
## + Action       1 1.6105e+16 2.4423e+18 20977
## + Horror       1 1.3496e+16 2.4449e+18 20978
## + Comedy       1 1.3367e+16 2.4450e+18 20978
## <none>                      2.4584e+18 20979
## + RealLife     1 8.0290e+15 2.4503e+18 20979
## + PG           1 7.2926e+15 2.4511e+18 20979
## + G            1 4.9078e+15 2.4534e+18 20980
## + Drama        1 4.1396e+15 2.4542e+18 20980
## + NonOriginal  1 2.5414e+15 2.4558e+18 20981
## + SOthers      1 1.8631e+15 2.4565e+18 20981
## + GOther       1 1.5062e+15 2.4569e+18 20981
## + Thriller     1 2.2507e+14 2.4581e+18 20981
## + Season3      1 1.6799e+14 2.4582e+18 20981
## 
## Step:  AIC=20884.26
## Box.Office ~ Theatres + Budget
## 
##               Df  Sum of Sq        RSS   AIC
## + Sequel       1 7.5366e+16 2.0068e+18 20865
## + Action       1 2.6413e+16 2.0558e+18 20879
## + Season2      1 1.6667e+16 2.0655e+18 20882
## + RealLife     1 1.5316e+16 2.0669e+18 20882
## + Season1      1 1.4044e+16 2.0681e+18 20882
## + Drama        1 9.7615e+15 2.0724e+18 20884
## + SOthers      1 7.5097e+15 2.0747e+18 20884
## <none>                      2.0822e+18 20884
## + PG           1 6.7487e+15 2.0754e+18 20884
## + PG13         1 4.0048e+15 2.0782e+18 20885
## + Comedy       1 3.6590e+15 2.0785e+18 20885
## + G            1 3.4419e+15 2.0787e+18 20885
## + Horror       1 3.0851e+15 2.0791e+18 20885
## + Writing      1 2.0657e+15 2.0801e+18 20886
## + NonOriginal  1 1.4059e+15 2.0808e+18 20886
## + GOther       1 1.2000e+15 2.0810e+18 20886
## + Thriller     1 1.0118e+15 2.0812e+18 20886
## + R            1 1.9148e+14 2.0820e+18 20886
## + Season3      1 1.2725e+14 2.0821e+18 20886
## 
## Step:  AIC=20864.76
## Box.Office ~ Theatres + Budget + Sequel
## 
##               Df  Sum of Sq        RSS   AIC
## + Action       1 3.4203e+16 1.9726e+18 20857
## + RealLife     1 1.7270e+16 1.9895e+18 20862
## + Season2      1 1.2653e+16 1.9942e+18 20863
## + Drama        1 1.2060e+16 1.9948e+18 20863
## + SOthers      1 1.1721e+16 1.9951e+18 20863
## + Season1      1 7.7574e+15 1.9991e+18 20865
## <none>                      2.0068e+18 20865
## + Horror       1 6.0203e+15 2.0008e+18 20865
## + PG           1 5.1471e+15 2.0017e+18 20865
## + PG13         1 5.0657e+15 2.0017e+18 20865
## + Thriller     1 3.6615e+15 2.0032e+18 20866
## + Writing      1 3.1622e+15 2.0036e+18 20866
## + Comedy       1 2.9924e+15 2.0038e+18 20866
## + GOther       1 2.7233e+15 2.0041e+18 20866
## + G            1 1.6095e+15 2.0052e+18 20866
## + R            1 6.9548e+14 2.0061e+18 20867
## + Season3      1 6.4688e+14 2.0062e+18 20867
## + NonOriginal  1 4.3240e+14 2.0064e+18 20867
## 
## Step:  AIC=20856.74
## Box.Office ~ Theatres + Budget + Sequel + Action
## 
##               Df  Sum of Sq        RSS   AIC
## + RealLife     1 1.4399e+16 1.9582e+18 20855
## + Season2      1 1.1799e+16 1.9608e+18 20855
## + Horror       1 1.0287e+16 1.9623e+18 20856
## + SOthers      1 9.8596e+15 1.9627e+18 20856
## + Writing      1 6.8384e+15 1.9658e+18 20857
## <none>                      1.9726e+18 20857
## + Season1      1 4.6257e+15 1.9680e+18 20857
## + Drama        1 4.3096e+15 1.9683e+18 20858
## + PG           1 2.4235e+15 1.9702e+18 20858
## + PG13         1 2.2589e+15 1.9704e+18 20858
## + G            1 1.9193e+15 1.9707e+18 20858
## + Season3      1 1.7735e+15 1.9708e+18 20858
## + GOther       1 1.0008e+15 1.9716e+18 20858
## + NonOriginal  1 7.8074e+14 1.9718e+18 20859
## + R            1 4.6537e+14 1.9721e+18 20859
## + Comedy       1 4.4936e+14 1.9722e+18 20859
## + Thriller     1 2.0258e+14 1.9724e+18 20859
## 
## Step:  AIC=20854.47
## Box.Office ~ Theatres + Budget + Sequel + Action + RealLife
## 
##               Df  Sum of Sq        RSS   AIC
## + Season2      1 1.1323e+16 1.9469e+18 20853
## + Writing      1 1.0725e+16 1.9475e+18 20853
## + SOthers      1 9.3394e+15 1.9489e+18 20854
## + Horror       1 9.0708e+15 1.9491e+18 20854
## <none>                      1.9582e+18 20855
## + Season1      1 4.3799e+15 1.9538e+18 20855
## + PG           1 3.5897e+15 1.9546e+18 20855
## + PG13         1 2.2742e+15 1.9559e+18 20856
## + Season3      1 1.7377e+15 1.9565e+18 20856
## + G            1 1.7145e+15 1.9565e+18 20856
## + Thriller     1 1.0525e+15 1.9572e+18 20856
## + Drama        1 7.8146e+14 1.9574e+18 20856
## + GOther       1 6.3954e+14 1.9576e+18 20856
## + NonOriginal  1 1.9817e+14 1.9580e+18 20856
## + R            1 1.3426e+14 1.9581e+18 20856
## + Comedy       1 1.2589e+13 1.9582e+18 20857
## 
## Step:  AIC=20853.09
## Box.Office ~ Theatres + Budget + Sequel + Action + RealLife + 
##     Season2
## 
##               Df  Sum of Sq        RSS   AIC
## + Writing      1 1.1872e+16 1.9350e+18 20852
## + Horror       1 9.7141e+15 1.9372e+18 20852
## + SOthers      1 8.5944e+15 1.9383e+18 20853
## <none>                      1.9469e+18 20853
## + PG           1 2.8560e+15 1.9440e+18 20854
## + Thriller     1 1.7764e+15 1.9451e+18 20855
## + PG13         1 1.7426e+15 1.9451e+18 20855
## + G            1 1.3973e+15 1.9455e+18 20855
## + Drama        1 1.0408e+15 1.9458e+18 20855
## + GOther       1 6.0094e+14 1.9463e+18 20855
## + NonOriginal  1 2.9702e+14 1.9466e+18 20855
## + Season1      1 2.1482e+14 1.9467e+18 20855
## + Season3      1 2.1482e+14 1.9467e+18 20855
## + Comedy       1 1.6079e+14 1.9467e+18 20855
## + R            1 9.2312e+13 1.9468e+18 20855
## 
## Step:  AIC=20851.52
## Box.Office ~ Theatres + Budget + Sequel + Action + RealLife + 
##     Season2 + Writing
## 
##               Df  Sum of Sq        RSS   AIC
## + Horror       1 8.5907e+15 1.9264e+18 20851
## <none>                      1.9350e+18 20852
## + SOthers      1 6.2532e+15 1.9288e+18 20852
## + PG           1 2.7473e+15 1.9323e+18 20853
## + G            1 1.6158e+15 1.9334e+18 20853
## + Thriller     1 1.6046e+15 1.9334e+18 20853
## + PG13         1 6.1105e+14 1.9344e+18 20853
## + GOther       1 5.1228e+14 1.9345e+18 20853
## + NonOriginal  1 2.8096e+14 1.9347e+18 20853
## + Season1      1 1.2290e+14 1.9349e+18 20854
## + Season3      1 1.2290e+14 1.9349e+18 20854
## + Drama        1 1.1143e+14 1.9349e+18 20854
## + R            1 6.2471e+13 1.9350e+18 20854
## + Comedy       1 1.7933e+13 1.9350e+18 20854
## 
## Step:  AIC=20850.93
## Box.Office ~ Theatres + Budget + Sequel + Action + RealLife + 
##     Season2 + Writing + Horror
## 
##               Df  Sum of Sq        RSS   AIC
## <none>                      1.9264e+18 20851
## + SOthers      1 5.0447e+15 1.9214e+18 20851
## + PG           1 3.4823e+15 1.9229e+18 20852
## + G            1 1.3998e+15 1.9250e+18 20853
## + NonOriginal  1 8.5401e+14 1.9256e+18 20853
## + Comedy       1 6.8077e+14 1.9257e+18 20853
## + Thriller     1 6.5382e+14 1.9258e+18 20853
## + PG13         1 4.1324e+14 1.9260e+18 20853
## + R            1 3.8927e+14 1.9260e+18 20853
## + GOther       1 3.0601e+14 1.9261e+18 20853
## + Season1      1 1.5545e+14 1.9263e+18 20853
## + Season3      1 1.5545e+14 1.9263e+18 20853
## + Drama        1 1.7473e+13 1.9264e+18 20853
## 
## Call:
## lm(formula = Box.Office ~ Theatres + Budget + Sequel + Action + 
##     RealLife + Season2 + Writing + Horror, data = Movie2)
## 
## Residuals:
##        Min         1Q     Median         3Q        Max 
## -166838330  -32992802   -6237790   21913890  392411728 
## 
## Coefficients:
##               Estimate Std. Error t value Pr(>|t|)    
## (Intercept) -1.169e+08  1.352e+07  -8.644  < 2e-16 ***
## Theatres     5.022e+04  5.016e+03  10.011  < 2e-16 ***
## Budget       6.063e-01  6.244e-02   9.709  < 2e-16 ***
## Sequel       3.297e+07  6.460e+06   5.104 4.52e-07 ***
## Action      -2.138e+07  6.282e+06  -3.404  0.00071 ***
## RealLife     2.013e+07  9.104e+06   2.211  0.02741 *  
## Season2      1.021e+07  5.178e+06   1.972  0.04913 *  
## Writing      9.865e+06  5.512e+06   1.790  0.07404 .  
## Horror      -1.683e+07  1.052e+07  -1.600  0.11017    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 57930000 on 574 degrees of freedom
## Multiple R-squared:  0.566,  Adjusted R-squared:  0.5599 
## F-statistic: 93.56 on 8 and 574 DF,  p-value: < 2.2e-16

The best subset of predictor variables to predict Box.Office based on forward selection (with AIC) is Theatres, Budget, Sequel, Action, RealLife, Season2, Writing, and Horror.

b) Using backward elimination (with AIC), find the best subset of predictor variables to predict Box.Office.

## Start:  AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG + 
##     PG13 + R + Season1 + Season2 + Season3 + Action + Comedy + 
##     Drama + Horror + GOther + Thriller + RealLife + Writing + 
##     NonOriginal + Original + Screenplay + SOthers
## 
## 
## Step:  AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG + 
##     PG13 + R + Season1 + Season2 + Season3 + Action + Comedy + 
##     Drama + Horror + GOther + Thriller + RealLife + Writing + 
##     NonOriginal + Original + SOthers
## 
## 
## Step:  AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG + 
##     PG13 + R + Season1 + Season2 + Season3 + Action + Comedy + 
##     Drama + Horror + GOther + Thriller + RealLife + Writing + 
##     NonOriginal + SOthers
## 
## 
## Step:  AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG + 
##     PG13 + R + Season1 + Season2 + Season3 + Action + Comedy + 
##     Drama + Horror + GOther + RealLife + Writing + NonOriginal + 
##     SOthers
## 
## 
## Step:  AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG + 
##     PG13 + R + Season1 + Season2 + Action + Comedy + Drama + 
##     Horror + GOther + RealLife + Writing + NonOriginal + SOthers
## 
## 
## Step:  AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG + 
##     PG13 + Season1 + Season2 + Action + Comedy + Drama + Horror + 
##     GOther + RealLife + Writing + NonOriginal + SOthers
## 
## 
## Step:  AIC=20865.42
## Box.Office ~ Sequel + Budget + Theatres + G + PG + PG13 + Season1 + 
##     Season2 + Action + Comedy + Drama + Horror + GOther + RealLife + 
##     Writing + NonOriginal + SOthers
## 
##               Df  Sum of Sq        RSS   AIC
## - PG13         1 2.6415e+13 1.9149e+18 20863
## - GOther       1 8.1922e+13 1.9149e+18 20863
## - Drama        1 1.0319e+14 1.9150e+18 20864
## - Season1      1 2.7187e+14 1.9151e+18 20864
## - Comedy       1 5.0062e+14 1.9154e+18 20864
## - NonOriginal  1 5.4848e+14 1.9154e+18 20864
## - G            1 7.7291e+14 1.9156e+18 20864
## - PG           1 2.8300e+15 1.9177e+18 20864
## - SOthers      1 4.8018e+15 1.9197e+18 20865
## <none>                      1.9149e+18 20865
## - Season2      1 7.0474e+15 1.9219e+18 20866
## - Horror       1 7.8770e+15 1.9227e+18 20866
## - Writing      1 8.3308e+15 1.9232e+18 20866
## - RealLife     1 1.4657e+16 1.9295e+18 20868
## - Action       1 2.0273e+16 1.9351e+18 20870
## - Sequel       1 8.5859e+16 2.0007e+18 20889
## - Budget       1 2.8985e+17 2.2047e+18 20946
## - Theatres     1 3.2892e+17 2.2438e+18 20956
## 
## Step:  AIC=20863.43
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season1 + 
##     Season2 + Action + Comedy + Drama + Horror + GOther + RealLife + 
##     Writing + NonOriginal + SOthers
## 
##               Df  Sum of Sq        RSS   AIC
## - GOther       1 7.8120e+13 1.9150e+18 20862
## - Drama        1 1.1615e+14 1.9150e+18 20862
## - Season1      1 2.8009e+14 1.9152e+18 20862
## - Comedy       1 4.8913e+14 1.9154e+18 20862
## - NonOriginal  1 5.5771e+14 1.9154e+18 20862
## - G            1 8.7305e+14 1.9158e+18 20862
## - PG           1 3.4962e+15 1.9184e+18 20863
## - SOthers      1 4.7981e+15 1.9197e+18 20863
## <none>                      1.9149e+18 20863
## - Season2      1 7.0222e+15 1.9219e+18 20864
## - Horror       1 7.8569e+15 1.9227e+18 20864
## - Writing      1 8.3340e+15 1.9232e+18 20864
## - RealLife     1 1.4652e+16 1.9295e+18 20866
## - Action       1 2.0274e+16 1.9352e+18 20868
## - Sequel       1 8.5914e+16 2.0008e+18 20887
## - Budget       1 2.9828e+17 2.2132e+18 20946
## - Theatres     1 3.3056e+17 2.2454e+18 20954
## 
## Step:  AIC=20861.45
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season1 + 
##     Season2 + Action + Comedy + Drama + Horror + RealLife + Writing + 
##     NonOriginal + SOthers
## 
##               Df  Sum of Sq        RSS   AIC
## - Drama        1 2.1017e+14 1.9152e+18 20860
## - Season1      1 3.0130e+14 1.9153e+18 20860
## - NonOriginal  1 6.2939e+14 1.9156e+18 20860
## - Comedy       1 7.2702e+14 1.9157e+18 20860
## - G            1 9.2320e+14 1.9159e+18 20860
## - PG           1 3.4182e+15 1.9184e+18 20861
## - SOthers      1 4.7652e+15 1.9197e+18 20861
## <none>                      1.9150e+18 20862
## - Season2      1 7.0318e+15 1.9220e+18 20862
## - Writing      1 8.4644e+15 1.9234e+18 20862
## - Horror       1 8.7477e+15 1.9237e+18 20862
## - RealLife     1 1.5122e+16 1.9301e+18 20864
## - Action       1 2.4012e+16 1.9390e+18 20867
## - Sequel       1 8.5865e+16 2.0008e+18 20885
## - Budget       1 2.9866e+17 2.2136e+18 20944
## - Theatres     1 3.3089e+17 2.2459e+18 20952
## 
## Step:  AIC=20859.51
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season1 + 
##     Season2 + Action + Comedy + Horror + RealLife + Writing + 
##     NonOriginal + SOthers
## 
##               Df  Sum of Sq        RSS   AIC
## - Season1      1 3.0662e+14 1.9155e+18 20858
## - Comedy       1 5.1726e+14 1.9157e+18 20858
## - NonOriginal  1 6.0446e+14 1.9158e+18 20858
## - G            1 9.4522e+14 1.9161e+18 20858
## - PG           1 3.5675e+15 1.9187e+18 20859
## - SOthers      1 4.8166e+15 1.9200e+18 20859
## <none>                      1.9152e+18 20860
## - Season2      1 6.9618e+15 1.9221e+18 20860
## - Writing      1 8.2628e+15 1.9234e+18 20860
## - Horror       1 8.8883e+15 1.9241e+18 20860
## - RealLife     1 1.5410e+16 1.9306e+18 20862
## - Action       1 2.9223e+16 1.9444e+18 20866
## - Sequel       1 8.5674e+16 2.0009e+18 20883
## - Budget       1 2.9883e+17 2.2140e+18 20942
## - Theatres     1 3.3253e+17 2.2477e+18 20951
## 
## Step:  AIC=20857.61
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season2 + 
##     Action + Comedy + Horror + RealLife + Writing + NonOriginal + 
##     SOthers
## 
##               Df  Sum of Sq        RSS   AIC
## - Comedy       1 5.2868e+14 1.9160e+18 20856
## - NonOriginal  1 6.2339e+14 1.9161e+18 20856
## - G            1 9.3581e+14 1.9164e+18 20856
## - PG           1 3.3808e+15 1.9189e+18 20857
## - SOthers      1 4.8528e+15 1.9203e+18 20857
## <none>                      1.9155e+18 20858
## - Writing      1 8.3843e+15 1.9239e+18 20858
## - Horror       1 8.8400e+15 1.9243e+18 20858
## - Season2      1 1.1484e+16 1.9270e+18 20859
## - RealLife     1 1.5428e+16 1.9309e+18 20860
## - Action       1 3.0388e+16 1.9459e+18 20865
## - Sequel       1 8.7957e+16 2.0034e+18 20882
## - Budget       1 3.0737e+17 2.2229e+18 20942
## - Theatres     1 3.3396e+17 2.2494e+18 20949
## 
## Step:  AIC=20855.77
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season2 + 
##     Action + Horror + RealLife + Writing + NonOriginal + SOthers
## 
##               Df  Sum of Sq        RSS   AIC
## - NonOriginal  1 5.9736e+14 1.9166e+18 20854
## - G            1 8.7216e+14 1.9169e+18 20854
## - PG           1 3.6675e+15 1.9197e+18 20855
## - SOthers      1 4.8590e+15 1.9209e+18 20855
## <none>                      1.9160e+18 20856
## - Horror       1 8.3477e+15 1.9244e+18 20856
## - Writing      1 9.3218e+15 1.9253e+18 20857
## - Season2      1 1.1119e+16 1.9271e+18 20857
## - RealLife     1 1.7320e+16 1.9333e+18 20859
## - Action       1 3.3657e+16 1.9497e+18 20864
## - Sequel       1 8.7429e+16 2.0034e+18 20880
## - Budget       1 3.1376e+17 2.2298e+18 20942
## - Theatres     1 3.3483e+17 2.2508e+18 20948
## 
## Step:  AIC=20853.95
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season2 + 
##     Action + Horror + RealLife + Writing + SOthers
## 
##            Df  Sum of Sq        RSS   AIC
## - G         1 9.0703e+14 1.9175e+18 20852
## - PG        1 3.5162e+15 1.9201e+18 20853
## - SOthers   1 5.2746e+15 1.9219e+18 20854
## <none>                   1.9166e+18 20854
## - Horror    1 7.8777e+15 1.9245e+18 20854
## - Writing   1 8.7580e+15 1.9254e+18 20855
## - Season2   1 1.1167e+16 1.9278e+18 20855
## - RealLife  1 1.6725e+16 1.9333e+18 20857
## - Action    1 3.3568e+16 1.9502e+18 20862
## - Sequel    1 8.6833e+16 2.0034e+18 20878
## - Budget    1 3.1620e+17 2.2328e+18 20941
## - Theatres  1 3.3694e+17 2.2536e+18 20946
## 
## Step:  AIC=20852.23
## Box.Office ~ Sequel + Budget + Theatres + PG + Season2 + Action + 
##     Horror + RealLife + Writing + SOthers
## 
##            Df  Sum of Sq        RSS   AIC
## - PG        1 3.8614e+15 1.9214e+18 20851
## - SOthers   1 5.4239e+15 1.9229e+18 20852
## <none>                   1.9175e+18 20852
## - Horror    1 8.0654e+15 1.9256e+18 20853
## - Writing   1 8.5847e+15 1.9261e+18 20853
## - Season2   1 1.1376e+16 1.9289e+18 20854
## - RealLife  1 1.6880e+16 1.9344e+18 20855
## - Action    1 3.3233e+16 1.9508e+18 20860
## - Sequel    1 8.8333e+16 2.0059e+18 20877
## - Budget    1 3.1609e+17 2.2336e+18 20939
## - Theatres  1 3.3832e+17 2.2558e+18 20945
## 
## Step:  AIC=20851.4
## Box.Office ~ Sequel + Budget + Theatres + Season2 + Action + 
##     Horror + RealLife + Writing + SOthers
## 
##            Df  Sum of Sq        RSS   AIC
## - SOthers   1 5.0447e+15 1.9264e+18 20851
## <none>                   1.9214e+18 20851
## - Horror    1 7.3822e+15 1.9288e+18 20852
## - Writing   1 8.8043e+15 1.9302e+18 20852
## - Season2   1 1.2266e+16 1.9336e+18 20853
## - RealLife  1 1.5713e+16 1.9371e+18 20854
## - Action    1 3.6624e+16 1.9580e+18 20860
## - Sequel    1 8.9711e+16 2.0111e+18 20876
## - Budget    1 3.1993e+17 2.2413e+18 20939
## - Theatres  1 3.3467e+17 2.2560e+18 20943
## 
## Step:  AIC=20850.93
## Box.Office ~ Sequel + Budget + Theatres + Season2 + Action + 
##     Horror + RealLife + Writing
## 
##            Df  Sum of Sq        RSS   AIC
## <none>                   1.9264e+18 20851
## - Horror    1 8.5907e+15 1.9350e+18 20852
## - Writing   1 1.0749e+16 1.9372e+18 20852
## - Season2   1 1.3047e+16 1.9395e+18 20853
## - RealLife  1 1.6411e+16 1.9428e+18 20854
## - Action    1 3.8894e+16 1.9653e+18 20861
## - Sequel    1 8.7444e+16 2.0139e+18 20875
## - Budget    1 3.1638e+17 2.2428e+18 20938
## - Theatres  1 3.3632e+17 2.2627e+18 20943
## 
## Call:
## lm(formula = Box.Office ~ Sequel + Budget + Theatres + Season2 + 
##     Action + Horror + RealLife + Writing, data = Movie2)
## 
## Residuals:
##        Min         1Q     Median         3Q        Max 
## -166838330  -32992802   -6237790   21913890  392411728 
## 
## Coefficients:
##               Estimate Std. Error t value Pr(>|t|)    
## (Intercept) -1.169e+08  1.352e+07  -8.644  < 2e-16 ***
## Sequel       3.297e+07  6.460e+06   5.104 4.52e-07 ***
## Budget       6.063e-01  6.244e-02   9.709  < 2e-16 ***
## Theatres     5.022e+04  5.016e+03  10.011  < 2e-16 ***
## Season2      1.021e+07  5.178e+06   1.972  0.04913 *  
## Action      -2.138e+07  6.282e+06  -3.404  0.00071 ***
## Horror      -1.683e+07  1.052e+07  -1.600  0.11017    
## RealLife     2.013e+07  9.104e+06   2.211  0.02741 *  
## Writing      9.865e+06  5.512e+06   1.790  0.07404 .  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 57930000 on 574 degrees of freedom
## Multiple R-squared:  0.566,  Adjusted R-squared:  0.5599 
## F-statistic: 93.56 on 8 and 574 DF,  p-value: < 2.2e-16

The best subset of predictor variables to predict Box.Office based on backward elimination (with AIC) is Sequel, Budget, Theatres, Season2, Action, Horror, RealLife, and Writing.

c) Are the models in part (a) and part (b) the same?

d) Using forward selection (with BIC), find the best subset of predictor variables to predict Box.Office.

## Start:  AIC=21325.88
## Box.Office ~ 1
## 
##               Df  Sum of Sq        RSS   AIC
## + Theatres     1 1.9800e+18 2.4584e+18 20988
## + Budget       1 1.9453e+18 2.4931e+18 20996
## + Sequel       1 6.4531e+17 3.7931e+18 21241
## + Action       1 4.9314e+17 3.9453e+18 21264
## + R            1 2.6847e+17 4.1699e+18 21296
## + Season2      1 2.2761e+17 4.2108e+18 21302
## + Writing      1 1.8902e+17 4.2494e+18 21307
## + Season1      1 1.2136e+17 4.3170e+18 21316
## + PG13         1 1.0624e+17 4.3322e+18 21318
## + Horror       1 8.2679e+16 4.3557e+18 21321
## + Comedy       1 6.4364e+16 4.3740e+18 21324
## + Drama        1 5.3374e+16 4.3850e+18 21325
## <none>                      4.4384e+18 21326
## + Thriller     1 3.5588e+16 4.4028e+18 21328
## + G            1 2.5547e+16 4.4128e+18 21329
## + PG           1 1.9613e+16 4.4188e+18 21330
## + RealLife     1 1.9296e+16 4.4191e+18 21330
## + Season3      1 1.9031e+16 4.4194e+18 21330
## + GOther       1 3.4998e+15 4.4349e+18 21332
## + SOthers      1 8.8164e+14 4.4375e+18 21332
## + NonOriginal  1 7.4731e+13 4.4383e+18 21332
## 
## Step:  AIC=20987.82
## Box.Office ~ Theatres
## 
##               Df  Sum of Sq        RSS   AIC
## + Budget       1 3.7618e+17 2.0822e+18 20897
## + Sequel       1 1.2168e+17 2.3367e+18 20965
## + Season1      1 4.4363e+16 2.4140e+18 20984
## + Season2      1 3.9151e+16 2.4192e+18 20985
## + Writing      1 2.7391e+16 2.4310e+18 20988
## + PG13         1 2.7183e+16 2.4312e+18 20988
## <none>                      2.4584e+18 20988
## + R            1 1.6358e+16 2.4420e+18 20990
## + Action       1 1.6105e+16 2.4423e+18 20990
## + Horror       1 1.3496e+16 2.4449e+18 20991
## + Comedy       1 1.3367e+16 2.4450e+18 20991
## + RealLife     1 8.0290e+15 2.4503e+18 20992
## + PG           1 7.2926e+15 2.4511e+18 20993
## + G            1 4.9078e+15 2.4534e+18 20993
## + Drama        1 4.1396e+15 2.4542e+18 20993
## + NonOriginal  1 2.5414e+15 2.4558e+18 20994
## + SOthers      1 1.8631e+15 2.4565e+18 20994
## + GOther       1 1.5062e+15 2.4569e+18 20994
## + Thriller     1 2.2507e+14 2.4581e+18 20994
## + Season3      1 1.6799e+14 2.4582e+18 20994
## 
## Step:  AIC=20897.36
## Box.Office ~ Theatres + Budget
## 
##               Df  Sum of Sq        RSS   AIC
## + Sequel       1 7.5366e+16 2.0068e+18 20882
## + Action       1 2.6413e+16 2.0558e+18 20896
## <none>                      2.0822e+18 20897
## + Season2      1 1.6667e+16 2.0655e+18 20899
## + RealLife     1 1.5316e+16 2.0669e+18 20899
## + Season1      1 1.4044e+16 2.0681e+18 20900
## + Drama        1 9.7615e+15 2.0724e+18 20901
## + SOthers      1 7.5097e+15 2.0747e+18 20902
## + PG           1 6.7487e+15 2.0754e+18 20902
## + PG13         1 4.0048e+15 2.0782e+18 20903
## + Comedy       1 3.6590e+15 2.0785e+18 20903
## + G            1 3.4419e+15 2.0787e+18 20903
## + Horror       1 3.0851e+15 2.0791e+18 20903
## + Writing      1 2.0657e+15 2.0801e+18 20903
## + NonOriginal  1 1.4059e+15 2.0808e+18 20903
## + GOther       1 1.2000e+15 2.0810e+18 20903
## + Thriller     1 1.0118e+15 2.0812e+18 20903
## + R            1 1.9148e+14 2.0820e+18 20904
## + Season3      1 1.2725e+14 2.0821e+18 20904
## 
## Step:  AIC=20882.23
## Box.Office ~ Theatres + Budget + Sequel
## 
##               Df  Sum of Sq        RSS   AIC
## + Action       1 3.4203e+16 1.9726e+18 20879
## <none>                      2.0068e+18 20882
## + RealLife     1 1.7270e+16 1.9895e+18 20884
## + Season2      1 1.2653e+16 1.9942e+18 20885
## + Drama        1 1.2060e+16 1.9948e+18 20885
## + SOthers      1 1.1721e+16 1.9951e+18 20885
## + Season1      1 7.7574e+15 1.9991e+18 20886
## + Horror       1 6.0203e+15 2.0008e+18 20887
## + PG           1 5.1471e+15 2.0017e+18 20887
## + PG13         1 5.0657e+15 2.0017e+18 20887
## + Thriller     1 3.6615e+15 2.0032e+18 20888
## + Writing      1 3.1622e+15 2.0036e+18 20888
## + Comedy       1 2.9924e+15 2.0038e+18 20888
## + GOther       1 2.7233e+15 2.0041e+18 20888
## + G            1 1.6095e+15 2.0052e+18 20888
## + R            1 6.9548e+14 2.0061e+18 20888
## + Season3      1 6.4688e+14 2.0062e+18 20888
## + NonOriginal  1 4.3240e+14 2.0064e+18 20889
## 
## Step:  AIC=20878.58
## Box.Office ~ Theatres + Budget + Sequel + Action
## 
##               Df  Sum of Sq        RSS   AIC
## <none>                      1.9726e+18 20879
## + RealLife     1 1.4399e+16 1.9582e+18 20881
## + Season2      1 1.1799e+16 1.9608e+18 20882
## + Horror       1 1.0287e+16 1.9623e+18 20882
## + SOthers      1 9.8596e+15 1.9627e+18 20882
## + Writing      1 6.8384e+15 1.9658e+18 20883
## + Season1      1 4.6257e+15 1.9680e+18 20884
## + Drama        1 4.3096e+15 1.9683e+18 20884
## + PG           1 2.4235e+15 1.9702e+18 20884
## + PG13         1 2.2589e+15 1.9704e+18 20884
## + G            1 1.9193e+15 1.9707e+18 20884
## + Season3      1 1.7735e+15 1.9708e+18 20884
## + GOther       1 1.0008e+15 1.9716e+18 20885
## + NonOriginal  1 7.8074e+14 1.9718e+18 20885
## + R            1 4.6537e+14 1.9721e+18 20885
## + Comedy       1 4.4936e+14 1.9722e+18 20885
## + Thriller     1 2.0258e+14 1.9724e+18 20885
## 
## Call:
## lm(formula = Box.Office ~ Theatres + Budget + Sequel + Action, 
##     data = Movie2)
## 
## Residuals:
##        Min         1Q     Median         3Q        Max 
## -169664977  -33263137   -4291410   22141604  400426367 
## 
## Coefficients:
##               Estimate Std. Error t value Pr(>|t|)    
## (Intercept) -1.126e+08  1.331e+07  -8.461  < 2e-16 ***
## Theatres     5.047e+04  5.028e+03  10.038  < 2e-16 ***
## Budget       6.347e-01  6.205e-02  10.229  < 2e-16 ***
## Sequel       3.193e+07  6.468e+06   4.936 1.04e-06 ***
## Action      -1.970e+07  6.223e+06  -3.166  0.00163 ** 
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 58420000 on 578 degrees of freedom
## Multiple R-squared:  0.5556, Adjusted R-squared:  0.5525 
## F-statistic: 180.6 on 4 and 578 DF,  p-value: < 2.2e-16

The best subset of predictor variables to predict Box.Office based on forward selection (with BIC) is Theatres, Budget, Sequel, and Action.

e) Using backward elimination (with BIC), find the best subset of predictor variables to predict Box.Office.

## Start:  AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG + 
##     PG13 + R + Season1 + Season2 + Season3 + Action + Comedy + 
##     Drama + Horror + GOther + Thriller + RealLife + Writing + 
##     NonOriginal + Original + Screenplay + SOthers
## 
## 
## Step:  AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG + 
##     PG13 + R + Season1 + Season2 + Season3 + Action + Comedy + 
##     Drama + Horror + GOther + Thriller + RealLife + Writing + 
##     NonOriginal + Original + SOthers
## 
## 
## Step:  AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG + 
##     PG13 + R + Season1 + Season2 + Season3 + Action + Comedy + 
##     Drama + Horror + GOther + Thriller + RealLife + Writing + 
##     NonOriginal + SOthers
## 
## 
## Step:  AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG + 
##     PG13 + R + Season1 + Season2 + Season3 + Action + Comedy + 
##     Drama + Horror + GOther + RealLife + Writing + NonOriginal + 
##     SOthers
## 
## 
## Step:  AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG + 
##     PG13 + R + Season1 + Season2 + Action + Comedy + Drama + 
##     Horror + GOther + RealLife + Writing + NonOriginal + SOthers
## 
## 
## Step:  AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + Not.Rated + PG + 
##     PG13 + Season1 + Season2 + Action + Comedy + Drama + Horror + 
##     GOther + RealLife + Writing + NonOriginal + SOthers
## 
## 
## Step:  AIC=20944.05
## Box.Office ~ Sequel + Budget + Theatres + G + PG + PG13 + Season1 + 
##     Season2 + Action + Comedy + Drama + Horror + GOther + RealLife + 
##     Writing + NonOriginal + SOthers
## 
##               Df  Sum of Sq        RSS   AIC
## - PG13         1 2.6415e+13 1.9149e+18 20938
## - GOther       1 8.1922e+13 1.9149e+18 20938
## - Drama        1 1.0319e+14 1.9150e+18 20938
## - Season1      1 2.7187e+14 1.9151e+18 20938
## - Comedy       1 5.0062e+14 1.9154e+18 20938
## - NonOriginal  1 5.4848e+14 1.9154e+18 20938
## - G            1 7.7291e+14 1.9156e+18 20938
## - PG           1 2.8300e+15 1.9177e+18 20939
## - SOthers      1 4.8018e+15 1.9197e+18 20939
## - Season2      1 7.0474e+15 1.9219e+18 20940
## - Horror       1 7.8770e+15 1.9227e+18 20940
## - Writing      1 8.3308e+15 1.9232e+18 20940
## - RealLife     1 1.4657e+16 1.9295e+18 20942
## - Action       1 2.0273e+16 1.9351e+18 20944
## <none>                      1.9149e+18 20944
## - Sequel       1 8.5859e+16 2.0007e+18 20963
## - Budget       1 2.8985e+17 2.2047e+18 21020
## - Theatres     1 3.2892e+17 2.2438e+18 21030
## 
## Step:  AIC=20937.69
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season1 + 
##     Season2 + Action + Comedy + Drama + Horror + GOther + RealLife + 
##     Writing + NonOriginal + SOthers
## 
##               Df  Sum of Sq        RSS   AIC
## - GOther       1 7.8120e+13 1.9150e+18 20931
## - Drama        1 1.1615e+14 1.9150e+18 20931
## - Season1      1 2.8009e+14 1.9152e+18 20931
## - Comedy       1 4.8913e+14 1.9154e+18 20932
## - NonOriginal  1 5.5771e+14 1.9154e+18 20932
## - G            1 8.7305e+14 1.9158e+18 20932
## - PG           1 3.4962e+15 1.9184e+18 20932
## - SOthers      1 4.7981e+15 1.9197e+18 20933
## - Season2      1 7.0222e+15 1.9219e+18 20934
## - Horror       1 7.8569e+15 1.9227e+18 20934
## - Writing      1 8.3340e+15 1.9232e+18 20934
## - RealLife     1 1.4652e+16 1.9295e+18 20936
## - Action       1 2.0274e+16 1.9352e+18 20938
## <none>                      1.9149e+18 20938
## - Sequel       1 8.5914e+16 2.0008e+18 20957
## - Budget       1 2.9828e+17 2.2132e+18 21016
## - Theatres     1 3.3056e+17 2.2454e+18 21024
## 
## Step:  AIC=20931.34
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season1 + 
##     Season2 + Action + Comedy + Drama + Horror + RealLife + Writing + 
##     NonOriginal + SOthers
## 
##               Df  Sum of Sq        RSS   AIC
## - Drama        1 2.1017e+14 1.9152e+18 20925
## - Season1      1 3.0130e+14 1.9153e+18 20925
## - NonOriginal  1 6.2939e+14 1.9156e+18 20925
## - Comedy       1 7.2702e+14 1.9157e+18 20925
## - G            1 9.2320e+14 1.9159e+18 20925
## - PG           1 3.4182e+15 1.9184e+18 20926
## - SOthers      1 4.7652e+15 1.9197e+18 20926
## - Season2      1 7.0318e+15 1.9220e+18 20927
## - Writing      1 8.4644e+15 1.9234e+18 20928
## - Horror       1 8.7477e+15 1.9237e+18 20928
## - RealLife     1 1.5122e+16 1.9301e+18 20930
## <none>                      1.9150e+18 20931
## - Action       1 2.4012e+16 1.9390e+18 20932
## - Sequel       1 8.5865e+16 2.0008e+18 20951
## - Budget       1 2.9866e+17 2.2136e+18 21010
## - Theatres     1 3.3089e+17 2.2459e+18 21018
## 
## Step:  AIC=20925.04
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season1 + 
##     Season2 + Action + Comedy + Horror + RealLife + Writing + 
##     NonOriginal + SOthers
## 
##               Df  Sum of Sq        RSS   AIC
## - Season1      1 3.0662e+14 1.9155e+18 20919
## - Comedy       1 5.1726e+14 1.9157e+18 20919
## - NonOriginal  1 6.0446e+14 1.9158e+18 20919
## - G            1 9.4522e+14 1.9161e+18 20919
## - PG           1 3.5675e+15 1.9187e+18 20920
## - SOthers      1 4.8166e+15 1.9200e+18 20920
## - Season2      1 6.9618e+15 1.9221e+18 20921
## - Writing      1 8.2628e+15 1.9234e+18 20921
## - Horror       1 8.8883e+15 1.9241e+18 20921
## - RealLife     1 1.5410e+16 1.9306e+18 20923
## <none>                      1.9152e+18 20925
## - Action       1 2.9223e+16 1.9444e+18 20928
## - Sequel       1 8.5674e+16 2.0009e+18 20944
## - Budget       1 2.9883e+17 2.2140e+18 21003
## - Theatres     1 3.3253e+17 2.2477e+18 21012
## 
## Step:  AIC=20918.76
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season2 + 
##     Action + Comedy + Horror + RealLife + Writing + NonOriginal + 
##     SOthers
## 
##               Df  Sum of Sq        RSS   AIC
## - Comedy       1 5.2868e+14 1.9160e+18 20913
## - NonOriginal  1 6.2339e+14 1.9161e+18 20913
## - G            1 9.3581e+14 1.9164e+18 20913
## - PG           1 3.3808e+15 1.9189e+18 20913
## - SOthers      1 4.8528e+15 1.9203e+18 20914
## - Writing      1 8.3843e+15 1.9239e+18 20915
## - Horror       1 8.8400e+15 1.9243e+18 20915
## - Season2      1 1.1484e+16 1.9270e+18 20916
## - RealLife     1 1.5428e+16 1.9309e+18 20917
## <none>                      1.9155e+18 20919
## - Action       1 3.0388e+16 1.9459e+18 20922
## - Sequel       1 8.7957e+16 2.0034e+18 20939
## - Budget       1 3.0737e+17 2.2229e+18 20999
## - Theatres     1 3.3396e+17 2.2494e+18 21006
## 
## Step:  AIC=20912.56
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season2 + 
##     Action + Horror + RealLife + Writing + NonOriginal + SOthers
## 
##               Df  Sum of Sq        RSS   AIC
## - NonOriginal  1 5.9736e+14 1.9166e+18 20906
## - G            1 8.7216e+14 1.9169e+18 20907
## - PG           1 3.6675e+15 1.9197e+18 20907
## - SOthers      1 4.8590e+15 1.9209e+18 20908
## - Horror       1 8.3477e+15 1.9244e+18 20909
## - Writing      1 9.3218e+15 1.9253e+18 20909
## - Season2      1 1.1119e+16 1.9271e+18 20910
## - RealLife     1 1.7320e+16 1.9333e+18 20911
## <none>                      1.9160e+18 20913
## - Action       1 3.3657e+16 1.9497e+18 20916
## - Sequel       1 8.7429e+16 2.0034e+18 20932
## - Budget       1 3.1376e+17 2.2298e+18 20995
## - Theatres     1 3.3483e+17 2.2508e+18 21000
## 
## Step:  AIC=20906.37
## Box.Office ~ Sequel + Budget + Theatres + G + PG + Season2 + 
##     Action + Horror + RealLife + Writing + SOthers
## 
##            Df  Sum of Sq        RSS   AIC
## - G         1 9.0703e+14 1.9175e+18 20900
## - PG        1 3.5162e+15 1.9201e+18 20901
## - SOthers   1 5.2746e+15 1.9219e+18 20902
## - Horror    1 7.8777e+15 1.9245e+18 20902
## - Writing   1 8.7580e+15 1.9254e+18 20903
## - Season2   1 1.1167e+16 1.9278e+18 20903
## - RealLife  1 1.6725e+16 1.9333e+18 20905
## <none>                   1.9166e+18 20906
## - Action    1 3.3568e+16 1.9502e+18 20910
## - Sequel    1 8.6833e+16 2.0034e+18 20926
## - Budget    1 3.1620e+17 2.2328e+18 20989
## - Theatres  1 3.3694e+17 2.2536e+18 20994
## 
## Step:  AIC=20900.28
## Box.Office ~ Sequel + Budget + Theatres + PG + Season2 + Action + 
##     Horror + RealLife + Writing + SOthers
## 
##            Df  Sum of Sq        RSS   AIC
## - PG        1 3.8614e+15 1.9214e+18 20895
## - SOthers   1 5.4239e+15 1.9229e+18 20896
## - Horror    1 8.0654e+15 1.9256e+18 20896
## - Writing   1 8.5847e+15 1.9261e+18 20897
## - Season2   1 1.1376e+16 1.9289e+18 20897
## - RealLife  1 1.6880e+16 1.9344e+18 20899
## <none>                   1.9175e+18 20900
## - Action    1 3.3233e+16 1.9508e+18 20904
## - Sequel    1 8.8333e+16 2.0059e+18 20920
## - Budget    1 3.1609e+17 2.2336e+18 20983
## - Theatres  1 3.3832e+17 2.2558e+18 20989
## 
## Step:  AIC=20895.08
## Box.Office ~ Sequel + Budget + Theatres + Season2 + Action + 
##     Horror + RealLife + Writing + SOthers
## 
##            Df  Sum of Sq        RSS   AIC
## - SOthers   1 5.0447e+15 1.9264e+18 20890
## - Horror    1 7.3822e+15 1.9288e+18 20891
## - Writing   1 8.8043e+15 1.9302e+18 20891
## - Season2   1 1.2266e+16 1.9336e+18 20892
## - RealLife  1 1.5713e+16 1.9371e+18 20894
## <none>                   1.9214e+18 20895
## - Action    1 3.6624e+16 1.9580e+18 20900
## - Sequel    1 8.9711e+16 2.0111e+18 20915
## - Budget    1 3.1993e+17 2.2413e+18 20979
## - Theatres  1 3.3467e+17 2.2560e+18 20982
## 
## Step:  AIC=20890.24
## Box.Office ~ Sequel + Budget + Theatres + Season2 + Action + 
##     Horror + RealLife + Writing
## 
##            Df  Sum of Sq        RSS   AIC
## - Horror    1 8.5907e+15 1.9350e+18 20887
## - Writing   1 1.0749e+16 1.9372e+18 20887
## - Season2   1 1.3047e+16 1.9395e+18 20888
## - RealLife  1 1.6411e+16 1.9428e+18 20889
## <none>                   1.9264e+18 20890
## - Action    1 3.8894e+16 1.9653e+18 20896
## - Sequel    1 8.7444e+16 2.0139e+18 20910
## - Budget    1 3.1638e+17 2.2428e+18 20973
## - Theatres  1 3.3632e+17 2.2627e+18 20978
## 
## Step:  AIC=20886.47
## Box.Office ~ Sequel + Budget + Theatres + Season2 + Action + 
##     RealLife + Writing
## 
##            Df  Sum of Sq        RSS   AIC
## - Writing   1 1.1872e+16 1.9469e+18 20884
## - Season2   1 1.2470e+16 1.9475e+18 20884
## - RealLife  1 1.7972e+16 1.9530e+18 20886
## <none>                   1.9350e+18 20887
## - Action    1 3.5153e+16 1.9702e+18 20891
## - Sequel    1 8.3500e+16 2.0185e+18 20905
## - Budget    1 3.2123e+17 2.2562e+18 20970
## - Theatres  1 3.4137e+17 2.2764e+18 20975
## 
## Step:  AIC=20883.67
## Box.Office ~ Sequel + Budget + Theatres + Season2 + Action + 
##     RealLife
## 
##            Df  Sum of Sq        RSS   AIC
## - Season2   1 1.1323e+16 1.9582e+18 20881
## - RealLife  1 1.3922e+16 1.9608e+18 20882
## <none>                   1.9469e+18 20884
## - Action    1 3.0577e+16 1.9775e+18 20886
## - Sequel    1 8.0491e+16 2.0274e+18 20901
## - Theatres  1 3.4256e+17 2.2894e+18 20972
## - Budget    1 3.4265e+17 2.2895e+18 20972
## 
## Step:  AIC=20880.68
## Box.Office ~ Sequel + Budget + Theatres + Action + RealLife
## 
##            Df  Sum of Sq        RSS   AIC
## - RealLife  1 1.4399e+16 1.9726e+18 20879
## <none>                   1.9582e+18 20881
## - Action    1 3.1331e+16 1.9895e+18 20884
## - Sequel    1 8.4689e+16 2.0429e+18 20899
## - Theatres  1 3.5265e+17 2.3109e+18 20971
## - Budget    1 3.5968e+17 2.3179e+18 20973
## 
## Step:  AIC=20878.58
## Box.Office ~ Sequel + Budget + Theatres + Action
## 
##            Df  Sum of Sq        RSS   AIC
## <none>                   1.9726e+18 20879
## - Action    1 3.4203e+16 2.0068e+18 20882
## - Sequel    1 8.3156e+16 2.0558e+18 20896
## - Theatres  1 3.4385e+17 2.3165e+18 20966
## - Budget    1 3.5708e+17 2.3297e+18 20969
## 
## Call:
## lm(formula = Box.Office ~ Sequel + Budget + Theatres + Action, 
##     data = Movie2)
## 
## Residuals:
##        Min         1Q     Median         3Q        Max 
## -169664977  -33263137   -4291410   22141604  400426367 
## 
## Coefficients:
##               Estimate Std. Error t value Pr(>|t|)    
## (Intercept) -1.126e+08  1.331e+07  -8.461  < 2e-16 ***
## Sequel       3.193e+07  6.468e+06   4.936 1.04e-06 ***
## Budget       6.347e-01  6.205e-02  10.229  < 2e-16 ***
## Theatres     5.047e+04  5.028e+03  10.038  < 2e-16 ***
## Action      -1.970e+07  6.223e+06  -3.166  0.00163 ** 
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 58420000 on 578 degrees of freedom
## Multiple R-squared:  0.5556, Adjusted R-squared:  0.5525 
## F-statistic: 180.6 on 4 and 578 DF,  p-value: < 2.2e-16

The best subset of predictor variables to predict Box.Office based on backward elimination (with BIC) is Sequel, Budget, Theatres, and Action.

f) Are the models in part (a) and part (d) the same? Are the models in part (b) and part (e) the same?

g) Calculate \(PRESS_{p}\) for the models found in (a), (b), (d), and (e).

## [1] "Model (a):  1998001231737451776"
## [1] "Model (b):  1998001231737451776"
## [1] "Model (d):  2024868586000841472"
## [1] "Model (e):  2024868586000841472"

The best model based on having the lowest PRESS value is model a and b with 1998001231737451776.

h) Calculate Mallow’s \(C_p\) for the models found in (a), (b), (d), and (e).

## [1] "Model (a):  3.41104093258105"
## [1] "Model (b):  3.41104093258116"
## [1] "Model (d):  9.03822550665348"
## [1] "Model (e):  9.03822550665359"

The best model based on having the lowest C value is model a and b with value of 3.411 each.

i) Use regsubsets with nbest = 10 and nvars = 25. For all models, plot \(SSE\), \(R^2_{adj}\), AIC, BIC, PRESS, and Mallow’s \(C_p\) against \(p\). Use the last question from the Day4PracticeSolution.Rmd file as a reference.

## Warning: package 'leaps' was built under R version 3.5.3
## Warning: package 'ggplot2' was built under R version 3.5.3
## Warning: package 'cowplot' was built under R version 3.5.3
## 
## Attaching package: 'cowplot'
## The following object is masked from 'package:ggplot2':
## 
##     ggsave
## Warning in leaps.setup(x, y, wt = wt, nbest = nbest, nvmax = nvmax,
## force.in = force.in, : 6 linear dependencies found
## Reordering variables and trying again:
## Subset selection object
## Call: regsubsets.formula(Box.Office ~ ., data = Movie2, nbest = 10, 
##     nvmax = 25)
## 23 Variables  (and intercept)
##             Forced in Forced out
## Sequel          FALSE      FALSE
## Budget          FALSE      FALSE
## Theatres        FALSE      FALSE
## G               FALSE      FALSE
## PG              FALSE      FALSE
## PG13            FALSE      FALSE
## Season1         FALSE      FALSE
## Season2         FALSE      FALSE
## Action          FALSE      FALSE
## Comedy          FALSE      FALSE
## Drama           FALSE      FALSE
## Horror          FALSE      FALSE
## GOther          FALSE      FALSE
## RealLife        FALSE      FALSE
## Writing         FALSE      FALSE
## NonOriginal     FALSE      FALSE
## SOthers         FALSE      FALSE
## Not.Rated       FALSE      FALSE
## R               FALSE      FALSE
## Season3         FALSE      FALSE
## Thriller        FALSE      FALSE
## Original        FALSE      FALSE
## Screenplay      FALSE      FALSE
## 10 subsets of each size up to 17
## Selection Algorithm: exhaustive
##            Sequel Budget Theatres G   Not.Rated PG  PG13 R   Season1
## 1  ( 1 )   " "    " "    "*"      " " " "       " " " "  " " " "    
## 1  ( 2 )   " "    "*"    " "      " " " "       " " " "  " " " "    
## 1  ( 3 )   "*"    " "    " "      " " " "       " " " "  " " " "    
## 1  ( 4 )   " "    " "    " "      " " " "       " " " "  " " " "    
## 1  ( 5 )   " "    " "    " "      " " " "       " " " "  "*" " "    
## 1  ( 6 )   " "    " "    " "      " " " "       " " " "  " " " "    
## 1  ( 7 )   " "    " "    " "      " " " "       " " " "  " " " "    
## 1  ( 8 )   " "    " "    " "      " " " "       " " " "  " " "*"    
## 1  ( 9 )   " "    " "    " "      " " " "       " " "*"  " " " "    
## 1  ( 10 )  " "    " "    " "      " " " "       " " " "  " " " "    
## 2  ( 1 )   " "    "*"    "*"      " " " "       " " " "  " " " "    
## 2  ( 2 )   "*"    " "    "*"      " " " "       " " " "  " " " "    
## 2  ( 3 )   "*"    "*"    " "      " " " "       " " " "  " " " "    
## 2  ( 4 )   " "    " "    "*"      " " " "       " " " "  " " "*"    
## 2  ( 5 )   " "    " "    "*"      " " " "       " " " "  " " " "    
## 2  ( 6 )   " "    " "    "*"      " " " "       " " " "  " " " "    
## 2  ( 7 )   " "    " "    "*"      " " " "       " " "*"  " " " "    
## 2  ( 8 )   " "    " "    "*"      " " " "       " " " "  "*" " "    
## 2  ( 9 )   " "    " "    "*"      " " " "       " " " "  " " " "    
## 2  ( 10 )  " "    " "    "*"      " " " "       " " " "  " " " "    
## 3  ( 1 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 3  ( 2 )   " "    "*"    "*"      " " " "       " " " "  " " " "    
## 3  ( 3 )   " "    "*"    "*"      " " " "       " " " "  " " " "    
## 3  ( 4 )   " "    "*"    "*"      " " " "       " " " "  " " " "    
## 3  ( 5 )   " "    "*"    "*"      " " " "       " " " "  " " "*"    
## 3  ( 6 )   " "    "*"    "*"      " " " "       " " " "  " " " "    
## 3  ( 7 )   " "    "*"    "*"      " " " "       " " " "  " " " "    
## 3  ( 8 )   " "    "*"    "*"      " " " "       "*" " "  " " " "    
## 3  ( 9 )   " "    "*"    "*"      " " " "       " " "*"  " " " "    
## 3  ( 10 )  " "    "*"    "*"      " " " "       " " " "  " " " "    
## 4  ( 1 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 4  ( 2 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 4  ( 3 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 4  ( 4 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 4  ( 5 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 4  ( 6 )   "*"    "*"    "*"      " " " "       " " " "  " " "*"    
## 4  ( 7 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 4  ( 8 )   "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 4  ( 9 )   "*"    "*"    "*"      " " " "       " " "*"  " " " "    
## 4  ( 10 )  "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 5  ( 1 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 5  ( 2 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 5  ( 3 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 5  ( 4 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 5  ( 5 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 5  ( 6 )   "*"    "*"    "*"      " " " "       " " " "  " " "*"    
## 5  ( 7 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 5  ( 8 )   "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 5  ( 9 )   "*"    "*"    "*"      " " " "       " " "*"  " " " "    
## 5  ( 10 )  "*"    "*"    "*"      "*" " "       " " " "  " " " "    
## 6  ( 1 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 6  ( 2 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 6  ( 3 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 6  ( 4 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 6  ( 5 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 6  ( 6 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 6  ( 7 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 6  ( 8 )   "*"    "*"    "*"      " " " "       " " " "  " " "*"    
## 6  ( 9 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 6  ( 10 )  "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 7  ( 1 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 7  ( 2 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 7  ( 3 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 7  ( 4 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 7  ( 5 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 7  ( 6 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 7  ( 7 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 7  ( 8 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 7  ( 9 )   "*"    "*"    "*"      " " " "       " " " "  " " "*"    
## 7  ( 10 )  "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 8  ( 1 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 8  ( 2 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 8  ( 3 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 8  ( 4 )   "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 8  ( 5 )   "*"    "*"    "*"      "*" " "       " " " "  " " " "    
## 8  ( 6 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 8  ( 7 )   "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 8  ( 8 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 8  ( 9 )   "*"    "*"    "*"      " " " "       " " "*"  " " " "    
## 8  ( 10 )  "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 9  ( 1 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 9  ( 2 )   "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 9  ( 3 )   "*"    "*"    "*"      "*" " "       " " " "  " " " "    
## 9  ( 4 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 9  ( 5 )   "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 9  ( 6 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 9  ( 7 )   "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 9  ( 8 )   "*"    "*"    "*"      " " " "       " " "*"  " " " "    
## 9  ( 9 )   "*"    "*"    "*"      " " " "       " " " "  "*" " "    
## 9  ( 10 )  "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 10  ( 1 )  "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 10  ( 2 )  "*"    "*"    "*"      "*" " "       " " " "  " " " "    
## 10  ( 3 )  "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 10  ( 4 )  "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 10  ( 5 )  "*"    "*"    "*"      " " " "       " " "*"  " " " "    
## 10  ( 6 )  "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 10  ( 7 )  "*"    "*"    "*"      " " " "       " " " "  "*" " "    
## 10  ( 8 )  "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 10  ( 9 )  "*"    "*"    "*"      " " " "       " " " "  " " " "    
## 10  ( 10 ) "*"    "*"    "*"      " " " "       " " " "  " " "*"    
## 11  ( 1 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 11  ( 2 )  "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 11  ( 3 )  "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 11  ( 4 )  "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 11  ( 5 )  "*"    "*"    "*"      " " " "       "*" " "  " " "*"    
## 11  ( 6 )  "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 11  ( 7 )  "*"    "*"    "*"      " " " "       "*" " "  " " "*"    
## 11  ( 8 )  "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 11  ( 9 )  "*"    "*"    "*"      " " " "       "*" "*"  " " " "    
## 11  ( 10 ) "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 12  ( 1 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 12  ( 2 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 12  ( 3 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 12  ( 4 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 12  ( 5 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 12  ( 6 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 12  ( 7 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 12  ( 8 )  "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 12  ( 9 )  "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 12  ( 10 ) "*"    "*"    "*"      " " " "       "*" " "  " " " "    
## 13  ( 1 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 13  ( 2 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 13  ( 3 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 13  ( 4 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 13  ( 5 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 13  ( 6 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 13  ( 7 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 13  ( 8 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 13  ( 9 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 13  ( 10 ) "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 14  ( 1 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 14  ( 2 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 14  ( 3 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 14  ( 4 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 14  ( 5 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 14  ( 6 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 14  ( 7 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 14  ( 8 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 14  ( 9 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 14  ( 10 ) "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 15  ( 1 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 15  ( 2 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 15  ( 3 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 15  ( 4 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 15  ( 5 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 15  ( 6 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 15  ( 7 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 15  ( 8 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 15  ( 9 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 15  ( 10 ) "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 16  ( 1 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 16  ( 2 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 16  ( 3 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 16  ( 4 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 16  ( 5 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 16  ( 6 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 16  ( 7 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 16  ( 8 )  "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 16  ( 9 )  "*"    "*"    "*"      "*" " "       "*" " "  " " "*"    
## 16  ( 10 ) "*"    "*"    "*"      "*" " "       "*" " "  " " " "    
## 17  ( 1 )  "*"    "*"    "*"      "*" " "       "*" "*"  " " "*"    
## 17  ( 2 )  "*"    "*"    "*"      "*" " "       "*" "*"  " " "*"    
## 17  ( 3 )  "*"    "*"    "*"      "*" " "       "*" "*"  " " "*"    
## 17  ( 4 )  "*"    "*"    "*"      "*" " "       "*" "*"  " " "*"    
## 17  ( 5 )  "*"    "*"    "*"      "*" " "       "*" "*"  " " "*"    
## 17  ( 6 )  "*"    "*"    "*"      "*" " "       "*" "*"  " " "*"    
## 17  ( 7 )  "*"    "*"    "*"      "*" " "       "*" "*"  " " "*"    
## 17  ( 8 )  "*"    "*"    "*"      "*" " "       "*" "*"  " " "*"    
## 17  ( 9 )  "*"    "*"    "*"      "*" " "       "*" "*"  " " "*"    
## 17  ( 10 ) "*"    "*"    "*"      "*" " "       "*" "*"  " " "*"    
##            Season2 Season3 Action Comedy Drama Horror GOther Thriller
## 1  ( 1 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 1  ( 2 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 1  ( 3 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 1  ( 4 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 1  ( 5 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 1  ( 6 )   "*"     " "     " "    " "    " "   " "    " "    " "     
## 1  ( 7 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 1  ( 8 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 1  ( 9 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 1  ( 10 )  " "     " "     " "    " "    " "   "*"    " "    " "     
## 2  ( 1 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 2  ( 2 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 2  ( 3 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 2  ( 4 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 2  ( 5 )   "*"     " "     " "    " "    " "   " "    " "    " "     
## 2  ( 6 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 2  ( 7 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 2  ( 8 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 2  ( 9 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 2  ( 10 )  " "     " "     " "    " "    " "   "*"    " "    " "     
## 3  ( 1 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 3  ( 2 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 3  ( 3 )   "*"     " "     " "    " "    " "   " "    " "    " "     
## 3  ( 4 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 3  ( 5 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 3  ( 6 )   " "     " "     " "    " "    "*"   " "    " "    " "     
## 3  ( 7 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 3  ( 8 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 3  ( 9 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 3  ( 10 )  " "     " "     " "    "*"    " "   " "    " "    " "     
## 4  ( 1 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 4  ( 2 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 4  ( 3 )   "*"     " "     " "    " "    " "   " "    " "    " "     
## 4  ( 4 )   " "     " "     " "    " "    "*"   " "    " "    " "     
## 4  ( 5 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 4  ( 6 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 4  ( 7 )   " "     " "     " "    " "    " "   "*"    " "    " "     
## 4  ( 8 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 4  ( 9 )   " "     " "     " "    " "    " "   " "    " "    " "     
## 4  ( 10 )  " "     " "     " "    " "    " "   " "    " "    "*"     
## 5  ( 1 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 5  ( 2 )   "*"     " "     "*"    " "    " "   " "    " "    " "     
## 5  ( 3 )   " "     " "     "*"    " "    " "   "*"    " "    " "     
## 5  ( 4 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 5  ( 5 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 5  ( 6 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 5  ( 7 )   " "     " "     "*"    " "    "*"   " "    " "    " "     
## 5  ( 8 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 5  ( 9 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 5  ( 10 )  " "     " "     "*"    " "    " "   " "    " "    " "     
## 6  ( 1 )   "*"     " "     "*"    " "    " "   " "    " "    " "     
## 6  ( 2 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 6  ( 3 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 6  ( 4 )   " "     " "     "*"    " "    " "   "*"    " "    " "     
## 6  ( 5 )   "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 6  ( 6 )   "*"     " "     "*"    " "    " "   " "    " "    " "     
## 6  ( 7 )   "*"     " "     "*"    " "    " "   " "    " "    " "     
## 6  ( 8 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 6  ( 9 )   " "     " "     "*"    " "    " "   "*"    " "    " "     
## 6  ( 10 )  " "     " "     "*"    " "    " "   " "    " "    " "     
## 7  ( 1 )   "*"     " "     "*"    " "    " "   " "    " "    " "     
## 7  ( 2 )   "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 7  ( 3 )   "*"     " "     "*"    " "    " "   " "    " "    " "     
## 7  ( 4 )   " "     " "     "*"    " "    " "   "*"    " "    " "     
## 7  ( 5 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 7  ( 6 )   " "     " "     "*"    " "    " "   "*"    " "    " "     
## 7  ( 7 )   "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 7  ( 8 )   "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 7  ( 9 )   " "     " "     "*"    " "    " "   " "    " "    " "     
## 7  ( 10 )  " "     " "     "*"    " "    " "   " "    " "    " "     
## 8  ( 1 )   "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 8  ( 2 )   "*"     " "     "*"    " "    " "   " "    " "    " "     
## 8  ( 3 )   "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 8  ( 4 )   "*"     " "     "*"    " "    " "   " "    " "    " "     
## 8  ( 5 )   "*"     " "     "*"    " "    " "   " "    " "    " "     
## 8  ( 6 )   "*"     " "     "*"    " "    " "   " "    " "    "*"     
## 8  ( 7 )   "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 8  ( 8 )   " "     " "     "*"    " "    " "   "*"    " "    " "     
## 8  ( 9 )   "*"     " "     "*"    " "    " "   " "    " "    " "     
## 8  ( 10 )  "*"     " "     "*"    " "    " "   " "    "*"    " "     
## 9  ( 1 )   "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 9  ( 2 )   "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 9  ( 3 )   "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 9  ( 4 )   "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 9  ( 5 )   "*"     " "     "*"    " "    " "   " "    " "    " "     
## 9  ( 6 )   "*"     " "     "*"    "*"    " "   "*"    " "    " "     
## 9  ( 7 )   "*"     " "     "*"    " "    " "   "*"    " "    "*"     
## 9  ( 8 )   "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 9  ( 9 )   "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 9  ( 10 )  "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 10  ( 1 )  "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 10  ( 2 )  "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 10  ( 3 )  "*"     " "     "*"    "*"    " "   "*"    " "    " "     
## 10  ( 4 )  "*"     " "     "*"    " "    " "   "*"    " "    "*"     
## 10  ( 5 )  "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 10  ( 6 )  "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 10  ( 7 )  "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 10  ( 8 )  "*"     " "     "*"    " "    " "   "*"    "*"    " "     
## 10  ( 9 )  "*"     "*"     "*"    " "    " "   "*"    " "    " "     
## 10  ( 10 ) "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 11  ( 1 )  "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 11  ( 2 )  "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 11  ( 3 )  "*"     " "     "*"    " "    " "   "*"    "*"    " "     
## 11  ( 4 )  "*"     " "     "*"    "*"    " "   "*"    " "    " "     
## 11  ( 5 )  "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 11  ( 6 )  "*"     "*"     "*"    " "    " "   "*"    " "    " "     
## 11  ( 7 )  " "     "*"     "*"    " "    " "   "*"    " "    " "     
## 11  ( 8 )  "*"     " "     "*"    " "    " "   "*"    " "    "*"     
## 11  ( 9 )  "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 11  ( 10 ) "*"     " "     "*"    " "    "*"   "*"    " "    " "     
## 12  ( 1 )  "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 12  ( 2 )  "*"     " "     "*"    "*"    " "   "*"    " "    " "     
## 12  ( 3 )  "*"     " "     "*"    " "    " "   "*"    "*"    " "     
## 12  ( 4 )  " "     "*"     "*"    " "    " "   "*"    " "    " "     
## 12  ( 5 )  "*"     "*"     "*"    " "    " "   "*"    " "    " "     
## 12  ( 6 )  "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 12  ( 7 )  "*"     " "     "*"    " "    " "   "*"    " "    "*"     
## 12  ( 8 )  "*"     " "     "*"    "*"    " "   "*"    " "    " "     
## 12  ( 9 )  "*"     " "     "*"    " "    " "   "*"    "*"    " "     
## 12  ( 10 ) "*"     "*"     "*"    " "    " "   "*"    " "    " "     
## 13  ( 1 )  "*"     " "     "*"    "*"    " "   "*"    " "    " "     
## 13  ( 2 )  "*"     " "     "*"    " "    " "   "*"    "*"    " "     
## 13  ( 3 )  "*"     " "     "*"    " "    " "   "*"    " "    "*"     
## 13  ( 4 )  " "     "*"     "*"    " "    " "   "*"    " "    " "     
## 13  ( 5 )  "*"     "*"     "*"    " "    " "   "*"    " "    " "     
## 13  ( 6 )  "*"     " "     "*"    " "    " "   "*"    " "    " "     
## 13  ( 7 )  " "     "*"     "*"    "*"    " "   "*"    " "    " "     
## 13  ( 8 )  "*"     "*"     "*"    "*"    " "   "*"    " "    " "     
## 13  ( 9 )  "*"     " "     "*"    "*"    " "   "*"    " "    " "     
## 13  ( 10 ) "*"     " "     "*"    "*"    " "   "*"    "*"    " "     
## 14  ( 1 )  " "     "*"     "*"    "*"    " "   "*"    " "    " "     
## 14  ( 2 )  "*"     "*"     "*"    "*"    " "   "*"    " "    " "     
## 14  ( 3 )  "*"     " "     "*"    "*"    " "   "*"    " "    " "     
## 14  ( 4 )  "*"     " "     "*"    " "    " "   "*"    "*"    "*"     
## 14  ( 5 )  "*"     " "     "*"    "*"    "*"   "*"    " "    " "     
## 14  ( 6 )  "*"     " "     "*"    "*"    " "   "*"    "*"    " "     
## 14  ( 7 )  "*"     " "     "*"    " "    " "   "*"    " "    "*"     
## 14  ( 8 )  "*"     "*"     "*"    " "    " "   "*"    " "    "*"     
## 14  ( 9 )  " "     "*"     "*"    " "    " "   "*"    " "    "*"     
## 14  ( 10 ) "*"     " "     "*"    " "    " "   "*"    "*"    " "     
## 15  ( 1 )  " "     "*"     "*"    "*"    "*"   "*"    " "    " "     
## 15  ( 2 )  "*"     "*"     "*"    "*"    "*"   "*"    " "    " "     
## 15  ( 3 )  "*"     " "     "*"    "*"    "*"   "*"    " "    " "     
## 15  ( 4 )  "*"     "*"     "*"    " "    " "   "*"    "*"    "*"     
## 15  ( 5 )  "*"     " "     "*"    " "    " "   "*"    "*"    "*"     
## 15  ( 6 )  " "     "*"     "*"    " "    " "   "*"    "*"    "*"     
## 15  ( 7 )  " "     "*"     "*"    "*"    " "   "*"    "*"    " "     
## 15  ( 8 )  "*"     " "     "*"    "*"    " "   "*"    "*"    " "     
## 15  ( 9 )  "*"     "*"     "*"    "*"    " "   "*"    "*"    " "     
## 15  ( 10 ) " "     "*"     " "    "*"    "*"   " "    "*"    "*"     
## 16  ( 1 )  "*"     "*"     "*"    "*"    "*"   "*"    " "    "*"     
## 16  ( 2 )  "*"     " "     "*"    "*"    "*"   "*"    " "    "*"     
## 16  ( 3 )  "*"     " "     "*"    "*"    "*"   " "    "*"    "*"     
## 16  ( 4 )  "*"     "*"     "*"    "*"    "*"   " "    "*"    "*"     
## 16  ( 5 )  "*"     "*"     "*"    "*"    "*"   "*"    "*"    " "     
## 16  ( 6 )  "*"     " "     "*"    "*"    "*"   "*"    "*"    " "     
## 16  ( 7 )  "*"     " "     " "    "*"    "*"   "*"    "*"    "*"     
## 16  ( 8 )  "*"     "*"     " "    "*"    "*"   "*"    "*"    "*"     
## 16  ( 9 )  "*"     " "     "*"    "*"    " "   "*"    "*"    "*"     
## 16  ( 10 ) "*"     "*"     "*"    "*"    " "   "*"    "*"    "*"     
## 17  ( 1 )  " "     "*"     " "    "*"    "*"   "*"    "*"    "*"     
## 17  ( 2 )  " "     "*"     "*"    "*"    "*"   " "    "*"    "*"     
## 17  ( 3 )  " "     "*"     "*"    " "    "*"   "*"    "*"    "*"     
## 17  ( 4 )  " "     "*"     "*"    "*"    " "   "*"    "*"    "*"     
## 17  ( 5 )  "*"     " "     " "    "*"    "*"   "*"    "*"    "*"     
## 17  ( 6 )  "*"     " "     "*"    " "    "*"   "*"    "*"    "*"     
## 17  ( 7 )  "*"     " "     "*"    "*"    " "   "*"    "*"    "*"     
## 17  ( 8 )  "*"     " "     "*"    "*"    "*"   " "    "*"    "*"     
## 17  ( 9 )  "*"     " "     "*"    "*"    "*"   "*"    " "    "*"     
## 17  ( 10 ) "*"     " "     "*"    "*"    "*"   "*"    "*"    " "     
##            RealLife Writing NonOriginal Original Screenplay SOthers
## 1  ( 1 )   " "      " "     " "         " "      " "        " "    
## 1  ( 2 )   " "      " "     " "         " "      " "        " "    
## 1  ( 3 )   " "      " "     " "         " "      " "        " "    
## 1  ( 4 )   " "      " "     " "         " "      " "        " "    
## 1  ( 5 )   " "      " "     " "         " "      " "        " "    
## 1  ( 6 )   " "      " "     " "         " "      " "        " "    
## 1  ( 7 )   " "      "*"     " "         " "      " "        " "    
## 1  ( 8 )   " "      " "     " "         " "      " "        " "    
## 1  ( 9 )   " "      " "     " "         " "      " "        " "    
## 1  ( 10 )  " "      " "     " "         " "      " "        " "    
## 2  ( 1 )   " "      " "     " "         " "      " "        " "    
## 2  ( 2 )   " "      " "     " "         " "      " "        " "    
## 2  ( 3 )   " "      " "     " "         " "      " "        " "    
## 2  ( 4 )   " "      " "     " "         " "      " "        " "    
## 2  ( 5 )   " "      " "     " "         " "      " "        " "    
## 2  ( 6 )   " "      "*"     " "         " "      " "        " "    
## 2  ( 7 )   " "      " "     " "         " "      " "        " "    
## 2  ( 8 )   " "      " "     " "         " "      " "        " "    
## 2  ( 9 )   " "      " "     " "         " "      " "        " "    
## 2  ( 10 )  " "      " "     " "         " "      " "        " "    
## 3  ( 1 )   " "      " "     " "         " "      " "        " "    
## 3  ( 2 )   " "      " "     " "         " "      " "        " "    
## 3  ( 3 )   " "      " "     " "         " "      " "        " "    
## 3  ( 4 )   "*"      " "     " "         " "      " "        " "    
## 3  ( 5 )   " "      " "     " "         " "      " "        " "    
## 3  ( 6 )   " "      " "     " "         " "      " "        " "    
## 3  ( 7 )   " "      " "     " "         " "      " "        "*"    
## 3  ( 8 )   " "      " "     " "         " "      " "        " "    
## 3  ( 9 )   " "      " "     " "         " "      " "        " "    
## 3  ( 10 )  " "      " "     " "         " "      " "        " "    
## 4  ( 1 )   " "      " "     " "         " "      " "        " "    
## 4  ( 2 )   "*"      " "     " "         " "      " "        " "    
## 4  ( 3 )   " "      " "     " "         " "      " "        " "    
## 4  ( 4 )   " "      " "     " "         " "      " "        " "    
## 4  ( 5 )   " "      " "     " "         " "      " "        "*"    
## 4  ( 6 )   " "      " "     " "         " "      " "        " "    
## 4  ( 7 )   " "      " "     " "         " "      " "        " "    
## 4  ( 8 )   " "      " "     " "         " "      " "        " "    
## 4  ( 9 )   " "      " "     " "         " "      " "        " "    
## 4  ( 10 )  " "      " "     " "         " "      " "        " "    
## 5  ( 1 )   "*"      " "     " "         " "      " "        " "    
## 5  ( 2 )   " "      " "     " "         " "      " "        " "    
## 5  ( 3 )   " "      " "     " "         " "      " "        " "    
## 5  ( 4 )   " "      " "     " "         " "      " "        "*"    
## 5  ( 5 )   " "      "*"     " "         " "      " "        " "    
## 5  ( 6 )   " "      " "     " "         " "      " "        " "    
## 5  ( 7 )   " "      " "     " "         " "      " "        " "    
## 5  ( 8 )   " "      " "     " "         " "      " "        " "    
## 5  ( 9 )   " "      " "     " "         " "      " "        " "    
## 5  ( 10 )  " "      " "     " "         " "      " "        " "    
## 6  ( 1 )   "*"      " "     " "         " "      " "        " "    
## 6  ( 2 )   "*"      "*"     " "         " "      " "        " "    
## 6  ( 3 )   "*"      " "     " "         " "      " "        "*"    
## 6  ( 4 )   "*"      " "     " "         " "      " "        " "    
## 6  ( 5 )   " "      " "     " "         " "      " "        " "    
## 6  ( 6 )   " "      " "     " "         " "      " "        "*"    
## 6  ( 7 )   " "      "*"     " "         " "      " "        " "    
## 6  ( 8 )   "*"      " "     " "         " "      " "        " "    
## 6  ( 9 )   " "      " "     " "         " "      " "        "*"    
## 6  ( 10 )  "*"      " "     " "         " "      " "        " "    
## 7  ( 1 )   "*"      "*"     " "         " "      " "        " "    
## 7  ( 2 )   "*"      " "     " "         " "      " "        " "    
## 7  ( 3 )   "*"      " "     " "         " "      " "        "*"    
## 7  ( 4 )   "*"      "*"     " "         " "      " "        " "    
## 7  ( 5 )   "*"      "*"     " "         " "      " "        "*"    
## 7  ( 6 )   "*"      " "     " "         " "      " "        "*"    
## 7  ( 7 )   " "      " "     " "         " "      " "        "*"    
## 7  ( 8 )   " "      "*"     " "         " "      " "        " "    
## 7  ( 9 )   "*"      "*"     " "         " "      " "        " "    
## 7  ( 10 )  "*"      "*"     " "         " "      " "        " "    
## 8  ( 1 )   "*"      "*"     " "         " "      " "        " "    
## 8  ( 2 )   "*"      "*"     " "         " "      " "        "*"    
## 8  ( 3 )   "*"      " "     " "         " "      " "        "*"    
## 8  ( 4 )   "*"      "*"     " "         " "      " "        " "    
## 8  ( 5 )   "*"      "*"     " "         " "      " "        " "    
## 8  ( 6 )   "*"      "*"     " "         " "      " "        " "    
## 8  ( 7 )   "*"      " "     " "         " "      " "        " "    
## 8  ( 8 )   "*"      "*"     " "         " "      " "        "*"    
## 8  ( 9 )   "*"      "*"     " "         " "      " "        " "    
## 8  ( 10 )  "*"      "*"     " "         " "      " "        " "    
## 9  ( 1 )   "*"      "*"     " "         " "      " "        "*"    
## 9  ( 2 )   "*"      "*"     " "         " "      " "        " "    
## 9  ( 3 )   "*"      "*"     " "         " "      " "        " "    
## 9  ( 4 )   "*"      "*"     "*"         " "      " "        " "    
## 9  ( 5 )   "*"      "*"     " "         " "      " "        "*"    
## 9  ( 6 )   "*"      "*"     " "         " "      " "        " "    
## 9  ( 7 )   "*"      "*"     " "         " "      " "        " "    
## 9  ( 8 )   "*"      "*"     " "         " "      " "        " "    
## 9  ( 9 )   "*"      "*"     " "         " "      " "        " "    
## 9  ( 10 )  "*"      " "     " "         " "      " "        "*"    
## 10  ( 1 )  "*"      "*"     " "         " "      " "        "*"    
## 10  ( 2 )  "*"      "*"     " "         " "      " "        "*"    
## 10  ( 3 )  "*"      "*"     " "         " "      " "        "*"    
## 10  ( 4 )  "*"      "*"     " "         " "      " "        "*"    
## 10  ( 5 )  "*"      "*"     " "         " "      " "        "*"    
## 10  ( 6 )  "*"      "*"     "*"         " "      " "        "*"    
## 10  ( 7 )  "*"      "*"     " "         " "      " "        "*"    
## 10  ( 8 )  "*"      "*"     " "         " "      " "        "*"    
## 10  ( 9 )  "*"      "*"     " "         " "      " "        "*"    
## 10  ( 10 ) "*"      "*"     " "         " "      " "        "*"    
## 11  ( 1 )  "*"      "*"     " "         " "      " "        "*"    
## 11  ( 2 )  "*"      "*"     "*"         " "      " "        "*"    
## 11  ( 3 )  "*"      "*"     " "         " "      " "        "*"    
## 11  ( 4 )  "*"      "*"     " "         " "      " "        "*"    
## 11  ( 5 )  "*"      "*"     " "         " "      " "        "*"    
## 11  ( 6 )  "*"      "*"     " "         " "      " "        "*"    
## 11  ( 7 )  "*"      "*"     " "         " "      " "        "*"    
## 11  ( 8 )  "*"      "*"     " "         " "      " "        "*"    
## 11  ( 9 )  "*"      "*"     " "         " "      " "        "*"    
## 11  ( 10 ) "*"      "*"     " "         " "      " "        "*"    
## 12  ( 1 )  "*"      "*"     "*"         " "      " "        "*"    
## 12  ( 2 )  "*"      "*"     " "         " "      " "        "*"    
## 12  ( 3 )  "*"      "*"     " "         " "      " "        "*"    
## 12  ( 4 )  "*"      "*"     " "         " "      " "        "*"    
## 12  ( 5 )  "*"      "*"     " "         " "      " "        "*"    
## 12  ( 6 )  "*"      "*"     " "         " "      " "        "*"    
## 12  ( 7 )  "*"      "*"     " "         " "      " "        "*"    
## 12  ( 8 )  "*"      "*"     "*"         " "      " "        "*"    
## 12  ( 9 )  "*"      "*"     "*"         " "      " "        "*"    
## 12  ( 10 ) "*"      "*"     "*"         " "      " "        "*"    
## 13  ( 1 )  "*"      "*"     "*"         " "      " "        "*"    
## 13  ( 2 )  "*"      "*"     "*"         " "      " "        "*"    
## 13  ( 3 )  "*"      "*"     "*"         " "      " "        "*"    
## 13  ( 4 )  "*"      "*"     "*"         " "      " "        "*"    
## 13  ( 5 )  "*"      "*"     "*"         " "      " "        "*"    
## 13  ( 6 )  "*"      "*"     "*"         " "      " "        "*"    
## 13  ( 7 )  "*"      "*"     " "         " "      " "        "*"    
## 13  ( 8 )  "*"      "*"     " "         " "      " "        "*"    
## 13  ( 9 )  "*"      "*"     " "         " "      " "        "*"    
## 13  ( 10 ) "*"      "*"     " "         " "      " "        "*"    
## 14  ( 1 )  "*"      "*"     "*"         " "      " "        "*"    
## 14  ( 2 )  "*"      "*"     "*"         " "      " "        "*"    
## 14  ( 3 )  "*"      "*"     "*"         " "      " "        "*"    
## 14  ( 4 )  "*"      "*"     "*"         " "      " "        "*"    
## 14  ( 5 )  "*"      "*"     "*"         " "      " "        "*"    
## 14  ( 6 )  "*"      "*"     "*"         " "      " "        "*"    
## 14  ( 7 )  "*"      "*"     "*"         " "      " "        "*"    
## 14  ( 8 )  "*"      "*"     "*"         " "      " "        "*"    
## 14  ( 9 )  "*"      "*"     "*"         " "      " "        "*"    
## 14  ( 10 ) "*"      "*"     "*"         " "      " "        "*"    
## 15  ( 1 )  "*"      "*"     "*"         " "      " "        "*"    
## 15  ( 2 )  "*"      "*"     "*"         " "      " "        "*"    
## 15  ( 3 )  "*"      "*"     "*"         " "      " "        "*"    
## 15  ( 4 )  "*"      "*"     "*"         " "      " "        "*"    
## 15  ( 5 )  "*"      "*"     "*"         " "      " "        "*"    
## 15  ( 6 )  "*"      "*"     "*"         " "      " "        "*"    
## 15  ( 7 )  "*"      "*"     "*"         " "      " "        "*"    
## 15  ( 8 )  "*"      "*"     "*"         " "      " "        "*"    
## 15  ( 9 )  "*"      "*"     "*"         " "      " "        "*"    
## 15  ( 10 ) "*"      "*"     "*"         " "      " "        "*"    
## 16  ( 1 )  "*"      "*"     "*"         " "      " "        "*"    
## 16  ( 2 )  "*"      "*"     "*"         " "      " "        "*"    
## 16  ( 3 )  "*"      "*"     "*"         " "      " "        "*"    
## 16  ( 4 )  "*"      "*"     "*"         " "      " "        "*"    
## 16  ( 5 )  "*"      "*"     "*"         " "      " "        "*"    
## 16  ( 6 )  "*"      "*"     "*"         " "      " "        "*"    
## 16  ( 7 )  "*"      "*"     "*"         " "      " "        "*"    
## 16  ( 8 )  "*"      "*"     "*"         " "      " "        "*"    
## 16  ( 9 )  "*"      "*"     "*"         " "      " "        "*"    
## 16  ( 10 ) "*"      "*"     "*"         " "      " "        "*"    
## 17  ( 1 )  "*"      "*"     "*"         " "      " "        "*"    
## 17  ( 2 )  "*"      "*"     "*"         " "      " "        "*"    
## 17  ( 3 )  "*"      "*"     "*"         " "      " "        "*"    
## 17  ( 4 )  "*"      "*"     "*"         " "      " "        "*"    
## 17  ( 5 )  "*"      "*"     "*"         " "      " "        "*"    
## 17  ( 6 )  "*"      "*"     "*"         " "      " "        "*"    
## 17  ( 7 )  "*"      "*"     "*"         " "      " "        "*"    
## 17  ( 8 )  "*"      "*"     "*"         " "      " "        "*"    
## 17  ( 9 )  "*"      "*"     "*"         " "      " "        "*"    
## 17  ( 10 ) "*"      "*"     "*"         " "      " "        "*"

Based on the 6 plots, it is recommended to build a model around 3-5 variables.