Introduction

The goal is to build a predictive regression model for assigning interest rates to loans.

reading the data

##     Loan_id       Borrower_ID       Loan_Amount_Requested
##  Min.   :    1   Min.   :   92671   Min.   :  950        
##  1st Qu.: 7251   1st Qu.: 3921030   1st Qu.: 8944        
##  Median :14500   Median :10789582   Median :14000        
##  Mean   :14500   Mean   :13458500   Mean   :15344        
##  3rd Qu.:21750   3rd Qu.:21138123   3rd Qu.:20050        
##  Max.   :29000   Max.   :38923005   Max.   :35000        
##                                                          
##  Initial_Loan_Term_Months Interest_Rate                Employer    
##   36 months:20386         Min.   :0.0542                   : 2060  
##   60 months: 8614         1st Qu.:0.1016   Teacher         :  402  
##                           Median :0.1335   Manager         :  267  
##                           Mean   :0.1356   RN              :  143  
##                           3rd Qu.:0.1629   Registered Nurse:  132  
##                           Max.   :0.2606   Owner           :  113  
##                                            (Other)         :25883  
##  Length_Employed     Home_Owner    Annual_Income    
##  Min.   : 0.000   MORTGAGE:14148   Min.   :   7000  
##  1st Qu.: 3.000   N/A     : 4543   1st Qu.:  50000  
##  Median : 8.000   NONE    :    4   Median :  70000  
##  Mean   : 6.581   OTHER   :    8   Mean   :  79956  
##  3rd Qu.:10.000   OWN     : 2249   3rd Qu.:  95000  
##  Max.   :10.000   RENT    : 8048   Max.   :1000000  
##  NA's   :1568                      NA's   :4404     
##                  Income_Verified   Month_Issued  
##  not verified            : 8292   Oct    : 3921  
##  VERIFIED - income       :11521   Jul    : 2993  
##  VERIFIED - income source: 9187   Nov    : 2943  
##                                   Aug    : 2597  
##                                   May    : 2351  
##                                   Apr    : 2261  
##                                   (Other):11934  
##                                               Loan_Description
##                                                       :20654  
##    Borrower added on 01/03/14 > Debt consolidation<br>:    2  
##    Borrower added on 01/15/14 > Debt consolidation<br>:    2  
##    Borrower added on 01/23/13 > debt consolidation<br>:    2  
##    Borrower added on 02/05/14 > Debt consolidation<br>:    2  
##    Borrower added on 03/10/14 > debt consolidation<br>:    2  
##  (Other)                                              : 8336  
##            Purpose_Of_Loan                    Loan_Title        Zip_3      
##  debt_consolidation:17253   Debt consolidation     : 9871   945xx  :  320  
##  credit_card       : 6458   Credit card refinancing: 3749   300xx  :  284  
##  home_improvement  : 1797   Debt Consolidation     : 1096   606xx  :  278  
##  other             : 1335   Home improvement       :  948   750xx  :  276  
##  major_purchase    :  565   Other                  :  652   112xx  :  265  
##  small_business    :  424   Consolidation          :  397   070xx  :  230  
##  (Other)           : 1168   (Other)                :12287   (Other):27347  
##      State       Debt_To_Income  Number_Delinqueny_2yrs Date_Earliest_Credit
##  CA     : 4220   Min.   : 0.00   Min.   : 0.0000        Oct-00 :  365       
##  NY     : 2385   1st Qu.:11.57   1st Qu.: 0.0000        Aug-00 :  353       
##  TX     : 2304   Median :17.03   Median : 0.0000        Oct-99 :  342       
##  FL     : 1791   Mean   :17.36   Mean   : 0.3327        Nov-00 :  328       
##  NJ     : 1159   3rd Qu.:22.86   3rd Qu.: 0.0000        Nov-99 :  317       
##  IL     : 1129   Max.   :39.91   Max.   :13.0000        Dec-98 :  303       
##  (Other):16012                                          (Other):26992       
##  Inquiries_Last_6Mo Months_Since_Deliquency Months_Since_Record
##  Min.   :0.0000     Min.   :  0.00          Min.   :  0.00     
##  1st Qu.:0.0000     1st Qu.: 15.00          1st Qu.: 52.00     
##  Median :0.0000     Median : 30.00          Median : 74.00     
##  Mean   :0.7976     Mean   : 33.82          Mean   : 74.39     
##  3rd Qu.:1.0000     3rd Qu.: 49.00          3rd Qu.:101.00     
##  Max.   :8.0000     Max.   :141.00          Max.   :119.00     
##                     NA's   :14200           NA's   :24767      
##  Number_Open_Accounts Public_Record_Count Revolving_Balance
##  Min.   : 1.00        Min.   : 0.0000     Min.   :      0  
##  1st Qu.: 8.00        1st Qu.: 0.0000     1st Qu.:   7578  
##  Median :11.00        Median : 0.0000     Median :  14016  
##  Mean   :11.61        Mean   : 0.1774     Mean   :  18806  
##  3rd Qu.:14.00        3rd Qu.: 0.0000     3rd Qu.:  23988  
##  Max.   :52.00        Max.   :16.0000     Max.   :2560703  
##                                                            
##  Revolving_Utilization Total_Accounts   Collections_12Mo_Exclude_Med
##  Min.   :0.0000        Min.   :  3.00   Min.   :0.000               
##  1st Qu.:0.3920        1st Qu.: 19.00   1st Qu.:0.000               
##  Median :0.5810        Median : 26.00   Median :0.000               
##  Mean   :0.5638        Mean   : 27.68   Mean   :0.009               
##  3rd Qu.:0.7510        3rd Qu.: 34.00   3rd Qu.:0.000               
##  Max.   :1.1720        Max.   :105.00   Max.   :3.000               
##                                                                     
##  Months_Since_Last_Derogatory
##  Min.   :  0.0               
##  1st Qu.: 25.0               
##  Median : 42.0               
##  Mean   : 42.5               
##  3rd Qu.: 58.0               
##  Max.   :162.0               
##  NA's   :22079
##     Loan_id      Borrower_ID       Loan_Amount_Requested
##  Min.   :   1   Min.   :   89243   Min.   : 1000        
##  1st Qu.:1251   1st Qu.: 3876160   1st Qu.: 8788        
##  Median :2500   Median :10789712   Median :14062        
##  Mean   :2500   Mean   :13543818   Mean   :15324        
##  3rd Qu.:3750   3rd Qu.:21213555   3rd Qu.:20150        
##  Max.   :5000   Max.   :38921981   Max.   :35000        
##                                                         
##  Initial_Loan_Term_Months             Employer    Length_Employed 
##   36 months:3520                          : 365   Min.   : 0.000  
##   60 months:1480          Teacher         :  76   1st Qu.: 3.000  
##                           Manager         :  46   Median : 8.000  
##                           Registered Nurse:  35   Mean   : 6.644  
##                           RN              :  22   3rd Qu.:10.000  
##                           Vice President  :  22   Max.   :10.000  
##                           (Other)         :4434   NA's   :271     
##     Home_Owner   Annual_Income                    Income_Verified
##  MORTGAGE:2438   Min.   :  9600   not verified            :1470  
##  N/A     : 789   1st Qu.: 50000   VERIFIED - income       :1959  
##  NONE    :   1   Median : 69000   VERIFIED - income source:1571  
##  OTHER   :   2   Mean   : 79532                                  
##  OWN     : 387   3rd Qu.: 96500                                  
##  RENT    :1383   Max.   :600000                                  
##                  NA's   :741                                     
##   Month_Issued 
##  Oct    : 638  
##  Nov    : 554  
##  Jul    : 527  
##  Aug    : 457  
##  May    : 431  
##  Sep    : 371  
##  (Other):2022  
##                                                                                                                                                                                                                                                                                                                                                  Loan_Description
##                                                                                                                                                                                                                                                                                                                                                          :3565   
##    550402 added on 10/11/09 > Better rate loan pay off                                                                                                                                                                                                                                                                                                   :   1   
##    554269 added on 12/16/09 > These funds will enable personal debt consolidation and enable resource dedication towards bringing a long-time moonlighting business into what's now a full-time venture.<br/>                                                                                                                                            :   1   
##    555217 added on 10/14/09 > Fund to consolidate higher-interest debt. 555217 added on 10/15/09 > Purpose of this loan is to consolidate and payoff several higher-interest debt, thus lowering my monthly payments and decreasing my overall interests rates.  I have good credit and have never missed a debt payment in my 25+ years of paying bills.:   1   
##    578992 added on 11/23/09 > Thank you. I plan on correcting some small debt and making my truck run smooth. I have a stable job and plan on paying off this loan early. Thanks again<br/>                                                                                                                                                              :   1   
##    583145 added on 12/07/09 > This loan would be for fertility assistance in order to conceive a child.  Unfortunately, this type of medical care is not civered by my employers' insurance. Thank you very much.<br/>                                                                                                                                   :   1   
##  (Other)                                                                                                                                                                                                                                                                                                                                                 :1430   
##            Purpose_Of_Loan                   Loan_Title       Zip_3     
##  debt_consolidation:2971   Debt consolidation     :1733   750xx  :  67  
##  credit_card       :1106   Credit card refinancing: 622   945xx  :  56  
##  home_improvement  : 324   Debt Consolidation     : 195   112xx  :  54  
##  other             : 222   Home improvement       : 165   300xx  :  41  
##  small_business    :  90   Other                  : 112   606xx  :  41  
##  major_purchase    :  87   Consolidation          :  75   331xx  :  40  
##  (Other)           : 200   (Other)                :2098   (Other):4701  
##      State      Debt_To_Income  Number_Delinqueny_2yrs Date_Earliest_Credit
##  CA     : 719   Min.   : 0.00   Min.   : 0.0000        Oct-00 :  68        
##  NY     : 418   1st Qu.:11.43   1st Qu.: 0.0000        Aug-00 :  66        
##  TX     : 399   Median :16.66   Median : 0.0000        May-00 :  65        
##  FL     : 336   Mean   :17.18   Mean   : 0.3438        Aug-99 :  55        
##  PA     : 198   3rd Qu.:22.59   3rd Qu.: 0.0000        Jan-00 :  53        
##  IL     : 187   Max.   :39.99   Max.   :15.0000        Oct-99 :  53        
##  (Other):2743                                          (Other):4640        
##  Inquiries_Last_6Mo Months_Since_Deliquency Months_Since_Record
##  Min.   :0.000      Min.   :  0.00          Min.   :  3.00     
##  1st Qu.:0.000      1st Qu.: 16.00          1st Qu.: 54.00     
##  Median :0.000      Median : 31.00          Median : 75.00     
##  Mean   :0.787      Mean   : 34.19          Mean   : 75.15     
##  3rd Qu.:1.000      3rd Qu.: 51.00          3rd Qu.:100.00     
##  Max.   :7.000      Max.   :135.00          Max.   :119.00     
##                     NA's   :2428            NA's   :4244       
##  Number_Open_Accounts Public_Record_Count Revolving_Balance
##  Min.   : 2.00        Min.   :0.0000      Min.   :     0   
##  1st Qu.: 8.00        1st Qu.:0.0000      1st Qu.:  7327   
##  Median :11.00        Median :0.0000      Median : 13818   
##  Mean   :11.59        Mean   :0.1868      Mean   : 18699   
##  3rd Qu.:14.00        3rd Qu.:0.0000      3rd Qu.: 23639   
##  Max.   :43.00        Max.   :8.0000      Max.   :376674   
##                                                            
##  Revolving_Utilization Total_Accounts   Collections_12Mo_Exclude_Med
##  Min.   :0.000         Min.   :  4.00   Min.   :0.0000              
##  1st Qu.:0.389         1st Qu.: 19.00   1st Qu.:0.0000              
##  Median :0.576         Median : 26.00   Median :0.0000              
##  Mean   :0.560         Mean   : 27.59   Mean   :0.0082              
##  3rd Qu.:0.749         3rd Qu.: 35.00   3rd Qu.:0.0000              
##  Max.   :1.232         Max.   :105.00   Max.   :1.0000              
##                                                                     
##  Months_Since_Last_Derogatory
##  Min.   :  0.00              
##  1st Qu.: 25.00              
##  Median : 42.00              
##  Mean   : 42.44              
##  3rd Qu.: 58.00              
##  Max.   :139.00              
##  NA's   :3848

Data pre-processing

Combined train and test

I will combine our two datasets so that we do not need to prepare data separately for them. And avoid problem of dealing with different columns in different datasets.

However before combining them, need to add response column to test because number of columns need to be same for two datasets to stack vertically.

Look at the data after combined, all formats are appropriate in either numeric or factor.

## Rows: 34,000
## Columns: 30
## $ Loan_id                      <int> 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 1…
## $ Borrower_ID                  <int> 403344, 410191, 416412, 418859, 420699, …
## $ Loan_Amount_Requested        <int> 15000, 17400, 8000, 10000, 16000, 5500, …
## $ Initial_Loan_Term_Months     <fct>  36 months,  36 months,  36 months,  36 …
## $ Interest_Rate                <dbl> 0.1474, 0.1347, 0.1095, 0.0800, 0.1663, …
## $ Employer                     <fct> Helpdesk Analyst, National Aquarium, pes…
## $ Length_Employed              <int> 1, 2, 10, 1, 2, 4, 10, 10, 1, 10, 2, 2, …
## $ Home_Owner                   <fct> MORTGAGE, N/A, RENT, MORTGAGE, MORTGAGE,…
## $ Annual_Income                <dbl> 87000, NA, 39996, 111150, 70000, 32004, …
## $ Income_Verified              <fct> VERIFIED - income, not verified, not ver…
## $ Month_Issued                 <fct> Feb, Apr, Mar, Mar, Mar, Apr, Apr, Apr, …
## $ Loan_Description             <fct> "Several years ago my wife started a gra…
## $ Purpose_Of_Loan              <fct> debt_consolidation, debt_consolidation, …
## $ Loan_Title                   <fct> "Help the love of my life", "Credit Card…
## $ Zip_3                        <fct> 553xx, 394xx, 087xx, 923xx, 975xx, 024xx…
## $ State                        <fct> MN, MS, NJ, CA, OR, MA, TX, TX, WI, MI, …
## $ Debt_To_Income               <dbl> 23.49, 13.38, 22.98, 0.49, 0.26, 19.20, …
## $ Number_Delinqueny_2yrs       <int> 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0…
## $ Date_Earliest_Credit         <fct> Oct-96, Dec-93, May-89, Aug-97, Feb-00, …
## $ Inquiries_Last_6Mo           <int> 1, 0, 1, 1, 3, 0, 1, 3, 0, 0, 1, 0, 1, 0…
## $ Months_Since_Deliquency      <int> 25, NA, 53, NA, 30, NA, 49, NA, NA, 11, …
## $ Months_Since_Record          <int> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
## $ Number_Open_Accounts         <int> 15, 13, 21, 9, 5, 7, 11, 4, 12, 14, 5, 1…
## $ Public_Record_Count          <int> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0…
## $ Revolving_Balance            <int> 28766, 35598, 25336, 7195, 438, 6860, 15…
## $ Revolving_Utilization        <dbl> 0.001, 0.579, 0.485, 0.063, 0.046, 0.294…
## $ Total_Accounts               <int> 25, 41, 43, 20, 11, 12, 23, 35, 29, 31, …
## $ Collections_12Mo_Exclude_Med <int> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0…
## $ Months_Since_Last_Derogatory <int> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, …
## $ data                         <chr> "train", "train", "train", "train", "tra…

Data removing, imputing/removing missing data

Give a look on dataset about the missing values. the following opreations should be done based on the obsvervation from two datasets:

Drop [Borrower_ID] as they are unique identifiers for each loan and borrower and not useful for our model

Drop [Loan_Description]. As the test data has 3565 out of 5000 values missing for Loan_Description. Besides, those variables are basically the borrower’s reason for applying for the loan. More over, this is another relatively unique text data type that will most likely not be useful for our model. Therefore, those are defenitly not useful for our model, where the ultimate goal is to predict on the test dataset.

Drop [Loan_Title,Employer]. Those are also another unique character data types that won’t be as useful to the model, so I will remove the variables altogether from both the test and training datasets.

Drop [Month_Issued]. Even though I think base interest rates may oscillate during certains months of any year, like seasons, this feature doesn’t seem to be as strong as some of the other features, intuitively.

Drop [Date_Earliest_Credit]. This could be converted into years, days, or even seconds since earliest line of credit in integer format, but for this model I will exclude this column. Cause since it doesn’t seem to be as strong as the other features we kept.

Drop the variables [Months_Since_Deliquency,Months_Since_Record and Months_Since_Last_Derogatory]. The reason is that there are 24,767 instances in Months_Since_Record missing (22,079 missing in Months_Since_Last_Derogatory; 14,200 out of 29,000 missing for Months_Since_Deliquency), which means almost all of the values (or more than 50% instances are missing) here are missing for Months_Since_Record (Months_Since_Last_Derogatory, Months_Since_Deliquency). Therefore, it’s better to excluded from the model.

Replace the missing values with mean value for variables [Length_Employed, Annual_Income].

## $Loan_id
## [1] 0
## 
## $Borrower_ID
## [1] 0
## 
## $Loan_Amount_Requested
## [1] 0
## 
## $Initial_Loan_Term_Months
## [1] 0
## 
## $Interest_Rate
## [1] 0
## 
## $Employer
## [1] 0
## 
## $Length_Employed
## [1] 1568
## 
## $Home_Owner
## [1] 0
## 
## $Annual_Income
## [1] 4404
## 
## $Income_Verified
## [1] 0
## 
## $Month_Issued
## [1] 0
## 
## $Loan_Description
## [1] 0
## 
## $Purpose_Of_Loan
## [1] 0
## 
## $Loan_Title
## [1] 0
## 
## $Zip_3
## [1] 0
## 
## $State
## [1] 0
## 
## $Debt_To_Income
## [1] 0
## 
## $Number_Delinqueny_2yrs
## [1] 0
## 
## $Date_Earliest_Credit
## [1] 0
## 
## $Inquiries_Last_6Mo
## [1] 0
## 
## $Months_Since_Deliquency
## [1] 14200
## 
## $Months_Since_Record
## [1] 24767
## 
## $Number_Open_Accounts
## [1] 0
## 
## $Public_Record_Count
## [1] 0
## 
## $Revolving_Balance
## [1] 0
## 
## $Revolving_Utilization
## [1] 0
## 
## $Total_Accounts
## [1] 0
## 
## $Collections_12Mo_Exclude_Med
## [1] 0
## 
## $Months_Since_Last_Derogatory
## [1] 22079
## 
## $data
## [1] 0

Dummy variables

Look at the variable Purpose_Of_Loan: There are too many categories. I will combine categories on the basis of average reponse, this will bring down number of categories and make dummies.

## 
##                car        credit_card debt_consolidation        educational 
##                360               7564              20224                 33 
##   home_improvement              house     major_purchase            medical 
##               2121                144                652                327 
##             moving              other   renewable_energy     small_business 
##                170               1557                 25                514 
##           vacation            wedding 
##                185                124

Create dummy variables for other category variables. “Initial_Loan_Term_Months”,“Home_Owner”,“Income_Verified”,“State”

Convert back to train and test data base on orginal response

Split train data to train and validation data

Validation data here is to validate the model we have and mitigate the overfitting

Linear Regression

Build model based on train1 data

Checking variance inflation factor of the columns

Before we go start looking at model summary and p-value for the variables , we need to drop variables from the model which have high VIF.For looking at VIF values for the variables , we’ll use function vif from package car.

It will be easier to identify high VIF vars if we sort the results and say look at top 3 only

##                 Loan_Amount_Requested                       Length_Employed 
##                              1.630383                              1.033510 
##                         Annual_Income                        Debt_To_Income 
##                              1.452889                              1.381670 
##                Number_Delinqueny_2yrs                    Inquiries_Last_6Mo 
##                              1.029400                              1.047783 
##                  Number_Open_Accounts                   Public_Record_Count 
##                              2.032254                              1.049685 
##                     Revolving_Balance                 Revolving_Utilization 
##                              1.255706                              1.200410 
##                        Total_Accounts          Collections_12Mo_Exclude_Med 
##                              1.951750                              1.006698 
##                                pol_10                                pol_11 
##                              2.104027                             44.593227 
##                                pol_12                                pol_13 
##                             77.283279                            237.252167 
##                                pol_14     Initial_Loan_Term_Months_36months 
##                            278.523442                              1.251403 
##                      `Home_Owner_N/A`                       Home_Owner_RENT 
##                              2.569354                              3.417613 
##                   Home_Owner_MORTGAGE Income_Verified_VERIFIED_incomesource 
##                              3.789055                              1.595978 
##       Income_Verified_VERIFIED_income                              State_HI 
##                              1.737881                              1.223844 
##                              State_NH                              State_RI 
##                              1.236055                              1.242699 
##                              State_WV                              State_NM 
##                              1.244356                              1.287221 
##                              State_UT                              State_AR 
##                              1.374105                              1.408086 
##                              State_KS                              State_OK 
##                              1.407173                              1.441290 
##                              State_KY                              State_LA 
##                              1.472960                              1.480999 
##                              State_OR                              State_SC 
##                              1.592097                              1.601082 
##                              State_TN                              State_NV 
##                              1.595829                              1.636279 
##                              State_AL                              State_WI 
##                              1.578309                              1.593803 
##                              State_IN                              State_CT 
##                              1.717771                              1.785850 
##                              State_MO                              State_MN 
##                              1.706918                              1.852110 
##                              State_CO                              State_WA 
##                              1.978691                              2.008233 
##                              State_AZ                              State_MD 
##                              2.029324                              2.039816 
##                              State_MA                              State_MI 
##                              2.112949                              2.233416 
##                              State_NC                              State_VA 
##                              2.255573                              2.473017 
##                              State_GA                              State_OH 
##                              2.534042                              2.488425 
##                              State_PA                              State_IL 
##                              2.655324                              2.787450 
##                              State_NJ                              State_FL 
##                              2.805476                              3.744812 
##                              State_TX                              State_NY 
##                              4.400172                              4.598596 
##                              State_CA 
##                              6.908742
##    pol_14    pol_13    pol_12 
## 278.52344 237.25217  77.28328

Drop the highest vif variable and run the model again.

Later on, we can see that All VIF values are under control.

## State_CA State_NY State_TX 
## 6.908421 4.598596 4.400153

Model summary

The model summary, specifically p-values asscociated with the variables. All variables with high p-values [ >0.05] will be dropped. Here I use step function which drops vars based on AIC score one by one. The goal here is to remove vars which do not contribute well.

## Start:  AIC=-157857
## Interest_Rate ~ (Loan_id + Loan_Amount_Requested + Length_Employed + 
##     Annual_Income + Debt_To_Income + Number_Delinqueny_2yrs + 
##     Inquiries_Last_6Mo + Number_Open_Accounts + Public_Record_Count + 
##     Revolving_Balance + Revolving_Utilization + Total_Accounts + 
##     Collections_12Mo_Exclude_Med + pol_10 + pol_11 + pol_12 + 
##     pol_13 + pol_14 + Initial_Loan_Term_Months_36months + `Home_Owner_N/A` + 
##     Home_Owner_RENT + Home_Owner_MORTGAGE + Income_Verified_VERIFIED_incomesource + 
##     Income_Verified_VERIFIED_income + State_HI + State_NH + State_RI + 
##     State_WV + State_NM + State_UT + State_AR + State_KS + State_OK + 
##     State_KY + State_LA + State_OR + State_SC + State_TN + State_NV + 
##     State_AL + State_WI + State_IN + State_CT + State_MO + State_MN + 
##     State_CO + State_WA + State_AZ + State_MD + State_MA + State_MI + 
##     State_NC + State_VA + State_GA + State_OH + State_PA + State_IL + 
##     State_NJ + State_FL + State_TX + State_NY + State_CA) - Loan_id - 
##     pol_14
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_NH                               1    0.0000 25.597 -157859
## - State_UT                               1    0.0000 25.597 -157859
## - State_WV                               1    0.0001 25.597 -157859
## - State_WI                               1    0.0001 25.597 -157859
## - State_MA                               1    0.0003 25.597 -157859
## - State_AL                               1    0.0004 25.597 -157859
## - State_RI                               1    0.0004 25.597 -157859
## - State_IL                               1    0.0006 25.597 -157858
## - State_MO                               1    0.0006 25.597 -157858
## - State_NJ                               1    0.0007 25.597 -157858
## - State_VA                               1    0.0007 25.598 -157858
## - State_CT                               1    0.0007 25.598 -157858
## - State_OH                               1    0.0009 25.598 -157858
## - State_HI                               1    0.0010 25.598 -157858
## - State_MN                               1    0.0012 25.598 -157858
## - State_CO                               1    0.0014 25.598 -157858
## - State_AR                               1    0.0014 25.598 -157858
## - State_PA                               1    0.0016 25.598 -157858
## - State_KS                               1    0.0016 25.598 -157858
## - pol_11                                 1    0.0017 25.599 -157857
## - State_GA                               1    0.0017 25.599 -157857
## - State_OR                               1    0.0017 25.599 -157857
## - State_KY                               1    0.0019 25.599 -157857
## <none>                                               25.597 -157857
## - State_OK                               1    0.0026 25.599 -157857
## - State_SC                               1    0.0031 25.600 -157856
## - pol_10                                 1    0.0034 25.600 -157856
## - State_TX                               1    0.0036 25.600 -157856
## - State_NM                               1    0.0037 25.601 -157856
## - State_LA                               1    0.0042 25.601 -157855
## - State_IN                               1    0.0043 25.601 -157855
## - State_AZ                               1    0.0043 25.601 -157855
## - State_MD                               1    0.0044 25.601 -157855
## - State_CA                               1    0.0056 25.602 -157854
## - State_MI                               1    0.0064 25.603 -157853
## - Length_Employed                        1    0.0065 25.603 -157853
## - State_WA                               1    0.0066 25.603 -157853
## - State_NC                               1    0.0074 25.604 -157852
## - Home_Owner_RENT                        1    0.0078 25.605 -157852
## - State_NV                               1    0.0085 25.605 -157851
## - State_FL                               1    0.0091 25.606 -157851
## - State_NY                               1    0.0092 25.606 -157851
## - `Home_Owner_N/A`                       1    0.0141 25.611 -157846
## - State_TN                               1    0.0169 25.614 -157844
## - Collections_12Mo_Exclude_Med           1    0.0176 25.614 -157843
## - pol_12                                 1    0.0177 25.615 -157843
## - Loan_Amount_Requested                  1    0.0222 25.619 -157839
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.637 -157823
## - Debt_To_Income                         1    0.0775 25.674 -157789
## - Annual_Income                          1    0.0899 25.687 -157778
## - Home_Owner_MORTGAGE                    1    0.1082 25.705 -157761
## - pol_13                                 1    0.1294 25.726 -157742
## - Total_Accounts                         1    0.1354 25.732 -157737
## - Revolving_Balance                      1    0.1397 25.737 -157733
## - Number_Open_Accounts                   1    0.1902 25.787 -157687
## - Income_Verified_VERIFIED_income        1    0.4066 26.003 -157493
## - Public_Record_Count                    1    0.4407 26.038 -157463
## - Number_Delinqueny_2yrs                 1    0.4735 26.070 -157434
## - Inquiries_Last_6Mo                     1    2.4013 27.998 -155779
## - Revolving_Utilization                  1    4.4264 30.023 -154159
## - Initial_Loan_Term_Months_36months      1    6.2432 31.840 -152795
## 
## Step:  AIC=-157859
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_RI + State_WV + State_NM + State_UT + State_AR + 
##     State_KS + State_OK + State_KY + State_LA + State_OR + State_SC + 
##     State_TN + State_NV + State_AL + State_WI + State_IN + State_CT + 
##     State_MO + State_MN + State_CO + State_WA + State_AZ + State_MD + 
##     State_MA + State_MI + State_NC + State_VA + State_GA + State_OH + 
##     State_PA + State_IL + State_NJ + State_FL + State_TX + State_NY + 
##     State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_UT                               1    0.0000 25.597 -157861
## - State_WV                               1    0.0001 25.597 -157861
## - State_WI                               1    0.0001 25.597 -157861
## - State_MA                               1    0.0004 25.597 -157861
## - State_RI                               1    0.0004 25.597 -157861
## - State_AL                               1    0.0004 25.597 -157861
## - State_IL                               1    0.0006 25.597 -157860
## - State_MO                               1    0.0007 25.598 -157860
## - State_NJ                               1    0.0008 25.598 -157860
## - State_CT                               1    0.0008 25.598 -157860
## - State_VA                               1    0.0008 25.598 -157860
## - State_OH                               1    0.0010 25.598 -157860
## - State_HI                               1    0.0011 25.598 -157860
## - State_MN                               1    0.0013 25.598 -157860
## - State_AR                               1    0.0015 25.598 -157860
## - State_CO                               1    0.0015 25.598 -157860
## - pol_11                                 1    0.0017 25.599 -157859
## - State_KS                               1    0.0017 25.599 -157859
## - State_PA                               1    0.0018 25.599 -157859
## - State_OR                               1    0.0019 25.599 -157859
## - State_GA                               1    0.0020 25.599 -157859
## - State_KY                               1    0.0020 25.599 -157859
## <none>                                               25.597 -157859
## - State_OK                               1    0.0028 25.600 -157858
## - State_SC                               1    0.0034 25.600 -157858
## - pol_10                                 1    0.0034 25.600 -157858
## - State_NM                               1    0.0039 25.601 -157857
## - State_TX                               1    0.0042 25.601 -157857
## - State_LA                               1    0.0045 25.601 -157857
## - State_IN                               1    0.0047 25.601 -157857
## - State_AZ                               1    0.0048 25.602 -157857
## - State_MD                               1    0.0049 25.602 -157857
## - Length_Employed                        1    0.0065 25.603 -157855
## - State_CA                               1    0.0067 25.604 -157855
## - State_MI                               1    0.0072 25.604 -157854
## - State_WA                               1    0.0073 25.604 -157854
## - Home_Owner_RENT                        1    0.0078 25.605 -157854
## - State_NC                               1    0.0083 25.605 -157853
## - State_NV                               1    0.0092 25.606 -157853
## - State_FL                               1    0.0107 25.607 -157851
## - State_NY                               1    0.0108 25.608 -157851
## - `Home_Owner_N/A`                       1    0.0141 25.611 -157848
## - Collections_12Mo_Exclude_Med           1    0.0176 25.614 -157845
## - pol_12                                 1    0.0177 25.615 -157845
## - State_TN                               1    0.0182 25.615 -157844
## - Loan_Amount_Requested                  1    0.0222 25.619 -157841
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.637 -157825
## - Debt_To_Income                         1    0.0775 25.674 -157791
## - Annual_Income                          1    0.0899 25.687 -157780
## - Home_Owner_MORTGAGE                    1    0.1082 25.705 -157763
## - pol_13                                 1    0.1294 25.726 -157744
## - Total_Accounts                         1    0.1354 25.732 -157739
## - Revolving_Balance                      1    0.1397 25.737 -157735
## - Number_Open_Accounts                   1    0.1902 25.787 -157689
## - Income_Verified_VERIFIED_income        1    0.4066 26.003 -157495
## - Public_Record_Count                    1    0.4407 26.038 -157465
## - Number_Delinqueny_2yrs                 1    0.4737 26.071 -157436
## - Inquiries_Last_6Mo                     1    2.4014 27.998 -155781
## - Revolving_Utilization                  1    4.4264 30.023 -154160
## - Initial_Loan_Term_Months_36months      1    6.2437 31.841 -152797
## 
## Step:  AIC=-157861
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_RI + State_WV + State_NM + State_AR + State_KS + 
##     State_OK + State_KY + State_LA + State_OR + State_SC + State_TN + 
##     State_NV + State_AL + State_WI + State_IN + State_CT + State_MO + 
##     State_MN + State_CO + State_WA + State_AZ + State_MD + State_MA + 
##     State_MI + State_NC + State_VA + State_GA + State_OH + State_PA + 
##     State_IL + State_NJ + State_FL + State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_WV                               1    0.0000 25.597 -157863
## - State_WI                               1    0.0001 25.597 -157863
## - State_RI                               1    0.0004 25.597 -157863
## - State_AL                               1    0.0004 25.597 -157863
## - State_MA                               1    0.0005 25.597 -157863
## - State_IL                               1    0.0006 25.597 -157862
## - State_MO                               1    0.0007 25.598 -157862
## - State_CT                               1    0.0007 25.598 -157862
## - State_NJ                               1    0.0008 25.598 -157862
## - State_VA                               1    0.0008 25.598 -157862
## - State_OH                               1    0.0010 25.598 -157862
## - State_HI                               1    0.0012 25.598 -157862
## - State_MN                               1    0.0013 25.598 -157862
## - State_AR                               1    0.0015 25.598 -157862
## - State_CO                               1    0.0016 25.598 -157862
## - pol_11                                 1    0.0017 25.599 -157861
## - State_KS                               1    0.0017 25.599 -157861
## - State_OR                               1    0.0019 25.599 -157861
## - State_PA                               1    0.0019 25.599 -157861
## - State_KY                               1    0.0021 25.599 -157861
## - State_GA                               1    0.0021 25.599 -157861
## <none>                                               25.597 -157861
## - State_OK                               1    0.0028 25.600 -157860
## - pol_10                                 1    0.0034 25.600 -157860
## - State_SC                               1    0.0035 25.600 -157860
## - State_NM                               1    0.0039 25.601 -157859
## - State_LA                               1    0.0046 25.601 -157859
## - State_TX                               1    0.0048 25.602 -157859
## - State_IN                               1    0.0049 25.602 -157859
## - State_AZ                               1    0.0052 25.602 -157858
## - State_MD                               1    0.0053 25.602 -157858
## - Length_Employed                        1    0.0065 25.603 -157857
## - Home_Owner_RENT                        1    0.0078 25.605 -157856
## - State_MI                               1    0.0078 25.605 -157856
## - State_WA                               1    0.0079 25.605 -157856
## - State_CA                               1    0.0079 25.605 -157856
## - State_NC                               1    0.0091 25.606 -157855
## - State_NV                               1    0.0097 25.607 -157854
## - State_FL                               1    0.0123 25.609 -157852
## - State_NY                               1    0.0126 25.610 -157852
## - `Home_Owner_N/A`                       1    0.0141 25.611 -157850
## - Collections_12Mo_Exclude_Med           1    0.0176 25.614 -157847
## - pol_12                                 1    0.0177 25.615 -157847
## - State_TN                               1    0.0193 25.616 -157845
## - Loan_Amount_Requested                  1    0.0221 25.619 -157843
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.637 -157827
## - Debt_To_Income                         1    0.0775 25.674 -157793
## - Annual_Income                          1    0.0899 25.687 -157782
## - Home_Owner_MORTGAGE                    1    0.1082 25.705 -157765
## - pol_13                                 1    0.1294 25.726 -157746
## - Total_Accounts                         1    0.1355 25.732 -157740
## - Revolving_Balance                      1    0.1397 25.737 -157737
## - Number_Open_Accounts                   1    0.1903 25.787 -157691
## - Income_Verified_VERIFIED_income        1    0.4066 26.003 -157497
## - Public_Record_Count                    1    0.4411 26.038 -157467
## - Number_Delinqueny_2yrs                 1    0.4737 26.071 -157438
## - Inquiries_Last_6Mo                     1    2.4015 27.998 -155782
## - Revolving_Utilization                  1    4.4264 30.023 -154162
## - Initial_Loan_Term_Months_36months      1    6.2441 31.841 -152799
## 
## Step:  AIC=-157862.9
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_RI + State_NM + State_AR + State_KS + State_OK + 
##     State_KY + State_LA + State_OR + State_SC + State_TN + State_NV + 
##     State_AL + State_WI + State_IN + State_CT + State_MO + State_MN + 
##     State_CO + State_WA + State_AZ + State_MD + State_MA + State_MI + 
##     State_NC + State_VA + State_GA + State_OH + State_PA + State_IL + 
##     State_NJ + State_FL + State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_WI                               1    0.0002 25.597 -157865
## - State_RI                               1    0.0003 25.597 -157865
## - State_AL                               1    0.0003 25.597 -157865
## - State_IL                               1    0.0006 25.598 -157864
## - State_MA                               1    0.0006 25.598 -157864
## - State_MO                               1    0.0006 25.598 -157864
## - State_CT                               1    0.0007 25.598 -157864
## - State_NJ                               1    0.0007 25.598 -157864
## - State_VA                               1    0.0007 25.598 -157864
## - State_OH                               1    0.0010 25.598 -157864
## - State_HI                               1    0.0012 25.598 -157864
## - State_MN                               1    0.0013 25.598 -157864
## - State_AR                               1    0.0015 25.598 -157864
## - State_CO                               1    0.0016 25.598 -157864
## - State_KS                               1    0.0017 25.599 -157863
## - pol_11                                 1    0.0017 25.599 -157863
## - State_OR                               1    0.0019 25.599 -157863
## - State_PA                               1    0.0019 25.599 -157863
## - State_KY                               1    0.0020 25.599 -157863
## - State_GA                               1    0.0021 25.599 -157863
## <none>                                               25.597 -157863
## - State_OK                               1    0.0028 25.600 -157862
## - pol_10                                 1    0.0034 25.600 -157862
## - State_SC                               1    0.0034 25.600 -157862
## - State_NM                               1    0.0039 25.601 -157861
## - State_LA                               1    0.0046 25.601 -157861
## - State_IN                               1    0.0049 25.602 -157860
## - State_TX                               1    0.0050 25.602 -157860
## - State_AZ                               1    0.0052 25.602 -157860
## - State_MD                               1    0.0053 25.602 -157860
## - Length_Employed                        1    0.0065 25.603 -157859
## - Home_Owner_RENT                        1    0.0078 25.605 -157858
## - State_WA                               1    0.0080 25.605 -157858
## - State_MI                               1    0.0080 25.605 -157858
## - State_CA                               1    0.0084 25.605 -157857
## - State_NC                               1    0.0094 25.606 -157856
## - State_NV                               1    0.0098 25.607 -157856
## - State_FL                               1    0.0130 25.610 -157853
## - State_NY                               1    0.0134 25.610 -157853
## - `Home_Owner_N/A`                       1    0.0141 25.611 -157852
## - Collections_12Mo_Exclude_Med           1    0.0176 25.614 -157849
## - pol_12                                 1    0.0177 25.615 -157849
## - State_TN                               1    0.0197 25.617 -157847
## - Loan_Amount_Requested                  1    0.0221 25.619 -157845
## - Income_Verified_VERIFIED_incomesource  1    0.0400 25.637 -157829
## - Debt_To_Income                         1    0.0776 25.674 -157795
## - Annual_Income                          1    0.0899 25.687 -157784
## - Home_Owner_MORTGAGE                    1    0.1082 25.705 -157767
## - pol_13                                 1    0.1294 25.726 -157748
## - Total_Accounts                         1    0.1355 25.732 -157742
## - Revolving_Balance                      1    0.1397 25.737 -157739
## - Number_Open_Accounts                   1    0.1902 25.787 -157693
## - Income_Verified_VERIFIED_income        1    0.4066 26.004 -157499
## - Public_Record_Count                    1    0.4412 26.038 -157468
## - Number_Delinqueny_2yrs                 1    0.4739 26.071 -157439
## - Inquiries_Last_6Mo                     1    2.4019 27.999 -155784
## - Revolving_Utilization                  1    4.4265 30.023 -154164
## - Initial_Loan_Term_Months_36months      1    6.2451 31.842 -152800
## 
## Step:  AIC=-157864.8
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_RI + State_NM + State_AR + State_KS + State_OK + 
##     State_KY + State_LA + State_OR + State_SC + State_TN + State_NV + 
##     State_AL + State_IN + State_CT + State_MO + State_MN + State_CO + 
##     State_WA + State_AZ + State_MD + State_MA + State_MI + State_NC + 
##     State_VA + State_GA + State_OH + State_PA + State_IL + State_NJ + 
##     State_FL + State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_RI                               1    0.0004 25.598 -157866
## - State_MA                               1    0.0005 25.598 -157866
## - State_AL                               1    0.0005 25.598 -157866
## - State_MO                               1    0.0009 25.598 -157866
## - State_IL                               1    0.0010 25.598 -157866
## - State_CT                               1    0.0010 25.598 -157866
## - State_HI                               1    0.0011 25.598 -157866
## - State_VA                               1    0.0011 25.598 -157866
## - State_NJ                               1    0.0011 25.598 -157866
## - State_OH                               1    0.0015 25.599 -157865
## - pol_11                                 1    0.0017 25.599 -157865
## - State_MN                               1    0.0017 25.599 -157865
## - State_AR                               1    0.0018 25.599 -157865
## - State_KS                               1    0.0020 25.599 -157865
## - State_CO                               1    0.0021 25.599 -157865
## <none>                                               25.597 -157865
## - State_OR                               1    0.0023 25.599 -157865
## - State_KY                               1    0.0024 25.600 -157865
## - State_PA                               1    0.0027 25.600 -157864
## - State_GA                               1    0.0028 25.600 -157864
## - State_OK                               1    0.0033 25.600 -157864
## - pol_10                                 1    0.0034 25.600 -157864
## - State_SC                               1    0.0041 25.601 -157863
## - State_NM                               1    0.0043 25.601 -157863
## - State_LA                               1    0.0053 25.602 -157862
## - State_IN                               1    0.0058 25.603 -157861
## - State_AZ                               1    0.0064 25.603 -157861
## - Length_Employed                        1    0.0065 25.604 -157861
## - State_MD                               1    0.0065 25.604 -157861
## - State_TX                               1    0.0069 25.604 -157860
## - Home_Owner_RENT                        1    0.0077 25.605 -157860
## - State_WA                               1    0.0096 25.607 -157858
## - State_MI                               1    0.0098 25.607 -157858
## - State_NV                               1    0.0112 25.608 -157857
## - State_NC                               1    0.0114 25.608 -157856
## - State_CA                               1    0.0119 25.609 -157856
## - `Home_Owner_N/A`                       1    0.0141 25.611 -157854
## - State_FL                               1    0.0167 25.614 -157852
## - Collections_12Mo_Exclude_Med           1    0.0176 25.615 -157851
## - State_NY                               1    0.0177 25.615 -157851
## - pol_12                                 1    0.0177 25.615 -157851
## - State_TN                               1    0.0220 25.619 -157847
## - Loan_Amount_Requested                  1    0.0222 25.619 -157847
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.637 -157830
## - Debt_To_Income                         1    0.0777 25.675 -157796
## - Annual_Income                          1    0.0898 25.687 -157786
## - Home_Owner_MORTGAGE                    1    0.1084 25.705 -157769
## - pol_13                                 1    0.1295 25.727 -157750
## - Total_Accounts                         1    0.1355 25.733 -157744
## - Revolving_Balance                      1    0.1400 25.737 -157740
## - Number_Open_Accounts                   1    0.1901 25.787 -157695
## - Income_Verified_VERIFIED_income        1    0.4067 26.004 -157501
## - Public_Record_Count                    1    0.4410 26.038 -157470
## - Number_Delinqueny_2yrs                 1    0.4739 26.071 -157441
## - Inquiries_Last_6Mo                     1    2.4017 27.999 -155786
## - Revolving_Utilization                  1    4.4269 30.024 -154166
## - Initial_Loan_Term_Months_36months      1    6.2449 31.842 -152802
## 
## Step:  AIC=-157866.4
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_AR + State_KS + State_OK + State_KY + 
##     State_LA + State_OR + State_SC + State_TN + State_NV + State_AL + 
##     State_IN + State_CT + State_MO + State_MN + State_CO + State_WA + 
##     State_AZ + State_MD + State_MA + State_MI + State_NC + State_VA + 
##     State_GA + State_OH + State_PA + State_IL + State_NJ + State_FL + 
##     State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_AL                               1    0.0004 25.598 -157868
## - State_MA                               1    0.0006 25.598 -157868
## - State_MO                               1    0.0007 25.598 -157868
## - State_IL                               1    0.0008 25.598 -157868
## - State_CT                               1    0.0008 25.598 -157868
## - State_VA                               1    0.0009 25.598 -157868
## - State_NJ                               1    0.0009 25.598 -157868
## - State_OH                               1    0.0012 25.599 -157867
## - State_HI                               1    0.0013 25.599 -157867
## - State_MN                               1    0.0015 25.599 -157867
## - State_AR                               1    0.0016 25.599 -157867
## - pol_11                                 1    0.0017 25.599 -157867
## - State_CO                               1    0.0018 25.599 -157867
## - State_KS                               1    0.0018 25.599 -157867
## - State_OR                               1    0.0021 25.600 -157866
## <none>                                               25.598 -157866
## - State_KY                               1    0.0022 25.600 -157866
## - State_PA                               1    0.0023 25.600 -157866
## - State_GA                               1    0.0025 25.600 -157866
## - State_OK                               1    0.0030 25.601 -157866
## - pol_10                                 1    0.0033 25.601 -157865
## - State_SC                               1    0.0038 25.601 -157865
## - State_NM                               1    0.0041 25.602 -157865
## - State_LA                               1    0.0050 25.603 -157864
## - State_IN                               1    0.0055 25.603 -157863
## - State_AZ                               1    0.0060 25.604 -157863
## - State_MD                               1    0.0062 25.604 -157863
## - State_TX                               1    0.0065 25.604 -157862
## - Length_Employed                        1    0.0066 25.604 -157862
## - Home_Owner_RENT                        1    0.0077 25.605 -157861
## - State_WA                               1    0.0092 25.607 -157860
## - State_MI                               1    0.0094 25.607 -157860
## - State_NV                               1    0.0108 25.608 -157859
## - State_NC                               1    0.0109 25.608 -157858
## - State_CA                               1    0.0115 25.609 -157858
## - `Home_Owner_N/A`                       1    0.0142 25.612 -157856
## - State_FL                               1    0.0163 25.614 -157854
## - State_NY                               1    0.0174 25.615 -157853
## - Collections_12Mo_Exclude_Med           1    0.0176 25.615 -157852
## - pol_12                                 1    0.0177 25.615 -157852
## - State_TN                               1    0.0215 25.619 -157849
## - Loan_Amount_Requested                  1    0.0222 25.620 -157848
## - Income_Verified_VERIFIED_incomesource  1    0.0400 25.638 -157832
## - Debt_To_Income                         1    0.0775 25.675 -157798
## - Annual_Income                          1    0.0898 25.687 -157787
## - Home_Owner_MORTGAGE                    1    0.1086 25.706 -157770
## - pol_13                                 1    0.1296 25.727 -157751
## - Total_Accounts                         1    0.1356 25.733 -157746
## - Revolving_Balance                      1    0.1399 25.737 -157742
## - Number_Open_Accounts                   1    0.1904 25.788 -157696
## - Income_Verified_VERIFIED_income        1    0.4066 26.004 -157503
## - Public_Record_Count                    1    0.4408 26.038 -157472
## - Number_Delinqueny_2yrs                 1    0.4738 26.071 -157443
## - Inquiries_Last_6Mo                     1    2.4014 27.999 -155788
## - Revolving_Utilization                  1    4.4284 30.026 -154166
## - Initial_Loan_Term_Months_36months      1    6.2445 31.842 -152804
## 
## Step:  AIC=-157868
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_AR + State_KS + State_OK + State_KY + 
##     State_LA + State_OR + State_SC + State_TN + State_NV + State_IN + 
##     State_CT + State_MO + State_MN + State_CO + State_WA + State_AZ + 
##     State_MD + State_MA + State_MI + State_NC + State_VA + State_GA + 
##     State_OH + State_PA + State_IL + State_NJ + State_FL + State_TX + 
##     State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_IL                               1    0.0005 25.598 -157870
## - State_MO                               1    0.0005 25.598 -157869
## - State_CT                               1    0.0006 25.599 -157869
## - State_NJ                               1    0.0007 25.599 -157869
## - State_VA                               1    0.0007 25.599 -157869
## - State_MA                               1    0.0009 25.599 -157869
## - State_OH                               1    0.0010 25.599 -157869
## - State_MN                               1    0.0013 25.599 -157869
## - State_AR                               1    0.0014 25.599 -157869
## - State_HI                               1    0.0014 25.599 -157869
## - State_CO                               1    0.0015 25.599 -157869
## - State_KS                               1    0.0016 25.600 -157869
## - pol_11                                 1    0.0017 25.600 -157868
## - State_OR                               1    0.0018 25.600 -157868
## - State_KY                               1    0.0020 25.600 -157868
## - State_PA                               1    0.0020 25.600 -157868
## - State_GA                               1    0.0022 25.600 -157868
## <none>                                               25.598 -157868
## - State_OK                               1    0.0028 25.601 -157868
## - pol_10                                 1    0.0034 25.601 -157867
## - State_SC                               1    0.0035 25.601 -157867
## - State_NM                               1    0.0038 25.602 -157867
## - State_LA                               1    0.0047 25.603 -157866
## - State_IN                               1    0.0051 25.603 -157865
## - State_AZ                               1    0.0056 25.604 -157865
## - State_MD                               1    0.0058 25.604 -157865
## - State_TX                               1    0.0061 25.604 -157864
## - Length_Employed                        1    0.0066 25.604 -157864
## - Home_Owner_RENT                        1    0.0077 25.606 -157863
## - State_WA                               1    0.0088 25.607 -157862
## - State_MI                               1    0.0090 25.607 -157862
## - State_NV                               1    0.0104 25.608 -157861
## - State_NC                               1    0.0106 25.609 -157860
## - State_CA                               1    0.0114 25.609 -157860
## - `Home_Owner_N/A`                       1    0.0143 25.612 -157857
## - State_FL                               1    0.0164 25.614 -157855
## - State_NY                               1    0.0175 25.615 -157854
## - Collections_12Mo_Exclude_Med           1    0.0177 25.616 -157854
## - pol_12                                 1    0.0178 25.616 -157854
## - State_TN                               1    0.0212 25.619 -157851
## - Loan_Amount_Requested                  1    0.0221 25.620 -157850
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.638 -157834
## - Debt_To_Income                         1    0.0777 25.676 -157800
## - Annual_Income                          1    0.0898 25.688 -157789
## - Home_Owner_MORTGAGE                    1    0.1088 25.707 -157772
## - pol_13                                 1    0.1297 25.728 -157753
## - Total_Accounts                         1    0.1356 25.734 -157747
## - Revolving_Balance                      1    0.1399 25.738 -157744
## - Number_Open_Accounts                   1    0.1903 25.788 -157698
## - Income_Verified_VERIFIED_income        1    0.4071 26.005 -157504
## - Public_Record_Count                    1    0.4406 26.039 -157474
## - Number_Delinqueny_2yrs                 1    0.4736 26.072 -157445
## - Inquiries_Last_6Mo                     1    2.4016 27.999 -155790
## - Revolving_Utilization                  1    4.4289 30.027 -154168
## - Initial_Loan_Term_Months_36months      1    6.2470 31.845 -152804
## 
## Step:  AIC=-157869.5
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_AR + State_KS + State_OK + State_KY + 
##     State_LA + State_OR + State_SC + State_TN + State_NV + State_IN + 
##     State_CT + State_MO + State_MN + State_CO + State_WA + State_AZ + 
##     State_MD + State_MA + State_MI + State_NC + State_VA + State_GA + 
##     State_OH + State_PA + State_NJ + State_FL + State_TX + State_NY + 
##     State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_MO                               1    0.0003 25.599 -157871
## - State_NJ                               1    0.0003 25.599 -157871
## - State_VA                               1    0.0004 25.599 -157871
## - State_CT                               1    0.0004 25.599 -157871
## - State_OH                               1    0.0006 25.599 -157871
## - State_MN                               1    0.0009 25.599 -157871
## - State_AR                               1    0.0011 25.600 -157871
## - State_CO                               1    0.0012 25.600 -157870
## - State_KS                               1    0.0013 25.600 -157870
## - State_OR                               1    0.0015 25.600 -157870
## - State_PA                               1    0.0015 25.600 -157870
## - State_MA                               1    0.0016 25.600 -157870
## - State_KY                               1    0.0016 25.600 -157870
## - State_GA                               1    0.0017 25.600 -157870
## - pol_11                                 1    0.0017 25.600 -157870
## - State_HI                               1    0.0018 25.600 -157870
## <none>                                               25.598 -157870
## - State_OK                               1    0.0024 25.601 -157869
## - State_SC                               1    0.0031 25.602 -157869
## - pol_10                                 1    0.0034 25.602 -157868
## - State_NM                               1    0.0035 25.602 -157868
## - State_LA                               1    0.0042 25.603 -157868
## - State_IN                               1    0.0046 25.603 -157867
## - State_AZ                               1    0.0051 25.604 -157867
## - State_MD                               1    0.0052 25.604 -157867
## - State_TX                               1    0.0057 25.604 -157866
## - Length_Employed                        1    0.0065 25.605 -157866
## - Home_Owner_RENT                        1    0.0077 25.606 -157865
## - State_WA                               1    0.0083 25.607 -157864
## - State_MI                               1    0.0086 25.607 -157864
## - State_NV                               1    0.0099 25.608 -157863
## - State_NC                               1    0.0102 25.609 -157862
## - State_CA                               1    0.0121 25.611 -157861
## - `Home_Owner_N/A`                       1    0.0142 25.613 -157859
## - State_FL                               1    0.0169 25.615 -157856
## - Collections_12Mo_Exclude_Med           1    0.0177 25.616 -157855
## - pol_12                                 1    0.0178 25.616 -157855
## - State_NY                               1    0.0186 25.617 -157855
## - State_TN                               1    0.0208 25.619 -157853
## - Loan_Amount_Requested                  1    0.0221 25.621 -157851
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.639 -157835
## - Debt_To_Income                         1    0.0774 25.676 -157801
## - Annual_Income                          1    0.0896 25.688 -157790
## - Home_Owner_MORTGAGE                    1    0.1088 25.707 -157773
## - pol_13                                 1    0.1294 25.728 -157755
## - Total_Accounts                         1    0.1359 25.734 -157749
## - Revolving_Balance                      1    0.1397 25.738 -157745
## - Number_Open_Accounts                   1    0.1909 25.789 -157699
## - Income_Verified_VERIFIED_income        1    0.4072 26.006 -157505
## - Public_Record_Count                    1    0.4403 26.039 -157476
## - Number_Delinqueny_2yrs                 1    0.4737 26.072 -157446
## - Inquiries_Last_6Mo                     1    2.4054 28.004 -155788
## - Revolving_Utilization                  1    4.4284 30.027 -154170
## - Initial_Loan_Term_Months_36months      1    6.2469 31.845 -152806
## 
## Step:  AIC=-157871.2
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_AR + State_KS + State_OK + State_KY + 
##     State_LA + State_OR + State_SC + State_TN + State_NV + State_IN + 
##     State_CT + State_MN + State_CO + State_WA + State_AZ + State_MD + 
##     State_MA + State_MI + State_NC + State_VA + State_GA + State_OH + 
##     State_PA + State_NJ + State_FL + State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_NJ                               1    0.0002 25.599 -157873
## - State_VA                               1    0.0003 25.599 -157873
## - State_CT                               1    0.0003 25.599 -157873
## - State_OH                               1    0.0005 25.599 -157873
## - State_MN                               1    0.0008 25.600 -157872
## - State_AR                               1    0.0010 25.600 -157872
## - State_CO                               1    0.0010 25.600 -157872
## - State_KS                               1    0.0012 25.600 -157872
## - State_PA                               1    0.0013 25.600 -157872
## - State_OR                               1    0.0013 25.600 -157872
## - State_GA                               1    0.0015 25.600 -157872
## - State_KY                               1    0.0015 25.600 -157872
## - pol_11                                 1    0.0017 25.600 -157872
## - State_MA                               1    0.0018 25.601 -157872
## - State_HI                               1    0.0019 25.601 -157872
## <none>                                               25.599 -157871
## - State_OK                               1    0.0022 25.601 -157871
## - State_SC                               1    0.0029 25.602 -157871
## - State_NM                               1    0.0033 25.602 -157870
## - pol_10                                 1    0.0034 25.602 -157870
## - State_LA                               1    0.0040 25.603 -157870
## - State_IN                               1    0.0044 25.603 -157869
## - State_AZ                               1    0.0048 25.604 -157869
## - State_MD                               1    0.0050 25.604 -157869
## - State_TX                               1    0.0054 25.604 -157868
## - Length_Employed                        1    0.0065 25.605 -157867
## - Home_Owner_RENT                        1    0.0077 25.606 -157866
## - State_WA                               1    0.0080 25.607 -157866
## - State_MI                               1    0.0082 25.607 -157866
## - State_NV                               1    0.0096 25.608 -157865
## - State_NC                               1    0.0098 25.609 -157864
## - State_CA                               1    0.0119 25.611 -157862
## - `Home_Owner_N/A`                       1    0.0142 25.613 -157860
## - State_FL                               1    0.0167 25.615 -157858
## - Collections_12Mo_Exclude_Med           1    0.0177 25.616 -157857
## - pol_12                                 1    0.0178 25.617 -157857
## - State_NY                               1    0.0184 25.617 -157857
## - State_TN                               1    0.0205 25.619 -157855
## - Loan_Amount_Requested                  1    0.0220 25.621 -157853
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.639 -157837
## - Debt_To_Income                         1    0.0775 25.676 -157803
## - Annual_Income                          1    0.0897 25.689 -157792
## - Home_Owner_MORTGAGE                    1    0.1087 25.707 -157775
## - pol_13                                 1    0.1294 25.728 -157756
## - Total_Accounts                         1    0.1357 25.734 -157751
## - Revolving_Balance                      1    0.1397 25.738 -157747
## - Number_Open_Accounts                   1    0.1907 25.789 -157701
## - Income_Verified_VERIFIED_income        1    0.4073 26.006 -157507
## - Public_Record_Count                    1    0.4401 26.039 -157478
## - Number_Delinqueny_2yrs                 1    0.4734 26.072 -157448
## - Inquiries_Last_6Mo                     1    2.4056 28.004 -155789
## - Revolving_Utilization                  1    4.4280 30.027 -154172
## - Initial_Loan_Term_Months_36months      1    6.2487 31.847 -152806
## 
## Step:  AIC=-157873
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_AR + State_KS + State_OK + State_KY + 
##     State_LA + State_OR + State_SC + State_TN + State_NV + State_IN + 
##     State_CT + State_MN + State_CO + State_WA + State_AZ + State_MD + 
##     State_MA + State_MI + State_NC + State_VA + State_GA + State_OH + 
##     State_PA + State_FL + State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_VA                               1    0.0002 25.599 -157875
## - State_CT                               1    0.0002 25.599 -157875
## - State_OH                               1    0.0004 25.599 -157875
## - State_MN                               1    0.0007 25.600 -157874
## - State_CO                               1    0.0009 25.600 -157874
## - State_AR                               1    0.0009 25.600 -157874
## - State_KS                               1    0.0011 25.600 -157874
## - State_PA                               1    0.0011 25.600 -157874
## - State_OR                               1    0.0012 25.600 -157874
## - State_GA                               1    0.0013 25.600 -157874
## - State_KY                               1    0.0014 25.600 -157874
## - pol_11                                 1    0.0017 25.601 -157873
## - State_HI                               1    0.0020 25.601 -157873
## - State_OK                               1    0.0021 25.601 -157873
## - State_MA                               1    0.0022 25.601 -157873
## <none>                                               25.599 -157873
## - State_SC                               1    0.0027 25.602 -157873
## - State_NM                               1    0.0032 25.602 -157872
## - pol_10                                 1    0.0034 25.602 -157872
## - State_LA                               1    0.0038 25.603 -157872
## - State_IN                               1    0.0042 25.603 -157871
## - State_AZ                               1    0.0046 25.604 -157871
## - State_MD                               1    0.0047 25.604 -157871
## - State_TX                               1    0.0052 25.604 -157870
## - Length_Employed                        1    0.0065 25.606 -157869
## - Home_Owner_RENT                        1    0.0077 25.607 -157868
## - State_WA                               1    0.0078 25.607 -157868
## - State_MI                               1    0.0080 25.607 -157868
## - State_NV                               1    0.0094 25.608 -157867
## - State_NC                               1    0.0096 25.609 -157866
## - State_CA                               1    0.0123 25.611 -157864
## - `Home_Owner_N/A`                       1    0.0142 25.613 -157862
## - State_FL                               1    0.0169 25.616 -157860
## - Collections_12Mo_Exclude_Med           1    0.0177 25.617 -157859
## - pol_12                                 1    0.0178 25.617 -157859
## - State_NY                               1    0.0190 25.618 -157858
## - State_TN                               1    0.0203 25.619 -157857
## - Loan_Amount_Requested                  1    0.0220 25.621 -157855
## - Income_Verified_VERIFIED_incomesource  1    0.0400 25.639 -157839
## - Debt_To_Income                         1    0.0773 25.676 -157805
## - Annual_Income                          1    0.0895 25.689 -157794
## - Home_Owner_MORTGAGE                    1    0.1088 25.708 -157777
## - pol_13                                 1    0.1296 25.729 -157758
## - Total_Accounts                         1    0.1361 25.735 -157752
## - Revolving_Balance                      1    0.1396 25.739 -157749
## - Number_Open_Accounts                   1    0.1917 25.791 -157702
## - Income_Verified_VERIFIED_income        1    0.4075 26.007 -157509
## - Public_Record_Count                    1    0.4402 26.039 -157479
## - Number_Delinqueny_2yrs                 1    0.4741 26.073 -157449
## - Inquiries_Last_6Mo                     1    2.4054 28.004 -155791
## - Revolving_Utilization                  1    4.4278 30.027 -154174
## - Initial_Loan_Term_Months_36months      1    6.2499 31.849 -152807
## 
## Step:  AIC=-157874.8
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_AR + State_KS + State_OK + State_KY + 
##     State_LA + State_OR + State_SC + State_TN + State_NV + State_IN + 
##     State_CT + State_MN + State_CO + State_WA + State_AZ + State_MD + 
##     State_MA + State_MI + State_NC + State_GA + State_OH + State_PA + 
##     State_FL + State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_CT                               1    0.0002 25.599 -157877
## - State_OH                               1    0.0003 25.599 -157877
## - State_MN                               1    0.0006 25.600 -157876
## - State_CO                               1    0.0008 25.600 -157876
## - State_AR                               1    0.0008 25.600 -157876
## - State_PA                               1    0.0010 25.600 -157876
## - State_KS                               1    0.0010 25.600 -157876
## - State_OR                               1    0.0011 25.600 -157876
## - State_GA                               1    0.0012 25.600 -157876
## - State_KY                               1    0.0013 25.601 -157876
## - pol_11                                 1    0.0017 25.601 -157875
## - State_OK                               1    0.0020 25.601 -157875
## - State_HI                               1    0.0021 25.601 -157875
## <none>                                               25.599 -157875
## - State_MA                               1    0.0024 25.602 -157875
## - State_SC                               1    0.0026 25.602 -157875
## - State_NM                               1    0.0031 25.602 -157874
## - pol_10                                 1    0.0034 25.603 -157874
## - State_LA                               1    0.0037 25.603 -157873
## - State_IN                               1    0.0040 25.603 -157873
## - State_AZ                               1    0.0044 25.604 -157873
## - State_MD                               1    0.0046 25.604 -157873
## - State_TX                               1    0.0051 25.604 -157872
## - Length_Employed                        1    0.0065 25.606 -157871
## - State_WA                               1    0.0076 25.607 -157870
## - Home_Owner_RENT                        1    0.0078 25.607 -157870
## - State_MI                               1    0.0078 25.607 -157870
## - State_NV                               1    0.0092 25.608 -157868
## - State_NC                               1    0.0095 25.609 -157868
## - State_CA                               1    0.0125 25.612 -157866
## - `Home_Owner_N/A`                       1    0.0142 25.613 -157864
## - State_FL                               1    0.0170 25.616 -157861
## - Collections_12Mo_Exclude_Med           1    0.0177 25.617 -157861
## - pol_12                                 1    0.0178 25.617 -157861
## - State_NY                               1    0.0192 25.618 -157859
## - State_TN                               1    0.0201 25.619 -157859
## - Loan_Amount_Requested                  1    0.0220 25.621 -157857
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.639 -157840
## - Debt_To_Income                         1    0.0772 25.676 -157807
## - Annual_Income                          1    0.0895 25.689 -157796
## - Home_Owner_MORTGAGE                    1    0.1088 25.708 -157778
## - pol_13                                 1    0.1297 25.729 -157760
## - Total_Accounts                         1    0.1361 25.735 -157754
## - Revolving_Balance                      1    0.1396 25.739 -157751
## - Number_Open_Accounts                   1    0.1917 25.791 -157704
## - Income_Verified_VERIFIED_income        1    0.4077 26.007 -157510
## - Public_Record_Count                    1    0.4401 26.039 -157481
## - Number_Delinqueny_2yrs                 1    0.4742 26.073 -157451
## - Inquiries_Last_6Mo                     1    2.4054 28.005 -155793
## - Revolving_Utilization                  1    4.4276 30.027 -154176
## - Initial_Loan_Term_Months_36months      1    6.2506 31.850 -152808
## 
## Step:  AIC=-157876.7
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_AR + State_KS + State_OK + State_KY + 
##     State_LA + State_OR + State_SC + State_TN + State_NV + State_IN + 
##     State_MN + State_CO + State_WA + State_AZ + State_MD + State_MA + 
##     State_MI + State_NC + State_GA + State_OH + State_PA + State_FL + 
##     State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_OH                               1    0.0003 25.600 -157878
## - State_MN                               1    0.0005 25.600 -157878
## - State_CO                               1    0.0007 25.600 -157878
## - State_AR                               1    0.0008 25.600 -157878
## - State_PA                               1    0.0009 25.600 -157878
## - State_KS                               1    0.0010 25.600 -157878
## - State_OR                               1    0.0011 25.600 -157878
## - State_GA                               1    0.0011 25.600 -157878
## - State_KY                               1    0.0012 25.601 -157878
## - pol_11                                 1    0.0017 25.601 -157877
## - State_OK                               1    0.0019 25.601 -157877
## - State_HI                               1    0.0022 25.602 -157877
## <none>                                               25.599 -157877
## - State_SC                               1    0.0025 25.602 -157876
## - State_MA                               1    0.0026 25.602 -157876
## - State_NM                               1    0.0030 25.602 -157876
## - pol_10                                 1    0.0034 25.603 -157876
## - State_LA                               1    0.0036 25.603 -157875
## - State_IN                               1    0.0039 25.603 -157875
## - State_AZ                               1    0.0043 25.604 -157875
## - State_MD                               1    0.0044 25.604 -157875
## - State_TX                               1    0.0049 25.604 -157874
## - Length_Employed                        1    0.0065 25.606 -157873
## - State_WA                               1    0.0074 25.607 -157872
## - State_MI                               1    0.0077 25.607 -157872
## - Home_Owner_RENT                        1    0.0078 25.607 -157872
## - State_NV                               1    0.0091 25.608 -157870
## - State_NC                               1    0.0093 25.609 -157870
## - State_CA                               1    0.0123 25.612 -157867
## - `Home_Owner_N/A`                       1    0.0142 25.614 -157866
## - State_FL                               1    0.0168 25.616 -157863
## - Collections_12Mo_Exclude_Med           1    0.0177 25.617 -157863
## - pol_12                                 1    0.0178 25.617 -157863
## - State_NY                               1    0.0191 25.618 -157861
## - State_TN                               1    0.0199 25.619 -157861
## - Loan_Amount_Requested                  1    0.0220 25.621 -157859
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.640 -157842
## - Debt_To_Income                         1    0.0771 25.676 -157809
## - Annual_Income                          1    0.0895 25.689 -157798
## - Home_Owner_MORTGAGE                    1    0.1088 25.708 -157780
## - pol_13                                 1    0.1298 25.729 -157761
## - Total_Accounts                         1    0.1362 25.736 -157756
## - Revolving_Balance                      1    0.1394 25.739 -157753
## - Number_Open_Accounts                   1    0.1920 25.791 -157705
## - Income_Verified_VERIFIED_income        1    0.4077 26.007 -157512
## - Public_Record_Count                    1    0.4402 26.040 -157483
## - Number_Delinqueny_2yrs                 1    0.4745 26.074 -157453
## - Inquiries_Last_6Mo                     1    2.4056 28.005 -155795
## - Revolving_Utilization                  1    4.4284 30.028 -154177
## - Initial_Loan_Term_Months_36months      1    6.2509 31.850 -152810
## 
## Step:  AIC=-157878.4
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_AR + State_KS + State_OK + State_KY + 
##     State_LA + State_OR + State_SC + State_TN + State_NV + State_IN + 
##     State_MN + State_CO + State_WA + State_AZ + State_MD + State_MA + 
##     State_MI + State_NC + State_GA + State_PA + State_FL + State_TX + 
##     State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_MN                               1    0.0005 25.600 -157880
## - State_CO                               1    0.0006 25.600 -157880
## - State_AR                               1    0.0007 25.600 -157880
## - State_PA                               1    0.0008 25.600 -157880
## - State_KS                               1    0.0009 25.601 -157880
## - State_OR                               1    0.0010 25.601 -157880
## - State_GA                               1    0.0010 25.601 -157880
## - State_KY                               1    0.0012 25.601 -157879
## - pol_11                                 1    0.0017 25.601 -157879
## - State_OK                               1    0.0018 25.601 -157879
## <none>                                               25.600 -157878
## - State_HI                               1    0.0023 25.602 -157878
## - State_SC                               1    0.0024 25.602 -157878
## - State_MA                               1    0.0028 25.602 -157878
## - State_NM                               1    0.0029 25.603 -157878
## - pol_10                                 1    0.0034 25.603 -157877
## - State_LA                               1    0.0035 25.603 -157877
## - State_IN                               1    0.0038 25.603 -157877
## - State_AZ                               1    0.0041 25.604 -157877
## - State_MD                               1    0.0043 25.604 -157877
## - State_TX                               1    0.0046 25.604 -157876
## - Length_Employed                        1    0.0065 25.606 -157875
## - State_WA                               1    0.0072 25.607 -157874
## - State_MI                               1    0.0074 25.607 -157874
## - Home_Owner_RENT                        1    0.0077 25.607 -157873
## - State_NV                               1    0.0089 25.609 -157872
## - State_NC                               1    0.0090 25.609 -157872
## - State_CA                               1    0.0122 25.612 -157869
## - `Home_Owner_N/A`                       1    0.0142 25.614 -157868
## - State_FL                               1    0.0166 25.616 -157865
## - Collections_12Mo_Exclude_Med           1    0.0177 25.617 -157864
## - pol_12                                 1    0.0178 25.617 -157864
## - State_NY                               1    0.0190 25.619 -157863
## - State_TN                               1    0.0197 25.619 -157863
## - Loan_Amount_Requested                  1    0.0220 25.622 -157861
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.640 -157844
## - Debt_To_Income                         1    0.0773 25.677 -157810
## - Annual_Income                          1    0.0898 25.689 -157799
## - Home_Owner_MORTGAGE                    1    0.1087 25.708 -157782
## - pol_13                                 1    0.1298 25.729 -157763
## - Total_Accounts                         1    0.1367 25.736 -157757
## - Revolving_Balance                      1    0.1394 25.739 -157754
## - Number_Open_Accounts                   1    0.1923 25.792 -157707
## - Income_Verified_VERIFIED_income        1    0.4076 26.007 -157514
## - Public_Record_Count                    1    0.4407 26.040 -157484
## - Number_Delinqueny_2yrs                 1    0.4745 26.074 -157454
## - Inquiries_Last_6Mo                     1    2.4058 28.005 -155797
## - Revolving_Utilization                  1    4.4281 30.028 -154179
## - Initial_Loan_Term_Months_36months      1    6.2514 31.851 -152811
## 
## Step:  AIC=-157880
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_AR + State_KS + State_OK + State_KY + 
##     State_LA + State_OR + State_SC + State_TN + State_NV + State_IN + 
##     State_CO + State_WA + State_AZ + State_MD + State_MA + State_MI + 
##     State_NC + State_GA + State_PA + State_FL + State_TX + State_NY + 
##     State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_CO                               1    0.0006 25.601 -157882
## - State_AR                               1    0.0007 25.601 -157881
## - State_PA                               1    0.0007 25.601 -157881
## - State_KS                               1    0.0009 25.601 -157881
## - State_GA                               1    0.0009 25.601 -157881
## - State_OR                               1    0.0009 25.601 -157881
## - State_KY                               1    0.0011 25.601 -157881
## - pol_11                                 1    0.0017 25.602 -157880
## - State_OK                               1    0.0017 25.602 -157880
## <none>                                               25.600 -157880
## - State_SC                               1    0.0023 25.602 -157880
## - State_HI                               1    0.0023 25.602 -157880
## - State_NM                               1    0.0028 25.603 -157879
## - State_MA                               1    0.0030 25.603 -157879
## - State_LA                               1    0.0033 25.603 -157879
## - pol_10                                 1    0.0034 25.603 -157879
## - State_IN                               1    0.0036 25.604 -157879
## - State_AZ                               1    0.0039 25.604 -157878
## - State_MD                               1    0.0041 25.604 -157878
## - State_TX                               1    0.0043 25.604 -157878
## - Length_Employed                        1    0.0065 25.607 -157876
## - State_WA                               1    0.0070 25.607 -157876
## - State_MI                               1    0.0072 25.607 -157875
## - Home_Owner_RENT                        1    0.0078 25.608 -157875
## - State_NV                               1    0.0087 25.609 -157874
## - State_NC                               1    0.0088 25.609 -157874
## - State_CA                               1    0.0117 25.612 -157871
## - `Home_Owner_N/A`                       1    0.0141 25.614 -157869
## - State_FL                               1    0.0162 25.616 -157867
## - Collections_12Mo_Exclude_Med           1    0.0176 25.618 -157866
## - pol_12                                 1    0.0178 25.618 -157866
## - State_NY                               1    0.0185 25.619 -157865
## - State_TN                               1    0.0194 25.620 -157864
## - Loan_Amount_Requested                  1    0.0220 25.622 -157862
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.640 -157846
## - Debt_To_Income                         1    0.0772 25.677 -157812
## - Annual_Income                          1    0.0901 25.690 -157800
## - Home_Owner_MORTGAGE                    1    0.1085 25.709 -157784
## - pol_13                                 1    0.1296 25.730 -157765
## - Total_Accounts                         1    0.1365 25.737 -157759
## - Revolving_Balance                      1    0.1393 25.739 -157756
## - Number_Open_Accounts                   1    0.1924 25.792 -157708
## - Income_Verified_VERIFIED_income        1    0.4075 26.008 -157516
## - Public_Record_Count                    1    0.4405 26.041 -157486
## - Number_Delinqueny_2yrs                 1    0.4743 26.074 -157456
## - Inquiries_Last_6Mo                     1    2.4055 28.006 -155798
## - Revolving_Utilization                  1    4.4300 30.030 -154179
## - Initial_Loan_Term_Months_36months      1    6.2515 31.852 -152813
## 
## Step:  AIC=-157881.5
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_AR + State_KS + State_OK + State_KY + 
##     State_LA + State_OR + State_SC + State_TN + State_NV + State_IN + 
##     State_WA + State_AZ + State_MD + State_MA + State_MI + State_NC + 
##     State_GA + State_PA + State_FL + State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_PA                               1    0.0006 25.601 -157883
## - State_AR                               1    0.0006 25.601 -157883
## - State_GA                               1    0.0007 25.601 -157883
## - State_KS                               1    0.0008 25.601 -157883
## - State_OR                               1    0.0008 25.601 -157883
## - State_KY                               1    0.0010 25.602 -157883
## - State_OK                               1    0.0016 25.602 -157882
## - pol_11                                 1    0.0017 25.602 -157882
## - State_SC                               1    0.0021 25.603 -157882
## <none>                                               25.601 -157882
## - State_HI                               1    0.0024 25.603 -157881
## - State_NM                               1    0.0027 25.603 -157881
## - State_LA                               1    0.0032 25.604 -157881
## - State_MA                               1    0.0032 25.604 -157881
## - pol_10                                 1    0.0033 25.604 -157880
## - State_IN                               1    0.0035 25.604 -157880
## - State_AZ                               1    0.0037 25.604 -157880
## - State_MD                               1    0.0039 25.605 -157880
## - State_TX                               1    0.0040 25.605 -157880
## - Length_Employed                        1    0.0063 25.607 -157878
## - State_WA                               1    0.0067 25.607 -157877
## - State_MI                               1    0.0069 25.608 -157877
## - Home_Owner_RENT                        1    0.0078 25.608 -157876
## - State_NV                               1    0.0084 25.609 -157876
## - State_NC                               1    0.0085 25.609 -157876
## - State_CA                               1    0.0112 25.612 -157873
## - `Home_Owner_N/A`                       1    0.0141 25.615 -157871
## - State_FL                               1    0.0157 25.616 -157869
## - Collections_12Mo_Exclude_Med           1    0.0176 25.618 -157868
## - pol_12                                 1    0.0178 25.618 -157867
## - State_NY                               1    0.0180 25.619 -157867
## - State_TN                               1    0.0191 25.620 -157866
## - Loan_Amount_Requested                  1    0.0220 25.623 -157864
## - Income_Verified_VERIFIED_incomesource  1    0.0400 25.641 -157847
## - Debt_To_Income                         1    0.0773 25.678 -157814
## - Annual_Income                          1    0.0903 25.691 -157802
## - Home_Owner_MORTGAGE                    1    0.1084 25.709 -157785
## - pol_13                                 1    0.1297 25.730 -157766
## - Total_Accounts                         1    0.1363 25.737 -157760
## - Revolving_Balance                      1    0.1395 25.740 -157757
## - Number_Open_Accounts                   1    0.1921 25.793 -157710
## - Income_Verified_VERIFIED_income        1    0.4073 26.008 -157517
## - Public_Record_Count                    1    0.4409 26.042 -157487
## - Number_Delinqueny_2yrs                 1    0.4740 26.075 -157458
## - Inquiries_Last_6Mo                     1    2.4068 28.007 -155799
## - Revolving_Utilization                  1    4.4315 30.032 -154180
## - Initial_Loan_Term_Months_36months      1    6.2529 31.854 -152814
## 
## Step:  AIC=-157883
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_AR + State_KS + State_OK + State_KY + 
##     State_LA + State_OR + State_SC + State_TN + State_NV + State_IN + 
##     State_WA + State_AZ + State_MD + State_MA + State_MI + State_NC + 
##     State_GA + State_FL + State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_AR                               1    0.0006 25.602 -157884
## - State_GA                               1    0.0006 25.602 -157884
## - State_KS                               1    0.0007 25.602 -157884
## - State_OR                               1    0.0007 25.602 -157884
## - State_KY                               1    0.0009 25.602 -157884
## - State_OK                               1    0.0015 25.603 -157884
## - pol_11                                 1    0.0017 25.603 -157883
## - State_SC                               1    0.0020 25.603 -157883
## <none>                                               25.601 -157883
## - State_HI                               1    0.0025 25.604 -157883
## - State_NM                               1    0.0026 25.604 -157883
## - State_LA                               1    0.0030 25.604 -157882
## - State_IN                               1    0.0033 25.605 -157882
## - pol_10                                 1    0.0034 25.605 -157882
## - State_AZ                               1    0.0035 25.605 -157882
## - State_MA                               1    0.0035 25.605 -157882
## - State_MD                               1    0.0036 25.605 -157882
## - State_TX                               1    0.0036 25.605 -157882
## - Length_Employed                        1    0.0064 25.608 -157879
## - State_WA                               1    0.0064 25.608 -157879
## - State_MI                               1    0.0066 25.608 -157879
## - Home_Owner_RENT                        1    0.0078 25.609 -157878
## - State_NC                               1    0.0081 25.609 -157878
## - State_NV                               1    0.0081 25.609 -157878
## - State_CA                               1    0.0106 25.612 -157875
## - `Home_Owner_N/A`                       1    0.0141 25.615 -157872
## - State_FL                               1    0.0151 25.616 -157871
## - State_NY                               1    0.0174 25.619 -157869
## - Collections_12Mo_Exclude_Med           1    0.0176 25.619 -157869
## - pol_12                                 1    0.0179 25.619 -157869
## - State_TN                               1    0.0187 25.620 -157868
## - Loan_Amount_Requested                  1    0.0220 25.623 -157865
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.641 -157849
## - Debt_To_Income                         1    0.0774 25.679 -157815
## - Annual_Income                          1    0.0905 25.692 -157803
## - Home_Owner_MORTGAGE                    1    0.1085 25.710 -157787
## - pol_13                                 1    0.1296 25.731 -157768
## - Total_Accounts                         1    0.1363 25.738 -157762
## - Revolving_Balance                      1    0.1394 25.741 -157759
## - Number_Open_Accounts                   1    0.1922 25.793 -157711
## - Income_Verified_VERIFIED_income        1    0.4075 26.009 -157519
## - Public_Record_Count                    1    0.4409 26.042 -157489
## - Number_Delinqueny_2yrs                 1    0.4739 26.075 -157459
## - Inquiries_Last_6Mo                     1    2.4077 28.009 -155800
## - Revolving_Utilization                  1    4.4309 30.032 -154182
## - Initial_Loan_Term_Months_36months      1    6.2535 31.855 -152815
## 
## Step:  AIC=-157884.5
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_KS + State_OK + State_KY + State_LA + 
##     State_OR + State_SC + State_TN + State_NV + State_IN + State_WA + 
##     State_AZ + State_MD + State_MA + State_MI + State_NC + State_GA + 
##     State_FL + State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_GA                               1    0.0006 25.602 -157886
## - State_KS                               1    0.0007 25.603 -157886
## - State_OR                               1    0.0007 25.603 -157886
## - State_KY                               1    0.0009 25.603 -157886
## - State_OK                               1    0.0015 25.603 -157885
## - pol_11                                 1    0.0017 25.604 -157885
## - State_SC                               1    0.0019 25.604 -157885
## <none>                                               25.602 -157884
## - State_NM                               1    0.0026 25.604 -157884
## - State_HI                               1    0.0026 25.604 -157884
## - State_LA                               1    0.0030 25.605 -157884
## - State_IN                               1    0.0032 25.605 -157884
## - pol_10                                 1    0.0033 25.605 -157883
## - State_AZ                               1    0.0034 25.605 -157883
## - State_TX                               1    0.0034 25.605 -157883
## - State_MD                               1    0.0035 25.605 -157883
## - State_MA                               1    0.0037 25.605 -157883
## - State_WA                               1    0.0063 25.608 -157881
## - Length_Employed                        1    0.0063 25.608 -157881
## - State_MI                               1    0.0064 25.608 -157881
## - Home_Owner_RENT                        1    0.0077 25.610 -157880
## - State_NC                               1    0.0079 25.610 -157879
## - State_NV                               1    0.0080 25.610 -157879
## - State_CA                               1    0.0103 25.612 -157877
## - `Home_Owner_N/A`                       1    0.0142 25.616 -157874
## - State_FL                               1    0.0148 25.617 -157873
## - State_NY                               1    0.0170 25.619 -157871
## - Collections_12Mo_Exclude_Med           1    0.0176 25.619 -157870
## - pol_12                                 1    0.0179 25.620 -157870
## - State_TN                               1    0.0185 25.620 -157870
## - Loan_Amount_Requested                  1    0.0219 25.624 -157867
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.642 -157850
## - Debt_To_Income                         1    0.0776 25.679 -157816
## - Annual_Income                          1    0.0906 25.692 -157805
## - Home_Owner_MORTGAGE                    1    0.1087 25.711 -157788
## - pol_13                                 1    0.1297 25.732 -157769
## - Total_Accounts                         1    0.1363 25.738 -157763
## - Revolving_Balance                      1    0.1396 25.741 -157760
## - Number_Open_Accounts                   1    0.1921 25.794 -157713
## - Income_Verified_VERIFIED_income        1    0.4077 26.010 -157520
## - Public_Record_Count                    1    0.4408 26.043 -157490
## - Number_Delinqueny_2yrs                 1    0.4737 26.076 -157461
## - Inquiries_Last_6Mo                     1    2.4089 28.011 -155800
## - Revolving_Utilization                  1    4.4310 30.033 -154183
## - Initial_Loan_Term_Months_36months      1    6.2529 31.855 -152817
## 
## Step:  AIC=-157886
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_KS + State_OK + State_KY + State_LA + 
##     State_OR + State_SC + State_TN + State_NV + State_IN + State_WA + 
##     State_AZ + State_MD + State_MA + State_MI + State_NC + State_FL + 
##     State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_KS                               1    0.0006 25.603 -157887
## - State_OR                               1    0.0006 25.603 -157887
## - State_KY                               1    0.0008 25.603 -157887
## - State_OK                               1    0.0014 25.604 -157887
## - pol_11                                 1    0.0017 25.604 -157886
## - State_SC                               1    0.0018 25.604 -157886
## <none>                                               25.602 -157886
## - State_NM                               1    0.0025 25.605 -157886
## - State_HI                               1    0.0027 25.605 -157886
## - State_LA                               1    0.0028 25.605 -157885
## - State_IN                               1    0.0030 25.605 -157885
## - State_TX                               1    0.0031 25.606 -157885
## - State_AZ                               1    0.0032 25.606 -157885
## - State_MD                               1    0.0033 25.606 -157885
## - pol_10                                 1    0.0034 25.606 -157885
## - State_MA                               1    0.0039 25.606 -157884
## - State_WA                               1    0.0060 25.608 -157882
## - State_MI                               1    0.0061 25.609 -157882
## - Length_Employed                        1    0.0063 25.609 -157882
## - State_NC                               1    0.0076 25.610 -157881
## - Home_Owner_RENT                        1    0.0076 25.610 -157881
## - State_NV                               1    0.0078 25.610 -157881
## - State_CA                               1    0.0098 25.612 -157879
## - `Home_Owner_N/A`                       1    0.0142 25.617 -157875
## - State_FL                               1    0.0143 25.617 -157875
## - State_NY                               1    0.0165 25.619 -157873
## - Collections_12Mo_Exclude_Med           1    0.0177 25.620 -157872
## - pol_12                                 1    0.0179 25.620 -157872
## - State_TN                               1    0.0182 25.621 -157871
## - Loan_Amount_Requested                  1    0.0219 25.624 -157868
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.642 -157852
## - Debt_To_Income                         1    0.0777 25.680 -157818
## - Annual_Income                          1    0.0905 25.693 -157806
## - Home_Owner_MORTGAGE                    1    0.1086 25.711 -157790
## - pol_13                                 1    0.1298 25.732 -157771
## - Total_Accounts                         1    0.1363 25.739 -157765
## - Revolving_Balance                      1    0.1396 25.742 -157762
## - Number_Open_Accounts                   1    0.1920 25.794 -157715
## - Income_Verified_VERIFIED_income        1    0.4076 26.010 -157522
## - Public_Record_Count                    1    0.4413 26.044 -157491
## - Number_Delinqueny_2yrs                 1    0.4745 26.077 -157462
## - Inquiries_Last_6Mo                     1    2.4087 28.011 -155802
## - Revolving_Utilization                  1    4.4305 30.033 -154185
## - Initial_Loan_Term_Months_36months      1    6.2527 31.855 -152819
## 
## Step:  AIC=-157887.4
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_OK + State_KY + State_LA + State_OR + 
##     State_SC + State_TN + State_NV + State_IN + State_WA + State_AZ + 
##     State_MD + State_MA + State_MI + State_NC + State_FL + State_TX + 
##     State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_OR                               1    0.0006 25.604 -157889
## - State_KY                               1    0.0008 25.604 -157889
## - State_OK                               1    0.0013 25.604 -157888
## - pol_11                                 1    0.0017 25.605 -157888
## - State_SC                               1    0.0017 25.605 -157888
## <none>                                               25.603 -157887
## - State_NM                               1    0.0024 25.605 -157887
## - State_HI                               1    0.0027 25.606 -157887
## - State_LA                               1    0.0028 25.606 -157887
## - State_IN                               1    0.0029 25.606 -157887
## - State_TX                               1    0.0030 25.606 -157887
## - State_AZ                               1    0.0031 25.606 -157887
## - State_MD                               1    0.0032 25.606 -157886
## - pol_10                                 1    0.0034 25.606 -157886
## - State_MA                               1    0.0040 25.607 -157886
## - State_WA                               1    0.0059 25.609 -157884
## - State_MI                               1    0.0060 25.609 -157884
## - Length_Employed                        1    0.0063 25.609 -157884
## - State_NC                               1    0.0075 25.610 -157883
## - Home_Owner_RENT                        1    0.0076 25.611 -157882
## - State_NV                               1    0.0077 25.611 -157882
## - State_CA                               1    0.0095 25.612 -157881
## - State_FL                               1    0.0140 25.617 -157877
## - `Home_Owner_N/A`                       1    0.0141 25.617 -157877
## - State_NY                               1    0.0162 25.619 -157875
## - Collections_12Mo_Exclude_Med           1    0.0176 25.621 -157873
## - pol_12                                 1    0.0178 25.621 -157873
## - State_TN                               1    0.0180 25.621 -157873
## - Loan_Amount_Requested                  1    0.0220 25.625 -157869
## - Income_Verified_VERIFIED_incomesource  1    0.0400 25.643 -157853
## - Debt_To_Income                         1    0.0778 25.681 -157819
## - Annual_Income                          1    0.0907 25.694 -157807
## - Home_Owner_MORTGAGE                    1    0.1084 25.711 -157791
## - pol_13                                 1    0.1298 25.733 -157772
## - Total_Accounts                         1    0.1361 25.739 -157766
## - Revolving_Balance                      1    0.1397 25.743 -157763
## - Number_Open_Accounts                   1    0.1916 25.795 -157716
## - Income_Verified_VERIFIED_income        1    0.4073 26.010 -157523
## - Public_Record_Count                    1    0.4410 26.044 -157493
## - Number_Delinqueny_2yrs                 1    0.4741 26.077 -157464
## - Inquiries_Last_6Mo                     1    2.4086 28.012 -155803
## - Revolving_Utilization                  1    4.4300 30.033 -154187
## - Initial_Loan_Term_Months_36months      1    6.2521 31.855 -152820
## 
## Step:  AIC=-157888.9
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_OK + State_KY + State_LA + State_SC + 
##     State_TN + State_NV + State_IN + State_WA + State_AZ + State_MD + 
##     State_MA + State_MI + State_NC + State_FL + State_TX + State_NY + 
##     State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_KY                               1    0.0007 25.604 -157890
## - State_OK                               1    0.0013 25.605 -157890
## - State_SC                               1    0.0017 25.605 -157889
## - pol_11                                 1    0.0017 25.605 -157889
## <none>                                               25.604 -157889
## - State_NM                               1    0.0024 25.606 -157889
## - State_LA                               1    0.0027 25.606 -157888
## - State_HI                               1    0.0028 25.606 -157888
## - State_TX                               1    0.0028 25.606 -157888
## - State_IN                               1    0.0028 25.606 -157888
## - State_AZ                               1    0.0030 25.607 -157888
## - State_MD                               1    0.0031 25.607 -157888
## - pol_10                                 1    0.0034 25.607 -157888
## - State_MA                               1    0.0042 25.608 -157887
## - State_WA                               1    0.0058 25.609 -157886
## - State_MI                               1    0.0058 25.609 -157886
## - Length_Employed                        1    0.0063 25.610 -157885
## - State_NC                               1    0.0073 25.611 -157884
## - State_NV                               1    0.0075 25.611 -157884
## - Home_Owner_RENT                        1    0.0077 25.611 -157884
## - State_CA                               1    0.0091 25.613 -157883
## - State_FL                               1    0.0137 25.617 -157878
## - `Home_Owner_N/A`                       1    0.0141 25.618 -157878
## - State_NY                               1    0.0158 25.619 -157877
## - Collections_12Mo_Exclude_Med           1    0.0176 25.621 -157875
## - pol_12                                 1    0.0177 25.621 -157875
## - State_TN                               1    0.0178 25.621 -157875
## - Loan_Amount_Requested                  1    0.0220 25.626 -157871
## - Income_Verified_VERIFIED_incomesource  1    0.0400 25.644 -157855
## - Debt_To_Income                         1    0.0777 25.681 -157821
## - Annual_Income                          1    0.0909 25.695 -157809
## - Home_Owner_MORTGAGE                    1    0.1083 25.712 -157793
## - pol_13                                 1    0.1297 25.733 -157774
## - Total_Accounts                         1    0.1362 25.740 -157768
## - Revolving_Balance                      1    0.1397 25.743 -157765
## - Number_Open_Accounts                   1    0.1913 25.795 -157718
## - Income_Verified_VERIFIED_income        1    0.4074 26.011 -157525
## - Public_Record_Count                    1    0.4408 26.044 -157495
## - Number_Delinqueny_2yrs                 1    0.4741 26.078 -157465
## - Inquiries_Last_6Mo                     1    2.4081 28.012 -155805
## - Revolving_Utilization                  1    4.4295 30.033 -154189
## - Initial_Loan_Term_Months_36months      1    6.2515 31.855 -152822
## 
## Step:  AIC=-157890.2
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_OK + State_LA + State_SC + State_TN + 
##     State_NV + State_IN + State_WA + State_AZ + State_MD + State_MA + 
##     State_MI + State_NC + State_FL + State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_OK                               1    0.0012 25.606 -157891
## - State_SC                               1    0.0016 25.606 -157891
## - pol_11                                 1    0.0017 25.606 -157891
## <none>                                               25.604 -157890
## - State_NM                               1    0.0023 25.607 -157890
## - State_TX                               1    0.0026 25.607 -157890
## - State_LA                               1    0.0026 25.607 -157890
## - State_IN                               1    0.0027 25.607 -157890
## - State_HI                               1    0.0028 25.607 -157890
## - State_AZ                               1    0.0029 25.607 -157890
## - State_MD                               1    0.0030 25.607 -157889
## - pol_10                                 1    0.0033 25.608 -157889
## - State_MA                               1    0.0043 25.609 -157888
## - State_WA                               1    0.0056 25.610 -157887
## - State_MI                               1    0.0057 25.610 -157887
## - Length_Employed                        1    0.0063 25.611 -157886
## - State_NC                               1    0.0071 25.611 -157886
## - State_NV                               1    0.0074 25.612 -157885
## - Home_Owner_RENT                        1    0.0076 25.612 -157885
## - State_CA                               1    0.0088 25.613 -157884
## - State_FL                               1    0.0134 25.618 -157880
## - `Home_Owner_N/A`                       1    0.0141 25.618 -157879
## - State_NY                               1    0.0155 25.620 -157878
## - Collections_12Mo_Exclude_Med           1    0.0176 25.622 -157876
## - State_TN                               1    0.0176 25.622 -157876
## - pol_12                                 1    0.0177 25.622 -157876
## - Loan_Amount_Requested                  1    0.0219 25.626 -157872
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.644 -157856
## - Debt_To_Income                         1    0.0781 25.682 -157821
## - Annual_Income                          1    0.0910 25.695 -157810
## - Home_Owner_MORTGAGE                    1    0.1082 25.713 -157794
## - pol_13                                 1    0.1297 25.734 -157775
## - Total_Accounts                         1    0.1359 25.740 -157769
## - Revolving_Balance                      1    0.1399 25.744 -157766
## - Number_Open_Accounts                   1    0.1910 25.795 -157720
## - Income_Verified_VERIFIED_income        1    0.4073 26.012 -157526
## - Public_Record_Count                    1    0.4407 26.045 -157496
## - Number_Delinqueny_2yrs                 1    0.4743 26.079 -157466
## - Inquiries_Last_6Mo                     1    2.4082 28.013 -155807
## - Revolving_Utilization                  1    4.4289 30.033 -154191
## - Initial_Loan_Term_Months_36months      1    6.2529 31.857 -152823
## 
## Step:  AIC=-157891.1
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_LA + State_SC + State_TN + State_NV + 
##     State_IN + State_WA + State_AZ + State_MD + State_MA + State_MI + 
##     State_NC + State_FL + State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_SC                               1    0.0015 25.607 -157892
## - pol_11                                 1    0.0017 25.607 -157891
## <none>                                               25.606 -157891
## - State_NM                               1    0.0022 25.608 -157891
## - State_TX                               1    0.0024 25.608 -157891
## - State_LA                               1    0.0025 25.608 -157891
## - State_IN                               1    0.0026 25.608 -157891
## - State_AZ                               1    0.0028 25.608 -157891
## - State_HI                               1    0.0029 25.608 -157890
## - State_MD                               1    0.0029 25.608 -157890
## - pol_10                                 1    0.0034 25.609 -157890
## - State_MA                               1    0.0045 25.610 -157889
## - State_WA                               1    0.0054 25.611 -157888
## - State_MI                               1    0.0055 25.611 -157888
## - Length_Employed                        1    0.0062 25.612 -157887
## - State_NC                               1    0.0069 25.612 -157887
## - State_NV                               1    0.0072 25.613 -157887
## - Home_Owner_RENT                        1    0.0075 25.613 -157886
## - State_CA                               1    0.0083 25.614 -157886
## - State_FL                               1    0.0129 25.619 -157881
## - `Home_Owner_N/A`                       1    0.0141 25.620 -157880
## - State_NY                               1    0.0150 25.621 -157879
## - State_TN                               1    0.0174 25.623 -157877
## - Collections_12Mo_Exclude_Med           1    0.0176 25.623 -157877
## - pol_12                                 1    0.0178 25.623 -157877
## - Loan_Amount_Requested                  1    0.0221 25.628 -157873
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.646 -157857
## - Debt_To_Income                         1    0.0784 25.684 -157822
## - Annual_Income                          1    0.0912 25.697 -157811
## - Home_Owner_MORTGAGE                    1    0.1083 25.714 -157795
## - pol_13                                 1    0.1294 25.735 -157776
## - Total_Accounts                         1    0.1359 25.741 -157770
## - Revolving_Balance                      1    0.1401 25.746 -157766
## - Number_Open_Accounts                   1    0.1906 25.796 -157721
## - Income_Verified_VERIFIED_income        1    0.4073 26.013 -157527
## - Public_Record_Count                    1    0.4405 26.046 -157497
## - Number_Delinqueny_2yrs                 1    0.4743 26.080 -157467
## - Inquiries_Last_6Mo                     1    2.4084 28.014 -155808
## - Revolving_Utilization                  1    4.4295 30.035 -154191
## - Initial_Loan_Term_Months_36months      1    6.2544 31.860 -152823
## 
## Step:  AIC=-157891.7
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_11 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_LA + State_TN + State_NV + State_IN + 
##     State_WA + State_AZ + State_MD + State_MA + State_MI + State_NC + 
##     State_FL + State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - pol_11                                 1    0.0017 25.609 -157892
## - State_TX                               1    0.0021 25.609 -157892
## - State_NM                               1    0.0022 25.609 -157892
## <none>                                               25.607 -157892
## - State_LA                               1    0.0024 25.610 -157891
## - State_IN                               1    0.0025 25.610 -157891
## - State_AZ                               1    0.0026 25.610 -157891
## - State_MD                               1    0.0027 25.610 -157891
## - State_HI                               1    0.0030 25.610 -157891
## - pol_10                                 1    0.0033 25.610 -157891
## - State_MA                               1    0.0047 25.612 -157889
## - State_WA                               1    0.0052 25.612 -157889
## - State_MI                               1    0.0052 25.612 -157889
## - Length_Employed                        1    0.0061 25.613 -157888
## - State_NC                               1    0.0066 25.614 -157888
## - State_NV                               1    0.0070 25.614 -157887
## - Home_Owner_RENT                        1    0.0075 25.615 -157887
## - State_CA                               1    0.0078 25.615 -157887
## - State_FL                               1    0.0124 25.620 -157882
## - `Home_Owner_N/A`                       1    0.0141 25.621 -157881
## - State_NY                               1    0.0144 25.622 -157881
## - State_TN                               1    0.0171 25.624 -157878
## - Collections_12Mo_Exclude_Med           1    0.0176 25.625 -157878
## - pol_12                                 1    0.0178 25.625 -157878
## - Loan_Amount_Requested                  1    0.0220 25.629 -157874
## - Income_Verified_VERIFIED_incomesource  1    0.0401 25.647 -157857
## - Debt_To_Income                         1    0.0786 25.686 -157823
## - Annual_Income                          1    0.0913 25.698 -157811
## - Home_Owner_MORTGAGE                    1    0.1082 25.715 -157796
## - pol_13                                 1    0.1297 25.737 -157776
## - Total_Accounts                         1    0.1358 25.743 -157771
## - Revolving_Balance                      1    0.1402 25.747 -157767
## - Number_Open_Accounts                   1    0.1904 25.797 -157722
## - Income_Verified_VERIFIED_income        1    0.4073 26.014 -157528
## - Public_Record_Count                    1    0.4404 26.047 -157498
## - Number_Delinqueny_2yrs                 1    0.4740 26.081 -157468
## - Inquiries_Last_6Mo                     1    2.4069 28.014 -155810
## - Revolving_Utilization                  1    4.4291 30.036 -154193
## - Initial_Loan_Term_Months_36months      1    6.2555 31.863 -152823
## 
## Step:  AIC=-157892.1
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_LA + State_TN + State_NV + State_IN + 
##     State_WA + State_AZ + State_MD + State_MA + State_MI + State_NC + 
##     State_FL + State_TX + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_TX                               1    0.0022 25.611 -157892
## - State_NM                               1    0.0022 25.611 -157892
## <none>                                               25.609 -157892
## - State_LA                               1    0.0024 25.611 -157892
## - State_IN                               1    0.0025 25.611 -157892
## - State_AZ                               1    0.0026 25.611 -157892
## - State_MD                               1    0.0027 25.612 -157892
## - State_HI                               1    0.0030 25.612 -157891
## - pol_10                                 1    0.0034 25.612 -157891
## - State_MA                               1    0.0047 25.614 -157890
## - State_WA                               1    0.0052 25.614 -157889
## - State_MI                               1    0.0053 25.614 -157889
## - Length_Employed                        1    0.0061 25.615 -157889
## - State_NC                               1    0.0066 25.615 -157888
## - State_NV                               1    0.0070 25.616 -157888
## - Home_Owner_RENT                        1    0.0073 25.616 -157888
## - State_CA                               1    0.0078 25.617 -157887
## - State_FL                               1    0.0125 25.621 -157883
## - `Home_Owner_N/A`                       1    0.0143 25.623 -157881
## - State_NY                               1    0.0144 25.623 -157881
## - pol_12                                 1    0.0168 25.626 -157879
## - State_TN                               1    0.0170 25.626 -157879
## - Collections_12Mo_Exclude_Med           1    0.0175 25.626 -157878
## - Loan_Amount_Requested                  1    0.0208 25.630 -157875
## - Income_Verified_VERIFIED_incomesource  1    0.0400 25.649 -157858
## - Debt_To_Income                         1    0.0778 25.687 -157824
## - Annual_Income                          1    0.0902 25.699 -157813
## - Home_Owner_MORTGAGE                    1    0.1087 25.718 -157796
## - Total_Accounts                         1    0.1359 25.745 -157771
## - pol_13                                 1    0.1372 25.746 -157770
## - Revolving_Balance                      1    0.1398 25.749 -157768
## - Number_Open_Accounts                   1    0.1895 25.798 -157723
## - Income_Verified_VERIFIED_income        1    0.4076 26.016 -157528
## - Public_Record_Count                    1    0.4392 26.048 -157500
## - Number_Delinqueny_2yrs                 1    0.4734 26.082 -157469
## - Inquiries_Last_6Mo                     1    2.4076 28.016 -155809
## - Revolving_Utilization                  1    4.4497 30.059 -154177
## - Initial_Loan_Term_Months_36months      1    6.2620 31.871 -152819
## 
## Step:  AIC=-157892.1
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_NM + State_LA + State_TN + State_NV + State_IN + 
##     State_WA + State_AZ + State_MD + State_MA + State_MI + State_NC + 
##     State_FL + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_NM                               1    0.0020 25.613 -157892
## - State_LA                               1    0.0021 25.613 -157892
## - State_IN                               1    0.0022 25.613 -157892
## - State_AZ                               1    0.0022 25.613 -157892
## <none>                                               25.611 -157892
## - State_MD                               1    0.0023 25.613 -157892
## - State_HI                               1    0.0032 25.614 -157891
## - pol_10                                 1    0.0035 25.614 -157891
## - State_MI                               1    0.0047 25.616 -157890
## - State_WA                               1    0.0047 25.616 -157890
## - State_MA                               1    0.0054 25.616 -157889
## - Length_Employed                        1    0.0059 25.617 -157889
## - State_NC                               1    0.0060 25.617 -157889
## - State_NV                               1    0.0065 25.617 -157888
## - State_CA                               1    0.0065 25.618 -157888
## - Home_Owner_RENT                        1    0.0071 25.618 -157888
## - State_FL                               1    0.0112 25.622 -157884
## - State_NY                               1    0.0130 25.624 -157882
## - `Home_Owner_N/A`                       1    0.0145 25.625 -157881
## - State_TN                               1    0.0162 25.627 -157879
## - pol_12                                 1    0.0169 25.628 -157879
## - Collections_12Mo_Exclude_Med           1    0.0176 25.629 -157878
## - Loan_Amount_Requested                  1    0.0211 25.632 -157875
## - Income_Verified_VERIFIED_incomesource  1    0.0403 25.651 -157858
## - Debt_To_Income                         1    0.0790 25.690 -157823
## - Annual_Income                          1    0.0896 25.701 -157813
## - Home_Owner_MORTGAGE                    1    0.1091 25.720 -157796
## - Total_Accounts                         1    0.1356 25.747 -157772
## - pol_13                                 1    0.1374 25.748 -157770
## - Revolving_Balance                      1    0.1410 25.752 -157767
## - Number_Open_Accounts                   1    0.1892 25.800 -157723
## - Income_Verified_VERIFIED_income        1    0.4081 26.019 -157527
## - Public_Record_Count                    1    0.4373 26.048 -157501
## - Number_Delinqueny_2yrs                 1    0.4730 26.084 -157470
## - Inquiries_Last_6Mo                     1    2.4059 28.017 -155811
## - Revolving_Utilization                  1    4.4475 30.059 -154179
## - Initial_Loan_Term_Months_36months      1    6.2599 31.871 -152821
## 
## Step:  AIC=-157892.4
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_LA + State_TN + State_NV + State_IN + State_WA + 
##     State_AZ + State_MD + State_MA + State_MI + State_NC + State_FL + 
##     State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_LA                               1    0.0021 25.615 -157892
## - State_AZ                               1    0.0021 25.615 -157892
## - State_IN                               1    0.0021 25.615 -157892
## <none>                                               25.613 -157892
## - State_MD                               1    0.0022 25.615 -157892
## - State_HI                               1    0.0032 25.616 -157891
## - pol_10                                 1    0.0035 25.616 -157891
## - State_MI                               1    0.0045 25.618 -157890
## - State_WA                               1    0.0046 25.618 -157890
## - State_MA                               1    0.0055 25.619 -157889
## - State_NC                               1    0.0058 25.619 -157889
## - Length_Employed                        1    0.0059 25.619 -157889
## - State_CA                               1    0.0062 25.619 -157889
## - State_NV                               1    0.0064 25.619 -157889
## - Home_Owner_RENT                        1    0.0070 25.620 -157888
## - State_FL                               1    0.0109 25.624 -157884
## - State_NY                               1    0.0126 25.626 -157883
## - `Home_Owner_N/A`                       1    0.0146 25.628 -157881
## - State_TN                               1    0.0160 25.629 -157880
## - pol_12                                 1    0.0169 25.630 -157879
## - Collections_12Mo_Exclude_Med           1    0.0176 25.631 -157878
## - Loan_Amount_Requested                  1    0.0211 25.634 -157875
## - Income_Verified_VERIFIED_incomesource  1    0.0404 25.653 -157858
## - Debt_To_Income                         1    0.0794 25.692 -157823
## - Annual_Income                          1    0.0895 25.702 -157813
## - Home_Owner_MORTGAGE                    1    0.1093 25.722 -157796
## - Total_Accounts                         1    0.1358 25.749 -157772
## - pol_13                                 1    0.1374 25.750 -157770
## - Revolving_Balance                      1    0.1413 25.754 -157767
## - Number_Open_Accounts                   1    0.1890 25.802 -157724
## - Income_Verified_VERIFIED_income        1    0.4085 26.022 -157527
## - Public_Record_Count                    1    0.4380 26.051 -157501
## - Number_Delinqueny_2yrs                 1    0.4727 26.086 -157470
## - Inquiries_Last_6Mo                     1    2.4057 28.019 -155812
## - Revolving_Utilization                  1    4.4474 30.060 -154180
## - Initial_Loan_Term_Months_36months      1    6.2583 31.871 -152823
## 
## Step:  AIC=-157892.5
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_TN + State_NV + State_IN + State_WA + State_AZ + 
##     State_MD + State_MA + State_MI + State_NC + State_FL + State_NY + 
##     State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_AZ                               1    0.0020 25.617 -157893
## - State_IN                               1    0.0020 25.617 -157893
## - State_MD                               1    0.0021 25.617 -157893
## <none>                                               25.615 -157892
## - State_HI                               1    0.0033 25.618 -157891
## - pol_10                                 1    0.0035 25.619 -157891
## - State_MI                               1    0.0043 25.619 -157891
## - State_WA                               1    0.0044 25.619 -157891
## - State_NC                               1    0.0056 25.621 -157889
## - State_CA                               1    0.0057 25.621 -157889
## - State_MA                               1    0.0058 25.621 -157889
## - Length_Employed                        1    0.0058 25.621 -157889
## - State_NV                               1    0.0062 25.621 -157889
## - Home_Owner_RENT                        1    0.0069 25.622 -157888
## - State_FL                               1    0.0105 25.626 -157885
## - State_NY                               1    0.0121 25.627 -157883
## - `Home_Owner_N/A`                       1    0.0146 25.630 -157881
## - State_TN                               1    0.0158 25.631 -157880
## - pol_12                                 1    0.0169 25.632 -157879
## - Collections_12Mo_Exclude_Med           1    0.0175 25.633 -157879
## - Loan_Amount_Requested                  1    0.0211 25.636 -157875
## - Income_Verified_VERIFIED_incomesource  1    0.0402 25.655 -157858
## - Debt_To_Income                         1    0.0798 25.695 -157822
## - Annual_Income                          1    0.0894 25.704 -157814
## - Home_Owner_MORTGAGE                    1    0.1098 25.725 -157795
## - Total_Accounts                         1    0.1353 25.750 -157772
## - pol_13                                 1    0.1377 25.753 -157770
## - Revolving_Balance                      1    0.1416 25.757 -157767
## - Number_Open_Accounts                   1    0.1880 25.803 -157725
## - Income_Verified_VERIFIED_income        1    0.4083 26.023 -157528
## - Public_Record_Count                    1    0.4373 26.052 -157502
## - Number_Delinqueny_2yrs                 1    0.4726 26.088 -157470
## - Inquiries_Last_6Mo                     1    2.4040 28.019 -155813
## - Revolving_Utilization                  1    4.4454 30.060 -154182
## - Initial_Loan_Term_Months_36months      1    6.2620 31.877 -152820
## 
## Step:  AIC=-157892.7
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_TN + State_NV + State_IN + State_WA + State_MD + 
##     State_MA + State_MI + State_NC + State_FL + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_IN                               1    0.0019 25.619 -157893
## - State_MD                               1    0.0020 25.619 -157893
## <none>                                               25.617 -157893
## - State_HI                               1    0.0034 25.620 -157892
## - pol_10                                 1    0.0035 25.621 -157892
## - State_MI                               1    0.0041 25.621 -157891
## - State_WA                               1    0.0042 25.621 -157891
## - State_CA                               1    0.0052 25.622 -157890
## - State_NC                               1    0.0053 25.622 -157890
## - Length_Employed                        1    0.0058 25.623 -157889
## - State_NV                               1    0.0060 25.623 -157889
## - State_MA                               1    0.0061 25.623 -157889
## - Home_Owner_RENT                        1    0.0070 25.624 -157888
## - State_FL                               1    0.0099 25.627 -157886
## - State_NY                               1    0.0115 25.628 -157884
## - `Home_Owner_N/A`                       1    0.0146 25.632 -157882
## - State_TN                               1    0.0154 25.632 -157881
## - pol_12                                 1    0.0169 25.634 -157879
## - Collections_12Mo_Exclude_Med           1    0.0176 25.635 -157879
## - Loan_Amount_Requested                  1    0.0209 25.638 -157876
## - Income_Verified_VERIFIED_incomesource  1    0.0404 25.657 -157858
## - Debt_To_Income                         1    0.0798 25.697 -157823
## - Annual_Income                          1    0.0892 25.706 -157814
## - Home_Owner_MORTGAGE                    1    0.1097 25.727 -157796
## - Total_Accounts                         1    0.1351 25.752 -157773
## - pol_13                                 1    0.1379 25.755 -157770
## - Revolving_Balance                      1    0.1417 25.759 -157767
## - Number_Open_Accounts                   1    0.1876 25.805 -157725
## - Income_Verified_VERIFIED_income        1    0.4086 26.026 -157528
## - Public_Record_Count                    1    0.4369 26.054 -157502
## - Number_Delinqueny_2yrs                 1    0.4730 26.090 -157470
## - Inquiries_Last_6Mo                     1    2.4028 28.020 -155815
## - Revolving_Utilization                  1    4.4456 30.063 -154182
## - Initial_Loan_Term_Months_36months      1    6.2637 31.881 -152820
## 
## Step:  AIC=-157893
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_TN + State_NV + State_WA + State_MD + State_MA + 
##     State_MI + State_NC + State_FL + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## - State_MD                               1    0.0018 25.621 -157893
## <none>                                               25.619 -157893
## - State_HI                               1    0.0035 25.622 -157892
## - pol_10                                 1    0.0035 25.622 -157892
## - State_MI                               1    0.0039 25.623 -157892
## - State_WA                               1    0.0040 25.623 -157891
## - State_CA                               1    0.0048 25.624 -157891
## - State_NC                               1    0.0051 25.624 -157890
## - Length_Employed                        1    0.0058 25.625 -157890
## - State_NV                               1    0.0058 25.625 -157890
## - State_MA                               1    0.0063 25.625 -157889
## - Home_Owner_RENT                        1    0.0070 25.626 -157889
## - State_FL                               1    0.0095 25.628 -157886
## - State_NY                               1    0.0110 25.630 -157885
## - `Home_Owner_N/A`                       1    0.0146 25.633 -157882
## - State_TN                               1    0.0152 25.634 -157881
## - pol_12                                 1    0.0168 25.636 -157880
## - Collections_12Mo_Exclude_Med           1    0.0176 25.636 -157879
## - Loan_Amount_Requested                  1    0.0209 25.640 -157876
## - Income_Verified_VERIFIED_incomesource  1    0.0406 25.659 -157858
## - Debt_To_Income                         1    0.0799 25.699 -157823
## - Annual_Income                          1    0.0896 25.708 -157814
## - Home_Owner_MORTGAGE                    1    0.1094 25.728 -157796
## - Total_Accounts                         1    0.1352 25.754 -157773
## - pol_13                                 1    0.1376 25.756 -157771
## - Revolving_Balance                      1    0.1420 25.761 -157767
## - Number_Open_Accounts                   1    0.1875 25.806 -157726
## - Income_Verified_VERIFIED_income        1    0.4087 26.028 -157528
## - Public_Record_Count                    1    0.4386 26.057 -157501
## - Number_Delinqueny_2yrs                 1    0.4733 26.092 -157470
## - Inquiries_Last_6Mo                     1    2.4046 28.023 -155814
## - Revolving_Utilization                  1    4.4478 30.067 -154181
## - Initial_Loan_Term_Months_36months      1    6.2682 31.887 -152817
## 
## Step:  AIC=-157893.4
## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_TN + State_NV + State_WA + State_MA + State_MI + 
##     State_NC + State_FL + State_NY + State_CA
## 
##                                         Df Sum of Sq    RSS     AIC
## <none>                                               25.621 -157893
## - pol_10                                 1    0.0035 25.624 -157892
## - State_HI                               1    0.0036 25.624 -157892
## - State_MI                               1    0.0037 25.624 -157892
## - State_WA                               1    0.0038 25.624 -157892
## - State_CA                               1    0.0043 25.625 -157892
## - State_NC                               1    0.0048 25.625 -157891
## - State_NV                               1    0.0056 25.626 -157890
## - Length_Employed                        1    0.0058 25.626 -157890
## - State_MA                               1    0.0066 25.627 -157889
## - Home_Owner_RENT                        1    0.0071 25.628 -157889
## - State_FL                               1    0.0090 25.630 -157887
## - State_NY                               1    0.0104 25.631 -157886
## - `Home_Owner_N/A`                       1    0.0145 25.635 -157882
## - State_TN                               1    0.0149 25.636 -157882
## - pol_12                                 1    0.0169 25.638 -157880
## - Collections_12Mo_Exclude_Med           1    0.0176 25.638 -157879
## - Loan_Amount_Requested                  1    0.0209 25.642 -157876
## - Income_Verified_VERIFIED_incomesource  1    0.0406 25.661 -157859
## - Debt_To_Income                         1    0.0794 25.700 -157824
## - Annual_Income                          1    0.0891 25.710 -157815
## - Home_Owner_MORTGAGE                    1    0.1093 25.730 -157797
## - Total_Accounts                         1    0.1350 25.756 -157773
## - pol_13                                 1    0.1379 25.759 -157771
## - Revolving_Balance                      1    0.1418 25.763 -157767
## - Number_Open_Accounts                   1    0.1878 25.808 -157726
## - Income_Verified_VERIFIED_income        1    0.4095 26.030 -157528
## - Public_Record_Count                    1    0.4384 26.059 -157502
## - Number_Delinqueny_2yrs                 1    0.4738 26.094 -157470
## - Inquiries_Last_6Mo                     1    2.4032 28.024 -155815
## - Revolving_Utilization                  1    4.4509 30.072 -154179
## - Initial_Loan_Term_Months_36months      1    6.2693 31.890 -152817

check model summary to see the kept variables in the model

## 
## Call:
## lm(formula = Interest_Rate ~ Loan_Amount_Requested + Length_Employed + 
##     Annual_Income + Debt_To_Income + Number_Delinqueny_2yrs + 
##     Inquiries_Last_6Mo + Number_Open_Accounts + Public_Record_Count + 
##     Revolving_Balance + Revolving_Utilization + Total_Accounts + 
##     Collections_12Mo_Exclude_Med + pol_10 + pol_12 + pol_13 + 
##     Initial_Loan_Term_Months_36months + `Home_Owner_N/A` + Home_Owner_RENT + 
##     Home_Owner_MORTGAGE + Income_Verified_VERIFIED_incomesource + 
##     Income_Verified_VERIFIED_income + State_HI + State_TN + State_NV + 
##     State_WA + State_MA + State_MI + State_NC + State_FL + State_NY + 
##     State_CA, data = train1)
## 
## Residuals:
##       Min        1Q    Median        3Q       Max 
## -0.180224 -0.023644 -0.003194  0.020312  0.294128 
## 
## Coefficients:
##                                         Estimate Std. Error t value Pr(>|t|)
## (Intercept)                            1.127e-01  1.450e-03  77.713  < 2e-16
## Loan_Amount_Requested                  1.403e-07  3.230e-08   4.344 1.40e-05
## Length_Employed                        1.450e-04  6.353e-05   2.282 0.022502
## Annual_Income                         -5.016e-08  5.587e-09  -8.978  < 2e-16
## Debt_To_Income                         2.784e-04  3.285e-05   8.474  < 2e-16
## Number_Delinqueny_2yrs                 5.255e-03  2.539e-04  20.699  < 2e-16
## Inquiries_Last_6Mo                     9.839e-03  2.111e-04  46.617  < 2e-16
## Number_Open_Accounts                   8.042e-04  6.172e-05  13.032  < 2e-16
## Public_Record_Count                    8.728e-03  4.384e-04  19.910  < 2e-16
## Revolving_Balance                     -1.052e-07  9.290e-09 -11.325  < 2e-16
## Revolving_Utilization                  6.334e-02  9.984e-04  63.441  < 2e-16
## Total_Accounts                        -2.918e-04  2.641e-05 -11.049  < 2e-16
## Collections_12Mo_Exclude_Med           8.634e-03  2.166e-03   3.987 6.72e-05
## pol_10                                -1.272e-02  7.107e-03  -1.790 0.073507
## pol_12                                 3.459e-03  8.839e-04   3.913 9.14e-05
## pol_13                                -5.517e-03  4.941e-04 -11.166  < 2e-16
## Initial_Loan_Term_Months_36months     -4.014e-02  5.332e-04 -75.294  < 2e-16
## `Home_Owner_N/A`                      -3.472e-03  9.573e-04  -3.627 0.000288
## Home_Owner_RENT                        2.267e-03  8.971e-04   2.527 0.011507
## Home_Owner_MORTGAGE                   -8.442e-03  8.489e-04  -9.944  < 2e-16
## Income_Verified_VERIFIED_incomesource  3.600e-03  5.941e-04   6.060 1.38e-09
## Income_Verified_VERIFIED_income        1.131e-02  5.875e-04  19.243  < 2e-16
## State_HI                              -5.747e-03  3.190e-03  -1.802 0.071628
## State_TN                               7.154e-03  1.951e-03   3.667 0.000246
## State_NV                               4.253e-03  1.889e-03   2.251 0.024403
## State_WA                               2.775e-03  1.502e-03   1.848 0.064685
## State_MA                              -3.514e-03  1.438e-03  -2.444 0.014532
## State_MI                               2.480e-03  1.361e-03   1.822 0.068483
## State_NC                               2.810e-03  1.348e-03   2.084 0.037128
## State_FL                               2.632e-03  9.218e-04   2.856 0.004299
## State_NY                               2.527e-03  8.244e-04   3.066 0.002173
## State_CA                               1.283e-03  6.540e-04   1.962 0.049783
##                                          
## (Intercept)                           ***
## Loan_Amount_Requested                 ***
## Length_Employed                       *  
## Annual_Income                         ***
## Debt_To_Income                        ***
## Number_Delinqueny_2yrs                ***
## Inquiries_Last_6Mo                    ***
## Number_Open_Accounts                  ***
## Public_Record_Count                   ***
## Revolving_Balance                     ***
## Revolving_Utilization                 ***
## Total_Accounts                        ***
## Collections_12Mo_Exclude_Med          ***
## pol_10                                .  
## pol_12                                ***
## pol_13                                ***
## Initial_Loan_Term_Months_36months     ***
## `Home_Owner_N/A`                      ***
## Home_Owner_RENT                       *  
## Home_Owner_MORTGAGE                   ***
## Income_Verified_VERIFIED_incomesource ***
## Income_Verified_VERIFIED_income       ***
## State_HI                              .  
## State_TN                              ***
## State_NV                              *  
## State_WA                              .  
## State_MA                              *  
## State_MI                              .  
## State_NC                              *  
## State_FL                              ** 
## State_NY                              ** 
## State_CA                              *  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.03325 on 23168 degrees of freedom
## Multiple R-squared:  0.4421, Adjusted R-squared:  0.4413 
## F-statistic: 592.1 on 31 and 23168 DF,  p-value: < 2.2e-16

Imporving the performance of the model

It turns out there are still some vars for which p-value is higher than .05 . extract the exact formula using formula function.

## Interest_Rate ~ Loan_Amount_Requested + Length_Employed + Annual_Income + 
##     Debt_To_Income + Number_Delinqueny_2yrs + Inquiries_Last_6Mo + 
##     Number_Open_Accounts + Public_Record_Count + Revolving_Balance + 
##     Revolving_Utilization + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_10 + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_HI + State_TN + State_NV + State_WA + State_MA + State_MI + 
##     State_NC + State_FL + State_NY + State_CA

Drop variables p-value large than 0.05, train model again

## 
## Call:
## lm(formula = Interest_Rate ~ Loan_Amount_Requested + Length_Employed + 
##     Annual_Income + Debt_To_Income + Number_Delinqueny_2yrs + 
##     Inquiries_Last_6Mo + Number_Open_Accounts + Public_Record_Count + 
##     Revolving_Balance + Revolving_Utilization + Total_Accounts + 
##     Collections_12Mo_Exclude_Med + pol_12 + pol_13 + Initial_Loan_Term_Months_36months + 
##     `Home_Owner_N/A` + Home_Owner_RENT + Home_Owner_MORTGAGE + 
##     Income_Verified_VERIFIED_incomesource + Income_Verified_VERIFIED_income + 
##     State_TN + State_NV + State_MA + State_FL + State_NY, data = train1)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.18063 -0.02364 -0.00319  0.02029  0.29320 
## 
## Coefficients:
##                                         Estimate Std. Error t value Pr(>|t|)
## (Intercept)                            1.130e-01  1.443e-03  78.368  < 2e-16
## Loan_Amount_Requested                  1.403e-07  3.230e-08   4.343 1.41e-05
## Length_Employed                        1.491e-04  6.351e-05   2.347 0.018944
## Annual_Income                         -5.018e-08  5.584e-09  -8.986  < 2e-16
## Debt_To_Income                         2.748e-04  3.276e-05   8.389  < 2e-16
## Number_Delinqueny_2yrs                 5.254e-03  2.539e-04  20.691  < 2e-16
## Inquiries_Last_6Mo                     9.828e-03  2.109e-04  46.591  < 2e-16
## Number_Open_Accounts                   8.084e-04  6.171e-05  13.099  < 2e-16
## Public_Record_Count                    8.729e-03  4.381e-04  19.924  < 2e-16
## Revolving_Balance                     -1.050e-07  9.292e-09 -11.303  < 2e-16
## Revolving_Utilization                  6.343e-02  9.983e-04  63.537  < 2e-16
## Total_Accounts                        -2.940e-04  2.640e-05 -11.136  < 2e-16
## Collections_12Mo_Exclude_Med           8.604e-03  2.166e-03   3.972 7.15e-05
## pol_12                                 3.472e-03  8.839e-04   3.928 8.60e-05
## pol_13                                -5.510e-03  4.939e-04 -11.156  < 2e-16
## Initial_Loan_Term_Months_36months     -4.011e-02  5.331e-04 -75.243  < 2e-16
## `Home_Owner_N/A`                      -3.443e-03  9.571e-04  -3.597 0.000322
## Home_Owner_RENT                        2.372e-03  8.917e-04   2.660 0.007809
## Home_Owner_MORTGAGE                   -8.439e-03  8.491e-04  -9.939  < 2e-16
## Income_Verified_VERIFIED_incomesource  3.653e-03  5.940e-04   6.149 7.91e-10
## Income_Verified_VERIFIED_income        1.137e-02  5.872e-04  19.368  < 2e-16
## State_TN                               6.722e-03  1.946e-03   3.454 0.000553
## State_NV                               3.799e-03  1.883e-03   2.018 0.043638
## State_MA                              -3.995e-03  1.428e-03  -2.797 0.005169
## State_FL                               2.169e-03  9.087e-04   2.387 0.016975
## State_NY                               2.029e-03  8.061e-04   2.517 0.011843
##                                          
## (Intercept)                           ***
## Loan_Amount_Requested                 ***
## Length_Employed                       *  
## Annual_Income                         ***
## Debt_To_Income                        ***
## Number_Delinqueny_2yrs                ***
## Inquiries_Last_6Mo                    ***
## Number_Open_Accounts                  ***
## Public_Record_Count                   ***
## Revolving_Balance                     ***
## Revolving_Utilization                 ***
## Total_Accounts                        ***
## Collections_12Mo_Exclude_Med          ***
## pol_12                                ***
## pol_13                                ***
## Initial_Loan_Term_Months_36months     ***
## `Home_Owner_N/A`                      ***
## Home_Owner_RENT                       ** 
## Home_Owner_MORTGAGE                   ***
## Income_Verified_VERIFIED_incomesource ***
## Income_Verified_VERIFIED_income       ***
## State_TN                              ***
## State_NV                              *  
## State_MA                              ** 
## State_FL                              *  
## State_NY                              *  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.03326 on 23174 degrees of freedom
## Multiple R-squared:  0.4416, Adjusted R-squared:  0.441 
## F-statistic:   733 on 25 and 23174 DF,  p-value: < 2.2e-16

Improve R-squared value by add multi-nomial

## 
## Call:
## lm(formula = Interest_Rate ~ Loan_Amount_Requested + I(Loan_Amount_Requested * 
##     Loan_Amount_Requested) + Length_Employed + Annual_Income + 
##     (Annual_Income * Annual_Income) + Debt_To_Income + I(Debt_To_Income * 
##     Debt_To_Income) + Number_Delinqueny_2yrs + I(Number_Delinqueny_2yrs * 
##     Number_Delinqueny_2yrs) + Inquiries_Last_6Mo + I(Inquiries_Last_6Mo * 
##     Inquiries_Last_6Mo) + Number_Open_Accounts + Public_Record_Count + 
##     Revolving_Balance + Revolving_Utilization + I(Revolving_Utilization * 
##     Revolving_Utilization) + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_13 + Initial_Loan_Term_Months_36months + `Home_Owner_N/A` + 
##     Home_Owner_RENT + Home_Owner_MORTGAGE + Income_Verified_VERIFIED_incomesource + 
##     Income_Verified_VERIFIED_income + State_TN + State_MA + State_FL + 
##     State_NY, data = train1)
## 
## Residuals:
##       Min        1Q    Median        3Q       Max 
## -0.183461 -0.022925 -0.003017  0.019824  0.309148 
## 
## Coefficients:
##                                                      Estimate Std. Error
## (Intercept)                                         1.405e-01  1.792e-03
## Loan_Amount_Requested                              -2.586e-06  1.017e-07
## I(Loan_Amount_Requested * Loan_Amount_Requested)    7.584e-11  2.674e-12
## Length_Employed                                     1.461e-04  6.194e-05
## Annual_Income                                      -6.762e-08  5.483e-09
## Debt_To_Income                                     -8.544e-04  1.164e-04
## I(Debt_To_Income * Debt_To_Income)                  3.065e-05  3.024e-06
## Number_Delinqueny_2yrs                              9.767e-03  4.285e-04
## I(Number_Delinqueny_2yrs * Number_Delinqueny_2yrs) -9.635e-04  7.392e-05
## Inquiries_Last_6Mo                                  1.429e-02  4.570e-04
## I(Inquiries_Last_6Mo * Inquiries_Last_6Mo)         -1.404e-03  1.256e-04
## Number_Open_Accounts                                9.020e-04  6.063e-05
## Public_Record_Count                                 8.759e-03  4.286e-04
## Revolving_Balance                                  -1.032e-07  9.069e-09
## Revolving_Utilization                               5.889e-02  3.832e-03
## I(Revolving_Utilization * Revolving_Utilization)    5.473e-03  3.478e-03
## Total_Accounts                                     -3.014e-04  2.575e-05
## Collections_12Mo_Exclude_Med                        7.399e-03  2.113e-03
## pol_13                                             -5.972e-03  4.744e-04
## Initial_Loan_Term_Months_36months                  -4.168e-02  5.226e-04
## `Home_Owner_N/A`                                   -3.660e-03  9.331e-04
## Home_Owner_RENT                                     2.311e-03  8.668e-04
## Home_Owner_MORTGAGE                                -8.082e-03  8.282e-04
## Income_Verified_VERIFIED_incomesource               4.637e-03  5.806e-04
## Income_Verified_VERIFIED_income                     1.097e-02  5.742e-04
## State_TN                                            6.887e-03  1.897e-03
## State_MA                                           -3.036e-03  1.393e-03
## State_FL                                            2.365e-03  8.853e-04
## State_NY                                            1.894e-03  7.854e-04
##                                                    t value Pr(>|t|)    
## (Intercept)                                         78.394  < 2e-16 ***
## Loan_Amount_Requested                              -25.413  < 2e-16 ***
## I(Loan_Amount_Requested * Loan_Amount_Requested)    28.368  < 2e-16 ***
## Length_Employed                                      2.358 0.018364 *  
## Annual_Income                                      -12.332  < 2e-16 ***
## Debt_To_Income                                      -7.341 2.19e-13 ***
## I(Debt_To_Income * Debt_To_Income)                  10.135  < 2e-16 ***
## Number_Delinqueny_2yrs                              22.791  < 2e-16 ***
## I(Number_Delinqueny_2yrs * Number_Delinqueny_2yrs) -13.035  < 2e-16 ***
## Inquiries_Last_6Mo                                  31.259  < 2e-16 ***
## I(Inquiries_Last_6Mo * Inquiries_Last_6Mo)         -11.174  < 2e-16 ***
## Number_Open_Accounts                                14.877  < 2e-16 ***
## Public_Record_Count                                 20.435  < 2e-16 ***
## Revolving_Balance                                  -11.384  < 2e-16 ***
## Revolving_Utilization                               15.367  < 2e-16 ***
## I(Revolving_Utilization * Revolving_Utilization)     1.574 0.115581    
## Total_Accounts                                     -11.707  < 2e-16 ***
## Collections_12Mo_Exclude_Med                         3.502 0.000463 ***
## pol_13                                             -12.589  < 2e-16 ***
## Initial_Loan_Term_Months_36months                  -79.764  < 2e-16 ***
## `Home_Owner_N/A`                                    -3.922 8.80e-05 ***
## Home_Owner_RENT                                      2.666 0.007686 ** 
## Home_Owner_MORTGAGE                                 -9.758  < 2e-16 ***
## Income_Verified_VERIFIED_incomesource                7.988 1.44e-15 ***
## Income_Verified_VERIFIED_income                     19.102  < 2e-16 ***
## State_TN                                             3.630 0.000284 ***
## State_MA                                            -2.180 0.029296 *  
## State_FL                                             2.672 0.007548 ** 
## State_NY                                             2.412 0.015879 *  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.03243 on 23171 degrees of freedom
## Multiple R-squared:  0.4692, Adjusted R-squared:  0.4685 
## F-statistic: 731.5 on 28 and 23171 DF,  p-value: < 2.2e-16

RMSE on validation dataset

As we can see that the performance RMSE on validation data is 2.003, which is the best after I comparied several other models.

## [1] 0.03222466

Final model on entire train data

Final train the model on the all train date to generalize to prodict on the test data.

## 
## Call:
## lm(formula = Interest_Rate ~ Loan_Amount_Requested + I(Loan_Amount_Requested * 
##     Loan_Amount_Requested) + Length_Employed + Annual_Income + 
##     (Annual_Income * Annual_Income) + Debt_To_Income + I(Debt_To_Income * 
##     Debt_To_Income) + Number_Delinqueny_2yrs + I(Number_Delinqueny_2yrs * 
##     Number_Delinqueny_2yrs) + Inquiries_Last_6Mo + I(Inquiries_Last_6Mo * 
##     Inquiries_Last_6Mo) + Number_Open_Accounts + Public_Record_Count + 
##     Revolving_Balance + Revolving_Utilization + I(Revolving_Utilization * 
##     Revolving_Utilization) + Total_Accounts + Collections_12Mo_Exclude_Med + 
##     pol_13 + Initial_Loan_Term_Months_36months + `Home_Owner_N/A` + 
##     Home_Owner_RENT + Home_Owner_MORTGAGE + Income_Verified_VERIFIED_incomesource + 
##     Income_Verified_VERIFIED_income + State_TN + State_MA + State_FL + 
##     State_NY, data = train)
## 
## Residuals:
##       Min        1Q    Median        3Q       Max 
## -0.189401 -0.022885 -0.003128  0.019922  0.302418 
## 
## Coefficients:
##                                                      Estimate Std. Error
## (Intercept)                                         1.411e-01  1.599e-03
## Loan_Amount_Requested                              -2.640e-06  9.064e-08
## I(Loan_Amount_Requested * Loan_Amount_Requested)    7.730e-11  2.379e-12
## Length_Employed                                     1.268e-04  5.526e-05
## Annual_Income                                      -6.826e-08  4.906e-09
## Debt_To_Income                                     -8.624e-04  1.038e-04
## I(Debt_To_Income * Debt_To_Income)                  3.101e-05  2.698e-06
## Number_Delinqueny_2yrs                              9.820e-03  3.899e-04
## I(Number_Delinqueny_2yrs * Number_Delinqueny_2yrs) -9.510e-04  6.990e-05
## Inquiries_Last_6Mo                                  1.451e-02  4.107e-04
## I(Inquiries_Last_6Mo * Inquiries_Last_6Mo)         -1.493e-03  1.136e-04
## Number_Open_Accounts                                9.207e-04  5.429e-05
## Public_Record_Count                                 9.114e-03  3.838e-04
## Revolving_Balance                                  -1.002e-07  8.346e-09
## Revolving_Utilization                               5.923e-02  3.440e-03
## I(Revolving_Utilization * Revolving_Utilization)    5.385e-03  3.116e-03
## Total_Accounts                                     -3.016e-04  2.299e-05
## Collections_12Mo_Exclude_Med                        7.663e-03  1.899e-03
## pol_13                                             -6.151e-03  4.241e-04
## Initial_Loan_Term_Months_36months                  -4.192e-02  4.668e-04
## `Home_Owner_N/A`                                   -3.940e-03  8.357e-04
## Home_Owner_RENT                                     2.099e-03  7.758e-04
## Home_Owner_MORTGAGE                                -8.288e-03  7.400e-04
## Income_Verified_VERIFIED_incomesource               4.131e-03  5.185e-04
## Income_Verified_VERIFIED_income                     1.073e-02  5.147e-04
## State_TN                                            6.563e-03  1.685e-03
## State_MA                                           -3.587e-03  1.244e-03
## State_FL                                            2.271e-03  7.947e-04
## State_NY                                            1.731e-03  7.036e-04
##                                                    t value Pr(>|t|)    
## (Intercept)                                         88.214  < 2e-16 ***
## Loan_Amount_Requested                              -29.125  < 2e-16 ***
## I(Loan_Amount_Requested * Loan_Amount_Requested)    32.488  < 2e-16 ***
## Length_Employed                                      2.294  0.02178 *  
## Annual_Income                                      -13.915  < 2e-16 ***
## Debt_To_Income                                      -8.307  < 2e-16 ***
## I(Debt_To_Income * Debt_To_Income)                  11.494  < 2e-16 ***
## Number_Delinqueny_2yrs                              25.185  < 2e-16 ***
## I(Number_Delinqueny_2yrs * Number_Delinqueny_2yrs) -13.605  < 2e-16 ***
## Inquiries_Last_6Mo                                  35.327  < 2e-16 ***
## I(Inquiries_Last_6Mo * Inquiries_Last_6Mo)         -13.139  < 2e-16 ***
## Number_Open_Accounts                                16.960  < 2e-16 ***
## Public_Record_Count                                 23.746  < 2e-16 ***
## Revolving_Balance                                  -12.010  < 2e-16 ***
## Revolving_Utilization                               17.218  < 2e-16 ***
## I(Revolving_Utilization * Revolving_Utilization)     1.728  0.08395 .  
## Total_Accounts                                     -13.119  < 2e-16 ***
## Collections_12Mo_Exclude_Med                         4.036 5.45e-05 ***
## pol_13                                             -14.504  < 2e-16 ***
## Initial_Loan_Term_Months_36months                  -89.815  < 2e-16 ***
## `Home_Owner_N/A`                                    -4.715 2.43e-06 ***
## Home_Owner_RENT                                      2.706  0.00681 ** 
## Home_Owner_MORTGAGE                                -11.201  < 2e-16 ***
## Income_Verified_VERIFIED_incomesource                7.967 1.68e-15 ***
## Income_Verified_VERIFIED_income                     20.845  < 2e-16 ***
## State_TN                                             3.895 9.82e-05 ***
## State_MA                                            -2.884  0.00393 ** 
## State_FL                                             2.858  0.00426 ** 
## State_NY                                             2.461  0.01388 *  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.03239 on 28971 degrees of freedom
## Multiple R-squared:  0.4699, Adjusted R-squared:  0.4694 
## F-statistic: 917.3 on 28 and 28971 DF,  p-value: < 2.2e-16

Prediction on test data

Predict interest rate for test data and write it on csv files.