class: center, middle, inverse, title-slide .title[ #
Analyzation of Credit Approval rates using logistic regression.
] .subtitle[ ##
] .author[ ###
Kyle Weber
] .institute[ ###
West Chester University of Pennsylvania
] .date[ ###
Prepared for
STA490: Statistics Capstone
Slides available at:
https://github.com/Kyle-Weber/STA490
] --- ```{} if (!require("xaringanthemer")) { install.packages("xaringanthemer") library(xaringanthemer) } ``` <img src="SoloP_files/figure-html/unnamed-chunk-2-1.png" width="100%" /> <img src="SoloP_files/figure-html/unnamed-chunk-3-1.png" width="100%" /><img src="SoloP_files/figure-html/unnamed-chunk-3-2.png" width="100%" /> --- class: top, center # Table of Contents <br> .left[ 1. Data Set Summary <br> <br> 2. Research Question <br> <br> 3. Exploratory Analysis <br> <br> 4. Full Logistic Regression Model <br> <br> 5. Reduced Logistic Regression Model <br> <br> 6. Final Logistic Regression Model <br> <br> 7. Model Comparison <br> <br> 8. Odds Ratio Analysis <br> <br> 9. Conclusion ] --- # Research Question - Can a multiple logistic regression model predict credit card approval based on applicant’s demographic and financial information? --- # Exploratory Analysis - Pairwise Scatter Plots for Numerical Variables <br> - Seems to be issues regrading skewness and grouping <img src="SoloP_files/figure-html/unnamed-chunk-5-1.png" width="100%" /> - grouping the histograms will help to fix this problem --- # Logistic Regression Models - Full Model <br> <br> - Helps to find variables that are not statistically significant Table: Summary of inferential statistics of the full model | | Estimate| Std. Error| z value| Pr(>|z|)| |:--------------------------|----------:|----------:|----------:|------------------:| |(Intercept) | -1.3451043| 1.2590670| -1.0683342| 0.2853698| |grp.Debt0.1-0.6 | -2.0457678| 0.8428722| -2.4271388| 0.0152184| |grp.Debt0.61-1.2 | -3.3892800| 0.9200526| -3.6837893| 0.0002298| |grp.Debt1.21-5.0 | -3.1604617| 0.8380558| -3.7711831| 0.0001625| |grp.Debt5.1-10.0 | -2.5166373| 0.8679872| -2.8993943| 0.0037388| |grp.Debt10.1-40 | -3.0749208| 0.8553437| -3.5949533| 0.0003244| |grp.Age17-21 | 0.2710334| 0.9598219| 0.2823789| 0.7776530| |grp.Age21-26 | 0.2339748| 0.9414384| 0.2485290| 0.8037251| |grp.Age26-35 | -0.3188429| 0.9510212| -0.3352637| 0.7374262| |grp.Age35-50 | 0.2373826| 0.9625368| 0.2466218| 0.8052009| |grp.Age50-100 | -0.4443699| 1.0449929| -0.4252373| 0.6706637| |grp.Income0.1-5 | -2.1327787| 0.7929849| -2.6895580| 0.0071547| |grp.Income5-10 | 0.7716000| 0.8142668| 0.9476010| 0.3433326| |grp.Income10-300 | -0.1033976| 0.3791983| -0.2726743| 0.7851036| |grp.Income300-5000 | 0.9837330| 0.3782887| 2.6004818| 0.0093093| |grp.Income5000+ | 3.0404111| 1.0500793| 2.8954111| 0.0037866| |Gender | 0.0081213| 0.2975490| 0.0272939| 0.9782253| |BankCustomer | 0.8959578| 0.3289897| 2.7233608| 0.0064621| |EthnicityBlack | 0.8362797| 0.5464358| 1.5304261| 0.1259113| |EthnicityLatino | -0.8261380| 0.8676858| -0.9521166| 0.3410379| |EthnicityOther | 1.0941315| 0.8719407| 1.2548233| 0.2095429| |EthnicityWhite | 0.4714134| 0.4707245| 1.0014636| 0.3166027| |grp.YearsEmployed0.1-1.0 | -0.8413427| 0.6809067| -1.2356210| 0.2165995| |grp.YearsEmployed3.0-5.0 | 0.2886461| 0.7262822| 0.3974297| 0.6910506| |grp.YearsEmployed5.0-10.0 | 0.3594689| 0.7789135| 0.4615004| 0.6444396| |grp.YearsEmployed10.1-50.0 | 0.8506472| 0.8222453| 1.0345419| 0.3008829| |grp.YearsEmployed50+ | -0.2292317| 0.8587276| -0.2669434| 0.7895127| |PriorDefault | 3.5527489| 0.3549968| 10.0078345| 0.0000000| |Employed | 0.7351539| 0.3736206| 1.9676484| 0.0491085| |CreditScore | 0.1022253| 0.0557785| 1.8327008| 0.0668471| |DriversLicense | 0.0176826| 0.2804494| 0.0630510| 0.9497259| --- # Logistic Regression Models - Reduced Model <br> <br> - non-significant variables taken out manually Table: Summary of inferential statistics of the reduced model | | Estimate| Std. Error| z value| Pr(>|z|)| |:------------------|----------:|----------:|----------:|------------------:| |(Intercept) | -0.4433921| 0.5461622| -0.8118323| 0.4168879| |grp.Income0.1-5 | -3.3044573| 0.6708738| -4.9256020| 0.0000008| |grp.Income5-10 | -1.5894303| 0.6120379| -2.5969476| 0.0094056| |grp.Income10-300 | -0.9974284| 0.2928437| -3.4060097| 0.0006592| |grp.Income300-5000 | 0.3354653| 0.2649959| 1.2659263| 0.2055395| |grp.Income5000+ | 2.5665203| 0.7929171| 3.2368077| 0.0012087| |grp.Debt0.1-0.6 | -1.0233252| 0.5792296| -1.7667003| 0.0772784| |grp.Debt0.61-1.2 | -1.4984775| 0.6135070| -2.4424783| 0.0145868| |grp.Debt1.21-5.0 | -1.1917078| 0.5449017| -2.1870142| 0.0287415| |grp.Debt5.1-10.0 | -0.4199398| 0.5722382| -0.7338549| 0.4630372| |grp.Debt10.1-40 | -0.6843711| 0.5778427| -1.1843554| 0.2362724| |CreditScore | 0.1956628| 0.0512145| 3.8204552| 0.0001332| |Employed | 1.4801347| 0.2998444| 4.9363430| 0.0000008| |BankCustomer | 0.5344925| 0.2433127| 2.1967305| 0.0280397| --- # Logistic Regression Models - Final Model <br> <br> - automatic variable selection <br> <br> - most relevant variables kept in Table: Summary of inferential statistics of the final model | | Estimate| Std. Error| z value| Pr(>|z|)| |:--------------------------|----------:|----------:|----------:|------------------:| |(Intercept) | -1.3172370| 0.8513798| -1.5471790| 0.1218201| |grp.Income0.1-5 | -1.9875260| 0.7764240| -2.5598461| 0.0104719| |grp.Income5-10 | 0.8072470| 0.8024122| 1.0060253| 0.3144034| |grp.Income10-300 | -0.1113254| 0.3772895| -0.2950662| 0.7679433| |grp.Income300-5000 | 0.9935654| 0.3731707| 2.6624959| 0.0077564| |grp.Income5000+ | 2.9841562| 1.0523408| 2.8357317| 0.0045721| |grp.Debt0.1-0.6 | -2.1228736| 0.8259741| -2.5701455| 0.0101656| |grp.Debt0.61-1.2 | -3.4516563| 0.8932555| -3.8641311| 0.0001115| |grp.Debt1.21-5.0 | -3.2520806| 0.8090601| -4.0195785| 0.0000583| |grp.Debt5.1-10.0 | -2.5254756| 0.8460892| -2.9848811| 0.0028369| |grp.Debt10.1-40 | -3.0766593| 0.8400838| -3.6623244| 0.0002499| |CreditScore | 0.0972506| 0.0553596| 1.7567058| 0.0789680| |Employed | 0.7095433| 0.3725014| 1.9048073| 0.0568051| |BankCustomer | 0.8509058| 0.3222964| 2.6401342| 0.0082873| |PriorDefault | 3.5192042| 0.3451889| 10.1950089| 0.0000000| |grp.YearsEmployed0.1-1.0 | -0.7288612| 0.6790085| -1.0734198| 0.2830828| |grp.YearsEmployed3.0-5.0 | 0.3838400| 0.7230751| 0.5308439| 0.5955270| |grp.YearsEmployed5.0-10.0 | 0.3731764| 0.7763964| 0.4806520| 0.6307639| |grp.YearsEmployed10.1-50.0 | 0.7432616| 0.8207288| 0.9056117| 0.3651414| |grp.YearsEmployed50+ | -0.2614599| 0.8467595| -0.3087771| 0.7574911| |EthnicityBlack | 0.9229021| 0.5337120| 1.7292135| 0.0837709| |EthnicityLatino | -0.8316552| 0.8527065| -0.9753124| 0.3294053| |EthnicityOther | 1.2276316| 0.8707288| 1.4098897| 0.1585723| |EthnicityWhite | 0.5613195| 0.4641797| 1.2092719| 0.2265584| --- # Goodness-of-fit Model Comparison - Comparison of three logistic regression models. <br> <br> - final model has a slightly higher Deviance and lower AIC Table: Comparison of global goodness-of-fit statistics | | Deviance.residual| Null.Deviance.Residual| AIC| |:-------------|-----------------:|----------------------:|--------:| |full.model | 397.5970| 948.1551| 459.5970| |reduced.model | 635.0433| 948.1551| 663.0433| |final.model | 401.8565| 948.1551| 449.8565| --- # Odds Ratio analysis - performed for a more practical interpretation <br> - Income group "0.1-5" has odds ratio 0.1388257, indicating about 86% lower approval odds than the baseline <br> - Similar patterns observed for other variables <br> - Priordefault is the most influential variable Table: Summary Stats with Odds Ratios | | Estimate| Std. Error| z value| Pr(>|z|)| odds.ratio| |:--------------------------|----------:|----------:|----------:|------------------:|----------:| |(Intercept) | -1.3172370| 0.8513798| -1.5471790| 0.1218201| 0.2678744| |grp.Income0.1-5 | -1.9875260| 0.7764240| -2.5598461| 0.0104719| 0.1370340| |grp.Income5-10 | 0.8072470| 0.8024122| 1.0060253| 0.3144034| 2.2417279| |grp.Income10-300 | -0.1113254| 0.3772895| -0.2950662| 0.7679433| 0.8946476| |grp.Income300-5000 | 0.9935654| 0.3731707| 2.6624959| 0.0077564| 2.7008469| |grp.Income5000+ | 2.9841562| 1.0523408| 2.8357317| 0.0045721| 19.7698140| |grp.Debt0.1-0.6 | -2.1228736| 0.8259741| -2.5701455| 0.0101656| 0.1196872| |grp.Debt0.61-1.2 | -3.4516563| 0.8932555| -3.8641311| 0.0001115| 0.0316931| |grp.Debt1.21-5.0 | -3.2520806| 0.8090601| -4.0195785| 0.0000583| 0.0386936| |grp.Debt5.1-10.0 | -2.5254756| 0.8460892| -2.9848811| 0.0028369| 0.0800202| |grp.Debt10.1-40 | -3.0766593| 0.8400838| -3.6623244| 0.0002499| 0.0461131| |CreditScore | 0.0972506| 0.0553596| 1.7567058| 0.0789680| 1.1021365| |Employed | 0.7095433| 0.3725014| 1.9048073| 0.0568051| 2.0330626| |BankCustomer | 0.8509058| 0.3222964| 2.6401342| 0.0082873| 2.3417670| |PriorDefault | 3.5192042| 0.3451889| 10.1950089| 0.0000000| 33.7575520| |grp.YearsEmployed0.1-1.0 | -0.7288612| 0.6790085| -1.0734198| 0.2830828| 0.4824581| |grp.YearsEmployed3.0-5.0 | 0.3838400| 0.7230751| 0.5308439| 0.5955270| 1.4679106| |grp.YearsEmployed5.0-10.0 | 0.3731764| 0.7763964| 0.4806520| 0.6307639| 1.4523405| |grp.YearsEmployed10.1-50.0 | 0.7432616| 0.8207288| 0.9056117| 0.3651414| 2.1027827| |grp.YearsEmployed50+ | -0.2614599| 0.8467595| -0.3087771| 0.7574911| 0.7699267| |EthnicityBlack | 0.9229021| 0.5337120| 1.7292135| 0.0837709| 2.5165832| |EthnicityLatino | -0.8316552| 0.8527065| -0.9753124| 0.3294053| 0.4353281| |EthnicityOther | 1.2276316| 0.8707288| 1.4098897| 0.1585723| 3.4131362| |EthnicityWhite | 0.5613195| 0.4641797| 1.2092719| 0.2265584| 1.7529840| --- # Conclusion - Multiple logistic regression serves as a powerful tool for extracting insights from intricate datasets. - Offers a deeper understanding of the dynamics influencing credit card approval decisions. - Revealed crucial information about the relationship between credit card approval and predictor variables. ---