German_Credit Data Analysis
Chirag Ahluwalia
4/22/2020
Load the data
This data have two classes for the credit worthiness: good or bad. There are predictors related to attributes, such as: checking account status, duration, credit history, purpose of the loan, amount of the loan, savings accounts or bonds, employment duration, Installment rate in percentage of disposable income, personal information, other debtors/guarantors, residence duration, property, age, other installment plans, housing, number of existing credits, job information, Number of people being liable to provide maintenance for, telephone, and foreign worker status.
library(caret)
data("GermanCredit")
german <- GermanCreditBasic checks and Manipulation
dim(german) # 1000 people have been given to us ## [1] 1000 62str(german) # Class being our Factor variable ## 'data.frame': 1000 obs. of 62 variables:
## $ Duration : int 6 48 12 42 24 36 24 36 12 30 ...
## $ Amount : int 1169 5951 2096 7882 4870 9055 2835 6948 3059 5234 ...
## $ InstallmentRatePercentage : int 4 2 2 2 3 2 3 2 2 4 ...
## $ ResidenceDuration : int 4 2 3 4 4 4 4 2 4 2 ...
## $ Age : int 67 22 49 45 53 35 53 35 61 28 ...
## $ NumberExistingCredits : int 2 1 1 1 2 1 1 1 1 2 ...
## $ NumberPeopleMaintenance : int 1 1 2 2 2 2 1 1 1 1 ...
## $ Telephone : num 0 1 1 1 1 0 1 0 1 1 ...
## $ ForeignWorker : num 1 1 1 1 1 1 1 1 1 1 ...
## $ Class : Factor w/ 2 levels "Bad","Good": 2 1 2 2 1 2 2 2 2 1 ...
## $ CheckingAccountStatus.lt.0 : num 1 0 0 1 1 0 0 0 0 0 ...
## $ CheckingAccountStatus.0.to.200 : num 0 1 0 0 0 0 0 1 0 1 ...
## $ CheckingAccountStatus.gt.200 : num 0 0 0 0 0 0 0 0 0 0 ...
## $ CheckingAccountStatus.none : num 0 0 1 0 0 1 1 0 1 0 ...
## $ CreditHistory.NoCredit.AllPaid : num 0 0 0 0 0 0 0 0 0 0 ...
## $ CreditHistory.ThisBank.AllPaid : num 0 0 0 0 0 0 0 0 0 0 ...
## $ CreditHistory.PaidDuly : num 0 1 0 1 0 1 1 1 1 0 ...
## $ CreditHistory.Delay : num 0 0 0 0 1 0 0 0 0 0 ...
## $ CreditHistory.Critical : num 1 0 1 0 0 0 0 0 0 1 ...
## $ Purpose.NewCar : num 0 0 0 0 1 0 0 0 0 1 ...
## $ Purpose.UsedCar : num 0 0 0 0 0 0 0 1 0 0 ...
## $ Purpose.Furniture.Equipment : num 0 0 0 1 0 0 1 0 0 0 ...
## $ Purpose.Radio.Television : num 1 1 0 0 0 0 0 0 1 0 ...
## $ Purpose.DomesticAppliance : num 0 0 0 0 0 0 0 0 0 0 ...
## $ Purpose.Repairs : num 0 0 0 0 0 0 0 0 0 0 ...
## $ Purpose.Education : num 0 0 1 0 0 1 0 0 0 0 ...
## $ Purpose.Vacation : num 0 0 0 0 0 0 0 0 0 0 ...
## $ Purpose.Retraining : num 0 0 0 0 0 0 0 0 0 0 ...
## $ Purpose.Business : num 0 0 0 0 0 0 0 0 0 0 ...
## $ Purpose.Other : num 0 0 0 0 0 0 0 0 0 0 ...
## $ SavingsAccountBonds.lt.100 : num 0 1 1 1 1 0 0 1 0 1 ...
## $ SavingsAccountBonds.100.to.500 : num 0 0 0 0 0 0 0 0 0 0 ...
## $ SavingsAccountBonds.500.to.1000 : num 0 0 0 0 0 0 1 0 0 0 ...
## $ SavingsAccountBonds.gt.1000 : num 0 0 0 0 0 0 0 0 1 0 ...
## $ SavingsAccountBonds.Unknown : num 1 0 0 0 0 1 0 0 0 0 ...
## $ EmploymentDuration.lt.1 : num 0 0 0 0 0 0 0 0 0 0 ...
## $ EmploymentDuration.1.to.4 : num 0 1 0 0 1 1 0 1 0 0 ...
## $ EmploymentDuration.4.to.7 : num 0 0 1 1 0 0 0 0 1 0 ...
## $ EmploymentDuration.gt.7 : num 1 0 0 0 0 0 1 0 0 0 ...
## $ EmploymentDuration.Unemployed : num 0 0 0 0 0 0 0 0 0 1 ...
## $ Personal.Male.Divorced.Seperated : num 0 0 0 0 0 0 0 0 1 0 ...
## $ Personal.Female.NotSingle : num 0 1 0 0 0 0 0 0 0 0 ...
## $ Personal.Male.Single : num 1 0 1 1 1 1 1 1 0 0 ...
## $ Personal.Male.Married.Widowed : num 0 0 0 0 0 0 0 0 0 1 ...
## $ Personal.Female.Single : num 0 0 0 0 0 0 0 0 0 0 ...
## $ OtherDebtorsGuarantors.None : num 1 1 1 0 1 1 1 1 1 1 ...
## $ OtherDebtorsGuarantors.CoApplicant : num 0 0 0 0 0 0 0 0 0 0 ...
## $ OtherDebtorsGuarantors.Guarantor : num 0 0 0 1 0 0 0 0 0 0 ...
## $ Property.RealEstate : num 1 1 1 0 0 0 0 0 1 0 ...
## $ Property.Insurance : num 0 0 0 1 0 0 1 0 0 0 ...
## $ Property.CarOther : num 0 0 0 0 0 0 0 1 0 1 ...
## $ Property.Unknown : num 0 0 0 0 1 1 0 0 0 0 ...
## $ OtherInstallmentPlans.Bank : num 0 0 0 0 0 0 0 0 0 0 ...
## $ OtherInstallmentPlans.Stores : num 0 0 0 0 0 0 0 0 0 0 ...
## $ OtherInstallmentPlans.None : num 1 1 1 1 1 1 1 1 1 1 ...
## $ Housing.Rent : num 0 0 0 0 0 0 0 1 0 0 ...
## $ Housing.Own : num 1 1 1 0 0 0 1 0 1 1 ...
## $ Housing.ForFree : num 0 0 0 1 1 1 0 0 0 0 ...
## $ Job.UnemployedUnskilled : num 0 0 0 0 0 0 0 0 0 0 ...
## $ Job.UnskilledResident : num 0 0 1 0 0 1 0 0 1 0 ...
## $ Job.SkilledEmployee : num 1 1 0 1 1 0 1 0 0 0 ...
## $ Job.Management.SelfEmp.HighlyQualified: num 0 0 0 0 0 0 0 1 0 1 ...# Checking Missing Data
colSums(is.na(german))## Duration Amount
## 0 0
## InstallmentRatePercentage ResidenceDuration
## 0 0
## Age NumberExistingCredits
## 0 0
## NumberPeopleMaintenance Telephone
## 0 0
## ForeignWorker Class
## 0 0
## CheckingAccountStatus.lt.0 CheckingAccountStatus.0.to.200
## 0 0
## CheckingAccountStatus.gt.200 CheckingAccountStatus.none
## 0 0
## CreditHistory.NoCredit.AllPaid CreditHistory.ThisBank.AllPaid
## 0 0
## CreditHistory.PaidDuly CreditHistory.Delay
## 0 0
## CreditHistory.Critical Purpose.NewCar
## 0 0
## Purpose.UsedCar Purpose.Furniture.Equipment
## 0 0
## Purpose.Radio.Television Purpose.DomesticAppliance
## 0 0
## Purpose.Repairs Purpose.Education
## 0 0
## Purpose.Vacation Purpose.Retraining
## 0 0
## Purpose.Business Purpose.Other
## 0 0
## SavingsAccountBonds.lt.100 SavingsAccountBonds.100.to.500
## 0 0
## SavingsAccountBonds.500.to.1000 SavingsAccountBonds.gt.1000
## 0 0
## SavingsAccountBonds.Unknown EmploymentDuration.lt.1
## 0 0
## EmploymentDuration.1.to.4 EmploymentDuration.4.to.7
## 0 0
## EmploymentDuration.gt.7 EmploymentDuration.Unemployed
## 0 0
## Personal.Male.Divorced.Seperated Personal.Female.NotSingle
## 0 0
## Personal.Male.Single Personal.Male.Married.Widowed
## 0 0
## Personal.Female.Single OtherDebtorsGuarantors.None
## 0 0
## OtherDebtorsGuarantors.CoApplicant OtherDebtorsGuarantors.Guarantor
## 0 0
## Property.RealEstate Property.Insurance
## 0 0
## Property.CarOther Property.Unknown
## 0 0
## OtherInstallmentPlans.Bank OtherInstallmentPlans.Stores
## 0 0
## OtherInstallmentPlans.None Housing.Rent
## 0 0
## Housing.Own Housing.ForFree
## 0 0
## Job.UnemployedUnskilled Job.UnskilledResident
## 0 0
## Job.SkilledEmployee Job.Management.SelfEmp.HighlyQualified
## 0 0# This shows that there are no missing data in our Dataset, Good Start!
# converting all the variables into factor which have less than 4 unique values
col_names <- sapply(german, function(col) length(unique(col)) < 4)
german[ , col_names] <- lapply(german[ , col_names] , factor)
str(german)## 'data.frame': 1000 obs. of 62 variables:
## $ Duration : int 6 48 12 42 24 36 24 36 12 30 ...
## $ Amount : int 1169 5951 2096 7882 4870 9055 2835 6948 3059 5234 ...
## $ InstallmentRatePercentage : int 4 2 2 2 3 2 3 2 2 4 ...
## $ ResidenceDuration : int 4 2 3 4 4 4 4 2 4 2 ...
## $ Age : int 67 22 49 45 53 35 53 35 61 28 ...
## $ NumberExistingCredits : int 2 1 1 1 2 1 1 1 1 2 ...
## $ NumberPeopleMaintenance : Factor w/ 2 levels "1","2": 1 1 2 2 2 2 1 1 1 1 ...
## $ Telephone : Factor w/ 2 levels "0","1": 1 2 2 2 2 1 2 1 2 2 ...
## $ ForeignWorker : Factor w/ 2 levels "0","1": 2 2 2 2 2 2 2 2 2 2 ...
## $ Class : Factor w/ 2 levels "Bad","Good": 2 1 2 2 1 2 2 2 2 1 ...
## $ CheckingAccountStatus.lt.0 : Factor w/ 2 levels "0","1": 2 1 1 2 2 1 1 1 1 1 ...
## $ CheckingAccountStatus.0.to.200 : Factor w/ 2 levels "0","1": 1 2 1 1 1 1 1 2 1 2 ...
## $ CheckingAccountStatus.gt.200 : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ CheckingAccountStatus.none : Factor w/ 2 levels "0","1": 1 1 2 1 1 2 2 1 2 1 ...
## $ CreditHistory.NoCredit.AllPaid : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ CreditHistory.ThisBank.AllPaid : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ CreditHistory.PaidDuly : Factor w/ 2 levels "0","1": 1 2 1 2 1 2 2 2 2 1 ...
## $ CreditHistory.Delay : Factor w/ 2 levels "0","1": 1 1 1 1 2 1 1 1 1 1 ...
## $ CreditHistory.Critical : Factor w/ 2 levels "0","1": 2 1 2 1 1 1 1 1 1 2 ...
## $ Purpose.NewCar : Factor w/ 2 levels "0","1": 1 1 1 1 2 1 1 1 1 2 ...
## $ Purpose.UsedCar : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 2 1 1 ...
## $ Purpose.Furniture.Equipment : Factor w/ 2 levels "0","1": 1 1 1 2 1 1 2 1 1 1 ...
## $ Purpose.Radio.Television : Factor w/ 2 levels "0","1": 2 2 1 1 1 1 1 1 2 1 ...
## $ Purpose.DomesticAppliance : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ Purpose.Repairs : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ Purpose.Education : Factor w/ 2 levels "0","1": 1 1 2 1 1 2 1 1 1 1 ...
## $ Purpose.Vacation : Factor w/ 1 level "0": 1 1 1 1 1 1 1 1 1 1 ...
## $ Purpose.Retraining : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ Purpose.Business : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ Purpose.Other : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ SavingsAccountBonds.lt.100 : Factor w/ 2 levels "0","1": 1 2 2 2 2 1 1 2 1 2 ...
## $ SavingsAccountBonds.100.to.500 : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ SavingsAccountBonds.500.to.1000 : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 2 1 1 1 ...
## $ SavingsAccountBonds.gt.1000 : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 2 1 ...
## $ SavingsAccountBonds.Unknown : Factor w/ 2 levels "0","1": 2 1 1 1 1 2 1 1 1 1 ...
## $ EmploymentDuration.lt.1 : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ EmploymentDuration.1.to.4 : Factor w/ 2 levels "0","1": 1 2 1 1 2 2 1 2 1 1 ...
## $ EmploymentDuration.4.to.7 : Factor w/ 2 levels "0","1": 1 1 2 2 1 1 1 1 2 1 ...
## $ EmploymentDuration.gt.7 : Factor w/ 2 levels "0","1": 2 1 1 1 1 1 2 1 1 1 ...
## $ EmploymentDuration.Unemployed : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 2 ...
## $ Personal.Male.Divorced.Seperated : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 2 1 ...
## $ Personal.Female.NotSingle : Factor w/ 2 levels "0","1": 1 2 1 1 1 1 1 1 1 1 ...
## $ Personal.Male.Single : Factor w/ 2 levels "0","1": 2 1 2 2 2 2 2 2 1 1 ...
## $ Personal.Male.Married.Widowed : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 2 ...
## $ Personal.Female.Single : Factor w/ 1 level "0": 1 1 1 1 1 1 1 1 1 1 ...
## $ OtherDebtorsGuarantors.None : Factor w/ 2 levels "0","1": 2 2 2 1 2 2 2 2 2 2 ...
## $ OtherDebtorsGuarantors.CoApplicant : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ OtherDebtorsGuarantors.Guarantor : Factor w/ 2 levels "0","1": 1 1 1 2 1 1 1 1 1 1 ...
## $ Property.RealEstate : Factor w/ 2 levels "0","1": 2 2 2 1 1 1 1 1 2 1 ...
## $ Property.Insurance : Factor w/ 2 levels "0","1": 1 1 1 2 1 1 2 1 1 1 ...
## $ Property.CarOther : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 2 1 2 ...
## $ Property.Unknown : Factor w/ 2 levels "0","1": 1 1 1 1 2 2 1 1 1 1 ...
## $ OtherInstallmentPlans.Bank : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ OtherInstallmentPlans.Stores : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ OtherInstallmentPlans.None : Factor w/ 2 levels "0","1": 2 2 2 2 2 2 2 2 2 2 ...
## $ Housing.Rent : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 2 1 1 ...
## $ Housing.Own : Factor w/ 2 levels "0","1": 2 2 2 1 1 1 2 1 2 2 ...
## $ Housing.ForFree : Factor w/ 2 levels "0","1": 1 1 1 2 2 2 1 1 1 1 ...
## $ Job.UnemployedUnskilled : Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 1 1 1 ...
## $ Job.UnskilledResident : Factor w/ 2 levels "0","1": 1 1 2 1 1 2 1 1 2 1 ...
## $ Job.SkilledEmployee : Factor w/ 2 levels "0","1": 2 2 1 2 2 1 2 1 1 1 ...
## $ Job.Management.SelfEmp.HighlyQualified: Factor w/ 2 levels "0","1": 1 1 1 1 1 1 1 2 1 2 ...g<- german # Taking the backup of the cleaned data Let us look into the dependent variable - Binary CLassification
# Checking the proportions of the class
table(german$Class)##
## Bad Good
## 300 700prop.table(table(german$Class))##
## Bad Good
## 0.3 0.7# Let us see the data graphically
library(ggplot2)
ggplot(data = german, mapping = aes(x =Class)) +
geom_bar(color="black",fill="orange")+
ggtitle("How is the target variable distributed")+
xlab("Bad->Not Credit-Worthy \n Good->Credit-Worthy")+
theme_bw()
# data looks decent, howeveer, we will still see if we can further enhance the data with CV or BootstrappingExploratory Data Analysis
## AGE
hist(german$Age, # Save histogram as object
freq = T,
col = "thistle1", # Or use: col = colors() [626]
main = "Histogram for Age distribution",
xlab = "Age in Years",
ylim=c(0,250))
# Insight: We see that we have a lot of young people in our dataset whoes age is between 20 - 30 and 30-40 years
## Age over CLass
# Let us see shows us how age of the customer is distributed across Class
ggplot(data = german, mapping = aes(x =Age)) +
geom_bar(color="black",fill="orange")+
facet_wrap(~Class)+
ggtitle("Vistualising Age over Credit Worthiness")+
xlab("Customer Age - in Years")+
theme_bw()
# Insight : we cannot see much of a difference in how age alone would play a role on Credit Worthiness
## amount
hist(german$Amount, # Save histogram as object
freq = T,
breaks = 20,
col = "thistle1", # Or use: col = colors() [626]
main = "Histogram for Amount distribution",
xlab = "income",
ylim=c(0,500))
# Amount is majorly distributed over 200o to 4000 dollar range
## Amount OVER CLASS
# Let us see shows us how amount is distributed across Class
ggplot(data = german, mapping = aes(x =Amount)) +
geom_bar(color="black",fill="orange")+
facet_wrap(~Class)+
ggtitle("Vistualising amount over Credit Worthiness")+
xlab("amount")+
theme_bw()
library(dplyr)
german %>% #plot density of Customer Age by churn outcomes
ggplot(aes(x=Amount,fill=Class))+
geom_density(alpha=.3,position="identity")+
labs(title = "Density of Amount by Class\n(blue=Good, red=Bad)",x="Amount Level",y = "Density of AMount")+#add title and axis labels
theme(legend.position="none")#hide the side signal of fill parameter
# Insight : this suggests that as more amount is given there are more changes that the customer will be a defaulter, however, amount alone can also not predict the credit worthiness, we will have to see how it plays a role on Credit coupled with other variables Checking Correlation between Variables
library(corrplot)
corr_simple <- function(data=german,sig=0.5){
#convert data to numeric in order to run correlations
#convert to factor first to keep the integrity of the data - each value will become a number rather than turn into NA
df_cor <- data %>% mutate_if(is.character, as.factor)
df_cor <- df_cor %>% mutate_if(is.factor, as.numeric)
#run a correlation and drop the insignificant ones
corr <- cor(df_cor)
#prepare to drop duplicates and correlations of 1
corr[lower.tri(corr,diag=TRUE)] <- NA
#drop perfect correlations
corr[corr == 1] <- NA
#turn into a 3-column table
corr <- as.data.frame(as.table(corr))
#remove the NA values from above
corr <- na.omit(corr)
#select significant values
corr <- subset(corr, abs(Freq) > sig)
#sort by highest correlation
corr <- corr[order(-abs(corr$Freq)),]
#print table
print(corr)
#turn corr back into matrix in order to plot with corrplot
mtx_corr <- reshape2::acast(corr, Var1~Var2, value.var="Freq")
#plot correlations visually
corrplot(mtx_corr, is.corr=FALSE, tl.col="black", na.label=" ")
}
corr_simple()## Var1 Var2
## 3401 OtherInstallmentPlans.Bank OtherInstallmentPlans.None
## 3586 Property.Unknown Housing.ForFree
## 2646 Personal.Female.NotSingle Personal.Male.Single
## 3528 Housing.Rent Housing.Own
## 2960 OtherDebtorsGuarantors.None OtherDebtorsGuarantors.Guarantor
## 1133 CreditHistory.PaidDuly CreditHistory.Critical
## 3780 Job.UnskilledResident Job.SkilledEmployee
## 2898 OtherDebtorsGuarantors.None OtherDebtorsGuarantors.CoApplicant
## 63 Duration Amount
## 2139 SavingsAccountBonds.lt.100 SavingsAccountBonds.Unknown
## 3591 Housing.Own Housing.ForFree
## 3843 Job.SkilledEmployee Job.Management.SelfEmp.HighlyQualified
## 998 NumberExistingCredits CreditHistory.PaidDuly
## 1122 NumberExistingCredits CreditHistory.Critical
## Freq
## 3401 -0.8405461
## 3586 0.7798526
## 2646 -0.7380357
## 3528 -0.7359677
## 2960 -0.7314079
## 1133 -0.6836174
## 3780 -0.6524383
## 2898 -0.6457208
## 63 0.6249842
## 2139 -0.5832811
## 3591 -0.5484452
## 3843 -0.5438517
## 998 -0.5403545
## 1122 0.5013637
Elimentary Logistic Regression
# Let us see if our factor variables have more than 1 level
a<- which(sapply(german, function(x) length(unique(x))<2))
names(german)## [1] "Duration"
## [2] "Amount"
## [3] "InstallmentRatePercentage"
## [4] "ResidenceDuration"
## [5] "Age"
## [6] "NumberExistingCredits"
## [7] "NumberPeopleMaintenance"
## [8] "Telephone"
## [9] "ForeignWorker"
## [10] "Class"
## [11] "CheckingAccountStatus.lt.0"
## [12] "CheckingAccountStatus.0.to.200"
## [13] "CheckingAccountStatus.gt.200"
## [14] "CheckingAccountStatus.none"
## [15] "CreditHistory.NoCredit.AllPaid"
## [16] "CreditHistory.ThisBank.AllPaid"
## [17] "CreditHistory.PaidDuly"
## [18] "CreditHistory.Delay"
## [19] "CreditHistory.Critical"
## [20] "Purpose.NewCar"
## [21] "Purpose.UsedCar"
## [22] "Purpose.Furniture.Equipment"
## [23] "Purpose.Radio.Television"
## [24] "Purpose.DomesticAppliance"
## [25] "Purpose.Repairs"
## [26] "Purpose.Education"
## [27] "Purpose.Vacation"
## [28] "Purpose.Retraining"
## [29] "Purpose.Business"
## [30] "Purpose.Other"
## [31] "SavingsAccountBonds.lt.100"
## [32] "SavingsAccountBonds.100.to.500"
## [33] "SavingsAccountBonds.500.to.1000"
## [34] "SavingsAccountBonds.gt.1000"
## [35] "SavingsAccountBonds.Unknown"
## [36] "EmploymentDuration.lt.1"
## [37] "EmploymentDuration.1.to.4"
## [38] "EmploymentDuration.4.to.7"
## [39] "EmploymentDuration.gt.7"
## [40] "EmploymentDuration.Unemployed"
## [41] "Personal.Male.Divorced.Seperated"
## [42] "Personal.Female.NotSingle"
## [43] "Personal.Male.Single"
## [44] "Personal.Male.Married.Widowed"
## [45] "Personal.Female.Single"
## [46] "OtherDebtorsGuarantors.None"
## [47] "OtherDebtorsGuarantors.CoApplicant"
## [48] "OtherDebtorsGuarantors.Guarantor"
## [49] "Property.RealEstate"
## [50] "Property.Insurance"
## [51] "Property.CarOther"
## [52] "Property.Unknown"
## [53] "OtherInstallmentPlans.Bank"
## [54] "OtherInstallmentPlans.Stores"
## [55] "OtherInstallmentPlans.None"
## [56] "Housing.Rent"
## [57] "Housing.Own"
## [58] "Housing.ForFree"
## [59] "Job.UnemployedUnskilled"
## [60] "Job.UnskilledResident"
## [61] "Job.SkilledEmployee"
## [62] "Job.Management.SelfEmp.HighlyQualified"german <- german[,-c(27,45)]
# let us split the data into Training and Testing data
set.seed(1234)
index1 <- sample(1:2, nrow(german), replace = TRUE, prob = c(0.65,0.35))
train <- german[index1 == 1, ]
test <- german[index1 == 2, ]
full <- glm(Class~., data=train,family = "binomial")
null <- glm(Class~1, data=train,family = "binomial")
# Forward selection
mod_log<- step(full,scope=list(lower=null,upper=full),
direction = "both")## Start: AIC=636.28
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CheckingAccountStatus.none +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + CreditHistory.Critical +
## Purpose.NewCar + Purpose.UsedCar + Purpose.Furniture.Equipment +
## Purpose.Radio.Television + Purpose.DomesticAppliance + Purpose.Repairs +
## Purpose.Education + Purpose.Retraining + Purpose.Business +
## Purpose.Other + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + SavingsAccountBonds.gt.1000 +
## SavingsAccountBonds.Unknown + EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 +
## EmploymentDuration.4.to.7 + EmploymentDuration.gt.7 + EmploymentDuration.Unemployed +
## Personal.Male.Divorced.Seperated + Personal.Female.NotSingle +
## Personal.Male.Single + Personal.Male.Married.Widowed + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + OtherDebtorsGuarantors.Guarantor +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## Property.Unknown + OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## OtherInstallmentPlans.None + Housing.Rent + Housing.Own +
## Housing.ForFree + Job.UnemployedUnskilled + Job.UnskilledResident +
## Job.SkilledEmployee + Job.Management.SelfEmp.HighlyQualified
##
##
## Step: AIC=636.28
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CheckingAccountStatus.none +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + CreditHistory.Critical +
## Purpose.NewCar + Purpose.UsedCar + Purpose.Furniture.Equipment +
## Purpose.Radio.Television + Purpose.DomesticAppliance + Purpose.Repairs +
## Purpose.Education + Purpose.Retraining + Purpose.Business +
## Purpose.Other + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + SavingsAccountBonds.gt.1000 +
## SavingsAccountBonds.Unknown + EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 +
## EmploymentDuration.4.to.7 + EmploymentDuration.gt.7 + EmploymentDuration.Unemployed +
## Personal.Male.Divorced.Seperated + Personal.Female.NotSingle +
## Personal.Male.Single + Personal.Male.Married.Widowed + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + OtherDebtorsGuarantors.Guarantor +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## Property.Unknown + OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## OtherInstallmentPlans.None + Housing.Rent + Housing.Own +
## Housing.ForFree + Job.UnemployedUnskilled + Job.UnskilledResident +
## Job.SkilledEmployee
##
##
## Step: AIC=636.28
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CheckingAccountStatus.none +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + CreditHistory.Critical +
## Purpose.NewCar + Purpose.UsedCar + Purpose.Furniture.Equipment +
## Purpose.Radio.Television + Purpose.DomesticAppliance + Purpose.Repairs +
## Purpose.Education + Purpose.Retraining + Purpose.Business +
## Purpose.Other + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + SavingsAccountBonds.gt.1000 +
## SavingsAccountBonds.Unknown + EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 +
## EmploymentDuration.4.to.7 + EmploymentDuration.gt.7 + EmploymentDuration.Unemployed +
## Personal.Male.Divorced.Seperated + Personal.Female.NotSingle +
## Personal.Male.Single + Personal.Male.Married.Widowed + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + OtherDebtorsGuarantors.Guarantor +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## Property.Unknown + OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## OtherInstallmentPlans.None + Housing.Rent + Housing.Own +
## Job.UnemployedUnskilled + Job.UnskilledResident + Job.SkilledEmployee
##
##
## Step: AIC=636.28
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CheckingAccountStatus.none +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + CreditHistory.Critical +
## Purpose.NewCar + Purpose.UsedCar + Purpose.Furniture.Equipment +
## Purpose.Radio.Television + Purpose.DomesticAppliance + Purpose.Repairs +
## Purpose.Education + Purpose.Retraining + Purpose.Business +
## Purpose.Other + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + SavingsAccountBonds.gt.1000 +
## SavingsAccountBonds.Unknown + EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 +
## EmploymentDuration.4.to.7 + EmploymentDuration.gt.7 + EmploymentDuration.Unemployed +
## Personal.Male.Divorced.Seperated + Personal.Female.NotSingle +
## Personal.Male.Single + Personal.Male.Married.Widowed + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + OtherDebtorsGuarantors.Guarantor +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## Property.Unknown + OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Housing.Own + Job.UnemployedUnskilled + Job.UnskilledResident +
## Job.SkilledEmployee
##
##
## Step: AIC=636.28
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CheckingAccountStatus.none +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + CreditHistory.Critical +
## Purpose.NewCar + Purpose.UsedCar + Purpose.Furniture.Equipment +
## Purpose.Radio.Television + Purpose.DomesticAppliance + Purpose.Repairs +
## Purpose.Education + Purpose.Retraining + Purpose.Business +
## Purpose.Other + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + SavingsAccountBonds.gt.1000 +
## SavingsAccountBonds.Unknown + EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 +
## EmploymentDuration.4.to.7 + EmploymentDuration.gt.7 + EmploymentDuration.Unemployed +
## Personal.Male.Divorced.Seperated + Personal.Female.NotSingle +
## Personal.Male.Single + Personal.Male.Married.Widowed + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + OtherDebtorsGuarantors.Guarantor +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Housing.Own + Job.UnemployedUnskilled + Job.UnskilledResident +
## Job.SkilledEmployee
##
##
## Step: AIC=636.28
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CheckingAccountStatus.none +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + CreditHistory.Critical +
## Purpose.NewCar + Purpose.UsedCar + Purpose.Furniture.Equipment +
## Purpose.Radio.Television + Purpose.DomesticAppliance + Purpose.Repairs +
## Purpose.Education + Purpose.Retraining + Purpose.Business +
## Purpose.Other + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + SavingsAccountBonds.gt.1000 +
## SavingsAccountBonds.Unknown + EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 +
## EmploymentDuration.4.to.7 + EmploymentDuration.gt.7 + EmploymentDuration.Unemployed +
## Personal.Male.Divorced.Seperated + Personal.Female.NotSingle +
## Personal.Male.Single + Personal.Male.Married.Widowed + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + Property.RealEstate +
## Property.Insurance + Property.CarOther + OtherInstallmentPlans.Bank +
## OtherInstallmentPlans.Stores + Housing.Rent + Housing.Own +
## Job.UnemployedUnskilled + Job.UnskilledResident + Job.SkilledEmployee
##
##
## Step: AIC=636.28
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CheckingAccountStatus.none +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + CreditHistory.Critical +
## Purpose.NewCar + Purpose.UsedCar + Purpose.Furniture.Equipment +
## Purpose.Radio.Television + Purpose.DomesticAppliance + Purpose.Repairs +
## Purpose.Education + Purpose.Retraining + Purpose.Business +
## Purpose.Other + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + SavingsAccountBonds.gt.1000 +
## SavingsAccountBonds.Unknown + EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 +
## EmploymentDuration.4.to.7 + EmploymentDuration.gt.7 + EmploymentDuration.Unemployed +
## Personal.Male.Divorced.Seperated + Personal.Female.NotSingle +
## Personal.Male.Single + OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Housing.Own + Job.UnemployedUnskilled + Job.UnskilledResident +
## Job.SkilledEmployee
##
##
## Step: AIC=636.28
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CheckingAccountStatus.none +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + CreditHistory.Critical +
## Purpose.NewCar + Purpose.UsedCar + Purpose.Furniture.Equipment +
## Purpose.Radio.Television + Purpose.DomesticAppliance + Purpose.Repairs +
## Purpose.Education + Purpose.Retraining + Purpose.Business +
## Purpose.Other + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + SavingsAccountBonds.gt.1000 +
## SavingsAccountBonds.Unknown + EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 +
## EmploymentDuration.4.to.7 + EmploymentDuration.gt.7 + Personal.Male.Divorced.Seperated +
## Personal.Female.NotSingle + Personal.Male.Single + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + Property.RealEstate +
## Property.Insurance + Property.CarOther + OtherInstallmentPlans.Bank +
## OtherInstallmentPlans.Stores + Housing.Rent + Housing.Own +
## Job.UnemployedUnskilled + Job.UnskilledResident + Job.SkilledEmployee
##
##
## Step: AIC=636.28
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CheckingAccountStatus.none +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + CreditHistory.Critical +
## Purpose.NewCar + Purpose.UsedCar + Purpose.Furniture.Equipment +
## Purpose.Radio.Television + Purpose.DomesticAppliance + Purpose.Repairs +
## Purpose.Education + Purpose.Retraining + Purpose.Business +
## Purpose.Other + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + SavingsAccountBonds.gt.1000 +
## EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 + EmploymentDuration.4.to.7 +
## EmploymentDuration.gt.7 + Personal.Male.Divorced.Seperated +
## Personal.Female.NotSingle + Personal.Male.Single + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + Property.RealEstate +
## Property.Insurance + Property.CarOther + OtherInstallmentPlans.Bank +
## OtherInstallmentPlans.Stores + Housing.Rent + Housing.Own +
## Job.UnemployedUnskilled + Job.UnskilledResident + Job.SkilledEmployee
##
##
## Step: AIC=636.28
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CheckingAccountStatus.none +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + CreditHistory.Critical +
## Purpose.NewCar + Purpose.UsedCar + Purpose.Furniture.Equipment +
## Purpose.Radio.Television + Purpose.DomesticAppliance + Purpose.Repairs +
## Purpose.Education + Purpose.Retraining + Purpose.Business +
## SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + SavingsAccountBonds.gt.1000 +
## EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 + EmploymentDuration.4.to.7 +
## EmploymentDuration.gt.7 + Personal.Male.Divorced.Seperated +
## Personal.Female.NotSingle + Personal.Male.Single + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + Property.RealEstate +
## Property.Insurance + Property.CarOther + OtherInstallmentPlans.Bank +
## OtherInstallmentPlans.Stores + Housing.Rent + Housing.Own +
## Job.UnemployedUnskilled + Job.UnskilledResident + Job.SkilledEmployee
##
##
## Step: AIC=636.28
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CheckingAccountStatus.none +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + Purpose.NewCar +
## Purpose.UsedCar + Purpose.Furniture.Equipment + Purpose.Radio.Television +
## Purpose.DomesticAppliance + Purpose.Repairs + Purpose.Education +
## Purpose.Retraining + Purpose.Business + SavingsAccountBonds.lt.100 +
## SavingsAccountBonds.100.to.500 + SavingsAccountBonds.500.to.1000 +
## SavingsAccountBonds.gt.1000 + EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 +
## EmploymentDuration.4.to.7 + EmploymentDuration.gt.7 + Personal.Male.Divorced.Seperated +
## Personal.Female.NotSingle + Personal.Male.Single + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + Property.RealEstate +
## Property.Insurance + Property.CarOther + OtherInstallmentPlans.Bank +
## OtherInstallmentPlans.Stores + Housing.Rent + Housing.Own +
## Job.UnemployedUnskilled + Job.UnskilledResident + Job.SkilledEmployee
##
##
## Step: AIC=636.28
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## CreditHistory.Delay + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Furniture.Equipment + Purpose.Radio.Television +
## Purpose.DomesticAppliance + Purpose.Repairs + Purpose.Education +
## Purpose.Retraining + Purpose.Business + SavingsAccountBonds.lt.100 +
## SavingsAccountBonds.100.to.500 + SavingsAccountBonds.500.to.1000 +
## SavingsAccountBonds.gt.1000 + EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 +
## EmploymentDuration.4.to.7 + EmploymentDuration.gt.7 + Personal.Male.Divorced.Seperated +
## Personal.Female.NotSingle + Personal.Male.Single + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + Property.RealEstate +
## Property.Insurance + Property.CarOther + OtherInstallmentPlans.Bank +
## OtherInstallmentPlans.Stores + Housing.Rent + Housing.Own +
## Job.UnemployedUnskilled + Job.UnskilledResident + Job.SkilledEmployee
##
## Df Deviance AIC
## - Purpose.Radio.Television 1 538.28 634.28
## - EmploymentDuration.4.to.7 1 538.29 634.29
## - SavingsAccountBonds.gt.1000 1 538.34 634.34
## - Purpose.Business 1 538.35 634.35
## - Purpose.Furniture.Equipment 1 538.36 634.36
## - Personal.Male.Divorced.Seperated 1 538.37 634.37
## - Job.UnskilledResident 1 538.37 634.37
## - Purpose.UsedCar 1 538.43 634.43
## - Personal.Female.NotSingle 1 538.48 634.48
## - Job.SkilledEmployee 1 538.62 634.62
## - Purpose.DomesticAppliance 1 538.66 634.66
## - Purpose.Retraining 1 538.66 634.66
## - SavingsAccountBonds.500.to.1000 1 538.76 634.76
## - Purpose.Education 1 539.18 635.18
## - Duration 1 539.20 635.20
## - Purpose.NewCar 1 539.35 635.35
## - Purpose.Repairs 1 539.42 635.42
## - Housing.Own 1 539.50 635.50
## - CheckingAccountStatus.gt.200 1 539.60 635.60
## - CreditHistory.Delay 1 539.65 635.65
## - ResidenceDuration 1 539.82 635.82
## - Age 1 539.96 635.96
## - Job.UnemployedUnskilled 1 540.02 636.02
## - Telephone 1 540.04 636.04
## - EmploymentDuration.lt.1 1 540.26 636.26
## <none> 538.28 636.28
## - EmploymentDuration.gt.7 1 540.34 636.34
## - CreditHistory.NoCredit.AllPaid 1 540.46 636.46
## - OtherInstallmentPlans.Stores 1 540.57 636.57
## - EmploymentDuration.1.to.4 1 540.97 636.97
## - NumberExistingCredits 1 541.05 637.05
## - Property.Insurance 1 541.36 637.36
## - SavingsAccountBonds.100.to.500 1 541.60 637.60
## - OtherInstallmentPlans.Bank 1 542.41 638.41
## - ForeignWorker 1 542.50 638.50
## - NumberPeopleMaintenance 1 542.82 638.82
## - Housing.Rent 1 542.99 638.99
## - OtherDebtorsGuarantors.CoApplicant 1 543.09 639.09
## - Property.CarOther 1 543.21 639.21
## - Personal.Male.Single 1 543.28 639.28
## - Property.RealEstate 1 545.20 641.20
## - CreditHistory.PaidDuly 1 546.26 642.26
## - OtherDebtorsGuarantors.None 1 546.95 642.95
## - CreditHistory.ThisBank.AllPaid 1 547.54 643.54
## - Amount 1 549.64 645.64
## - InstallmentRatePercentage 1 549.93 645.93
## - SavingsAccountBonds.lt.100 1 553.41 649.41
## - CheckingAccountStatus.0.to.200 1 559.80 655.80
## - CheckingAccountStatus.lt.0 1 574.55 670.55
##
## Step: AIC=634.28
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## CreditHistory.Delay + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Furniture.Equipment + Purpose.DomesticAppliance +
## Purpose.Repairs + Purpose.Education + Purpose.Retraining +
## Purpose.Business + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + SavingsAccountBonds.gt.1000 +
## EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 + EmploymentDuration.4.to.7 +
## EmploymentDuration.gt.7 + Personal.Male.Divorced.Seperated +
## Personal.Female.NotSingle + Personal.Male.Single + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + Property.RealEstate +
## Property.Insurance + Property.CarOther + OtherInstallmentPlans.Bank +
## OtherInstallmentPlans.Stores + Housing.Rent + Housing.Own +
## Job.UnemployedUnskilled + Job.UnskilledResident + Job.SkilledEmployee
##
## Df Deviance AIC
## - EmploymentDuration.4.to.7 1 538.29 632.29
## - SavingsAccountBonds.gt.1000 1 538.34 632.34
## - Personal.Male.Divorced.Seperated 1 538.37 632.37
## - Job.UnskilledResident 1 538.37 632.37
## - Personal.Female.NotSingle 1 538.48 632.48
## - Job.SkilledEmployee 1 538.62 632.62
## - Purpose.Business 1 538.68 632.68
## - Purpose.Retraining 1 538.69 632.69
## - SavingsAccountBonds.500.to.1000 1 538.76 632.76
## - Purpose.UsedCar 1 538.93 632.93
## - Purpose.DomesticAppliance 1 539.00 633.00
## - Purpose.Furniture.Equipment 1 539.03 633.03
## - Duration 1 539.21 633.21
## - Housing.Own 1 539.50 633.50
## - CheckingAccountStatus.gt.200 1 539.60 633.60
## - CreditHistory.Delay 1 539.66 633.66
## - ResidenceDuration 1 539.83 633.83
## - Age 1 539.96 633.96
## - Job.UnemployedUnskilled 1 540.02 634.02
## - Telephone 1 540.05 634.05
## - EmploymentDuration.lt.1 1 540.27 634.27
## <none> 538.28 634.28
## - EmploymentDuration.gt.7 1 540.34 634.34
## - CreditHistory.NoCredit.AllPaid 1 540.46 634.46
## - OtherInstallmentPlans.Stores 1 540.58 634.58
## - EmploymentDuration.1.to.4 1 540.97 634.97
## - NumberExistingCredits 1 541.05 635.05
## - Property.Insurance 1 541.36 635.36
## - Purpose.Repairs 1 541.53 635.53
## - SavingsAccountBonds.100.to.500 1 541.60 635.60
## - Purpose.Education 1 541.97 635.97
## + Purpose.Radio.Television 1 538.28 636.28
## + Purpose.Other 1 538.28 636.28
## - OtherInstallmentPlans.Bank 1 542.44 636.44
## - ForeignWorker 1 542.51 636.51
## - NumberPeopleMaintenance 1 542.87 636.87
## - Housing.Rent 1 542.99 636.99
## - OtherDebtorsGuarantors.CoApplicant 1 543.18 637.18
## - Property.CarOther 1 543.21 637.21
## - Personal.Male.Single 1 543.28 637.28
## - Property.RealEstate 1 545.20 639.20
## - CreditHistory.PaidDuly 1 546.31 640.31
## - OtherDebtorsGuarantors.None 1 546.95 640.95
## - CreditHistory.ThisBank.AllPaid 1 547.54 641.54
## - Purpose.NewCar 1 548.06 642.06
## - Amount 1 549.88 643.88
## - InstallmentRatePercentage 1 549.94 643.94
## - SavingsAccountBonds.lt.100 1 553.42 647.42
## - CheckingAccountStatus.0.to.200 1 559.86 653.86
## - CheckingAccountStatus.lt.0 1 574.60 668.60
##
## Step: AIC=632.29
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## CreditHistory.Delay + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Furniture.Equipment + Purpose.DomesticAppliance +
## Purpose.Repairs + Purpose.Education + Purpose.Retraining +
## Purpose.Business + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + SavingsAccountBonds.gt.1000 +
## EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 +
## Personal.Male.Divorced.Seperated + Personal.Female.NotSingle +
## Personal.Male.Single + OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Housing.Own + Job.UnemployedUnskilled + Job.UnskilledResident +
## Job.SkilledEmployee
##
## Df Deviance AIC
## - SavingsAccountBonds.gt.1000 1 538.36 630.36
## - Job.UnskilledResident 1 538.37 630.37
## - Personal.Male.Divorced.Seperated 1 538.38 630.38
## - Personal.Female.NotSingle 1 538.50 630.50
## - Purpose.Business 1 538.70 630.70
## - Job.SkilledEmployee 1 538.70 630.70
## - Purpose.Retraining 1 538.70 630.70
## - SavingsAccountBonds.500.to.1000 1 538.77 630.77
## - Purpose.UsedCar 1 538.95 630.95
## - Purpose.DomesticAppliance 1 539.01 631.01
## - Purpose.Furniture.Equipment 1 539.04 631.04
## - Duration 1 539.27 631.27
## - Housing.Own 1 539.53 631.53
## - CheckingAccountStatus.gt.200 1 539.64 631.64
## - CreditHistory.Delay 1 539.67 631.67
## - ResidenceDuration 1 539.83 631.83
## - Age 1 540.02 632.02
## - Job.UnemployedUnskilled 1 540.04 632.04
## - Telephone 1 540.05 632.05
## <none> 538.29 632.29
## - CreditHistory.NoCredit.AllPaid 1 540.47 632.47
## - OtherInstallmentPlans.Stores 1 540.58 632.58
## - NumberExistingCredits 1 541.07 633.07
## - Property.Insurance 1 541.37 633.37
## - Purpose.Repairs 1 541.53 633.53
## - SavingsAccountBonds.100.to.500 1 541.63 633.63
## - Purpose.Education 1 542.00 634.00
## - EmploymentDuration.gt.7 1 542.06 634.06
## - EmploymentDuration.lt.1 1 542.08 634.08
## + EmploymentDuration.4.to.7 1 538.28 634.28
## + EmploymentDuration.Unemployed 1 538.28 634.28
## + Purpose.Radio.Television 1 538.29 634.29
## + Purpose.Other 1 538.29 634.29
## - OtherInstallmentPlans.Bank 1 542.47 634.47
## - ForeignWorker 1 542.51 634.51
## - NumberPeopleMaintenance 1 542.90 634.90
## - Housing.Rent 1 543.10 635.10
## - OtherDebtorsGuarantors.CoApplicant 1 543.19 635.19
## - Property.CarOther 1 543.22 635.22
## - Personal.Male.Single 1 543.28 635.28
## - EmploymentDuration.1.to.4 1 544.38 636.38
## - Property.RealEstate 1 545.20 637.20
## - CreditHistory.PaidDuly 1 546.32 638.32
## - OtherDebtorsGuarantors.None 1 546.95 638.95
## - CreditHistory.ThisBank.AllPaid 1 547.68 639.68
## - Purpose.NewCar 1 548.06 640.06
## - Amount 1 549.88 641.88
## - InstallmentRatePercentage 1 549.97 641.97
## - SavingsAccountBonds.lt.100 1 553.42 645.42
## - CheckingAccountStatus.0.to.200 1 559.88 651.88
## - CheckingAccountStatus.lt.0 1 574.76 666.76
##
## Step: AIC=630.36
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## CreditHistory.Delay + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Furniture.Equipment + Purpose.DomesticAppliance +
## Purpose.Repairs + Purpose.Education + Purpose.Retraining +
## Purpose.Business + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Male.Divorced.Seperated +
## Personal.Female.NotSingle + Personal.Male.Single + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + Property.RealEstate +
## Property.Insurance + Property.CarOther + OtherInstallmentPlans.Bank +
## OtherInstallmentPlans.Stores + Housing.Rent + Housing.Own +
## Job.UnemployedUnskilled + Job.UnskilledResident + Job.SkilledEmployee
##
## Df Deviance AIC
## - Job.UnskilledResident 1 538.44 628.44
## - Personal.Male.Divorced.Seperated 1 538.44 628.44
## - Personal.Female.NotSingle 1 538.56 628.56
## - Purpose.Business 1 538.76 628.76
## - Job.SkilledEmployee 1 538.77 628.77
## - Purpose.Retraining 1 538.77 628.77
## - SavingsAccountBonds.500.to.1000 1 538.78 628.78
## - Purpose.UsedCar 1 539.01 629.01
## - Purpose.DomesticAppliance 1 539.05 629.05
## - Purpose.Furniture.Equipment 1 539.11 629.11
## - Duration 1 539.29 629.29
## - Housing.Own 1 539.58 629.58
## - CheckingAccountStatus.gt.200 1 539.70 629.70
## - CreditHistory.Delay 1 539.72 629.72
## - ResidenceDuration 1 539.86 629.86
## - Age 1 540.06 630.06
## - Job.UnemployedUnskilled 1 540.08 630.08
## - Telephone 1 540.12 630.12
## <none> 538.36 630.36
## - CreditHistory.NoCredit.AllPaid 1 540.50 630.50
## - OtherInstallmentPlans.Stores 1 540.69 630.69
## - NumberExistingCredits 1 541.14 631.14
## - Property.Insurance 1 541.42 631.42
## - SavingsAccountBonds.100.to.500 1 541.70 631.70
## - Purpose.Repairs 1 541.73 631.73
## - Purpose.Education 1 542.10 632.10
## - EmploymentDuration.gt.7 1 542.13 632.13
## - EmploymentDuration.lt.1 1 542.18 632.18
## + SavingsAccountBonds.gt.1000 1 538.29 632.29
## + SavingsAccountBonds.Unknown 1 538.29 632.29
## + EmploymentDuration.4.to.7 1 538.34 632.34
## + EmploymentDuration.Unemployed 1 538.34 632.34
## + Purpose.Other 1 538.36 632.36
## + Purpose.Radio.Television 1 538.36 632.36
## - OtherInstallmentPlans.Bank 1 542.54 632.54
## - ForeignWorker 1 542.57 632.57
## - NumberPeopleMaintenance 1 543.03 633.03
## - Housing.Rent 1 543.13 633.13
## - OtherDebtorsGuarantors.CoApplicant 1 543.24 633.24
## - Property.CarOther 1 543.27 633.27
## - Personal.Male.Single 1 543.43 633.43
## - EmploymentDuration.1.to.4 1 544.46 634.46
## - Property.RealEstate 1 545.24 635.24
## - CreditHistory.PaidDuly 1 546.35 636.35
## - OtherDebtorsGuarantors.None 1 547.05 637.05
## - CreditHistory.ThisBank.AllPaid 1 547.73 637.73
## - Purpose.NewCar 1 548.15 638.15
## - Amount 1 549.92 639.92
## - InstallmentRatePercentage 1 550.07 640.07
## - SavingsAccountBonds.lt.100 1 555.63 645.63
## - CheckingAccountStatus.0.to.200 1 560.17 650.17
## - CheckingAccountStatus.lt.0 1 575.02 665.02
##
## Step: AIC=628.44
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## CreditHistory.Delay + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Furniture.Equipment + Purpose.DomesticAppliance +
## Purpose.Repairs + Purpose.Education + Purpose.Retraining +
## Purpose.Business + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Male.Divorced.Seperated +
## Personal.Female.NotSingle + Personal.Male.Single + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + Property.RealEstate +
## Property.Insurance + Property.CarOther + OtherInstallmentPlans.Bank +
## OtherInstallmentPlans.Stores + Housing.Rent + Housing.Own +
## Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - Personal.Male.Divorced.Seperated 1 538.53 626.53
## - Personal.Female.NotSingle 1 538.65 626.65
## - Purpose.Business 1 538.81 626.81
## - SavingsAccountBonds.500.to.1000 1 538.85 626.85
## - Purpose.Retraining 1 538.87 626.87
## - Purpose.UsedCar 1 539.13 627.13
## - Purpose.DomesticAppliance 1 539.13 627.13
## - Purpose.Furniture.Equipment 1 539.18 627.18
## - Duration 1 539.35 627.35
## - Housing.Own 1 539.66 627.66
## - CheckingAccountStatus.gt.200 1 539.82 627.82
## - CreditHistory.Delay 1 539.83 627.83
## - ResidenceDuration 1 539.88 627.88
## - Job.SkilledEmployee 1 539.95 627.95
## - Telephone 1 540.14 628.14
## - Age 1 540.16 628.16
## <none> 538.44 628.44
## - Job.UnemployedUnskilled 1 540.56 628.56
## - CreditHistory.NoCredit.AllPaid 1 540.61 628.61
## - OtherInstallmentPlans.Stores 1 540.79 628.79
## - NumberExistingCredits 1 541.26 629.26
## - Property.Insurance 1 541.68 629.68
## - Purpose.Repairs 1 541.73 629.73
## - SavingsAccountBonds.100.to.500 1 541.73 629.73
## - Purpose.Education 1 542.11 630.11
## - EmploymentDuration.gt.7 1 542.16 630.16
## - EmploymentDuration.lt.1 1 542.18 630.18
## + Job.UnskilledResident 1 538.36 630.36
## + Job.Management.SelfEmp.HighlyQualified 1 538.36 630.36
## + SavingsAccountBonds.gt.1000 1 538.37 630.37
## + SavingsAccountBonds.Unknown 1 538.37 630.37
## + EmploymentDuration.4.to.7 1 538.44 630.44
## + EmploymentDuration.Unemployed 1 538.44 630.44
## + Purpose.Radio.Television 1 538.44 630.44
## + Purpose.Other 1 538.44 630.44
## - OtherInstallmentPlans.Bank 1 542.57 630.57
## - ForeignWorker 1 542.69 630.69
## - NumberPeopleMaintenance 1 543.03 631.03
## - Housing.Rent 1 543.25 631.25
## - OtherDebtorsGuarantors.CoApplicant 1 543.40 631.40
## - Property.CarOther 1 543.50 631.50
## - Personal.Male.Single 1 543.54 631.54
## - EmploymentDuration.1.to.4 1 544.47 632.47
## - Property.RealEstate 1 545.78 633.78
## - CreditHistory.PaidDuly 1 546.40 634.40
## - OtherDebtorsGuarantors.None 1 547.24 635.24
## - CreditHistory.ThisBank.AllPaid 1 547.79 635.79
## - Purpose.NewCar 1 548.16 636.16
## - InstallmentRatePercentage 1 550.48 638.48
## - Amount 1 550.71 638.71
## - SavingsAccountBonds.lt.100 1 555.65 643.65
## - CheckingAccountStatus.0.to.200 1 560.54 648.54
## - CheckingAccountStatus.lt.0 1 575.26 663.26
##
## Step: AIC=626.53
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## CreditHistory.Delay + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Furniture.Equipment + Purpose.DomesticAppliance +
## Purpose.Repairs + Purpose.Education + Purpose.Retraining +
## Purpose.Business + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## SavingsAccountBonds.500.to.1000 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Female.NotSingle +
## Personal.Male.Single + OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Housing.Own + Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - SavingsAccountBonds.500.to.1000 1 538.94 624.94
## - Purpose.Retraining 1 538.95 624.95
## - Purpose.Business 1 538.96 624.96
## - Personal.Female.NotSingle 1 539.03 625.03
## - Purpose.UsedCar 1 539.23 625.23
## - Purpose.DomesticAppliance 1 539.26 625.26
## - Purpose.Furniture.Equipment 1 539.40 625.40
## - Duration 1 539.44 625.44
## - Housing.Own 1 539.80 625.80
## - CheckingAccountStatus.gt.200 1 539.96 625.96
## - ResidenceDuration 1 539.96 625.96
## - CreditHistory.Delay 1 539.97 625.97
## - Job.SkilledEmployee 1 540.02 626.02
## - Age 1 540.17 626.17
## - Telephone 1 540.26 626.26
## <none> 538.53 626.53
## - Job.UnemployedUnskilled 1 540.65 626.65
## - CreditHistory.NoCredit.AllPaid 1 540.70 626.70
## - OtherInstallmentPlans.Stores 1 540.86 626.86
## - NumberExistingCredits 1 541.37 627.37
## - Purpose.Repairs 1 541.80 627.80
## - SavingsAccountBonds.100.to.500 1 541.83 627.83
## - Property.Insurance 1 541.89 627.89
## - Purpose.Education 1 542.24 628.24
## - EmploymentDuration.lt.1 1 542.30 628.30
## - EmploymentDuration.gt.7 1 542.41 628.41
## + Personal.Male.Divorced.Seperated 1 538.44 628.44
## + Personal.Male.Married.Widowed 1 538.44 628.44
## + Job.UnskilledResident 1 538.44 628.44
## + Job.Management.SelfEmp.HighlyQualified 1 538.44 628.44
## + SavingsAccountBonds.gt.1000 1 538.47 628.47
## + SavingsAccountBonds.Unknown 1 538.47 628.47
## + EmploymentDuration.4.to.7 1 538.53 628.53
## + EmploymentDuration.Unemployed 1 538.53 628.53
## + Purpose.Radio.Television 1 538.53 628.53
## + Purpose.Other 1 538.53 628.53
## - OtherInstallmentPlans.Bank 1 542.60 628.60
## - ForeignWorker 1 542.78 628.78
## - NumberPeopleMaintenance 1 543.18 629.18
## - Housing.Rent 1 543.40 629.40
## - OtherDebtorsGuarantors.CoApplicant 1 543.50 629.50
## - Property.CarOther 1 543.67 629.67
## - EmploymentDuration.1.to.4 1 544.63 630.63
## - Property.RealEstate 1 546.04 632.04
## - CreditHistory.PaidDuly 1 546.56 632.56
## - Personal.Male.Single 1 547.14 633.14
## - OtherDebtorsGuarantors.None 1 547.41 633.41
## - CreditHistory.ThisBank.AllPaid 1 548.04 634.04
## - Purpose.NewCar 1 548.48 634.48
## - InstallmentRatePercentage 1 550.49 636.49
## - Amount 1 551.06 637.06
## - SavingsAccountBonds.lt.100 1 555.95 641.95
## - CheckingAccountStatus.0.to.200 1 560.67 646.67
## - CheckingAccountStatus.lt.0 1 575.65 661.65
##
## Step: AIC=624.94
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## CreditHistory.Delay + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Furniture.Equipment + Purpose.DomesticAppliance +
## Purpose.Repairs + Purpose.Education + Purpose.Retraining +
## Purpose.Business + SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 +
## Personal.Female.NotSingle + Personal.Male.Single + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + Property.RealEstate +
## Property.Insurance + Property.CarOther + OtherInstallmentPlans.Bank +
## OtherInstallmentPlans.Stores + Housing.Rent + Housing.Own +
## Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - Purpose.Business 1 539.29 623.29
## - Purpose.Retraining 1 539.39 623.39
## - Personal.Female.NotSingle 1 539.46 623.46
## - Purpose.DomesticAppliance 1 539.65 623.65
## - Purpose.UsedCar 1 539.66 623.66
## - Purpose.Furniture.Equipment 1 539.83 623.83
## - Duration 1 539.87 623.87
## - Housing.Own 1 540.21 624.21
## - CreditHistory.Delay 1 540.34 624.34
## - CheckingAccountStatus.gt.200 1 540.36 624.36
## - ResidenceDuration 1 540.37 624.37
## - Job.SkilledEmployee 1 540.47 624.47
## - Age 1 540.58 624.58
## - Telephone 1 540.62 624.62
## <none> 538.94 624.94
## - Job.UnemployedUnskilled 1 541.11 625.11
## - CreditHistory.NoCredit.AllPaid 1 541.22 625.22
## - OtherInstallmentPlans.Stores 1 541.39 625.39
## - NumberExistingCredits 1 541.80 625.80
## - SavingsAccountBonds.100.to.500 1 541.87 625.87
## - Purpose.Repairs 1 542.12 626.12
## - Property.Insurance 1 542.36 626.36
## - Purpose.Education 1 542.46 626.46
## + SavingsAccountBonds.500.to.1000 1 538.53 626.53
## + SavingsAccountBonds.Unknown 1 538.57 626.57
## - EmploymentDuration.lt.1 1 542.75 626.75
## - EmploymentDuration.gt.7 1 542.78 626.78
## - OtherInstallmentPlans.Bank 1 542.83 626.83
## + Personal.Male.Divorced.Seperated 1 538.85 626.85
## + Personal.Male.Married.Widowed 1 538.85 626.85
## + Job.UnskilledResident 1 538.87 626.87
## + Job.Management.SelfEmp.HighlyQualified 1 538.87 626.87
## + SavingsAccountBonds.gt.1000 1 538.93 626.93
## + EmploymentDuration.4.to.7 1 538.94 626.94
## + EmploymentDuration.Unemployed 1 538.94 626.94
## + Purpose.Radio.Television 1 538.94 626.94
## + Purpose.Other 1 538.94 626.94
## - ForeignWorker 1 543.16 627.16
## - NumberPeopleMaintenance 1 543.51 627.51
## - Housing.Rent 1 543.81 627.81
## - OtherDebtorsGuarantors.CoApplicant 1 543.87 627.87
## - Property.CarOther 1 544.10 628.10
## - EmploymentDuration.1.to.4 1 545.00 629.00
## - Property.RealEstate 1 546.44 630.44
## - CreditHistory.PaidDuly 1 546.99 630.99
## - Personal.Male.Single 1 547.49 631.49
## - OtherDebtorsGuarantors.None 1 547.92 631.92
## - Purpose.NewCar 1 548.67 632.67
## - CreditHistory.ThisBank.AllPaid 1 548.99 632.99
## - InstallmentRatePercentage 1 550.53 634.53
## - Amount 1 551.21 635.21
## - SavingsAccountBonds.lt.100 1 557.16 641.16
## - CheckingAccountStatus.0.to.200 1 560.92 644.92
## - CheckingAccountStatus.lt.0 1 575.85 659.85
##
## Step: AIC=623.29
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## CreditHistory.Delay + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Furniture.Equipment + Purpose.DomesticAppliance +
## Purpose.Repairs + Purpose.Education + Purpose.Retraining +
## SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 +
## Personal.Female.NotSingle + Personal.Male.Single + OtherDebtorsGuarantors.None +
## OtherDebtorsGuarantors.CoApplicant + Property.RealEstate +
## Property.Insurance + Property.CarOther + OtherInstallmentPlans.Bank +
## OtherInstallmentPlans.Stores + Housing.Rent + Housing.Own +
## Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - Purpose.Retraining 1 539.78 621.78
## - Personal.Female.NotSingle 1 539.84 621.84
## - Purpose.Furniture.Equipment 1 539.92 621.92
## - Purpose.DomesticAppliance 1 539.93 621.93
## - Duration 1 540.32 622.32
## - Purpose.UsedCar 1 540.41 622.41
## - Housing.Own 1 540.60 622.60
## - ResidenceDuration 1 540.64 622.64
## - CheckingAccountStatus.gt.200 1 540.77 622.77
## - CreditHistory.Delay 1 540.80 622.80
## - Age 1 540.85 622.85
## - Telephone 1 540.87 622.87
## - Job.SkilledEmployee 1 540.89 622.89
## <none> 539.29 623.29
## - Job.UnemployedUnskilled 1 541.55 623.55
## - OtherInstallmentPlans.Stores 1 541.79 623.79
## - CreditHistory.NoCredit.AllPaid 1 542.01 624.01
## - Purpose.Repairs 1 542.20 624.20
## - SavingsAccountBonds.100.to.500 1 542.22 624.22
## - NumberExistingCredits 1 542.24 624.24
## - Purpose.Education 1 542.50 624.50
## - Property.Insurance 1 542.68 624.68
## + Purpose.Business 1 538.94 624.94
## + SavingsAccountBonds.500.to.1000 1 538.96 624.96
## + SavingsAccountBonds.Unknown 1 538.97 624.97
## + Purpose.Radio.Television 1 538.98 624.98
## - EmploymentDuration.lt.1 1 543.06 625.06
## - EmploymentDuration.gt.7 1 543.07 625.07
## - OtherInstallmentPlans.Bank 1 543.13 625.13
## + Personal.Male.Divorced.Seperated 1 539.15 625.15
## + Personal.Male.Married.Widowed 1 539.15 625.15
## + Job.UnskilledResident 1 539.25 625.25
## + Job.Management.SelfEmp.HighlyQualified 1 539.25 625.25
## + SavingsAccountBonds.gt.1000 1 539.28 625.28
## + EmploymentDuration.4.to.7 1 539.29 625.29
## + EmploymentDuration.Unemployed 1 539.29 625.29
## + Purpose.Other 1 539.29 625.29
## - ForeignWorker 1 543.58 625.58
## - NumberPeopleMaintenance 1 543.84 625.84
## - OtherDebtorsGuarantors.CoApplicant 1 544.07 626.07
## - Housing.Rent 1 544.33 626.33
## - Property.CarOther 1 544.48 626.48
## - EmploymentDuration.1.to.4 1 545.31 627.31
## - Property.RealEstate 1 546.80 628.80
## - CreditHistory.PaidDuly 1 547.24 629.24
## - Personal.Male.Single 1 547.88 629.88
## - OtherDebtorsGuarantors.None 1 548.44 630.44
## - Purpose.NewCar 1 549.08 631.08
## - CreditHistory.ThisBank.AllPaid 1 549.79 631.79
## - InstallmentRatePercentage 1 550.81 632.81
## - Amount 1 551.74 633.74
## - SavingsAccountBonds.lt.100 1 557.36 639.36
## - CheckingAccountStatus.0.to.200 1 561.61 643.61
## - CheckingAccountStatus.lt.0 1 576.09 658.09
##
## Step: AIC=621.78
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## CreditHistory.Delay + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Furniture.Equipment + Purpose.DomesticAppliance +
## Purpose.Repairs + Purpose.Education + SavingsAccountBonds.lt.100 +
## SavingsAccountBonds.100.to.500 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Female.NotSingle +
## Personal.Male.Single + OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Housing.Own + Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - Personal.Female.NotSingle 1 540.34 620.34
## - Purpose.DomesticAppliance 1 540.43 620.43
## - Purpose.Furniture.Equipment 1 540.45 620.45
## - Duration 1 540.83 620.83
## - Purpose.UsedCar 1 540.87 620.87
## - Housing.Own 1 541.08 621.08
## - ResidenceDuration 1 541.09 621.09
## - CheckingAccountStatus.gt.200 1 541.25 621.25
## - CreditHistory.Delay 1 541.29 621.29
## - Age 1 541.32 621.32
## - Telephone 1 541.36 621.36
## - Job.SkilledEmployee 1 541.38 621.38
## <none> 539.78 621.78
## - Job.UnemployedUnskilled 1 542.05 622.05
## - OtherInstallmentPlans.Stores 1 542.32 622.32
## - CreditHistory.NoCredit.AllPaid 1 542.42 622.42
## - NumberExistingCredits 1 542.65 622.65
## - Purpose.Repairs 1 542.75 622.75
## - SavingsAccountBonds.100.to.500 1 542.81 622.81
## - Purpose.Education 1 543.05 623.05
## - Property.Insurance 1 543.22 623.22
## + Purpose.Retraining 1 539.29 623.29
## + Purpose.Business 1 539.39 623.39
## + SavingsAccountBonds.Unknown 1 539.42 623.42
## + SavingsAccountBonds.500.to.1000 1 539.42 623.42
## - EmploymentDuration.gt.7 1 543.51 623.51
## + Purpose.Radio.Television 1 539.54 623.54
## - EmploymentDuration.lt.1 1 543.58 623.58
## + Personal.Male.Divorced.Seperated 1 539.64 623.64
## + Personal.Male.Married.Widowed 1 539.64 623.64
## - OtherInstallmentPlans.Bank 1 543.69 623.69
## + Job.UnskilledResident 1 539.73 623.73
## + Job.Management.SelfEmp.HighlyQualified 1 539.73 623.73
## + SavingsAccountBonds.gt.1000 1 539.76 623.76
## + EmploymentDuration.4.to.7 1 539.77 623.77
## + EmploymentDuration.Unemployed 1 539.77 623.77
## + Purpose.Other 1 539.78 623.78
## - ForeignWorker 1 544.07 624.07
## - NumberPeopleMaintenance 1 544.42 624.42
## - OtherDebtorsGuarantors.CoApplicant 1 544.55 624.55
## - Housing.Rent 1 544.82 624.82
## - Property.CarOther 1 544.94 624.94
## - EmploymentDuration.1.to.4 1 545.80 625.80
## - Property.RealEstate 1 547.29 627.29
## - CreditHistory.PaidDuly 1 547.59 627.59
## - Personal.Male.Single 1 548.55 628.55
## - OtherDebtorsGuarantors.None 1 548.90 628.90
## - Purpose.NewCar 1 549.80 629.80
## - CreditHistory.ThisBank.AllPaid 1 550.18 630.18
## - InstallmentRatePercentage 1 551.35 631.35
## - Amount 1 552.36 632.36
## - SavingsAccountBonds.lt.100 1 558.15 638.15
## - CheckingAccountStatus.0.to.200 1 561.88 641.88
## - CheckingAccountStatus.lt.0 1 576.59 656.59
##
## Step: AIC=620.34
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## CreditHistory.Delay + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Furniture.Equipment + Purpose.DomesticAppliance +
## Purpose.Repairs + Purpose.Education + SavingsAccountBonds.lt.100 +
## SavingsAccountBonds.100.to.500 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Male.Single +
## OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Housing.Own + Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - Purpose.DomesticAppliance 1 540.88 618.88
## - Purpose.Furniture.Equipment 1 540.93 618.93
## - Duration 1 541.39 619.39
## - Purpose.UsedCar 1 541.42 619.42
## - ResidenceDuration 1 541.47 619.47
## - Housing.Own 1 541.62 619.62
## - Telephone 1 541.79 619.79
## - Age 1 541.80 619.80
## - CheckingAccountStatus.gt.200 1 541.88 619.88
## - Job.SkilledEmployee 1 541.90 619.90
## - CreditHistory.Delay 1 541.94 619.94
## - Job.UnemployedUnskilled 1 542.33 620.33
## <none> 540.34 620.34
## - OtherInstallmentPlans.Stores 1 542.76 620.76
## - CreditHistory.NoCredit.AllPaid 1 542.93 620.93
## - Purpose.Repairs 1 543.29 621.29
## - NumberExistingCredits 1 543.36 621.36
## - SavingsAccountBonds.100.to.500 1 543.43 621.43
## - Purpose.Education 1 543.44 621.44
## + Personal.Female.NotSingle 1 539.78 621.78
## - Property.Insurance 1 543.81 621.81
## + Purpose.Retraining 1 539.84 621.84
## + Personal.Male.Divorced.Seperated 1 539.85 621.85
## - EmploymentDuration.lt.1 1 543.92 621.92
## + Purpose.Business 1 539.92 621.92
## + SavingsAccountBonds.500.to.1000 1 539.97 621.97
## + SavingsAccountBonds.Unknown 1 539.97 621.97
## - EmploymentDuration.gt.7 1 544.09 622.09
## + Purpose.Radio.Television 1 540.10 622.10
## - OtherInstallmentPlans.Bank 1 544.11 622.11
## + Personal.Male.Married.Widowed 1 540.25 622.25
## + Job.Management.SelfEmp.HighlyQualified 1 540.30 622.30
## + Job.UnskilledResident 1 540.30 622.30
## + SavingsAccountBonds.gt.1000 1 540.32 622.32
## + EmploymentDuration.4.to.7 1 540.33 622.33
## + EmploymentDuration.Unemployed 1 540.33 622.33
## + Purpose.Other 1 540.34 622.34
## - ForeignWorker 1 544.36 622.36
## - NumberPeopleMaintenance 1 544.93 622.93
## - OtherDebtorsGuarantors.CoApplicant 1 545.16 623.16
## - Housing.Rent 1 545.29 623.29
## - Property.CarOther 1 545.49 623.49
## - EmploymentDuration.1.to.4 1 546.32 624.32
## - Property.RealEstate 1 547.72 625.72
## - CreditHistory.PaidDuly 1 548.11 626.11
## - OtherDebtorsGuarantors.None 1 549.44 627.44
## - Purpose.NewCar 1 550.03 628.03
## - Personal.Male.Single 1 550.72 628.72
## - CreditHistory.ThisBank.AllPaid 1 550.92 628.92
## - InstallmentRatePercentage 1 551.69 629.69
## - Amount 1 552.66 630.66
## - SavingsAccountBonds.lt.100 1 558.66 636.66
## - CheckingAccountStatus.0.to.200 1 563.17 641.17
## - CheckingAccountStatus.lt.0 1 577.31 655.31
##
## Step: AIC=618.88
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## CreditHistory.Delay + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Furniture.Equipment + Purpose.Repairs + Purpose.Education +
## SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 +
## Personal.Male.Single + OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Housing.Own + Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - Purpose.Furniture.Equipment 1 541.33 617.33
## - Duration 1 541.80 617.80
## - ResidenceDuration 1 541.96 617.96
## - Purpose.UsedCar 1 542.07 618.07
## - Housing.Own 1 542.15 618.15
## - Telephone 1 542.36 618.36
## - CheckingAccountStatus.gt.200 1 542.39 618.39
## - Age 1 542.40 618.40
## - CreditHistory.Delay 1 542.46 618.46
## - Job.SkilledEmployee 1 542.59 618.59
## - Job.UnemployedUnskilled 1 542.82 618.82
## <none> 540.88 618.88
## - OtherInstallmentPlans.Stores 1 543.24 619.24
## - CreditHistory.NoCredit.AllPaid 1 543.45 619.45
## - Purpose.Repairs 1 543.73 619.73
## - Purpose.Education 1 543.83 619.83
## - NumberExistingCredits 1 543.83 619.83
## - SavingsAccountBonds.100.to.500 1 544.03 620.03
## + Purpose.DomesticAppliance 1 540.34 620.34
## - Property.Insurance 1 544.35 620.35
## - EmploymentDuration.lt.1 1 544.36 620.36
## + Purpose.Retraining 1 540.37 620.37
## + Personal.Male.Divorced.Seperated 1 540.39 620.39
## + Purpose.Radio.Television 1 540.39 620.39
## + Personal.Female.NotSingle 1 540.43 620.43
## - EmploymentDuration.gt.7 1 544.48 620.48
## + SavingsAccountBonds.500.to.1000 1 540.52 620.52
## + Purpose.Business 1 540.54 620.54
## - OtherInstallmentPlans.Bank 1 544.55 620.55
## + SavingsAccountBonds.Unknown 1 540.56 620.56
## + Job.UnskilledResident 1 540.83 620.83
## + Job.Management.SelfEmp.HighlyQualified 1 540.83 620.83
## + Personal.Male.Married.Widowed 1 540.83 620.83
## + SavingsAccountBonds.gt.1000 1 540.87 620.87
## + Purpose.Other 1 540.88 620.88
## + EmploymentDuration.4.to.7 1 540.88 620.88
## + EmploymentDuration.Unemployed 1 540.88 620.88
## - ForeignWorker 1 544.97 620.97
## - NumberPeopleMaintenance 1 545.41 621.41
## - OtherDebtorsGuarantors.CoApplicant 1 545.69 621.69
## - Housing.Rent 1 545.82 621.82
## - Property.CarOther 1 546.11 622.11
## - EmploymentDuration.1.to.4 1 546.65 622.65
## - Property.RealEstate 1 548.30 624.30
## - CreditHistory.PaidDuly 1 548.60 624.60
## - OtherDebtorsGuarantors.None 1 550.09 626.09
## - Purpose.NewCar 1 550.16 626.16
## - CreditHistory.ThisBank.AllPaid 1 551.32 627.32
## - Personal.Male.Single 1 551.54 627.54
## - InstallmentRatePercentage 1 552.41 628.41
## - Amount 1 553.33 629.33
## - SavingsAccountBonds.lt.100 1 558.86 634.86
## - CheckingAccountStatus.0.to.200 1 563.50 639.50
## - CheckingAccountStatus.lt.0 1 578.61 654.61
##
## Step: AIC=617.33
## Class ~ Duration + Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## CreditHistory.Delay + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Repairs + Purpose.Education + SavingsAccountBonds.lt.100 +
## SavingsAccountBonds.100.to.500 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Male.Single +
## OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Housing.Own + Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - Duration 1 542.13 616.13
## - ResidenceDuration 1 542.50 616.50
## - Housing.Own 1 542.61 616.61
## - CreditHistory.Delay 1 542.77 616.77
## - Telephone 1 542.85 616.85
## - Age 1 542.91 616.91
## - CheckingAccountStatus.gt.200 1 542.93 616.93
## - Purpose.UsedCar 1 543.08 617.08
## - Job.SkilledEmployee 1 543.09 617.09
## - Job.UnemployedUnskilled 1 543.20 617.20
## <none> 541.33 617.33
## - OtherInstallmentPlans.Stores 1 543.68 617.68
## - CreditHistory.NoCredit.AllPaid 1 543.75 617.75
## - Purpose.Education 1 543.90 617.90
## - Purpose.Repairs 1 543.93 617.93
## - NumberExistingCredits 1 544.30 618.30
## - SavingsAccountBonds.100.to.500 1 544.36 618.36
## + Purpose.Radio.Television 1 540.40 618.40
## + Personal.Male.Divorced.Seperated 1 540.75 618.75
## + Purpose.Retraining 1 540.78 618.78
## - Property.Insurance 1 544.80 618.80
## - EmploymentDuration.lt.1 1 544.86 618.86
## - EmploymentDuration.gt.7 1 544.88 618.88
## + Purpose.Furniture.Equipment 1 540.88 618.88
## + Purpose.DomesticAppliance 1 540.93 618.93
## + Personal.Female.NotSingle 1 540.94 618.94
## + SavingsAccountBonds.500.to.1000 1 540.94 618.94
## - OtherInstallmentPlans.Bank 1 544.96 618.96
## + SavingsAccountBonds.Unknown 1 540.97 618.97
## + Purpose.Business 1 541.21 619.21
## + Job.UnskilledResident 1 541.28 619.28
## + Job.Management.SelfEmp.HighlyQualified 1 541.28 619.28
## + Purpose.Other 1 541.31 619.31
## + Personal.Male.Married.Widowed 1 541.32 619.32
## + SavingsAccountBonds.gt.1000 1 541.32 619.32
## + EmploymentDuration.4.to.7 1 541.33 619.33
## + EmploymentDuration.Unemployed 1 541.33 619.33
## - ForeignWorker 1 545.51 619.51
## - NumberPeopleMaintenance 1 545.76 619.76
## - OtherDebtorsGuarantors.CoApplicant 1 546.10 620.10
## - Housing.Rent 1 546.33 620.33
## - Property.CarOther 1 546.81 620.81
## - EmploymentDuration.1.to.4 1 547.11 621.11
## - CreditHistory.PaidDuly 1 548.92 622.92
## - Property.RealEstate 1 549.11 623.11
## - Purpose.NewCar 1 550.42 624.42
## - OtherDebtorsGuarantors.None 1 550.63 624.63
## - CreditHistory.ThisBank.AllPaid 1 551.77 625.77
## - Personal.Male.Single 1 552.12 626.12
## - InstallmentRatePercentage 1 552.59 626.59
## - Amount 1 553.99 627.99
## - SavingsAccountBonds.lt.100 1 559.46 633.46
## - CheckingAccountStatus.0.to.200 1 563.84 637.84
## - CheckingAccountStatus.lt.0 1 580.18 654.18
##
## Step: AIC=616.13
## Class ~ Amount + InstallmentRatePercentage + ResidenceDuration +
## Age + NumberExistingCredits + NumberPeopleMaintenance + Telephone +
## ForeignWorker + CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CheckingAccountStatus.gt.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## CreditHistory.Delay + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Repairs + Purpose.Education + SavingsAccountBonds.lt.100 +
## SavingsAccountBonds.100.to.500 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Male.Single +
## OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Housing.Own + Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - ResidenceDuration 1 543.29 615.29
## - Housing.Own 1 543.46 615.46
## - CheckingAccountStatus.gt.200 1 543.70 615.70
## - Telephone 1 543.82 615.82
## - Age 1 543.86 615.86
## - Purpose.UsedCar 1 543.87 615.87
## - CreditHistory.Delay 1 543.91 615.91
## - Job.UnemployedUnskilled 1 544.03 616.03
## <none> 542.13 616.13
## - Job.SkilledEmployee 1 544.44 616.44
## - OtherInstallmentPlans.Stores 1 544.64 616.64
## - Purpose.Repairs 1 544.66 616.66
## - CreditHistory.NoCredit.AllPaid 1 544.79 616.79
## - Purpose.Education 1 544.91 616.91
## - NumberExistingCredits 1 545.01 617.01
## - SavingsAccountBonds.100.to.500 1 545.27 617.27
## + Purpose.Radio.Television 1 541.30 617.30
## + Duration 1 541.33 617.33
## + Personal.Male.Divorced.Seperated 1 541.53 617.53
## + Purpose.Retraining 1 541.56 617.56
## - EmploymentDuration.lt.1 1 545.58 617.58
## - EmploymentDuration.gt.7 1 545.71 617.71
## + Personal.Female.NotSingle 1 541.72 617.72
## - OtherInstallmentPlans.Bank 1 545.73 617.73
## + SavingsAccountBonds.500.to.1000 1 541.75 617.75
## + Purpose.Furniture.Equipment 1 541.80 617.80
## + Purpose.DomesticAppliance 1 541.82 617.82
## + SavingsAccountBonds.Unknown 1 541.86 617.86
## - Property.Insurance 1 545.90 617.90
## + Purpose.Business 1 541.93 617.93
## + Purpose.Other 1 542.09 618.09
## + EmploymentDuration.4.to.7 1 542.11 618.11
## + EmploymentDuration.Unemployed 1 542.11 618.11
## + Job.UnskilledResident 1 542.11 618.11
## + Job.Management.SelfEmp.HighlyQualified 1 542.11 618.11
## + Personal.Male.Married.Widowed 1 542.12 618.12
## + SavingsAccountBonds.gt.1000 1 542.13 618.13
## - OtherDebtorsGuarantors.CoApplicant 1 546.57 618.57
## - ForeignWorker 1 546.69 618.69
## - NumberPeopleMaintenance 1 546.73 618.73
## - Housing.Rent 1 547.22 619.22
## - Property.CarOther 1 547.87 619.87
## - EmploymentDuration.1.to.4 1 547.88 619.88
## - CreditHistory.PaidDuly 1 549.76 621.76
## - Property.RealEstate 1 550.53 622.53
## - Purpose.NewCar 1 551.06 623.06
## - OtherDebtorsGuarantors.None 1 551.22 623.22
## - CreditHistory.ThisBank.AllPaid 1 552.94 624.94
## - Personal.Male.Single 1 552.97 624.97
## - InstallmentRatePercentage 1 555.47 627.47
## - SavingsAccountBonds.lt.100 1 560.20 632.20
## - CheckingAccountStatus.0.to.200 1 564.65 636.65
## - Amount 1 569.48 641.48
## - CheckingAccountStatus.lt.0 1 581.62 653.62
##
## Step: AIC=615.29
## Class ~ Amount + InstallmentRatePercentage + Age + NumberExistingCredits +
## NumberPeopleMaintenance + Telephone + ForeignWorker + CheckingAccountStatus.lt.0 +
## CheckingAccountStatus.0.to.200 + CheckingAccountStatus.gt.200 +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + Purpose.NewCar +
## Purpose.UsedCar + Purpose.Repairs + Purpose.Education + SavingsAccountBonds.lt.100 +
## SavingsAccountBonds.100.to.500 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Male.Single +
## OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Housing.Own + Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - Housing.Own 1 544.31 614.31
## - CheckingAccountStatus.gt.200 1 544.75 614.75
## - Telephone 1 544.75 614.75
## - Age 1 544.76 614.76
## - Purpose.UsedCar 1 544.85 614.85
## - CreditHistory.Delay 1 544.90 614.90
## - Job.UnemployedUnskilled 1 544.90 614.90
## <none> 543.29 615.29
## - Job.SkilledEmployee 1 545.62 615.62
## - CreditHistory.NoCredit.AllPaid 1 545.69 615.69
## - OtherInstallmentPlans.Stores 1 545.78 615.78
## - Purpose.Repairs 1 546.01 616.01
## + ResidenceDuration 1 542.13 616.13
## - Purpose.Education 1 546.14 616.14
## - NumberExistingCredits 1 546.31 616.31
## - EmploymentDuration.lt.1 1 546.38 616.38
## - SavingsAccountBonds.100.to.500 1 546.40 616.40
## + Purpose.Radio.Television 1 542.48 616.48
## + Duration 1 542.50 616.50
## + Purpose.Retraining 1 542.76 616.76
## + Personal.Male.Divorced.Seperated 1 542.81 616.81
## - OtherInstallmentPlans.Bank 1 546.84 616.84
## + Purpose.Furniture.Equipment 1 542.89 616.89
## + SavingsAccountBonds.500.to.1000 1 542.91 616.91
## + Purpose.DomesticAppliance 1 543.02 617.02
## + Personal.Female.NotSingle 1 543.04 617.04
## + SavingsAccountBonds.Unknown 1 543.06 617.06
## - Property.Insurance 1 547.10 617.10
## + Purpose.Business 1 543.16 617.16
## + Purpose.Other 1 543.25 617.25
## + EmploymentDuration.4.to.7 1 543.28 617.28
## + EmploymentDuration.Unemployed 1 543.28 617.28
## + Personal.Male.Married.Widowed 1 543.29 617.29
## + SavingsAccountBonds.gt.1000 1 543.29 617.29
## + Job.UnskilledResident 1 543.29 617.29
## + Job.Management.SelfEmp.HighlyQualified 1 543.29 617.29
## - EmploymentDuration.gt.7 1 547.43 617.43
## - OtherDebtorsGuarantors.CoApplicant 1 547.73 617.73
## - NumberPeopleMaintenance 1 547.82 617.82
## - ForeignWorker 1 547.88 617.88
## - Housing.Rent 1 548.36 618.36
## - EmploymentDuration.1.to.4 1 548.81 618.81
## - Property.CarOther 1 548.98 618.98
## - CreditHistory.PaidDuly 1 550.47 620.47
## - Property.RealEstate 1 551.63 621.63
## - Purpose.NewCar 1 552.07 622.07
## - OtherDebtorsGuarantors.None 1 552.31 622.31
## - Personal.Male.Single 1 554.12 624.12
## - CreditHistory.ThisBank.AllPaid 1 554.27 624.27
## - InstallmentRatePercentage 1 556.63 626.63
## - SavingsAccountBonds.lt.100 1 560.62 630.62
## - CheckingAccountStatus.0.to.200 1 565.39 635.39
## - Amount 1 570.37 640.37
## - CheckingAccountStatus.lt.0 1 583.02 653.02
##
## Step: AIC=614.31
## Class ~ Amount + InstallmentRatePercentage + Age + NumberExistingCredits +
## NumberPeopleMaintenance + Telephone + ForeignWorker + CheckingAccountStatus.lt.0 +
## CheckingAccountStatus.0.to.200 + CheckingAccountStatus.gt.200 +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + Purpose.NewCar +
## Purpose.UsedCar + Purpose.Repairs + Purpose.Education + SavingsAccountBonds.lt.100 +
## SavingsAccountBonds.100.to.500 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Male.Single +
## OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - Telephone 1 545.73 613.73
## - CheckingAccountStatus.gt.200 1 545.74 613.74
## - CreditHistory.Delay 1 545.84 613.84
## - Job.UnemployedUnskilled 1 545.88 613.88
## - Age 1 546.14 614.14
## - Purpose.UsedCar 1 546.22 614.22
## <none> 544.31 614.31
## - Job.SkilledEmployee 1 546.53 614.53
## - CreditHistory.NoCredit.AllPaid 1 546.69 614.69
## - OtherInstallmentPlans.Stores 1 546.98 614.98
## - Purpose.Education 1 547.05 615.05
## - Purpose.Repairs 1 547.20 615.20
## - NumberExistingCredits 1 547.27 615.27
## + Housing.Own 1 543.29 615.29
## + Housing.ForFree 1 543.29 615.29
## + ResidenceDuration 1 543.46 615.46
## + Purpose.Radio.Television 1 543.47 615.47
## + Duration 1 543.49 615.49
## - Property.Insurance 1 547.52 615.52
## - SavingsAccountBonds.100.to.500 1 547.60 615.60
## - EmploymentDuration.lt.1 1 547.63 615.63
## + Personal.Male.Divorced.Seperated 1 543.75 615.75
## + Purpose.Retraining 1 543.79 615.79
## + Purpose.Furniture.Equipment 1 543.92 615.92
## + SavingsAccountBonds.500.to.1000 1 543.94 615.94
## + Purpose.DomesticAppliance 1 544.05 616.05
## + Personal.Female.NotSingle 1 544.06 616.06
## + SavingsAccountBonds.Unknown 1 544.09 616.09
## - OtherInstallmentPlans.Bank 1 548.14 616.14
## + Purpose.Business 1 544.15 616.15
## + Purpose.Other 1 544.26 616.26
## + EmploymentDuration.4.to.7 1 544.29 616.29
## + EmploymentDuration.Unemployed 1 544.29 616.29
## + SavingsAccountBonds.gt.1000 1 544.31 616.31
## + Job.UnskilledResident 1 544.31 616.31
## + Job.Management.SelfEmp.HighlyQualified 1 544.31 616.31
## + Personal.Male.Married.Widowed 1 544.31 616.31
## - EmploymentDuration.gt.7 1 548.59 616.59
## - ForeignWorker 1 548.59 616.59
## - NumberPeopleMaintenance 1 548.62 616.62
## - OtherDebtorsGuarantors.CoApplicant 1 548.76 616.76
## - EmploymentDuration.1.to.4 1 550.00 618.00
## - Property.CarOther 1 550.51 618.51
## - CreditHistory.PaidDuly 1 551.15 619.15
## - Housing.Rent 1 552.32 620.32
## - Purpose.NewCar 1 552.79 620.79
## - OtherDebtorsGuarantors.None 1 553.01 621.01
## - Property.RealEstate 1 553.85 621.85
## - CreditHistory.ThisBank.AllPaid 1 554.96 622.96
## - Personal.Male.Single 1 554.98 622.98
## - InstallmentRatePercentage 1 557.79 625.79
## - SavingsAccountBonds.lt.100 1 561.44 629.44
## - CheckingAccountStatus.0.to.200 1 566.50 634.50
## - Amount 1 571.14 639.14
## - CheckingAccountStatus.lt.0 1 583.35 651.35
##
## Step: AIC=613.73
## Class ~ Amount + InstallmentRatePercentage + Age + NumberExistingCredits +
## NumberPeopleMaintenance + ForeignWorker + CheckingAccountStatus.lt.0 +
## CheckingAccountStatus.0.to.200 + CheckingAccountStatus.gt.200 +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + CreditHistory.Delay + Purpose.NewCar +
## Purpose.UsedCar + Purpose.Repairs + Purpose.Education + SavingsAccountBonds.lt.100 +
## SavingsAccountBonds.100.to.500 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Male.Single +
## OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - CreditHistory.Delay 1 547.16 613.16
## - CheckingAccountStatus.gt.200 1 547.31 613.31
## - Job.UnemployedUnskilled 1 547.45 613.45
## <none> 545.73 613.73
## - Purpose.UsedCar 1 547.80 613.80
## - Age 1 547.99 613.99
## - OtherInstallmentPlans.Stores 1 548.16 614.16
## - Job.SkilledEmployee 1 548.22 614.22
## - CreditHistory.NoCredit.AllPaid 1 548.24 614.24
## + Telephone 1 544.31 614.31
## - Purpose.Education 1 548.49 614.49
## + Duration 1 544.74 614.74
## - NumberExistingCredits 1 548.75 614.75
## + Housing.ForFree 1 544.75 614.75
## + Housing.Own 1 544.75 614.75
## - Property.Insurance 1 548.86 614.86
## - Purpose.Repairs 1 548.90 614.90
## + Purpose.Radio.Television 1 545.00 615.00
## + ResidenceDuration 1 545.05 615.05
## - EmploymentDuration.lt.1 1 549.06 615.06
## - SavingsAccountBonds.100.to.500 1 549.09 615.09
## + Purpose.Retraining 1 545.19 615.19
## + Personal.Male.Divorced.Seperated 1 545.19 615.19
## + Purpose.Furniture.Equipment 1 545.32 615.32
## + SavingsAccountBonds.500.to.1000 1 545.40 615.40
## + Purpose.DomesticAppliance 1 545.45 615.45
## + SavingsAccountBonds.Unknown 1 545.53 615.53
## - OtherInstallmentPlans.Bank 1 549.54 615.54
## + Personal.Female.NotSingle 1 545.55 615.55
## + Job.UnskilledResident 1 545.61 615.61
## + Job.Management.SelfEmp.HighlyQualified 1 545.61 615.61
## + Purpose.Business 1 545.62 615.62
## + Purpose.Other 1 545.63 615.63
## + EmploymentDuration.4.to.7 1 545.71 615.71
## + EmploymentDuration.Unemployed 1 545.71 615.71
## + Personal.Male.Married.Widowed 1 545.72 615.72
## + SavingsAccountBonds.gt.1000 1 545.73 615.73
## - ForeignWorker 1 549.78 615.78
## - NumberPeopleMaintenance 1 550.01 616.01
## - OtherDebtorsGuarantors.CoApplicant 1 550.02 616.02
## - EmploymentDuration.gt.7 1 550.21 616.21
## - Property.CarOther 1 551.66 617.66
## - EmploymentDuration.1.to.4 1 551.86 617.86
## - CreditHistory.PaidDuly 1 552.61 618.61
## - Housing.Rent 1 553.49 619.49
## - OtherDebtorsGuarantors.None 1 553.98 619.98
## - Purpose.NewCar 1 554.18 620.18
## - Property.RealEstate 1 554.81 620.81
## - CreditHistory.ThisBank.AllPaid 1 556.30 622.30
## - Personal.Male.Single 1 556.74 622.74
## - InstallmentRatePercentage 1 558.84 624.84
## - SavingsAccountBonds.lt.100 1 562.97 628.97
## - CheckingAccountStatus.0.to.200 1 568.51 634.51
## - Amount 1 571.15 637.15
## - CheckingAccountStatus.lt.0 1 585.82 651.82
##
## Step: AIC=613.16
## Class ~ Amount + InstallmentRatePercentage + Age + NumberExistingCredits +
## NumberPeopleMaintenance + ForeignWorker + CheckingAccountStatus.lt.0 +
## CheckingAccountStatus.0.to.200 + CheckingAccountStatus.gt.200 +
## CreditHistory.NoCredit.AllPaid + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Repairs + Purpose.Education + SavingsAccountBonds.lt.100 +
## SavingsAccountBonds.100.to.500 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Male.Single +
## OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - CheckingAccountStatus.gt.200 1 548.81 612.81
## - CreditHistory.NoCredit.AllPaid 1 548.89 612.89
## - Job.UnemployedUnskilled 1 548.89 612.89
## <none> 547.16 613.16
## - Age 1 549.30 613.30
## - Purpose.UsedCar 1 549.58 613.58
## - Purpose.Education 1 549.72 613.72
## + CreditHistory.Delay 1 545.73 613.73
## + CreditHistory.Critical 1 545.73 613.73
## - NumberExistingCredits 1 549.75 613.75
## + Telephone 1 545.84 613.84
## - Job.SkilledEmployee 1 549.85 613.85
## + Duration 1 545.85 613.85
## - OtherInstallmentPlans.Stores 1 550.23 614.23
## + Housing.Own 1 546.25 614.25
## + Housing.ForFree 1 546.25 614.25
## - Property.Insurance 1 550.39 614.39
## + Purpose.Radio.Television 1 546.48 614.48
## + Personal.Male.Divorced.Seperated 1 546.51 614.51
## - Purpose.Repairs 1 550.58 614.58
## + ResidenceDuration 1 546.60 614.60
## + Purpose.Retraining 1 546.62 614.62
## - EmploymentDuration.lt.1 1 550.65 614.65
## - SavingsAccountBonds.100.to.500 1 550.74 614.74
## + SavingsAccountBonds.500.to.1000 1 546.88 614.88
## + Purpose.DomesticAppliance 1 546.88 614.88
## + Purpose.Business 1 546.91 614.91
## + Purpose.Furniture.Equipment 1 546.91 614.91
## + Personal.Female.NotSingle 1 546.92 614.92
## - OtherInstallmentPlans.Bank 1 550.98 614.98
## + SavingsAccountBonds.Unknown 1 547.00 615.00
## + Purpose.Other 1 547.02 615.02
## + Job.UnskilledResident 1 547.08 615.08
## + Job.Management.SelfEmp.HighlyQualified 1 547.08 615.08
## + EmploymentDuration.4.to.7 1 547.14 615.14
## + EmploymentDuration.Unemployed 1 547.14 615.14
## + Personal.Male.Married.Widowed 1 547.16 615.16
## + SavingsAccountBonds.gt.1000 1 547.16 615.16
## - OtherDebtorsGuarantors.CoApplicant 1 551.31 615.31
## - ForeignWorker 1 551.46 615.46
## - NumberPeopleMaintenance 1 551.72 615.72
## - EmploymentDuration.gt.7 1 551.74 615.74
## - CreditHistory.PaidDuly 1 552.62 616.62
## - Property.CarOther 1 553.29 617.29
## - EmploymentDuration.1.to.4 1 553.61 617.61
## - Housing.Rent 1 555.13 619.13
## - Purpose.NewCar 1 555.40 619.40
## - OtherDebtorsGuarantors.None 1 555.61 619.61
## - CreditHistory.ThisBank.AllPaid 1 556.39 620.39
## - Property.RealEstate 1 556.50 620.50
## - Personal.Male.Single 1 557.86 621.86
## - InstallmentRatePercentage 1 560.08 624.08
## - SavingsAccountBonds.lt.100 1 564.34 628.34
## - CheckingAccountStatus.0.to.200 1 571.82 635.82
## - Amount 1 573.36 637.36
## - CheckingAccountStatus.lt.0 1 587.39 651.39
##
## Step: AIC=612.81
## Class ~ Amount + InstallmentRatePercentage + Age + NumberExistingCredits +
## NumberPeopleMaintenance + ForeignWorker + CheckingAccountStatus.lt.0 +
## CheckingAccountStatus.0.to.200 + CreditHistory.NoCredit.AllPaid +
## CreditHistory.ThisBank.AllPaid + CreditHistory.PaidDuly +
## Purpose.NewCar + Purpose.UsedCar + Purpose.Repairs + Purpose.Education +
## SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 +
## Personal.Male.Single + OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## - CreditHistory.NoCredit.AllPaid 1 550.67 612.67
## <none> 548.81 612.81
## - Job.UnemployedUnskilled 1 550.88 612.88
## - Age 1 551.11 613.11
## + CheckingAccountStatus.none 1 547.16 613.16
## + CheckingAccountStatus.gt.200 1 547.16 613.16
## - NumberExistingCredits 1 551.19 613.19
## - Purpose.Education 1 551.30 613.30
## - Purpose.UsedCar 1 551.31 613.31
## + CreditHistory.Delay 1 547.31 613.31
## + CreditHistory.Critical 1 547.31 613.31
## + Telephone 1 547.34 613.34
## - Job.SkilledEmployee 1 551.48 613.48
## + Duration 1 547.53 613.53
## + Housing.Own 1 547.93 613.93
## + Housing.ForFree 1 547.93 613.93
## + Personal.Male.Divorced.Seperated 1 547.96 613.96
## + Purpose.Radio.Television 1 548.01 614.01
## - Purpose.Repairs 1 552.04 614.04
## - OtherInstallmentPlans.Stores 1 552.08 614.08
## - Property.Insurance 1 552.13 614.13
## + Purpose.Retraining 1 548.27 614.27
## + ResidenceDuration 1 548.34 614.34
## + Purpose.Furniture.Equipment 1 548.50 614.50
## - SavingsAccountBonds.100.to.500 1 552.51 614.51
## + Personal.Female.NotSingle 1 548.52 614.52
## + Purpose.Business 1 548.53 614.53
## + SavingsAccountBonds.500.to.1000 1 548.53 614.53
## - EmploymentDuration.lt.1 1 552.56 614.56
## + Purpose.DomesticAppliance 1 548.57 614.57
## + SavingsAccountBonds.Unknown 1 548.65 614.65
## - OtherInstallmentPlans.Bank 1 552.66 614.66
## + Purpose.Other 1 548.66 614.66
## + Job.UnskilledResident 1 548.75 614.75
## + Job.Management.SelfEmp.HighlyQualified 1 548.75 614.75
## + EmploymentDuration.4.to.7 1 548.77 614.77
## + EmploymentDuration.Unemployed 1 548.77 614.77
## + Personal.Male.Married.Widowed 1 548.81 614.81
## + SavingsAccountBonds.gt.1000 1 548.81 614.81
## - OtherDebtorsGuarantors.CoApplicant 1 553.17 615.17
## - ForeignWorker 1 553.22 615.22
## - NumberPeopleMaintenance 1 553.35 615.35
## - EmploymentDuration.gt.7 1 553.52 615.52
## - CreditHistory.PaidDuly 1 554.60 616.60
## - Property.CarOther 1 555.10 617.10
## - EmploymentDuration.1.to.4 1 555.26 617.26
## - Housing.Rent 1 556.39 618.39
## - OtherDebtorsGuarantors.None 1 557.28 619.28
## - Purpose.NewCar 1 557.36 619.36
## - CreditHistory.ThisBank.AllPaid 1 558.13 620.13
## - Property.RealEstate 1 558.44 620.44
## - Personal.Male.Single 1 559.81 621.81
## - InstallmentRatePercentage 1 561.51 623.51
## - SavingsAccountBonds.lt.100 1 567.26 629.26
## - CheckingAccountStatus.0.to.200 1 571.83 633.83
## - Amount 1 574.37 636.37
## - CheckingAccountStatus.lt.0 1 587.75 649.75
##
## Step: AIC=612.67
## Class ~ Amount + InstallmentRatePercentage + Age + NumberExistingCredits +
## NumberPeopleMaintenance + ForeignWorker + CheckingAccountStatus.lt.0 +
## CheckingAccountStatus.0.to.200 + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Repairs + Purpose.Education + SavingsAccountBonds.lt.100 +
## SavingsAccountBonds.100.to.500 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Male.Single +
## OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Job.UnemployedUnskilled + Job.SkilledEmployee
##
## Df Deviance AIC
## + CreditHistory.Critical 1 547.74 611.74
## <none> 550.67 612.67
## + CreditHistory.NoCredit.AllPaid 1 548.81 612.81
## + CheckingAccountStatus.gt.200 1 548.89 612.89
## + CheckingAccountStatus.none 1 548.89 612.89
## - Purpose.Education 1 552.89 612.89
## - NumberExistingCredits 1 552.94 612.94
## + Telephone 1 549.04 613.04
## - Age 1 553.15 613.15
## - Job.UnemployedUnskilled 1 553.20 613.20
## + Duration 1 549.25 613.25
## - Purpose.UsedCar 1 553.36 613.36
## + Purpose.Radio.Television 1 549.63 613.63
## + Housing.ForFree 1 549.78 613.78
## + Housing.Own 1 549.78 613.78
## + Personal.Male.Divorced.Seperated 1 549.83 613.83
## - Job.SkilledEmployee 1 553.89 613.89
## - Purpose.Repairs 1 553.98 613.98
## + CreditHistory.Delay 1 550.00 614.00
## + Purpose.Business 1 550.06 614.06
## - OtherInstallmentPlans.Stores 1 554.07 614.07
## - Property.Insurance 1 554.09 614.09
## + Purpose.Retraining 1 550.22 614.22
## + ResidenceDuration 1 550.30 614.30
## + SavingsAccountBonds.500.to.1000 1 550.34 614.34
## + Personal.Female.NotSingle 1 550.42 614.42
## + Purpose.DomesticAppliance 1 550.42 614.42
## + Purpose.Furniture.Equipment 1 550.44 614.44
## - SavingsAccountBonds.100.to.500 1 554.49 614.49
## + SavingsAccountBonds.Unknown 1 550.52 614.52
## + Purpose.Other 1 550.53 614.53
## + Job.UnskilledResident 1 550.60 614.60
## + Job.Management.SelfEmp.HighlyQualified 1 550.60 614.60
## + EmploymentDuration.4.to.7 1 550.62 614.62
## + EmploymentDuration.Unemployed 1 550.62 614.62
## + Personal.Male.Married.Widowed 1 550.65 614.65
## + SavingsAccountBonds.gt.1000 1 550.66 614.66
## - OtherDebtorsGuarantors.CoApplicant 1 554.76 614.76
## - ForeignWorker 1 554.77 614.77
## - EmploymentDuration.lt.1 1 555.00 615.00
## - OtherInstallmentPlans.Bank 1 555.13 615.13
## - NumberPeopleMaintenance 1 555.27 615.27
## - CreditHistory.PaidDuly 1 555.28 615.28
## - EmploymentDuration.gt.7 1 555.49 615.49
## - Property.CarOther 1 556.88 616.88
## - EmploymentDuration.1.to.4 1 557.64 617.64
## - Housing.Rent 1 558.12 618.12
## - Purpose.NewCar 1 558.80 618.80
## - CreditHistory.ThisBank.AllPaid 1 558.93 618.93
## - OtherDebtorsGuarantors.None 1 559.12 619.12
## - Property.RealEstate 1 560.68 620.68
## - Personal.Male.Single 1 561.64 621.64
## - InstallmentRatePercentage 1 562.87 622.87
## - SavingsAccountBonds.lt.100 1 569.35 629.35
## - CheckingAccountStatus.0.to.200 1 575.08 635.08
## - Amount 1 579.27 639.27
## - CheckingAccountStatus.lt.0 1 590.59 650.59
##
## Step: AIC=611.74
## Class ~ Amount + InstallmentRatePercentage + Age + NumberExistingCredits +
## NumberPeopleMaintenance + ForeignWorker + CheckingAccountStatus.lt.0 +
## CheckingAccountStatus.0.to.200 + CreditHistory.ThisBank.AllPaid +
## CreditHistory.PaidDuly + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Repairs + Purpose.Education + SavingsAccountBonds.lt.100 +
## SavingsAccountBonds.100.to.500 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Male.Single +
## OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Job.UnemployedUnskilled + Job.SkilledEmployee +
## CreditHistory.Critical
##
## Df Deviance AIC
## - CreditHistory.PaidDuly 1 548.31 610.31
## <none> 547.74 611.74
## - Purpose.UsedCar 1 549.90 611.90
## - Job.UnemployedUnskilled 1 549.99 611.99
## + Telephone 1 546.10 612.10
## + CheckingAccountStatus.none 1 546.12 612.12
## + CheckingAccountStatus.gt.200 1 546.12 612.12
## - Age 1 550.28 612.28
## - OtherInstallmentPlans.Stores 1 550.28 612.28
## - Purpose.Education 1 550.37 612.37
## - Job.SkilledEmployee 1 550.37 612.37
## - NumberExistingCredits 1 550.61 612.61
## - CreditHistory.Critical 1 550.67 612.67
## - Purpose.Repairs 1 550.71 612.71
## + Housing.Own 1 546.77 612.77
## + Housing.ForFree 1 546.77 612.77
## + Purpose.Radio.Television 1 546.79 612.79
## + Duration 1 546.81 612.81
## - Property.Insurance 1 550.97 612.97
## + Personal.Male.Divorced.Seperated 1 547.06 613.06
## + ResidenceDuration 1 547.19 613.19
## - SavingsAccountBonds.100.to.500 1 551.22 613.22
## + Purpose.Retraining 1 547.24 613.24
## + Purpose.Furniture.Equipment 1 547.26 613.26
## + CreditHistory.NoCredit.AllPaid 1 547.31 613.31
## + CreditHistory.Delay 1 547.31 613.31
## + SavingsAccountBonds.500.to.1000 1 547.39 613.39
## + Purpose.DomesticAppliance 1 547.49 613.49
## - EmploymentDuration.lt.1 1 551.52 613.52
## + SavingsAccountBonds.Unknown 1 547.53 613.53
## + Personal.Female.NotSingle 1 547.55 613.55
## + Purpose.Business 1 547.56 613.56
## + Job.UnskilledResident 1 547.64 613.64
## + Job.Management.SelfEmp.HighlyQualified 1 547.64 613.64
## + Purpose.Other 1 547.65 613.65
## + EmploymentDuration.4.to.7 1 547.70 613.70
## + EmploymentDuration.Unemployed 1 547.70 613.70
## - ForeignWorker 1 551.72 613.72
## + Personal.Male.Married.Widowed 1 547.72 613.72
## + SavingsAccountBonds.gt.1000 1 547.74 613.74
## - OtherInstallmentPlans.Bank 1 551.88 613.88
## - CreditHistory.ThisBank.AllPaid 1 551.90 613.90
## - NumberPeopleMaintenance 1 551.94 613.94
## - OtherDebtorsGuarantors.CoApplicant 1 552.14 614.14
## - EmploymentDuration.gt.7 1 552.38 614.38
## - Property.CarOther 1 553.73 615.73
## - EmploymentDuration.1.to.4 1 554.02 616.02
## - Housing.Rent 1 555.01 617.01
## - OtherDebtorsGuarantors.None 1 555.94 617.94
## - Purpose.NewCar 1 556.42 618.42
## - Property.RealEstate 1 557.19 619.19
## - Personal.Male.Single 1 559.13 621.13
## - InstallmentRatePercentage 1 560.47 622.47
## - SavingsAccountBonds.lt.100 1 566.42 628.42
## - CheckingAccountStatus.0.to.200 1 569.08 631.08
## - Amount 1 573.64 635.64
## - CheckingAccountStatus.lt.0 1 587.13 649.13
##
## Step: AIC=610.31
## Class ~ Amount + InstallmentRatePercentage + Age + NumberExistingCredits +
## NumberPeopleMaintenance + ForeignWorker + CheckingAccountStatus.lt.0 +
## CheckingAccountStatus.0.to.200 + CreditHistory.ThisBank.AllPaid +
## Purpose.NewCar + Purpose.UsedCar + Purpose.Repairs + Purpose.Education +
## SavingsAccountBonds.lt.100 + SavingsAccountBonds.100.to.500 +
## EmploymentDuration.lt.1 + EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 +
## Personal.Male.Single + OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Job.UnemployedUnskilled + Job.SkilledEmployee +
## CreditHistory.Critical
##
## Df Deviance AIC
## <none> 548.31 610.31
## - Purpose.UsedCar 1 550.31 610.31
## - Job.UnemployedUnskilled 1 550.47 610.47
## - NumberExistingCredits 1 550.61 610.61
## - OtherInstallmentPlans.Stores 1 550.63 610.63
## + Telephone 1 546.64 610.64
## + CheckingAccountStatus.gt.200 1 546.66 610.66
## + CheckingAccountStatus.none 1 546.66 610.66
## - Job.SkilledEmployee 1 550.80 610.80
## - Age 1 550.89 610.89
## - Purpose.Education 1 551.12 611.12
## - Purpose.Repairs 1 551.26 611.26
## + CreditHistory.Delay 1 547.31 611.31
## + Housing.Own 1 547.39 611.39
## + Housing.ForFree 1 547.39 611.39
## + Purpose.Radio.Television 1 547.50 611.50
## + Duration 1 547.58 611.58
## - Property.Insurance 1 551.58 611.58
## + Personal.Male.Divorced.Seperated 1 547.67 611.67
## + Purpose.Furniture.Equipment 1 547.72 611.72
## - SavingsAccountBonds.100.to.500 1 551.74 611.74
## + ResidenceDuration 1 547.74 611.74
## + CreditHistory.PaidDuly 1 547.74 611.74
## + Purpose.Retraining 1 547.82 611.82
## + SavingsAccountBonds.500.to.1000 1 547.94 611.94
## - EmploymentDuration.lt.1 1 551.97 611.97
## - CreditHistory.ThisBank.AllPaid 1 552.04 612.04
## + Purpose.DomesticAppliance 1 548.05 612.05
## + SavingsAccountBonds.Unknown 1 548.09 612.09
## + Personal.Female.NotSingle 1 548.14 612.14
## + Job.UnskilledResident 1 548.19 612.19
## + Job.Management.SelfEmp.HighlyQualified 1 548.19 612.19
## + Purpose.Other 1 548.20 612.20
## + CreditHistory.NoCredit.AllPaid 1 548.25 612.25
## + Purpose.Business 1 548.25 612.25
## + EmploymentDuration.4.to.7 1 548.26 612.26
## + EmploymentDuration.Unemployed 1 548.26 612.26
## + Personal.Male.Married.Widowed 1 548.29 612.29
## + SavingsAccountBonds.gt.1000 1 548.31 612.31
## - OtherInstallmentPlans.Bank 1 552.38 612.38
## - ForeignWorker 1 552.45 612.45
## - NumberPeopleMaintenance 1 552.48 612.48
## - OtherDebtorsGuarantors.CoApplicant 1 552.74 612.74
## - EmploymentDuration.gt.7 1 552.79 612.79
## - Property.CarOther 1 554.16 614.16
## - EmploymentDuration.1.to.4 1 554.28 614.28
## - CreditHistory.Critical 1 555.28 615.28
## - Housing.Rent 1 555.73 615.73
## - OtherDebtorsGuarantors.None 1 556.31 616.31
## - Purpose.NewCar 1 557.20 617.20
## - Property.RealEstate 1 557.66 617.66
## - Personal.Male.Single 1 560.11 620.11
## - InstallmentRatePercentage 1 560.97 620.97
## - SavingsAccountBonds.lt.100 1 566.99 626.99
## - CheckingAccountStatus.0.to.200 1 569.20 629.20
## - Amount 1 573.66 633.66
## - CheckingAccountStatus.lt.0 1 588.34 648.34summary(mod_log)##
## Call:
## glm(formula = Class ~ Amount + InstallmentRatePercentage + Age +
## NumberExistingCredits + NumberPeopleMaintenance + ForeignWorker +
## CheckingAccountStatus.lt.0 + CheckingAccountStatus.0.to.200 +
## CreditHistory.ThisBank.AllPaid + Purpose.NewCar + Purpose.UsedCar +
## Purpose.Repairs + Purpose.Education + SavingsAccountBonds.lt.100 +
## SavingsAccountBonds.100.to.500 + EmploymentDuration.lt.1 +
## EmploymentDuration.1.to.4 + EmploymentDuration.gt.7 + Personal.Male.Single +
## OtherDebtorsGuarantors.None + OtherDebtorsGuarantors.CoApplicant +
## Property.RealEstate + Property.Insurance + Property.CarOther +
## OtherInstallmentPlans.Bank + OtherInstallmentPlans.Stores +
## Housing.Rent + Job.UnemployedUnskilled + Job.SkilledEmployee +
## CreditHistory.Critical, family = "binomial", data = train)
##
## Deviance Residuals:
## Min 1Q Median 3Q Max
## -2.7289 -0.5626 0.3506 0.6583 1.9056
##
## Coefficients:
## Estimate Std. Error z value Pr(>|z|)
## (Intercept) 7.5486309 1.3180749 5.727 1.02e-08 ***
## Amount -0.0002096 0.0000433 -4.839 1.30e-06 ***
## InstallmentRatePercentage -0.3892795 0.1126279 -3.456 0.000548 ***
## Age 0.0182447 0.0115045 1.586 0.112767
## NumberExistingCredits -0.3598820 0.2380002 -1.512 0.130506
## NumberPeopleMaintenance2 -0.6397108 0.3108932 -2.058 0.039623 *
## ForeignWorker1 -1.4032606 0.7596510 -1.847 0.064712 .
## CheckingAccountStatus.lt.01 -1.6658529 0.2725290 -6.113 9.80e-10 ***
## CheckingAccountStatus.0.to.2001 -1.2584344 0.2785388 -4.518 6.24e-06 ***
## CreditHistory.ThisBank.AllPaid1 -0.9067713 0.4769212 -1.901 0.057262 .
## Purpose.NewCar1 -0.7874616 0.2642000 -2.981 0.002877 **
## Purpose.UsedCar1 0.6034672 0.4365740 1.382 0.166886
## Purpose.Repairs1 -1.1028173 0.6290085 -1.753 0.079557 .
## Purpose.Education1 -0.8198501 0.4857761 -1.688 0.091467 .
## SavingsAccountBonds.lt.1001 -1.1443554 0.2765704 -4.138 3.51e-05 ***
## SavingsAccountBonds.100.to.5001 -0.7810875 0.4179168 -1.869 0.061622 .
## EmploymentDuration.lt.11 -0.6785512 0.3573091 -1.899 0.057557 .
## EmploymentDuration.1.to.41 -0.7716564 0.3211651 -2.403 0.016276 *
## EmploymentDuration.gt.71 -0.7548847 0.3594777 -2.100 0.035733 *
## Personal.Male.Single1 0.8790502 0.2599607 3.381 0.000721 ***
## OtherDebtorsGuarantors.None1 -1.6082869 0.6353397 -2.531 0.011361 *
## OtherDebtorsGuarantors.CoApplicant1 -1.7150099 0.8367268 -2.050 0.040397 *
## Property.RealEstate1 1.1864089 0.3910982 3.034 0.002417 **
## Property.Insurance1 0.6519178 0.3609267 1.806 0.070882 .
## Property.CarOther1 0.8251965 0.3413786 2.417 0.015638 *
## OtherInstallmentPlans.Bank1 -0.6054603 0.2971831 -2.037 0.041617 *
## OtherInstallmentPlans.Stores1 -0.7003090 0.4540947 -1.542 0.123023
## Housing.Rent1 -0.7805025 0.2856985 -2.732 0.006297 **
## Job.UnemployedUnskilled1 -1.2848160 0.8627267 -1.489 0.136421
## Job.SkilledEmployee1 -0.3739581 0.2390076 -1.565 0.117670
## CreditHistory.Critical1 0.8000806 0.3101098 2.580 0.009880 **
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
## (Dispersion parameter for binomial family taken to be 1)
##
## Null deviance: 764.46 on 648 degrees of freedom
## Residual deviance: 548.31 on 618 degrees of freedom
## AIC: 610.31
##
## Number of Fisher Scoring iterations: 5# let us tidy the model
library (devtools)
library (broom)
tidy(mod_log)## # A tibble: 31 x 5
## term estimate std.error statistic p.value
## <chr> <dbl> <dbl> <dbl> <dbl>
## 1 (Intercept) 7.55 1.32 5.73 1.02e- 8
## 2 Amount -0.000210 0.0000433 -4.84 1.30e- 6
## 3 InstallmentRatePercentage -0.389 0.113 -3.46 5.48e- 4
## 4 Age 0.0182 0.0115 1.59 1.13e- 1
## 5 NumberExistingCredits -0.360 0.238 -1.51 1.31e- 1
## 6 NumberPeopleMaintenance2 -0.640 0.311 -2.06 3.96e- 2
## 7 ForeignWorker1 -1.40 0.760 -1.85 6.47e- 2
## 8 CheckingAccountStatus.lt.01 -1.67 0.273 -6.11 9.80e-10
## 9 CheckingAccountStatus.0.to.2001 -1.26 0.279 -4.52 6.24e- 6
## 10 CreditHistory.ThisBank.AllPaid1 -0.907 0.477 -1.90 5.73e- 2
## # … with 21 more rows# Checking Odds Ratio
exp(coef(mod_log))## (Intercept) Amount
## 1898.1422831 0.9997905
## InstallmentRatePercentage Age
## 0.6775449 1.0184122
## NumberExistingCredits NumberPeopleMaintenance2
## 0.6977586 0.5274449
## ForeignWorker1 CheckingAccountStatus.lt.01
## 0.2457942 0.1890294
## CheckingAccountStatus.0.to.2001 CreditHistory.ThisBank.AllPaid1
## 0.2840985 0.4038260
## Purpose.NewCar1 Purpose.UsedCar1
## 0.4549983 1.8284474
## Purpose.Repairs1 Purpose.Education1
## 0.3319346 0.4404977
## SavingsAccountBonds.lt.1001 SavingsAccountBonds.100.to.5001
## 0.3184291 0.4579078
## EmploymentDuration.lt.11 EmploymentDuration.1.to.41
## 0.5073515 0.4622468
## EmploymentDuration.gt.71 Personal.Male.Single1
## 0.4700648 2.4086109
## OtherDebtorsGuarantors.None1 OtherDebtorsGuarantors.CoApplicant1
## 0.2002303 0.1799619
## Property.RealEstate1 Property.Insurance1
## 3.2752980 1.9192179
## Property.CarOther1 OtherInstallmentPlans.Bank1
## 2.2823293 0.5458231
## OtherInstallmentPlans.Stores1 Housing.Rent1
## 0.4964319 0.4581757
## Job.UnemployedUnskilled1 Job.SkilledEmployee1
## 0.2767015 0.6880057
## CreditHistory.Critical1
## 2.2257203exp(cbind(OR = coef(mod_log), confint(mod_log)))## OR 2.5 % 97.5 %
## (Intercept) 1898.1422831 160.25607896 2.900088e+04
## Amount 0.9997905 0.99970335 9.998736e-01
## InstallmentRatePercentage 0.6775449 0.54076177 8.416646e-01
## Age 1.0184122 0.99602397 1.042084e+00
## NumberExistingCredits 0.6977586 0.43539539 1.110937e+00
## NumberPeopleMaintenance2 0.5274449 0.28706119 9.744296e-01
## ForeignWorker1 0.2457942 0.04520182 9.529000e-01
## CheckingAccountStatus.lt.01 0.1890294 0.10971858 3.199909e-01
## CheckingAccountStatus.0.to.2001 0.2840985 0.16347504 4.883215e-01
## CreditHistory.ThisBank.AllPaid1 0.4038260 0.15471380 1.012798e+00
## Purpose.NewCar1 0.4549983 0.27033915 7.631222e-01
## Purpose.UsedCar1 1.8284474 0.79838081 4.457902e+00
## Purpose.Repairs1 0.3319346 0.09626773 1.174662e+00
## Purpose.Education1 0.4404977 0.16981948 1.151496e+00
## SavingsAccountBonds.lt.1001 0.3184291 0.18240069 5.409445e-01
## SavingsAccountBonds.100.to.5001 0.4579078 0.20242884 1.047667e+00
## EmploymentDuration.lt.11 0.5073515 0.24983999 1.017033e+00
## EmploymentDuration.1.to.41 0.4622468 0.24345005 8.597848e-01
## EmploymentDuration.gt.71 0.4700648 0.23029444 9.458793e-01
## Personal.Male.Single1 2.4086109 1.45469507 4.038627e+00
## OtherDebtorsGuarantors.None1 0.2002303 0.05003894 6.305790e-01
## OtherDebtorsGuarantors.CoApplicant1 0.1799619 0.03229628 8.902891e-01
## Property.RealEstate1 3.2752980 1.52922295 7.109436e+00
## Property.Insurance1 1.9192179 0.94679164 3.909520e+00
## Property.CarOther1 2.2823293 1.16951446 4.471765e+00
## OtherInstallmentPlans.Bank1 0.5458231 0.30547238 9.824516e-01
## OtherInstallmentPlans.Stores1 0.4964319 0.20460327 1.226872e+00
## Housing.Rent1 0.4581757 0.26129182 8.026573e-01
## Job.UnemployedUnskilled1 0.2767015 0.05155168 1.554458e+00
## Job.SkilledEmployee1 0.6880057 0.42790006 1.093930e+00
## CreditHistory.Critical1 2.2257203 1.22542069 4.145915e+00# Let us do some prediction
predicted <- predict(mod_log, newdata=test, type="response")
# Model Evaluation
#run anova for checking the model
anova(mod_log, test = 'Chisq')## Analysis of Deviance Table
##
## Model: binomial, link: logit
##
## Response: Class
##
## Terms added sequentially (first to last)
##
##
## Df Deviance Resid. Df Resid. Dev Pr(>Chi)
## NULL 648 764.46
## Amount 1 19.887 647 744.57 8.216e-06
## InstallmentRatePercentage 1 7.895 646 736.68 0.0049571
## Age 1 6.085 645 730.59 0.0136317
## NumberExistingCredits 1 0.023 644 730.57 0.8789719
## NumberPeopleMaintenance 1 0.514 643 730.05 0.4732532
## ForeignWorker 1 4.093 642 725.96 0.0430551
## CheckingAccountStatus.lt.0 1 38.484 641 687.48 5.521e-10
## CheckingAccountStatus.0.to.200 1 30.492 640 656.98 3.352e-08
## CreditHistory.ThisBank.AllPaid 1 8.400 639 648.58 0.0037527
## Purpose.NewCar 1 5.200 638 643.38 0.0225823
## Purpose.UsedCar 1 3.174 637 640.21 0.0748082
## Purpose.Repairs 1 3.786 636 636.42 0.0516900
## Purpose.Education 1 5.536 635 630.89 0.0186286
## SavingsAccountBonds.lt.100 1 12.367 634 618.52 0.0004369
## SavingsAccountBonds.100.to.500 1 4.021 633 614.50 0.0449436
## EmploymentDuration.lt.1 1 2.167 632 612.33 0.1409667
## EmploymentDuration.1.to.4 1 2.754 631 609.58 0.0969986
## EmploymentDuration.gt.7 1 4.618 630 604.96 0.0316344
## Personal.Male.Single 1 13.237 629 591.72 0.0002745
## OtherDebtorsGuarantors.None 1 3.591 628 588.13 0.0580803
## OtherDebtorsGuarantors.CoApplicant 1 4.669 627 583.46 0.0307071
## Property.RealEstate 1 4.913 626 578.55 0.0266477
## Property.Insurance 1 0.153 625 578.40 0.6957455
## Property.CarOther 1 5.640 624 572.76 0.0175546
## OtherInstallmentPlans.Bank 1 2.844 623 569.91 0.0917144
## OtherInstallmentPlans.Stores 1 1.832 622 568.08 0.1759017
## Housing.Rent 1 8.090 621 559.99 0.0044519
## Job.UnemployedUnskilled 1 1.612 620 558.38 0.2041416
## Job.SkilledEmployee 1 3.095 619 555.28 0.0785453
## CreditHistory.Critical 1 6.975 618 548.31 0.0082651
##
## NULL
## Amount ***
## InstallmentRatePercentage **
## Age *
## NumberExistingCredits
## NumberPeopleMaintenance
## ForeignWorker *
## CheckingAccountStatus.lt.0 ***
## CheckingAccountStatus.0.to.200 ***
## CreditHistory.ThisBank.AllPaid **
## Purpose.NewCar *
## Purpose.UsedCar .
## Purpose.Repairs .
## Purpose.Education *
## SavingsAccountBonds.lt.100 ***
## SavingsAccountBonds.100.to.500 *
## EmploymentDuration.lt.1
## EmploymentDuration.1.to.4 .
## EmploymentDuration.gt.7 *
## Personal.Male.Single ***
## OtherDebtorsGuarantors.None .
## OtherDebtorsGuarantors.CoApplicant *
## Property.RealEstate *
## Property.Insurance
## Property.CarOther *
## OtherInstallmentPlans.Bank .
## OtherInstallmentPlans.Stores
## Housing.Rent **
## Job.UnemployedUnskilled
## Job.SkilledEmployee .
## CreditHistory.Critical **
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1# Recode Predicted to factors
y_pred <- ifelse(predicted>0.5,"Good","Bad") # let us recode with cut off of 0.5
table(y_pred,test$Class)##
## y_pred Bad Good
## Bad 48 28
## Good 73 202# Confusion Matrix
library(caret)
confusionMatrix(factor(y_pred),test$Class,positive = "Bad")## Confusion Matrix and Statistics
##
## Reference
## Prediction Bad Good
## Bad 48 28
## Good 73 202
##
## Accuracy : 0.7123
## 95% CI : (0.6618, 0.7591)
## No Information Rate : 0.6553
## P-Value [Acc > NIR] : 0.01338
##
## Kappa : 0.3015
##
## Mcnemar's Test P-Value : 1.197e-05
##
## Sensitivity : 0.3967
## Specificity : 0.8783
## Pos Pred Value : 0.6316
## Neg Pred Value : 0.7345
## Prevalence : 0.3447
## Detection Rate : 0.1368
## Detection Prevalence : 0.2165
## Balanced Accuracy : 0.6375
##
## 'Positive' Class : Bad
## # ROC Curve with ROCR package
library(ROCR)
pred <- predict(mod_log, test, type="response")
pred1 <- prediction(pred,test$Class)
eval <- performance(pred1,"fnr")
plot(eval) # ROC Curve 
# wee need to boost our RECALL as well as FNR Let us try some other techniques to boost the performance
#SVM
library(e1071)
classifier = svm(formula = Class ~ .,
data = train,
type = 'C-classification',
kernel = 'radial')
y_pred = predict(classifier, newdata = test)
confusionMatrix(factor(y_pred),test$Class)## Confusion Matrix and Statistics
##
## Reference
## Prediction Bad Good
## Bad 12 4
## Good 109 226
##
## Accuracy : 0.6781
## 95% CI : (0.6264, 0.7267)
## No Information Rate : 0.6553
## P-Value [Acc > NIR] : 0.2003
##
## Kappa : 0.103
##
## Mcnemar's Test P-Value : <2e-16
##
## Sensitivity : 0.09917
## Specificity : 0.98261
## Pos Pred Value : 0.75000
## Neg Pred Value : 0.67463
## Prevalence : 0.34473
## Detection Rate : 0.03419
## Detection Prevalence : 0.04558
## Balanced Accuracy : 0.54089
##
## 'Positive' Class : Bad
## # SVM performs terribly as both RECALL and FNR are bad
# Cross validation with Random Forest
modelcv <- train(Class~., data=train,
method = "rf",
trControl = trainControl(method = "cv", number = 10))
pred<- predict(modelcv, newdata = test)
confusionMatrix(pred,test$Class,positive = "Bad")## Confusion Matrix and Statistics
##
## Reference
## Prediction Bad Good
## Bad 41 18
## Good 80 212
##
## Accuracy : 0.7208
## 95% CI : (0.6707, 0.7671)
## No Information Rate : 0.6553
## P-Value [Acc > NIR] : 0.005187
##
## Kappa : 0.2966
##
## Mcnemar's Test P-Value : 7.186e-10
##
## Sensitivity : 0.3388
## Specificity : 0.9217
## Pos Pred Value : 0.6949
## Neg Pred Value : 0.7260
## Prevalence : 0.3447
## Detection Rate : 0.1168
## Detection Prevalence : 0.1681
## Balanced Accuracy : 0.6303
##
## 'Positive' Class : Bad
## # This model performed nearly as good as Stepwise Logistic Regression
# XGBOOST
control = trainControl(
method = 'cv',
number = 10,
classProbs = TRUE,
summaryFunction = twoClassSummary
)
xgb <- train(Class ~ .,
data = train,
method = "xgbTree",
metric = "Sens",
trControl = control)
confusionMatrix(predict(xgb, test), test$Class,positive = "Bad")## Confusion Matrix and Statistics
##
## Reference
## Prediction Bad Good
## Bad 52 31
## Good 69 199
##
## Accuracy : 0.7151
## 95% CI : (0.6648, 0.7618)
## No Information Rate : 0.6553
## P-Value [Acc > NIR] : 0.0098813
##
## Kappa : 0.3187
##
## Mcnemar's Test P-Value : 0.0002156
##
## Sensitivity : 0.4298
## Specificity : 0.8652
## Pos Pred Value : 0.6265
## Neg Pred Value : 0.7425
## Prevalence : 0.3447
## Detection Rate : 0.1481
## Detection Prevalence : 0.2365
## Balanced Accuracy : 0.6475
##
## 'Positive' Class : Bad
## # This worked nicely - we could enahnce the performance of our model where we good a better RECALL AND FALSE NEGATIVE RATE than Stepwise Logistic Regression