hw2_Prob6
Haiying Peng
2025-03-20
PCA + Multinomial Regression
- Construction safety outcomes data have been compiled from accident
reports and described in Tixier et al. (2016). The data, attribute
information and relevant R commands can be found at http://civil.colorado.edu/~balajir/CVEN6833/const-data
For the safety outcome of body part, with five categories (see Table 2
of Tixier et al., 2016). Twenty leading attributes, all binary (1 or 0 –
i.e., present or absent) are provided for each accident record.
- Perform a PCA on the attribute data – show the Eigen spectrum and the leading four Eigen vectors
- Fit a best multinomial regression with the principal components as predictors to model the categorical probability of injuries to the five category of body parts and compute the RPSS
- Repeat (b) for the Injury Severity Tixier et al. (2016) modeled these using Random Forests and Stochastic Boosting. They could not get good skill for Injury Severity. Compare your results with theirs.
#### Clear Memory and Set Options
rm(list=ls())
options(warn=-1)
save <- TRUE # Change to TRUE if you want to save the plot
# Set working directory (Modify if necessary)
script_dir <- dirname(rstudioapi::getActiveDocumentContext()$path)
setwd(script_dir)
source("HW2_Library.R")## Package 'sm', version 2.2-6.0: type help(sm) for summary information## Loading required package: lattice## Loading required package: KernSmooth## KernSmooth 2.23 loaded
## Copyright M. P. Wand 1997-2009## Loading required package: randomForest## randomForest 4.7-1.2## Type rfNews() to see new features/changes/bug fixes.## Loading required package: spam## Spam version 2.11-1 (2025-01-20) is loaded.
## Type 'help( Spam)' or 'demo( spam)' for a short introduction
## and overview of this package.
## Help for individual functions is also obtained by adding the
## suffix '.spam' to the function name, e.g. 'help( chol.spam)'.##
## Attaching package: 'spam'## The following objects are masked from 'package:base':
##
## backsolve, forwardsolve## Loading required package: viridisLite##
## Try help(fields) to get started.## locfit 1.5-9.11 2025-01-27##
## Attaching package: 'MASS'## The following object is masked from 'package:MPV':
##
## cement## The following object is masked from 'package:sm':
##
## muscle## Loading required package: stats4##
## Attaching package: 'stats4'## The following object is masked from 'package:spam':
##
## mle## Loading required package: splines## Loading required package: boot##
## Attaching package: 'boot'## The following objects are masked from 'package:VGAM':
##
## logit, simplex## The following object is masked from 'package:MPV':
##
## motor## The following object is masked from 'package:lattice':
##
## melanoma## The following object is masked from 'package:sm':
##
## dogs## Loading required package: CircStats##
## Attaching package: 'CircStats'## The following objects are masked from 'package:VGAM':
##
## dcard, rcard## Loading required package: dtw## Loading required package: proxy##
## Attaching package: 'proxy'## The following object is masked from 'package:spam':
##
## as.matrix## The following objects are masked from 'package:stats':
##
## as.dist, dist## The following object is masked from 'package:base':
##
## as.matrix## Loaded dtw v1.23-1. See ?dtw for help, citation("dtw") for use in publication.##
## Attaching package: 'verification'## The following object is masked from 'package:VGAM':
##
## exponential##
## Attaching package: 'ggplot2'## The following object is masked from 'package:randomForest':
##
## margin##
## Attaching package: 'reshape2'## The following objects are masked from 'package:data.table':
##
## dcast, melt## --------------------------------------------------------------
## Analysis of Geostatistical Data
## For an Introduction to geoR go to http://www.leg.ufpr.br/geoR
## geoR version 1.9-4 (built on 2024-02-14) is now loaded
## --------------------------------------------------------------## Package 'mclust' version 6.1.1
## Type 'citation("mclust")' for citing this R package in publications.##
## Attaching package: 'mclust'## The following object is masked from 'package:maps':
##
## map##
## Attaching package: 'Hmisc'## The following object is masked from 'package:fields':
##
## describe## The following objects are masked from 'package:base':
##
## format.pval, units##
## Attaching package: 'cluster'## The following object is masked from 'package:maps':
##
## votes.repub##
## Attaching package: 'kohonen'## The following object is masked from 'package:mclust':
##
## map## The following object is masked from 'package:maps':
##
## map(a) Perform a PCA on the attribute data - show the Eigen spectrum and the leading four Eigen vectors
## Read Data
# Retain top 20 variables
to.retain = 20
imp.vars.body = as.character(read.csv("./data/gbm.importance.50.body.csv", header = T)[1:to.retain,"var"])
imp.vars.severity = as.character(read.csv("./data/gbm.importance.50.code.csv", header = T)[1:to.retain,"var"])
## Read Body Part data and select the important variables
data = read.csv("./data/data.body.part.csv")
colnames(data) <- as.character(colnames(data))
index = which(colnames(data)%in%imp.vars.body)
Xpredictors = data[,index]
bpart = data[,1]
bpart=as.character(bpart)
bpart[bpart == "head"]=1
bpart[bpart == "neck"]=2
bpart[bpart == "trunk"]=3
bpart[bpart == "upper extremities"]=4
bpart[bpart == "lower extremities"]=5
###################
### Perform PCA ###
###################
#get variance matrix..
zs=var(Xpredictors)
#do an Eigen decomposition..
zsvd=svd(zs)
#Principal Components...
pcs=t(t(zsvd$u) %*% t(Xpredictors)) # eigenvector * X matrix
#Eigen Values.. - fraction variance
lambdas=(zsvd$d/sum(zsvd$d))
## Eigen Spectrum
plot(1:20, lambdas[1:20], type="l", xlab="Modes", ylab="Frac. Var. Explained")
points(1:20, lambdas[1:20], col="red")
print(sprintf("The first 4 PCs explain %s%% of the variance", round(sum(lambdas[1:4])*100)))## [1] "The first 4 PCs explain 46% of the variance"print(sprintf("The first 6 PCs explain %s%% of the variance", round(sum(lambdas[1:6])*100)))## [1] "The first 6 PCs explain 57% of the variance"## Eigen Vectors
### plot zsvd$u[,1:4]
### against the variables
### Identify the variables that have a strong influence
### on the injuries.
tu = expand.grid(Eofs = gl(4, 1, labels = c("EOF no.1","EOF no.2","EOF no.3","EOF no.4")),
variable = imp.vars.body)
a=vector(length = 80)
a[1:4]=zsvd$u[1,1:4]
for (i in 2:20) {
ind1=4*(i-1)+1
ind=ind1+3
a[ind1:ind]=zsvd$u[i,1:4]
}
tu$Eof= a
show(ggplot(tu, aes(x = variable, y = Eof, color = Eofs, group = Eofs)) +
geom_point(size=3) + geom_line()+
labs(title = "Eigen vectors injury precursors",x = "variable",y = "Influence",color="")+
theme(plot.title = element_text(size = 13, face = "bold", hjust = 0.5))+
theme(axis.text.x=element_text(color = "black", size=11, angle=90, vjust=.8, hjust=0.8))+
coord_flip())
(b) Fit a best multinomial regression with the principal components as predictors to model the categorical probability of injuries to the five category of body parts and compute the RPSS
### create binary vector
bpartbin = as.numeric(bpart)
pcs=cbind(bpartbin,pcs)
pcs = data.frame(pcs)
zz = multinom(bpartbin ~ ., data=pcs)## # weights: 110 (84 variable)
## initial value 6830.454500
## iter 10 value 4802.845600
## iter 20 value 4681.045845
## iter 30 value 4667.484616
## iter 40 value 4665.052067
## iter 50 value 4664.133716
## iter 60 value 4663.837152
## iter 70 value 4663.749986
## iter 80 value 4663.668413
## final value 4663.655477
## convergedN = log(length(bpartbin))zbest=stepAIC(zz,k=N) ## Start: AIC=10028.98
## bpartbin ~ V2 + V3 + V4 + V5 + V6 + V7 + V8 + V9 + V10 + V11 +
## V12 + V13 + V14 + V15 + V16 + V17 + V18 + V19 + V20 + V21
##
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 5020.397187
## iter 20 value 4836.470091
## iter 30 value 4815.439083
## iter 40 value 4814.201013
## iter 50 value 4813.721806
## iter 60 value 4813.374295
## iter 70 value 4806.917564
## iter 80 value 4749.071862
## iter 90 value 4742.548132
## iter 100 value 4742.388938
## final value 4742.388938
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 5266.524305
## iter 20 value 5152.096239
## iter 30 value 5142.263660
## iter 40 value 5137.621963
## iter 50 value 5113.121757
## iter 60 value 5108.275858
## iter 70 value 5107.832362
## iter 80 value 5107.797629
## final value 5107.792192
## converged
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4838.785583
## iter 20 value 4719.746972
## iter 30 value 4704.525313
## iter 40 value 4702.572261
## iter 50 value 4695.664614
## iter 60 value 4683.061393
## iter 70 value 4677.206915
## iter 80 value 4673.337937
## iter 90 value 4672.068401
## iter 100 value 4670.250743
## final value 4670.250743
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4817.705416
## iter 20 value 4698.923845
## iter 30 value 4681.994182
## iter 40 value 4675.961097
## iter 50 value 4671.355166
## iter 60 value 4670.932283
## iter 70 value 4670.468463
## iter 80 value 4668.215440
## iter 90 value 4663.853807
## iter 100 value 4663.820539
## final value 4663.820539
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4880.881833
## iter 20 value 4744.431359
## iter 30 value 4722.005083
## iter 40 value 4703.050800
## iter 50 value 4670.811689
## iter 60 value 4667.406840
## iter 70 value 4666.014555
## iter 80 value 4665.654017
## final value 4665.649776
## converged
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4873.520524
## iter 20 value 4756.648500
## iter 30 value 4737.560517
## iter 40 value 4734.339369
## iter 50 value 4733.385550
## iter 60 value 4732.900098
## iter 70 value 4732.802756
## iter 80 value 4732.718632
## iter 90 value 4732.679669
## iter 100 value 4732.669741
## final value 4732.669741
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4839.876780
## iter 20 value 4713.488830
## iter 30 value 4698.856732
## iter 40 value 4697.095596
## iter 50 value 4696.385800
## iter 60 value 4696.162324
## iter 70 value 4695.571552
## iter 80 value 4695.171973
## final value 4695.154291
## converged
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4821.645261
## iter 20 value 4695.307296
## iter 30 value 4680.318408
## iter 40 value 4678.310476
## iter 50 value 4677.175777
## iter 60 value 4675.908075
## iter 70 value 4674.724803
## iter 80 value 4667.251510
## iter 90 value 4665.899849
## iter 100 value 4665.885227
## final value 4665.885227
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4810.896806
## iter 20 value 4690.976781
## iter 30 value 4675.769244
## iter 40 value 4673.790163
## iter 50 value 4671.361442
## iter 60 value 4669.133945
## iter 70 value 4667.072098
## iter 80 value 4665.969695
## iter 90 value 4664.912066
## iter 100 value 4664.312196
## final value 4664.312196
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4808.327576
## iter 20 value 4686.167477
## iter 30 value 4671.283960
## iter 40 value 4669.567561
## iter 50 value 4667.980028
## iter 60 value 4666.450266
## iter 70 value 4665.543417
## iter 80 value 4665.253927
## iter 90 value 4665.196965
## iter 100 value 4665.171765
## final value 4665.171765
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4807.868891
## iter 20 value 4686.219755
## iter 30 value 4670.729196
## iter 40 value 4668.925111
## iter 50 value 4668.020341
## iter 60 value 4667.814502
## iter 70 value 4667.530477
## iter 80 value 4667.456006
## iter 90 value 4667.434303
## final value 4667.433672
## converged
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4803.933971
## iter 20 value 4683.410188
## iter 30 value 4669.682645
## iter 40 value 4667.388067
## iter 50 value 4666.217329
## iter 60 value 4666.002516
## iter 70 value 4665.874090
## iter 80 value 4665.738565
## iter 90 value 4665.314468
## iter 100 value 4665.122317
## final value 4665.122317
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4819.216906
## iter 20 value 4698.606326
## iter 30 value 4684.233954
## iter 40 value 4681.028297
## iter 50 value 4673.202827
## iter 60 value 4669.100246
## iter 70 value 4668.809898
## iter 80 value 4664.597722
## iter 90 value 4664.518498
## final value 4664.517161
## converged
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4830.363651
## iter 20 value 4714.931222
## iter 30 value 4701.372308
## iter 40 value 4699.572765
## iter 50 value 4698.530828
## iter 60 value 4697.513812
## iter 70 value 4694.385555
## iter 80 value 4688.009789
## iter 90 value 4680.949415
## iter 100 value 4679.381221
## final value 4679.381221
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4805.742470
## iter 20 value 4684.687829
## iter 30 value 4671.029392
## iter 40 value 4669.398225
## iter 50 value 4668.535687
## iter 60 value 4668.152591
## iter 70 value 4667.792982
## iter 80 value 4665.835226
## iter 90 value 4665.704625
## iter 100 value 4665.662623
## final value 4665.662623
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4813.893118
## iter 20 value 4690.762967
## iter 30 value 4674.730508
## iter 40 value 4670.580408
## iter 50 value 4668.799850
## iter 60 value 4668.554353
## iter 70 value 4668.423747
## iter 80 value 4668.313830
## iter 90 value 4668.304485
## final value 4668.302319
## converged
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4809.034025
## iter 20 value 4690.087585
## iter 30 value 4676.302180
## iter 40 value 4673.954980
## iter 50 value 4672.564621
## iter 60 value 4670.011288
## iter 70 value 4668.582294
## iter 80 value 4668.129619
## iter 90 value 4667.270427
## iter 100 value 4666.444433
## final value 4666.444433
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4806.695715
## iter 20 value 4684.788995
## iter 30 value 4671.192883
## iter 40 value 4668.494590
## iter 50 value 4667.388306
## iter 60 value 4667.089967
## iter 70 value 4666.879569
## iter 80 value 4666.824529
## iter 90 value 4666.692963
## iter 100 value 4666.679424
## final value 4666.679424
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4818.546823
## iter 20 value 4700.397144
## iter 30 value 4686.699827
## iter 40 value 4684.905151
## iter 50 value 4684.154828
## iter 60 value 4684.017503
## iter 70 value 4683.857921
## iter 80 value 4683.618553
## iter 90 value 4683.009978
## iter 100 value 4682.944147
## final value 4682.944147
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4817.132934
## iter 20 value 4697.903000
## iter 30 value 4684.205625
## iter 40 value 4681.986493
## iter 50 value 4680.095875
## iter 60 value 4678.783425
## iter 70 value 4678.341266
## iter 80 value 4677.496165
## iter 90 value 4677.048841
## iter 100 value 4676.882924
## final value 4676.882924
## stopped after 100 iterations
## Df AIC
## - V5 4 9995.9
## - V10 4 9996.9
## - V14 4 9997.3
## - V13 4 9998.5
## - V11 4 9998.6
## - V6 4 9999.6
## - V16 4 9999.6
## - V9 4 10000.0
## - V18 4 10001.1
## - V19 4 10001.6
## - V12 4 10003.1
## - V17 4 10004.9
## - V4 4 10008.8
## - V21 4 10022.0
## - V15 4 10027.0
## <none> 10029.0
## - V20 4 10034.1
## - V8 4 10058.6
## - V7 4 10133.6
## - V2 4 10153.0
## - V3 4 10883.8
## # weights: 105 (80 variable)
## initial value 6830.454500
## iter 10 value 4817.705416
## iter 20 value 4698.923845
## iter 30 value 4681.994182
## iter 40 value 4675.961097
## iter 50 value 4671.355166
## iter 60 value 4670.932283
## iter 70 value 4670.468463
## iter 80 value 4668.215440
## iter 90 value 4663.853807
## iter 100 value 4663.820539
## final value 4663.820539
## stopped after 100 iterations
##
## Step: AIC=9995.9
## bpartbin ~ V2 + V3 + V4 + V6 + V7 + V8 + V9 + V10 + V11 + V12 +
## V13 + V14 + V15 + V16 + V17 + V18 + V19 + V20 + V21
##
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 5033.695756
## iter 20 value 4855.255273
## iter 30 value 4834.597522
## iter 40 value 4833.711697
## iter 50 value 4833.192735
## iter 60 value 4831.916887
## iter 70 value 4830.765258
## iter 80 value 4821.047919
## iter 90 value 4812.146803
## iter 100 value 4785.887523
## final value 4785.887523
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 5281.929521
## iter 20 value 5167.622988
## iter 30 value 5160.397842
## iter 40 value 5149.976224
## iter 50 value 5137.643841
## iter 60 value 5135.560643
## iter 70 value 5134.767109
## iter 80 value 5129.667967
## iter 90 value 5126.078793
## iter 100 value 5125.191250
## final value 5125.191250
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4854.255841
## iter 20 value 4742.578768
## iter 30 value 4717.786448
## iter 40 value 4710.168101
## iter 50 value 4704.755655
## iter 60 value 4704.420672
## iter 70 value 4703.889946
## iter 80 value 4701.496760
## iter 90 value 4700.261965
## iter 100 value 4699.245139
## final value 4699.245139
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4903.213411
## iter 20 value 4767.868486
## iter 30 value 4732.947502
## iter 40 value 4702.919977
## iter 50 value 4689.342320
## iter 60 value 4688.314848
## iter 70 value 4687.916052
## iter 80 value 4685.707905
## iter 90 value 4682.671431
## iter 100 value 4682.150288
## final value 4682.150288
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4888.410330
## iter 20 value 4774.165294
## iter 30 value 4752.910640
## iter 40 value 4745.741868
## iter 50 value 4740.747808
## iter 60 value 4740.105108
## iter 70 value 4739.705089
## iter 80 value 4738.007101
## iter 90 value 4736.125846
## iter 100 value 4735.578709
## final value 4735.578709
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4855.289027
## iter 20 value 4736.054921
## iter 30 value 4714.418729
## iter 40 value 4709.618365
## iter 50 value 4706.506976
## iter 60 value 4706.050913
## iter 70 value 4705.175112
## iter 80 value 4701.682186
## iter 90 value 4700.892783
## iter 100 value 4699.595572
## final value 4699.595572
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4836.829687
## iter 20 value 4713.328816
## iter 30 value 4696.069452
## iter 40 value 4689.507003
## iter 50 value 4684.189977
## iter 60 value 4683.802786
## iter 70 value 4683.605758
## iter 80 value 4683.276908
## iter 90 value 4682.852301
## iter 100 value 4682.537237
## final value 4682.537237
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4825.624523
## iter 20 value 4711.095516
## iter 30 value 4690.528101
## iter 40 value 4684.252468
## iter 50 value 4679.609866
## iter 60 value 4678.664551
## iter 70 value 4676.755103
## iter 80 value 4667.485681
## iter 90 value 4666.684943
## iter 100 value 4666.130710
## final value 4666.130710
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4823.090056
## iter 20 value 4706.037013
## iter 30 value 4686.256368
## iter 40 value 4680.490793
## iter 50 value 4675.577826
## iter 60 value 4674.919181
## iter 70 value 4673.438991
## iter 80 value 4669.149991
## iter 90 value 4668.535297
## iter 100 value 4665.290256
## final value 4665.290256
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4823.223241
## iter 20 value 4705.084705
## iter 30 value 4685.816434
## iter 40 value 4681.328400
## iter 50 value 4679.072773
## iter 60 value 4678.624363
## iter 70 value 4678.029807
## iter 80 value 4673.509641
## iter 90 value 4671.520653
## iter 100 value 4670.809709
## final value 4670.809709
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4818.682690
## iter 20 value 4700.896808
## iter 30 value 4683.296155
## iter 40 value 4677.355033
## iter 50 value 4673.815433
## iter 60 value 4673.482406
## iter 70 value 4673.109458
## iter 80 value 4668.093526
## iter 90 value 4667.426844
## iter 100 value 4667.162077
## final value 4667.162077
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4834.153021
## iter 20 value 4716.044391
## iter 30 value 4697.909579
## iter 40 value 4690.121273
## iter 50 value 4681.709219
## iter 60 value 4680.367721
## iter 70 value 4677.762479
## iter 80 value 4675.409055
## iter 90 value 4674.516975
## iter 100 value 4671.898935
## final value 4671.898935
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4845.916384
## iter 20 value 4733.488045
## iter 30 value 4715.551814
## iter 40 value 4710.265428
## iter 50 value 4706.492755
## iter 60 value 4706.171912
## iter 70 value 4705.937202
## iter 80 value 4705.736682
## iter 90 value 4705.113652
## iter 100 value 4705.102087
## final value 4705.102087
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4820.622631
## iter 20 value 4702.613938
## iter 30 value 4684.951656
## iter 40 value 4680.001490
## iter 50 value 4675.905753
## iter 60 value 4675.516635
## iter 70 value 4674.784097
## iter 80 value 4670.751070
## iter 90 value 4667.007931
## iter 100 value 4666.667554
## final value 4666.667554
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4835.087518
## iter 20 value 4715.560506
## iter 30 value 4694.316027
## iter 40 value 4684.946837
## iter 50 value 4679.217819
## iter 60 value 4678.547897
## iter 70 value 4678.103902
## iter 80 value 4676.486131
## iter 90 value 4675.166621
## iter 100 value 4672.106883
## final value 4672.106883
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4823.788274
## iter 20 value 4707.426107
## iter 30 value 4690.058809
## iter 40 value 4683.749648
## iter 50 value 4678.404277
## iter 60 value 4677.980223
## iter 70 value 4677.169309
## iter 80 value 4675.164501
## iter 90 value 4671.028283
## iter 100 value 4671.015383
## final value 4671.015383
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4821.485253
## iter 20 value 4702.732563
## iter 30 value 4685.880400
## iter 40 value 4679.860562
## iter 50 value 4675.581300
## iter 60 value 4675.179595
## iter 70 value 4674.915192
## iter 80 value 4674.527325
## iter 90 value 4667.293158
## iter 100 value 4667.101469
## final value 4667.101469
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4833.475827
## iter 20 value 4718.447063
## iter 30 value 4701.705772
## iter 40 value 4696.368840
## iter 50 value 4692.557514
## iter 60 value 4692.251716
## iter 70 value 4692.059923
## iter 80 value 4691.611157
## iter 90 value 4686.594641
## iter 100 value 4683.721291
## final value 4683.721291
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4831.841909
## iter 20 value 4715.406106
## iter 30 value 4698.749576
## iter 40 value 4692.630952
## iter 50 value 4687.529437
## iter 60 value 4686.562031
## iter 70 value 4684.491604
## iter 80 value 4681.370080
## iter 90 value 4676.816324
## iter 100 value 4676.793071
## final value 4676.793071
## stopped after 100 iterations
## Df AIC
## - V11 4 9965.4
## - V10 4 9967.1
## - V16 4 9968.2
## - V19 4 9969.1
## - V13 4 9969.2
## - V12 4 9976.5
## - V18 4 9976.9
## - V14 4 9978.6
## - V17 4 9979.1
## - V21 4 9988.4
## <none> 9995.9
## - V6 4 9999.1
## - V9 4 9999.9
## - V20 4 10002.3
## - V4 4 10033.3
## - V8 4 10034.0
## - V15 4 10045.1
## - V7 4 10106.0
## - V2 4 10206.6
## - V3 4 10885.2
## # weights: 100 (76 variable)
## initial value 6830.454500
## iter 10 value 4823.090056
## iter 20 value 4706.037013
## iter 30 value 4686.256368
## iter 40 value 4680.490793
## iter 50 value 4675.577826
## iter 60 value 4674.919181
## iter 70 value 4673.438991
## iter 80 value 4669.149991
## iter 90 value 4668.535297
## iter 100 value 4665.290256
## final value 4665.290256
## stopped after 100 iterations
##
## Step: AIC=9965.43
## bpartbin ~ V2 + V3 + V4 + V6 + V7 + V8 + V9 + V10 + V12 + V13 +
## V14 + V15 + V16 + V17 + V18 + V19 + V20 + V21
##
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 5037.707193
## iter 20 value 4855.181355
## iter 30 value 4838.775048
## iter 40 value 4838.193753
## iter 50 value 4837.889336
## iter 60 value 4837.177333
## iter 70 value 4833.607013
## iter 80 value 4828.553057
## iter 90 value 4828.151291
## iter 100 value 4828.013786
## final value 4828.013786
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 5288.633684
## iter 20 value 5174.976279
## iter 30 value 5164.976355
## iter 40 value 5150.932211
## iter 50 value 5140.879821
## iter 60 value 5139.583810
## iter 70 value 5136.968935
## iter 80 value 5134.429203
## iter 90 value 5129.341239
## iter 100 value 5128.656804
## final value 5128.656804
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4859.827173
## iter 20 value 4742.015143
## iter 30 value 4722.206030
## iter 40 value 4715.004142
## iter 50 value 4709.686958
## iter 60 value 4709.141257
## iter 70 value 4708.416611
## iter 80 value 4705.922647
## iter 90 value 4705.503423
## iter 100 value 4704.280633
## final value 4704.280633
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4908.694241
## iter 20 value 4773.938089
## iter 30 value 4736.254016
## iter 40 value 4705.176814
## iter 50 value 4693.096876
## iter 60 value 4691.886707
## iter 70 value 4690.377332
## iter 80 value 4687.845648
## iter 90 value 4687.523966
## iter 100 value 4683.252091
## final value 4683.252091
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4892.861589
## iter 20 value 4774.742931
## iter 30 value 4755.557675
## iter 40 value 4748.919653
## iter 50 value 4744.118631
## iter 60 value 4743.503197
## iter 70 value 4742.799489
## iter 80 value 4741.142083
## iter 90 value 4740.784738
## iter 100 value 4739.630935
## final value 4739.630935
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4861.101793
## iter 20 value 4742.112744
## iter 30 value 4719.193137
## iter 40 value 4714.423765
## iter 50 value 4710.796360
## iter 60 value 4709.457383
## iter 70 value 4706.297742
## iter 80 value 4704.502693
## iter 90 value 4704.140402
## iter 100 value 4703.496610
## final value 4703.496610
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4842.042430
## iter 20 value 4718.639559
## iter 30 value 4700.629620
## iter 40 value 4694.285517
## iter 50 value 4689.281397
## iter 60 value 4688.822670
## iter 70 value 4688.503688
## iter 80 value 4688.228531
## iter 90 value 4688.079017
## iter 100 value 4687.698105
## final value 4687.698105
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4830.252563
## iter 20 value 4712.305082
## iter 30 value 4693.963537
## iter 40 value 4688.066146
## iter 50 value 4683.166120
## iter 60 value 4682.031811
## iter 70 value 4678.086763
## iter 80 value 4672.587965
## iter 90 value 4671.841615
## iter 100 value 4669.219629
## final value 4669.219629
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4828.860858
## iter 20 value 4709.942878
## iter 30 value 4690.472474
## iter 40 value 4685.967593
## iter 50 value 4683.376786
## iter 60 value 4682.538379
## iter 70 value 4679.917104
## iter 80 value 4678.566128
## iter 90 value 4677.560307
## iter 100 value 4673.278928
## final value 4673.278928
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4824.076233
## iter 20 value 4706.827626
## iter 30 value 4687.852800
## iter 40 value 4682.081709
## iter 50 value 4678.179447
## iter 60 value 4677.723264
## iter 70 value 4676.205243
## iter 80 value 4672.652253
## iter 90 value 4671.804319
## iter 100 value 4669.855253
## final value 4669.855253
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4839.138344
## iter 20 value 4724.614228
## iter 30 value 4701.886049
## iter 40 value 4693.639500
## iter 50 value 4684.931748
## iter 60 value 4683.183611
## iter 70 value 4679.621136
## iter 80 value 4676.890732
## iter 90 value 4674.797450
## iter 100 value 4672.871865
## final value 4672.871865
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4851.420185
## iter 20 value 4741.382569
## iter 30 value 4720.787044
## iter 40 value 4715.564333
## iter 50 value 4711.782538
## iter 60 value 4711.469391
## iter 70 value 4711.252527
## iter 80 value 4710.973824
## iter 90 value 4710.525879
## iter 100 value 4710.511638
## final value 4710.511638
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4826.066755
## iter 20 value 4709.669028
## iter 30 value 4689.797350
## iter 40 value 4684.360005
## iter 50 value 4680.067051
## iter 60 value 4679.486788
## iter 70 value 4677.110936
## iter 80 value 4672.291028
## iter 90 value 4671.716842
## iter 100 value 4670.565954
## final value 4670.565954
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4840.485564
## iter 20 value 4725.599510
## iter 30 value 4698.433621
## iter 40 value 4689.302622
## iter 50 value 4683.894655
## iter 60 value 4682.915729
## iter 70 value 4682.072425
## iter 80 value 4680.459198
## iter 90 value 4679.468142
## iter 100 value 4677.859713
## final value 4677.859713
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4829.219979
## iter 20 value 4713.587904
## iter 30 value 4694.972602
## iter 40 value 4689.186295
## iter 50 value 4684.037036
## iter 60 value 4683.610991
## iter 70 value 4682.810011
## iter 80 value 4678.315730
## iter 90 value 4676.625946
## iter 100 value 4676.599540
## final value 4676.599540
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4826.869860
## iter 20 value 4709.798021
## iter 30 value 4689.793598
## iter 40 value 4683.982451
## iter 50 value 4679.898413
## iter 60 value 4679.320656
## iter 70 value 4679.020972
## iter 80 value 4678.376652
## iter 90 value 4674.470891
## iter 100 value 4671.924921
## final value 4671.924921
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4838.987297
## iter 20 value 4725.035479
## iter 30 value 4706.384451
## iter 40 value 4701.474004
## iter 50 value 4697.794304
## iter 60 value 4697.502961
## iter 70 value 4697.335074
## iter 80 value 4696.642182
## iter 90 value 4693.963193
## iter 100 value 4688.956116
## final value 4688.956116
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4837.180676
## iter 20 value 4721.731668
## iter 30 value 4702.554298
## iter 40 value 4696.138426
## iter 50 value 4690.180534
## iter 60 value 4688.918973
## iter 70 value 4686.124300
## iter 80 value 4682.419343
## iter 90 value 4681.947673
## iter 100 value 4678.488077
## final value 4678.488077
## stopped after 100 iterations
## Df AIC
## - V10 4 9939.9
## - V13 4 9941.1
## - V16 4 9942.6
## - V19 4 9945.3
## - V14 4 9947.2
## - V12 4 9948.0
## - V18 4 9954.6
## - V17 4 9957.2
## - V21 4 9958.4
## <none> 9965.4
## - V6 4 9967.9
## - V9 4 9976.8
## - V20 4 9979.3
## - V8 4 10008.4
## - V4 4 10010.0
## - V15 4 10022.5
## - V7 4 10080.7
## - V2 4 10257.5
## - V3 4 10858.7
## # weights: 95 (72 variable)
## initial value 6830.454500
## iter 10 value 4830.252563
## iter 20 value 4712.305082
## iter 30 value 4693.963537
## iter 40 value 4688.066146
## iter 50 value 4683.166120
## iter 60 value 4682.031811
## iter 70 value 4678.086763
## iter 80 value 4672.587965
## iter 90 value 4671.841615
## iter 100 value 4669.219629
## final value 4669.219629
## stopped after 100 iterations
##
## Step: AIC=9939.87
## bpartbin ~ V2 + V3 + V4 + V6 + V7 + V8 + V9 + V12 + V13 + V14 +
## V15 + V16 + V17 + V18 + V19 + V20 + V21
##
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 5043.648575
## iter 20 value 4862.561524
## iter 30 value 4846.032254
## iter 40 value 4845.333850
## iter 50 value 4844.482568
## iter 60 value 4842.584941
## iter 70 value 4836.479292
## iter 80 value 4835.201797
## iter 90 value 4832.693799
## iter 100 value 4831.079099
## final value 4831.079099
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 5299.219276
## iter 20 value 5183.503349
## iter 30 value 5175.211073
## iter 40 value 5152.461928
## iter 50 value 5145.368969
## iter 60 value 5143.254462
## iter 70 value 5141.136466
## iter 80 value 5133.225657
## iter 90 value 5132.817357
## iter 100 value 5130.940076
## final value 5130.940076
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4866.804946
## iter 20 value 4750.460435
## iter 30 value 4730.861122
## iter 40 value 4722.884337
## iter 50 value 4718.527330
## iter 60 value 4717.346062
## iter 70 value 4713.684168
## iter 80 value 4710.715899
## iter 90 value 4710.055059
## iter 100 value 4705.270270
## final value 4705.270270
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4918.282677
## iter 20 value 4779.968739
## iter 30 value 4741.676747
## iter 40 value 4711.011672
## iter 50 value 4701.761017
## iter 60 value 4700.807781
## iter 70 value 4696.727646
## iter 80 value 4693.429837
## iter 90 value 4692.321226
## iter 100 value 4689.311138
## final value 4689.311138
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4904.247730
## iter 20 value 4790.801464
## iter 30 value 4765.624089
## iter 40 value 4759.539598
## iter 50 value 4754.577362
## iter 60 value 4753.202372
## iter 70 value 4750.173759
## iter 80 value 4748.971698
## iter 90 value 4747.286557
## iter 100 value 4745.485090
## final value 4745.485090
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4868.491895
## iter 20 value 4745.927610
## iter 30 value 4727.010699
## iter 40 value 4721.816996
## iter 50 value 4717.726558
## iter 60 value 4714.593577
## iter 70 value 4709.438673
## iter 80 value 4707.591682
## iter 90 value 4706.255550
## iter 100 value 4705.254984
## final value 4705.254984
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4849.523827
## iter 20 value 4730.307328
## iter 30 value 4709.480744
## iter 40 value 4703.445962
## iter 50 value 4699.315583
## iter 60 value 4698.699931
## iter 70 value 4697.865339
## iter 80 value 4696.930898
## iter 90 value 4695.729797
## iter 100 value 4695.176090
## final value 4695.176090
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4840.112099
## iter 20 value 4723.796831
## iter 30 value 4707.039208
## iter 40 value 4702.828771
## iter 50 value 4700.828816
## iter 60 value 4699.094080
## iter 70 value 4697.512558
## iter 80 value 4697.379885
## final value 4697.379508
## converged
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4831.456414
## iter 20 value 4714.422732
## iter 30 value 4695.998693
## iter 40 value 4690.181618
## iter 50 value 4686.447202
## iter 60 value 4684.726347
## iter 70 value 4678.871136
## iter 80 value 4677.003936
## iter 90 value 4674.598131
## iter 100 value 4673.672015
## final value 4673.672015
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4846.737840
## iter 20 value 4729.876565
## iter 30 value 4709.122392
## iter 40 value 4699.903070
## iter 50 value 4691.187297
## iter 60 value 4688.622213
## iter 70 value 4684.000021
## iter 80 value 4680.786020
## iter 90 value 4679.375725
## iter 100 value 4676.273918
## final value 4676.273918
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4858.060829
## iter 20 value 4746.119161
## iter 30 value 4728.948134
## iter 40 value 4724.081246
## iter 50 value 4721.178446
## iter 60 value 4720.819767
## iter 70 value 4720.482467
## iter 80 value 4719.570888
## final value 4719.565392
## converged
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4832.988305
## iter 20 value 4718.701558
## iter 30 value 4697.434106
## iter 40 value 4691.533805
## iter 50 value 4687.199306
## iter 60 value 4684.748891
## iter 70 value 4679.611923
## iter 80 value 4675.233565
## iter 90 value 4674.627870
## iter 100 value 4672.592875
## final value 4672.592875
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4848.287137
## iter 20 value 4733.144506
## iter 30 value 4709.575955
## iter 40 value 4702.998067
## iter 50 value 4697.996538
## iter 60 value 4697.014546
## iter 70 value 4695.917014
## iter 80 value 4695.164719
## iter 90 value 4695.101414
## iter 100 value 4695.094086
## final value 4695.094086
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4836.535189
## iter 20 value 4725.377418
## iter 30 value 4703.780925
## iter 40 value 4697.579492
## iter 50 value 4693.023981
## iter 60 value 4692.345911
## iter 70 value 4690.942841
## iter 80 value 4683.794702
## iter 90 value 4682.133554
## iter 100 value 4682.105218
## final value 4682.105218
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4833.943791
## iter 20 value 4715.742258
## iter 30 value 4697.502798
## iter 40 value 4691.622813
## iter 50 value 4687.886095
## iter 60 value 4686.880309
## iter 70 value 4685.695049
## iter 80 value 4678.749124
## iter 90 value 4677.545399
## iter 100 value 4675.232777
## final value 4675.232777
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4846.263289
## iter 20 value 4733.834172
## iter 30 value 4715.072096
## iter 40 value 4710.150239
## iter 50 value 4707.320412
## iter 60 value 4706.933310
## iter 70 value 4706.880657
## final value 4706.879296
## converged
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4844.344279
## iter 20 value 4727.893881
## iter 30 value 4709.903092
## iter 40 value 4702.954550
## iter 50 value 4697.180297
## iter 60 value 4694.732406
## iter 70 value 4690.501571
## iter 80 value 4687.023685
## iter 90 value 4685.627053
## iter 100 value 4680.846254
## final value 4680.846254
## stopped after 100 iterations
## Df AIC
## - V16 4 9913.2
## - V13 4 9915.4
## - V19 4 9918.5
## - V14 4 9920.6
## - V21 4 9929.7
## - V18 4 9932.2
## <none> 9939.9
## - V6 4 9946.6
## - V17 4 9958.2
## - V9 4 9958.4
## - V12 4 9962.8
## - V8 4 9978.5
## - V4 4 9978.6
## - V20 4 9981.8
## - V15 4 10007.2
## - V7 4 10059.0
## - V2 4 10230.2
## - V3 4 10829.9
## # weights: 90 (68 variable)
## initial value 6830.454500
## iter 10 value 4832.988305
## iter 20 value 4718.701558
## iter 30 value 4697.434106
## iter 40 value 4691.533805
## iter 50 value 4687.199306
## iter 60 value 4684.748891
## iter 70 value 4679.611923
## iter 80 value 4675.233565
## iter 90 value 4674.627870
## iter 100 value 4672.592875
## final value 4672.592875
## stopped after 100 iterations
##
## Step: AIC=9913.21
## bpartbin ~ V2 + V3 + V4 + V6 + V7 + V8 + V9 + V12 + V13 + V14 +
## V15 + V17 + V18 + V19 + V20 + V21
##
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 5046.739883
## iter 20 value 4864.775806
## iter 30 value 4849.701586
## iter 40 value 4849.096784
## iter 50 value 4848.102514
## iter 60 value 4844.484052
## iter 70 value 4837.907057
## iter 80 value 4836.120184
## iter 90 value 4835.759236
## iter 100 value 4835.174152
## final value 4835.174152
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 5301.731527
## iter 20 value 5187.509779
## iter 30 value 5178.849875
## iter 40 value 5155.315839
## iter 50 value 5148.984607
## iter 60 value 5146.450499
## iter 70 value 5144.518099
## iter 80 value 5134.712772
## iter 90 value 5134.658047
## final value 5134.621366
## converged
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4869.359110
## iter 20 value 4753.287264
## iter 30 value 4733.329778
## iter 40 value 4725.762144
## iter 50 value 4722.428142
## iter 60 value 4719.840247
## iter 70 value 4714.824638
## iter 80 value 4713.496223
## iter 90 value 4712.403189
## iter 100 value 4708.809664
## final value 4708.809664
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4920.788783
## iter 20 value 4784.632099
## iter 30 value 4744.644507
## iter 40 value 4715.900544
## iter 50 value 4708.350467
## iter 60 value 4706.351965
## iter 70 value 4698.551349
## iter 80 value 4697.710133
## iter 90 value 4695.693378
## iter 100 value 4692.428695
## final value 4692.428695
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4906.789034
## iter 20 value 4794.405989
## iter 30 value 4770.196376
## iter 40 value 4763.085110
## iter 50 value 4758.713251
## iter 60 value 4757.225438
## iter 70 value 4753.188420
## iter 80 value 4751.745159
## iter 90 value 4749.633872
## iter 100 value 4748.750853
## final value 4748.750853
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4871.164241
## iter 20 value 4752.557956
## iter 30 value 4730.376223
## iter 40 value 4725.217608
## iter 50 value 4721.348292
## iter 60 value 4715.749784
## iter 70 value 4711.324609
## iter 80 value 4710.143228
## iter 90 value 4709.391217
## iter 100 value 4707.601593
## final value 4707.601593
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4852.094978
## iter 20 value 4735.612849
## iter 30 value 4712.789154
## iter 40 value 4707.320646
## iter 50 value 4703.295308
## iter 60 value 4702.480820
## iter 70 value 4700.774762
## iter 80 value 4699.890772
## iter 90 value 4697.959365
## iter 100 value 4697.589326
## final value 4697.589326
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4842.433756
## iter 20 value 4725.374051
## iter 30 value 4709.997670
## iter 40 value 4706.082610
## iter 50 value 4704.536030
## iter 60 value 4702.571788
## iter 70 value 4700.794322
## final value 4700.673568
## converged
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4834.205947
## iter 20 value 4719.385277
## iter 30 value 4699.240021
## iter 40 value 4693.677467
## iter 50 value 4690.356294
## iter 60 value 4687.530004
## iter 70 value 4680.724852
## iter 80 value 4679.544168
## iter 90 value 4678.635165
## iter 100 value 4675.495696
## final value 4675.495696
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4849.866393
## iter 20 value 4734.099211
## iter 30 value 4713.255588
## iter 40 value 4704.926812
## iter 50 value 4696.789161
## iter 60 value 4691.306028
## iter 70 value 4685.014842
## iter 80 value 4683.879879
## iter 90 value 4682.207270
## iter 100 value 4677.142805
## final value 4677.142805
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4860.949435
## iter 20 value 4749.499022
## iter 30 value 4732.279282
## iter 40 value 4727.361445
## iter 50 value 4724.933793
## iter 60 value 4724.367661
## iter 70 value 4723.439140
## iter 80 value 4722.720155
## iter 90 value 4722.696523
## final value 4722.691203
## converged
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4851.740258
## iter 20 value 4735.433459
## iter 30 value 4717.157961
## iter 40 value 4712.619562
## iter 50 value 4709.499970
## iter 60 value 4708.932410
## iter 70 value 4708.721752
## iter 80 value 4708.686138
## iter 80 value 4708.686098
## iter 80 value 4708.686098
## final value 4708.686098
## converged
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4839.409881
## iter 20 value 4726.358512
## iter 30 value 4707.289854
## iter 40 value 4701.399099
## iter 50 value 4697.322262
## iter 60 value 4696.114531
## iter 70 value 4693.300175
## iter 80 value 4686.636089
## iter 90 value 4685.855705
## iter 100 value 4685.663164
## final value 4685.663164
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4836.512157
## iter 20 value 4722.776999
## iter 30 value 4700.506328
## iter 40 value 4694.965313
## iter 50 value 4691.664800
## iter 60 value 4690.708606
## iter 70 value 4688.538595
## iter 80 value 4681.533877
## iter 90 value 4679.706378
## iter 100 value 4678.864534
## final value 4678.864534
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4849.007898
## iter 20 value 4738.507259
## iter 30 value 4718.535348
## iter 40 value 4713.946727
## iter 50 value 4711.661954
## iter 60 value 4711.429165
## iter 70 value 4711.397661
## final value 4711.364786
## converged
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4847.043602
## iter 20 value 4732.213852
## iter 30 value 4713.414629
## iter 40 value 4706.501075
## iter 50 value 4700.962957
## iter 60 value 4699.001631
## iter 70 value 4693.778487
## iter 80 value 4690.951545
## iter 90 value 4689.469481
## iter 100 value 4683.509620
## final value 4683.509620
## stopped after 100 iterations
## Df AIC
## - V13 4 9885.6
## - V14 4 9888.9
## - V19 4 9892.3
## - V21 4 9901.6
## - V18 4 9905.9
## <none> 9913.2
## - V6 4 9919.5
## - V9 4 9929.8
## - V12 4 9936.0
## - V8 4 9949.8
## - V17 4 9952.0
## - V4 4 9952.2
## - V20 4 9957.3
## - V15 4 9980.0
## - V7 4 10032.1
## - V2 4 10205.0
## - V3 4 10803.9
## # weights: 85 (64 variable)
## initial value 6830.454500
## iter 10 value 4834.205947
## iter 20 value 4719.385277
## iter 30 value 4699.240021
## iter 40 value 4693.677467
## iter 50 value 4690.356294
## iter 60 value 4687.530004
## iter 70 value 4680.724852
## iter 80 value 4679.544168
## iter 90 value 4678.635165
## iter 100 value 4675.495696
## final value 4675.495696
## stopped after 100 iterations
##
## Step: AIC=9885.6
## bpartbin ~ V2 + V3 + V4 + V6 + V7 + V8 + V9 + V12 + V14 + V15 +
## V17 + V18 + V19 + V20 + V21
##
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 5048.739242
## iter 20 value 4866.447595
## iter 30 value 4851.976608
## iter 40 value 4851.408432
## iter 50 value 4849.702518
## iter 60 value 4845.240914
## iter 70 value 4840.630771
## iter 80 value 4839.921692
## iter 90 value 4839.439589
## iter 100 value 4838.819670
## final value 4838.819670
## stopped after 100 iterations
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 5302.476866
## iter 20 value 5188.055443
## iter 30 value 5179.910219
## iter 40 value 5153.839702
## iter 50 value 5150.324894
## iter 60 value 5148.044568
## iter 70 value 5143.838585
## iter 80 value 5139.332078
## iter 90 value 5139.056434
## final value 5139.039066
## converged
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4870.675641
## iter 20 value 4756.904917
## iter 30 value 4734.767422
## iter 40 value 4728.173643
## iter 50 value 4725.318093
## iter 60 value 4722.825112
## iter 70 value 4717.865932
## iter 80 value 4717.349895
## iter 90 value 4714.581584
## iter 100 value 4713.920838
## final value 4713.920838
## stopped after 100 iterations
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4921.827964
## iter 20 value 4785.541716
## iter 30 value 4747.485235
## iter 40 value 4725.707679
## iter 50 value 4719.836247
## iter 60 value 4716.901392
## iter 70 value 4710.986511
## iter 80 value 4710.343445
## iter 90 value 4706.200099
## iter 100 value 4705.968578
## final value 4705.968578
## stopped after 100 iterations
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4907.622520
## iter 20 value 4796.826272
## iter 30 value 4770.279753
## iter 40 value 4763.765956
## iter 50 value 4760.541608
## iter 60 value 4757.876961
## iter 70 value 4753.942296
## iter 80 value 4753.173841
## iter 90 value 4751.268436
## iter 100 value 4751.123976
## final value 4751.123976
## stopped after 100 iterations
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4873.003306
## iter 20 value 4755.380147
## iter 30 value 4732.364401
## iter 40 value 4727.175762
## iter 50 value 4723.826782
## iter 60 value 4717.876375
## iter 70 value 4714.087887
## iter 80 value 4713.484510
## iter 90 value 4711.505088
## iter 100 value 4711.448826
## final value 4711.448826
## stopped after 100 iterations
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4853.690044
## iter 20 value 4737.529111
## iter 30 value 4714.737876
## iter 40 value 4709.067915
## iter 50 value 4705.937102
## iter 60 value 4704.904860
## iter 70 value 4703.098319
## iter 80 value 4702.216266
## iter 90 value 4700.654905
## iter 100 value 4700.335303
## final value 4700.335303
## stopped after 100 iterations
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4844.976636
## iter 20 value 4729.559658
## iter 30 value 4713.172779
## iter 40 value 4709.638024
## iter 50 value 4707.615336
## iter 60 value 4705.803974
## iter 70 value 4704.649962
## final value 4704.628369
## converged
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4851.297244
## iter 20 value 4735.381024
## iter 30 value 4715.892089
## iter 40 value 4708.515228
## iter 50 value 4702.855686
## iter 60 value 4695.736283
## iter 70 value 4691.125693
## iter 80 value 4690.405302
## iter 90 value 4687.216680
## iter 100 value 4686.448449
## final value 4686.448449
## stopped after 100 iterations
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4862.275146
## iter 20 value 4751.635437
## iter 30 value 4733.980850
## iter 40 value 4729.681383
## iter 50 value 4727.811683
## iter 60 value 4727.304897
## iter 70 value 4726.026755
## iter 80 value 4725.815086
## final value 4725.786002
## converged
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4853.128649
## iter 20 value 4741.115138
## iter 30 value 4719.040089
## iter 40 value 4714.361336
## iter 50 value 4712.383191
## iter 60 value 4711.944145
## iter 70 value 4711.824252
## final value 4711.823799
## converged
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4840.648718
## iter 20 value 4728.264677
## iter 30 value 4708.557837
## iter 40 value 4703.639694
## iter 50 value 4700.393319
## iter 60 value 4699.154711
## iter 70 value 4694.670886
## iter 80 value 4690.914283
## iter 90 value 4690.634741
## iter 100 value 4690.596713
## final value 4690.596713
## stopped after 100 iterations
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4837.727051
## iter 20 value 4722.751125
## iter 30 value 4702.373348
## iter 40 value 4696.971801
## iter 50 value 4694.533892
## iter 60 value 4693.695153
## iter 70 value 4689.597537
## iter 80 value 4685.808648
## iter 90 value 4683.496673
## iter 100 value 4683.474491
## final value 4683.474491
## stopped after 100 iterations
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4850.226954
## iter 20 value 4738.477075
## iter 30 value 4720.261705
## iter 40 value 4716.082346
## iter 50 value 4714.401266
## iter 60 value 4714.253728
## iter 70 value 4714.210571
## final value 4714.195853
## converged
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4848.264002
## iter 20 value 4734.508009
## iter 30 value 4715.158157
## iter 40 value 4708.384302
## iter 50 value 4704.339717
## iter 60 value 4699.861417
## iter 70 value 4695.597055
## iter 80 value 4694.226783
## iter 90 value 4689.904683
## iter 100 value 4689.306288
## final value 4689.306288
## stopped after 100 iterations
## Df AIC
## - V19 4 9868.1
## - V14 4 9874.1
## - V21 4 9879.8
## - V18 4 9882.4
## <none> 9885.6
## - V9 4 9901.9
## - V12 4 9910.5
## - V6 4 9913.1
## - V8 4 9924.1
## - V17 4 9924.8
## - V4 4 9929.0
## - V20 4 9929.6
## - V15 4 9952.8
## - V7 4 10003.4
## - V2 4 10178.8
## - V3 4 10779.3
## # weights: 80 (60 variable)
## initial value 6830.454500
## iter 10 value 4837.727051
## iter 20 value 4722.751125
## iter 30 value 4702.373348
## iter 40 value 4696.971801
## iter 50 value 4694.533892
## iter 60 value 4693.695153
## iter 70 value 4689.597537
## iter 80 value 4685.808648
## iter 90 value 4683.496673
## iter 100 value 4683.474491
## final value 4683.474491
## stopped after 100 iterations
##
## Step: AIC=9868.14
## bpartbin ~ V2 + V3 + V4 + V6 + V7 + V8 + V9 + V12 + V14 + V15 +
## V17 + V18 + V20 + V21
##
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 5053.650446
## iter 20 value 4869.082461
## iter 30 value 4855.984228
## iter 40 value 4855.645116
## iter 50 value 4853.978488
## iter 60 value 4844.829420
## iter 70 value 4842.635451
## iter 80 value 4842.500151
## iter 90 value 4842.166019
## final value 4842.165961
## converged
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 5306.037343
## iter 20 value 5192.094982
## iter 30 value 5182.777685
## iter 40 value 5176.984515
## iter 50 value 5170.587405
## iter 60 value 5168.264959
## iter 70 value 5157.553473
## iter 80 value 5156.704722
## iter 90 value 5155.178491
## final value 5155.175228
## converged
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 4874.140530
## iter 20 value 4760.190239
## iter 30 value 4738.665373
## iter 40 value 4731.453232
## iter 50 value 4729.267615
## iter 60 value 4728.334361
## iter 70 value 4725.334580
## iter 80 value 4724.678431
## iter 90 value 4724.268346
## final value 4724.043608
## converged
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 4925.073323
## iter 20 value 4789.354895
## iter 30 value 4749.842574
## iter 40 value 4729.281954
## iter 50 value 4724.344690
## iter 60 value 4723.654074
## iter 70 value 4719.351570
## iter 80 value 4716.287618
## iter 90 value 4716.207651
## iter 100 value 4716.115847
## final value 4716.115847
## stopped after 100 iterations
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 4911.196946
## iter 20 value 4799.351259
## iter 30 value 4773.982650
## iter 40 value 4767.264297
## iter 50 value 4764.590474
## iter 60 value 4763.494923
## iter 70 value 4759.365718
## iter 80 value 4758.010329
## iter 90 value 4757.878546
## final value 4757.878266
## converged
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 4876.653793
## iter 20 value 4758.457408
## iter 30 value 4735.432507
## iter 40 value 4730.533459
## iter 50 value 4728.625713
## iter 60 value 4727.336050
## iter 70 value 4723.830792
## iter 80 value 4721.321716
## iter 90 value 4721.058998
## final value 4721.052464
## converged
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 4857.155132
## iter 20 value 4741.566808
## iter 30 value 4717.752408
## iter 40 value 4711.975260
## iter 50 value 4709.348178
## iter 60 value 4708.708787
## iter 70 value 4705.464598
## iter 80 value 4703.312589
## iter 90 value 4702.906209
## iter 100 value 4702.876725
## final value 4702.876725
## stopped after 100 iterations
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 4848.552919
## iter 20 value 4732.835780
## iter 30 value 4716.314636
## iter 40 value 4712.720380
## iter 50 value 4711.559154
## iter 60 value 4711.397633
## iter 70 value 4711.373148
## iter 80 value 4711.353565
## final value 4711.350750
## converged
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 4855.027268
## iter 20 value 4738.537826
## iter 30 value 4718.738317
## iter 40 value 4711.947003
## iter 50 value 4709.117696
## iter 60 value 4707.231280
## iter 70 value 4705.237518
## iter 80 value 4700.687401
## iter 90 value 4699.764871
## final value 4699.764227
## converged
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 4866.027226
## iter 20 value 4755.347881
## iter 30 value 4737.978688
## iter 40 value 4733.856236
## iter 50 value 4731.895825
## iter 60 value 4731.402121
## iter 70 value 4729.909542
## iter 80 value 4729.785714
## final value 4729.777298
## converged
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 4856.767112
## iter 20 value 4745.834542
## iter 30 value 4723.397100
## iter 40 value 4719.159515
## iter 50 value 4716.765035
## iter 60 value 4716.538337
## final value 4716.535879
## converged
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 4844.740827
## iter 20 value 4732.477092
## iter 30 value 4712.798160
## iter 40 value 4707.502474
## iter 50 value 4704.828421
## iter 60 value 4703.168816
## iter 70 value 4697.327125
## iter 80 value 4696.065199
## final value 4695.098443
## converged
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 4854.166323
## iter 20 value 4742.715729
## iter 30 value 4724.590527
## iter 40 value 4720.594129
## iter 50 value 4718.891581
## iter 60 value 4718.735697
## iter 70 value 4718.641369
## final value 4718.640451
## converged
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 4851.685923
## iter 20 value 4737.671735
## iter 30 value 4718.616186
## iter 40 value 4713.373104
## iter 50 value 4711.574124
## iter 60 value 4711.225133
## iter 70 value 4710.642745
## final value 4710.581630
## converged
## Df AIC
## - V18 4 9858.0
## - V14 4 9867.3
## <none> 9868.1
## - V9 4 9873.5
## - V21 4 9888.9
## - V12 4 9890.5
## - V6 4 9900.0
## - V17 4 9900.9
## - V20 4 9905.1
## - V8 4 9909.9
## - V4 4 9915.9
## - V15 4 9927.3
## - V7 4 9983.5
## - V2 4 10152.1
## - V3 4 10778.1
## # weights: 75 (56 variable)
## initial value 6830.454500
## iter 10 value 4844.740827
## iter 20 value 4732.477092
## iter 30 value 4712.798160
## iter 40 value 4707.502474
## iter 50 value 4704.828421
## iter 60 value 4703.168816
## iter 70 value 4697.327125
## iter 80 value 4696.065199
## final value 4695.098443
## converged
##
## Step: AIC=9857.98
## bpartbin ~ V2 + V3 + V4 + V6 + V7 + V8 + V9 + V12 + V14 + V15 +
## V17 + V20 + V21
##
## # weights: 70 (52 variable)
## initial value 6830.454500
## iter 10 value 5059.877146
## iter 20 value 4880.908005
## iter 30 value 4866.633419
## iter 40 value 4865.951712
## iter 50 value 4863.893008
## iter 60 value 4855.500455
## iter 70 value 4854.930223
## final value 4854.233214
## converged
## # weights: 70 (52 variable)
## initial value 6830.454500
## iter 10 value 5313.425839
## iter 20 value 5201.270955
## iter 30 value 5194.371672
## iter 40 value 5190.814657
## iter 50 value 5183.831334
## iter 60 value 5176.540126
## iter 70 value 5174.371033
## final value 5174.307353
## converged
## # weights: 70 (52 variable)
## initial value 6830.454500
## iter 10 value 4881.245675
## iter 20 value 4769.282126
## iter 30 value 4747.765434
## iter 40 value 4740.451431
## iter 50 value 4738.987630
## iter 60 value 4737.410963
## iter 70 value 4734.866675
## iter 80 value 4734.553271
## final value 4734.545798
## converged
## # weights: 70 (52 variable)
## initial value 6830.454500
## iter 10 value 4932.107307
## iter 20 value 4798.612332
## iter 30 value 4760.485546
## iter 40 value 4737.986187
## iter 50 value 4733.069971
## iter 60 value 4731.630430
## iter 70 value 4727.092182
## iter 80 value 4725.379371
## final value 4725.137083
## converged
## # weights: 70 (52 variable)
## initial value 6830.454500
## iter 10 value 4918.091958
## iter 20 value 4808.095782
## iter 30 value 4782.898307
## iter 40 value 4776.368334
## iter 50 value 4773.857755
## iter 60 value 4772.187716
## iter 70 value 4768.974071
## iter 80 value 4768.525630
## final value 4768.172886
## converged
## # weights: 70 (52 variable)
## initial value 6830.454500
## iter 10 value 4883.622747
## iter 20 value 4770.077950
## iter 30 value 4746.634871
## iter 40 value 4741.923183
## iter 50 value 4739.772999
## iter 60 value 4736.829019
## iter 70 value 4734.677225
## iter 80 value 4734.367610
## final value 4734.361019
## converged
## # weights: 70 (52 variable)
## initial value 6830.454500
## iter 10 value 4864.207951
## iter 20 value 4750.709560
## iter 30 value 4728.345136
## iter 40 value 4722.079781
## iter 50 value 4719.016671
## iter 60 value 4717.697014
## iter 70 value 4714.269741
## iter 80 value 4714.136353
## final value 4713.992804
## converged
## # weights: 70 (52 variable)
## initial value 6830.454500
## iter 10 value 4855.658795
## iter 20 value 4741.645633
## iter 30 value 4727.199257
## iter 40 value 4723.831870
## iter 50 value 4722.889940
## iter 60 value 4722.791274
## iter 70 value 4722.701863
## final value 4722.696544
## converged
## # weights: 70 (52 variable)
## initial value 6830.454500
## iter 10 value 4862.460486
## iter 20 value 4750.672570
## iter 30 value 4731.505017
## iter 40 value 4725.368049
## iter 50 value 4722.966153
## iter 60 value 4721.414817
## iter 70 value 4718.036234
## iter 80 value 4717.133838
## final value 4716.940270
## converged
## # weights: 70 (52 variable)
## initial value 6830.454500
## iter 10 value 4873.032919
## iter 20 value 4764.327243
## iter 30 value 4746.940651
## iter 40 value 4741.679148
## iter 50 value 4739.977060
## iter 60 value 4739.170561
## iter 70 value 4738.203637
## final value 4738.145655
## converged
## # weights: 70 (52 variable)
## initial value 6830.454500
## iter 10 value 4863.783724
## iter 20 value 4755.511261
## iter 30 value 4734.031461
## iter 40 value 4729.059399
## iter 50 value 4727.485402
## iter 60 value 4727.403629
## final value 4727.402336
## converged
## # weights: 70 (52 variable)
## initial value 6830.454500
## iter 10 value 4860.946829
## iter 20 value 4752.350382
## iter 30 value 4733.337553
## iter 40 value 4728.639531
## iter 50 value 4726.874051
## iter 60 value 4726.638082
## final value 4726.518346
## converged
## # weights: 70 (52 variable)
## initial value 6830.454500
## iter 10 value 4858.401175
## iter 20 value 4748.456862
## iter 30 value 4729.535543
## iter 40 value 4724.652581
## iter 50 value 4722.729296
## iter 60 value 4722.526624
## iter 70 value 4722.458496
## final value 4722.458400
## converged
## Df AIC
## <none> 9858.0
## - V9 4 9862.4
## - V14 4 9868.3
## - V21 4 9879.3
## - V12 4 9879.8
## - V6 4 9884.6
## - V20 4 9887.4
## - V17 4 9889.2
## - V8 4 9903.1
## - V4 4 9903.5
## - V15 4 9910.7
## - V7 4 9970.7
## - V2 4 10142.8
## - V3 4 10783.0print(summary(zbest))## Call:
## multinom(formula = bpartbin ~ V2 + V3 + V4 + V6 + V7 + V8 + V9 +
## V12 + V14 + V15 + V17 + V20 + V21, data = pcs)
##
## Coefficients:
## (Intercept) V2 V3 V4 V6 V7 V8
## 2 -1.8715403 -2.117657 0.7444662 -2.2291403 2.7728561 2.859202 -5.06051710
## 3 -0.2512364 -3.945427 7.8531051 -1.0534055 0.6796384 -1.412624 0.09345112
## 4 1.0090588 -1.829775 4.9939418 0.6960140 0.6249908 -3.050353 -1.07466342
## 5 0.2795602 -3.909752 12.7226743 -0.6675859 2.2823349 -1.776654 1.00568870
## V9 V12 V14 V15 V17 V20
## 2 -4.54543505 -9.5003324 -9.2493738 11.271684 -21.3996690 174.901741
## 3 0.07983149 0.2164937 2.2052052 1.017061 0.7406517 4.155083
## 4 0.83864614 -0.2290801 -0.4808086 -1.357942 0.9804030 -2.700105
## 5 -0.58910532 1.1178187 1.0133073 -1.302331 1.3559690 -1.332043
## V21
## 2 -223.4749927
## 3 0.4797571
## 4 3.2937500
## 5 1.2893075
##
## Std. Errors:
## (Intercept) V2 V3 V4 V6 V7 V8
## 2 0.14450319 0.6873848 1.6222056 0.8975402 1.0366390 1.7731184 1.9411282
## 3 0.07671925 0.6121483 1.8827514 0.4086169 0.4716272 0.3400028 0.4634082
## 4 0.05908701 0.1822436 0.3584732 0.2217303 0.3923408 0.2956986 0.3686182
## 5 0.06766681 0.5863416 1.7828655 0.2888557 0.4100698 0.3204268 0.4177351
## V9 V12 V14 V15 V17 V20 V21
## 2 1.8188829 2.3524723 3.2689684 3.4802727 5.9370087 54.749495 68.312069
## 3 0.4305687 0.6170746 0.7693763 0.3503601 0.6167398 3.912979 1.861419
## 4 0.3404493 0.2998880 0.3229168 0.3660987 0.3358988 1.041735 1.135893
## 5 0.3914876 0.4917368 0.4553335 0.4936806 0.5059824 1.109333 1.303356
##
## Residual Deviance: 9390.197
## AIC: 9502.197Compute the RPSS
#################### RPSS
ypred = predict(zbest, type = "probs")
# RPSS calculations
acc2 = as.numeric(bpart)
N = length(acc2)
acc2_name =""
#identify the numeric index
for (i in 1:5) {
ind=which(acc2==i)
acc2_name[i]=as.character(data$body.part[ind[1]])
}
### using verification package you get the same results..
# Empirical probabilities
p1 <- length(acc2[acc2 == 1])/N
p2 <- length(acc2[acc2 == 2])/N
p3 <- length(acc2[acc2 == 3])/N
p4 <- length(acc2[acc2 == 4])/N
p5 <- length(acc2[acc2 == 5])/N
prob = c(p1, p2, p3,p4, p5)
RPSS=rps(acc2, ypred, baseline=prob)$rpss
prob=as.data.frame(prob)
rownames(prob)=acc2_name
print("Empirical probabilities are:")## [1] "Empirical probabilities are:"print(prob)## prob
## head 0.23963242
## neck 0.02403393
## trunk 0.12111216
## upper extremities 0.42035815
## lower extremities 0.19486334print(sprintf('Body Part Multinomial Regression RPSS: %s', RPSS))## [1] "Body Part Multinomial Regression RPSS: 0.281666586947724"(c) Repeat (b) for the Injury Severity
# Read data
## Read Injury Severity data and select the important variables
data1 = read.csv("data/data.worst.case.severity.csv")
index=which(colnames(data1)%in%imp.vars.severity)
Xpredictors = data1[,index]
sev = data1[,1]
# Divide body parts into five classes
sev[sev == "1st Aid"]=1
sev[sev == "Medical Case"]=2
sev[sev == "Lost Work Time"]=3
sev[sev == "Permanent Disablement"]=4
sev[sev == "Fatality"]=5
### repeat steps from above.
#get variance matrix..
zs=var(Xpredictors)
#do an Eigen decomposition..
zsvd=svd(zs)
#Principal Components...
pcs1 = t(t(zsvd$u) %*% t(Xpredictors)) # eigenvector * X matrix
#Eigen Values.. - fraction variance
lambdas=(zsvd$d/sum(zsvd$d))
## Eigen Spectrum
plot(1:20, lambdas[1:20], type="l", xlab="Modes", ylab="Frac. Var. Explained")
points(1:20, lambdas[1:20], col="red")
print(sprintf("The first 4 PCs explain %s%% of the variance", round(sum(lambdas[1:4])*100)))## [1] "The first 4 PCs explain 47% of the variance"print(sprintf("The first 6 PCs explain %s%% of the variance", round(sum(lambdas[1:6])*100)))## [1] "The first 6 PCs explain 60% of the variance"## Eigen Vectors
### plot zsvd$u[,1:4]
### against the variables
### Identify the variables that have a strong influence
### on the injuries.
tu = expand.grid(Eofs = gl(4, 1, labels = c("EOF no.1","EOF no.2","EOF no.3","EOF no.4")),
variable = imp.vars.severity)
a=vector(length = 80)
a[1:4]=zsvd$u[1,1:4]
for (i in 2:20) {
ind1=4*(i-1)+1
ind=ind1+3
a[ind1:ind]=zsvd$u[i,1:4]
}
tu$Eof= a
show(ggplot(tu, aes(x = variable, y = Eof, color = Eofs, group = Eofs)) +
geom_point(size=3) + geom_line()+
labs(title = "Eigen vectors injury precursors",x = "variable",y = "Influence",color="")+
theme(plot.title = element_text(size = 13, face = "bold", hjust = 0.5))+
theme(axis.text.x=element_text(color = "black", size=11, angle=90, vjust=.8, hjust=0.8))+
coord_flip())
### fit Multinomial regression
### create binary vector
sevbin = as.numeric(sev)
pcs1 = cbind(sevbin,pcs1)
pcs1 = data.frame(pcs1)
zz = multinom(sevbin ~ ., data=pcs1)## # weights: 110 (84 variable)
## initial value 3033.790465
## iter 10 value 2259.280906
## iter 20 value 2193.854089
## iter 30 value 2183.696563
## iter 40 value 2181.897827
## iter 50 value 2181.379394
## iter 60 value 2181.332399
## iter 70 value 2181.327237
## final value 2181.327085
## convergedN = log(length(sevbin))
zbest=stepAIC(zz,k=N)## Start: AIC=4996.16
## sevbin ~ V2 + V3 + V4 + V5 + V6 + V7 + V8 + V9 + V10 + V11 +
## V12 + V13 + V14 + V15 + V16 + V17 + V18 + V19 + V20 + V21
##
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2253.119576
## iter 20 value 2195.032246
## iter 30 value 2184.617694
## iter 40 value 2183.056507
## iter 50 value 2182.841410
## iter 60 value 2182.730794
## iter 70 value 2182.554822
## iter 80 value 2182.429970
## iter 90 value 2182.356848
## iter 100 value 2182.308919
## final value 2182.308919
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2271.646107
## iter 20 value 2191.348396
## iter 30 value 2184.895763
## iter 40 value 2183.726100
## iter 50 value 2183.205164
## iter 60 value 2182.535003
## iter 70 value 2181.955827
## iter 80 value 2181.807477
## iter 90 value 2181.758225
## iter 100 value 2181.712705
## final value 2181.712705
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2261.319275
## iter 20 value 2191.669292
## iter 30 value 2185.763642
## iter 40 value 2184.038016
## iter 50 value 2183.563368
## final value 2183.517625
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2283.780933
## iter 20 value 2218.650233
## iter 30 value 2210.509121
## iter 40 value 2208.388222
## iter 50 value 2207.326595
## iter 60 value 2207.223265
## iter 70 value 2206.957683
## iter 80 value 2206.914990
## final value 2206.914322
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2261.382040
## iter 20 value 2191.339413
## iter 30 value 2185.478927
## iter 40 value 2183.882429
## iter 50 value 2183.496065
## iter 60 value 2183.441520
## iter 70 value 2183.421421
## iter 80 value 2183.389681
## iter 80 value 2183.389665
## iter 80 value 2183.389665
## final value 2183.389665
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2267.147226
## iter 20 value 2203.777965
## iter 30 value 2194.607690
## iter 40 value 2192.744851
## iter 50 value 2189.592762
## iter 60 value 2185.064640
## iter 70 value 2184.026590
## iter 80 value 2184.013675
## final value 2184.013356
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2261.275808
## iter 20 value 2194.627947
## iter 30 value 2186.796588
## iter 40 value 2185.486318
## iter 50 value 2184.544672
## iter 60 value 2183.760197
## iter 70 value 2183.324719
## iter 80 value 2182.743845
## iter 90 value 2182.213545
## final value 2182.114684
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2261.053077
## iter 20 value 2191.981835
## iter 30 value 2186.072625
## iter 40 value 2184.955814
## iter 50 value 2184.517063
## iter 60 value 2183.672755
## iter 70 value 2183.320458
## iter 80 value 2183.201794
## iter 90 value 2183.091846
## iter 100 value 2182.542411
## final value 2182.542411
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2269.150779
## iter 20 value 2199.881061
## iter 30 value 2193.182062
## iter 40 value 2191.669699
## iter 50 value 2190.396735
## iter 60 value 2189.377199
## iter 70 value 2189.334831
## final value 2189.211828
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2267.830870
## iter 20 value 2203.276530
## iter 30 value 2194.795596
## iter 40 value 2193.127374
## iter 50 value 2192.707070
## iter 60 value 2192.504791
## iter 70 value 2191.851503
## iter 80 value 2191.614139
## final value 2191.606888
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2261.084696
## iter 20 value 2194.344684
## iter 30 value 2185.938612
## iter 40 value 2184.134678
## iter 50 value 2183.600094
## iter 60 value 2183.472681
## iter 70 value 2183.089946
## iter 80 value 2182.922892
## final value 2182.921328
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2266.247499
## iter 20 value 2200.027078
## iter 30 value 2192.106580
## iter 40 value 2190.504570
## iter 50 value 2190.030104
## iter 60 value 2189.985519
## iter 70 value 2189.962702
## iter 80 value 2189.955997
## iter 90 value 2189.940003
## final value 2189.939672
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2265.401537
## iter 20 value 2196.361111
## iter 30 value 2190.196163
## iter 40 value 2188.696405
## iter 50 value 2188.282418
## iter 60 value 2187.777070
## iter 70 value 2187.561404
## iter 80 value 2187.460406
## final value 2187.451476
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2261.592415
## iter 20 value 2197.090709
## iter 30 value 2186.938030
## iter 40 value 2184.672011
## iter 50 value 2182.970726
## iter 60 value 2182.672657
## iter 70 value 2182.499705
## iter 80 value 2182.472730
## final value 2182.440279
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2259.866072
## iter 20 value 2193.938151
## iter 30 value 2184.724930
## iter 40 value 2182.516999
## iter 50 value 2181.858697
## iter 60 value 2181.659395
## iter 70 value 2181.597587
## iter 80 value 2181.595764
## iter 90 value 2181.588588
## final value 2181.588543
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2260.661893
## iter 20 value 2192.637666
## iter 30 value 2185.831584
## iter 40 value 2184.227236
## iter 50 value 2183.590705
## iter 60 value 2183.406457
## iter 70 value 2183.386157
## final value 2183.369467
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2262.987871
## iter 20 value 2198.414698
## iter 30 value 2190.623606
## iter 40 value 2189.081366
## iter 50 value 2188.477716
## iter 60 value 2187.210250
## iter 70 value 2186.338606
## iter 80 value 2186.309227
## iter 90 value 2186.303150
## iter 100 value 2186.299197
## final value 2186.299197
## stopped after 100 iterations
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2261.583644
## iter 20 value 2195.143202
## iter 30 value 2189.019453
## iter 40 value 2187.426775
## iter 50 value 2186.778183
## iter 60 value 2186.564700
## iter 70 value 2186.422413
## iter 80 value 2186.406063
## final value 2186.405997
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2259.351929
## iter 20 value 2193.967700
## iter 30 value 2184.823322
## iter 40 value 2183.307281
## iter 50 value 2182.680939
## iter 60 value 2182.399140
## iter 70 value 2182.272899
## iter 80 value 2182.254952
## final value 2182.254663
## converged
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2261.512064
## iter 20 value 2201.598528
## iter 30 value 2192.466659
## iter 40 value 2191.011477
## iter 50 value 2190.770173
## iter 60 value 2190.722538
## iter 70 value 2190.704268
## iter 80 value 2190.693094
## iter 90 value 2190.641634
## iter 100 value 2189.789441
## final value 2189.789441
## stopped after 100 iterations
## Df AIC
## - V16 4 4966.5
## - V3 4 4966.8
## - V8 4 4967.6
## - V20 4 4967.8
## - V2 4 4968.0
## - V15 4 4968.2
## - V9 4 4968.4
## - V12 4 4969.2
## - V17 4 4970.1
## - V6 4 4970.1
## - V4 4 4970.4
## - V7 4 4971.4
## - V18 4 4975.9
## - V19 4 4976.1
## - V14 4 4978.2
## - V10 4 4981.8
## - V21 4 4982.9
## - V13 4 4983.2
## - V11 4 4986.5
## <none> 4996.2
## - V5 4 5017.2
## # weights: 105 (80 variable)
## initial value 3033.790465
## iter 10 value 2259.866072
## iter 20 value 2193.938151
## iter 30 value 2184.724930
## iter 40 value 2182.516999
## iter 50 value 2181.858697
## iter 60 value 2181.659395
## iter 70 value 2181.597587
## iter 80 value 2181.595764
## iter 90 value 2181.588588
## final value 2181.588543
## converged
##
## Step: AIC=4966.51
## sevbin ~ V2 + V3 + V4 + V5 + V6 + V7 + V8 + V9 + V10 + V11 +
## V12 + V13 + V14 + V15 + V17 + V18 + V19 + V20 + V21
##
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2253.758219
## iter 20 value 2196.609363
## iter 30 value 2185.300456
## iter 40 value 2183.560987
## iter 50 value 2183.261478
## iter 60 value 2183.173637
## iter 70 value 2183.076227
## iter 80 value 2183.036745
## iter 90 value 2183.021272
## iter 100 value 2182.847179
## final value 2182.847179
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2273.852486
## iter 20 value 2193.101433
## iter 30 value 2185.565955
## iter 40 value 2184.205680
## iter 50 value 2183.629919
## iter 60 value 2183.048150
## iter 70 value 2182.478606
## iter 80 value 2182.266012
## iter 90 value 2182.081025
## iter 100 value 2182.001365
## final value 2182.001365
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2261.854570
## iter 20 value 2192.554701
## iter 30 value 2186.268513
## iter 40 value 2184.445189
## iter 50 value 2183.985711
## iter 60 value 2183.850817
## iter 70 value 2183.812901
## iter 80 value 2183.796223
## final value 2183.796125
## converged
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2284.451708
## iter 20 value 2219.399239
## iter 30 value 2211.273129
## iter 40 value 2208.920591
## iter 50 value 2207.791844
## iter 60 value 2207.406931
## iter 70 value 2207.319117
## iter 80 value 2207.275711
## iter 90 value 2207.248150
## iter 100 value 2207.223873
## final value 2207.223873
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2261.960505
## iter 20 value 2192.362629
## iter 30 value 2186.184847
## iter 40 value 2184.315332
## iter 50 value 2183.883929
## iter 60 value 2183.825991
## iter 70 value 2183.808999
## iter 80 value 2183.800120
## iter 90 value 2183.791049
## final value 2183.790996
## converged
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2267.759563
## iter 20 value 2204.318496
## iter 30 value 2195.322431
## iter 40 value 2193.367004
## iter 50 value 2192.479946
## iter 60 value 2192.000712
## iter 70 value 2191.824136
## iter 80 value 2191.815632
## final value 2191.811978
## converged
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2261.890840
## iter 20 value 2197.593793
## iter 30 value 2187.610486
## iter 40 value 2186.196430
## iter 50 value 2185.402061
## iter 60 value 2184.157372
## iter 70 value 2183.515940
## iter 80 value 2183.173566
## iter 90 value 2182.839432
## iter 100 value 2182.686253
## final value 2182.686253
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2261.655464
## iter 20 value 2194.853664
## iter 30 value 2186.929000
## iter 40 value 2185.643900
## iter 50 value 2184.995301
## iter 60 value 2184.712973
## iter 70 value 2184.162024
## iter 80 value 2183.845110
## iter 90 value 2183.378476
## iter 100 value 2183.256594
## final value 2183.256594
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2269.663687
## iter 20 value 2202.019681
## iter 30 value 2194.198583
## iter 40 value 2192.334269
## iter 50 value 2191.665942
## iter 60 value 2191.089429
## iter 70 value 2190.785741
## iter 80 value 2190.650968
## iter 90 value 2190.591052
## iter 100 value 2190.540030
## final value 2190.540030
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2268.278409
## iter 20 value 2204.206103
## iter 30 value 2195.590887
## iter 40 value 2193.758448
## iter 50 value 2193.386816
## iter 60 value 2193.279340
## iter 70 value 2193.210332
## iter 80 value 2193.183400
## iter 90 value 2193.179355
## final value 2193.179185
## converged
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2261.726168
## iter 20 value 2193.428221
## iter 30 value 2186.546552
## iter 40 value 2184.624342
## iter 50 value 2184.044180
## iter 60 value 2183.650955
## iter 70 value 2183.489711
## final value 2183.446773
## converged
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2266.953518
## iter 20 value 2202.332712
## iter 30 value 2192.884192
## iter 40 value 2191.031248
## iter 50 value 2190.496675
## iter 60 value 2190.379564
## iter 70 value 2190.310728
## final value 2190.306074
## converged
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2266.024689
## iter 20 value 2201.742546
## iter 30 value 2191.650666
## iter 40 value 2189.746779
## iter 50 value 2189.004015
## iter 60 value 2188.331849
## iter 70 value 2188.019949
## iter 80 value 2187.884825
## final value 2187.877625
## converged
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2262.204551
## iter 20 value 2197.952110
## iter 30 value 2187.916705
## iter 40 value 2185.348016
## iter 50 value 2183.874578
## iter 60 value 2183.142860
## iter 70 value 2183.087206
## final value 2183.056140
## converged
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2261.175480
## iter 20 value 2193.303609
## iter 30 value 2186.307004
## iter 40 value 2184.737384
## iter 50 value 2184.229645
## iter 60 value 2184.114034
## iter 70 value 2184.030851
## iter 80 value 2183.967318
## iter 90 value 2183.958801
## final value 2183.958683
## converged
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2263.585808
## iter 20 value 2199.205510
## iter 30 value 2191.321844
## iter 40 value 2189.593477
## iter 50 value 2189.114890
## iter 60 value 2188.694338
## iter 70 value 2188.622293
## iter 80 value 2188.497783
## iter 90 value 2188.428773
## iter 100 value 2188.420375
## final value 2188.420375
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2262.303285
## iter 20 value 2197.547983
## iter 30 value 2190.042726
## iter 40 value 2188.310840
## iter 50 value 2187.586829
## iter 60 value 2187.300566
## iter 70 value 2187.140021
## iter 80 value 2187.127335
## final value 2187.127293
## converged
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2259.957340
## iter 20 value 2194.260217
## iter 30 value 2185.891028
## iter 40 value 2183.972864
## iter 50 value 2183.294566
## iter 60 value 2183.187509
## iter 70 value 2183.060673
## iter 80 value 2183.052799
## iter 90 value 2183.050417
## iter 100 value 2182.952126
## final value 2182.952126
## stopped after 100 iterations
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2261.906837
## iter 20 value 2202.029619
## iter 30 value 2193.019384
## iter 40 value 2191.646155
## iter 50 value 2191.401855
## iter 60 value 2191.340939
## iter 70 value 2191.309847
## iter 80 value 2191.294557
## iter 90 value 2191.285441
## iter 100 value 2190.913673
## final value 2190.913673
## stopped after 100 iterations
## Df AIC
## - V3 4 4937.2
## - V8 4 4938.5
## - V2 4 4938.9
## - V20 4 4939.1
## - V15 4 4939.3
## - V9 4 4939.7
## - V12 4 4940.1
## - V6 4 4940.7
## - V4 4 4940.8
## - V17 4 4941.1
## - V19 4 4947.4
## - V14 4 4948.9
## - V18 4 4950.0
## - V13 4 4953.8
## - V10 4 4954.2
## - V21 4 4955.0
## - V7 4 4956.8
## - V11 4 4959.5
## <none> 4966.5
## - V5 4 4987.6
## # weights: 100 (76 variable)
## initial value 3033.790465
## iter 10 value 2273.852486
## iter 20 value 2193.101433
## iter 30 value 2185.565955
## iter 40 value 2184.205680
## iter 50 value 2183.629919
## iter 60 value 2183.048150
## iter 70 value 2182.478606
## iter 80 value 2182.266012
## iter 90 value 2182.081025
## iter 100 value 2182.001365
## final value 2182.001365
## stopped after 100 iterations
##
## Step: AIC=4937.17
## sevbin ~ V2 + V4 + V5 + V6 + V7 + V8 + V9 + V10 + V11 + V12 +
## V13 + V14 + V15 + V17 + V18 + V19 + V20 + V21
##
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2253.034400
## iter 20 value 2194.358254
## iter 30 value 2186.797904
## iter 40 value 2185.364157
## iter 50 value 2184.821298
## iter 60 value 2184.227138
## iter 70 value 2183.919096
## iter 80 value 2183.762185
## iter 90 value 2183.718040
## final value 2183.703818
## converged
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2274.883382
## iter 20 value 2194.744849
## iter 30 value 2187.731381
## iter 40 value 2186.367810
## iter 50 value 2185.848918
## iter 60 value 2185.350016
## iter 70 value 2185.130803
## iter 80 value 2184.901318
## iter 90 value 2184.668784
## iter 100 value 2184.170640
## final value 2184.170640
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2282.689873
## iter 20 value 2224.849427
## iter 30 value 2212.344310
## iter 40 value 2209.979506
## iter 50 value 2209.443758
## iter 60 value 2208.699536
## iter 70 value 2207.917174
## iter 80 value 2207.730296
## iter 90 value 2207.497675
## iter 100 value 2207.420081
## final value 2207.420081
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2278.800427
## iter 20 value 2195.696677
## iter 30 value 2187.731666
## iter 40 value 2186.086834
## iter 50 value 2185.664691
## iter 60 value 2185.102252
## iter 70 value 2184.652370
## iter 80 value 2184.344509
## iter 90 value 2184.261383
## iter 100 value 2184.168167
## final value 2184.168167
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2277.441437
## iter 20 value 2203.786608
## iter 30 value 2196.921265
## iter 40 value 2195.389255
## iter 50 value 2194.339021
## iter 60 value 2193.504215
## iter 70 value 2193.002880
## iter 80 value 2192.672527
## iter 90 value 2192.345795
## iter 100 value 2192.184672
## final value 2192.184672
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2268.536908
## iter 20 value 2195.695494
## iter 30 value 2188.674775
## iter 40 value 2187.438544
## iter 50 value 2186.506624
## iter 60 value 2184.985546
## iter 70 value 2184.338120
## iter 80 value 2183.664929
## iter 90 value 2183.116323
## iter 100 value 2183.064571
## final value 2183.064571
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2279.095799
## iter 20 value 2193.670252
## iter 30 value 2188.023766
## iter 40 value 2186.990569
## iter 50 value 2186.336475
## iter 60 value 2186.063637
## iter 70 value 2185.485306
## iter 80 value 2185.040246
## iter 90 value 2184.734047
## iter 100 value 2183.497991
## final value 2183.497991
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2270.625051
## iter 20 value 2201.924258
## iter 30 value 2195.300428
## iter 40 value 2193.684552
## iter 50 value 2192.908523
## iter 60 value 2191.769153
## iter 70 value 2191.352664
## iter 80 value 2191.159797
## iter 90 value 2191.065979
## iter 100 value 2190.942387
## final value 2190.942387
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2266.749615
## iter 20 value 2203.786671
## iter 30 value 2196.731138
## iter 40 value 2195.426401
## iter 50 value 2195.135637
## iter 60 value 2195.067163
## iter 70 value 2195.040896
## iter 80 value 2195.037701
## final value 2195.037279
## converged
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2273.865719
## iter 20 value 2195.576984
## iter 30 value 2188.109460
## iter 40 value 2186.508212
## iter 50 value 2185.961748
## iter 60 value 2185.556197
## iter 70 value 2185.301608
## iter 80 value 2185.094661
## iter 90 value 2185.059542
## iter 100 value 2185.049988
## final value 2185.049988
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2272.358075
## iter 20 value 2201.304650
## iter 30 value 2194.203460
## iter 40 value 2193.014889
## iter 50 value 2192.821777
## iter 60 value 2192.753553
## iter 70 value 2192.648805
## iter 80 value 2192.639609
## iter 90 value 2192.638614
## final value 2192.635499
## converged
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2277.481660
## iter 20 value 2199.527943
## iter 30 value 2192.606234
## iter 40 value 2191.587201
## iter 50 value 2191.244362
## iter 60 value 2190.765232
## iter 70 value 2190.518413
## iter 80 value 2190.227387
## iter 90 value 2189.510511
## iter 100 value 2188.097840
## final value 2188.097840
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2276.033040
## iter 20 value 2199.151330
## iter 30 value 2188.971927
## iter 40 value 2187.026240
## iter 50 value 2186.294196
## iter 60 value 2185.575905
## iter 70 value 2185.362277
## iter 80 value 2185.353068
## iter 90 value 2185.334742
## iter 100 value 2185.325979
## final value 2185.325979
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2273.921893
## iter 20 value 2197.215373
## iter 30 value 2188.114181
## iter 40 value 2186.424229
## iter 50 value 2185.703142
## iter 60 value 2185.381300
## iter 70 value 2185.205976
## iter 80 value 2185.096644
## iter 90 value 2184.673212
## iter 100 value 2184.258421
## final value 2184.258421
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2262.379337
## iter 20 value 2209.692097
## iter 30 value 2192.804916
## iter 40 value 2191.365625
## iter 50 value 2190.915127
## iter 60 value 2190.701628
## iter 70 value 2190.594639
## iter 80 value 2190.558770
## iter 90 value 2190.510640
## iter 100 value 2190.494857
## final value 2190.494857
## stopped after 100 iterations
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2275.966837
## iter 20 value 2198.501575
## iter 30 value 2191.448485
## iter 40 value 2190.165165
## iter 50 value 2189.508982
## iter 60 value 2188.740530
## iter 70 value 2187.523687
## iter 80 value 2187.398684
## iter 90 value 2187.395420
## iter 90 value 2187.395401
## iter 90 value 2187.395401
## final value 2187.395401
## converged
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2274.285888
## iter 20 value 2196.535847
## iter 30 value 2187.013193
## iter 40 value 2185.709328
## iter 50 value 2185.174250
## iter 60 value 2184.971210
## iter 70 value 2184.895497
## iter 80 value 2184.887767
## final value 2184.886355
## converged
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2260.424396
## iter 20 value 2202.688342
## iter 30 value 2194.540219
## iter 40 value 2193.558024
## iter 50 value 2193.171045
## iter 60 value 2192.840035
## iter 70 value 2192.806489
## final value 2192.800468
## converged
## Df AIC
## - V8 4 4909.1
## - V9 4 4910.0
## - V2 4 4910.4
## - V6 4 4911.3
## - V4 4 4911.3
## - V17 4 4911.5
## - V20 4 4912.8
## - V12 4 4913.1
## - V15 4 4913.7
## - V19 4 4917.8
## - V14 4 4919.2
## - V18 4 4924.0
## - V10 4 4924.9
## - V7 4 4927.4
## - V13 4 4928.3
## - V21 4 4928.6
## - V11 4 4933.1
## <none> 4937.2
## - V5 4 4957.8
## # weights: 95 (72 variable)
## initial value 3033.790465
## iter 10 value 2268.536908
## iter 20 value 2195.695494
## iter 30 value 2188.674775
## iter 40 value 2187.438544
## iter 50 value 2186.506624
## iter 60 value 2184.985546
## iter 70 value 2184.338120
## iter 80 value 2183.664929
## iter 90 value 2183.116323
## iter 100 value 2183.064571
## final value 2183.064571
## stopped after 100 iterations
##
## Step: AIC=4909.13
## sevbin ~ V2 + V4 + V5 + V6 + V7 + V9 + V10 + V11 + V12 + V13 +
## V14 + V15 + V17 + V18 + V19 + V20 + V21
##
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2248.599178
## iter 20 value 2194.286969
## iter 30 value 2189.698493
## iter 40 value 2188.475306
## iter 50 value 2187.296815
## iter 60 value 2186.009534
## iter 70 value 2185.654691
## iter 80 value 2185.415731
## iter 90 value 2185.246457
## iter 100 value 2185.178987
## final value 2185.178987
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2269.972030
## iter 20 value 2202.614378
## iter 30 value 2190.969309
## iter 40 value 2189.611317
## iter 50 value 2188.791335
## iter 60 value 2187.902730
## iter 70 value 2186.599875
## iter 80 value 2185.545151
## iter 90 value 2185.406660
## iter 100 value 2185.341264
## final value 2185.341264
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2285.072660
## iter 20 value 2228.025083
## iter 30 value 2216.347150
## iter 40 value 2214.568158
## iter 50 value 2213.196087
## iter 60 value 2211.664427
## iter 70 value 2210.419958
## iter 80 value 2209.954454
## iter 90 value 2209.349399
## iter 100 value 2209.157509
## final value 2209.157509
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2274.272003
## iter 20 value 2197.254092
## iter 30 value 2190.655763
## iter 40 value 2189.620201
## iter 50 value 2188.686674
## iter 60 value 2187.378292
## iter 70 value 2186.764629
## iter 80 value 2185.848197
## iter 90 value 2185.594952
## iter 100 value 2185.491683
## final value 2185.491683
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2271.996234
## iter 20 value 2205.367274
## iter 30 value 2199.593290
## iter 40 value 2197.950439
## iter 50 value 2196.256212
## iter 60 value 2195.161068
## iter 70 value 2194.258445
## iter 80 value 2193.596633
## iter 90 value 2192.843704
## iter 100 value 2192.815490
## final value 2192.815490
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2270.296854
## iter 20 value 2196.627008
## iter 30 value 2190.889333
## iter 40 value 2189.567436
## iter 50 value 2188.607629
## iter 60 value 2187.161339
## iter 70 value 2186.382273
## iter 80 value 2185.519327
## iter 90 value 2185.282911
## iter 100 value 2185.140612
## final value 2185.140612
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2270.494202
## iter 20 value 2204.831851
## iter 30 value 2197.992159
## iter 40 value 2196.416761
## iter 50 value 2195.403233
## iter 60 value 2193.935359
## iter 70 value 2193.335976
## iter 80 value 2192.905762
## iter 90 value 2192.522690
## iter 100 value 2192.267901
## final value 2192.267901
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2281.875213
## iter 20 value 2206.429456
## iter 30 value 2199.647733
## iter 40 value 2198.531857
## iter 50 value 2198.061829
## iter 60 value 2197.822617
## iter 70 value 2197.737383
## iter 80 value 2197.720139
## iter 90 value 2197.718566
## iter 100 value 2197.714976
## final value 2197.714976
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2269.002387
## iter 20 value 2197.159455
## iter 30 value 2191.163541
## iter 40 value 2189.848990
## iter 50 value 2188.931687
## iter 60 value 2188.059949
## iter 70 value 2187.785444
## iter 80 value 2187.443977
## iter 90 value 2187.337193
## iter 100 value 2187.333919
## final value 2187.333919
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2267.951572
## iter 20 value 2203.863074
## iter 30 value 2197.499147
## iter 40 value 2196.802651
## iter 50 value 2196.704621
## iter 60 value 2196.661938
## iter 70 value 2196.653258
## final value 2196.651334
## converged
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2272.383898
## iter 20 value 2205.404568
## iter 30 value 2195.676318
## iter 40 value 2194.851834
## iter 50 value 2194.398965
## iter 60 value 2193.957812
## iter 70 value 2193.807844
## iter 80 value 2193.764785
## iter 90 value 2193.762892
## final value 2193.757178
## converged
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2270.535043
## iter 20 value 2203.230864
## iter 30 value 2191.976895
## iter 40 value 2190.532305
## iter 50 value 2189.531390
## iter 60 value 2188.875562
## iter 70 value 2188.289430
## iter 80 value 2188.125907
## iter 90 value 2188.025527
## iter 100 value 2188.000846
## final value 2188.000846
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2268.075262
## iter 20 value 2198.106054
## iter 30 value 2191.072751
## iter 40 value 2189.844977
## iter 50 value 2188.950301
## iter 60 value 2188.666318
## iter 70 value 2188.611500
## iter 80 value 2188.573860
## iter 90 value 2188.370858
## iter 100 value 2186.801093
## final value 2186.801093
## stopped after 100 iterations
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2281.510408
## iter 20 value 2202.492227
## iter 30 value 2195.786442
## iter 40 value 2194.732512
## iter 50 value 2194.149327
## iter 60 value 2193.805317
## iter 70 value 2193.745532
## iter 80 value 2193.739377
## final value 2193.739242
## converged
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2270.406144
## iter 20 value 2200.670772
## iter 30 value 2194.267864
## iter 40 value 2193.273945
## iter 50 value 2191.746475
## iter 60 value 2189.307187
## iter 70 value 2188.747292
## iter 80 value 2188.535612
## iter 90 value 2188.515538
## final value 2188.515499
## converged
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2269.115050
## iter 20 value 2196.386047
## iter 30 value 2189.856916
## iter 40 value 2188.920713
## iter 50 value 2188.196472
## iter 60 value 2187.881773
## iter 70 value 2187.779367
## iter 80 value 2187.772654
## final value 2187.767633
## converged
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2280.532531
## iter 20 value 2214.516502
## iter 30 value 2197.592274
## iter 40 value 2196.891808
## iter 50 value 2196.373298
## iter 60 value 2196.117234
## iter 70 value 2196.075260
## final value 2196.075158
## converged
## Df AIC
## - V9 4 4883.1
## - V2 4 4883.2
## - V4 4 4883.5
## - V6 4 4883.8
## - V17 4 4886.4
## - V12 4 4887.5
## - V20 4 4888.4
## - V15 4 4888.8
## - V19 4 4889.9
## - V10 4 4897.4
## - V7 4 4898.5
## - V18 4 4900.3
## - V14 4 4900.3
## - V21 4 4905.0
## - V13 4 4906.1
## - V11 4 4908.3
## <none> 4909.1
## - V5 4 4931.1
## # weights: 90 (68 variable)
## initial value 3033.790465
## iter 10 value 2270.296854
## iter 20 value 2196.627008
## iter 30 value 2190.889333
## iter 40 value 2189.567436
## iter 50 value 2188.607629
## iter 60 value 2187.161339
## iter 70 value 2186.382273
## iter 80 value 2185.519327
## iter 90 value 2185.282911
## iter 100 value 2185.140612
## final value 2185.140612
## stopped after 100 iterations
##
## Step: AIC=4883.12
## sevbin ~ V2 + V4 + V5 + V6 + V7 + V10 + V11 + V12 + V13 + V14 +
## V15 + V17 + V18 + V19 + V20 + V21
##
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2250.818906
## iter 20 value 2195.077660
## iter 30 value 2192.062684
## iter 40 value 2190.729750
## iter 50 value 2189.545058
## iter 60 value 2188.296863
## iter 70 value 2187.595654
## iter 80 value 2187.379463
## iter 90 value 2187.249176
## iter 100 value 2187.160143
## final value 2187.160143
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2271.545122
## iter 20 value 2199.291925
## iter 30 value 2193.085249
## iter 40 value 2191.928358
## iter 50 value 2191.133673
## iter 60 value 2190.576970
## iter 70 value 2190.059967
## iter 80 value 2189.833562
## iter 90 value 2189.513138
## iter 100 value 2189.385310
## final value 2189.385310
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2286.783743
## iter 20 value 2224.659687
## iter 30 value 2218.242195
## iter 40 value 2216.226898
## iter 50 value 2214.750072
## iter 60 value 2213.177781
## iter 70 value 2211.870625
## iter 80 value 2211.338148
## iter 90 value 2210.947896
## iter 100 value 2210.573895
## final value 2210.573895
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2276.544279
## iter 20 value 2196.927162
## iter 30 value 2192.800175
## iter 40 value 2191.783603
## iter 50 value 2190.625411
## iter 60 value 2189.434044
## iter 70 value 2189.166267
## iter 80 value 2189.109604
## iter 90 value 2189.094843
## final value 2189.086353
## converged
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2272.671165
## iter 20 value 2206.056682
## iter 30 value 2201.948788
## iter 40 value 2200.670558
## iter 50 value 2199.484172
## iter 60 value 2198.511580
## iter 70 value 2197.218077
## iter 80 value 2196.166311
## iter 90 value 2196.079761
## iter 100 value 2195.612689
## final value 2195.612689
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2270.393724
## iter 20 value 2205.668200
## iter 30 value 2200.284625
## iter 40 value 2198.509289
## iter 50 value 2197.449570
## iter 60 value 2196.001679
## iter 70 value 2195.558263
## iter 80 value 2195.295350
## iter 90 value 2195.183459
## iter 100 value 2195.072444
## final value 2195.072444
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2285.457533
## iter 20 value 2208.438584
## iter 30 value 2201.946398
## iter 40 value 2200.984248
## iter 50 value 2200.510262
## iter 60 value 2200.049947
## iter 70 value 2199.817399
## iter 80 value 2199.769573
## final value 2199.768364
## converged
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2270.843469
## iter 20 value 2201.441244
## iter 30 value 2193.596537
## iter 40 value 2192.304726
## iter 50 value 2191.340947
## iter 60 value 2190.682727
## iter 70 value 2190.451747
## iter 80 value 2190.405263
## final value 2190.377893
## converged
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2269.300956
## iter 20 value 2205.575596
## iter 30 value 2199.952211
## iter 40 value 2199.372939
## iter 50 value 2199.157111
## iter 60 value 2198.906606
## iter 70 value 2198.890664
## final value 2198.888086
## converged
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2273.864039
## iter 20 value 2204.746193
## iter 30 value 2197.328648
## iter 40 value 2196.457116
## iter 50 value 2195.451828
## iter 60 value 2194.930238
## iter 70 value 2194.740345
## iter 80 value 2194.736898
## iter 90 value 2194.725604
## final value 2194.725581
## converged
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2272.283676
## iter 20 value 2204.494566
## iter 30 value 2194.085119
## iter 40 value 2192.749514
## iter 50 value 2192.243936
## iter 60 value 2191.767689
## iter 70 value 2191.500677
## iter 80 value 2191.489779
## iter 90 value 2191.483807
## final value 2191.481348
## converged
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2269.934603
## iter 20 value 2199.414553
## iter 30 value 2193.355354
## iter 40 value 2192.039574
## iter 50 value 2191.314209
## iter 60 value 2191.223177
## iter 70 value 2191.177701
## iter 80 value 2191.167240
## final value 2191.157888
## converged
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2283.513228
## iter 20 value 2203.364554
## iter 30 value 2197.905775
## iter 40 value 2196.870226
## iter 50 value 2196.388066
## iter 60 value 2196.132873
## iter 70 value 2196.052232
## final value 2196.051341
## converged
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2272.188212
## iter 20 value 2201.693277
## iter 30 value 2196.414996
## iter 40 value 2194.976656
## iter 50 value 2192.651073
## iter 60 value 2190.672232
## iter 70 value 2190.425348
## iter 80 value 2190.332773
## iter 90 value 2189.800511
## iter 100 value 2189.768447
## final value 2189.768447
## stopped after 100 iterations
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2270.879487
## iter 20 value 2197.343745
## iter 30 value 2192.054006
## iter 40 value 2190.863358
## iter 50 value 2190.165070
## iter 60 value 2189.905472
## iter 70 value 2189.807933
## iter 80 value 2189.800685
## iter 80 value 2189.800676
## iter 80 value 2189.800676
## final value 2189.800676
## converged
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2282.383413
## iter 20 value 2209.531444
## iter 30 value 2199.901819
## iter 40 value 2199.267212
## iter 50 value 2198.535458
## iter 60 value 2198.432422
## final value 2198.429490
## converged
## Df AIC
## - V2 4 4857.0
## - V6 4 4860.8
## - V4 4 4861.4
## - V19 4 4862.2
## - V20 4 4862.3
## - V12 4 4863.4
## - V17 4 4865.0
## - V15 4 4865.6
## - V14 4 4872.1
## - V10 4 4872.8
## - V7 4 4873.9
## - V18 4 4874.8
## - V21 4 4879.5
## - V13 4 4880.4
## - V11 4 4882.2
## <none> 4883.1
## - V5 4 4903.8
## # weights: 85 (64 variable)
## initial value 3033.790465
## iter 10 value 2250.818906
## iter 20 value 2195.077660
## iter 30 value 2192.062684
## iter 40 value 2190.729750
## iter 50 value 2189.545058
## iter 60 value 2188.296863
## iter 70 value 2187.595654
## iter 80 value 2187.379463
## iter 90 value 2187.249176
## iter 100 value 2187.160143
## final value 2187.160143
## stopped after 100 iterations
##
## Step: AIC=4856.99
## sevbin ~ V4 + V5 + V6 + V7 + V10 + V11 + V12 + V13 + V14 + V15 +
## V17 + V18 + V19 + V20 + V21
##
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2251.985456
## iter 20 value 2196.361853
## iter 30 value 2194.101765
## iter 40 value 2193.003667
## iter 50 value 2192.138686
## iter 60 value 2191.735227
## iter 70 value 2191.604064
## final value 2191.599308
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2273.324684
## iter 20 value 2222.113081
## iter 30 value 2219.569120
## iter 40 value 2217.219968
## iter 50 value 2215.588487
## iter 60 value 2214.044978
## iter 70 value 2213.474753
## iter 80 value 2213.215512
## iter 90 value 2213.136978
## final value 2213.135282
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2260.674933
## iter 20 value 2196.961464
## iter 30 value 2193.997173
## iter 40 value 2192.606501
## iter 50 value 2191.086325
## iter 60 value 2190.525468
## iter 70 value 2190.514292
## iter 80 value 2190.513785
## final value 2190.513500
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2252.169752
## iter 20 value 2205.259630
## iter 30 value 2202.985569
## iter 40 value 2201.259257
## iter 50 value 2200.003963
## iter 60 value 2199.118056
## iter 70 value 2198.356268
## iter 80 value 2198.105887
## iter 90 value 2197.747623
## final value 2197.747283
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2248.936259
## iter 20 value 2204.455325
## iter 30 value 2201.556111
## iter 40 value 2199.919100
## iter 50 value 2198.423571
## iter 60 value 2197.484978
## iter 70 value 2197.104865
## iter 80 value 2197.012338
## iter 90 value 2196.956245
## final value 2196.936958
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2261.687348
## iter 20 value 2205.971802
## iter 30 value 2203.070678
## iter 40 value 2202.253553
## iter 50 value 2201.791226
## iter 60 value 2201.341105
## iter 70 value 2201.153806
## iter 80 value 2201.137362
## iter 80 value 2201.137346
## iter 80 value 2201.137346
## final value 2201.137346
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2252.263148
## iter 20 value 2197.644977
## iter 30 value 2194.530992
## iter 40 value 2193.217303
## iter 50 value 2192.348613
## iter 60 value 2191.932243
## iter 70 value 2191.700578
## iter 80 value 2191.661496
## final value 2191.659807
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2251.679783
## iter 20 value 2203.363876
## iter 30 value 2201.002738
## iter 40 value 2200.569896
## iter 50 value 2200.406356
## iter 60 value 2200.258177
## iter 70 value 2200.251464
## iter 70 value 2200.251455
## iter 70 value 2200.251455
## final value 2200.251455
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2256.823245
## iter 20 value 2201.829353
## iter 30 value 2198.739046
## iter 40 value 2197.897106
## iter 50 value 2196.776243
## iter 60 value 2196.398952
## iter 70 value 2196.370458
## final value 2196.370318
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2254.089726
## iter 20 value 2198.228845
## iter 30 value 2195.035906
## iter 40 value 2193.941814
## iter 50 value 2193.643297
## iter 60 value 2193.268753
## iter 70 value 2193.180753
## iter 80 value 2193.157290
## final value 2193.157067
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2252.042112
## iter 20 value 2197.230530
## iter 30 value 2194.375989
## iter 40 value 2192.980314
## iter 50 value 2192.436054
## iter 60 value 2192.339783
## iter 70 value 2192.327295
## iter 80 value 2192.318218
## final value 2192.317743
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2264.232655
## iter 20 value 2202.707538
## iter 30 value 2199.148360
## iter 40 value 2198.013782
## iter 50 value 2197.631496
## iter 60 value 2197.474422
## iter 70 value 2197.437914
## final value 2197.437581
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2253.127176
## iter 20 value 2200.122500
## iter 30 value 2197.526391
## iter 40 value 2195.592372
## iter 50 value 2193.330345
## iter 60 value 2192.364947
## iter 70 value 2192.269224
## iter 80 value 2192.098185
## final value 2192.098116
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2250.913366
## iter 20 value 2195.766333
## iter 30 value 2193.160043
## iter 40 value 2191.848379
## iter 50 value 2191.346689
## iter 60 value 2191.056257
## iter 70 value 2191.038834
## final value 2191.033407
## converged
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2264.026098
## iter 20 value 2203.507896
## iter 30 value 2201.098238
## iter 40 value 2200.529926
## iter 50 value 2199.842744
## iter 60 value 2199.816203
## final value 2199.815998
## converged
## Df AIC
## - V6 4 4833.5
## - V20 4 4834.6
## - V4 4 4835.7
## - V12 4 4835.8
## - V19 4 4836.7
## - V17 4 4837.1
## - V15 4 4838.8
## - V14 4 4845.2
## - V10 4 4846.4
## - V18 4 4847.4
## - V7 4 4848.0
## - V21 4 4852.1
## - V13 4 4853.0
## - V11 4 4854.8
## <none> 4857.0
## - V5 4 4878.8
## # weights: 80 (60 variable)
## initial value 3033.790465
## iter 10 value 2260.674933
## iter 20 value 2196.961464
## iter 30 value 2193.997173
## iter 40 value 2192.606501
## iter 50 value 2191.086325
## iter 60 value 2190.525468
## iter 70 value 2190.514292
## iter 80 value 2190.513785
## final value 2190.513500
## converged
##
## Step: AIC=4833.53
## sevbin ~ V4 + V5 + V7 + V10 + V11 + V12 + V13 + V14 + V15 + V17 +
## V18 + V19 + V20 + V21
##
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2256.419353
## iter 20 value 2198.651840
## iter 30 value 2196.186026
## iter 40 value 2194.985932
## iter 50 value 2193.937051
## iter 60 value 2193.810459
## iter 70 value 2193.795747
## final value 2193.790947
## converged
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2269.510836
## iter 20 value 2223.568976
## iter 30 value 2221.100529
## iter 40 value 2219.144655
## iter 50 value 2217.351182
## iter 60 value 2216.972879
## iter 70 value 2216.906860
## iter 80 value 2216.874152
## final value 2216.873770
## converged
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2260.502798
## iter 20 value 2207.089678
## iter 30 value 2204.607206
## iter 40 value 2202.823033
## iter 50 value 2201.534771
## iter 60 value 2201.030166
## iter 70 value 2201.002026
## iter 80 value 2200.999524
## final value 2200.998854
## converged
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2248.055413
## iter 20 value 2205.926019
## iter 30 value 2203.186278
## iter 40 value 2201.458130
## iter 50 value 2199.907853
## iter 60 value 2199.692050
## iter 70 value 2199.662316
## iter 80 value 2199.659362
## final value 2199.657112
## converged
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2276.624846
## iter 20 value 2208.630063
## iter 30 value 2205.118505
## iter 40 value 2204.230612
## iter 50 value 2203.694709
## iter 60 value 2203.455136
## iter 70 value 2203.374290
## final value 2203.373498
## converged
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2266.643618
## iter 20 value 2199.288340
## iter 30 value 2196.478455
## iter 40 value 2195.125881
## iter 50 value 2194.148241
## iter 60 value 2194.074481
## iter 70 value 2194.050712
## iter 80 value 2194.044556
## final value 2194.044181
## converged
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2251.584062
## iter 20 value 2205.122137
## iter 30 value 2202.767648
## iter 40 value 2202.436768
## iter 50 value 2202.148084
## iter 60 value 2202.107299
## final value 2202.105444
## converged
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2264.407491
## iter 20 value 2203.567028
## iter 30 value 2200.657466
## iter 40 value 2199.704015
## iter 50 value 2198.804657
## iter 60 value 2198.751285
## iter 70 value 2198.686569
## final value 2198.682271
## converged
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2261.178421
## iter 20 value 2200.358160
## iter 30 value 2197.106908
## iter 40 value 2196.080211
## iter 50 value 2195.766528
## iter 60 value 2195.433940
## final value 2195.424565
## converged
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2263.331920
## iter 20 value 2199.345293
## iter 30 value 2196.122919
## iter 40 value 2194.677134
## iter 50 value 2194.299834
## iter 60 value 2194.210840
## iter 70 value 2194.195609
## final value 2194.192286
## converged
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2282.632254
## iter 20 value 2204.708389
## iter 30 value 2200.911821
## iter 40 value 2200.050862
## iter 50 value 2199.644716
## iter 60 value 2199.549639
## iter 70 value 2199.537372
## final value 2199.537324
## converged
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2266.563494
## iter 20 value 2202.200474
## iter 30 value 2199.378270
## iter 40 value 2196.680913
## iter 50 value 2195.252693
## iter 60 value 2195.144817
## iter 70 value 2195.138949
## final value 2195.138404
## converged
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2261.365478
## iter 20 value 2197.705793
## iter 30 value 2194.954475
## iter 40 value 2193.721702
## iter 50 value 2193.413060
## iter 60 value 2193.218889
## final value 2193.193924
## converged
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2269.959213
## iter 20 value 2205.091664
## iter 30 value 2202.787009
## iter 40 value 2201.939437
## iter 50 value 2201.520316
## final value 2201.518468
## converged
## Df AIC
## - V20 4 4808.7
## - V4 4 4809.9
## - V12 4 4810.4
## - V17 4 4810.7
## - V19 4 4812.6
## - V15 4 4813.2
## - V14 4 4819.7
## - V18 4 4821.4
## - V10 4 4821.6
## - V7 4 4824.3
## - V21 4 4825.4
## - V13 4 4826.5
## - V11 4 4829.1
## <none> 4833.5
## - V5 4 4856.1
## # weights: 75 (56 variable)
## initial value 3033.790465
## iter 10 value 2261.365478
## iter 20 value 2197.705793
## iter 30 value 2194.954475
## iter 40 value 2193.721702
## iter 50 value 2193.413060
## iter 60 value 2193.218889
## final value 2193.193924
## converged
##
## Step: AIC=4808.72
## sevbin ~ V4 + V5 + V7 + V10 + V11 + V12 + V13 + V14 + V15 + V17 +
## V18 + V19 + V21
##
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2257.063080
## iter 20 value 2199.404605
## iter 30 value 2197.157583
## iter 40 value 2196.179113
## iter 50 value 2195.969886
## iter 60 value 2195.894602
## final value 2195.892520
## converged
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2269.431464
## iter 20 value 2224.432584
## iter 30 value 2222.342332
## iter 40 value 2220.607741
## iter 50 value 2220.267577
## iter 60 value 2220.035895
## final value 2220.033651
## converged
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2260.917566
## iter 20 value 2207.512704
## iter 30 value 2205.125350
## iter 40 value 2203.973734
## iter 50 value 2203.648760
## iter 60 value 2203.502340
## final value 2203.493827
## converged
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2248.286130
## iter 20 value 2206.511635
## iter 30 value 2204.486757
## iter 40 value 2202.858377
## iter 50 value 2202.603087
## iter 60 value 2202.459998
## final value 2202.458307
## converged
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2277.248608
## iter 20 value 2209.338700
## iter 30 value 2206.072465
## iter 40 value 2205.082379
## iter 50 value 2204.632591
## iter 60 value 2204.486657
## final value 2204.486553
## converged
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2267.304822
## iter 20 value 2199.976049
## iter 30 value 2197.565020
## iter 40 value 2196.377985
## iter 50 value 2196.125567
## iter 60 value 2196.005642
## final value 2196.004620
## converged
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2251.767116
## iter 20 value 2205.684240
## iter 30 value 2203.589376
## iter 40 value 2203.177795
## iter 50 value 2202.815510
## final value 2202.813991
## converged
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2265.111943
## iter 20 value 2204.309042
## iter 30 value 2201.382726
## iter 40 value 2200.073702
## iter 50 value 2199.467598
## iter 60 value 2199.394289
## final value 2199.394152
## converged
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2261.860303
## iter 20 value 2201.279191
## iter 30 value 2198.403158
## iter 40 value 2197.646852
## iter 50 value 2197.036648
## final value 2197.023743
## converged
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2264.478651
## iter 20 value 2200.180422
## iter 30 value 2197.243038
## iter 40 value 2195.894857
## iter 50 value 2195.682362
## iter 60 value 2195.679041
## final value 2195.678955
## converged
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2283.615014
## iter 20 value 2205.444390
## iter 30 value 2201.819383
## iter 40 value 2200.765941
## iter 50 value 2200.450711
## iter 60 value 2200.403684
## final value 2200.401089
## converged
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2267.257803
## iter 20 value 2202.415435
## iter 30 value 2199.327849
## iter 40 value 2197.699361
## iter 50 value 2197.291815
## iter 60 value 2197.082754
## final value 2197.082587
## converged
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2268.599075
## iter 20 value 2205.965411
## iter 30 value 2203.723238
## iter 40 value 2203.208951
## iter 50 value 2203.115627
## iter 50 value 2203.115621
## iter 50 value 2203.115621
## final value 2203.115621
## converged
## Df AIC
## - V17 4 4783.5
## - V4 4 4784.0
## - V12 4 4784.2
## - V15 4 4786.2
## - V19 4 4786.3
## - V14 4 4791.0
## - V18 4 4793.0
## - V10 4 4797.1
## - V13 4 4797.8
## - V21 4 4798.4
## - V7 4 4799.2
## - V11 4 4801.1
## <none> 4808.7
## - V5 4 4832.2
## # weights: 70 (52 variable)
## initial value 3033.790465
## iter 10 value 2264.478651
## iter 20 value 2200.180422
## iter 30 value 2197.243038
## iter 40 value 2195.894857
## iter 50 value 2195.682362
## iter 60 value 2195.679041
## final value 2195.678955
## converged
##
## Step: AIC=4783.53
## sevbin ~ V4 + V5 + V7 + V10 + V11 + V12 + V13 + V14 + V15 + V18 +
## V19 + V21
##
## # weights: 65 (48 variable)
## initial value 3033.790465
## iter 10 value 2259.228269
## iter 20 value 2201.812830
## iter 30 value 2199.387348
## iter 40 value 2198.292286
## iter 50 value 2198.255720
## final value 2198.253785
## converged
## # weights: 65 (48 variable)
## initial value 3033.790465
## iter 10 value 2269.628330
## iter 20 value 2226.447078
## iter 30 value 2224.215855
## iter 40 value 2222.647087
## iter 50 value 2222.614513
## final value 2222.614059
## converged
## # weights: 65 (48 variable)
## initial value 3033.790465
## iter 10 value 2263.631236
## iter 20 value 2209.765446
## iter 30 value 2207.270842
## iter 40 value 2206.069830
## iter 50 value 2206.008545
## iter 60 value 2206.007474
## iter 60 value 2206.007453
## iter 60 value 2206.007453
## final value 2206.007453
## converged
## # weights: 65 (48 variable)
## initial value 3033.790465
## iter 10 value 2249.182087
## iter 20 value 2209.009033
## iter 30 value 2206.341693
## iter 40 value 2204.927845
## iter 50 value 2204.886841
## final value 2204.886301
## converged
## # weights: 65 (48 variable)
## initial value 3033.790465
## iter 10 value 2282.588458
## iter 20 value 2211.270611
## iter 30 value 2208.241940
## iter 40 value 2207.436738
## iter 50 value 2207.344156
## final value 2207.333452
## converged
## # weights: 65 (48 variable)
## initial value 3033.790465
## iter 10 value 2270.381800
## iter 20 value 2202.483413
## iter 30 value 2199.878519
## iter 40 value 2198.608591
## iter 50 value 2198.535084
## final value 2198.533853
## converged
## # weights: 65 (48 variable)
## initial value 3033.790465
## iter 10 value 2252.408657
## iter 20 value 2207.946612
## iter 30 value 2205.737263
## iter 40 value 2205.398439
## iter 50 value 2205.302876
## final value 2205.301789
## converged
## # weights: 65 (48 variable)
## initial value 3033.790465
## iter 10 value 2272.272520
## iter 20 value 2206.912798
## iter 30 value 2203.909981
## iter 40 value 2203.032369
## iter 50 value 2202.750697
## final value 2202.749361
## converged
## # weights: 65 (48 variable)
## initial value 3033.790465
## iter 10 value 2265.168955
## iter 20 value 2203.588105
## iter 30 value 2200.611592
## iter 40 value 2200.168169
## iter 50 value 2200.053304
## final value 2200.052202
## converged
## # weights: 65 (48 variable)
## initial value 3033.790465
## iter 10 value 2288.278326
## iter 20 value 2207.063270
## iter 30 value 2203.559963
## iter 40 value 2202.313754
## iter 50 value 2202.195985
## iter 60 value 2202.192612
## iter 60 value 2202.192600
## iter 60 value 2202.192600
## final value 2202.192600
## converged
## # weights: 65 (48 variable)
## initial value 3033.790465
## iter 10 value 2267.990407
## iter 20 value 2204.961266
## iter 30 value 2201.786564
## iter 40 value 2199.926292
## iter 50 value 2199.849837
## final value 2199.848959
## converged
## # weights: 65 (48 variable)
## initial value 3033.790465
## iter 10 value 2265.664010
## iter 20 value 2208.150102
## iter 30 value 2205.815427
## iter 40 value 2204.830171
## final value 2204.748986
## converged
## Df AIC
## - V4 4 4758.5
## - V12 4 4759.1
## - V19 4 4761.7
## - V15 4 4762.1
## - V18 4 4766.4
## - V14 4 4767.5
## - V21 4 4771.5
## - V10 4 4771.8
## - V13 4 4772.6
## - V7 4 4774.0
## - V11 4 4776.7
## <none> 4783.5
## - V5 4 4807.2
## # weights: 65 (48 variable)
## initial value 3033.790465
## iter 10 value 2259.228269
## iter 20 value 2201.812830
## iter 30 value 2199.387348
## iter 40 value 2198.292286
## iter 50 value 2198.255720
## final value 2198.253785
## converged
##
## Step: AIC=4758.51
## sevbin ~ V5 + V7 + V10 + V11 + V12 + V13 + V14 + V15 + V18 +
## V19 + V21
##
## # weights: 60 (44 variable)
## initial value 3033.790465
## iter 10 value 2273.538380
## iter 20 value 2227.611395
## iter 30 value 2225.610742
## iter 40 value 2224.881109
## iter 50 value 2224.872822
## final value 2224.871882
## converged
## # weights: 60 (44 variable)
## initial value 3033.790465
## iter 10 value 2258.734976
## iter 20 value 2211.183222
## iter 30 value 2209.415198
## iter 40 value 2208.546813
## iter 50 value 2208.513692
## final value 2208.513302
## converged
## # weights: 60 (44 variable)
## initial value 3033.790465
## iter 10 value 2251.634516
## iter 20 value 2210.425791
## iter 30 value 2208.483555
## iter 40 value 2207.395408
## iter 50 value 2207.390472
## final value 2207.389780
## converged
## # weights: 60 (44 variable)
## initial value 3033.790465
## iter 10 value 2280.675725
## iter 20 value 2212.423231
## iter 30 value 2210.291777
## iter 40 value 2209.602294
## iter 50 value 2209.580300
## final value 2209.579436
## converged
## # weights: 60 (44 variable)
## initial value 3033.790465
## iter 10 value 2264.428556
## iter 20 value 2204.162787
## iter 30 value 2202.047454
## iter 40 value 2201.073657
## iter 50 value 2201.061248
## final value 2201.060162
## converged
## # weights: 60 (44 variable)
## initial value 3033.790465
## iter 10 value 2269.370985
## iter 20 value 2210.242945
## iter 30 value 2208.194047
## iter 40 value 2207.905511
## iter 50 value 2207.834184
## final value 2207.834028
## converged
## # weights: 60 (44 variable)
## initial value 3033.790465
## iter 10 value 2284.525952
## iter 20 value 2208.345990
## iter 30 value 2206.130808
## iter 40 value 2205.329994
## iter 50 value 2205.248238
## final value 2205.247796
## converged
## # weights: 60 (44 variable)
## initial value 3033.790465
## iter 10 value 2260.445664
## iter 20 value 2205.254108
## iter 30 value 2202.972011
## iter 40 value 2202.604024
## iter 50 value 2202.528788
## iter 50 value 2202.528771
## iter 50 value 2202.528770
## final value 2202.528770
## converged
## # weights: 60 (44 variable)
## initial value 3033.790465
## iter 10 value 2282.776362
## iter 20 value 2209.124701
## iter 30 value 2205.758300
## iter 40 value 2204.747180
## iter 50 value 2204.708069
## final value 2204.705578
## converged
## # weights: 60 (44 variable)
## initial value 3033.790465
## iter 10 value 2262.068666
## iter 20 value 2206.614322
## iter 30 value 2203.997430
## iter 40 value 2202.524890
## iter 50 value 2202.502221
## final value 2202.501823
## converged
## # weights: 60 (44 variable)
## initial value 3033.790465
## iter 10 value 2281.533413
## iter 20 value 2210.721159
## iter 30 value 2208.228325
## iter 40 value 2207.314865
## final value 2207.296865
## converged
## Df AIC
## - V12 4 4734.0
## - V19 4 4736.8
## - V15 4 4736.9
## - V18 4 4741.2
## - V14 4 4742.3
## - V21 4 4746.4
## - V10 4 4746.6
## - V13 4 4747.5
## - V7 4 4748.9
## - V11 4 4751.0
## <none> 4758.5
## - V5 4 4781.6
## # weights: 60 (44 variable)
## initial value 3033.790465
## iter 10 value 2264.428556
## iter 20 value 2204.162787
## iter 30 value 2202.047454
## iter 40 value 2201.073657
## iter 50 value 2201.061248
## final value 2201.060162
## converged
##
## Step: AIC=4733.95
## sevbin ~ V5 + V7 + V10 + V11 + V13 + V14 + V15 + V18 + V19 +
## V21
##
## # weights: 55 (40 variable)
## initial value 3033.790465
## iter 10 value 2275.488442
## iter 20 value 2230.164907
## iter 30 value 2228.283627
## iter 40 value 2227.649357
## iter 50 value 2227.644985
## final value 2227.644801
## converged
## # weights: 55 (40 variable)
## initial value 3033.790465
## iter 10 value 2265.514176
## iter 20 value 2214.057170
## iter 30 value 2212.151133
## iter 40 value 2211.605121
## iter 50 value 2211.594164
## final value 2211.593854
## converged
## # weights: 55 (40 variable)
## initial value 3033.790465
## iter 10 value 2252.905513
## iter 20 value 2212.730195
## iter 30 value 2210.404763
## iter 40 value 2209.899451
## iter 50 value 2209.897584
## final value 2209.897330
## converged
## # weights: 55 (40 variable)
## initial value 3033.790465
## iter 10 value 2279.613368
## iter 20 value 2214.585149
## iter 30 value 2212.667684
## iter 40 value 2212.083522
## iter 50 value 2212.063742
## final value 2212.063711
## converged
## # weights: 55 (40 variable)
## initial value 3033.790465
## iter 10 value 2253.604181
## iter 20 value 2211.508361
## iter 30 value 2210.112175
## iter 40 value 2209.887084
## iter 50 value 2209.837471
## iter 50 value 2209.837452
## iter 50 value 2209.837452
## final value 2209.837452
## converged
## # weights: 55 (40 variable)
## initial value 3033.790465
## iter 10 value 2267.486751
## iter 20 value 2211.198523
## iter 30 value 2209.618052
## iter 40 value 2208.834447
## final value 2208.818069
## converged
## # weights: 55 (40 variable)
## initial value 3033.790465
## iter 10 value 2265.524530
## iter 20 value 2207.019945
## iter 30 value 2205.066564
## iter 40 value 2204.787870
## iter 50 value 2204.730264
## iter 50 value 2204.730245
## iter 50 value 2204.730245
## final value 2204.730245
## converged
## # weights: 55 (40 variable)
## initial value 3033.790465
## iter 10 value 2284.920699
## iter 20 value 2210.828380
## iter 30 value 2208.402664
## iter 40 value 2207.637342
## iter 50 value 2207.613038
## final value 2207.611384
## converged
## # weights: 55 (40 variable)
## initial value 3033.790465
## iter 10 value 2267.074193
## iter 20 value 2209.008072
## iter 30 value 2206.375961
## iter 40 value 2205.420866
## final value 2205.414849
## converged
## # weights: 55 (40 variable)
## initial value 3033.790465
## iter 10 value 2265.715952
## iter 20 value 2212.414873
## iter 30 value 2210.660996
## iter 40 value 2210.019240
## final value 2210.017811
## converged
## Df AIC
## - V15 4 4711.1
## - V19 4 4712.5
## - V18 4 4716.9
## - V14 4 4719.3
## - V13 4 4721.3
## - V10 4 4721.5
## - V21 4 4721.7
## - V7 4 4724.9
## - V11 4 4725.8
## <none> 4734.0
## - V5 4 4757.0
## # weights: 55 (40 variable)
## initial value 3033.790465
## iter 10 value 2265.524530
## iter 20 value 2207.019945
## iter 30 value 2205.066564
## iter 40 value 2204.787870
## iter 50 value 2204.730264
## iter 50 value 2204.730245
## iter 50 value 2204.730245
## final value 2204.730245
## converged
##
## Step: AIC=4711.13
## sevbin ~ V5 + V7 + V10 + V11 + V13 + V14 + V18 + V19 + V21
##
## # weights: 50 (36 variable)
## initial value 3033.790465
## iter 10 value 2278.387320
## iter 20 value 2233.333446
## iter 30 value 2232.197253
## iter 40 value 2231.734150
## final value 2231.729978
## converged
## # weights: 50 (36 variable)
## initial value 3033.790465
## iter 10 value 2267.027652
## iter 20 value 2216.953180
## iter 30 value 2215.462734
## iter 40 value 2215.311438
## final value 2215.306833
## converged
## # weights: 50 (36 variable)
## initial value 3033.790465
## iter 10 value 2254.681124
## iter 20 value 2215.314623
## iter 30 value 2213.829527
## iter 40 value 2213.557723
## iter 50 value 2213.509171
## iter 50 value 2213.509161
## iter 50 value 2213.509161
## final value 2213.509161
## converged
## # weights: 50 (36 variable)
## initial value 3033.790465
## iter 10 value 2280.748248
## iter 20 value 2217.682568
## iter 30 value 2215.968430
## iter 40 value 2215.696527
## final value 2215.659828
## converged
## # weights: 50 (36 variable)
## initial value 3033.790465
## iter 10 value 2255.213310
## iter 20 value 2213.832452
## iter 30 value 2212.506183
## iter 40 value 2212.299372
## final value 2212.291372
## converged
## # weights: 50 (36 variable)
## initial value 3033.790465
## iter 10 value 2268.442876
## iter 20 value 2214.270040
## iter 30 value 2212.610585
## iter 40 value 2212.054179
## iter 40 value 2212.054175
## iter 40 value 2212.054175
## final value 2212.054175
## converged
## # weights: 50 (36 variable)
## initial value 3033.790465
## iter 10 value 2283.627453
## iter 20 value 2213.595138
## iter 30 value 2211.559433
## iter 40 value 2211.170293
## final value 2211.125979
## converged
## # weights: 50 (36 variable)
## initial value 3033.790465
## iter 10 value 2269.718543
## iter 20 value 2211.860882
## iter 30 value 2209.966289
## iter 40 value 2209.597023
## final value 2209.590607
## converged
## # weights: 50 (36 variable)
## initial value 3033.790465
## iter 10 value 2286.752357
## iter 20 value 2215.399888
## iter 30 value 2213.735608
## final value 2213.608192
## converged
## Df AIC
## - V19 4 4690.7
## - V18 4 4693.8
## - V14 4 4695.6
## - V13 4 4696.1
## - V10 4 4698.5
## - V21 4 4698.7
## - V7 4 4702.1
## - V11 4 4702.8
## <none> 4711.1
## - V5 4 4735.0
## # weights: 50 (36 variable)
## initial value 3033.790465
## iter 10 value 2269.718543
## iter 20 value 2211.860882
## iter 30 value 2209.966289
## iter 40 value 2209.597023
## final value 2209.590607
## converged
##
## Step: AIC=4690.68
## sevbin ~ V5 + V7 + V10 + V11 + V13 + V14 + V18 + V21
##
## # weights: 45 (32 variable)
## initial value 3033.790465
## iter 10 value 2282.375391
## iter 20 value 2238.711787
## iter 30 value 2237.651295
## iter 40 value 2237.582004
## iter 40 value 2237.581994
## iter 40 value 2237.581994
## final value 2237.581994
## converged
## # weights: 45 (32 variable)
## initial value 3033.790465
## iter 10 value 2269.518974
## iter 20 value 2221.488440
## iter 30 value 2219.820163
## iter 40 value 2219.779001
## final value 2219.776312
## converged
## # weights: 45 (32 variable)
## initial value 3033.790465
## iter 10 value 2267.564212
## iter 20 value 2221.165565
## iter 30 value 2218.491468
## iter 40 value 2218.386202
## final value 2218.378877
## converged
## # weights: 45 (32 variable)
## initial value 3033.790465
## iter 10 value 2285.184318
## iter 20 value 2222.737221
## iter 30 value 2220.548435
## iter 40 value 2220.440337
## final value 2220.435282
## converged
## # weights: 45 (32 variable)
## initial value 3033.790465
## iter 10 value 2276.035394
## iter 20 value 2219.447857
## iter 30 value 2217.429618
## iter 40 value 2217.387821
## final value 2217.386890
## converged
## # weights: 45 (32 variable)
## initial value 3033.790465
## iter 10 value 2272.616682
## iter 20 value 2219.057222
## iter 30 value 2217.904048
## final value 2217.863510
## converged
## # weights: 45 (32 variable)
## initial value 3033.790465
## iter 10 value 2286.407314
## iter 20 value 2218.706813
## iter 30 value 2216.066824
## iter 40 value 2215.871904
## final value 2215.870366
## converged
## # weights: 45 (32 variable)
## initial value 3033.790465
## iter 10 value 2291.905294
## iter 20 value 2219.869462
## iter 30 value 2218.003758
## final value 2217.865964
## converged
## Df AIC
## - V18 4 4673.1
## - V13 4 4676.1
## - V14 4 4677.1
## - V21 4 4677.1
## - V10 4 4678.1
## - V7 4 4680.9
## - V11 4 4682.2
## <none> 4690.7
## - V5 4 4716.5
## # weights: 45 (32 variable)
## initial value 3033.790465
## iter 10 value 2286.407314
## iter 20 value 2218.706813
## iter 30 value 2216.066824
## iter 40 value 2215.871904
## final value 2215.870366
## converged
##
## Step: AIC=4673.07
## sevbin ~ V5 + V7 + V10 + V11 + V13 + V14 + V21
##
## # weights: 40 (28 variable)
## initial value 3033.790465
## iter 10 value 2327.373944
## iter 20 value 2244.609758
## iter 30 value 2243.732003
## final value 2243.653155
## converged
## # weights: 40 (28 variable)
## initial value 3033.790465
## iter 10 value 2276.792227
## iter 20 value 2227.090117
## iter 30 value 2225.839108
## iter 40 value 2225.757698
## final value 2225.757181
## converged
## # weights: 40 (28 variable)
## initial value 3033.790465
## iter 10 value 2305.190795
## iter 20 value 2226.254220
## iter 30 value 2224.828088
## iter 40 value 2224.725703
## final value 2224.725638
## converged
## # weights: 40 (28 variable)
## initial value 3033.790465
## iter 10 value 2295.973225
## iter 20 value 2228.499109
## iter 30 value 2226.898318
## iter 40 value 2226.794219
## final value 2226.793861
## converged
## # weights: 40 (28 variable)
## initial value 3033.790465
## iter 10 value 2287.570961
## iter 20 value 2224.608097
## iter 30 value 2223.523452
## final value 2223.453456
## converged
## # weights: 40 (28 variable)
## initial value 3033.790465
## iter 10 value 2289.237773
## iter 20 value 2225.261703
## iter 30 value 2223.967354
## final value 2223.886672
## converged
## # weights: 40 (28 variable)
## initial value 3033.790465
## iter 10 value 2280.990051
## iter 20 value 2226.845051
## iter 30 value 2224.367623
## final value 2224.329117
## converged
## Df AIC
## - V13 4 4658.1
## - V14 4 4658.9
## - V21 4 4659.8
## - V10 4 4660.6
## - V7 4 4662.7
## - V11 4 4664.8
## <none> 4673.1
## - V5 4 4698.5
## # weights: 40 (28 variable)
## initial value 3033.790465
## iter 10 value 2287.570961
## iter 20 value 2224.608097
## iter 30 value 2223.523452
## final value 2223.453456
## converged
##
## Step: AIC=4658.07
## sevbin ~ V5 + V7 + V10 + V11 + V14 + V21
##
## # weights: 35 (24 variable)
## initial value 3033.790465
## iter 10 value 2294.394349
## iter 20 value 2251.479409
## iter 30 value 2251.129975
## final value 2251.126881
## converged
## # weights: 35 (24 variable)
## initial value 3033.790465
## iter 10 value 2283.275318
## iter 20 value 2234.285918
## iter 30 value 2233.661384
## final value 2233.638991
## converged
## # weights: 35 (24 variable)
## initial value 3033.790465
## iter 10 value 2303.281588
## iter 20 value 2233.764691
## iter 30 value 2232.675727
## final value 2232.598839
## converged
## # weights: 35 (24 variable)
## initial value 3033.790465
## iter 10 value 2301.405312
## iter 20 value 2235.926370
## iter 30 value 2234.751794
## final value 2234.692552
## converged
## # weights: 35 (24 variable)
## initial value 3033.790465
## iter 10 value 2284.031492
## iter 20 value 2234.071206
## iter 30 value 2233.031893
## final value 2233.026571
## converged
## # weights: 35 (24 variable)
## initial value 3033.790465
## iter 10 value 2288.548717
## iter 20 value 2232.439137
## iter 30 value 2231.667055
## final value 2231.666958
## converged
## Df AIC
## - V21 4 4644.3
## - V10 4 4646.2
## - V14 4 4647.1
## - V7 4 4648.3
## - V11 4 4650.4
## <none> 4658.1
## - V5 4 4683.3
## # weights: 35 (24 variable)
## initial value 3033.790465
## iter 10 value 2288.548717
## iter 20 value 2232.439137
## iter 30 value 2231.667055
## final value 2231.666958
## converged
##
## Step: AIC=4644.33
## sevbin ~ V5 + V7 + V10 + V11 + V14
##
## # weights: 30 (20 variable)
## initial value 3033.790465
## iter 10 value 2310.914324
## iter 20 value 2259.594564
## final value 2259.355683
## converged
## # weights: 30 (20 variable)
## initial value 3033.790465
## iter 10 value 2285.063771
## iter 20 value 2242.347407
## final value 2242.102043
## converged
## # weights: 30 (20 variable)
## initial value 3033.790465
## iter 10 value 2288.352298
## iter 20 value 2241.033008
## final value 2240.856222
## converged
## # weights: 30 (20 variable)
## initial value 3033.790465
## iter 10 value 2294.663495
## iter 20 value 2243.359583
## final value 2242.825448
## converged
## # weights: 30 (20 variable)
## initial value 3033.790465
## iter 10 value 2279.717639
## iter 20 value 2241.383381
## final value 2241.178832
## converged
## Df AIC
## - V10 4 4632.5
## - V14 4 4633.2
## - V7 4 4635.0
## - V11 4 4636.5
## <none> 4644.3
## - V5 4 4669.5
## # weights: 30 (20 variable)
## initial value 3033.790465
## iter 10 value 2288.352298
## iter 20 value 2241.033008
## final value 2240.856222
## converged
##
## Step: AIC=4632.55
## sevbin ~ V5 + V7 + V11 + V14
##
## # weights: 25 (16 variable)
## initial value 3033.790465
## iter 10 value 2304.127694
## iter 20 value 2269.369073
## final value 2269.359193
## converged
## # weights: 25 (16 variable)
## initial value 3033.790465
## iter 10 value 2281.585872
## iter 20 value 2251.812483
## final value 2251.648808
## converged
## # weights: 25 (16 variable)
## initial value 3033.790465
## iter 10 value 2300.714879
## iter 20 value 2250.666909
## final value 2250.612843
## converged
## # weights: 25 (16 variable)
## initial value 3033.790465
## iter 10 value 2288.883427
## iter 20 value 2250.460702
## final value 2250.454196
## converged
## Df AIC
## - V14 4 4621.6
## - V11 4 4621.9
## - V7 4 4624.0
## <none> 4632.5
## - V5 4 4659.4
## # weights: 25 (16 variable)
## initial value 3033.790465
## iter 10 value 2288.883427
## iter 20 value 2250.460702
## final value 2250.454196
## converged
##
## Step: AIC=4621.58
## sevbin ~ V5 + V7 + V11
##
## # weights: 20 (12 variable)
## initial value 3033.790465
## iter 10 value 2308.708577
## final value 2278.520049
## converged
## # weights: 20 (12 variable)
## initial value 3033.790465
## iter 10 value 2293.562806
## iter 20 value 2261.340344
## final value 2261.340281
## converged
## # weights: 20 (12 variable)
## initial value 3033.790465
## iter 10 value 2296.445235
## iter 20 value 2260.044937
## final value 2260.044681
## converged
## Df AIC
## - V11 4 4610.6
## - V7 4 4613.2
## <none> 4621.6
## - V5 4 4647.5
## # weights: 20 (12 variable)
## initial value 3033.790465
## iter 10 value 2296.445235
## iter 20 value 2260.044937
## final value 2260.044681
## converged
##
## Step: AIC=4610.59
## sevbin ~ V5 + V7
##
## # weights: 15 (8 variable)
## initial value 3033.790465
## iter 10 value 2293.233218
## final value 2288.035328
## converged
## # weights: 15 (8 variable)
## initial value 3033.790465
## iter 10 value 2275.840837
## final value 2270.794809
## converged
## Df AIC
## - V7 4 4601.9
## <none> 4610.6
## - V5 4 4636.4
## # weights: 15 (8 variable)
## initial value 3033.790465
## iter 10 value 2275.840837
## final value 2270.794809
## converged
##
## Step: AIC=4601.92
## sevbin ~ V5
##
## # weights: 10 (4 variable)
## initial value 3033.790465
## iter 10 value 2298.868445
## final value 2298.860926
## converged
## Df AIC
## <none> 4601.9
## - V5 4 4627.9print(summary(zbest))## Call:
## multinom(formula = sevbin ~ V5, data = pcs1)
##
## Coefficients:
## (Intercept) V5
## 2 1.3856859 0.5023897
## 3 1.1492696 -1.0188690
## 4 -0.4902862 0.1879632
## 5 -1.8079867 -1.5778299
##
## Std. Errors:
## (Intercept) V5
## 2 0.08127565 0.2718042
## 3 0.08325535 0.3228468
## 4 0.11794842 0.3901892
## 5 0.19168359 1.0502369
##
## Residual Deviance: 4541.59
## AIC: 4557.59#################### RPSS
ypred = predict(zbest, type = "probs")
# RPSS calculations
acc2 = as.numeric(sev)
N = length(acc2)
acc2_name =""
#identify the numeric index
for (i in 1:4) {
ind=which(acc2==i)
acc2_name[i]=as.character(data1$worst.case.severity[ind[1]])
}
### using verification package you get the same results..
# Empirical probabilities
p1 <- length(acc2[acc2 == 1])/N
p2 <- length(acc2[acc2 == 2])/N
p3 <- length(acc2[acc2 == 3])/N
p4 <- length(acc2[acc2 == 4])/N
prob <- c(p1, p2, p3,p4)
RPSS=rps(acc2, ypred, baseline=prob)$rpss
prob=as.data.frame(prob)
rownames(prob)=acc2_name
print("Empirical probabilities are:")## [1] "Empirical probabilities are:"print(prob)## prob
## 1st Aid 0.11140584
## Medical Case 0.47108753
## Lost Work Time 0.33103448
## Permanent Disablement 0.06949602print(sprintf('Injury Severity Multinomial Regression RPSS: %s', RPSS))## [1] "Injury Severity Multinomial Regression RPSS: 0.357734324492506"Compare results with Tixier et al. (2016)
1.Body Part Injury Prediction The PCA + multinomial regression model achieved an RPSS of 0.282, which is higher than the RF model (0.172) reported by Tixier et al., and slightly below the SGTB model (0.324). This indicates that this approach is competitive and provides a compromise between interpretability and prediction accuracy. 2.Injury Severity Prediction The PCA + multinomial regression model achieved an RPSS of 0.358, which significantly outperforms both RF (−0.1) and SGTB (−0.65) reported in Tixier et al. (2016). This is a notable improvement, as the ensemble models failed to show predictive skill for injury severity. The PCA-based approach seems to better capture meaningful structure in the data, maybe because PCA can minimize noise and highlight important information, whereas Tixier et al. had limited success predicting this outcome.
Conclusion While ensemble methods perform well for predicting injury body part, the PCA-based regression approach proved to be similarly effective and even outperformed them in predicting injury severity. This demonstrates the value of PCA for improving model performance and clarity in addition to lowering dimensionality, particularly for complicated outcomes that are generally more difficult to anticipate.