PROJETOS EM DATA SCIENCE

Pós-Graduação em Estatística e Experimentação Agropecuária da Universidade Federal de Lavras (DES/UFLA). Disciplina Tópicos Especiais. Professor Responsável Paulo Henrique. Análise e Visualização de Dados
Resumo
Detalhes do projeto
Introdução
Dados
Weight Decay of Neural Network
Modelo “pcaNNet”
Random Forest
Knn (K-nearest neighbor) model.

Pós-Graduação em Estatística e Experimentação Agropecuária da Universidade Federal de Lavras (DES/UFLA). Disciplina Tópicos Especiais. Professor Responsável Paulo Henrique. Análise e Visualização de Dados

Resumo

Neste projeto, foi modelado através de dados de smartphones o comportamento com precisão as atividades de seus proprietários. Para o conjunto de dados, 30 pessoas foram usadas para realizar 6 atividades diferentes. Cada um deles usava um Samsung Galaxy SII na cintura. Usando os sensores incorporados do smartphone (o acelerômetro e o giroscópio), a velocidade e a aceleração do usuário foram medidas em direções 3-eixos. Usamos os dados do sensor para prever a atividade do usuário. Depois de preparar os conjuntos de dados e fazer alguns métodos de aprendizado de máquina, foi descoberto que o método de random forest teve o melhor desempenho em prever a atividade do usuário com uma precisão de 93%.

Detalhes do projeto

Site do projeto: http://archive.ics.uci.edu/ml/datasets/Human+Activity+Recognition+Using+Smartphones

Tipo: Classificação, Clustering

Métodos de aprendizado de máquina usados: Random forest, KNN, redes neurais (nnet, mlp, mlpWeightDecay)

Objetivo: Prever a atividade humana (andar 1, andar 2 no andar de cima, andar 3 no andar de baixo, 4 lugares, 5 lugares ou 6 lugares) usando os sensores do smartphone. Isso significa que, usando os métodos a seguir, o smartphone pode detectar o que estamos fazendo no momento.

Introdução

O reconhecimento da atividade humana , ou HAR, é o problema de prever o que uma pessoa está fazendo com base no traço de seu movimento usando sensores.

Os movimentos geralmente são atividades internas normais, como ficar em pé, sentado, pulando e subindo escadas.

Os sensores geralmente estão localizados sobre o assunto, como um smartphone ou colete, e geralmente registram dados do acelerômetro em três dimensões (x, y, z).

Dados

Os dados foram coletados de 30 indivíduos com idade entre 19 e 48 anos realizando uma das 6 atividades padrão enquanto usavam um smartphone montado na cintura que registrava os dados do movimento.

As seis atividades realizadas foram as seguintes:

Caminhada;
Andando no andar de cima;
Andando no térreo;
Sentado;
Em pé;
Deitado.

Os dados de movimento registrados foram os dados do acelerômetro x, y e z (aceleração linear) e dados giroscópicos (velocidade angular) do telefone inteligente.

Como o conjunto de dados de treinamento (7352 obs. De 562 variáveis) e o conjunto de dados de teste (2947 obs. De 562 variáveis) são grandes para um PC normal processar, selecionarei um subconjunto aleatório do conjunto de dados de treinamento e utilizarei meus métodos de aprendizado de máquina em isto. Dessa forma, posso ver qual método funciona melhor e é adequado para uma grande corrida final. Portanto, no início, criarei uma matriz de 20 números aleatórios de 1 a 7352. Esses números aleatórios serão usados para escolher amostras aleatórias do conjunto de dados desejado.

[1] 2947

[1] 562

[1] 7352

[1] 562

Weight Decay of Neural Network

O modelo testado é o “mlpWeightDecay”, que é uma variação do método “mlp”. Veremos sua convergencia e como se comporta na previsão dos resultados:

        
pre_mlpw    1    2    3    4    5    6
       1 1434  514  183    1    2    2
       2    0    0    0    0    0    0
       3  285 1029 1220    1    0    0
       4    0    0    0 1010  662  688
       5    0    0    0  726 1221   45
       6    0    0    0   35   17 1204

[1] 10279

[1] 0.5923728

A tabela acima mostra os resultados previstos. Os números diagonais mostram as previsões corretas e os números fora da diagonal mostram as previsões falsas.

Como pode ser visto nos resultados acima, as previsões realmente melhoraram muito e também não temos um número baixo de previsões corretas em nenhuma das atividades.

Modelo “pcaNNet”

Vamos tentar outro pacote de rede neural. Dessa vez, usei o “pcaNNet”. Esse modelo é conhecido como “Redes neurais com extração de recursos”:

# weights:  23
initial  value 39.091971 
iter  10 value 11.386314
iter  20 value 10.827462
iter  30 value 10.771149
iter  40 value 10.769438
final  value 10.769240 
converged
# weights:  57
initial  value 27.894671 
iter  10 value 8.333583
iter  20 value 7.269971
iter  30 value 4.255342
iter  40 value 3.767996
iter  50 value 3.538104
iter  60 value 3.328962
iter  70 value 1.449663
iter  80 value 1.333899
iter  90 value 1.333452
iter 100 value 1.333423
final  value 1.333423 
stopped after 100 iterations
# weights:  91
initial  value 26.453425 
iter  10 value 3.182288
iter  20 value 3.000516
iter  30 value 2.999948
iter  40 value 2.999931
iter  50 value 2.999911
iter  60 value 2.999734
iter  70 value 2.999483
iter  80 value 2.998291
iter  90 value 2.998195
iter 100 value 2.998088
final  value 2.998088 
stopped after 100 iterations
# weights:  23
initial  value 27.709528 
iter  10 value 15.531061
iter  20 value 13.879690
iter  30 value 12.656822
iter  40 value 12.610262
final  value 12.610039 
converged
# weights:  57
initial  value 37.241285 
iter  10 value 9.692409
iter  20 value 7.746826
iter  30 value 7.626560
iter  40 value 7.624976
final  value 7.624976 
converged
# weights:  91
initial  value 32.932164 
iter  10 value 8.436907
iter  20 value 6.150305
iter  30 value 5.986554
iter  40 value 5.986349
final  value 5.986349 
converged
# weights:  23
initial  value 31.602408 
iter  10 value 10.787512
iter  20 value 10.050598
iter  30 value 9.844752
iter  40 value 9.738943
iter  50 value 9.716947
iter  60 value 8.503405
iter  70 value 7.605136
iter  80 value 7.588298
iter  90 value 7.573651
iter 100 value 6.572168
final  value 6.572168 
stopped after 100 iterations
# weights:  57
initial  value 32.259514 
iter  10 value 7.334751
iter  20 value 3.107105
iter  30 value 3.063356
iter  40 value 3.060628
iter  50 value 3.055704
iter  60 value 3.053153
iter  70 value 3.046334
iter  80 value 3.034305
iter  90 value 2.810102
iter 100 value 1.416603
final  value 1.416603 
stopped after 100 iterations
# weights:  91
initial  value 30.595059 
iter  10 value 10.461607
iter  20 value 6.366482
iter  30 value 6.059624
iter  40 value 6.054689
iter  50 value 5.408682
iter  60 value 5.373672
iter  70 value 5.356932
iter  80 value 5.195428
iter  90 value 2.287630
iter 100 value 1.440964
final  value 1.440964 
stopped after 100 iterations
# weights:  25
initial  value 29.990839 
iter  10 value 16.913263
iter  20 value 13.806979
iter  30 value 13.330041
iter  40 value 12.303362
iter  50 value 11.376870
iter  60 value 10.738796
iter  70 value 10.266159
iter  80 value 10.224792
iter  90 value 10.152180
iter 100 value 9.832843
final  value 9.832843 
stopped after 100 iterations
# weights:  63
initial  value 25.987404 
iter  10 value 14.339446
iter  20 value 8.537874
iter  30 value 4.341177
iter  40 value 3.461052
iter  50 value 3.338170
iter  60 value 3.025275
iter  70 value 2.706432
iter  80 value 2.669684
iter  90 value 2.668113
iter 100 value 2.667658
final  value 2.667658 
stopped after 100 iterations
# weights:  101
initial  value 31.270301 
iter  10 value 9.143140
iter  20 value 7.027750
iter  30 value 5.975901
iter  40 value 3.064899
iter  50 value 2.999200
iter  60 value 2.989552
iter  70 value 1.706860
iter  80 value 1.481328
iter  90 value 1.334705
iter 100 value 1.334025
final  value 1.334025 
stopped after 100 iterations
# weights:  25
initial  value 31.314801 
iter  10 value 16.114241
iter  20 value 15.175783
iter  30 value 15.098109
final  value 15.097275 
converged
# weights:  63
initial  value 28.425465 
iter  10 value 11.344803
iter  20 value 10.350922
iter  30 value 10.281980
iter  40 value 10.025934
iter  50 value 9.982220
iter  60 value 9.493296
iter  70 value 9.443433
final  value 9.443386 
converged
# weights:  101
initial  value 33.436771 
iter  10 value 10.076507
iter  20 value 7.655391
iter  30 value 7.391974
iter  40 value 7.243661
iter  50 value 7.198748
iter  60 value 7.191272
iter  70 value 7.190698
iter  80 value 7.190085
final  value 7.190082 
converged
# weights:  25
initial  value 34.442861 
iter  10 value 16.580444
iter  20 value 12.337271
iter  30 value 12.224164
iter  40 value 12.154419
iter  50 value 12.129457
iter  60 value 12.101362
iter  70 value 11.487246
iter  80 value 11.359844
iter  90 value 11.217134
iter 100 value 11.158631
final  value 11.158631 
stopped after 100 iterations
# weights:  63
initial  value 37.180569 
iter  10 value 10.552306
iter  20 value 6.189711
iter  30 value 5.112384
iter  40 value 5.088588
iter  50 value 5.082766
iter  60 value 5.078755
iter  70 value 5.069804
iter  80 value 5.055923
iter  90 value 5.043600
iter 100 value 5.005495
final  value 5.005495 
stopped after 100 iterations
# weights:  101
initial  value 37.975705 
iter  10 value 12.998460
iter  20 value 3.961048
iter  30 value 3.108201
iter  40 value 3.014221
iter  50 value 1.499121
iter  60 value 0.630456
iter  70 value 0.157438
iter  80 value 0.151315
iter  90 value 0.119353
iter 100 value 0.109922
final  value 0.109922 
stopped after 100 iterations
# weights:  21
initial  value 27.053012 
iter  10 value 14.096623
iter  20 value 12.804967
iter  30 value 11.512302
iter  40 value 10.761223
iter  50 value 10.480944
iter  60 value 10.419701
iter  70 value 10.401156
final  value 10.400875 
converged
# weights:  51
initial  value 34.125618 
iter  10 value 10.716996
iter  20 value 9.378907
iter  30 value 7.254195
iter  40 value 7.113256
iter  50 value 7.016159
iter  60 value 7.001500
iter  70 value 7.000019
final  value 7.000016 
converged
# weights:  81
initial  value 30.717337 
iter  10 value 15.266612
iter  20 value 12.107931
iter  30 value 10.912396
iter  40 value 9.046858
iter  50 value 9.000739
iter  60 value 9.000007
final  value 8.999998 
converged
# weights:  21
initial  value 34.196538 
iter  10 value 15.248957
iter  20 value 14.929868
iter  30 value 14.646372
iter  40 value 14.247204
iter  50 value 14.242732
final  value 14.242732 
converged
# weights:  51
initial  value 25.371835 
iter  10 value 10.800824
iter  20 value 10.134921
iter  30 value 9.661575
iter  40 value 9.642055
iter  50 value 9.641959
final  value 9.641959 
converged
# weights:  81
initial  value 29.427506 
iter  10 value 8.792950
iter  20 value 7.933975
iter  30 value 7.413678
iter  40 value 7.200903
iter  50 value 7.165271
iter  60 value 7.165065
final  value 7.165065 
converged
# weights:  21
initial  value 33.087095 
iter  10 value 13.624320
iter  20 value 12.032632
iter  30 value 12.006124
iter  40 value 11.934707
iter  50 value 11.905039
iter  60 value 11.902786
iter  70 value 11.900937
iter  80 value 11.900394
iter  90 value 11.816706
iter 100 value 11.267324
final  value 11.267324 
stopped after 100 iterations
# weights:  51
initial  value 33.041526 
iter  10 value 12.399374
iter  20 value 11.030048
iter  30 value 7.632324
iter  40 value 6.776017
iter  50 value 3.498410
iter  60 value 3.407392
iter  70 value 1.213549
iter  80 value 1.156436
iter  90 value 1.149345
iter 100 value 1.140963
final  value 1.140963 
stopped after 100 iterations
# weights:  81
initial  value 30.028387 
iter  10 value 12.963553
iter  20 value 7.361382
iter  30 value 7.215668
iter  40 value 7.059712
iter  50 value 6.930649
iter  60 value 6.410619
iter  70 value 3.817334
iter  80 value 3.053076
iter  90 value 1.116820
iter 100 value 1.107266
final  value 1.107266 
stopped after 100 iterations
# weights:  25
initial  value 28.720871 
iter  10 value 14.516473
iter  20 value 13.581561
iter  30 value 12.772756
iter  40 value 12.748910
iter  50 value 12.747478
final  value 12.747475 
converged
# weights:  63
initial  value 32.856488 
iter  10 value 10.072877
iter  20 value 7.473344
iter  30 value 6.832387
iter  40 value 6.229388
iter  50 value 6.207693
iter  60 value 6.182753
iter  70 value 5.737077
iter  80 value 4.803309
iter  90 value 4.784744
iter 100 value 3.065557
final  value 3.065557 
stopped after 100 iterations
# weights:  101
initial  value 31.198364 
iter  10 value 19.727267
iter  20 value 17.418302
iter  30 value 13.601586
iter  40 value 11.847105
iter  50 value 8.515825
iter  60 value 8.424839
iter  70 value 5.678381
iter  80 value 5.090578
iter  90 value 3.904833
iter 100 value 3.760402
final  value 3.760402 
stopped after 100 iterations
# weights:  25
initial  value 29.995193 
iter  10 value 15.818505
iter  20 value 15.474471
iter  30 value 15.167384
iter  40 value 15.113919
final  value 15.113910 
converged
# weights:  63
initial  value 37.877376 
iter  10 value 15.892531
iter  20 value 11.041885
iter  30 value 10.874024
iter  40 value 10.852803
iter  50 value 10.811766
iter  60 value 10.808977
final  value 10.808968 
converged
# weights:  101
initial  value 39.851782 
iter  10 value 13.182252
iter  20 value 9.106900
iter  30 value 8.106916
iter  40 value 8.091879
final  value 8.091830 
converged
# weights:  25
initial  value 29.657886 
iter  10 value 14.799465
iter  20 value 13.040481
iter  30 value 13.017606
iter  40 value 13.008047
iter  50 value 12.706057
iter  60 value 12.623731
iter  70 value 12.621677
iter  80 value 12.621240
iter  90 value 12.621074
iter 100 value 12.228212
final  value 12.228212 
stopped after 100 iterations
# weights:  63
initial  value 34.882508 
iter  10 value 14.620587
iter  20 value 14.018775
iter  30 value 13.528939
iter  40 value 11.339335
iter  50 value 11.247789
iter  60 value 11.238992
iter  70 value 11.229924
iter  80 value 11.227836
iter  90 value 9.569035
iter 100 value 6.402780
final  value 6.402780 
stopped after 100 iterations
# weights:  101
initial  value 39.883160 
iter  10 value 15.965925
iter  20 value 12.878532
iter  30 value 6.634466
iter  40 value 3.306852
iter  50 value 2.302777
iter  60 value 2.227272
iter  70 value 2.216447
iter  80 value 2.196311
iter  90 value 2.163030
iter 100 value 1.687429
final  value 1.687429 
stopped after 100 iterations
# weights:  24
initial  value 33.597683 
iter  10 value 13.697902
iter  20 value 11.540808
iter  30 value 11.037917
iter  40 value 10.386702
iter  50 value 9.748818
iter  60 value 8.686156
iter  70 value 8.166630
iter  80 value 7.961025
iter  90 value 7.689900
iter 100 value 7.436847
final  value 7.436847 
stopped after 100 iterations
# weights:  60
initial  value 42.216191 
iter  10 value 16.499335
iter  20 value 6.214449
iter  30 value 5.037247
iter  40 value 5.003419
iter  50 value 4.894395
iter  60 value 2.848135
iter  70 value 2.039915
iter  80 value 2.006187
iter  90 value 2.003028
iter 100 value 2.000188
final  value 2.000188 
stopped after 100 iterations
# weights:  96
initial  value 28.128477 
iter  10 value 9.200722
iter  20 value 5.435370
iter  30 value 4.045772
iter  40 value 4.005062
iter  50 value 4.001145
iter  60 value 4.000449
iter  70 value 4.000119
iter  80 value 4.000057
iter  90 value 4.000043
final  value 4.000039 
converged
# weights:  24
initial  value 31.195591 
iter  10 value 15.130554
iter  20 value 14.484769
iter  30 value 14.373867
iter  40 value 14.132031
final  value 14.129223 
converged
# weights:  60
initial  value 32.777296 
iter  10 value 10.167946
iter  20 value 8.997194
iter  30 value 8.932385
iter  40 value 8.932173
final  value 8.932172 
converged
# weights:  96
initial  value 39.841873 
iter  10 value 8.563724
iter  20 value 6.337151
iter  30 value 6.247636
iter  40 value 6.243004
iter  50 value 6.242549
final  value 6.242546 
converged
# weights:  24
initial  value 35.731586 
iter  10 value 13.446943
iter  20 value 12.382252
iter  30 value 11.799408
iter  40 value 11.775304
iter  50 value 11.728090
iter  60 value 11.719567
iter  70 value 11.683726
iter  80 value 11.665421
iter  90 value 11.661473
iter 100 value 11.659596
final  value 11.659596 
stopped after 100 iterations
# weights:  60
initial  value 30.174897 
iter  10 value 7.820068
iter  20 value 6.736901
iter  30 value 6.723560
iter  40 value 5.496837
iter  50 value 4.427591
iter  60 value 4.418296
iter  70 value 4.405812
iter  80 value 2.993758
iter  90 value 1.443948
iter 100 value 1.438990
final  value 1.438990 
stopped after 100 iterations
# weights:  96
initial  value 28.971311 
iter  10 value 10.586438
iter  20 value 5.208578
iter  30 value 4.699458
iter  40 value 2.109405
iter  50 value 2.080357
iter  60 value 2.072370
iter  70 value 1.809949
iter  80 value 0.085780
iter  90 value 0.081019
iter 100 value 0.076630
final  value 0.076630 
stopped after 100 iterations
# weights:  23
initial  value 27.511896 
iter  10 value 13.689719
iter  20 value 11.935411
iter  30 value 11.900121
iter  40 value 11.898994
final  value 11.898990 
converged
# weights:  57
initial  value 32.293541 
iter  10 value 8.994031
iter  20 value 4.814474
iter  30 value 3.852936
iter  40 value 2.084422
iter  50 value 0.426051
iter  60 value 0.030811
iter  70 value 0.013902
iter  80 value 0.005945
iter  90 value 0.000601
iter 100 value 0.000181
final  value 0.000181 
stopped after 100 iterations
# weights:  91
initial  value 33.157968 
iter  10 value 8.441821
iter  20 value 5.061000
iter  30 value 4.025905
iter  40 value 4.002956
iter  50 value 3.999828
iter  60 value 3.987671
iter  70 value 1.049168
iter  80 value 0.996066
iter  90 value 0.995498
iter 100 value 0.994755
final  value 0.994755 
stopped after 100 iterations
# weights:  23
initial  value 36.618909 
iter  10 value 15.179679
iter  20 value 15.032675
iter  30 value 14.885369
final  value 14.885180 
converged
# weights:  57
initial  value 33.819259 
iter  10 value 11.107616
iter  20 value 10.173304
iter  30 value 9.926545
iter  40 value 9.912857
final  value 9.912844 
converged
# weights:  91
initial  value 38.146544 
iter  10 value 8.749169
iter  20 value 7.446071
iter  30 value 7.211068
iter  40 value 7.062598
iter  50 value 7.034397
final  value 7.034383 
converged
# weights:  23
initial  value 32.708717 
iter  10 value 13.882837
iter  20 value 13.109112
iter  30 value 12.013459
iter  40 value 11.664553
iter  50 value 11.650505
iter  60 value 11.642532
iter  70 value 11.641102
iter  80 value 11.186091
iter  90 value 11.117809
iter 100 value 10.986750
final  value 10.986750 
stopped after 100 iterations
# weights:  57
initial  value 34.982836 
iter  10 value 15.468980
iter  20 value 4.431194
iter  30 value 3.545515
iter  40 value 2.170416
iter  50 value 2.159591
iter  60 value 2.137449
iter  70 value 2.132648
iter  80 value 2.124409
iter  90 value 2.079459
iter 100 value 1.135357
final  value 1.135357 
stopped after 100 iterations
# weights:  91
initial  value 38.769518 
iter  10 value 9.218538
iter  20 value 3.245526
iter  30 value 1.714415
iter  40 value 1.128863
iter  50 value 1.118577
iter  60 value 1.105147
iter  70 value 1.101106
iter  80 value 1.090833
iter  90 value 1.084432
iter 100 value 0.474644
final  value 0.474644 
stopped after 100 iterations
# weights:  24
initial  value 32.410052 
iter  10 value 12.713271
iter  20 value 12.074779
iter  30 value 11.970020
iter  40 value 11.894249
iter  50 value 11.863298
iter  60 value 11.818974
iter  70 value 11.294212
iter  80 value 11.184097
iter  90 value 11.083530
iter 100 value 11.058268
final  value 11.058268 
stopped after 100 iterations
# weights:  60
initial  value 43.265118 
iter  10 value 13.925005
iter  20 value 13.450561
iter  30 value 13.348215
iter  40 value 13.114165
iter  50 value 12.488632
iter  60 value 11.853843
iter  70 value 11.846650
iter  80 value 11.846170
final  value 11.846156 
converged
# weights:  96
initial  value 40.921591 
iter  10 value 14.704192
iter  20 value 7.868770
iter  30 value 7.645413
iter  40 value 7.350679
iter  50 value 5.860964
iter  60 value 5.723346
iter  70 value 5.672151
iter  80 value 4.920530
iter  90 value 4.903019
iter 100 value 4.901893
final  value 4.901893 
stopped after 100 iterations
# weights:  24
initial  value 29.417342 
iter  10 value 14.845341
iter  20 value 14.158408
iter  30 value 14.131309
final  value 14.131305 
converged
# weights:  60
initial  value 33.107700 
iter  10 value 12.148779
iter  20 value 10.870773
iter  30 value 10.048443
iter  40 value 9.995576
iter  50 value 9.994704
iter  50 value 9.994704
iter  50 value 9.994704
final  value 9.994704 
converged
# weights:  96
initial  value 36.145559 
iter  10 value 12.117813
iter  20 value 9.177923
iter  30 value 8.089233
iter  40 value 7.555317
iter  50 value 7.470241
iter  60 value 7.290961
iter  70 value 7.180378
iter  80 value 7.149795
iter  90 value 7.149417
final  value 7.149413 
converged
# weights:  24
initial  value 30.259088 
iter  10 value 13.577121
iter  20 value 12.876544
iter  30 value 11.683568
iter  40 value 11.459243
iter  50 value 11.231461
iter  60 value 11.227776
iter  70 value 11.224796
iter  80 value 11.172102
iter  90 value 11.063357
iter 100 value 10.988309
final  value 10.988309 
stopped after 100 iterations
# weights:  60
initial  value 38.789511 
iter  10 value 14.280284
iter  20 value 8.364710
iter  30 value 3.195345
iter  40 value 3.100669
iter  50 value 2.694540
iter  60 value 1.819836
iter  70 value 1.789212
iter  80 value 1.711480
iter  90 value 1.514275
iter 100 value 1.354370
final  value 1.354370 
stopped after 100 iterations
# weights:  96
initial  value 29.149017 
iter  10 value 13.209484
iter  20 value 10.597221
iter  30 value 7.290970
iter  40 value 4.359111
iter  50 value 3.927936
iter  60 value 1.813828
iter  70 value 1.784296
iter  80 value 1.777559
iter  90 value 1.774152
iter 100 value 1.742711
final  value 1.742711 
stopped after 100 iterations
# weights:  23
initial  value 27.160998 
iter  10 value 9.746929
iter  20 value 9.328582
iter  30 value 9.203751
iter  40 value 9.122281
iter  50 value 9.100388
iter  60 value 9.092423
iter  70 value 9.070409
iter  80 value 9.048918
iter  90 value 9.047152
final  value 9.047007 
converged
# weights:  57
initial  value 34.899595 
iter  10 value 9.622490
iter  20 value 6.887452
iter  30 value 6.875381
final  value 6.875045 
converged
# weights:  91
initial  value 32.191155 
iter  10 value 9.993914
iter  20 value 3.590155
iter  30 value 3.013280
iter  40 value 3.000055
iter  50 value 2.999819
iter  60 value 2.999460
iter  70 value 2.999450
iter  80 value 2.999441
iter  90 value 2.999431
iter 100 value 2.999421
final  value 2.999421 
stopped after 100 iterations
# weights:  23
initial  value 25.153682 
iter  10 value 13.187487
iter  20 value 12.694154
iter  30 value 12.640943
final  value 12.640943 
converged
# weights:  57
initial  value 38.724783 
iter  10 value 11.937668
iter  20 value 10.577718
iter  30 value 8.380677
iter  40 value 7.797549
iter  50 value 7.792613
final  value 7.792608 
converged
# weights:  91
initial  value 39.499713 
iter  10 value 10.496733
iter  20 value 7.231111
iter  30 value 6.306403
iter  40 value 6.290218
iter  50 value 6.283584
iter  60 value 6.283466
final  value 6.283466 
converged
# weights:  23
initial  value 38.099705 
iter  10 value 10.003212
iter  20 value 9.836465
iter  30 value 9.390839
iter  40 value 9.360428
iter  50 value 9.329018
iter  60 value 9.297575
iter  70 value 9.238277
iter  80 value 9.222550
iter  90 value 9.220462
iter 100 value 9.213856
final  value 9.213856 
stopped after 100 iterations
# weights:  57
initial  value 28.398201 
iter  10 value 9.599472
iter  20 value 8.177535
iter  30 value 6.703482
iter  40 value 6.565675
iter  50 value 6.178533
iter  60 value 5.584484
iter  70 value 5.576479
iter  80 value 5.570465
iter  90 value 5.566236
iter 100 value 5.564931
final  value 5.564931 
stopped after 100 iterations
# weights:  91
initial  value 31.471140 
iter  10 value 8.645010
iter  20 value 6.057076
iter  30 value 1.586817
iter  40 value 1.575207
iter  50 value 1.570532
iter  60 value 0.618377
iter  70 value 0.100030
iter  80 value 0.087989
iter  90 value 0.085818
iter 100 value 0.077925
final  value 0.077925 
stopped after 100 iterations
# weights:  24
initial  value 33.473331 
iter  10 value 12.178216
iter  20 value 11.063753
iter  30 value 11.059113
iter  40 value 11.058622
iter  50 value 11.058112
iter  60 value 10.926949
iter  70 value 10.564467
iter  80 value 10.439470
iter  90 value 10.278247
iter 100 value 10.232463
final  value 10.232463 
stopped after 100 iterations
# weights:  60
initial  value 31.295668 
iter  10 value 8.269009
iter  20 value 0.353849
iter  30 value 0.006825
iter  40 value 0.000589
final  value 0.000097 
converged
# weights:  96
initial  value 27.847797 
iter  10 value 7.011661
iter  20 value 3.128055
iter  30 value 2.993675
iter  40 value 0.025453
iter  50 value 0.000592
iter  60 value 0.000157
final  value 0.000086 
converged
# weights:  24
initial  value 25.145564 
iter  10 value 13.046293
iter  20 value 12.579705
iter  30 value 12.473765
iter  40 value 12.455304
final  value 12.455211 
converged
# weights:  60
initial  value 24.093688 
iter  10 value 10.146998
iter  20 value 8.327469
iter  30 value 8.141504
iter  40 value 8.117285
iter  50 value 8.115736
iter  60 value 8.115668
iter  60 value 8.115668
iter  60 value 8.115668
final  value 8.115668 
converged
# weights:  96
initial  value 34.170234 
iter  10 value 7.256351
iter  20 value 5.647618
iter  30 value 5.550555
iter  40 value 5.308240
iter  50 value 5.301190
final  value 5.301190 
converged
# weights:  24
initial  value 33.380603 
iter  10 value 11.370204
iter  20 value 8.197309
iter  30 value 7.776976
iter  40 value 7.527687
iter  50 value 7.401647
iter  60 value 7.394345
iter  70 value 6.936704
iter  80 value 6.893327
iter  90 value 6.863015
iter 100 value 6.328443
final  value 6.328443 
stopped after 100 iterations
# weights:  60
initial  value 30.425529 
iter  10 value 6.796994
iter  20 value 4.204577
iter  30 value 4.079965
iter  40 value 4.067406
iter  50 value 3.900900
iter  60 value 3.248089
iter  70 value 2.783006
iter  80 value 2.456213
iter  90 value 0.201356
iter 100 value 0.142087
final  value 0.142087 
stopped after 100 iterations
# weights:  96
initial  value 30.541744 
iter  10 value 4.373255
iter  20 value 3.856683
iter  30 value 0.152810
iter  40 value 0.116412
iter  50 value 0.087580
iter  60 value 0.081779
iter  70 value 0.073220
iter  80 value 0.065727
iter  90 value 0.058765
iter 100 value 0.055196
final  value 0.055196 
stopped after 100 iterations
# weights:  23
initial  value 29.381338 
iter  10 value 11.065732
iter  20 value 10.052476
iter  30 value 9.353970
iter  40 value 9.259685
iter  50 value 8.968359
iter  60 value 8.906483
iter  70 value 8.682763
iter  80 value 8.558576
iter  90 value 8.528309
final  value 8.526470 
converged
# weights:  57
initial  value 31.341886 
iter  10 value 6.749765
iter  20 value 6.499930
iter  30 value 6.497610
iter  40 value 4.531057
iter  50 value 4.129146
iter  60 value 3.528752
iter  70 value 3.339673
iter  80 value 2.893799
iter  90 value 2.870945
iter 100 value 1.405347
final  value 1.405347 
stopped after 100 iterations
# weights:  91
initial  value 29.962653 
iter  10 value 10.150793
iter  20 value 8.526619
iter  30 value 6.331104
iter  40 value 5.418037
iter  50 value 5.066687
iter  60 value 4.570655
iter  70 value 4.502349
iter  80 value 4.500075
iter  90 value 4.500056
final  value 4.500054 
converged
# weights:  23
initial  value 30.381348 
iter  10 value 13.815719
iter  20 value 13.739063
final  value 13.738985 
converged
# weights:  57
initial  value 25.542026 
iter  10 value 10.852884
iter  20 value 8.789816
iter  30 value 8.735248
final  value 8.735112 
converged
# weights:  91
initial  value 37.653731 
iter  10 value 8.163455
iter  20 value 6.643830
iter  30 value 6.526143
iter  40 value 6.361042
iter  50 value 6.023804
iter  60 value 6.020126
final  value 6.020120 
converged
# weights:  23
initial  value 29.547316 
iter  10 value 12.218905
iter  20 value 11.444286
iter  30 value 10.643043
iter  40 value 10.623271
iter  50 value 10.622478
iter  60 value 10.621974
iter  70 value 10.621405
iter  80 value 10.620961
iter  90 value 9.569989
iter 100 value 9.348848
final  value 9.348848 
stopped after 100 iterations
# weights:  57
initial  value 36.364092 
iter  10 value 11.442219
iter  20 value 5.003740
iter  30 value 4.629640
iter  40 value 4.053240
iter  50 value 1.599329
iter  60 value 1.428373
iter  70 value 1.422884
iter  80 value 1.420900
iter  90 value 1.289793
iter 100 value 1.011590
final  value 1.011590 
stopped after 100 iterations
# weights:  91
initial  value 27.691382 
iter  10 value 8.622768
iter  20 value 5.957358
iter  30 value 4.380670
iter  40 value 3.201910
iter  50 value 3.058701
iter  60 value 0.132994
iter  70 value 0.113324
iter  80 value 0.105280
iter  90 value 0.100749
iter 100 value 0.093081
final  value 0.093081 
stopped after 100 iterations
# weights:  25
initial  value 23.306276 
iter  10 value 13.463525
iter  20 value 13.004429
iter  30 value 13.000012
final  value 13.000000 
converged
# weights:  63
initial  value 34.182956 
iter  10 value 15.003215
iter  20 value 12.207009
iter  30 value 9.953957
iter  40 value 7.048851
iter  50 value 4.647125
iter  60 value 4.339454
iter  70 value 4.333857
iter  80 value 4.333333
final  value 4.333332 
converged
# weights:  101
initial  value 36.919310 
iter  10 value 8.863288
iter  20 value 5.844747
iter  30 value 5.251006
iter  40 value 5.018004
iter  50 value 5.004811
iter  60 value 4.997429
iter  70 value 3.068068
iter  80 value 3.007205
iter  90 value 3.001995
iter 100 value 3.000423
final  value 3.000423 
stopped after 100 iterations
# weights:  25
initial  value 33.739661 
iter  10 value 16.045450
iter  20 value 15.483301
iter  30 value 15.461630
final  value 15.461629 
converged
# weights:  63
initial  value 26.332670 
iter  10 value 12.156898
iter  20 value 10.497507
iter  30 value 9.999344
iter  40 value 9.758622
iter  50 value 9.750684
iter  60 value 9.749831
iter  70 value 9.749725
final  value 9.749724 
converged
# weights:  101
initial  value 44.822127 
iter  10 value 9.520015
iter  20 value 8.168226
iter  30 value 7.867876
iter  40 value 7.545727
iter  50 value 7.444793
iter  60 value 7.440027
iter  70 value 7.439948
final  value 7.439946 
converged
# weights:  25
initial  value 26.603593 
iter  10 value 13.748824
iter  20 value 12.656691
iter  30 value 12.250637
iter  40 value 11.605568
iter  50 value 11.284763
iter  60 value 11.211925
iter  70 value 10.519009
iter  80 value 10.376691
iter  90 value 10.215239
iter 100 value 10.169741
final  value 10.169741 
stopped after 100 iterations
# weights:  63
initial  value 26.711922 
iter  10 value 12.888689
iter  20 value 11.623409
iter  30 value 8.871378
iter  40 value 7.857456
iter  50 value 7.008875
iter  60 value 5.041400
iter  70 value 4.578735
iter  80 value 4.487141
iter  90 value 4.480188
iter 100 value 4.472582
final  value 4.472582 
stopped after 100 iterations
# weights:  101
initial  value 25.564889 
iter  10 value 10.949527
iter  20 value 6.750780
iter  30 value 3.117194
iter  40 value 2.122783
iter  50 value 1.338918
iter  60 value 0.131124
iter  70 value 0.122857
iter  80 value 0.118667
iter  90 value 0.115040
iter 100 value 0.108445
final  value 0.108445 
stopped after 100 iterations
# weights:  25
initial  value 31.102701 
iter  10 value 12.727645
iter  20 value 11.127086
iter  30 value 10.217012
iter  40 value 9.556056
iter  50 value 9.327322
iter  60 value 9.299170
iter  70 value 9.294624
final  value 9.294102 
converged
# weights:  63
initial  value 35.487340 
iter  10 value 14.279272
iter  20 value 6.598102
iter  30 value 6.232532
iter  40 value 4.098793
iter  50 value 3.430913
iter  60 value 3.429240
iter  70 value 3.428809
iter  80 value 3.428793
iter  90 value 3.428747
iter 100 value 3.428591
final  value 3.428591 
stopped after 100 iterations
# weights:  101
initial  value 35.757876 
iter  10 value 13.588364
iter  20 value 6.257198
iter  30 value 5.015960
iter  40 value 5.004125
iter  50 value 5.002799
iter  60 value 5.001082
iter  70 value 5.000933
iter  80 value 5.000597
iter  90 value 5.000358
iter 100 value 5.000335
final  value 5.000335 
stopped after 100 iterations
# weights:  25
initial  value 29.948508 
iter  10 value 14.558269
iter  20 value 13.333918
iter  30 value 13.323447
final  value 13.323444 
converged
# weights:  63
initial  value 35.846229 
iter  10 value 13.924629
iter  20 value 10.189540
iter  30 value 9.713298
iter  40 value 8.959547
iter  50 value 8.875738
iter  60 value 8.875008
final  value 8.874980 
converged
# weights:  101
initial  value 34.143170 
iter  10 value 11.775736
iter  20 value 7.132916
iter  30 value 6.535132
iter  40 value 6.534721
final  value 6.534721 
converged
# weights:  25
initial  value 36.494246 
iter  10 value 14.372012
iter  20 value 11.650205
iter  30 value 11.087456
iter  40 value 10.082701
iter  50 value 9.706961
iter  60 value 9.243735
iter  70 value 9.162981
iter  80 value 9.078629
iter  90 value 9.071979
iter 100 value 9.071730
final  value 9.071730 
stopped after 100 iterations
# weights:  63
initial  value 36.473255 
iter  10 value 10.867718
iter  20 value 7.438738
iter  30 value 6.375342
iter  40 value 4.502267
iter  50 value 3.191528
iter  60 value 1.682502
iter  70 value 1.603155
iter  80 value 1.597844
iter  90 value 1.591593
iter 100 value 1.587480
final  value 1.587480 
stopped after 100 iterations
# weights:  101
initial  value 35.659218 
iter  10 value 10.093667
iter  20 value 9.215306
iter  30 value 7.709885
iter  40 value 7.057089
iter  50 value 5.279929
iter  60 value 3.557458
iter  70 value 3.518420
iter  80 value 3.492330
iter  90 value 0.449038
iter 100 value 0.114528
final  value 0.114528 
stopped after 100 iterations
# weights:  23
initial  value 34.975799 
iter  10 value 13.588916
iter  20 value 13.401543
iter  30 value 12.836571
iter  40 value 12.525747
iter  50 value 11.244646
iter  60 value 11.238330
iter  70 value 11.238170
iter  80 value 11.238097
final  value 11.238096 
converged
# weights:  57
initial  value 34.960682 
iter  10 value 12.949603
iter  20 value 10.544703
iter  30 value 7.683263
iter  40 value 4.975076
iter  50 value 4.200423
iter  60 value 3.527307
iter  70 value 3.401633
iter  80 value 3.401096
iter  90 value 3.400593
iter 100 value 3.400561
final  value 3.400561 
stopped after 100 iterations
# weights:  91
initial  value 41.313707 
iter  10 value 7.244958
iter  20 value 6.999993
iter  30 value 6.996375
iter  40 value 6.996105
iter  50 value 6.995792
iter  60 value 6.995422
iter  70 value 6.994981
iter  80 value 6.994445
iter  90 value 6.993780
iter 100 value 6.992933
final  value 6.992933 
stopped after 100 iterations
# weights:  23
initial  value 24.481518 
iter  10 value 14.009218
iter  20 value 12.550585
iter  30 value 12.385203
iter  40 value 12.383804
final  value 12.383803 
converged
# weights:  57
initial  value 34.926053 
iter  10 value 12.210896
iter  20 value 9.769451
iter  30 value 8.951068
iter  40 value 8.455102
iter  50 value 8.432657
iter  60 value 8.432507
final  value 8.432507 
converged
# weights:  91
initial  value 33.836375 
iter  10 value 8.945846
iter  20 value 6.922624
iter  30 value 6.489476
iter  40 value 6.454436
iter  50 value 6.444404
final  value 6.444396 
converged
# weights:  23
initial  value 29.612659 
iter  10 value 11.972939
iter  20 value 11.066667
iter  30 value 10.897405
iter  40 value 10.878024
iter  50 value 10.876825
iter  60 value 10.875728
iter  70 value 10.403426
iter  80 value 9.997991
iter  90 value 8.881520
iter 100 value 7.751577
final  value 7.751577 
stopped after 100 iterations
# weights:  57
initial  value 29.195423 
iter  10 value 13.619026
iter  20 value 11.910947
iter  30 value 11.865413
iter  40 value 11.861399
iter  50 value 11.849110
iter  60 value 11.058010
iter  70 value 11.010171
iter  80 value 10.971121
iter  90 value 10.582403
iter 100 value 6.435527
final  value 6.435527 
stopped after 100 iterations
# weights:  91
initial  value 36.774008 
iter  10 value 7.950534
iter  20 value 7.129870
iter  30 value 7.010651
iter  40 value 6.082452
iter  50 value 5.113159
iter  60 value 5.093249
iter  70 value 5.086257
iter  80 value 5.072002
iter  90 value 5.065874
iter 100 value 5.058239
final  value 5.058239 
stopped after 100 iterations
# weights:  23
initial  value 28.836775 
iter  10 value 13.435756
iter  20 value 13.021799
iter  30 value 12.504132
iter  40 value 12.429886
iter  50 value 12.270435
iter  60 value 11.944846
iter  70 value 11.314168
iter  80 value 11.313533
iter  90 value 11.306701
iter 100 value 11.254760
final  value 11.254760 
stopped after 100 iterations
# weights:  57
initial  value 41.128242 
iter  10 value 10.598507
iter  20 value 8.004049
iter  30 value 7.540387
iter  40 value 5.139543
iter  50 value 5.011353
iter  60 value 3.721716
iter  70 value 2.202643
iter  80 value 2.006081
iter  90 value 2.003626
iter 100 value 2.002552
final  value 2.002552 
stopped after 100 iterations
# weights:  91
initial  value 36.993737 
iter  10 value 8.063609
iter  20 value 4.052563
iter  30 value 4.007542
iter  40 value 4.001796
iter  50 value 4.000138
iter  60 value 4.000035
final  value 4.000008 
converged
# weights:  23
initial  value 27.767027 
iter  10 value 13.277631
iter  20 value 12.743400
iter  30 value 12.681237
final  value 12.680886 
converged
# weights:  57
initial  value 29.525993 
iter  10 value 9.915063
iter  20 value 9.170158
iter  30 value 8.636402
iter  40 value 8.597736
iter  50 value 8.507962
iter  60 value 8.485833
iter  70 value 8.480744
final  value 8.480536 
converged
# weights:  91
initial  value 27.527311 
iter  10 value 7.819455
iter  20 value 6.479325
iter  30 value 6.203284
iter  40 value 6.199993
final  value 6.199984 
converged
# weights:  23
initial  value 35.328580 
iter  10 value 13.186980
iter  20 value 11.980680
iter  30 value 11.229286
iter  40 value 11.062850
iter  50 value 11.059339
iter  60 value 11.057792
iter  70 value 11.054672
iter  80 value 10.805187
iter  90 value 9.001329
iter 100 value 8.636215
final  value 8.636215 
stopped after 100 iterations
# weights:  57
initial  value 41.322888 
iter  10 value 10.603797
iter  20 value 4.898068
iter  30 value 2.234361
iter  40 value 2.148523
iter  50 value 2.041982
iter  60 value 0.642473
iter  70 value 0.140892
iter  80 value 0.136447
iter  90 value 0.133450
iter 100 value 0.128819
final  value 0.128819 
stopped after 100 iterations
# weights:  91
initial  value 33.002869 
iter  10 value 4.459942
iter  20 value 4.070085
iter  30 value 4.049719
iter  40 value 4.041694
iter  50 value 4.037857
iter  60 value 3.699357
iter  70 value 1.679869
iter  80 value 0.067149
iter  90 value 0.063823
iter 100 value 0.060280
final  value 0.060280 
stopped after 100 iterations
# weights:  24
initial  value 32.145348 
iter  10 value 10.290801
iter  20 value 8.870303
iter  30 value 8.194915
iter  40 value 8.095289
iter  50 value 8.061148
iter  60 value 7.883138
iter  70 value 7.718969
iter  80 value 7.551349
iter  90 value 7.546762
iter 100 value 7.518860
final  value 7.518860 
stopped after 100 iterations
# weights:  60
initial  value 24.193518 
iter  10 value 8.225029
iter  20 value 7.153336
iter  30 value 7.071736
iter  40 value 5.642258
iter  50 value 5.502980
iter  60 value 5.492680
iter  70 value 5.328196
iter  80 value 5.084657
iter  90 value 4.358633
iter 100 value 4.086485
final  value 4.086485 
stopped after 100 iterations
# weights:  96
initial  value 28.603253 
iter  10 value 5.077230
iter  20 value 4.008152
iter  30 value 3.999723
iter  40 value 3.996376
iter  50 value 3.996035
iter  60 value 3.995631
iter  70 value 3.995147
iter  80 value 3.994554
iter  90 value 3.993811
iter 100 value 3.992852
final  value 3.992852 
stopped after 100 iterations
# weights:  24
initial  value 28.503937 
iter  10 value 13.488927
iter  20 value 12.673332
iter  30 value 12.665846
final  value 12.665845 
converged
# weights:  60
initial  value 33.885648 
iter  10 value 12.109726
iter  20 value 9.298689
iter  30 value 8.738453
iter  40 value 8.725332
iter  50 value 8.723857
final  value 8.723851 
converged
# weights:  96
initial  value 29.608504 
iter  10 value 8.588307
iter  20 value 7.759719
iter  30 value 6.966551
iter  40 value 6.591762
iter  50 value 6.587404
iter  60 value 6.587367
final  value 6.587366 
converged
# weights:  24
initial  value 31.176243 
iter  10 value 12.648430
iter  20 value 9.568719
iter  30 value 8.453069
iter  40 value 8.300641
iter  50 value 8.213097
iter  60 value 8.210732
iter  70 value 8.206836
iter  80 value 8.205111
iter  90 value 8.204666
iter 100 value 8.084023
final  value 8.084023 
stopped after 100 iterations
# weights:  60
initial  value 30.822453 
iter  10 value 9.226315
iter  20 value 4.916344
iter  30 value 4.844783
iter  40 value 3.872227
iter  50 value 2.910929
iter  60 value 2.753615
iter  70 value 2.610772
iter  80 value 2.601003
iter  90 value 2.589079
iter 100 value 2.585182
final  value 2.585182 
stopped after 100 iterations
# weights:  96
initial  value 27.226558 
iter  10 value 6.669638
iter  20 value 5.582753
iter  30 value 4.138460
iter  40 value 4.076920
iter  50 value 4.073377
iter  60 value 4.071896
iter  70 value 4.069756
iter  80 value 4.065879
iter  90 value 4.055284
iter 100 value 3.946938
final  value 3.946938 
stopped after 100 iterations
# weights:  26
initial  value 31.177990 
iter  10 value 13.574483
iter  20 value 12.091526
iter  30 value 12.041984
iter  40 value 12.014828
iter  50 value 10.929538
iter  60 value 10.748925
iter  70 value 10.186764
iter  80 value 9.879061
iter  90 value 9.712739
iter 100 value 9.379345
final  value 9.379345 
stopped after 100 iterations
# weights:  66
initial  value 34.684494 
iter  10 value 7.154305
iter  20 value 2.226199
iter  30 value 1.952581
iter  40 value 1.913888
iter  50 value 1.858382
iter  60 value 1.849003
iter  70 value 1.801875
iter  80 value 1.555167
iter  90 value 1.012712
iter 100 value 1.001568
final  value 1.001568 
stopped after 100 iterations
# weights:  106
initial  value 32.368009 
iter  10 value 15.744915
iter  20 value 10.558953
iter  30 value 9.033053
iter  40 value 6.410829
iter  50 value 6.020666
iter  60 value 6.010361
iter  70 value 5.771102
iter  80 value 1.846989
iter  90 value 1.838554
iter 100 value 1.835367
final  value 1.835367 
stopped after 100 iterations
# weights:  26
initial  value 33.650035 
iter  10 value 15.069747
iter  20 value 14.613529
iter  30 value 14.605510
iter  40 value 14.563892
final  value 14.563888 
converged
# weights:  66
initial  value 33.348017 
iter  10 value 11.478601
iter  20 value 9.447336
iter  30 value 9.123237
iter  40 value 8.960879
iter  50 value 8.921254
iter  60 value 8.919502
final  value 8.919485 
converged
# weights:  106
initial  value 25.681984 
iter  10 value 9.561148
iter  20 value 8.327854
iter  30 value 8.038411
iter  40 value 7.651407
iter  50 value 7.633935
final  value 7.633890 
converged
# weights:  26
initial  value 29.745660 
iter  10 value 13.571862
iter  20 value 12.225382
iter  30 value 11.859070
iter  40 value 11.215741
iter  50 value 11.129243
iter  60 value 10.911107
iter  70 value 10.869684
iter  80 value 10.767569
iter  90 value 10.742206
iter 100 value 10.727769
final  value 10.727769 
stopped after 100 iterations
# weights:  66
initial  value 35.862284 
iter  10 value 12.193221
iter  20 value 4.759258
iter  30 value 1.914975
iter  40 value 1.461080
iter  50 value 1.112205
iter  60 value 1.108089
iter  70 value 1.093893
iter  80 value 1.089134
iter  90 value 1.080546
iter 100 value 1.055755
final  value 1.055755 
stopped after 100 iterations
# weights:  106
initial  value 43.388264 
iter  10 value 15.719875
iter  20 value 8.068603
iter  30 value 6.769930
iter  40 value 6.496078
iter  50 value 6.466340
iter  60 value 4.242405
iter  70 value 1.494417
iter  80 value 1.138971
iter  90 value 1.126340
iter 100 value 1.115758
final  value 1.115758 
stopped after 100 iterations
# weights:  22
initial  value 27.612909 
iter  10 value 10.772012
iter  20 value 10.599417
iter  30 value 10.583754
iter  40 value 10.583339
final  value 10.583333 
converged
# weights:  54
initial  value 27.303633 
iter  10 value 9.553042
iter  20 value 7.465938
iter  30 value 2.756397
iter  40 value 1.870585
iter  50 value 1.185943
iter  60 value 1.062193
iter  70 value 1.023190
iter  80 value 1.005342
iter  90 value 1.000051
iter 100 value 1.000002
final  value 1.000002 
stopped after 100 iterations
# weights:  86
initial  value 29.827609 
iter  10 value 11.413517
iter  20 value 3.245038
iter  30 value 3.005903
iter  40 value 3.000160
iter  50 value 3.000042
iter  60 value 2.999937
final  value 2.999933 
converged
# weights:  22
initial  value 32.004383 
iter  10 value 14.411973
iter  20 value 13.570949
iter  30 value 13.552176
final  value 13.552169 
converged
# weights:  54
initial  value 36.810442 
iter  10 value 12.801364
iter  20 value 9.088634
iter  30 value 8.837902
iter  40 value 8.703458
iter  50 value 8.160020
iter  60 value 7.832124
iter  70 value 7.830337
final  value 7.830334 
converged
# weights:  86
initial  value 34.798966 
iter  10 value 11.036054
iter  20 value 7.481541
iter  30 value 6.663193
iter  40 value 6.517193
iter  50 value 6.464682
iter  60 value 6.096745
iter  70 value 6.090239
iter  80 value 6.089715
final  value 6.089670 
converged
# weights:  22
initial  value 36.018257 
iter  10 value 13.191358
iter  20 value 10.115020
iter  30 value 9.479882
iter  40 value 9.370112
iter  50 value 9.134367
iter  60 value 8.634952
iter  70 value 8.614227
iter  80 value 8.612551
iter  90 value 8.610286
final  value 8.610284 
converged
# weights:  54
initial  value 39.017651 
iter  10 value 11.460520
iter  20 value 10.057738
iter  30 value 9.804186
iter  40 value 9.799754
iter  50 value 9.748288
iter  60 value 9.721455
iter  70 value 9.714433
iter  80 value 9.711802
iter  90 value 7.976469
iter 100 value 4.238256
final  value 4.238256 
stopped after 100 iterations
# weights:  86
initial  value 34.142190 
iter  10 value 7.112750
iter  20 value 6.862806
iter  30 value 6.751944
iter  40 value 6.734333
iter  50 value 6.724568
iter  60 value 6.714309
iter  70 value 6.712628
iter  80 value 6.710157
iter  90 value 6.705096
iter 100 value 6.682995
final  value 6.682995 
stopped after 100 iterations
# weights:  23
initial  value 30.292766 
iter  10 value 14.334049
iter  20 value 13.042217
iter  30 value 12.836558
iter  40 value 12.833399
iter  50 value 12.833334
iter  50 value 12.833333
iter  50 value 12.833333
final  value 12.833333 
converged
# weights:  57
initial  value 34.477362 
iter  10 value 12.271633
iter  20 value 9.873816
iter  30 value 7.865867
iter  40 value 7.831247
iter  50 value 7.830078
iter  60 value 7.740006
iter  70 value 7.313450
iter  80 value 7.159027
iter  90 value 5.491335
iter 100 value 5.449121
final  value 5.449121 
stopped after 100 iterations
# weights:  91
initial  value 34.216142 
iter  10 value 13.830707
iter  20 value 12.583195
iter  30 value 12.101840
iter  40 value 12.100126
iter  50 value 12.096557
iter  60 value 12.092169
iter  70 value 11.603282
iter  80 value 11.600340
iter  90 value 11.600012
iter 100 value 11.600001
final  value 11.600001 
stopped after 100 iterations
# weights:  23
initial  value 26.749226 
iter  10 value 15.878155
iter  20 value 15.850082
iter  30 value 15.673898
iter  40 value 15.607323
final  value 15.605784 
converged
# weights:  57
initial  value 28.569319 
iter  10 value 12.541957
iter  20 value 11.518917
iter  30 value 10.909457
iter  40 value 10.727812
iter  50 value 10.584563
iter  60 value 10.574509
iter  70 value 10.573908
final  value 10.573905 
converged
# weights:  91
initial  value 32.331521 
iter  10 value 11.086187
iter  20 value 7.768610
iter  30 value 7.660269
iter  40 value 7.659046
final  value 7.659033 
converged
# weights:  23
initial  value 32.485130 
iter  10 value 15.698029
iter  20 value 13.195544
iter  30 value 11.592450
iter  40 value 10.881719
iter  50 value 10.291008
iter  60 value 10.204782
iter  70 value 9.933281
iter  80 value 9.907983
iter  90 value 9.898594
iter 100 value 9.892876
final  value 9.892876 
stopped after 100 iterations
# weights:  57
initial  value 36.798996 
iter  10 value 15.537604
iter  20 value 13.098091
iter  30 value 12.866500
iter  40 value 12.854796
iter  50 value 12.845568
iter  60 value 12.844114
iter  70 value 12.843384
iter  80 value 12.330716
iter  90 value 5.964472
iter 100 value 5.504881
final  value 5.504881 
stopped after 100 iterations
# weights:  91
initial  value 34.569069 
iter  10 value 12.708420
iter  20 value 7.706862
iter  30 value 5.217491
iter  40 value 4.415250
iter  50 value 2.028766
iter  60 value 1.282201
iter  70 value 1.134237
iter  80 value 0.957580
iter  90 value 0.931164
iter 100 value 0.515387
final  value 0.515387 
stopped after 100 iterations
# weights:  23
initial  value 32.656418 
iter  10 value 14.598145
iter  20 value 13.264231
iter  30 value 12.857645
iter  40 value 12.677905
iter  50 value 12.569821
iter  60 value 12.463263
iter  70 value 12.342335
iter  80 value 12.173312
iter  90 value 11.966356
iter 100 value 11.755269
final  value 11.755269 
stopped after 100 iterations
# weights:  57
initial  value 28.698224 
iter  10 value 10.877441
iter  20 value 6.182509
iter  30 value 5.648248
iter  40 value 5.596132
iter  50 value 5.153668
iter  60 value 4.606869
iter  70 value 2.731537
iter  80 value 2.463357
iter  90 value 2.283322
iter 100 value 1.638184
final  value 1.638184 
stopped after 100 iterations
# weights:  91
initial  value 25.827401 
iter  10 value 12.962076
iter  20 value 8.829972
iter  30 value 8.297459
iter  40 value 7.350735
iter  50 value 4.320690
iter  60 value 2.843181
iter  70 value 1.761133
iter  80 value 0.819201
iter  90 value 0.766633
iter 100 value 0.677306
final  value 0.677306 
stopped after 100 iterations
# weights:  23
initial  value 37.019454 
iter  10 value 15.909553
iter  20 value 14.318216
iter  30 value 13.967624
iter  40 value 13.935160
iter  50 value 13.934303
final  value 13.934298 
converged
# weights:  57
initial  value 32.659457 
iter  10 value 13.553256
iter  20 value 10.671663
iter  30 value 10.240198
iter  40 value 10.213477
iter  50 value 9.893126
iter  60 value 9.390051
iter  70 value 9.381530
iter  80 value 9.381377
final  value 9.381375 
converged
# weights:  91
initial  value 36.121095 
iter  10 value 10.199951
iter  20 value 7.563151
iter  30 value 7.356004
iter  40 value 7.147253
iter  50 value 6.997369
iter  60 value 6.994589
final  value 6.994584 
converged
# weights:  23
initial  value 32.124178 
iter  10 value 13.615322
iter  20 value 11.999330
iter  30 value 10.881216
iter  40 value 10.288991
iter  50 value 9.977832
iter  60 value 9.872416
iter  70 value 9.822414
iter  80 value 9.781009
iter  90 value 9.228534
iter 100 value 9.181631
final  value 9.181631 
stopped after 100 iterations
# weights:  57
initial  value 34.604843 
iter  10 value 9.536478
iter  20 value 7.900419
iter  30 value 7.767755
iter  40 value 4.904227
iter  50 value 3.626779
iter  60 value 3.591660
iter  70 value 3.589196
iter  80 value 3.055493
iter  90 value 1.674657
iter 100 value 1.166811
final  value 1.166811 
stopped after 100 iterations
# weights:  91
initial  value 28.163796 
iter  10 value 4.960979
iter  20 value 4.272424
iter  30 value 4.260965
iter  40 value 2.245703
iter  50 value 1.778924
iter  60 value 1.577242
iter  70 value 1.460081
iter  80 value 1.428969
iter  90 value 1.422030
iter 100 value 1.407466
final  value 1.407466 
stopped after 100 iterations
# weights:  25
initial  value 37.240997 
iter  10 value 14.895198
iter  20 value 14.637053
iter  30 value 14.423191
iter  40 value 13.169843
iter  50 value 12.589192
iter  60 value 11.817244
iter  70 value 11.674530
iter  80 value 11.321834
iter  90 value 11.233268
iter 100 value 11.232596
final  value 11.232596 
stopped after 100 iterations
# weights:  63
initial  value 33.885687 
iter  10 value 12.256539
iter  20 value 4.069247
iter  30 value 3.552642
iter  40 value 1.733546
iter  50 value 0.048962
iter  60 value 0.010228
iter  70 value 0.005219
iter  80 value 0.002226
iter  90 value 0.001990
iter 100 value 0.000985
final  value 0.000985 
stopped after 100 iterations
# weights:  101
initial  value 36.999746 
iter  10 value 8.884428
iter  20 value 6.152627
iter  30 value 5.022847
iter  40 value 5.003615
iter  50 value 5.001869
iter  60 value 5.000019
final  value 5.000019 
converged
# weights:  25
initial  value 33.103231 
iter  10 value 15.250346
iter  20 value 14.542627
iter  30 value 14.536092
final  value 14.535773 
converged
# weights:  63
initial  value 26.766150 
iter  10 value 12.657060
iter  20 value 10.453303
iter  30 value 10.390981
iter  40 value 10.390184
final  value 10.390184 
converged
# weights:  101
initial  value 32.050610 
iter  10 value 9.301803
iter  20 value 6.784464
iter  30 value 6.457859
iter  40 value 6.387262
iter  50 value 6.228027
final  value 6.227750 
converged
# weights:  25
initial  value 31.748985 
iter  10 value 13.693871
iter  20 value 12.326584
iter  30 value 12.291754
iter  40 value 12.289414
iter  50 value 12.194951
iter  60 value 11.579351
iter  70 value 11.427149
iter  80 value 11.419618
iter  90 value 11.406702
iter 100 value 10.616382
final  value 10.616382 
stopped after 100 iterations
# weights:  63
initial  value 26.805292 
iter  10 value 15.853531
iter  20 value 13.166821
iter  30 value 10.301563
iter  40 value 4.375765
iter  50 value 3.159268
iter  60 value 2.582353
iter  70 value 2.490962
iter  80 value 2.485450
iter  90 value 2.479778
iter 100 value 2.448775
final  value 2.448775 
stopped after 100 iterations
# weights:  101
initial  value 40.171033 
iter  10 value 16.798082
iter  20 value 11.872168
iter  30 value 6.928802
iter  40 value 4.320066
iter  50 value 1.316583
iter  60 value 0.151658
iter  70 value 0.142475
iter  80 value 0.134501
iter  90 value 0.110735
iter 100 value 0.100849
final  value 0.100849 
stopped after 100 iterations
# weights:  23
initial  value 30.286382 
iter  10 value 15.021351
iter  20 value 14.997654
iter  30 value 14.981653
iter  40 value 14.429352
final  value 14.428594 
converged
# weights:  57
initial  value 30.214294 
iter  10 value 7.729712
iter  20 value 7.236417
iter  30 value 6.529099
iter  40 value 6.328350
iter  50 value 6.282992
iter  60 value 5.681926
iter  70 value 5.336831
iter  80 value 5.333316
iter  90 value 5.325310
iter 100 value 4.857700
final  value 4.857700 
stopped after 100 iterations
# weights:  91
initial  value 38.032580 
iter  10 value 19.887614
iter  20 value 18.483024
iter  30 value 11.513910
iter  40 value 9.443062
iter  50 value 8.081675
iter  60 value 6.162867
iter  70 value 4.075239
iter  80 value 0.028924
iter  90 value 0.011660
iter 100 value 0.006295
final  value 0.006295 
stopped after 100 iterations
# weights:  23
initial  value 34.893740 
iter  10 value 15.485676
iter  20 value 14.260660
iter  30 value 14.223532
iter  40 value 14.220905
final  value 14.220904 
converged
# weights:  57
initial  value 37.502161 
iter  10 value 14.499948
iter  20 value 12.424204
iter  30 value 10.694577
iter  40 value 10.665621
iter  50 value 10.646253
iter  60 value 10.406299
iter  70 value 10.370130
iter  80 value 10.368644
final  value 10.368640 
converged
# weights:  91
initial  value 30.513606 
iter  10 value 10.587183
iter  20 value 8.348964
iter  30 value 8.083005
iter  40 value 7.608855
iter  50 value 7.565296
iter  60 value 7.540199
iter  70 value 7.397511
final  value 7.397295 
converged
# weights:  23
initial  value 39.763128 
iter  10 value 14.959265
iter  20 value 13.743794
iter  30 value 13.724830
iter  40 value 13.218395
iter  50 value 12.686125
iter  60 value 12.609645
iter  70 value 12.598431
iter  80 value 12.594610
iter  90 value 12.593120
iter 100 value 12.592985
final  value 12.592985 
stopped after 100 iterations
# weights:  57
initial  value 33.185044 
iter  10 value 14.529698
iter  20 value 14.048242
iter  30 value 13.904485
iter  40 value 12.548418
iter  50 value 11.709058
iter  60 value 8.636257
iter  70 value 7.347288
iter  80 value 4.867423
iter  90 value 2.450146
iter 100 value 2.174888
final  value 2.174888 
stopped after 100 iterations
# weights:  91
initial  value 38.524908 
iter  10 value 11.170540
iter  20 value 6.451970
iter  30 value 5.153048
iter  40 value 4.144593
iter  50 value 4.073869
iter  60 value 2.756171
iter  70 value 2.110478
iter  80 value 2.072953
iter  90 value 1.862810
iter 100 value 0.130060
final  value 0.130060 
stopped after 100 iterations
# weights:  25
initial  value 28.400679 
iter  10 value 12.631795
iter  20 value 11.866044
iter  30 value 11.697255
iter  40 value 11.486841
iter  50 value 11.437869
iter  60 value 11.434331
iter  70 value 11.407162
iter  80 value 11.400499
final  value 11.395697 
converged
# weights:  63
initial  value 29.230406 
iter  10 value 12.776183
iter  20 value 11.508311
iter  30 value 10.096363
iter  40 value 9.945807
iter  50 value 8.957562
iter  60 value 6.940750
iter  70 value 6.867933
iter  80 value 6.831519
iter  90 value 5.945462
iter 100 value 5.764834
final  value 5.764834 
stopped after 100 iterations
# weights:  101
initial  value 33.233924 
iter  10 value 11.928336
iter  20 value 8.472049
iter  30 value 7.060255
iter  40 value 6.992370
iter  50 value 6.981279
iter  60 value 6.894064
iter  70 value 4.564859
iter  80 value 4.501133
iter  90 value 4.493064
iter 100 value 2.165549
final  value 2.165549 
stopped after 100 iterations
# weights:  25
initial  value 35.659791 
iter  10 value 15.672566
iter  20 value 15.534475
iter  30 value 15.495584
iter  30 value 15.495584
iter  30 value 15.495584
final  value 15.495584 
converged
# weights:  63
initial  value 40.116645 
iter  10 value 14.228378
iter  20 value 13.473104
iter  30 value 11.741996
iter  40 value 11.091690
iter  50 value 10.835136
iter  60 value 10.602681
iter  70 value 10.227045
iter  80 value 10.225044
final  value 10.225044 
converged
# weights:  101
initial  value 35.291160 
iter  10 value 10.436838
iter  20 value 8.369173
iter  30 value 8.177830
iter  40 value 8.076560
iter  50 value 7.682312
iter  60 value 7.188496
iter  70 value 7.167633
final  value 7.167628 
converged
# weights:  25
initial  value 23.087427 
iter  10 value 13.467377
iter  20 value 12.717388
iter  30 value 12.669890
iter  40 value 12.468328
iter  50 value 12.349408
iter  60 value 12.342819
iter  70 value 12.060500
iter  80 value 11.998453
iter  90 value 11.808929
iter 100 value 11.800346
final  value 11.800346 
stopped after 100 iterations
# weights:  63
initial  value 43.384242 
iter  10 value 14.275737
iter  20 value 9.066203
iter  30 value 6.309888
iter  40 value 6.015447
iter  50 value 4.823855
iter  60 value 4.414969
iter  70 value 4.385976
iter  80 value 4.383398
iter  90 value 4.377762
iter 100 value 4.374801
final  value 4.374801 
stopped after 100 iterations
# weights:  101
initial  value 35.585394 
iter  10 value 11.933656
iter  20 value 10.444272
iter  30 value 7.104795
iter  40 value 7.059997
iter  50 value 7.038795
iter  60 value 5.465909
iter  70 value 4.053616
iter  80 value 1.136157
iter  90 value 1.109333
iter 100 value 1.100426
final  value 1.100426 
stopped after 100 iterations
# weights:  24
initial  value 29.389565 
iter  10 value 13.107577
iter  20 value 11.172383
iter  30 value 10.722950
iter  40 value 10.631442
iter  50 value 10.330977
iter  60 value 8.468441
iter  70 value 8.455466
iter  80 value 8.216268
iter  90 value 8.193692
iter 100 value 8.159122
final  value 8.159122 
stopped after 100 iterations
# weights:  60
initial  value 31.615133 
iter  10 value 13.020773
iter  20 value 9.162843
iter  30 value 5.985882
iter  40 value 5.262263
iter  50 value 5.251458
iter  60 value 5.250341
iter  70 value 5.199401
iter  80 value 4.753827
iter  90 value 4.750128
iter 100 value 4.749736
final  value 4.749736 
stopped after 100 iterations
# weights:  96
initial  value 37.363013 
iter  10 value 10.579835
iter  20 value 9.035286
iter  30 value 6.705790
iter  40 value 5.439028
iter  50 value 5.428817
iter  60 value 5.362832
iter  70 value 4.938315
iter  80 value 4.679418
iter  90 value 3.857230
iter 100 value 3.437191
final  value 3.437191 
stopped after 100 iterations
# weights:  24
initial  value 41.774131 
iter  10 value 15.079639
iter  20 value 13.673535
iter  30 value 13.358153
iter  40 value 13.352003
final  value 13.351897 
converged
# weights:  60
initial  value 28.539970 
iter  10 value 11.165129
iter  20 value 9.796116
iter  30 value 9.612114
iter  40 value 8.868647
iter  50 value 8.645453
iter  60 value 8.640313
final  value 8.640311 
converged
# weights:  96
initial  value 39.905079 
iter  10 value 8.883189
iter  20 value 7.865056
iter  30 value 7.778490
iter  40 value 7.609735
iter  50 value 7.472635
iter  60 value 7.291247
iter  70 value 7.290890
iter  80 value 7.290865
iter  90 value 7.286156
iter 100 value 7.142542
final  value 7.142542 
stopped after 100 iterations
# weights:  24
initial  value 33.439009 
iter  10 value 14.072389
iter  20 value 12.317404
iter  30 value 12.203959
iter  40 value 12.089905
iter  50 value 12.081988
iter  60 value 11.914159
iter  70 value 11.894067
iter  80 value 11.889344
iter  90 value 11.888380
iter 100 value 11.852691
final  value 11.852691 
stopped after 100 iterations
# weights:  60
initial  value 28.682002 
iter  10 value 10.079298
iter  20 value 8.440734
iter  30 value 6.863754
iter  40 value 5.869600
iter  50 value 5.523348
iter  60 value 5.410523
iter  70 value 5.297051
iter  80 value 5.201823
iter  90 value 4.258173
iter 100 value 4.148637
final  value 4.148637 
stopped after 100 iterations
# weights:  96
initial  value 35.148735 
iter  10 value 8.426928
iter  20 value 3.733439
iter  30 value 2.748805
iter  40 value 2.741807
iter  50 value 2.736321
iter  60 value 2.578481
iter  70 value 2.405345
iter  80 value 2.399351
iter  90 value 2.395600
iter 100 value 2.091192
final  value 2.091192 
stopped after 100 iterations
# weights:  24
initial  value 40.325036 
iter  10 value 13.447445
iter  20 value 13.009887
iter  30 value 10.852625
iter  40 value 10.121650
iter  50 value 9.560238
iter  60 value 9.498181
iter  70 value 7.373827
iter  80 value 7.300476
iter  90 value 7.058474
iter 100 value 6.940136
final  value 6.940136 
stopped after 100 iterations
# weights:  60
initial  value 25.755613 
iter  10 value 4.583264
iter  20 value 1.376789
iter  30 value 1.333463
iter  40 value 1.333335
final  value 1.333333 
converged
# weights:  96
initial  value 34.194398 
iter  10 value 4.286698
iter  20 value 3.003925
iter  30 value 3.000210
iter  40 value 3.000004
final  value 3.000002 
converged
# weights:  24
initial  value 30.476034 
iter  10 value 12.302096
iter  20 value 11.497594
iter  30 value 11.478931
final  value 11.478031 
converged
# weights:  60
initial  value 34.272096 
iter  10 value 14.340005
iter  20 value 9.260769
iter  30 value 8.252517
iter  40 value 7.942611
iter  50 value 7.557858
iter  60 value 7.550567
final  value 7.550514 
converged
# weights:  96
initial  value 32.733558 
iter  10 value 8.523177
iter  20 value 6.630217
iter  30 value 6.287003
iter  40 value 6.033687
iter  50 value 5.975551
iter  60 value 5.930682
iter  70 value 5.824757
iter  80 value 5.824551
final  value 5.824551 
converged
# weights:  24
initial  value 31.015196 
iter  10 value 12.657948
iter  20 value 9.807443
iter  30 value 7.695427
iter  40 value 7.421487
iter  50 value 7.150593
iter  60 value 6.985124
iter  70 value 6.979796
iter  80 value 6.950749
iter  90 value 6.943281
iter 100 value 6.895413
final  value 6.895413 
stopped after 100 iterations
# weights:  60
initial  value 29.696522 
iter  10 value 9.605394
iter  20 value 6.976785
iter  30 value 5.739659
iter  40 value 4.201641
iter  50 value 4.060149
iter  60 value 3.474842
iter  70 value 1.465200
iter  80 value 1.232025
iter  90 value 1.203156
iter 100 value 1.176442
final  value 1.176442 
stopped after 100 iterations
# weights:  96
initial  value 33.893709 
iter  10 value 9.039149
iter  20 value 7.484578
iter  30 value 6.065113
iter  40 value 6.053952
iter  50 value 6.040210
iter  60 value 6.035398
iter  70 value 6.026943
iter  80 value 5.992082
iter  90 value 3.526079
iter 100 value 3.055401
final  value 3.055401 
stopped after 100 iterations
# weights:  23
initial  value 32.972862 
iter  10 value 12.758690
iter  20 value 11.022437
iter  30 value 9.738037
iter  40 value 9.611395
iter  50 value 9.230639
iter  60 value 8.880356
iter  70 value 8.865353
iter  80 value 8.858582
iter  90 value 8.793521
iter 100 value 8.695003
final  value 8.695003 
stopped after 100 iterations
# weights:  57
initial  value 34.994108 
iter  10 value 10.141096
iter  20 value 9.970386
iter  30 value 9.635576
iter  40 value 7.115706
iter  50 value 6.513896
iter  60 value 6.447024
iter  70 value 6.444763
iter  80 value 6.436280
iter  90 value 6.017576
iter 100 value 5.287700
final  value 5.287700 
stopped after 100 iterations
# weights:  91
initial  value 30.473508 
iter  10 value 9.404181
iter  20 value 8.026070
iter  30 value 7.367957
iter  40 value 5.201483
iter  50 value 2.071304
iter  60 value 2.010542
iter  70 value 2.001993
iter  80 value 2.000358
iter  90 value 2.000106
final  value 2.000099 
converged
# weights:  23
initial  value 37.458817 
iter  10 value 13.824817
iter  20 value 13.209448
iter  30 value 13.088232
final  value 13.088228 
converged
# weights:  57
initial  value 25.615137 
iter  10 value 11.003363
iter  20 value 9.640654
iter  30 value 9.432032
iter  40 value 9.430308
iter  40 value 9.430308
iter  40 value 9.430308
final  value 9.430308 
converged
# weights:  91
initial  value 43.385108 
iter  10 value 9.831345
iter  20 value 7.438282
iter  30 value 7.080917
iter  40 value 6.984200
final  value 6.984108 
converged
# weights:  23
initial  value 29.404036 
iter  10 value 10.631360
iter  20 value 10.470062
iter  30 value 10.426838
iter  40 value 10.422624
iter  50 value 10.421968
iter  60 value 10.406640
iter  70 value 9.536268
iter  80 value 9.338979
iter  90 value 9.285447
iter 100 value 9.263796
final  value 9.263796 
stopped after 100 iterations
# weights:  57
initial  value 30.721556 
iter  10 value 6.234162
iter  20 value 3.981326
iter  30 value 3.109141
iter  40 value 2.653468
iter  50 value 2.571927
iter  60 value 2.059115
iter  70 value 2.016645
iter  80 value 1.869870
iter  90 value 1.423296
iter 100 value 1.227863
final  value 1.227863 
stopped after 100 iterations
# weights:  91
initial  value 36.752758 
iter  10 value 15.374863
iter  20 value 6.734642
iter  30 value 4.135615
iter  40 value 4.090573
iter  50 value 4.079285
iter  60 value 4.076210
iter  70 value 4.073226
iter  80 value 3.941761
iter  90 value 2.482689
iter 100 value 2.107051
final  value 2.107051 
stopped after 100 iterations
# weights:  126
initial  value 38.585153 
iter  10 value 10.019839
iter  20 value 7.980942
iter  30 value 7.861781
iter  40 value 7.754357
iter  50 value 7.523928
iter  60 value 7.519638
iter  70 value 7.519521
final  value 7.519520 
converged

       
pre_pca    1    2    3    4    5    6
      1 1225  518   96    2    0    1
      2    0    0    0    0    0    0
      3  486  972 1306    0    0    0
      4    0    0    0 1071  790  742
      5    8   23    0  620 1105   33
      6    0   30    1   80    7 1163

[1] 10279

[1] 0.5710672

Random Forest

Este modelo não é tão bom quanto o anterior. Continuamos testando diferentes modelos famosos para alcançar um resultado aceitável.

Em seguida, usei o método Random Forest:

       
pre_rf5    1    2    3    4    5    6
      1 1365 1224  276    1    0    0
      2    0    1    0    0    0    0
      3  354  316 1127    0    0    0
      4    0    0    0 1079  854  892
      5    0    0    0  596 1045   59
      6    0    2    0   97    3  988

[1] 10279

[1] 0.5452865

Knn (K-nearest neighbor) model.

Como pode ser visto nos resultados acima, a precisão deste modelo é maior que todos os outros modelos. Vamos tentar o método Knn (vizinho mais próximo K) e concluir nosso procedimento de teste.

       
pre_rfF   1   2   3   4   5   6
      1 481  34  18   0   0   0
      2   7 431  46   0   0   0
      3   8   6 356   0   0   0
      4   0   0   0 436  46   0
      5   0   0   0  55 486   0
      6   0   0   0   0   0 537

[1] 0.9253478

PROJETOS EM DATA SCIENCE

Projeto_1: Atividade Humana