Lab 07: Tree Methods
Anna Peterson
2023-03-26
The file Sonar.csv contains values of 208 sonar signals. The data have 60 features, each representing “the energy within a particular frequency band, integrated over a certain period of time”, and an outcome variable Class, which is coded M or R. The goal of the experiment is to discriminate between the sonar signals bounced of a rock R or a metal object (a mine M). The exercise for this lab is to use one of the ensemble methods (random forest or boosted regression trees) to produce a new model of these data. You should use mlr3 package, and you need to do the following:
Exercise 1: Set up a task, learner, outer resampling strategy and performance measure
In order to set up our task, we need to convert the vector Class to a factor.
sonar$Class = as.factor(sonar$Class)
task_sonar = TaskClassif$new(id = "sonar", backend = sonar,
target = "Class")
#checking task details
task_sonar$col_roles## $feature
## [1] "V1" "V10" "V11" "V12" "V13" "V14" "V15" "V16" "V17" "V18" "V19" "V2"
## [13] "V20" "V21" "V22" "V23" "V24" "V25" "V26" "V27" "V28" "V29" "V3" "V30"
## [25] "V31" "V32" "V33" "V34" "V35" "V36" "V37" "V38" "V39" "V4" "V40" "V41"
## [37] "V42" "V43" "V44" "V45" "V46" "V47" "V48" "V49" "V5" "V50" "V51" "V52"
## [49] "V53" "V54" "V55" "V56" "V57" "V58" "V59" "V6" "V60" "V7" "V8" "V9"
##
## $target
## [1] "Class"
##
## $name
## character(0)
##
## $order
## character(0)
##
## $stratum
## character(0)
##
## $group
## character(0)
##
## $weight
## character(0)Since we do not need to exclude data we can move on to learners. I chose random forest:
## <LearnerClassifRanger:classif.ranger>
## * Model: -
## * Parameters: num.threads=1
## * Packages: mlr3, mlr3learners, ranger
## * Predict Types: [response], prob
## * Feature Types: logical, integer, numeric, character, factor, ordered
## * Properties: hotstart_backward, importance, multiclass, oob_error,
## twoclass, weightsResampling strategy
resamp_out = rsmp("holdout", ratio = 0.8)
resamp_out$instantiate(task_sonar)Set performance measure
measure = msr("classif.auc")Run the resampler and checking performance
rr = resample(task_sonar, lrn_sonar, resamp_out, store_models = TRUE)## INFO [20:22:43.757] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)rr$score(measure)## task_id learner_id resampling_id iteration classif.auc
## 1: sonar classif.ranger holdout 1 0.8870588
## Hidden columns: task, learner, resampling, predictionrr$aggregate(measure)## classif.auc
## 0.8870588Looking gooooood so far!
Exercise 2: Use the AutoTuner to tune your model
Setup
tune_sonar = ParamSet$new(list(ParamInt$new("mtry", lower = 1, upper = 8), ParamInt$new("num.trees", lower = 100, upper = 1000)))Running
resampling_inner = rsmp("holdout", ratio = 0.8)
resampling_outer = rsmp("cv", folds = 3)
evals = trm("evals", n_evals = 50)
tuner = tnr("grid_search", resolution = 10)
at_sonar = AutoTuner$new(learner = lrn_sonar,
resampling = resampling_inner,
measure = measure,
search_space = tune_sonar,
terminator = evals,
tuner = tuner)Exercise 3: Report the AUC score for the tuned model
## INFO [20:22:44.207] [mlr3] Applying learner 'classif.ranger.tuned' on task 'sonar' (iter 1/3)
## INFO [20:22:44.299] [bbotk] Starting to optimize 2 parameter(s) with '<TunerGridSearch>' and '<TerminatorEvals> [n_evals=50, k=0]'
## INFO [20:22:44.305] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:44.345] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:44.354] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:44.471] [mlr3] Finished benchmark
## INFO [20:22:44.522] [bbotk] Result of batch 1:
## INFO [20:22:44.524] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:44.524] [bbotk] 8 500 0.953125 0 0 0.107
## INFO [20:22:44.524] [bbotk] uhash
## INFO [20:22:44.524] [bbotk] 03dd5a15-d70d-4a84-a684-4e4f1cec10a0
## INFO [20:22:44.525] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:44.553] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:44.560] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:44.630] [mlr3] Finished benchmark
## INFO [20:22:44.663] [bbotk] Result of batch 2:
## INFO [20:22:44.665] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:44.665] [bbotk] 6 300 0.9583333 0 0 0.061
## INFO [20:22:44.665] [bbotk] uhash
## INFO [20:22:44.665] [bbotk] 4dc64de6-a2ba-40a9-8e82-ceb4d6b6dd39
## INFO [20:22:44.667] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:44.695] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:44.702] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:44.844] [mlr3] Finished benchmark
## INFO [20:22:44.877] [bbotk] Result of batch 3:
## INFO [20:22:44.879] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:44.879] [bbotk] 1 800 0.9375 0 0 0.133
## INFO [20:22:44.879] [bbotk] uhash
## INFO [20:22:44.879] [bbotk] f7136bde-7a0b-41a6-971a-67fa3be3b53f
## INFO [20:22:44.881] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:44.910] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:44.917] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:45.063] [mlr3] Finished benchmark
## INFO [20:22:45.096] [bbotk] Result of batch 4:
## INFO [20:22:45.098] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:45.098] [bbotk] 7 700 0.9479167 0 0 0.136
## INFO [20:22:45.098] [bbotk] uhash
## INFO [20:22:45.098] [bbotk] 94ea2d3b-0114-4670-8a22-bcc3a787cf6d
## INFO [20:22:45.100] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:45.128] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:45.135] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:45.269] [mlr3] Finished benchmark
## INFO [20:22:45.303] [bbotk] Result of batch 5:
## INFO [20:22:45.305] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:45.305] [bbotk] 4 700 0.9427083 0 0 0.124
## INFO [20:22:45.305] [bbotk] uhash
## INFO [20:22:45.305] [bbotk] b9bcd8c0-b44b-4461-b902-8a273e9914b2
## INFO [20:22:45.306] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:45.346] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:45.352] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:45.432] [mlr3] Finished benchmark
## INFO [20:22:45.465] [bbotk] Result of batch 6:
## INFO [20:22:45.467] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:45.467] [bbotk] 3 400 0.921875 0 0 0.071
## INFO [20:22:45.467] [bbotk] uhash
## INFO [20:22:45.467] [bbotk] d597423a-3962-49a8-9642-cb90f2a69f8a
## INFO [20:22:45.468] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:45.497] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:45.503] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:45.581] [mlr3] Finished benchmark
## INFO [20:22:45.615] [bbotk] Result of batch 7:
## INFO [20:22:45.617] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:45.617] [bbotk] 2 400 0.9583333 0 0 0.069
## INFO [20:22:45.617] [bbotk] uhash
## INFO [20:22:45.617] [bbotk] dd8bd3ac-9ac0-4b77-9020-97dd99cc6a9b
## INFO [20:22:45.619] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:45.647] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:45.654] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:45.689] [mlr3] Finished benchmark
## INFO [20:22:45.722] [bbotk] Result of batch 8:
## INFO [20:22:45.724] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:45.724] [bbotk] 7 100 0.9375 0 0 0.028
## INFO [20:22:45.724] [bbotk] uhash
## INFO [20:22:45.724] [bbotk] 6c67db73-70d4-4414-b715-7eeb261697dc
## INFO [20:22:45.726] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:46.035] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:46.042] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:46.089] [mlr3] Finished benchmark
## INFO [20:22:46.122] [bbotk] Result of batch 9:
## INFO [20:22:46.124] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:46.124] [bbotk] 2 200 0.9583333 0 0 0.039
## INFO [20:22:46.124] [bbotk] uhash
## INFO [20:22:46.124] [bbotk] f7a1f5b8-ed4f-4f59-a6aa-8db7312a3ed6
## INFO [20:22:46.125] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:46.154] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:46.160] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:46.193] [mlr3] Finished benchmark
## INFO [20:22:46.226] [bbotk] Result of batch 10:
## INFO [20:22:46.228] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:46.228] [bbotk] 4 100 0.9583333 0 0 0.024
## INFO [20:22:46.228] [bbotk] uhash
## INFO [20:22:46.228] [bbotk] 8f8d3071-aaa4-4aa3-9726-c212e3282d21
## INFO [20:22:46.230] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:46.257] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:46.264] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:46.448] [mlr3] Finished benchmark
## INFO [20:22:46.480] [bbotk] Result of batch 11:
## INFO [20:22:46.482] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:46.482] [bbotk] 5 1000 0.9479167 0 0 0.175
## INFO [20:22:46.482] [bbotk] uhash
## INFO [20:22:46.482] [bbotk] 93fd1f36-bac4-4c81-80ad-135175390d2d
## INFO [20:22:46.484] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:46.511] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:46.518] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:46.550] [mlr3] Finished benchmark
## INFO [20:22:46.584] [bbotk] Result of batch 12:
## INFO [20:22:46.586] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:46.586] [bbotk] 1 100 0.8958333 0 0 0.024
## INFO [20:22:46.586] [bbotk] uhash
## INFO [20:22:46.586] [bbotk] 3815e151-a4dc-4646-8083-efda2790f0d7
## INFO [20:22:46.587] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:46.615] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:46.622] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:46.743] [mlr3] Finished benchmark
## INFO [20:22:46.775] [bbotk] Result of batch 13:
## INFO [20:22:46.777] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:46.777] [bbotk] 6 600 0.9322917 0 0 0.112
## INFO [20:22:46.777] [bbotk] uhash
## INFO [20:22:46.777] [bbotk] 34d6c44e-b1b7-4b35-96fd-8ecea28e30b7
## INFO [20:22:46.778] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:46.806] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:46.813] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:47.020] [mlr3] Finished benchmark
## INFO [20:22:47.054] [bbotk] Result of batch 14:
## INFO [20:22:47.056] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:47.056] [bbotk] 8 1000 0.953125 0 0 0.198
## INFO [20:22:47.056] [bbotk] uhash
## INFO [20:22:47.056] [bbotk] 033342d6-1f2f-4ec3-bd19-82b3d92e2238
## INFO [20:22:47.057] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:47.085] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:47.091] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:47.214] [mlr3] Finished benchmark
## INFO [20:22:47.253] [bbotk] Result of batch 15:
## INFO [20:22:47.266] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:47.266] [bbotk] 1 700 0.953125 0 0 0.113
## INFO [20:22:47.266] [bbotk] uhash
## INFO [20:22:47.266] [bbotk] 45dc598d-a9a7-49fb-8717-0524d11191eb
## INFO [20:22:47.269] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:47.297] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:47.303] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:47.417] [mlr3] Finished benchmark
## INFO [20:22:47.451] [bbotk] Result of batch 16:
## INFO [20:22:47.453] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:47.453] [bbotk] 4 600 0.9635417 0 0 0.106
## INFO [20:22:47.453] [bbotk] uhash
## INFO [20:22:47.453] [bbotk] eb57182e-4422-4b19-bc1f-871801b01787
## INFO [20:22:47.455] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:47.482] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:47.489] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:47.596] [mlr3] Finished benchmark
## INFO [20:22:47.628] [bbotk] Result of batch 17:
## INFO [20:22:47.630] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:47.630] [bbotk] 1 600 0.9479167 0 0 0.097
## INFO [20:22:47.630] [bbotk] uhash
## INFO [20:22:47.630] [bbotk] 7ea6d0cd-ee7e-4af6-99c2-b71846573f99
## INFO [20:22:47.632] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:47.660] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:47.666] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:47.735] [mlr3] Finished benchmark
## INFO [20:22:47.769] [bbotk] Result of batch 18:
## INFO [20:22:47.771] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:47.771] [bbotk] 5 300 0.9479167 0 0 0.059
## INFO [20:22:47.771] [bbotk] uhash
## INFO [20:22:47.771] [bbotk] b63bcf8e-8ae0-458b-b0a6-8ac578588b5b
## INFO [20:22:47.772] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:47.801] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:47.808] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:47.888] [mlr3] Finished benchmark
## INFO [20:22:47.920] [bbotk] Result of batch 19:
## INFO [20:22:47.922] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:47.922] [bbotk] 4 400 0.9583333 0 0 0.072
## INFO [20:22:47.922] [bbotk] uhash
## INFO [20:22:47.922] [bbotk] 90cfabe7-491b-4a80-b2ca-e64024887fd8
## INFO [20:22:47.924] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:47.951] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:47.958] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:48.051] [mlr3] Finished benchmark
## INFO [20:22:48.084] [bbotk] Result of batch 20:
## INFO [20:22:48.086] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:48.086] [bbotk] 1 500 0.9375 0 0 0.084
## INFO [20:22:48.086] [bbotk] uhash
## INFO [20:22:48.086] [bbotk] 7a33b62c-b7f4-40a2-991b-b6c77ec504c5
## INFO [20:22:48.088] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:48.125] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:48.132] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:48.239] [mlr3] Finished benchmark
## INFO [20:22:48.272] [bbotk] Result of batch 21:
## INFO [20:22:48.274] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:48.274] [bbotk] 2 600 0.9427083 0 0 0.098
## INFO [20:22:48.274] [bbotk] uhash
## INFO [20:22:48.274] [bbotk] 5a8fa9f3-c199-48f7-96b9-363852246f25
## INFO [20:22:48.275] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:48.303] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:48.309] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:48.372] [mlr3] Finished benchmark
## INFO [20:22:48.406] [bbotk] Result of batch 22:
## INFO [20:22:48.408] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:48.408] [bbotk] 2 300 0.9427083 0 0 0.054
## INFO [20:22:48.408] [bbotk] uhash
## INFO [20:22:48.408] [bbotk] 1ce593bc-6764-4b4b-a171-90cddad68ce3
## INFO [20:22:48.410] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:48.438] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:48.445] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:48.480] [mlr3] Finished benchmark
## INFO [20:22:48.512] [bbotk] Result of batch 23:
## INFO [20:22:48.514] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:48.514] [bbotk] 5 100 0.921875 0 0 0.025
## INFO [20:22:48.514] [bbotk] uhash
## INFO [20:22:48.514] [bbotk] 4579f539-f30b-4201-8894-95a6206ed710
## INFO [20:22:48.516] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:48.543] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:48.550] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:48.628] [mlr3] Finished benchmark
## INFO [20:22:48.660] [bbotk] Result of batch 24:
## INFO [20:22:48.662] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:48.662] [bbotk] 1 400 0.9270833 0 0 0.07
## INFO [20:22:48.662] [bbotk] uhash
## INFO [20:22:48.662] [bbotk] 59cde383-06b3-42fc-87cf-b407caf8a9ae
## INFO [20:22:48.664] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:48.692] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:48.698] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:48.791] [mlr3] Finished benchmark
## INFO [20:22:48.823] [bbotk] Result of batch 25:
## INFO [20:22:48.825] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:48.825] [bbotk] 2 500 0.9375 0 0 0.083
## INFO [20:22:48.825] [bbotk] uhash
## INFO [20:22:48.825] [bbotk] 554dbc69-3171-4e95-b112-f4fba5f543be
## INFO [20:22:48.827] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:48.855] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:48.862] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:48.924] [mlr3] Finished benchmark
## INFO [20:22:48.959] [bbotk] Result of batch 26:
## INFO [20:22:48.961] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:48.961] [bbotk] 1 300 0.921875 0 0 0.053
## INFO [20:22:48.961] [bbotk] uhash
## INFO [20:22:48.961] [bbotk] 002eb7ff-d7b4-4575-9d5b-c6d7ee435517
## INFO [20:22:48.962] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:48.990] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:48.997] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:49.135] [mlr3] Finished benchmark
## INFO [20:22:49.167] [bbotk] Result of batch 27:
## INFO [20:22:49.169] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:49.169] [bbotk] 7 500 0.9583333 0 0 0.129
## INFO [20:22:49.169] [bbotk] uhash
## INFO [20:22:49.169] [bbotk] e93a4967-9989-4e74-8940-b59aea4aabaf
## INFO [20:22:49.171] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:49.198] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:49.205] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:49.354] [mlr3] Finished benchmark
## INFO [20:22:49.388] [bbotk] Result of batch 28:
## INFO [20:22:49.390] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:49.390] [bbotk] 8 700 0.9375 0 0 0.141
## INFO [20:22:49.390] [bbotk] uhash
## INFO [20:22:49.390] [bbotk] 300546d5-4bb7-430a-ad24-2200bdacc017
## INFO [20:22:49.392] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:49.420] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:49.427] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:49.598] [mlr3] Finished benchmark
## INFO [20:22:49.631] [bbotk] Result of batch 29:
## INFO [20:22:49.633] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:49.633] [bbotk] 2 1000 0.953125 0 0 0.163
## INFO [20:22:49.633] [bbotk] uhash
## INFO [20:22:49.633] [bbotk] ce077daf-4304-4b7e-ac8a-248d05d3e93b
## INFO [20:22:49.635] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:49.662] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:49.669] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:49.702] [mlr3] Finished benchmark
## INFO [20:22:49.733] [bbotk] Result of batch 30:
## INFO [20:22:49.736] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:49.736] [bbotk] 3 100 0.9635417 0 0 0.024
## INFO [20:22:49.736] [bbotk] uhash
## INFO [20:22:49.736] [bbotk] 6d492444-6e19-411e-8700-abbdcd38ee1d
## INFO [20:22:49.737] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:49.766] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:49.773] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:49.857] [mlr3] Finished benchmark
## INFO [20:22:49.892] [bbotk] Result of batch 31:
## INFO [20:22:49.894] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:49.894] [bbotk] 5 400 0.9427083 0 0 0.075
## INFO [20:22:49.894] [bbotk] uhash
## INFO [20:22:49.894] [bbotk] 9e0700f1-d752-44b1-9648-6eaf1dca3316
## INFO [20:22:49.896] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:49.925] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:49.932] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:50.034] [mlr3] Finished benchmark
## INFO [20:22:50.079] [bbotk] Result of batch 32:
## INFO [20:22:50.081] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:50.081] [bbotk] 5 500 0.953125 0 0 0.094
## INFO [20:22:50.081] [bbotk] uhash
## INFO [20:22:50.081] [bbotk] a4c00553-f7db-46d2-bf5e-533eade50907
## INFO [20:22:50.082] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:50.111] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:50.118] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:50.275] [mlr3] Finished benchmark
## INFO [20:22:50.306] [bbotk] Result of batch 33:
## INFO [20:22:50.308] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:50.308] [bbotk] 3 900 0.96875 0 0 0.148
## INFO [20:22:50.308] [bbotk] uhash
## INFO [20:22:50.308] [bbotk] 7e9c3903-2c62-43b1-9fe7-9c4aa5c6d461
## INFO [20:22:50.310] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:50.338] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:50.344] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:50.391] [mlr3] Finished benchmark
## INFO [20:22:50.425] [bbotk] Result of batch 34:
## INFO [20:22:50.427] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:50.427] [bbotk] 1 200 0.9427083 0 0 0.038
## INFO [20:22:50.427] [bbotk] uhash
## INFO [20:22:50.427] [bbotk] 55b9da75-e4a8-4caf-bc0b-4ed537e4c8d5
## INFO [20:22:50.428] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:50.455] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:50.462] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:50.513] [mlr3] Finished benchmark
## INFO [20:22:50.545] [bbotk] Result of batch 35:
## INFO [20:22:50.547] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:50.547] [bbotk] 5 200 0.9322917 0 0 0.043
## INFO [20:22:50.547] [bbotk] uhash
## INFO [20:22:50.547] [bbotk] 42a7313e-d78e-4b47-807d-1e7ed7939277
## INFO [20:22:50.549] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:50.577] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:50.583] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:50.720] [mlr3] Finished benchmark
## INFO [20:22:50.752] [bbotk] Result of batch 36:
## INFO [20:22:50.754] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:50.754] [bbotk] 2 800 0.953125 0 0 0.128
## INFO [20:22:50.754] [bbotk] uhash
## INFO [20:22:50.754] [bbotk] 49b82291-a32e-4c34-b4bc-162c65696687
## INFO [20:22:50.756] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:50.783] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:50.790] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:50.825] [mlr3] Finished benchmark
## INFO [20:22:50.857] [bbotk] Result of batch 37:
## INFO [20:22:50.859] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:50.859] [bbotk] 6 100 0.9375 0 0 0.027
## INFO [20:22:50.859] [bbotk] uhash
## INFO [20:22:50.859] [bbotk] 19c961ce-6d22-458b-9826-5d43f8841a4d
## INFO [20:22:50.861] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:50.891] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:50.898] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:51.107] [mlr3] Finished benchmark
## INFO [20:22:51.144] [bbotk] Result of batch 38:
## INFO [20:22:51.146] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:51.146] [bbotk] 7 1000 0.9583333 0 0 0.201
## INFO [20:22:51.146] [bbotk] uhash
## INFO [20:22:51.146] [bbotk] 8ba1ebc1-d17c-43d2-9eb0-bc80d6219280
## INFO [20:22:51.147] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:51.176] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:51.183] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:51.354] [mlr3] Finished benchmark
## INFO [20:22:51.388] [bbotk] Result of batch 39:
## INFO [20:22:51.390] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:51.390] [bbotk] 1 1000 0.9479167 0 0 0.162
## INFO [20:22:51.390] [bbotk] uhash
## INFO [20:22:51.390] [bbotk] 5b6662c7-83ba-408b-b2fc-df89cf6cf288
## INFO [20:22:51.392] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:51.421] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:51.427] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:51.537] [mlr3] Finished benchmark
## INFO [20:22:51.570] [bbotk] Result of batch 40:
## INFO [20:22:51.572] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:51.572] [bbotk] 3 600 0.9375 0 0 0.1
## INFO [20:22:51.572] [bbotk] uhash
## INFO [20:22:51.572] [bbotk] 8817c5e4-2636-4a68-a65e-cd7461d774b4
## INFO [20:22:51.573] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:51.601] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:51.608] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:51.773] [mlr3] Finished benchmark
## INFO [20:22:51.807] [bbotk] Result of batch 41:
## INFO [20:22:51.809] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:51.809] [bbotk] 4 900 0.9479167 0 0 0.157
## INFO [20:22:51.809] [bbotk] uhash
## INFO [20:22:51.809] [bbotk] 54875425-211b-4f3b-92bb-f2398154a825
## INFO [20:22:51.811] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:51.841] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:51.849] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:52.024] [mlr3] Finished benchmark
## INFO [20:22:52.059] [bbotk] Result of batch 42:
## INFO [20:22:52.061] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:52.061] [bbotk] 6 900 0.953125 0 0 0.166
## INFO [20:22:52.061] [bbotk] uhash
## INFO [20:22:52.061] [bbotk] 1b32ebac-94f6-49b7-b4aa-ee21da819331
## INFO [20:22:52.063] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:52.094] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:52.100] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:52.234] [mlr3] Finished benchmark
## INFO [20:22:52.267] [bbotk] Result of batch 43:
## INFO [20:22:52.269] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:52.269] [bbotk] 2 700 0.9427083 0 0 0.125
## INFO [20:22:52.269] [bbotk] uhash
## INFO [20:22:52.269] [bbotk] 72d84d65-a49f-46ff-971f-72ba62341d49
## INFO [20:22:52.271] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:52.322] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:52.330] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:52.462] [mlr3] Finished benchmark
## INFO [20:22:52.495] [bbotk] Result of batch 44:
## INFO [20:22:52.497] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:52.497] [bbotk] 8 600 0.9479167 0 0 0.123
## INFO [20:22:52.497] [bbotk] uhash
## INFO [20:22:52.497] [bbotk] ad1832cc-a9d5-493e-b03e-cc86ca1df457
## INFO [20:22:52.499] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:52.528] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:52.535] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:52.722] [mlr3] Finished benchmark
## INFO [20:22:52.756] [bbotk] Result of batch 45:
## INFO [20:22:52.758] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:52.758] [bbotk] 8 900 0.9427083 0 0 0.179
## INFO [20:22:52.758] [bbotk] uhash
## INFO [20:22:52.758] [bbotk] 15796c07-f679-454a-a6c4-bff43c280d3c
## INFO [20:22:52.760] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:52.788] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:52.795] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:52.922] [mlr3] Finished benchmark
## INFO [20:22:52.957] [bbotk] Result of batch 46:
## INFO [20:22:52.959] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:52.959] [bbotk] 7 600 0.9427083 0 0 0.117
## INFO [20:22:52.959] [bbotk] uhash
## INFO [20:22:52.959] [bbotk] 942e40a3-7fe7-489b-a26e-334a61296f34
## INFO [20:22:52.961] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:52.991] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:52.998] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:53.180] [mlr3] Finished benchmark
## INFO [20:22:53.215] [bbotk] Result of batch 47:
## INFO [20:22:53.217] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:53.217] [bbotk] 7 900 0.9479167 0 0 0.172
## INFO [20:22:53.217] [bbotk] uhash
## INFO [20:22:53.217] [bbotk] addabac6-b61d-4a75-a997-ce40d2573b3c
## INFO [20:22:53.219] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:53.250] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:53.258] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:53.433] [mlr3] Finished benchmark
## INFO [20:22:53.466] [bbotk] Result of batch 48:
## INFO [20:22:53.468] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:53.468] [bbotk] 6 800 0.9479167 0 0 0.166
## INFO [20:22:53.468] [bbotk] uhash
## INFO [20:22:53.468] [bbotk] 1b42acf3-1bfa-4c78-86a9-7865b5aff9be
## INFO [20:22:53.470] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:53.499] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:53.505] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:53.695] [mlr3] Finished benchmark
## INFO [20:22:53.743] [bbotk] Result of batch 49:
## INFO [20:22:53.745] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:53.745] [bbotk] 4 1000 0.953125 0 0 0.179
## INFO [20:22:53.745] [bbotk] uhash
## INFO [20:22:53.745] [bbotk] c55ddc30-7856-4c1f-ab96-6b62ec76fdd1
## INFO [20:22:53.747] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:53.787] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:53.796] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:53.908] [mlr3] Finished benchmark
## INFO [20:22:53.949] [bbotk] Result of batch 50:
## INFO [20:22:53.951] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:53.951] [bbotk] 3 500 0.953125 0 0 0.1
## INFO [20:22:53.951] [bbotk] uhash
## INFO [20:22:53.951] [bbotk] 341c8ae6-ccfb-49a2-aa45-fc01c77811c6
## INFO [20:22:53.959] [bbotk] Finished optimizing after 50 evaluation(s)
## INFO [20:22:53.960] [bbotk] Result:
## INFO [20:22:53.962] [bbotk] mtry num.trees learner_param_vals x_domain classif.auc
## INFO [20:22:53.962] [bbotk] 3 900 <list[4]> <list[2]> 0.96875
## INFO [20:22:54.220] [mlr3] Applying learner 'classif.ranger.tuned' on task 'sonar' (iter 2/3)
## INFO [20:22:54.298] [bbotk] Starting to optimize 2 parameter(s) with '<TunerGridSearch>' and '<TerminatorEvals> [n_evals=50, k=0]'
## INFO [20:22:54.301] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:54.332] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:54.339] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:54.447] [mlr3] Finished benchmark
## INFO [20:22:54.481] [bbotk] Result of batch 1:
## INFO [20:22:54.483] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:54.483] [bbotk] 2 500 0.8307692 0 0 0.096
## INFO [20:22:54.483] [bbotk] uhash
## INFO [20:22:54.483] [bbotk] bff4cda4-6d9f-4939-9ac9-7b2515d5b832
## INFO [20:22:54.485] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:54.526] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:54.535] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:54.677] [mlr3] Finished benchmark
## INFO [20:22:54.713] [bbotk] Result of batch 2:
## INFO [20:22:54.715] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:54.715] [bbotk] 3 800 0.8461538 0 0 0.133
## INFO [20:22:54.715] [bbotk] uhash
## INFO [20:22:54.715] [bbotk] 8fdf604f-fff4-4ea8-9d7a-c9dd8c3e9f98
## INFO [20:22:54.717] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:54.746] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:54.752] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:54.804] [mlr3] Finished benchmark
## INFO [20:22:54.839] [bbotk] Result of batch 3:
## INFO [20:22:54.841] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:54.841] [bbotk] 2 200 0.8512821 0 0 0.042
## INFO [20:22:54.841] [bbotk] uhash
## INFO [20:22:54.841] [bbotk] 0cc7d850-b331-44c4-a581-2c4ba210965e
## INFO [20:22:54.842] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:54.871] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:54.878] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:55.045] [mlr3] Finished benchmark
## INFO [20:22:55.079] [bbotk] Result of batch 4:
## INFO [20:22:55.081] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:55.081] [bbotk] 8 800 0.8 0 0 0.158
## INFO [20:22:55.081] [bbotk] uhash
## INFO [20:22:55.081] [bbotk] 63c0b53a-d10b-4d9a-97ad-ec3bdd71d588
## INFO [20:22:55.082] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:55.110] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:55.116] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:55.233] [mlr3] Finished benchmark
## INFO [20:22:55.267] [bbotk] Result of batch 5:
## INFO [20:22:55.269] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:55.269] [bbotk] 5 600 0.8461538 0 0 0.107
## INFO [20:22:55.269] [bbotk] uhash
## INFO [20:22:55.269] [bbotk] 0465cf8f-9d2e-46e8-a716-6fddc6b56679
## INFO [20:22:55.271] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:55.300] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:55.307] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:55.340] [mlr3] Finished benchmark
## INFO [20:22:55.373] [bbotk] Result of batch 6:
## INFO [20:22:55.375] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:55.375] [bbotk] 1 100 0.8666667 0 0 0.025
## INFO [20:22:55.375] [bbotk] uhash
## INFO [20:22:55.375] [bbotk] dd34e3a1-b19f-4cd2-8a41-9afce08d100d
## INFO [20:22:55.377] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:55.417] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:55.424] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:55.611] [mlr3] Finished benchmark
## INFO [20:22:55.643] [bbotk] Result of batch 7:
## INFO [20:22:55.645] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:55.645] [bbotk] 8 900 0.8051282 0 0 0.178
## INFO [20:22:55.645] [bbotk] uhash
## INFO [20:22:55.645] [bbotk] 07279ca1-3788-4db8-bb2f-1c41172056d6
## INFO [20:22:55.647] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:55.677] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:55.684] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:55.867] [mlr3] Finished benchmark
## INFO [20:22:55.907] [bbotk] Result of batch 8:
## INFO [20:22:55.910] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:55.910] [bbotk] 1 1000 0.8717949 0 0 0.174
## INFO [20:22:55.910] [bbotk] uhash
## INFO [20:22:55.910] [bbotk] 41006009-c7cc-48c8-bd22-829bf1dabdc8
## INFO [20:22:55.912] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:55.941] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:55.948] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:56.099] [mlr3] Finished benchmark
## INFO [20:22:56.132] [bbotk] Result of batch 9:
## INFO [20:22:56.134] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:56.134] [bbotk] 2 900 0.8410256 0 0 0.142
## INFO [20:22:56.134] [bbotk] uhash
## INFO [20:22:56.134] [bbotk] 69967e53-c4f8-473e-839a-5053905b8019
## INFO [20:22:56.136] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:56.164] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:56.171] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:56.242] [mlr3] Finished benchmark
## INFO [20:22:56.280] [bbotk] Result of batch 10:
## INFO [20:22:56.283] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:56.283] [bbotk] 5 300 0.8461538 0 0 0.061
## INFO [20:22:56.283] [bbotk] uhash
## INFO [20:22:56.283] [bbotk] 974ac23d-e287-480f-a5a5-0864a33265af
## INFO [20:22:56.284] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:56.324] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:56.332] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:56.463] [mlr3] Finished benchmark
## INFO [20:22:56.503] [bbotk] Result of batch 11:
## INFO [20:22:56.507] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:56.507] [bbotk] 1 700 0.8666667 0 0 0.121
## INFO [20:22:56.507] [bbotk] uhash
## INFO [20:22:56.507] [bbotk] 2745a458-e7a2-4d7f-9be0-ee66978c8fc1
## INFO [20:22:56.512] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:56.569] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:56.581] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:56.675] [mlr3] Finished benchmark
## INFO [20:22:56.715] [bbotk] Result of batch 12:
## INFO [20:22:56.717] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:56.717] [bbotk] 3 300 0.8666667 0 0 0.083
## INFO [20:22:56.717] [bbotk] uhash
## INFO [20:22:56.717] [bbotk] c3d9aff9-90f1-4582-868d-d58c3fa28b82
## INFO [20:22:56.719] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:56.752] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:56.760] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:56.880] [mlr3] Finished benchmark
## INFO [20:22:56.916] [bbotk] Result of batch 13:
## INFO [20:22:56.918] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:56.918] [bbotk] 8 500 0.8102564 0 0 0.11
## INFO [20:22:56.918] [bbotk] uhash
## INFO [20:22:56.918] [bbotk] 09f8d5de-e669-4d2f-b1ba-ab95b195563a
## INFO [20:22:56.920] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:56.948] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:56.955] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:56.991] [mlr3] Finished benchmark
## INFO [20:22:57.031] [bbotk] Result of batch 14:
## INFO [20:22:57.033] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:57.033] [bbotk] 3 100 0.8410256 0 0 0.026
## INFO [20:22:57.033] [bbotk] uhash
## INFO [20:22:57.033] [bbotk] 53135943-8e4e-41a3-9fc9-2f64006d9889
## INFO [20:22:57.035] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:57.071] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:57.078] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:57.218] [mlr3] Finished benchmark
## INFO [20:22:57.263] [bbotk] Result of batch 15:
## INFO [20:22:57.265] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:57.265] [bbotk] 2 800 0.8512821 0 0 0.132
## INFO [20:22:57.265] [bbotk] uhash
## INFO [20:22:57.265] [bbotk] 4da5feee-3c6e-4b41-8bb9-c6ee89972353
## INFO [20:22:57.267] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:57.296] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:57.305] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:57.386] [mlr3] Finished benchmark
## INFO [20:22:57.429] [bbotk] Result of batch 16:
## INFO [20:22:57.432] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:57.432] [bbotk] 8 300 0.8 0 0 0.068
## INFO [20:22:57.432] [bbotk] uhash
## INFO [20:22:57.432] [bbotk] 50fb7dd3-d554-46d0-8247-3dc70e89b5c8
## INFO [20:22:57.434] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:57.463] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:57.470] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:57.607] [mlr3] Finished benchmark
## INFO [20:22:57.640] [bbotk] Result of batch 17:
## INFO [20:22:57.643] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:57.643] [bbotk] 1 800 0.8974359 0 0 0.128
## INFO [20:22:57.643] [bbotk] uhash
## INFO [20:22:57.643] [bbotk] 6c4b618a-a106-4051-bd5c-a11cf939009f
## INFO [20:22:57.644] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:57.675] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:57.682] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:57.848] [mlr3] Finished benchmark
## INFO [20:22:57.884] [bbotk] Result of batch 18:
## INFO [20:22:57.887] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:57.887] [bbotk] 6 800 0.8205128 0 0 0.157
## INFO [20:22:57.887] [bbotk] uhash
## INFO [20:22:57.887] [bbotk] 35f0a687-60cf-4dca-9c18-053d710810df
## INFO [20:22:57.889] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:57.921] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:57.930] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:58.085] [mlr3] Finished benchmark
## INFO [20:22:58.130] [bbotk] Result of batch 19:
## INFO [20:22:58.132] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:58.132] [bbotk] 5 800 0.8358974 0 0 0.145
## INFO [20:22:58.132] [bbotk] uhash
## INFO [20:22:58.132] [bbotk] 7fbb1023-a2eb-449a-b70d-6913f183737b
## INFO [20:22:58.133] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:58.161] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:58.168] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:58.307] [mlr3] Finished benchmark
## INFO [20:22:58.341] [bbotk] Result of batch 20:
## INFO [20:22:58.344] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:58.344] [bbotk] 7 700 0.8102564 0 0 0.13
## INFO [20:22:58.344] [bbotk] uhash
## INFO [20:22:58.344] [bbotk] 47aaf605-f11c-4551-9233-15147f0b2da3
## INFO [20:22:58.346] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:58.376] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:58.384] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:58.580] [mlr3] Finished benchmark
## INFO [20:22:58.615] [bbotk] Result of batch 21:
## INFO [20:22:58.617] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:58.617] [bbotk] 6 1000 0.8102564 0 0 0.186
## INFO [20:22:58.617] [bbotk] uhash
## INFO [20:22:58.617] [bbotk] c06b1b2e-adaf-4d18-b955-8c6bf213c0a2
## INFO [20:22:58.619] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:58.648] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:58.654] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:58.719] [mlr3] Finished benchmark
## INFO [20:22:58.753] [bbotk] Result of batch 22:
## INFO [20:22:58.755] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:58.755] [bbotk] 1 300 0.8410256 0 0 0.055
## INFO [20:22:58.755] [bbotk] uhash
## INFO [20:22:58.755] [bbotk] 853d2bc9-ee54-4509-97f3-f1e27c61e4f6
## INFO [20:22:58.757] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:58.787] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:58.794] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:58.860] [mlr3] Finished benchmark
## INFO [20:22:58.895] [bbotk] Result of batch 23:
## INFO [20:22:58.897] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:58.897] [bbotk] 4 300 0.8410256 0 0 0.057
## INFO [20:22:58.897] [bbotk] uhash
## INFO [20:22:58.897] [bbotk] 35c95be4-2b1a-419c-9cf7-3dccaa1a4374
## INFO [20:22:58.899] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:58.937] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:58.944] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:59.122] [mlr3] Finished benchmark
## INFO [20:22:59.160] [bbotk] Result of batch 24:
## INFO [20:22:59.162] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:59.162] [bbotk] 7 900 0.8153846 0 0 0.169
## INFO [20:22:59.162] [bbotk] uhash
## INFO [20:22:59.162] [bbotk] 07d97993-dbbc-4768-a718-d88e1f943249
## INFO [20:22:59.164] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:59.193] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:59.201] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:59.238] [mlr3] Finished benchmark
## INFO [20:22:59.273] [bbotk] Result of batch 25:
## INFO [20:22:59.275] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:59.275] [bbotk] 7 100 0.825641 0 0 0.027
## INFO [20:22:59.275] [bbotk] uhash
## INFO [20:22:59.275] [bbotk] c1f2e27c-1285-4c60-a53e-91c3782a2ba9
## INFO [20:22:59.276] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:59.305] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:59.312] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:59.382] [mlr3] Finished benchmark
## INFO [20:22:59.418] [bbotk] Result of batch 26:
## INFO [20:22:59.420] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:59.420] [bbotk] 6 300 0.8051282 0 0 0.061
## INFO [20:22:59.420] [bbotk] uhash
## INFO [20:22:59.420] [bbotk] 186326d7-db1d-4e4e-9db0-bd36f53963ea
## INFO [20:22:59.422] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:59.450] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:59.458] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:59.624] [mlr3] Finished benchmark
## INFO [20:22:59.659] [bbotk] Result of batch 27:
## INFO [20:22:59.661] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:59.661] [bbotk] 7 800 0.8102564 0 0 0.157
## INFO [20:22:59.661] [bbotk] uhash
## INFO [20:22:59.661] [bbotk] 783df09e-67bf-40ef-9884-0e9b9df54257
## INFO [20:22:59.663] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:59.692] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:59.699] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:22:59.765] [mlr3] Finished benchmark
## INFO [20:22:59.799] [bbotk] Result of batch 28:
## INFO [20:22:59.801] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:22:59.801] [bbotk] 8 200 0.7897436 0 0 0.047
## INFO [20:22:59.801] [bbotk] uhash
## INFO [20:22:59.801] [bbotk] fb2b35ce-71fb-4f47-ad83-ce5347a5aa9c
## INFO [20:22:59.803] [bbotk] Evaluating 1 configuration(s)
## INFO [20:22:59.832] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:22:59.839] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:00.012] [mlr3] Finished benchmark
## INFO [20:23:00.046] [bbotk] Result of batch 29:
## INFO [20:23:00.048] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:00.048] [bbotk] 3 1000 0.8512821 0 0 0.163
## INFO [20:23:00.048] [bbotk] uhash
## INFO [20:23:00.048] [bbotk] cd02b9e5-8572-4911-a902-bda12b04414a
## INFO [20:23:00.050] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:00.078] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:00.085] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:00.212] [mlr3] Finished benchmark
## INFO [20:23:00.246] [bbotk] Result of batch 30:
## INFO [20:23:00.248] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:00.248] [bbotk] 3 700 0.8410256 0 0 0.117
## INFO [20:23:00.248] [bbotk] uhash
## INFO [20:23:00.248] [bbotk] 7aa0db41-0f66-4423-9045-668284378aaa
## INFO [20:23:00.250] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:00.278] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:00.285] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:00.367] [mlr3] Finished benchmark
## INFO [20:23:00.404] [bbotk] Result of batch 31:
## INFO [20:23:00.406] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:00.406] [bbotk] 3 400 0.8358974 0 0 0.073
## INFO [20:23:00.406] [bbotk] uhash
## INFO [20:23:00.406] [bbotk] cc8d4a65-676c-4d5b-b5b6-54cf58983da3
## INFO [20:23:00.407] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:00.438] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:00.445] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:00.601] [mlr3] Finished benchmark
## INFO [20:23:00.634] [bbotk] Result of batch 32:
## INFO [20:23:00.636] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:00.636] [bbotk] 4 800 0.8461538 0 0 0.147
## INFO [20:23:00.636] [bbotk] uhash
## INFO [20:23:00.636] [bbotk] 38a769d1-d161-4cc7-8f66-3030564db6c7
## INFO [20:23:00.638] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:00.666] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:00.673] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:00.766] [mlr3] Finished benchmark
## INFO [20:23:00.799] [bbotk] Result of batch 33:
## INFO [20:23:00.801] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:00.801] [bbotk] 1 500 0.8564103 0 0 0.083
## INFO [20:23:00.801] [bbotk] uhash
## INFO [20:23:00.801] [bbotk] 8b36a840-97b1-47ef-81bd-3e6fb013c22a
## INFO [20:23:00.803] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:00.835] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:00.843] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:00.926] [mlr3] Finished benchmark
## INFO [20:23:00.984] [bbotk] Result of batch 34:
## INFO [20:23:00.987] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:00.987] [bbotk] 7 200 0.8051282 0 0 0.068
## INFO [20:23:00.987] [bbotk] uhash
## INFO [20:23:00.987] [bbotk] 2c317aaf-c995-4f97-bada-e00ab7984edb
## INFO [20:23:00.989] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:01.022] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:01.032] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:01.077] [mlr3] Finished benchmark
## INFO [20:23:01.116] [bbotk] Result of batch 35:
## INFO [20:23:01.118] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:01.118] [bbotk] 8 100 0.8358974 0 0 0.035
## INFO [20:23:01.118] [bbotk] uhash
## INFO [20:23:01.118] [bbotk] 238ebaa8-3301-4140-b01e-4234e18d707a
## INFO [20:23:01.120] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:01.153] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:01.161] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:01.257] [mlr3] Finished benchmark
## INFO [20:23:01.306] [bbotk] Result of batch 36:
## INFO [20:23:01.309] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:01.309] [bbotk] 5 200 0.825641 0 0 0.046
## INFO [20:23:01.309] [bbotk] uhash
## INFO [20:23:01.309] [bbotk] ed9c8bc5-1d5c-4d45-9fbc-5c56ebcf7aad
## INFO [20:23:01.311] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:01.346] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:01.354] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:01.533] [mlr3] Finished benchmark
## INFO [20:23:01.599] [bbotk] Result of batch 37:
## INFO [20:23:01.601] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:01.601] [bbotk] 2 700 0.8205128 0 0 0.165
## INFO [20:23:01.601] [bbotk] uhash
## INFO [20:23:01.601] [bbotk] 9b737bb1-f92e-4c0a-9d86-bd4c2cfe63c2
## INFO [20:23:01.604] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:01.634] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:01.644] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:01.797] [mlr3] Finished benchmark
## INFO [20:23:01.841] [bbotk] Result of batch 38:
## INFO [20:23:01.845] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:01.845] [bbotk] 7 600 0.8205128 0 0 0.143
## INFO [20:23:01.845] [bbotk] uhash
## INFO [20:23:01.845] [bbotk] 301b6a67-251f-4297-8006-86d16fc7466f
## INFO [20:23:01.847] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:01.891] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:01.900] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:01.984] [mlr3] Finished benchmark
## INFO [20:23:02.031] [bbotk] Result of batch 39:
## INFO [20:23:02.034] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:02.034] [bbotk] 2 300 0.8615385 0 0 0.069
## INFO [20:23:02.034] [bbotk] uhash
## INFO [20:23:02.034] [bbotk] 5c3609b8-1b58-4f95-879c-93a4ba17fba0
## INFO [20:23:02.036] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:02.069] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:02.076] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:02.233] [mlr3] Finished benchmark
## INFO [20:23:02.267] [bbotk] Result of batch 40:
## INFO [20:23:02.269] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:02.269] [bbotk] 1 900 0.8615385 0 0 0.147
## INFO [20:23:02.269] [bbotk] uhash
## INFO [20:23:02.269] [bbotk] 2f0ab2b1-b4ca-4e01-884e-755a56271d70
## INFO [20:23:02.271] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:02.299] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:02.316] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:02.354] [mlr3] Finished benchmark
## INFO [20:23:02.392] [bbotk] Result of batch 41:
## INFO [20:23:02.394] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:02.394] [bbotk] 2 100 0.8102564 0 0 0.027
## INFO [20:23:02.394] [bbotk] uhash
## INFO [20:23:02.394] [bbotk] 04932518-5b3f-4af7-907b-1c54d2eef448
## INFO [20:23:02.396] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:02.425] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:02.433] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:02.637] [mlr3] Finished benchmark
## INFO [20:23:02.671] [bbotk] Result of batch 42:
## INFO [20:23:02.673] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:02.673] [bbotk] 8 1000 0.8102564 0 0 0.194
## INFO [20:23:02.673] [bbotk] uhash
## INFO [20:23:02.673] [bbotk] 39fb1604-3d38-4954-8aed-a8ea47d88cfa
## INFO [20:23:02.674] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:02.704] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:02.711] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:02.841] [mlr3] Finished benchmark
## INFO [20:23:02.876] [bbotk] Result of batch 43:
## INFO [20:23:02.878] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:02.878] [bbotk] 8 600 0.8 0 0 0.121
## INFO [20:23:02.878] [bbotk] uhash
## INFO [20:23:02.878] [bbotk] ca4fc6ce-a619-4ebe-afd2-b65c8d3ebecc
## INFO [20:23:02.879] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:02.910] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:02.918] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:03.037] [mlr3] Finished benchmark
## INFO [20:23:03.070] [bbotk] Result of batch 44:
## INFO [20:23:03.072] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:03.072] [bbotk] 3 500 0.8307692 0 0 0.107
## INFO [20:23:03.072] [bbotk] uhash
## INFO [20:23:03.072] [bbotk] cfdbe87a-7f58-4a6f-9a08-44ebc96ccd0d
## INFO [20:23:03.074] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:03.103] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:03.110] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:03.212] [mlr3] Finished benchmark
## INFO [20:23:03.245] [bbotk] Result of batch 45:
## INFO [20:23:03.247] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:03.247] [bbotk] 5 500 0.8410256 0 0 0.093
## INFO [20:23:03.247] [bbotk] uhash
## INFO [20:23:03.247] [bbotk] 83515867-bde3-4029-b179-513dbc84c28b
## INFO [20:23:03.249] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:03.277] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:03.284] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:03.329] [mlr3] Finished benchmark
## INFO [20:23:03.367] [bbotk] Result of batch 46:
## INFO [20:23:03.369] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:03.369] [bbotk] 6 100 0.8153846 0 0 0.036
## INFO [20:23:03.369] [bbotk] uhash
## INFO [20:23:03.369] [bbotk] 2cee63d8-8aef-4cf8-bb7e-0abc0a6feb0e
## INFO [20:23:03.370] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:03.399] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:03.406] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:03.575] [mlr3] Finished benchmark
## INFO [20:23:03.607] [bbotk] Result of batch 47:
## INFO [20:23:03.610] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:03.610] [bbotk] 6 900 0.8153846 0 0 0.16
## INFO [20:23:03.610] [bbotk] uhash
## INFO [20:23:03.610] [bbotk] ea8e679c-49d3-4427-b1c1-10a5de26f93e
## INFO [20:23:03.612] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:03.639] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:03.646] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:03.777] [mlr3] Finished benchmark
## INFO [20:23:03.810] [bbotk] Result of batch 48:
## INFO [20:23:03.812] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:03.812] [bbotk] 5 700 0.8307692 0 0 0.122
## INFO [20:23:03.812] [bbotk] uhash
## INFO [20:23:03.812] [bbotk] 786b9fa3-490e-4c82-9f36-1423fc39b2e2
## INFO [20:23:03.814] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:03.842] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:03.850] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:03.938] [mlr3] Finished benchmark
## INFO [20:23:03.971] [bbotk] Result of batch 49:
## INFO [20:23:03.973] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:03.973] [bbotk] 7 400 0.8153846 0 0 0.08
## INFO [20:23:03.973] [bbotk] uhash
## INFO [20:23:03.973] [bbotk] 25f91916-f32c-4695-b042-3323dc68d87f
## INFO [20:23:03.974] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:04.002] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:04.009] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:04.135] [mlr3] Finished benchmark
## INFO [20:23:04.168] [bbotk] Result of batch 50:
## INFO [20:23:04.170] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:04.170] [bbotk] 4 700 0.8410256 0 0 0.118
## INFO [20:23:04.170] [bbotk] uhash
## INFO [20:23:04.170] [bbotk] 55d6a6cc-ac4b-4f2e-b248-2f88b0c7318c
## INFO [20:23:04.176] [bbotk] Finished optimizing after 50 evaluation(s)
## INFO [20:23:04.177] [bbotk] Result:
## INFO [20:23:04.178] [bbotk] mtry num.trees learner_param_vals x_domain classif.auc
## INFO [20:23:04.178] [bbotk] 1 800 <list[4]> <list[2]> 0.8974359
## INFO [20:23:04.408] [mlr3] Applying learner 'classif.ranger.tuned' on task 'sonar' (iter 3/3)
## INFO [20:23:04.476] [bbotk] Starting to optimize 2 parameter(s) with '<TunerGridSearch>' and '<TerminatorEvals> [n_evals=50, k=0]'
## INFO [20:23:04.480] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:04.507] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:04.514] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:04.662] [mlr3] Finished benchmark
## INFO [20:23:04.691] [bbotk] Result of batch 1:
## INFO [20:23:04.693] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:04.693] [bbotk] 3 800 0.8888889 0 0 0.138
## INFO [20:23:04.693] [bbotk] uhash
## INFO [20:23:04.693] [bbotk] 87e5106b-b7c4-45f7-9309-6c32468df0a8
## INFO [20:23:04.694] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:04.722] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:04.728] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:04.839] [mlr3] Finished benchmark
## INFO [20:23:04.871] [bbotk] Result of batch 2:
## INFO [20:23:04.873] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:04.873] [bbotk] 2 600 0.9055556 0 0 0.103
## INFO [20:23:04.873] [bbotk] uhash
## INFO [20:23:04.873] [bbotk] 44365945-50c3-4e8c-a46d-717477ea41d4
## INFO [20:23:04.875] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:04.903] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:04.910] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:05.104] [mlr3] Finished benchmark
## INFO [20:23:05.136] [bbotk] Result of batch 3:
## INFO [20:23:05.138] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:05.138] [bbotk] 8 900 0.8666667 0 0 0.185
## INFO [20:23:05.138] [bbotk] uhash
## INFO [20:23:05.138] [bbotk] de89407c-1540-46db-bdb5-f599f4ad7340
## INFO [20:23:05.140] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:05.168] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:05.175] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:05.382] [mlr3] Finished benchmark
## INFO [20:23:05.431] [bbotk] Result of batch 4:
## INFO [20:23:05.433] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:05.433] [bbotk] 7 1000 0.8944444 0 0 0.199
## INFO [20:23:05.433] [bbotk] uhash
## INFO [20:23:05.433] [bbotk] 3c606f2f-182f-4630-9166-d4ecf0ea2e6c
## INFO [20:23:05.435] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:05.466] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:05.473] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:05.573] [mlr3] Finished benchmark
## INFO [20:23:05.606] [bbotk] Result of batch 5:
## INFO [20:23:05.608] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:05.608] [bbotk] 3 500 0.9 0 0 0.091
## INFO [20:23:05.608] [bbotk] uhash
## INFO [20:23:05.608] [bbotk] 0b5b67c7-eb26-449e-bdc1-69fa087b9bbd
## INFO [20:23:05.609] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:05.638] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:05.644] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:05.729] [mlr3] Finished benchmark
## INFO [20:23:05.765] [bbotk] Result of batch 6:
## INFO [20:23:05.767] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:05.767] [bbotk] 3 400 0.8777778 0 0 0.075
## INFO [20:23:05.767] [bbotk] uhash
## INFO [20:23:05.767] [bbotk] 1a84a2f6-54d4-4024-8212-25afac3a7960
## INFO [20:23:05.769] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:05.798] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:05.805] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:05.951] [mlr3] Finished benchmark
## INFO [20:23:05.983] [bbotk] Result of batch 7:
## INFO [20:23:05.985] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:05.985] [bbotk] 6 700 0.8833333 0 0 0.135
## INFO [20:23:05.985] [bbotk] uhash
## INFO [20:23:05.985] [bbotk] 06b51756-4abe-400b-8c23-df1bed579960
## INFO [20:23:05.987] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:06.014] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:06.021] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:06.114] [mlr3] Finished benchmark
## INFO [20:23:06.146] [bbotk] Result of batch 8:
## INFO [20:23:06.148] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:06.148] [bbotk] 7 400 0.8888889 0 0 0.085
## INFO [20:23:06.148] [bbotk] uhash
## INFO [20:23:06.148] [bbotk] 19881693-c27e-49fb-82a7-e53c0ed7a58f
## INFO [20:23:06.150] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:06.179] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:06.185] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:06.269] [mlr3] Finished benchmark
## INFO [20:23:06.315] [bbotk] Result of batch 9:
## INFO [20:23:06.317] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:06.317] [bbotk] 4 400 0.8666667 0 0 0.075
## INFO [20:23:06.317] [bbotk] uhash
## INFO [20:23:06.317] [bbotk] f8e4f545-90cf-483b-90c5-619e44e1ed49
## INFO [20:23:06.319] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:06.349] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:06.356] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:06.470] [mlr3] Finished benchmark
## INFO [20:23:06.503] [bbotk] Result of batch 10:
## INFO [20:23:06.505] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:06.505] [bbotk] 7 500 0.8722222 0 0 0.106
## INFO [20:23:06.505] [bbotk] uhash
## INFO [20:23:06.505] [bbotk] a271ea3f-a4ed-492e-9dbd-e705b8aa31a7
## INFO [20:23:06.506] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:06.534] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:06.541] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:06.755] [mlr3] Finished benchmark
## INFO [20:23:06.787] [bbotk] Result of batch 11:
## INFO [20:23:06.789] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:06.789] [bbotk] 8 1000 0.8722222 0 0 0.205
## INFO [20:23:06.789] [bbotk] uhash
## INFO [20:23:06.789] [bbotk] fe76ff76-ddfe-486d-91a1-09a9e5a203f7
## INFO [20:23:06.791] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:06.818] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:06.825] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:06.971] [mlr3] Finished benchmark
## INFO [20:23:07.004] [bbotk] Result of batch 12:
## INFO [20:23:07.006] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:07.006] [bbotk] 2 800 0.9277778 0 0 0.137
## INFO [20:23:07.006] [bbotk] uhash
## INFO [20:23:07.006] [bbotk] 9010ded6-355d-48e7-b529-7a06ea52419d
## INFO [20:23:07.008] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:07.036] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:07.043] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:07.184] [mlr3] Finished benchmark
## INFO [20:23:07.229] [bbotk] Result of batch 13:
## INFO [20:23:07.232] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:07.232] [bbotk] 5 700 0.8722222 0 0 0.133
## INFO [20:23:07.232] [bbotk] uhash
## INFO [20:23:07.232] [bbotk] 3d39f04d-be84-4c54-8af6-553dd9770cce
## INFO [20:23:07.233] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:07.264] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:07.270] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:07.475] [mlr3] Finished benchmark
## INFO [20:23:07.508] [bbotk] Result of batch 14:
## INFO [20:23:07.510] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:07.510] [bbotk] 6 1000 0.8833333 0 0 0.194
## INFO [20:23:07.510] [bbotk] uhash
## INFO [20:23:07.510] [bbotk] 9dd7387c-17f4-4c60-a1ca-042fe8262099
## INFO [20:23:07.512] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:07.540] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:07.547] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:07.717] [mlr3] Finished benchmark
## INFO [20:23:07.750] [bbotk] Result of batch 15:
## INFO [20:23:07.752] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:07.752] [bbotk] 7 800 0.8777778 0 0 0.162
## INFO [20:23:07.752] [bbotk] uhash
## INFO [20:23:07.752] [bbotk] b942de76-7f39-435d-8baf-3ec187fd48db
## INFO [20:23:07.754] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:07.781] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:07.788] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:07.894] [mlr3] Finished benchmark
## INFO [20:23:07.927] [bbotk] Result of batch 16:
## INFO [20:23:07.929] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:07.929] [bbotk] 5 500 0.8944444 0 0 0.098
## INFO [20:23:07.929] [bbotk] uhash
## INFO [20:23:07.929] [bbotk] c0f93ae2-d713-4914-a6dc-cd9176dcf6b0
## INFO [20:23:07.930] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:07.958] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:07.965] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:08.100] [mlr3] Finished benchmark
## INFO [20:23:08.135] [bbotk] Result of batch 17:
## INFO [20:23:08.137] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:08.137] [bbotk] 3 700 0.9 0 0 0.127
## INFO [20:23:08.137] [bbotk] uhash
## INFO [20:23:08.137] [bbotk] d1885c04-585a-4ea2-b597-67b1da0dfdff
## INFO [20:23:08.139] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:08.182] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:08.191] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:08.228] [mlr3] Finished benchmark
## INFO [20:23:08.261] [bbotk] Result of batch 18:
## INFO [20:23:08.263] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:08.263] [bbotk] 2 100 0.8555556 0 0 0.026
## INFO [20:23:08.263] [bbotk] uhash
## INFO [20:23:08.263] [bbotk] a41574ad-e39b-4039-acc1-213c5503093c
## INFO [20:23:08.265] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:08.293] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:08.300] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:08.351] [mlr3] Finished benchmark
## INFO [20:23:08.384] [bbotk] Result of batch 19:
## INFO [20:23:08.387] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:08.387] [bbotk] 3 200 0.9 0 0 0.042
## INFO [20:23:08.387] [bbotk] uhash
## INFO [20:23:08.387] [bbotk] 62acaf94-5403-43ba-8722-7b918987b27c
## INFO [20:23:08.388] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:08.417] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:08.424] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:08.462] [mlr3] Finished benchmark
## INFO [20:23:08.498] [bbotk] Result of batch 20:
## INFO [20:23:08.500] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:08.500] [bbotk] 4 100 0.8555556 0 0 0.029
## INFO [20:23:08.500] [bbotk] uhash
## INFO [20:23:08.500] [bbotk] 1ef897ed-9fcc-40d0-8988-fa2301b85253
## INFO [20:23:08.501] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:08.530] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:08.537] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:08.609] [mlr3] Finished benchmark
## INFO [20:23:08.642] [bbotk] Result of batch 21:
## INFO [20:23:08.644] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:08.644] [bbotk] 6 300 0.8833333 0 0 0.061
## INFO [20:23:08.644] [bbotk] uhash
## INFO [20:23:08.644] [bbotk] 6c2cf65c-4734-42b3-a9b0-2c87f9be0308
## INFO [20:23:08.646] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:08.674] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:08.681] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:08.796] [mlr3] Finished benchmark
## INFO [20:23:08.839] [bbotk] Result of batch 22:
## INFO [20:23:08.842] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:08.842] [bbotk] 3 600 0.9055556 0 0 0.106
## INFO [20:23:08.842] [bbotk] uhash
## INFO [20:23:08.842] [bbotk] 7eedd4bd-3ede-46fd-9c84-55c023eaddf1
## INFO [20:23:08.844] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:08.873] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:08.880] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:09.069] [mlr3] Finished benchmark
## INFO [20:23:09.103] [bbotk] Result of batch 23:
## INFO [20:23:09.105] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:09.105] [bbotk] 7 900 0.8833333 0 0 0.18
## INFO [20:23:09.105] [bbotk] uhash
## INFO [20:23:09.105] [bbotk] 1e589953-9fea-4b02-b6f9-45743002f99f
## INFO [20:23:09.107] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:09.135] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:09.142] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:09.318] [mlr3] Finished benchmark
## INFO [20:23:09.351] [bbotk] Result of batch 24:
## INFO [20:23:09.353] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:09.353] [bbotk] 2 1000 0.9055556 0 0 0.168
## INFO [20:23:09.353] [bbotk] uhash
## INFO [20:23:09.353] [bbotk] cc9372e5-f2f2-45d0-a1bb-e020bdbde5e8
## INFO [20:23:09.355] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:09.383] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:09.390] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:09.520] [mlr3] Finished benchmark
## INFO [20:23:09.554] [bbotk] Result of batch 25:
## INFO [20:23:09.556] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:09.556] [bbotk] 2 700 0.9055556 0 0 0.119
## INFO [20:23:09.556] [bbotk] uhash
## INFO [20:23:09.556] [bbotk] aa120b8e-7a44-4cb4-8e6f-ff9f7c58d2e3
## INFO [20:23:09.558] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:09.587] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:09.594] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:09.774] [mlr3] Finished benchmark
## INFO [20:23:09.813] [bbotk] Result of batch 26:
## INFO [20:23:09.815] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:09.815] [bbotk] 1 700 0.9166667 0 0 0.126
## INFO [20:23:09.815] [bbotk] uhash
## INFO [20:23:09.815] [bbotk] 852e9083-7f1f-4866-a8c6-c2a8f55060f4
## INFO [20:23:09.816] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:09.845] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:09.853] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:09.919] [mlr3] Finished benchmark
## INFO [20:23:09.955] [bbotk] Result of batch 27:
## INFO [20:23:09.957] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:09.957] [bbotk] 2 300 0.9055556 0 0 0.056
## INFO [20:23:09.957] [bbotk] uhash
## INFO [20:23:09.957] [bbotk] a0b88627-3713-4259-858e-9459973530ce
## INFO [20:23:09.959] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:09.989] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:09.997] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:10.126] [mlr3] Finished benchmark
## INFO [20:23:10.160] [bbotk] Result of batch 28:
## INFO [20:23:10.163] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:10.163] [bbotk] 5 600 0.8833333 0 0 0.12
## INFO [20:23:10.163] [bbotk] uhash
## INFO [20:23:10.163] [bbotk] b8d8b22f-3f1b-4552-9836-62710ba57880
## INFO [20:23:10.165] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:10.193] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:10.201] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:10.388] [mlr3] Finished benchmark
## INFO [20:23:10.423] [bbotk] Result of batch 29:
## INFO [20:23:10.425] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:10.425] [bbotk] 3 1000 0.8944444 0 0 0.178
## INFO [20:23:10.425] [bbotk] uhash
## INFO [20:23:10.425] [bbotk] c9c63c6e-e05e-4586-8c62-c880c9cd4243
## INFO [20:23:10.428] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:10.458] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:10.466] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:10.579] [mlr3] Finished benchmark
## INFO [20:23:10.627] [bbotk] Result of batch 30:
## INFO [20:23:10.630] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:10.630] [bbotk] 1 600 0.9277778 0 0 0.105
## INFO [20:23:10.630] [bbotk] uhash
## INFO [20:23:10.630] [bbotk] e9747f1a-6f41-4c2e-9fe1-8f989c39e23a
## INFO [20:23:10.632] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:10.664] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:10.671] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:10.831] [mlr3] Finished benchmark
## INFO [20:23:10.865] [bbotk] Result of batch 31:
## INFO [20:23:10.867] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:10.867] [bbotk] 5 800 0.8833333 0 0 0.15
## INFO [20:23:10.867] [bbotk] uhash
## INFO [20:23:10.867] [bbotk] b19f7218-45f6-4668-b490-268dcbed6c12
## INFO [20:23:10.869] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:10.898] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:10.905] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:10.943] [mlr3] Finished benchmark
## INFO [20:23:10.976] [bbotk] Result of batch 32:
## INFO [20:23:10.979] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:10.979] [bbotk] 8 100 0.8555556 0 0 0.03
## INFO [20:23:10.979] [bbotk] uhash
## INFO [20:23:10.979] [bbotk] 95bf2f78-6b7f-4436-9484-1095798a24d3
## INFO [20:23:10.980] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:11.009] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:11.017] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:11.128] [mlr3] Finished benchmark
## INFO [20:23:11.162] [bbotk] Result of batch 33:
## INFO [20:23:11.164] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:11.164] [bbotk] 6 500 0.8722222 0 0 0.101
## INFO [20:23:11.164] [bbotk] uhash
## INFO [20:23:11.164] [bbotk] b56c0d64-4d20-4a0b-8f06-c2ab969716f2
## INFO [20:23:11.166] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:11.196] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:11.203] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:11.333] [mlr3] Finished benchmark
## INFO [20:23:11.368] [bbotk] Result of batch 34:
## INFO [20:23:11.370] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:11.370] [bbotk] 6 600 0.8777778 0 0 0.121
## INFO [20:23:11.370] [bbotk] uhash
## INFO [20:23:11.370] [bbotk] 9908ca87-b313-449c-a6c9-32e9aaab0662
## INFO [20:23:11.372] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:11.402] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:11.420] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:11.588] [mlr3] Finished benchmark
## INFO [20:23:11.623] [bbotk] Result of batch 35:
## INFO [20:23:11.625] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:11.625] [bbotk] 2 900 0.9222222 0 0 0.157
## INFO [20:23:11.625] [bbotk] uhash
## INFO [20:23:11.625] [bbotk] d1fb0f97-1da5-42e5-a317-b189b24bc916
## INFO [20:23:11.627] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:11.656] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:11.663] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:11.717] [mlr3] Finished benchmark
## INFO [20:23:11.751] [bbotk] Result of batch 36:
## INFO [20:23:11.753] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:11.753] [bbotk] 4 200 0.9 0 0 0.044
## INFO [20:23:11.753] [bbotk] uhash
## INFO [20:23:11.753] [bbotk] e49a00fc-40d4-435f-b038-a708a3e8cc36
## INFO [20:23:11.754] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:11.783] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:11.791] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:11.934] [mlr3] Finished benchmark
## INFO [20:23:11.967] [bbotk] Result of batch 37:
## INFO [20:23:11.970] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:11.970] [bbotk] 1 800 0.9166667 0 0 0.134
## INFO [20:23:11.970] [bbotk] uhash
## INFO [20:23:11.970] [bbotk] add8a630-b8b8-465d-ae6c-9cc73cf6e315
## INFO [20:23:11.971] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:12.001] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:12.008] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:12.070] [mlr3] Finished benchmark
## INFO [20:23:12.109] [bbotk] Result of batch 38:
## INFO [20:23:12.111] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:12.111] [bbotk] 7 200 0.8722222 0 0 0.052
## INFO [20:23:12.111] [bbotk] uhash
## INFO [20:23:12.111] [bbotk] 222c2dd4-9eb6-442f-a587-e1fc871b21f2
## INFO [20:23:12.113] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:12.144] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:12.152] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:12.322] [mlr3] Finished benchmark
## INFO [20:23:12.364] [bbotk] Result of batch 39:
## INFO [20:23:12.366] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:12.366] [bbotk] 4 800 0.9111111 0 0 0.16
## INFO [20:23:12.366] [bbotk] uhash
## INFO [20:23:12.366] [bbotk] 865cfddc-0031-4e59-b137-190dc11da613
## INFO [20:23:12.368] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:12.402] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:12.409] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:12.510] [mlr3] Finished benchmark
## INFO [20:23:12.565] [bbotk] Result of batch 40:
## INFO [20:23:12.571] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:12.571] [bbotk] 2 400 0.9055556 0 0 0.088
## INFO [20:23:12.571] [bbotk] uhash
## INFO [20:23:12.571] [bbotk] db92387d-0638-4b28-af7d-0d0bf261d735
## INFO [20:23:12.574] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:12.611] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:12.619] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:12.786] [mlr3] Finished benchmark
## INFO [20:23:12.821] [bbotk] Result of batch 41:
## INFO [20:23:12.823] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:12.823] [bbotk] 8 600 0.8777778 0 0 0.158
## INFO [20:23:12.823] [bbotk] uhash
## INFO [20:23:12.823] [bbotk] ac549879-27a3-412e-a557-af25bf3e05ed
## INFO [20:23:12.825] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:12.855] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:12.863] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:13.004] [mlr3] Finished benchmark
## INFO [20:23:13.051] [bbotk] Result of batch 42:
## INFO [20:23:13.054] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:13.054] [bbotk] 4 600 0.8944444 0 0 0.13
## INFO [20:23:13.054] [bbotk] uhash
## INFO [20:23:13.054] [bbotk] 0b1dd088-9ba3-412a-b998-de50ebbc1dfa
## INFO [20:23:13.056] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:13.106] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:13.119] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:13.344] [mlr3] Finished benchmark
## INFO [20:23:13.430] [bbotk] Result of batch 43:
## INFO [20:23:13.434] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:13.434] [bbotk] 8 700 0.8722222 0 0 0.213
## INFO [20:23:13.434] [bbotk] uhash
## INFO [20:23:13.434] [bbotk] d1eba531-8530-4e2f-80cb-39a83a3300d2
## INFO [20:23:13.439] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:13.493] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:13.507] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:13.603] [mlr3] Finished benchmark
## INFO [20:23:13.650] [bbotk] Result of batch 44:
## INFO [20:23:13.652] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:13.652] [bbotk] 2 200 0.9111111 0 0 0.079
## INFO [20:23:13.652] [bbotk] uhash
## INFO [20:23:13.652] [bbotk] a66b1267-3468-49c4-bdac-3e6f2f19dd3b
## INFO [20:23:13.654] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:13.693] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:13.702] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:13.747] [mlr3] Finished benchmark
## INFO [20:23:13.792] [bbotk] Result of batch 45:
## INFO [20:23:13.795] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:13.795] [bbotk] 3 100 0.8666667 0 0 0.032
## INFO [20:23:13.795] [bbotk] uhash
## INFO [20:23:13.795] [bbotk] 38b81b19-a7a5-4931-b5b7-06fb6b74bea9
## INFO [20:23:13.797] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:13.835] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:13.844] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:13.887] [mlr3] Finished benchmark
## INFO [20:23:13.948] [bbotk] Result of batch 46:
## INFO [20:23:13.951] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:13.951] [bbotk] 1 100 0.9055556 0 0 0.029
## INFO [20:23:13.951] [bbotk] uhash
## INFO [20:23:13.951] [bbotk] cbc707da-f404-4ab8-938a-3f17dc1f1eb6
## INFO [20:23:13.953] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:14.011] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:14.026] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:14.203] [mlr3] Finished benchmark
## INFO [20:23:14.295] [bbotk] Result of batch 47:
## INFO [20:23:14.300] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:14.300] [bbotk] 7 600 0.8722222 0 0 0.164
## INFO [20:23:14.300] [bbotk] uhash
## INFO [20:23:14.300] [bbotk] d0bca768-6d7d-489d-af7c-8c46b9ed3b24
## INFO [20:23:14.306] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:14.368] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:14.383] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:14.533] [mlr3] Finished benchmark
## INFO [20:23:14.585] [bbotk] Result of batch 48:
## INFO [20:23:14.587] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:14.587] [bbotk] 2 500 0.9055556 0 0 0.131
## INFO [20:23:14.587] [bbotk] uhash
## INFO [20:23:14.587] [bbotk] 14c3db04-9667-4d2d-9d68-6a169bb01d01
## INFO [20:23:14.590] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:14.632] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:14.646] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:14.875] [mlr3] Finished benchmark
## INFO [20:23:14.921] [bbotk] Result of batch 49:
## INFO [20:23:14.924] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:14.924] [bbotk] 1 900 0.9222222 0 0 0.215
## INFO [20:23:14.924] [bbotk] uhash
## INFO [20:23:14.924] [bbotk] 7ab882a8-1051-4ce3-800b-069c0bfd9b17
## INFO [20:23:14.926] [bbotk] Evaluating 1 configuration(s)
## INFO [20:23:14.958] [mlr3] Running benchmark with 1 resampling iterations
## INFO [20:23:14.966] [mlr3] Applying learner 'classif.ranger' on task 'sonar' (iter 1/1)
## INFO [20:23:15.127] [mlr3] Finished benchmark
## INFO [20:23:15.172] [bbotk] Result of batch 50:
## INFO [20:23:15.176] [bbotk] mtry num.trees classif.auc warnings errors runtime_learners
## INFO [20:23:15.176] [bbotk] 7 700 0.8833333 0 0 0.151
## INFO [20:23:15.176] [bbotk] uhash
## INFO [20:23:15.176] [bbotk] baf46d12-30ab-40dc-90ea-5871d497afff
## INFO [20:23:15.188] [bbotk] Finished optimizing after 50 evaluation(s)
## INFO [20:23:15.190] [bbotk] Result:
## INFO [20:23:15.192] [bbotk] mtry num.trees learner_param_vals x_domain classif.auc
## INFO [20:23:15.192] [bbotk] 2 800 <list[4]> <list[2]> 0.9277778rr_at_sonar$score(measure)## task_id learner_id resampling_id iteration classif.auc
## 1: sonar classif.ranger.tuned cv 1 0.9019608
## 2: sonar classif.ranger.tuned cv 2 0.8989813
## 3: sonar classif.ranger.tuned cv 3 0.9738176
## Hidden columns: task, learner, resampling, predictionrr_at_sonar$aggregate(measure)## classif.auc
## 0.9249199We see an increase in performance! This means the tuned model works better which is what we would expect and want.
Exercise 4: Produce a variable importance plot
This plot is indicative of what the most important factor in controlling
the model. As we can see, V11 is the frequency that determines the
classification of mine vs rock.