Some general info to grasp the plots and tables to follow

This is a summary of a set of 30 experiments I ran on Cranium using a single pipe workflow file that performs the following tasks: * Loads a text file with arguments (each line is an experiment with the specs: M[jobs],misValperc[missing value %],min[Kcol_min] and max[Kcol_max] for FSR-Feature Sampling Range %, min[Nrow_min] and max[Nrow_max] for SSR-Subject Sampling Range %). * Loads a dataset for machine learning * Sets the number of jobs/iteration of the CBDA-SL algorithm [j_global] * Sets the experiment to run [i_exp, in a sequence constrained by the max number of jobs that can be submitted on Cranium through the LONI pipeline as a guest] * Set the working directory where every workspace is saved * Set the R script/scripts to be run

This document has the final results, by experiment. See https://drive.google.com/file/d/0B5sz_T_1CNJQWmlsRTZEcjBEOEk/view?ths=true for some general documentation of the CBDA-SL project and github https://github.com/SOCR/CBDA for the code [still in progress]. The test dataset is defined as below:

# Problem parameters
# Problem parameters
n = 300          # number of observations
p = 100          # number of variables
X1 = matrix(rnorm(n*p), nrow=n, ncol=p) 
Ytemp = rbinom(n,1,0.5)    # balanced bernoulli response variable
X2 <- cbind(Ytemp,X1)
# Here I write the data in a text file [not executed]
#write.table(X2,"C:/Users/simeonem/Documents/CBDA-SL/Cranium/Random_dataset.txt",sep=",")
# Here I load the dataset [not executed]
#Binomial_dataset = read.csv("C:/Users/simeonem/Documents/CBDA-SL/Cranium/Random_dataset.txt",header = TRUE)
# Here the X and Y matrix/vector are set for the CBDA-SL algorithm to proceed [not executed]
#Ytemp <- Random_dataset[,1]
#Xtemp <- Random_dataset[,-1]

Thus, there is no feature that should be associated to the outcome. I don’t list the False Discovery Rates.

## [1] 1

##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 1 3000          0        5       15       60       80

## [1] "CBDA-SL results"
##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 1 3000          0        5       15       60       80
##  CBDA Frequency Density  Knockoff Density 
##  48   12        2.352941 39       4.039735
##  43   11        2.156863 91       3.907285
##  72   10        1.960784 16       2.715232
##  74   10        1.960784 15       2.582781
##  77    9        1.764706 71       2.450331
##  4     8        1.568627 31       2.384106
##  5     8        1.568627 51       2.251656
##  19    8        1.568627 65       1.986755
##  28    8        1.568627 64       1.920530
##  98    8        1.568627  1       1.854305
##  99    8        1.568627 19       1.788079
## [1] 2

##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 2 3000         10        5       15       60       80

## [1] "CBDA-SL results"
##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 2 3000         10        5       15       60       80
##  CBDA Frequency Density  Knockoff Density 
##  25   11        2.244898 91       3.543586
##  28   10        2.040816 15       2.763997
##  83   10        2.040816  1       2.622254
##  1     9        1.836735 71       2.622254
##  31    9        1.836735 39       2.409639
##  71    9        1.836735 31       2.197023
##  91    9        1.836735 47       2.197023
##  78    8        1.632653 64       2.197023
##  5     7        1.428571 67       2.126152
##  8     7        1.428571 65       2.055280
##  16    7        1.428571 14       1.984408
## [1] 3

##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 3 3000         20        5       15       60       80

## [1] "CBDA-SL results"
##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 3 3000         20        5       15       60       80
##  CBDA Frequency Density  Knockoff Density 
##  89   11        2.099237 91       3.422819
##  31   10        1.908397 31       3.288591
##  8     9        1.717557 47       2.483221
##  29    9        1.717557 15       2.281879
##  63    9        1.717557 39       2.080537
##  70    9        1.717557 71       1.946309
##  20    8        1.526718 14       1.879195
##  38    8        1.526718 67       1.812081
##  39    8        1.526718  1       1.744966
##  41    8        1.526718  8       1.744966
##  49    8        1.526718 35       1.744966
## [1] 4

##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 4 3000         30        5       15       60       80

## [1] "CBDA-SL results"
##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 4 3000         30        5       15       60       80
##  CBDA Frequency Density  Knockoff Density 
##  61   11        2.391304 39       3.012048
##  25    9        1.956522 31       2.945114
##  28    9        1.956522 51       2.275770
##  38    9        1.956522 91       2.275770
##  67    9        1.956522 71       2.208835
##  80    9        1.956522 35       2.141901
##  8     8        1.739130 67       2.141901
##  46    8        1.739130 14       2.074967
##  71    8        1.739130  1       1.941098
##  96    8        1.739130 15       1.874163
##  9     7        1.521739 63       1.874163
## [1] 5

##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 5 3000         40        5       15       60       80

## [1] "CBDA-SL results"
##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 5 3000         40        5       15       60       80
##  CBDA Frequency Density  Knockoff Density 
##  10   11        2.272727 91       2.892031
##  70   10        2.066116 39       2.377892
##  71   10        2.066116 47       2.313625
##  77    9        1.859504 31       2.120823
##  23    8        1.652893 71       2.120823
##  44    8        1.652893 15       1.863753
##  62    8        1.652893 65       1.863753
##  64    8        1.652893 67       1.863753
##  72    8        1.652893 51       1.735219
##  73    8        1.652893 63       1.735219
##  82    8        1.652893 72       1.670951
## [1] 6

##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 6 3000          0        5       15      100      100

## [1] "CBDA-SL results"
##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 6 3000          0        5       15      100      100
##  CBDA Frequency Density  Knockoff Density 
##  35   11        2.350427 91       6.091846
##  85   11        2.350427 71       5.435801
##  93   10        2.136752 39       4.311153
##  64    9        1.923077 67       3.936270
##  74    9        1.923077 16       3.748828
##  25    8        1.709402 31       3.748828
##  29    8        1.709402  1       3.655108
##  44    8        1.709402 15       3.280225
##  51    8        1.709402 14       3.186504
##  69    8        1.709402 47       2.811621
##  71    8        1.709402 77       2.811621
## [1] 7

##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 7 3000         10        5       15      100      100

## [1] "CBDA-SL results"
##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 7 3000         10        5       15      100      100
##  CBDA Frequency Density  Knockoff Density 
##  51   10        2.066116 39       5.383212
##  39    9        1.859504 91       5.018248
##  40    9        1.859504 67       4.288321
##  71    9        1.859504 31       3.740876
##  20    8        1.652893  1       3.375912
##  26    8        1.652893 35       3.102190
##  34    8        1.652893 47       3.010949
##  67    8        1.652893 51       3.010949
##  82    8        1.652893 71       2.919708
##  83    8        1.652893 64       2.737226
##  87    8        1.652893 15       2.645985
## [1] 8

##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 8 3000         20        5       15      100      100

## [1] "CBDA-SL results"
##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 8 3000         20        5       15      100      100
##  CBDA Frequency Density  Knockoff Density 
##  14   11        2.386117 91       4.844961
##  7    10        2.169197 71       4.166667
##  91   10        2.169197 15       3.682171
##  20    9        1.952278 31       3.585271
##  70    9        1.952278 39       3.391473
##  90    9        1.952278 51       3.391473
##  96    9        1.952278 72       2.713178
##  17    8        1.735358 77       2.713178
##  25    8        1.735358  1       2.616279
##  51    8        1.735358 14       2.616279
##  54    8        1.735358 64       2.228682
## [1] 9

##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 9 3000         30        5       15      100      100

## [1] "CBDA-SL results"
##      M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 9 3000         30        5       15      100      100
##  CBDA Frequency Density  Knockoff Density 
##  45   12        2.166065 91       5.286738
##  56   12        2.166065 31       4.121864
##  31   11        1.985560 51       3.405018
##  14   10        1.805054 15       2.956989
##  39   10        1.805054 64       2.777778
##  42   10        1.805054 71       2.688172
##  77   10        1.805054 77       2.419355
##  96   10        1.805054 14       2.329749
##  9     9        1.624549 35       2.329749
##  15    9        1.624549 39       2.329749
##  30    9        1.624549 16       2.150538
## [1] 10

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 10 3000         40        5       15      100      100

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 10 3000         40        5       15      100      100
##  CBDA Frequency Density  Knockoff Density 
##  60   11        2.103250 91       3.658537
##  4     9        1.720841 39       3.048780
##  7     9        1.720841 71       2.874564
##  16    9        1.720841 51       2.787456
##  39    9        1.720841  1       2.526132
##  40    9        1.720841 47       2.439024
##  42    9        1.720841 31       2.351916
##  91    9        1.720841 25       2.264808
##  17    8        1.529637 35       2.177700
##  21    8        1.529637 67       1.916376
##  37    8        1.529637 63       1.829268
## [1] 11

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 11 3000          0       15       30       60       80

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 11 3000          0       15       30       60       80
##  CBDA Frequency Density  Knockoff Density 
##  81   18        1.754386 91       5.877483
##  96   17        1.656920 39       4.056291
##  18   16        1.559454 31       3.807947
##  51   16        1.559454 15       3.725166
##  76   16        1.559454 51       3.476821
##  15   15        1.461988  1       3.062914
##  16   15        1.461988 64       3.062914
##  58   15        1.461988 67       3.062914
##  61   15        1.461988 71       2.980132
##  71   15        1.461988 16       2.814570
##  3    14        1.364522 35       2.483444
## [1] 12

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 12 3000         10       15       30       60       80

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 12 3000         10       15       30       60       80
##  CBDA Frequency Density  Knockoff Density 
##  15   17        1.593252 91       4.815651
##  32   17        1.593252 39       4.439428
##  91   17        1.593252 71       3.762227
##  1    16        1.499531 67       3.386005
##  23   16        1.499531 51       3.160271
##  35   16        1.499531 15       2.708804
##  67   16        1.499531 31       2.708804
##  86   16        1.499531 19       2.483070
##  100  16        1.499531 64       2.407825
##  8    15        1.405811  1       2.332581
##  39   15        1.405811 47       2.106847
## [1] 13

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 13 3000         20       15       30       60       80

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 13 3000         20       15       30       60       80
##  CBDA Frequency Density  Knockoff Density 
##  47   19        1.694915 91       3.825137
##  61   18        1.605709 31       3.669009
##  77   18        1.605709 47       3.512881
##  84   18        1.605709 71       3.434817
##  67   17        1.516503  1       2.888368
##  96   17        1.516503 39       2.810304
##  23   16        1.427297 15       2.263856
##  24   16        1.427297 16       2.263856
##  46   16        1.427297 35       1.951600
##  88   16        1.427297 19       1.873536
##  95   16        1.427297 26       1.873536
## [1] 14

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 14 3000         30       15       30       60       80

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 14 3000         30       15       30       60       80
##  CBDA Frequency Density  Knockoff Density 
##  6    16        1.438849 39       3.542673
##  7    16        1.438849 91       3.542673
##  15   16        1.438849 67       3.140097
##  21   16        1.438849 64       2.818035
##  34   16        1.438849 71       2.818035
##  51   15        1.348921 47       2.576490
##  72   15        1.348921 48       2.334944
##  92   15        1.348921 65       2.334944
##  3    14        1.258993 14       2.254428
##  14   14        1.258993 31       2.093398
##  16   14        1.258993 51       2.012882
## [1] 15

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 15 3000         40       15       30       60       80

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 15 3000         40       15       30       60       80
##  CBDA Frequency Density  Knockoff Density 
##  28   19        1.690391 39       3.435400
##  44   17        1.512456 71       3.211352
##  58   17        1.512456 91       2.613891
##  17   16        1.423488 31       2.539208
##  18   16        1.423488 64       2.389843
##  37   16        1.423488 67       2.315161
##  59   16        1.423488 51       2.165795
##  3    15        1.334520 47       2.016430
##  19   15        1.334520 15       1.867065
##  31   15        1.334520 35       1.867065
##  52   15        1.334520 77       1.867065
## [1] 16

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 16 3000          0       15       30      100      100

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 16 3000          0       15       30      100      100
##  CBDA Frequency Density  Knockoff Density 
##  71   23        2.017544 91       9.987820
##  14   18        1.578947 39       6.820950
##  36   18        1.578947 31       5.602923
##  64   18        1.578947 71       5.481121
##  72   18        1.578947 67       4.872107
##  20   17        1.491228 15       3.897686
##  62   17        1.491228 51       3.775883
##  84   17        1.491228 77       3.775883
##  19   16        1.403509  1       3.045067
##  30   16        1.403509 16       2.801462
##  61   16        1.403509 47       2.801462
## [1] 17

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 17 3000         10       15       30      100      100

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 17 3000         10       15       30      100      100
##  CBDA Frequency Density  Knockoff Density 
##  91   22        1.914708 91       8.860759
##  31   20        1.740644 31       6.455696
##  1    17        1.479547 71       6.202532
##  64   17        1.479547 39       5.569620
##  73   17        1.479547 15       4.303797
##  14   16        1.392515 67       3.797468
##  16   16        1.392515 64       3.670886
##  71   16        1.392515 51       3.417722
##  77   16        1.392515 47       3.291139
##  87   16        1.392515  1       2.658228
##  8    15        1.305483 14       2.658228
## [1] 18

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 18 3000         20       15       30      100      100

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 18 3000         20       15       30      100      100
##  CBDA Frequency Density  Knockoff Density 
##  51   20        1.718213 91       6.769596
##  98   20        1.718213 31       5.344418
##  71   19        1.632302 71       5.225653
##  16   17        1.460481 39       4.988124
##  72   17        1.460481 51       4.394299
##  77   17        1.460481  1       4.275534
##  9    15        1.288660 67       3.206651
##  33   15        1.288660 14       2.731591
##  48   15        1.288660 16       2.731591
##  55   15        1.288660 35       2.731591
##  63   15        1.288660 15       2.612827
## [1] 19

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 19 3000         30       15       30      100      100

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 19 3000         30       15       30      100      100
##  CBDA Frequency Density  Knockoff Density 
##  72   18        1.690141 91       5.933251
##  90   18        1.690141 39       5.315204
##  10   17        1.596244 31       4.573548
##  31   16        1.502347 71       4.202719
##  51   16        1.502347  1       3.831891
##  88   16        1.502347 15       3.461063
##  19   15        1.408451 47       3.213844
##  23   15        1.408451 67       2.966625
##  26   15        1.408451 65       2.843016
##  64   15        1.408451 35       2.595797
##  67   15        1.408451 48       2.595797
## [1] 20

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 20 3000         40       15       30      100      100

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 20 3000         40       15       30      100      100
##  CBDA Frequency Density  Knockoff Density 
##  19   19        1.731996 91       5.189873
##  82   18        1.640839 39       4.556962
##  14   16        1.458523  1       4.177215
##  68   16        1.458523 71       4.050633
##  96   16        1.458523 31       3.544304
##  34   15        1.367366 67       3.417722
##  39   15        1.367366 47       3.291139
##  41   15        1.367366 15       2.911392
##  43   15        1.367366 25       2.658228
##  46   15        1.367366 77       2.658228
##  75   15        1.367366 72       2.531646
## [1] 21

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 21 3000          0       30       50       60       80

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 21 3000          0       30       50       60       80
##  CBDA Frequency Density  Knockoff Density 
##  31   33        1.580460 91       5.866667
##  91   30        1.436782 39       5.600000
##  48   29        1.388889 71       4.800000
##  29   28        1.340996 51       3.822222
##  20   27        1.293103 31       3.466667
##  28   27        1.293103  1       2.933333
##  27   26        1.245211 65       2.933333
##  62   26        1.245211 67       2.933333
##  64   26        1.245211 47       2.755556
##  68   26        1.245211 15       2.488889
##  73   26        1.245211 48       2.311111
## [1] 22

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 22 3000         10       30       50       60       80

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 22 3000         10       30       50       60       80
##  CBDA Frequency Density  Knockoff Density 
##  91   29        1.416016 91       5.196982
##  58   28        1.367188 31       4.861693
##  89   28        1.367188 39       4.777871
##  11   27        1.318359  1       3.772003
##  25   27        1.318359 71       3.772003
##  35   27        1.318359 15       3.101425
##  83   27        1.318359 67       2.849958
##  21   26        1.269531 47       2.598491
##  53   26        1.269531 19       2.514669
##  64   26        1.269531 51       2.263202
##  93   26        1.269531 72       2.263202
## [1] 23

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 23 3000         20       30       50       60       80

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 23 3000         20       30       50       60       80
##  CBDA Frequency Density  Knockoff Density 
##  67   28        1.417722 91       5.206738
##  83   28        1.417722 71       3.292496
##  36   26        1.316456 31       3.062787
##  65   26        1.316456 39       3.062787
##  70   26        1.316456 67       3.062787
##  24   25        1.265823 47       2.986217
##  28   25        1.265823 64       2.909648
##  29   25        1.265823 14       2.297090
##  32   25        1.265823 65       2.297090
##  89   25        1.265823 51       2.143951
##  3    24        1.215190  1       2.067381
## [1] 24

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 24 3000         30       30       50       60       80

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 24 3000         30       30       50       60       80
##  CBDA Frequency Density  Knockoff Density 
##  20   31        1.586489 91       5.056180
##  28   27        1.381781 39       3.531300
##  66   27        1.381781 71       3.451043
##  42   26        1.330604 15       3.130016
##  85   26        1.330604 31       3.130016
##  86   26        1.330604 51       3.049759
##  12   25        1.279427 67       2.568218
##  22   25        1.279427  1       2.407705
##  67   25        1.279427 47       2.407705
##  81   25        1.279427 65       2.407705
##  90   25        1.279427 77       2.247191
## [1] 25

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 25 3000         40       30       50       60       80

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 25 3000         40       30       50       60       80
##  CBDA Frequency Density  Knockoff Density 
##  91   29        1.475827 91       3.970827
##  65   28        1.424936 71       3.484603
##  64   27        1.374046 39       3.322528
##  44   26        1.323155 48       2.593193
##  15   25        1.272265  1       2.350081
##  16   25        1.272265 31       2.188006
##  43   25        1.272265 47       2.106969
##  1    24        1.221374 16       2.025932
##  31   24        1.221374 64       2.025932
##  38   24        1.221374 19       1.944895
##  26   23        1.170483 65       1.944895
## [1] 26

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 26 3000          0       30       50      100      100

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 26 3000          0       30       50      100      100
##  CBDA Frequency Density  Knockoff Density  
##  6    29        1.477331 91       10.380623
##  39   28        1.426388 39       10.207612
##  95   28        1.426388 71        7.266436
##  21   26        1.324503 31        5.363322
##  98   26        1.324503 67        5.363322
##  11   25        1.273561  1        4.671280
##  35   25        1.273561 51        4.325260
##  51   25        1.273561 47        3.979239
##  100  25        1.273561 15        3.114187
##  8    24        1.222618 64        2.941176
##  18   24        1.222618 16        2.768166
## [1] 27

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 27 3000         10       30       50      100      100

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 27 3000         10       30       50      100      100
##  CBDA Frequency Density  Knockoff Density  
##  39   30        1.474201 91       10.371517
##  30   28        1.375921 31        7.894737
##  56   28        1.375921 71        7.739938
##  63   27        1.326781 39        6.191950
##  96   27        1.326781  1        4.643963
##  38   26        1.277641 51        4.489164
##  47   26        1.277641 47        4.334365
##  75   26        1.277641 67        3.869969
##  4    25        1.228501 15        3.715170
##  16   25        1.228501 35        3.250774
##  20   25        1.228501 16        3.095975
## [1] 28

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 28 3000         20       30       50      100      100

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 28 3000         20       30       50      100      100
##  CBDA Frequency Density  Knockoff Density 
##  91   28        1.465969 91       8.771930
##  39   26        1.361257 31       6.578947
##  43   26        1.361257 39       6.286550
##  35   25        1.308901 47       5.116959
##  31   24        1.256545 71       4.678363
##  58   24        1.256545 51       4.239766
##  67   24        1.256545 15       4.093567
##  89   24        1.256545  1       3.508772
##  18   23        1.204188 67       3.508772
##  19   23        1.204188 64       3.362573
##  33   23        1.204188 14       2.923977
## [1] 29

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 29 3000         30       30       50      100      100

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 29 3000         30       30       50      100      100
##  CBDA Frequency Density  Knockoff Density 
##  67   29        1.479592 91       7.713499
##  14   28        1.428571 31       7.162534
##  16   27        1.377551 39       5.096419
##  20   26        1.326531 67       4.958678
##  25   26        1.326531 71       4.820937
##  91   26        1.326531  1       4.132231
##  27   25        1.275510 51       4.132231
##  62   25        1.275510 64       3.443526
##  68   25        1.275510 47       3.030303
##  35   24        1.224490 14       2.892562
##  39   24        1.224490 15       2.754821
## [1] 30

##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 30 3000         40       30       50      100      100

## [1] "CBDA-SL results"
##       M misValperc Kcol_min Kcol_max Nrow_min Nrow_max
## 30 3000         40       30       50      100      100
##  CBDA Frequency Density  Knockoff Density 
##  39   32        1.542912 91       5.532503
##  58   32        1.542912 31       4.149378
##  14   30        1.446480 39       4.149378
##  1    29        1.398264 47       3.596127
##  15   28        1.350048 71       3.596127
##  43   28        1.350048 51       3.042877
##  62   28        1.350048 67       3.042877
##  91   27        1.301832  1       2.627939
##  83   26        1.253616 16       2.489627
##  96   26        1.253616 48       2.489627
##  2    25        1.205400 14       2.351314