Model Evaluation and Refinement

Estimated time needed: 30 minutes

Objectives

After completing this lab you will be able to:

- Evaluate and refine prediction models

Table of Contents

- Model Evaluation

- Over-fitting, Under-fitting and Model Selection

- Ridge Regression

- Grid Search

Setup

You are running the lab in your browser, so we will install the libraries using piplite

#you are running the lab in your  browser, so we will install the libraries using ``piplite``
#import piplite
#import micropip

#await piplite.install(['pandas'])
#await piplite.install(['matplotlib'])
#await piplite.install(['scipy'])
#await piplite.install(['seaborn'])
#await micropip.install(['ipywidgets'],keep_going=True)
#await micropip.install(['tqdm'],keep_going=True)

# Se comentan las líneas de código anteriores ya que funcionan al trabajar en Jupiter Notebook

If you run the lab locally using Anaconda, you can load the correct library and versions by uncommenting the following:

#install specific version of libraries used in lab
#! mamba install pandas==1.3.3 -y
#! mamba install numpy=1.21.2 -y
#! mamba install sklearn=0.20.1 -y
#! mamba install   ipywidgets=7.4.2 -y
#! mamba install tqdm

import pandas as pd
import numpy as np

This function will download the dataset into your browser

#from pyodide.http import pyfetch

async def download(url, filename):
    response = await pyfetch(url)
    if response.status == 200:
        with open(filename, "wb") as f:
            f.write(await response.bytes())
            

This dataset was hosted on IBM Cloud object. Click HERE for free storage.

path = 'https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DA0101EN-SkillsNetwork/labs/Data%20files/module_5_auto.csv'

You will need to download the dataset; if you are running locally, please comment out the following

#you will need to download the dataset; if you are running locally, please comment out the following 

#await download(path, "auto.csv")
#path="auto.csv"

df = pd.read_csv(path)

df.to_csv('module_5_auto.csv')

First, let’s only use numeric data:

df=df._get_numeric_data()

df.head()

##    Unnamed: 0.1  Unnamed: 0  symboling  ...  city-L/100km  diesel  gas
## 0             0           0          3  ...     11.190476       0    1
## 1             1           1          3  ...     11.190476       0    1
## 2             2           2          1  ...     12.368421       0    1
## 3             3           3          2  ...      9.791667       0    1
## 4             4           4          2  ...     13.055556       0    1
## 
## [5 rows x 21 columns]

Libraries for plotting:

from ipywidgets import interact, interactive, fixed, interact_manual

Functions for Plotting

def DistributionPlot(RedFunction, BlueFunction, RedName, BlueName, Title):
    width = 12
    height = 10
    plt.figure(figsize=(width, height))
    
    ax1 = sns.distplot(RedFunction, hist=False, color="r", label=RedName)
    ax2 = sns.distplot(BlueFunction, hist=False, color="b", label=BlueName, ax=ax1)
    
    plt.title(Title)
    plt.xlabel('Price (in dollars)')
    plt.ylabel('Proportion of Cars')
    
    plt.show()
    plt.close()
    

def PollyPlot(xtrain, xtest, y_train, y_test, lr,poly_transform):
    width = 12
    height = 10
    plt.figure(figsize=(width, height))
    
    #training data 
    #testing data 
    # lr:  linear regression object 
    #poly_transform:  polynomial transformation object 
    
    xmax=max([xtrain.values.max(), xtest.values.max()])
    xmin=min([xtrain.values.min(), xtest.values.min()])
    x=np.arange(xmin, xmax, 0.1)
    
    # Se agrega (".values" a "xtrain" y "xtest") para que no se tenga el error "invalidindexerror (slice(none none none) none)"
    plt.plot(xtrain.values, y_train, 'ro', label='Training Data')
    plt.plot(xtest.values, y_test, 'go', label='Test Data')
    
    plt.plot(x, lr.predict(poly_transform.fit_transform(x.reshape(-1, 1))), label='Predicted Function')
    
    plt.ylim([-10000, 60000])
    plt.ylabel('Price')
    plt.legend()
    
    plt.show()
    plt.close()
    

Part 1: Training and Testing

An important step in testing your model is to split your data into training and testing data. We will place the target data price in a separate dataframe y_data:

y_data = df['price']

Drop price data in dataframe x_data:

x_data=df.drop('price',axis=1)

Now, we randomly split our data into training and testing data using the function train_test_split.

from sklearn.model_selection import train_test_split


x_train, x_test, y_train, y_test = train_test_split(x_data, y_data, test_size=0.10, random_state=1)

print("number of test samples :", x_test.shape[0])

## number of test samples : 21

print("number of training samples:",x_train.shape[0])

## number of training samples: 180

The test_size parameter sets the proportion of data that is split into the testing set. In the above, the testing set is 10% of the total dataset.

Question #1):

Use the function “train_test_split” to split up the dataset such that 40% of the data samples will be utilized for testing. Set the parameter “random_state” equal to zero. The output of the function should be the following: “x_train1” , “x_test1”, “y_train1” and “y_test1”.

# Write your code below and press Shift+Enter to execute 

x_train1, x_test1, y_train1, y_test1 = train_test_split(x_data, y_data, test_size=0.40, random_state=0)

print("number of test samples :", x_test1.shape[0])

## number of test samples : 81

print("number of training samples:",x_train1.shape[0])

## number of training samples: 120

Let’s import LinearRegression from the module linear_model.

from sklearn.linear_model import LinearRegression

We create a Linear Regression object:

lre=LinearRegression()

We fit the model using the feature “horsepower”:

lre.fit(x_train[['horsepower']], y_train)

## LinearRegression()

Let’s calculate the R^2 on the test data:

lre.score(x_test[['horsepower']], y_test)

## 0.3635875575078824

We can see the R^2 is much smaller using the test data compared to the training data.

lre.score(x_train[['horsepower']], y_train)

## 0.6619724197515103

Question #2):

Find the R^2 on the test data using 40% of the dataset for testing.

# Write your code below and press Shift+Enter to execute 

lre1=LinearRegression()

lre1.fit(x_train1[['horsepower']], y_train1)

## LinearRegression()

lre1.score(x_test1[['horsepower']], y_test1)

## 0.7139364665406973

Sometimes you do not have sufficient testing data; as a result, you may want to perform cross-validation. Let’s go over several methods that you can use for cross-validation.

Cross-Validation Score

Let’s import model_selection from the module cross_val_score.

from sklearn.model_selection import cross_val_score

We input the object, the feature (“horsepower”), and the target data (y_data). The parameter ‘cv’ determines the number of folds. In this case, it is 4.

Rcross = cross_val_score(lre, x_data[['horsepower']], y_data, cv=4)

The default scoring is R^2. Each element in the array has the average R^2 value for the fold:

Rcross

## array([0.7746232 , 0.51716687, 0.74785353, 0.04839605])

We can calculate the average and standard deviation of our estimate:

print("The mean of the folds are", Rcross.mean(), "and the standard deviation is" , Rcross.std())

## The mean of the folds are 0.522009915042119 and the standard deviation is 0.2911839444756029

We can use negative squared error as a score by setting the parameter ‘scoring’ metric to ‘neg_mean_squared_error’.

-1 * cross_val_score(lre,x_data[['horsepower']], y_data,cv=4,scoring='neg_mean_squared_error')

## array([20254142.84026704, 43745493.26505169, 12539630.34014931,
##        17561927.72247591])

Question #3):

Calculate the average R^2 using two folds, then find the average R^2 for the second fold utilizing the “horsepower” feature:

Rcross1 = cross_val_score(lre, x_data[['horsepower']], y_data, cv=2)

Rcross1

## array([0.59015621, 0.44319613])

print("The mean of the folds are", Rcross1.mean())

## The mean of the folds are 0.5166761697127429

You can also use the function ‘cross_val_predict’ to predict the output. The function splits up the data into the specified number of folds, with one fold for testing and the other folds are used for training. First, import the function:

from sklearn.model_selection import cross_val_predict

We input the object, the feature “horsepower”, and the target data y_data. The parameter ‘cv’ determines the number of folds. In this case, it is 4. We can produce an output:

yhat = cross_val_predict(lre,x_data[['horsepower']], y_data,cv=4)

yhat[0:5]

## array([14141.63807508, 14141.63807508, 20814.29423473, 12745.03562306,
##        14762.35027598])

Part 2: Overfitting, Underfitting and Model Selection

It turns out that the test data, sometimes referred to as the “out of sample data”, is a much better measure of how well your model performs in the real world. One reason for this is overfitting.

Let’s go over some examples. It turns out these differences are more apparent in Multiple Linear Regression and Polynomial Regression so we will explore overfitting in that context.

Let’s create Multiple Linear Regression objects and train the model using ‘horsepower’, ‘curb-weight’, ‘engine-size’ and ‘highway-mpg’ as features.

lr = LinearRegression()

lr.fit(x_train[['horsepower', 'curb-weight', 'engine-size', 'highway-mpg']], y_train)

## LinearRegression()

Prediction using training data:

yhat_train = lr.predict(x_train[['horsepower', 'curb-weight', 'engine-size', 'highway-mpg']])

yhat_train[0:5]

## array([ 7426.6731551 , 28323.75090803, 14213.38819709,  4052.34146983,
##        34500.19124244])

Prediction using test data:

yhat_test = lr.predict(x_test[['horsepower', 'curb-weight', 'engine-size', 'highway-mpg']])

yhat_test[0:5]

## array([11349.35089149,  5884.11059106, 11208.6928275 ,  6641.07786278,
##        15565.79920282])

Let’s perform some model evaluation using our training and testing data separately. First, we import the seaborn and matplotlib library for plotting.

import matplotlib.pyplot as plt
#%matplotlib inline
import seaborn as sns

Let’s examine the distribution of the predicted values of the training data.

Title = 'Distribution  Plot of  Predicted Value Using Training Data vs Training Data Distribution'

DistributionPlot(y_train, yhat_train, "Actual Values (Train)", "Predicted Values (Train)", Title)

## C:\Users\USER\ANACON~1\lib\site-packages\seaborn\distributions.py:2619: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `kdeplot` (an axes-level function for kernel density plots).
##   warnings.warn(msg, FutureWarning)
## C:\Users\USER\ANACON~1\lib\site-packages\seaborn\distributions.py:2619: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `kdeplot` (an axes-level function for kernel density plots).
##   warnings.warn(msg, FutureWarning)

Figure 1: Plot of predicted values using the training data compared to the actual values of the training data.

So far, the model seems to be doing well in learning from the training dataset. But what happens when the model encounters new data from the testing dataset? When the model generates new values from the test data, we see the distribution of the predicted values is much different from the actual target values.

Title='Distribution  Plot of  Predicted Value Using Test Data vs Data Distribution of Test Data'

DistributionPlot(y_test,yhat_test,"Actual Values (Test)","Predicted Values (Test)",Title)

## C:\Users\USER\ANACON~1\lib\site-packages\seaborn\distributions.py:2619: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `kdeplot` (an axes-level function for kernel density plots).
##   warnings.warn(msg, FutureWarning)
## C:\Users\USER\ANACON~1\lib\site-packages\seaborn\distributions.py:2619: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `kdeplot` (an axes-level function for kernel density plots).
##   warnings.warn(msg, FutureWarning)

Figure 2: Plot of predicted value using the test data compared to the actual values of the test data.

Comparing Figure 1 and Figure 2, it is evident that the distribution of the test data in Figure 1 is much better at fitting the data. This difference in Figure 2 is apparent in the range of 5000 to 15,000. This is where the shape of the distribution is extremely different. Let’s see if polynomial regression also exhibits a drop in the prediction accuracy when analysing the test dataset.

from sklearn.preprocessing import PolynomialFeatures

Overfitting

Overfitting occurs when the model fits the noise, but not the underlying process. Therefore, when testing your model using the test set, your model does not perform as well since it is modelling noise, not the underlying process that generated the relationship. Let’s create a degree 5 polynomial model.

Let’s use 55 percent of the data for training and the rest for testing:

x_train, x_test, y_train, y_test = train_test_split(x_data, y_data, test_size=0.45, random_state=0)

We will perform a degree 5 polynomial transformation on the feature ‘horsepower’.

pr = PolynomialFeatures(degree=5)

x_train_pr = pr.fit_transform(x_train[['horsepower']])
x_test_pr = pr.fit_transform(x_test[['horsepower']])

pr

## PolynomialFeatures(degree=5)

Now, let’s create a Linear Regression model “poly” and train it.

poly = LinearRegression()

poly.fit(x_train_pr, y_train)

## LinearRegression()

We can see the output of our model using the method “predict.” We assign the values to”yhat”.

yhat = poly.predict(x_test_pr)

yhat[0:5]

## array([ 6728.77492727,  7308.09738048, 12213.83912148, 18893.06269972,
##        19995.73316497])

Let’s take the first five predicted values and compare it to the actual targets.

print("Predicted values:", yhat[0:4])

## Predicted values: [ 6728.77492727  7308.09738048 12213.83912148 18893.06269972]

print("True values:", y_test[0:4].values)

## True values: [ 6295. 10698. 13860. 13499.]

We will use the function “PollyPlot” that we defined at the beginning of the lab to display the training data, testing data, and the predicted function.

plt.clf()

PollyPlot(x_train[['horsepower']], x_test[['horsepower']], y_train, y_test, poly, pr)

Figure 3: A polynomial regression model where red dots represent training data, green dots represent test data, and the blue line represents the model prediction.

We see that the estimated function appears to track the data but around 200 horsepower, the function begins to diverge from the data points.

R^2 of the training data:

poly.score(x_train_pr, y_train)

## 0.5567716899817778

R^2 of the test data:

poly.score(x_test_pr, y_test)

## -29.871838229908324

We see the R^2 for the training data is 0.5567 while the R^2 on the test data was -29.87. The lower the R^2, the worse the model. A negative R^2 is a sign of overfitting.

Let’s see how the R^2 changes on the test data for different order polynomials and then plot the results:

plt.clf()

Rsqu_test = []

order = [1, 2, 3, 4]

for n in order:
    pr = PolynomialFeatures(degree=n)
    
    x_train_pr = pr.fit_transform(x_train[['horsepower']])
    x_test_pr = pr.fit_transform(x_test[['horsepower']])    
    
    lr.fit(x_train_pr, y_train)
    
    Rsqu_test.append(lr.score(x_test_pr, y_test))

## LinearRegression()
## LinearRegression()
## LinearRegression()
## LinearRegression()

plt.plot(order, Rsqu_test)
plt.xlabel('order')
plt.ylabel('R^2')
plt.title('R^2 Using Test Data')
plt.text(3, 0.75, 'Maximum R^2 ')   

plt.show()

We see the R^2 gradually increases until an order three polynomial is used. Then, the R^2 dramatically decreases at an order four polynomial.

The following function will be used in the next section. Please run the cell below.

def f(order, test_data):
    x_train, x_test, y_train, y_test = train_test_split(x_data, y_data, test_size=test_data, random_state=0)
    pr = PolynomialFeatures(degree=order)
    x_train_pr = pr.fit_transform(x_train[['horsepower']])
    x_test_pr = pr.fit_transform(x_test[['horsepower']])
    poly = LinearRegression()
    poly.fit(x_train_pr,y_train)
    PollyPlot(x_train[['horsepower']], x_test[['horsepower']], y_train,y_test, poly, pr)
    

The following interface allows you to experiment with different polynomial orders and different amounts of data.

interact(f, order=(0, 6, 1), test_data=(0.05, 0.95, 0.05))

## interactive(children=(IntSlider(value=3, description='order', max=6), FloatSlider(value=0.45, description='test_data', max=0.95, min=0.05, step=0.05), Output()), _dom_classes=('widget-interact',))
## <function f at 0x0000022D85145E50>

Question #4a):

We can perform polynomial transformations with more than one feature. Create a “PolynomialFeatures” object “pr1” of degree two.

# Write your code below and press Shift+Enter to execute

pr1=PolynomialFeatures(degree=2)

Question #4b):

Transform the training and testing samples for the features ‘horsepower’, ‘curb-weight’, ‘engine-size’ and ‘highway-mpg’. Hint: use the method “fit_transform”.

# Write your code below and press Shift+Enter to execute 

x_train_pr1 = pr1.fit_transform(x_train[['horsepower', 'curb-weight', 'engine-size', 'highway-mpg']])
x_test_pr1 = pr1.fit_transform(x_test[['horsepower', 'curb-weight', 'engine-size', 'highway-mpg']])

Question #4c):

How many dimensions does the new feature have? Hint: use the attribute “shape”.

# Write your code below and press Shift+Enter to execute 

x_train_pr1.shape

# x_train_pr1 ahora tiene 15 features

## (110, 15)

Question #4d):

Create a linear regression model “poly1”. Train the object using the method “fit” using the polynomial features.

# Write your code below and press Shift+Enter to execute 

poly1 = LinearRegression()

poly1.fit(x_train_pr1,y_train)

## LinearRegression()

Question #4e):

Use the method “predict” to predict an output on the polynomial features, then use the function “DistributionPlot” to display the distribution of the predicted test output vs. the actual test data.

# Write your code below and press Shift+Enter to execute 

yhat_test1 = poly1.predict(x_test_pr1)

Title='Distribution  Plot of  Predicted Value Using Test Data vs Data Distribution of Test Data'

DistributionPlot(y_test, yhat_test1, "Actual Test Values", "Predicted Test Values", Title)

## C:\Users\USER\ANACON~1\lib\site-packages\seaborn\distributions.py:2619: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `kdeplot` (an axes-level function for kernel density plots).
##   warnings.warn(msg, FutureWarning)
## C:\Users\USER\ANACON~1\lib\site-packages\seaborn\distributions.py:2619: FutureWarning: `distplot` is a deprecated function and will be removed in a future version. Please adapt your code to use either `displot` (a figure-level function with similar flexibility) or `kdeplot` (an axes-level function for kernel density plots).
##   warnings.warn(msg, FutureWarning)

Question #4f):

Using the distribution plot above, describe (in words) the two regions where the predicted prices are less accurate than the actual prices.

# Write your code below and press Shift+Enter to execute 

# Para un precio de 10K los "Predicted Test Values" son mayores que los "Actual Test Values" y para el rango de precios de 30k a 40k ésta diferencia se invierte siendo mayores los "Actual Test Values".

Part 3: Ridge Regression

In this section, we will review Ridge Regression and see how the parameter alpha changes the model. Just a note, here our test data will be used as validation data.

Let’s perform a degree two polynomial transformation on our data.

pr=PolynomialFeatures(degree=2)

x_train_pr=pr.fit_transform(x_train[['horsepower', 'curb-weight', 'engine-size', 'highway-mpg','normalized-losses','symboling']])
x_test_pr=pr.fit_transform(x_test[['horsepower', 'curb-weight', 'engine-size', 'highway-mpg','normalized-losses','symboling']])

Let’s import Ridge from the module linear models.

from sklearn.linear_model import Ridge

Let’s create a Ridge regression object, setting the regularization parameter (alpha) to 0.1

RigeModel=Ridge(alpha=1)

Like regular regression, you can fit the model using the method fit.

RigeModel.fit(x_train_pr, y_train)

## Ridge(alpha=1)

Similarly, you can obtain a prediction:

yhat = RigeModel.predict(x_test_pr)

Let’s compare the first five predicted samples to our test set:

print('predicted:', yhat[0:4])

## predicted: [ 6570.82441941  9636.24891471 20949.92322737 19403.60313255]

print('test set :', y_test[0:4].values)

## test set : [ 6295. 10698. 13860. 13499.]

We select the value of alpha that minimizes the test error. To do so, we can use a for loop. We have also created a progress bar to see how many iterations we have completed so far.

from tqdm import tqdm

Rsqu_test = []
Rsqu_train = []
dummy1 = []
Alpha = 10 * np.array(range(0,1000))
pbar = tqdm(Alpha)

## 
  0%|          | 0/1000 [00:00<?, ?it/s]

for alpha in pbar:
    RigeModel = Ridge(alpha=alpha) 
    RigeModel.fit(x_train_pr, y_train)
    test_score, train_score = RigeModel.score(x_test_pr, y_test), RigeModel.score(x_train_pr, y_train)
    pbar.set_postfix({"Test Score": test_score, "Train Score": train_score})
    Rsqu_test.append(test_score)
    Rsqu_train.append(train_score)
    

## Ridge(alpha=0)
## Ridge(alpha=10)
## Ridge(alpha=20)
## Ridge(alpha=30)
## Ridge(alpha=40)
## Ridge(alpha=50)
## Ridge(alpha=60)
## Ridge(alpha=70)
## Ridge(alpha=80)
## Ridge(alpha=90)
## Ridge(alpha=100)
## Ridge(alpha=110)
## Ridge(alpha=120)
## Ridge(alpha=130)
## Ridge(alpha=140)
## Ridge(alpha=150)
## Ridge(alpha=160)
## Ridge(alpha=170)
## Ridge(alpha=180)
## Ridge(alpha=190)
## Ridge(alpha=200)
## Ridge(alpha=210)
## Ridge(alpha=220)
## Ridge(alpha=230)
## Ridge(alpha=240)
## Ridge(alpha=250)
## Ridge(alpha=260)
## Ridge(alpha=270)
## Ridge(alpha=280)
## Ridge(alpha=290)
## Ridge(alpha=300)
## Ridge(alpha=310)
## Ridge(alpha=320)
## Ridge(alpha=330)
## Ridge(alpha=340)
## Ridge(alpha=350)
## Ridge(alpha=360)
## Ridge(alpha=370)
## Ridge(alpha=380)
## Ridge(alpha=390)
## Ridge(alpha=400)
## Ridge(alpha=410)
## Ridge(alpha=420)
## Ridge(alpha=430)
## Ridge(alpha=440)
## Ridge(alpha=450)
## Ridge(alpha=460)
## Ridge(alpha=470)
## Ridge(alpha=480)
## Ridge(alpha=490)
## Ridge(alpha=500)
## Ridge(alpha=510)
## Ridge(alpha=520)
## Ridge(alpha=530)
## Ridge(alpha=540)
## Ridge(alpha=550)
## Ridge(alpha=560)
## Ridge(alpha=570)
## Ridge(alpha=580)
## Ridge(alpha=590)
## Ridge(alpha=600)
## Ridge(alpha=610)
## Ridge(alpha=620)
## Ridge(alpha=630)
## Ridge(alpha=640)
## Ridge(alpha=650)
## Ridge(alpha=660)
## Ridge(alpha=670)
## Ridge(alpha=680)
## Ridge(alpha=690)
## Ridge(alpha=700)
## Ridge(alpha=710)
## Ridge(alpha=720)
## Ridge(alpha=730)
## Ridge(alpha=740)
## Ridge(alpha=750)
## Ridge(alpha=760)
## Ridge(alpha=770)
## Ridge(alpha=780)
## Ridge(alpha=790)
## Ridge(alpha=800)
## Ridge(alpha=810)
## Ridge(alpha=820)
## Ridge(alpha=830)
## Ridge(alpha=840)
## Ridge(alpha=850)
## Ridge(alpha=860)
## Ridge(alpha=870)
## Ridge(alpha=880)
## Ridge(alpha=890)
## Ridge(alpha=900)
## Ridge(alpha=910)
## Ridge(alpha=920)
## Ridge(alpha=930)
## Ridge(alpha=940)
## Ridge(alpha=950)
## Ridge(alpha=960)
## Ridge(alpha=970)
## Ridge(alpha=980)
## Ridge(alpha=990)
## Ridge(alpha=1000)
## Ridge(alpha=1010)
## Ridge(alpha=1020)
## Ridge(alpha=1030)
## Ridge(alpha=1040)
## Ridge(alpha=1050)
## Ridge(alpha=1060)
## Ridge(alpha=1070)
## Ridge(alpha=1080)
## Ridge(alpha=1090)
## Ridge(alpha=1100)
## Ridge(alpha=1110)
## Ridge(alpha=1120)
## Ridge(alpha=1130)
## Ridge(alpha=1140)
## Ridge(alpha=1150)
## Ridge(alpha=1160)
## Ridge(alpha=1170)
## Ridge(alpha=1180)
## Ridge(alpha=1190)
## Ridge(alpha=1200)
## Ridge(alpha=1210)
## Ridge(alpha=1220)
## Ridge(alpha=1230)
## Ridge(alpha=1240)
## Ridge(alpha=1250)
## Ridge(alpha=1260)
## Ridge(alpha=1270)
## Ridge(alpha=1280)
## Ridge(alpha=1290)
## Ridge(alpha=1300)
## Ridge(alpha=1310)
## Ridge(alpha=1320)
## Ridge(alpha=1330)
## Ridge(alpha=1340)
## Ridge(alpha=1350)
## Ridge(alpha=1360)
## Ridge(alpha=1370)
## Ridge(alpha=1380)
## Ridge(alpha=1390)
## Ridge(alpha=1400)
## Ridge(alpha=1410)
## Ridge(alpha=1420)
## Ridge(alpha=1430)
## Ridge(alpha=1440)
## Ridge(alpha=1450)
## Ridge(alpha=1460)
## Ridge(alpha=1470)
## Ridge(alpha=1480)
## Ridge(alpha=1490)
## Ridge(alpha=1500)
## Ridge(alpha=1510)
## Ridge(alpha=1520)
## Ridge(alpha=1530)
## Ridge(alpha=1540)
## Ridge(alpha=1550)
## Ridge(alpha=1560)
## Ridge(alpha=1570)
## Ridge(alpha=1580)
## Ridge(alpha=1590)
## Ridge(alpha=1600)
## Ridge(alpha=1610)
## Ridge(alpha=1620)
## Ridge(alpha=1630)
## Ridge(alpha=1640)
## Ridge(alpha=1650)
## Ridge(alpha=1660)
## Ridge(alpha=1670)
## Ridge(alpha=1680)
## Ridge(alpha=1690)
## Ridge(alpha=1700)
## Ridge(alpha=1710)
## Ridge(alpha=1720)
## Ridge(alpha=1730)
## Ridge(alpha=1740)
## Ridge(alpha=1750)
## Ridge(alpha=1760)
## Ridge(alpha=1770)
## Ridge(alpha=1780)
## Ridge(alpha=1790)
## Ridge(alpha=1800)
## Ridge(alpha=1810)
## Ridge(alpha=1820)
## Ridge(alpha=1830)
## Ridge(alpha=1840)
## Ridge(alpha=1850)
## Ridge(alpha=1860)
## Ridge(alpha=1870)
## Ridge(alpha=1880)
## Ridge(alpha=1890)
## Ridge(alpha=1900)
## Ridge(alpha=1910)
## Ridge(alpha=1920)
## Ridge(alpha=1930)
## Ridge(alpha=1940)
## Ridge(alpha=1950)
## Ridge(alpha=1960)
## Ridge(alpha=1970)
## Ridge(alpha=1980)
## Ridge(alpha=1990)
## Ridge(alpha=2000)
## Ridge(alpha=2010)
## Ridge(alpha=2020)
## Ridge(alpha=2030)
## Ridge(alpha=2040)
## Ridge(alpha=2050)
## Ridge(alpha=2060)
## Ridge(alpha=2070)
## Ridge(alpha=2080)
## Ridge(alpha=2090)
## Ridge(alpha=2100)
## Ridge(alpha=2110)
## Ridge(alpha=2120)
## Ridge(alpha=2130)
## Ridge(alpha=2140)
## Ridge(alpha=2150)
## Ridge(alpha=2160)
## Ridge(alpha=2170)
## Ridge(alpha=2180)
## Ridge(alpha=2190)
## Ridge(alpha=2200)
## Ridge(alpha=2210)
## Ridge(alpha=2220)
## Ridge(alpha=2230)
## Ridge(alpha=2240)
## Ridge(alpha=2250)
## Ridge(alpha=2260)
## Ridge(alpha=2270)
## Ridge(alpha=2280)
## Ridge(alpha=2290)
## Ridge(alpha=2300)
## Ridge(alpha=2310)
## Ridge(alpha=2320)
## Ridge(alpha=2330)
## Ridge(alpha=2340)
## Ridge(alpha=2350)
## Ridge(alpha=2360)
## Ridge(alpha=2370)
## Ridge(alpha=2380)
## Ridge(alpha=2390)
## Ridge(alpha=2400)
## Ridge(alpha=2410)
## Ridge(alpha=2420)
## Ridge(alpha=2430)
## Ridge(alpha=2440)
## Ridge(alpha=2450)
## Ridge(alpha=2460)
## Ridge(alpha=2470)
## Ridge(alpha=2480)
## Ridge(alpha=2490)
## Ridge(alpha=2500)
## Ridge(alpha=2510)
## Ridge(alpha=2520)
## Ridge(alpha=2530)
## Ridge(alpha=2540)
## Ridge(alpha=2550)
## Ridge(alpha=2560)
## Ridge(alpha=2570)
## Ridge(alpha=2580)
## Ridge(alpha=2590)
## Ridge(alpha=2600)
## Ridge(alpha=2610)
## Ridge(alpha=2620)
## Ridge(alpha=2630)
## Ridge(alpha=2640)
## Ridge(alpha=2650)
## Ridge(alpha=2660)
## Ridge(alpha=2670)
## Ridge(alpha=2680)
## Ridge(alpha=2690)
## Ridge(alpha=2700)
## Ridge(alpha=2710)
## Ridge(alpha=2720)
## Ridge(alpha=2730)
## Ridge(alpha=2740)
## Ridge(alpha=2750)
## Ridge(alpha=2760)
## Ridge(alpha=2770)
## Ridge(alpha=2780)
## Ridge(alpha=2790)
## Ridge(alpha=2800)
## Ridge(alpha=2810)
## Ridge(alpha=2820)
## Ridge(alpha=2830)
## Ridge(alpha=2840)
## Ridge(alpha=2850)
## Ridge(alpha=2860)
## Ridge(alpha=2870)
## Ridge(alpha=2880)
## Ridge(alpha=2890)
## Ridge(alpha=2900)
## Ridge(alpha=2910)
## Ridge(alpha=2920)
## Ridge(alpha=2930)
## Ridge(alpha=2940)
## Ridge(alpha=2950)
## Ridge(alpha=2960)
## Ridge(alpha=2970)
## Ridge(alpha=2980)
## Ridge(alpha=2990)
## Ridge(alpha=3000)
## Ridge(alpha=3010)
## Ridge(alpha=3020)
## Ridge(alpha=3030)
## Ridge(alpha=3040)
## Ridge(alpha=3050)
## Ridge(alpha=3060)
## Ridge(alpha=3070)
## Ridge(alpha=3080)
## Ridge(alpha=3090)
## Ridge(alpha=3100)
## Ridge(alpha=3110)
## Ridge(alpha=3120)
## Ridge(alpha=3130)
## Ridge(alpha=3140)
## Ridge(alpha=3150)
## Ridge(alpha=3160)
## Ridge(alpha=3170)
## Ridge(alpha=3180)
## Ridge(alpha=3190)
## Ridge(alpha=3200)
## Ridge(alpha=3210)
## Ridge(alpha=3220)
## Ridge(alpha=3230)
## Ridge(alpha=3240)
## Ridge(alpha=3250)
## Ridge(alpha=3260)
## Ridge(alpha=3270)
## Ridge(alpha=3280)
## Ridge(alpha=3290)
## Ridge(alpha=3300)
## Ridge(alpha=3310)
## Ridge(alpha=3320)
## Ridge(alpha=3330)
## Ridge(alpha=3340)
## Ridge(alpha=3350)
## Ridge(alpha=3360)
## Ridge(alpha=3370)
## Ridge(alpha=3380)
## Ridge(alpha=3390)
## Ridge(alpha=3400)
## Ridge(alpha=3410)
## Ridge(alpha=3420)
## Ridge(alpha=3430)
## Ridge(alpha=3440)
## Ridge(alpha=3450)
## Ridge(alpha=3460)
## Ridge(alpha=3470)
## Ridge(alpha=3480)
## Ridge(alpha=3490)
## Ridge(alpha=3500)
## Ridge(alpha=3510)
## Ridge(alpha=3520)
## Ridge(alpha=3530)
## Ridge(alpha=3540)
## Ridge(alpha=3550)
## Ridge(alpha=3560)
## Ridge(alpha=3570)
## Ridge(alpha=3580)
## Ridge(alpha=3590)
## Ridge(alpha=3600)
## Ridge(alpha=3610)
## Ridge(alpha=3620)
## Ridge(alpha=3630)
## Ridge(alpha=3640)
## Ridge(alpha=3650)
## Ridge(alpha=3660)
## Ridge(alpha=3670)
## Ridge(alpha=3680)
## Ridge(alpha=3690)
## Ridge(alpha=3700)
## Ridge(alpha=3710)
## Ridge(alpha=3720)
## Ridge(alpha=3730)
## Ridge(alpha=3740)
## Ridge(alpha=3750)
## Ridge(alpha=3760)
## Ridge(alpha=3770)
## Ridge(alpha=3780)
## Ridge(alpha=3790)
## Ridge(alpha=3800)
## Ridge(alpha=3810)
## Ridge(alpha=3820)
## Ridge(alpha=3830)
## Ridge(alpha=3840)
## Ridge(alpha=3850)
## Ridge(alpha=3860)
## Ridge(alpha=3870)
## Ridge(alpha=3880)
## Ridge(alpha=3890)
## Ridge(alpha=3900)
## Ridge(alpha=3910)
## Ridge(alpha=3920)
## Ridge(alpha=3930)
## Ridge(alpha=3940)
## Ridge(alpha=3950)
## Ridge(alpha=3960)
## Ridge(alpha=3970)
## Ridge(alpha=3980)
## Ridge(alpha=3990)
## Ridge(alpha=4000)
## Ridge(alpha=4010)
## Ridge(alpha=4020)
## Ridge(alpha=4030)
## Ridge(alpha=4040)
## Ridge(alpha=4050)
## Ridge(alpha=4060)
## Ridge(alpha=4070)
## Ridge(alpha=4080)
## Ridge(alpha=4090)
## Ridge(alpha=4100)
## Ridge(alpha=4110)
## Ridge(alpha=4120)
## Ridge(alpha=4130)
## Ridge(alpha=4140)
## Ridge(alpha=4150)
## Ridge(alpha=4160)
## Ridge(alpha=4170)
## Ridge(alpha=4180)
## Ridge(alpha=4190)
## Ridge(alpha=4200)
## Ridge(alpha=4210)
## Ridge(alpha=4220)
## Ridge(alpha=4230)
## Ridge(alpha=4240)
## Ridge(alpha=4250)
## Ridge(alpha=4260)
## Ridge(alpha=4270)
## Ridge(alpha=4280)
## Ridge(alpha=4290)
## Ridge(alpha=4300)
## Ridge(alpha=4310)
## Ridge(alpha=4320)
## Ridge(alpha=4330)
## Ridge(alpha=4340)
## Ridge(alpha=4350)
## Ridge(alpha=4360)
## Ridge(alpha=4370)
## Ridge(alpha=4380)
## Ridge(alpha=4390)
## Ridge(alpha=4400)
## Ridge(alpha=4410)
## Ridge(alpha=4420)
## Ridge(alpha=4430)
## Ridge(alpha=4440)
## Ridge(alpha=4450)
## Ridge(alpha=4460)
## Ridge(alpha=4470)
## Ridge(alpha=4480)
## Ridge(alpha=4490)
## Ridge(alpha=4500)
## Ridge(alpha=4510)
## Ridge(alpha=4520)
## Ridge(alpha=4530)
## Ridge(alpha=4540)
## Ridge(alpha=4550)
## Ridge(alpha=4560)
## Ridge(alpha=4570)
## Ridge(alpha=4580)
## Ridge(alpha=4590)
## Ridge(alpha=4600)
## Ridge(alpha=4610)
## Ridge(alpha=4620)
## Ridge(alpha=4630)
## Ridge(alpha=4640)
## Ridge(alpha=4650)
## Ridge(alpha=4660)
## Ridge(alpha=4670)
## Ridge(alpha=4680)
## Ridge(alpha=4690)
## Ridge(alpha=4700)
## Ridge(alpha=4710)
## Ridge(alpha=4720)
## Ridge(alpha=4730)
## Ridge(alpha=4740)
## Ridge(alpha=4750)
## Ridge(alpha=4760)
## Ridge(alpha=4770)
## Ridge(alpha=4780)
## Ridge(alpha=4790)
## Ridge(alpha=4800)
## Ridge(alpha=4810)
## Ridge(alpha=4820)
## Ridge(alpha=4830)
## Ridge(alpha=4840)
## Ridge(alpha=4850)
## Ridge(alpha=4860)
## Ridge(alpha=4870)
## Ridge(alpha=4880)
## Ridge(alpha=4890)
## Ridge(alpha=4900)
## Ridge(alpha=4910)
## Ridge(alpha=4920)
## Ridge(alpha=4930)
## Ridge(alpha=4940)
## Ridge(alpha=4950)
## Ridge(alpha=4960)
## Ridge(alpha=4970)
## Ridge(alpha=4980)
## Ridge(alpha=4990)
## Ridge(alpha=5000)
## Ridge(alpha=5010)
## Ridge(alpha=5020)
## Ridge(alpha=5030)
## Ridge(alpha=5040)
## Ridge(alpha=5050)
## Ridge(alpha=5060)
## Ridge(alpha=5070)
## Ridge(alpha=5080)
## Ridge(alpha=5090)
## Ridge(alpha=5100)
## Ridge(alpha=5110)
## Ridge(alpha=5120)
## Ridge(alpha=5130)
## Ridge(alpha=5140)
## Ridge(alpha=5150)
## Ridge(alpha=5160)
## Ridge(alpha=5170)
## Ridge(alpha=5180)
## Ridge(alpha=5190)
## Ridge(alpha=5200)
## Ridge(alpha=5210)
## Ridge(alpha=5220)
## Ridge(alpha=5230)
## Ridge(alpha=5240)
## Ridge(alpha=5250)
## Ridge(alpha=5260)
## Ridge(alpha=5270)
## Ridge(alpha=5280)
## Ridge(alpha=5290)
## Ridge(alpha=5300)
## Ridge(alpha=5310)
## Ridge(alpha=5320)
## Ridge(alpha=5330)
## Ridge(alpha=5340)
## Ridge(alpha=5350)
## Ridge(alpha=5360)
## Ridge(alpha=5370)
## Ridge(alpha=5380)
## Ridge(alpha=5390)
## Ridge(alpha=5400)
## Ridge(alpha=5410)
## Ridge(alpha=5420)
## Ridge(alpha=5430)
## Ridge(alpha=5440)
## Ridge(alpha=5450)
## Ridge(alpha=5460)
## Ridge(alpha=5470)
## Ridge(alpha=5480)
## Ridge(alpha=5490)
## Ridge(alpha=5500)
## Ridge(alpha=5510)
## Ridge(alpha=5520)
## Ridge(alpha=5530)
## Ridge(alpha=5540)
## Ridge(alpha=5550)
## Ridge(alpha=5560)
## Ridge(alpha=5570)
## Ridge(alpha=5580)
## Ridge(alpha=5590)
## Ridge(alpha=5600)
## Ridge(alpha=5610)
## Ridge(alpha=5620)
## Ridge(alpha=5630)
## Ridge(alpha=5640)
## Ridge(alpha=5650)
## Ridge(alpha=5660)
## Ridge(alpha=5670)
## Ridge(alpha=5680)
## Ridge(alpha=5690)
## Ridge(alpha=5700)
## Ridge(alpha=5710)
## Ridge(alpha=5720)
## Ridge(alpha=5730)
## Ridge(alpha=5740)
## Ridge(alpha=5750)
## Ridge(alpha=5760)
## Ridge(alpha=5770)
## Ridge(alpha=5780)
## Ridge(alpha=5790)
## Ridge(alpha=5800)
## Ridge(alpha=5810)
## Ridge(alpha=5820)
## Ridge(alpha=5830)
## Ridge(alpha=5840)
## Ridge(alpha=5850)
## Ridge(alpha=5860)
## Ridge(alpha=5870)
## Ridge(alpha=5880)
## Ridge(alpha=5890)
## Ridge(alpha=5900)
## Ridge(alpha=5910)
## Ridge(alpha=5920)
## Ridge(alpha=5930)
## Ridge(alpha=5940)
## Ridge(alpha=5950)
## Ridge(alpha=5960)
## Ridge(alpha=5970)
## Ridge(alpha=5980)
## Ridge(alpha=5990)
## Ridge(alpha=6000)
## Ridge(alpha=6010)
## Ridge(alpha=6020)
## Ridge(alpha=6030)
## Ridge(alpha=6040)
## Ridge(alpha=6050)
## Ridge(alpha=6060)
## Ridge(alpha=6070)
## Ridge(alpha=6080)
## Ridge(alpha=6090)
## Ridge(alpha=6100)
## Ridge(alpha=6110)
## Ridge(alpha=6120)
## Ridge(alpha=6130)
## Ridge(alpha=6140)
## Ridge(alpha=6150)
## Ridge(alpha=6160)
## Ridge(alpha=6170)
## Ridge(alpha=6180)
## Ridge(alpha=6190)
## Ridge(alpha=6200)
## Ridge(alpha=6210)
## Ridge(alpha=6220)
## Ridge(alpha=6230)
## Ridge(alpha=6240)
## Ridge(alpha=6250)
## Ridge(alpha=6260)
## Ridge(alpha=6270)
## Ridge(alpha=6280)
## Ridge(alpha=6290)
## Ridge(alpha=6300)
## Ridge(alpha=6310)
## Ridge(alpha=6320)
## Ridge(alpha=6330)
## Ridge(alpha=6340)
## Ridge(alpha=6350)
## Ridge(alpha=6360)
## Ridge(alpha=6370)
## Ridge(alpha=6380)
## Ridge(alpha=6390)
## Ridge(alpha=6400)
## Ridge(alpha=6410)
## Ridge(alpha=6420)
## Ridge(alpha=6430)
## Ridge(alpha=6440)
## Ridge(alpha=6450)
## Ridge(alpha=6460)
## Ridge(alpha=6470)
## Ridge(alpha=6480)
## Ridge(alpha=6490)
## Ridge(alpha=6500)
## Ridge(alpha=6510)
## Ridge(alpha=6520)
## Ridge(alpha=6530)
## Ridge(alpha=6540)
## Ridge(alpha=6550)
## Ridge(alpha=6560)
## Ridge(alpha=6570)
## Ridge(alpha=6580)
## Ridge(alpha=6590)
## Ridge(alpha=6600)
## Ridge(alpha=6610)
## Ridge(alpha=6620)
## Ridge(alpha=6630)
## Ridge(alpha=6640)
## Ridge(alpha=6650)
## Ridge(alpha=6660)
## Ridge(alpha=6670)
## Ridge(alpha=6680)
## Ridge(alpha=6690)
## Ridge(alpha=6700)
## Ridge(alpha=6710)
## Ridge(alpha=6720)
## Ridge(alpha=6730)
## Ridge(alpha=6740)
## Ridge(alpha=6750)
## Ridge(alpha=6760)
## Ridge(alpha=6770)
## Ridge(alpha=6780)
## Ridge(alpha=6790)
## Ridge(alpha=6800)
## Ridge(alpha=6810)
## Ridge(alpha=6820)
## Ridge(alpha=6830)
## Ridge(alpha=6840)
## Ridge(alpha=6850)
## Ridge(alpha=6860)
## Ridge(alpha=6870)
## Ridge(alpha=6880)
## Ridge(alpha=6890)
## Ridge(alpha=6900)
## Ridge(alpha=6910)
## Ridge(alpha=6920)
## Ridge(alpha=6930)
## Ridge(alpha=6940)
## Ridge(alpha=6950)
## Ridge(alpha=6960)
## Ridge(alpha=6970)
## Ridge(alpha=6980)
## Ridge(alpha=6990)
## Ridge(alpha=7000)
## Ridge(alpha=7010)
## Ridge(alpha=7020)
## Ridge(alpha=7030)
## Ridge(alpha=7040)
## Ridge(alpha=7050)
## Ridge(alpha=7060)
## Ridge(alpha=7070)
## Ridge(alpha=7080)
## Ridge(alpha=7090)
## Ridge(alpha=7100)
## Ridge(alpha=7110)
## Ridge(alpha=7120)
## Ridge(alpha=7130)
## Ridge(alpha=7140)
## Ridge(alpha=7150)
## Ridge(alpha=7160)
## Ridge(alpha=7170)
## Ridge(alpha=7180)
## Ridge(alpha=7190)
## Ridge(alpha=7200)
## Ridge(alpha=7210)
## Ridge(alpha=7220)
## Ridge(alpha=7230)
## Ridge(alpha=7240)
## Ridge(alpha=7250)
## Ridge(alpha=7260)
## Ridge(alpha=7270)
## Ridge(alpha=7280)
## Ridge(alpha=7290)
## Ridge(alpha=7300)
## Ridge(alpha=7310)
## Ridge(alpha=7320)
## Ridge(alpha=7330)
## Ridge(alpha=7340)
## Ridge(alpha=7350)
## Ridge(alpha=7360)
## Ridge(alpha=7370)
## Ridge(alpha=7380)
## Ridge(alpha=7390)
## Ridge(alpha=7400)
## Ridge(alpha=7410)
## Ridge(alpha=7420)
## Ridge(alpha=7430)
## Ridge(alpha=7440)
## Ridge(alpha=7450)
## Ridge(alpha=7460)
## Ridge(alpha=7470)
## Ridge(alpha=7480)
## Ridge(alpha=7490)
## Ridge(alpha=7500)
## Ridge(alpha=7510)
## Ridge(alpha=7520)
## Ridge(alpha=7530)
## Ridge(alpha=7540)
## Ridge(alpha=7550)
## Ridge(alpha=7560)
## Ridge(alpha=7570)
## Ridge(alpha=7580)
## Ridge(alpha=7590)
## Ridge(alpha=7600)
## Ridge(alpha=7610)
## Ridge(alpha=7620)
## Ridge(alpha=7630)
## Ridge(alpha=7640)
## Ridge(alpha=7650)
## Ridge(alpha=7660)
## Ridge(alpha=7670)
## Ridge(alpha=7680)
## Ridge(alpha=7690)
## Ridge(alpha=7700)
## Ridge(alpha=7710)
## Ridge(alpha=7720)
## Ridge(alpha=7730)
## Ridge(alpha=7740)
## Ridge(alpha=7750)
## Ridge(alpha=7760)
## Ridge(alpha=7770)
## Ridge(alpha=7780)
## Ridge(alpha=7790)
## Ridge(alpha=7800)
## Ridge(alpha=7810)
## Ridge(alpha=7820)
## Ridge(alpha=7830)
## Ridge(alpha=7840)
## Ridge(alpha=7850)
## Ridge(alpha=7860)
## Ridge(alpha=7870)
## Ridge(alpha=7880)
## Ridge(alpha=7890)
## Ridge(alpha=7900)
## Ridge(alpha=7910)
## Ridge(alpha=7920)
## Ridge(alpha=7930)
## Ridge(alpha=7940)
## Ridge(alpha=7950)
## Ridge(alpha=7960)
## Ridge(alpha=7970)
## Ridge(alpha=7980)
## Ridge(alpha=7990)
## Ridge(alpha=8000)
## Ridge(alpha=8010)
## Ridge(alpha=8020)
## Ridge(alpha=8030)
## Ridge(alpha=8040)
## Ridge(alpha=8050)
## Ridge(alpha=8060)
## Ridge(alpha=8070)
## Ridge(alpha=8080)
## Ridge(alpha=8090)
## Ridge(alpha=8100)
## Ridge(alpha=8110)
## Ridge(alpha=8120)
## Ridge(alpha=8130)
## Ridge(alpha=8140)
## Ridge(alpha=8150)
## Ridge(alpha=8160)
## Ridge(alpha=8170)
## Ridge(alpha=8180)
## Ridge(alpha=8190)
## Ridge(alpha=8200)
## Ridge(alpha=8210)
## Ridge(alpha=8220)
## Ridge(alpha=8230)
## Ridge(alpha=8240)
## Ridge(alpha=8250)
## Ridge(alpha=8260)
## Ridge(alpha=8270)
## Ridge(alpha=8280)
## Ridge(alpha=8290)
## Ridge(alpha=8300)
## Ridge(alpha=8310)
## Ridge(alpha=8320)
## Ridge(alpha=8330)
## Ridge(alpha=8340)
## Ridge(alpha=8350)
## Ridge(alpha=8360)
## Ridge(alpha=8370)
## Ridge(alpha=8380)
## Ridge(alpha=8390)
## Ridge(alpha=8400)
## Ridge(alpha=8410)
## Ridge(alpha=8420)
## Ridge(alpha=8430)
## Ridge(alpha=8440)
## Ridge(alpha=8450)
## Ridge(alpha=8460)
## Ridge(alpha=8470)
## Ridge(alpha=8480)
## Ridge(alpha=8490)
## Ridge(alpha=8500)
## Ridge(alpha=8510)
## Ridge(alpha=8520)
## Ridge(alpha=8530)
## Ridge(alpha=8540)
## Ridge(alpha=8550)
## Ridge(alpha=8560)
## Ridge(alpha=8570)
## Ridge(alpha=8580)
## Ridge(alpha=8590)
## Ridge(alpha=8600)
## Ridge(alpha=8610)
## Ridge(alpha=8620)
## Ridge(alpha=8630)
## Ridge(alpha=8640)
## Ridge(alpha=8650)
## Ridge(alpha=8660)
## Ridge(alpha=8670)
## Ridge(alpha=8680)
## Ridge(alpha=8690)
## Ridge(alpha=8700)
## Ridge(alpha=8710)
## Ridge(alpha=8720)
## Ridge(alpha=8730)
## Ridge(alpha=8740)
## Ridge(alpha=8750)
## Ridge(alpha=8760)
## Ridge(alpha=8770)
## Ridge(alpha=8780)
## Ridge(alpha=8790)
## Ridge(alpha=8800)
## Ridge(alpha=8810)
## Ridge(alpha=8820)
## Ridge(alpha=8830)
## Ridge(alpha=8840)
## Ridge(alpha=8850)
## Ridge(alpha=8860)
## Ridge(alpha=8870)
## Ridge(alpha=8880)
## Ridge(alpha=8890)
## Ridge(alpha=8900)
## Ridge(alpha=8910)
## Ridge(alpha=8920)
## Ridge(alpha=8930)
## Ridge(alpha=8940)
## Ridge(alpha=8950)
## Ridge(alpha=8960)
## Ridge(alpha=8970)
## Ridge(alpha=8980)
## Ridge(alpha=8990)
## Ridge(alpha=9000)
## Ridge(alpha=9010)
## Ridge(alpha=9020)
## Ridge(alpha=9030)
## Ridge(alpha=9040)
## Ridge(alpha=9050)
## Ridge(alpha=9060)
## Ridge(alpha=9070)
## Ridge(alpha=9080)
## Ridge(alpha=9090)
## Ridge(alpha=9100)
## Ridge(alpha=9110)
## Ridge(alpha=9120)
## Ridge(alpha=9130)
## Ridge(alpha=9140)
## Ridge(alpha=9150)
## Ridge(alpha=9160)
## Ridge(alpha=9170)
## Ridge(alpha=9180)
## Ridge(alpha=9190)
## Ridge(alpha=9200)
## Ridge(alpha=9210)
## Ridge(alpha=9220)
## Ridge(alpha=9230)
## Ridge(alpha=9240)
## Ridge(alpha=9250)
## Ridge(alpha=9260)
## Ridge(alpha=9270)
## Ridge(alpha=9280)
## Ridge(alpha=9290)
## Ridge(alpha=9300)
## Ridge(alpha=9310)
## Ridge(alpha=9320)
## Ridge(alpha=9330)
## Ridge(alpha=9340)
## Ridge(alpha=9350)
## Ridge(alpha=9360)
## Ridge(alpha=9370)
## Ridge(alpha=9380)
## Ridge(alpha=9390)
## Ridge(alpha=9400)
## Ridge(alpha=9410)
## Ridge(alpha=9420)
## Ridge(alpha=9430)
## Ridge(alpha=9440)
## Ridge(alpha=9450)
## Ridge(alpha=9460)
## Ridge(alpha=9470)
## Ridge(alpha=9480)
## Ridge(alpha=9490)
## Ridge(alpha=9500)
## Ridge(alpha=9510)
## Ridge(alpha=9520)
## Ridge(alpha=9530)
## Ridge(alpha=9540)
## Ridge(alpha=9550)
## Ridge(alpha=9560)
## Ridge(alpha=9570)
## Ridge(alpha=9580)
## Ridge(alpha=9590)
## Ridge(alpha=9600)
## Ridge(alpha=9610)
## Ridge(alpha=9620)
## Ridge(alpha=9630)
## Ridge(alpha=9640)
## Ridge(alpha=9650)
## Ridge(alpha=9660)
## Ridge(alpha=9670)
## Ridge(alpha=9680)
## Ridge(alpha=9690)
## Ridge(alpha=9700)
## Ridge(alpha=9710)
## Ridge(alpha=9720)
## Ridge(alpha=9730)
## Ridge(alpha=9740)
## Ridge(alpha=9750)
## Ridge(alpha=9760)
## Ridge(alpha=9770)
## Ridge(alpha=9780)
## Ridge(alpha=9790)
## Ridge(alpha=9800)
## Ridge(alpha=9810)
## Ridge(alpha=9820)
## Ridge(alpha=9830)
## Ridge(alpha=9840)
## Ridge(alpha=9850)
## Ridge(alpha=9860)
## Ridge(alpha=9870)
## Ridge(alpha=9880)
## Ridge(alpha=9890)
## Ridge(alpha=9900)
## Ridge(alpha=9910)
## Ridge(alpha=9920)
## Ridge(alpha=9930)
## Ridge(alpha=9940)
## Ridge(alpha=9950)
## Ridge(alpha=9960)
## Ridge(alpha=9970)
## Ridge(alpha=9980)
## Ridge(alpha=9990)
## 
## 
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.471, Train Score=0.854]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.542, Train Score=0.871]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.545, Train Score=0.87] 
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.547, Train Score=0.87]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.548, Train Score=0.869]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.548, Train Score=0.868]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.548, Train Score=0.868]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.548, Train Score=0.868]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.547, Train Score=0.867]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.547, Train Score=0.867]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.547, Train Score=0.867]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.547, Train Score=0.866]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.546, Train Score=0.866]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.546, Train Score=0.866]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.546, Train Score=0.866]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.545, Train Score=0.865]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.545, Train Score=0.865]
  0%|          | 0/1000 [00:00<?, ?it/s, Test Score=0.545, Train Score=0.865]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.545, Train Score=0.865]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.544, Train Score=0.865]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.544, Train Score=0.865]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.544, Train Score=0.865]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.543, Train Score=0.864]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.543, Train Score=0.864]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.543, Train Score=0.864]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.543, Train Score=0.864]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.543, Train Score=0.864]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.542, Train Score=0.864]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.542, Train Score=0.864]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.542, Train Score=0.864]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.542, Train Score=0.864]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.542, Train Score=0.863]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.542, Train Score=0.863]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.541, Train Score=0.863]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.541, Train Score=0.863]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.541, Train Score=0.863]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.541, Train Score=0.863]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.541, Train Score=0.863]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.541, Train Score=0.863]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.541, Train Score=0.863]
  2%|1         | 18/1000 [00:00<00:05, 178.69it/s, Test Score=0.541, Train Score=0.863]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.541, Train Score=0.863]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.541, Train Score=0.863]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.863] 
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.863]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.863]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.863]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.863]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.863]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.54, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.539, Train Score=0.862]
  4%|4         | 40/1000 [00:00<00:04, 200.88it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  6%|6         | 62/1000 [00:00<00:04, 208.86it/s, Test Score=0.539, Train Score=0.862]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.539, Train Score=0.862]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.539, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.539, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861] 
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
  9%|8         | 87/1000 [00:00<00:04, 224.36it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.54, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.541, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.541, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.541, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.541, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.541, Train Score=0.861]
 11%|#1        | 110/1000 [00:00<00:03, 225.79it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.541, Train Score=0.861]
 13%|#3        | 133/1000 [00:00<00:03, 224.39it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 16%|#5        | 156/1000 [00:00<00:04, 193.89it/s, Test Score=0.542, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.542, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.542, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.542, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.542, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.542, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 18%|#7        | 177/1000 [00:00<00:04, 191.56it/s, Test Score=0.543, Train Score=0.861]
 20%|##        | 201/1000 [00:00<00:03, 204.18it/s, Test Score=0.543, Train Score=0.861]
 20%|##        | 201/1000 [00:00<00:03, 204.18it/s, Test Score=0.543, Train Score=0.861]
 20%|##        | 201/1000 [00:00<00:03, 204.18it/s, Test Score=0.543, Train Score=0.861]
 20%|##        | 201/1000 [00:00<00:03, 204.18it/s, Test Score=0.543, Train Score=0.861]
 20%|##        | 201/1000 [00:00<00:03, 204.18it/s, Test Score=0.543, Train Score=0.861]
 20%|##        | 201/1000 [00:00<00:03, 204.18it/s, Test Score=0.543, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.543, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.861]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.86] 
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.86]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.86]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.86]
 20%|##        | 201/1000 [00:01<00:03, 204.18it/s, Test Score=0.544, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.544, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.544, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.544, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.544, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.544, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.544, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.544, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.544, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.544, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.544, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 22%|##2       | 224/1000 [00:01<00:03, 208.16it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.545, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.546, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.546, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.546, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.546, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.546, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.546, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.546, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.546, Train Score=0.86]
 25%|##4       | 247/1000 [00:01<00:03, 212.15it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.546, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.547, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.547, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.547, Train Score=0.86]
 27%|##6       | 269/1000 [00:01<00:03, 211.53it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 29%|##9       | 291/1000 [00:01<00:03, 199.21it/s, Test Score=0.547, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.547, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.547, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.547, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.547, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.547, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 31%|###1      | 312/1000 [00:01<00:03, 189.25it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.548, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.549, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.549, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.549, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.549, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.549, Train Score=0.86]
 33%|###3      | 332/1000 [00:01<00:03, 186.26it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 35%|###5      | 351/1000 [00:01<00:03, 166.57it/s, Test Score=0.549, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.549, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.549, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.549, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.549, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.549, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86] 
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 37%|###7      | 372/1000 [00:01<00:03, 177.41it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:01<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.55, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.551, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.551, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.551, Train Score=0.86]
 39%|###9      | 393/1000 [00:02<00:03, 185.79it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 41%|####1     | 412/1000 [00:02<00:03, 186.07it/s, Test Score=0.551, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.551, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.551, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.551, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.551, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.551, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.551, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.551, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.551, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.551, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.551, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.551, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.551, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.552, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.552, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.552, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.552, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.552, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.552, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.552, Train Score=0.86]
 43%|####3     | 431/1000 [00:02<00:03, 174.99it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 45%|####5     | 450/1000 [00:02<00:03, 177.77it/s, Test Score=0.552, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.552, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.552, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.552, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.552, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.552, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.552, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.552, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.552, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.552, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.553, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.553, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.553, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.553, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.553, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.553, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.553, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.553, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.553, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.553, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.553, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.553, Train Score=0.86]
 47%|####6     | 469/1000 [00:02<00:02, 177.37it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 49%|####9     | 490/1000 [00:02<00:02, 184.61it/s, Test Score=0.553, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.553, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.553, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.553, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.553, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.553, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 51%|#####     | 509/1000 [00:02<00:02, 176.75it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 53%|#####2    | 527/1000 [00:02<00:02, 166.24it/s, Test Score=0.554, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.554, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.554, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.554, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.554, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.554, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 55%|#####4    | 548/1000 [00:02<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 55%|#####4    | 548/1000 [00:03<00:02, 174.92it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 57%|#####6    | 566/1000 [00:03<00:02, 163.00it/s, Test Score=0.555, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.555, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.555, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.555, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.555, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.555, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.555, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.555, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.556, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.556, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.556, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.556, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.556, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.556, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.556, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.556, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.556, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.556, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.556, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.556, Train Score=0.86]
 59%|#####8    | 586/1000 [00:03<00:02, 172.54it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 60%|######    | 605/1000 [00:03<00:02, 175.07it/s, Test Score=0.556, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.556, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.556, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.556, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.556, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.556, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.556, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.556, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.556, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.556, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.556, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.556, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.557, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.557, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.557, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.557, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.557, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.557, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.557, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.557, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.557, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.557, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.557, Train Score=0.86]
 62%|######2   | 623/1000 [00:03<00:02, 162.51it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 64%|######4   | 645/1000 [00:03<00:02, 176.22it/s, Test Score=0.557, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.557, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.557, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.557, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.557, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.557, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.557, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.557, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.557, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.557, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.557, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.558, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.558, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.558, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.558, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.558, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.558, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.558, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.558, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.558, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.558, Train Score=0.86]
 67%|######6   | 668/1000 [00:03<00:01, 189.62it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 69%|######8   | 688/1000 [00:03<00:01, 183.91it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.558, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.559, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.559, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.559, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.559, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.559, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.559, Train Score=0.86]
 71%|#######1  | 710/1000 [00:03<00:01, 192.99it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 73%|#######3  | 730/1000 [00:03<00:01, 194.02it/s, Test Score=0.559, Train Score=0.86]
 75%|#######5  | 750/1000 [00:03<00:01, 191.50it/s, Test Score=0.559, Train Score=0.86]
 75%|#######5  | 750/1000 [00:03<00:01, 191.50it/s, Test Score=0.559, Train Score=0.86]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.86]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.86]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.86]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.86]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.86]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.86]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.86]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.86]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.859]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.859]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.859]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.859]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.859]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.859]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.859]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.859]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.859]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.859]
 75%|#######5  | 750/1000 [00:04<00:01, 191.50it/s, Test Score=0.559, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.559, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.559, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859] 
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 77%|#######7  | 770/1000 [00:04<00:01, 172.86it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 79%|#######9  | 790/1000 [00:04<00:01, 179.28it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.56, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.561, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.561, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.561, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.561, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.561, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.561, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.561, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.561, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.561, Train Score=0.859]
 81%|########  | 809/1000 [00:04<00:01, 168.05it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 83%|########3 | 831/1000 [00:04<00:00, 181.04it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 85%|########5 | 850/1000 [00:04<00:00, 173.20it/s, Test Score=0.561, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.561, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.561, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.561, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.561, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.561, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.561, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 87%|########6 | 868/1000 [00:04<00:00, 172.37it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 89%|########9 | 890/1000 [00:04<00:00, 183.61it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:04<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:05<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:05<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:05<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:05<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 91%|######### | 909/1000 [00:05<00:00, 174.78it/s, Test Score=0.562, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.562, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 93%|#########2| 927/1000 [00:05<00:00, 175.38it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 95%|#########4| 949/1000 [00:05<00:00, 187.51it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.563, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.564, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.564, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.564, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.564, Train Score=0.859]
 97%|#########6| 969/1000 [00:05<00:00, 189.60it/s, Test Score=0.564, Train Score=0.859]
 99%|#########8| 989/1000 [00:05<00:00, 171.53it/s, Test Score=0.564, Train Score=0.859]
 99%|#########8| 989/1000 [00:05<00:00, 171.53it/s, Test Score=0.564, Train Score=0.859]
 99%|#########8| 989/1000 [00:05<00:00, 171.53it/s, Test Score=0.564, Train Score=0.859]
 99%|#########8| 989/1000 [00:05<00:00, 171.53it/s, Test Score=0.564, Train Score=0.859]
 99%|#########8| 989/1000 [00:05<00:00, 171.53it/s, Test Score=0.564, Train Score=0.859]
 99%|#########8| 989/1000 [00:05<00:00, 171.53it/s, Test Score=0.564, Train Score=0.859]
 99%|#########8| 989/1000 [00:05<00:00, 171.53it/s, Test Score=0.564, Train Score=0.859]
 99%|#########8| 989/1000 [00:05<00:00, 171.53it/s, Test Score=0.564, Train Score=0.859]
 99%|#########8| 989/1000 [00:05<00:00, 171.53it/s, Test Score=0.564, Train Score=0.859]
 99%|#########8| 989/1000 [00:05<00:00, 171.53it/s, Test Score=0.564, Train Score=0.859]
 99%|#########8| 989/1000 [00:05<00:00, 171.53it/s, Test Score=0.564, Train Score=0.859]
 99%|#########8| 989/1000 [00:05<00:00, 171.53it/s, Test Score=0.564, Train Score=0.859]
100%|##########| 1000/1000 [00:05<00:00, 184.48it/s, Test Score=0.564, Train Score=0.859]

We can plot out the value of R^2 for different alphas:

width = 12
height = 10
plt.figure(figsize=(width, height))

plt.plot(Alpha, Rsqu_test, label='validation data  ')
plt.plot(Alpha, Rsqu_train, 'r', label='training Data ')

plt.xlabel('alpha')
plt.ylabel('R^2')
plt.legend()

plt.show()

Figure 4: The blue line represents the R^2 of the validation data, and the red line represents the R^2 of the training data. The x-axis represents the different values of Alpha.

Here the model is built and tested on the same data, so the training and test data are the same.

The red line in Figure 4 represents the R^2 of the training data. As alpha increases the R^2 decreases. Therefore, as alpha increases, the model performs worse on the training data

The blue line represents the R^2 on the validation data. As the value for alpha increases, the R^2 increases and converges at a point.

Question #5):

Perform Ridge regression. Calculate the R^2 using the polynomial features, use the training data to train the model and use the test data to test the model. The parameter alpha should be set to 10.

# Write your code below and press Shift+Enter to execute 

RigeModel = Ridge(alpha=10) 
RigeModel.fit(x_train_pr, y_train)

## Ridge(alpha=10)

RigeModel.score(x_test_pr, y_test)

## 0.5418576440207541

Part 4: Grid Search

The term alpha is a hyperparameter. Sklearn has the class GridSearchCV to make the process of finding the best hyperparameter simpler.

Let’s import GridSearchCV from the module model_selection.

from sklearn.model_selection import GridSearchCV

We create a dictionary of parameter values:

parameters1= [{'alpha': [0.001,0.1,1, 10, 100, 1000, 10000, 100000, 100000]}]

parameters1

## [{'alpha': [0.001, 0.1, 1, 10, 100, 1000, 10000, 100000, 100000]}]

Create a Ridge regression object:

RR=Ridge()

RR

## Ridge()

Create a ridge grid search object:

Grid1 = GridSearchCV(RR, parameters1,cv=4)

Fit the model:

Grid1.fit(x_data[['horsepower', 'curb-weight', 'engine-size', 'highway-mpg']], y_data)

## GridSearchCV(cv=4, estimator=Ridge(),
##              param_grid=[{'alpha': [0.001, 0.1, 1, 10, 100, 1000, 10000, 100000,
##                                     100000]}])

The object finds the best parameter values on the validation data. We can obtain the estimator with the best parameters and assign it to the variable BestRR as follows:

BestRR=Grid1.best_estimator_

BestRR

## Ridge(alpha=10000)

We now test our model on the test data:

BestRR.score(x_test[['horsepower', 'curb-weight', 'engine-size', 'highway-mpg']], y_test)

## 0.8411649831036149