使用LightGBM和GridSearchCV预测Titanic数据集

对于Titanic数据集预测的初次尝试，主要使用的是LightGBM和GridSearchCV。这两个参数都很多，对应的文档在https://lightgbm.readthedocs.io/en/latest/Experiments.html 和 https://lightgbm.cn/docs/6/#io以及https://scikit-learn.org/stable/modules/generated/sklearn.model_selection.GridSearchCV.html
常看常新吧，毕竟官方文档是最好的指导老师。

未来改进：可变学习速率；训练信息提取储存；Cabin信息充分利用；算法调参

import pandas as pd
import numpy as np
from xgboost import plot_importance
from matplotlib import pyplot as plt
from sklearn.model_selection import train_test_split
from sklearn.model_selection import StratifiedKFold
from sklearn.feature_extraction.text import TfidfVectorizer
from sklearn.metrics import roc_auc_score
from sklearn.preprocessing import LabelEncoder
from sklearn.preprocessing import OneHotEncoder
from sklearn.impute import SimpleImputer
import lightgbm as lgb
from sklearn.pipeline import Pipeline
from sklearn.compose import ColumnTransformer
from sklearn.model_selection import GridSearchCV
from sklearn.preprocessing import StandardScaler
from sklearn.metrics import roc_auc_score

dir=r'C:\Users\43480\Documents\python_work\Titanic'#写路径的时候，raw字符串可以用\，否则就需要用//。
train = pd.read_csv(dir+'//train.csv')
test = pd.read_csv(dir+'//test.csv')

cate_cols = ['Sex', 'Embarked']
no_feas = ['PassengerId','Survived','Ticket','Name','Cabin']#理论上说，Cabin还是有利用价值的，这里是第一次用，就没管。
num_cols=train.columns.drop(no_feas).drop(cate_cols)#.drop()可以在不改变原对象内容的情况下生成新的对象。
y_train=train['Survived']#.astype(int)#这里很迷，理论上应该完全不影响的，但是有的时候需要，有的时候就不需要。

两个imputer的strategy都是最频繁，数字属性这里确实可以考虑换成中位数

num_pipeline=Pipeline([
    ('imputer',SimpleImputer(missing_values=np.nan, strategy = 'most_frequent')),
    ('std_scaler',StandardScaler()),
])
cate_pipeline=Pipeline([
    ('imputer',SimpleImputer(missing_values=np.nan, strategy = 'most_frequent')),
    ('onehotencoder',OneHotEncoder()),
])

full_pipeline=ColumnTransformer([
    ('num', num_pipeline,num_cols),
    ('cate',cate_pipeline,cate_cols)
])
train_tr=full_pipeline.fit_transform(train)#train_tr即train_transformed
test_tr=full_pipeline.fit_transform(test)

查阅说明文档得知，bagging_fraction与subsample是同一个变量的不同名称，剩下三个的情况与此相同，之所以用一个不用另一个是因为用了就会不停地挑warning，原因不明。貌似就算数据集不平衡，开了is_unbalance也会导致预测结果变差，原因不明。

gsearch = GridSearchCV(gbm, params_grid, scoring=‘roc_auc’, cv=5,verbose=4,return_train_score=True)其中verbose>3才能够有详细的训练细节输出，return_train_score=True才能看到训练过程的得分，从而判断是否过拟合。
split0_train_score和split1_train_score是什么东西还没有搞懂。

从给出的score判断，现阶段模型处于过拟合状态（提交之后的得分也证实了这一点），解决过拟合需要调参，调参的基础是对于算法的深入理解，这也正是下一步的努力方向。

另外，未来很可能需要将 GridSearchCV的训练信息提取保存分析，出现需求的时候再说吧。

params = {
    "objective": "binary",
    "is_unbalance": True,
    "num_leaves": 50,
    "max_depth": -1,
    "learning_rate": 0.05,
    "subsample":0.8,#"bagging_fraction": 0.8,
    "colsample_bytree": 0.8,#"feature_fraction": 0.8,
    "subsample_freq":5,#"bagging_freq": 5,
    "bagging_seed": 42,
    "verbosity": -1,
    "min_child_samples":30,#"min_data_in_leaf":30,
    #"silent":False,#显示训练过程
    #"num_threads": 4  # 进程数 根据机器资源调整n_jobs
    #"n_jobs":-1#使用所有资源
}
params_grid={
    'learning_rate':[0.1,0.05],"num_leaves": [30,35],"subsample":[0.78,0.8,0.82],"colsample_bytree":[0.87,0.91,0.93],"min_child_samples":[10,20]
}

gbm = lgb.LGBMClassifier(**params)
gsearch = GridSearchCV(gbm, params_grid, scoring='roc_auc', cv=5,verbose=4,return_train_score=True)
gsearch.fit(train_tr, y_train)

#print("split0_train_score",gsearch.cv_results_['split0_train_score'])
#print("split1_train_score",gsearch.cv_results_['split1_train_score'])
for i in range(len(gsearch.cv_results_['params'])):
    print(gsearch.cv_results_['params'][i])
    print('\t')
    print('模型平均训练得分：{0}'.format(gsearch.cv_results_['mean_train_score'][i]))
    print('\t')
    print('模型平均测试得分：{0}'.format(gsearch.cv_results_['mean_test_score'][i]))
    print('\n')
print('参数的最佳取值:{0}'.format(gsearch.best_params_))
print('最佳模型得分:{0}'.format(gsearch.best_score_))

Fitting 5 folds for each of 72 candidates, totalling 360 fits
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.995, test=0.843), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.997, test=0.809), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.994, test=0.887), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 


[Parallel(n_jobs=1)]: Using backend SequentialBackend with 1 concurrent workers.
[Parallel(n_jobs=1)]: Done   1 out of   1 | elapsed:    0.0s remaining:    0.0s
[Parallel(n_jobs=1)]: Done   2 out of   2 | elapsed:    0.0s remaining:    0.0s
[Parallel(n_jobs=1)]: Done   3 out of   3 | elapsed:    0.1s remaining:    0.0s


[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.994, test=0.863), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.995, test=0.903), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.996, test=0.840), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.997, test=0.809), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.994, test=0.888), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.995, test=0.856), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.994, test=0.901), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.996, test=0.848), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.997, test=0.806), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.994, test=0.895), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.996, test=0.856), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.995, test=0.914), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.849), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.997, test=0.806), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.995, test=0.890), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.857), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.901), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.843), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.997, test=0.810), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.893), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.853), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.901), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.997, test=0.850), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.997, test=0.807), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.887), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.851), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.912), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.981, test=0.863), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.976, test=0.892), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.980, test=0.881), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.979, test=0.913), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.982, test=0.863), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.822), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.978, test=0.903), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.983, test=0.882), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.978, test=0.912), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.982, test=0.862), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.978, test=0.893), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.879), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.980, test=0.906), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.981, test=0.863), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.976, test=0.892), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.980, test=0.881), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.979, test=0.913), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.982, test=0.863), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.822), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.978, test=0.903), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.983, test=0.882), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.978, test=0.912), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.982, test=0.862), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.978, test=0.893), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.983, test=0.879), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.980, test=0.906), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.982, test=0.853), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.986, test=0.812), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.980, test=0.898), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.984, test=0.876), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.982, test=0.899), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.845), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.987, test=0.809), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.981, test=0.899), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.868), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.981, test=0.909), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.842), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.987, test=0.810), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.980, test=0.893), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.985, test=0.864), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.902), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.985, test=0.852), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.988, test=0.819), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.983, test=0.897), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.986, test=0.871), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.984, test=0.906), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.986, test=0.841), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.989, test=0.811), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.903), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.987, test=0.870), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.908), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.987, test=0.845), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.989, test=0.814), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.984, test=0.893), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.987, test=0.870), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.984, test=0.907), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.960, test=0.863), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.966, test=0.828), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.957, test=0.892), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.962, test=0.875), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.957, test=0.916), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.963, test=0.862), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.966, test=0.826), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.956, test=0.894), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.963, test=0.875), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.957, test=0.912), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.962, test=0.858), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.968, test=0.826), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.957, test=0.897), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.961, test=0.879), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.959, test=0.910), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.960, test=0.863), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.966, test=0.828), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.957, test=0.892), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.962, test=0.875), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.957, test=0.916), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.963, test=0.862), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.966, test=0.826), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.956, test=0.894), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.963, test=0.875), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.957, test=0.912), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.962, test=0.858), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.968, test=0.826), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.957, test=0.897), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.961, test=0.879), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.959, test=0.910), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.995, test=0.843), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.997, test=0.809), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.994, test=0.887), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.994, test=0.863), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.995, test=0.903), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.996, test=0.840), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.997, test=0.809), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.994, test=0.888), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.995, test=0.856), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.994, test=0.901), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.996, test=0.848), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.997, test=0.806), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.994, test=0.895), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.996, test=0.856), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.995, test=0.914), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.849), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.997, test=0.806), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.995, test=0.890), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.857), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.901), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.843), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.997, test=0.810), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.893), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.853), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.901), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.997, test=0.850), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.997, test=0.807), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.887), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.851), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.912), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.981, test=0.863), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.976, test=0.892), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.980, test=0.881), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.979, test=0.913), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.982, test=0.863), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.822), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.978, test=0.903), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.983, test=0.882), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.978, test=0.912), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.982, test=0.862), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.978, test=0.893), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.879), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.980, test=0.906), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.981, test=0.863), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.976, test=0.892), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.980, test=0.881), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.979, test=0.913), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.982, test=0.863), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.822), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.978, test=0.903), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.983, test=0.882), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.978, test=0.912), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.982, test=0.862), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.978, test=0.893), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.983, test=0.879), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.980, test=0.906), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.982, test=0.853), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.986, test=0.812), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.980, test=0.898), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.984, test=0.876), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.982, test=0.899), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.845), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.987, test=0.809), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.981, test=0.899), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.868), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.981, test=0.909), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.842), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.987, test=0.810), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.980, test=0.893), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.985, test=0.864), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.902), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.985, test=0.852), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.988, test=0.819), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.983, test=0.897), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.986, test=0.871), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.984, test=0.906), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.986, test=0.841), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.989, test=0.811), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.903), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.987, test=0.870), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.908), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.987, test=0.845), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.989, test=0.814), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.984, test=0.893), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.987, test=0.870), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.984, test=0.907), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.960, test=0.863), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.966, test=0.828), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.957, test=0.892), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.962, test=0.875), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.957, test=0.916), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.963, test=0.862), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.966, test=0.826), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.956, test=0.894), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.963, test=0.875), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.957, test=0.912), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.962, test=0.858), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.968, test=0.826), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.957, test=0.897), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.961, test=0.879), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.959, test=0.910), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.960, test=0.863), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.966, test=0.828), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.957, test=0.892), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.962, test=0.875), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.957, test=0.916), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.963, test=0.862), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.966, test=0.826), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.956, test=0.894), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.963, test=0.875), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.957, test=0.912), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.962, test=0.858), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.968, test=0.826), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.957, test=0.897), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.961, test=0.879), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.959, test=0.910), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.995, test=0.843), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.997, test=0.809), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.994, test=0.887), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.994, test=0.863), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.995, test=0.903), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.996, test=0.840), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.997, test=0.809), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.994, test=0.888), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.995, test=0.856), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.994, test=0.901), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.996, test=0.848), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.997, test=0.806), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.994, test=0.895), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.996, test=0.856), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.995, test=0.914), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.849), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.997, test=0.806), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.995, test=0.890), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.857), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.901), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.843), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.997, test=0.810), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.893), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.853), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.901), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.997, test=0.850), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.997, test=0.807), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.887), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.851), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.912), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.981, test=0.863), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.976, test=0.892), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.980, test=0.881), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.979, test=0.913), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.982, test=0.863), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.822), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.978, test=0.903), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.983, test=0.882), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.978, test=0.912), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.982, test=0.862), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.978, test=0.893), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.879), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.980, test=0.906), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.981, test=0.863), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.976, test=0.892), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.980, test=0.881), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.979, test=0.913), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.982, test=0.863), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.822), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.978, test=0.903), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.983, test=0.882), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.978, test=0.912), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.982, test=0.862), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.978, test=0.893), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.983, test=0.879), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.980, test=0.906), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.982, test=0.853), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.986, test=0.812), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.980, test=0.898), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.984, test=0.876), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.982, test=0.899), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.845), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.987, test=0.809), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.981, test=0.899), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.868), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.981, test=0.909), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.842), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.987, test=0.810), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.980, test=0.893), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.985, test=0.864), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.902), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.985, test=0.852), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.988, test=0.819), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.983, test=0.897), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.986, test=0.871), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.984, test=0.906), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.986, test=0.841), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.989, test=0.811), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.903), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.987, test=0.870), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.908), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.987, test=0.845), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.989, test=0.814), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.984, test=0.893), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.987, test=0.870), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.984, test=0.907), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.960, test=0.863), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.966, test=0.828), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.957, test=0.892), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.962, test=0.875), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.957, test=0.916), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.963, test=0.862), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.966, test=0.826), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.956, test=0.894), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.963, test=0.875), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.957, test=0.912), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.962, test=0.858), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.968, test=0.826), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.957, test=0.897), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.961, test=0.879), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.959, test=0.910), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.960, test=0.863), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.966, test=0.828), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.957, test=0.892), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.962, test=0.875), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.957, test=0.916), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.963, test=0.862), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.966, test=0.826), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.956, test=0.894), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.963, test=0.875), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.957, test=0.912), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.962, test=0.858), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.968, test=0.826), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.957, test=0.897), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.961, test=0.879), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.959, test=0.910), total=   0.0s
{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.78}
	
模型平均训练得分：0.9948913668289157
	
模型平均测试得分：0.8608351091098221


{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.8}
	
模型平均训练得分：0.9952100757707395
	
模型平均测试得分：0.8586537943313092


{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.82}
	
模型平均训练得分：0.995492319063807
	
模型平均测试得分：0.8636974901647936


{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.78}
	
模型平均训练得分：0.9961760304607352
	
模型平均测试得分：0.8604601571926592


{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.8}
	
模型平均训练得分：0.9962742557034495
	
模型平均测试得分：0.8601277225906501


{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.82}
	
模型平均训练得分：0.99633271486064
	
模型平均测试得分：0.86168599578933


{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.78}
	
模型平均训练得分：0.9800659666555948
	
模型平均测试得分：0.8752995445195519


{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}
	
模型平均训练得分：0.9810037812865241
	
模型平均测试得分：0.8763429083059412


{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.82}
	
模型平均训练得分：0.9816219899017564
	
模型平均测试得分：0.8734101325557602


{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.78}
	
模型平均训练得分：0.9800659666555948
	
模型平均测试得分：0.8752995445195519


{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.8}
	
模型平均训练得分：0.9810037812865241
	
模型平均测试得分：0.8763429083059412


{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.82}
	
模型平均训练得分：0.9816219899017564
	
模型平均测试得分：0.8734101325557602


{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.78}
	
模型平均训练得分：0.9828878353715409
	
模型平均测试得分：0.8674828999301066


{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.8}
	
模型平均训练得分：0.9834158405982226
	
模型平均测试得分：0.8659434954675926


{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.82}
	
模型平均训练得分：0.983594604576265
	
模型平均测试得分：0.8620285393411816


{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.78}
	
模型平均训练得分：0.985396181530478
	
模型平均测试得分：0.8690272850990489


{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.8}
	
模型平均训练得分：0.9860977803932928
	
模型平均测试得分：0.8665975606981379


{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.82}
	
模型平均训练得分：0.9861863090215518
	
模型平均测试得分：0.8657844292665029


{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.78}
	
模型平均训练得分：0.9603291739546999
	
模型平均测试得分：0.8749722825998079


{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}
	
模型平均训练得分：0.960894823796824
	
模型平均测试得分：0.8738037221270639


{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.82}
	
模型平均训练得分：0.9615460090403143
	
模型平均测试得分：0.8739911847539901


{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.78}
	
模型平均训练得分：0.9603291739546999
	
模型平均测试得分：0.8749722825998079


{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.8}
	
模型平均训练得分：0.960894823796824
	
模型平均测试得分：0.8738037221270639


{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.82}
	
模型平均训练得分：0.9615460090403143
	
模型平均测试得分：0.8739911847539901


{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.78}
	
模型平均训练得分：0.9948913668289157
	
模型平均测试得分：0.8608351091098221


{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.8}
	
模型平均训练得分：0.9952100757707395
	
模型平均测试得分：0.8586537943313092


{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.82}
	
模型平均训练得分：0.995492319063807
	
模型平均测试得分：0.8636974901647936


{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.78}
	
模型平均训练得分：0.9961760304607352
	
模型平均测试得分：0.8604601571926592


{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.8}
	
模型平均训练得分：0.9962742557034495
	
模型平均测试得分：0.8601277225906501


{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.82}
	
模型平均训练得分：0.99633271486064
	
模型平均测试得分：0.86168599578933


{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.78}
	
模型平均训练得分：0.9800659666555948
	
模型平均测试得分：0.8752995445195519


{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}
	
模型平均训练得分：0.9810037812865241
	
模型平均测试得分：0.8763429083059412


{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.82}
	
模型平均训练得分：0.9816219899017564
	
模型平均测试得分：0.8734101325557602


{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.78}
	
模型平均训练得分：0.9800659666555948
	
模型平均测试得分：0.8752995445195519


{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.8}
	
模型平均训练得分：0.9810037812865241
	
模型平均测试得分：0.8763429083059412


{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.82}
	
模型平均训练得分：0.9816219899017564
	
模型平均测试得分：0.8734101325557602


{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.78}
	
模型平均训练得分：0.9828878353715409
	
模型平均测试得分：0.8674828999301066


{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.8}
	
模型平均训练得分：0.9834158405982226
	
模型平均测试得分：0.8659434954675926


{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.82}
	
模型平均训练得分：0.983594604576265
	
模型平均测试得分：0.8620285393411816


{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.78}
	
模型平均训练得分：0.985396181530478
	
模型平均测试得分：0.8690272850990489


{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.8}
	
模型平均训练得分：0.9860977803932928
	
模型平均测试得分：0.8665975606981379


{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.82}
	
模型平均训练得分：0.9861863090215518
	
模型平均测试得分：0.8657844292665029


{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.78}
	
模型平均训练得分：0.9603291739546999
	
模型平均测试得分：0.8749722825998079


{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}
	
模型平均训练得分：0.960894823796824
	
模型平均测试得分：0.8738037221270639


{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.82}
	
模型平均训练得分：0.9615460090403143
	
模型平均测试得分：0.8739911847539901


{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.78}
	
模型平均训练得分：0.9603291739546999
	
模型平均测试得分：0.8749722825998079


{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.8}
	
模型平均训练得分：0.960894823796824
	
模型平均测试得分：0.8738037221270639


{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.82}
	
模型平均训练得分：0.9615460090403143
	
模型平均测试得分：0.8739911847539901


{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.78}
	
模型平均训练得分：0.9948913668289157
	
模型平均测试得分：0.8608351091098221


{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.8}
	
模型平均训练得分：0.9952100757707395
	
模型平均测试得分：0.8586537943313092


{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.82}
	
模型平均训练得分：0.995492319063807
	
模型平均测试得分：0.8636974901647936


{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.78}
	
模型平均训练得分：0.9961760304607352
	
模型平均测试得分：0.8604601571926592


{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.8}
	
模型平均训练得分：0.9962742557034495
	
模型平均测试得分：0.8601277225906501


{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.82}
	
模型平均训练得分：0.99633271486064
	
模型平均测试得分：0.86168599578933


{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.78}
	
模型平均训练得分：0.9800659666555948
	
模型平均测试得分：0.8752995445195519


{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}
	
模型平均训练得分：0.9810037812865241
	
模型平均测试得分：0.8763429083059412


{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.82}
	
模型平均训练得分：0.9816219899017564
	
模型平均测试得分：0.8734101325557602


{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.78}
	
模型平均训练得分：0.9800659666555948
	
模型平均测试得分：0.8752995445195519


{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.8}
	
模型平均训练得分：0.9810037812865241
	
模型平均测试得分：0.8763429083059412


{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.82}
	
模型平均训练得分：0.9816219899017564
	
模型平均测试得分：0.8734101325557602


{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.78}
	
模型平均训练得分：0.9828878353715409
	
模型平均测试得分：0.8674828999301066


{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.8}
	
模型平均训练得分：0.9834158405982226
	
模型平均测试得分：0.8659434954675926


{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.82}
	
模型平均训练得分：0.983594604576265
	
模型平均测试得分：0.8620285393411816


{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.78}
	
模型平均训练得分：0.985396181530478
	
模型平均测试得分：0.8690272850990489


{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.8}
	
模型平均训练得分：0.9860977803932928
	
模型平均测试得分：0.8665975606981379


{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.82}
	
模型平均训练得分：0.9861863090215518
	
模型平均测试得分：0.8657844292665029


{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.78}
	
模型平均训练得分：0.9603291739546999
	
模型平均测试得分：0.8749722825998079


{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}
	
模型平均训练得分：0.960894823796824
	
模型平均测试得分：0.8738037221270639


{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.82}
	
模型平均训练得分：0.9615460090403143
	
模型平均测试得分：0.8739911847539901


{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.78}
	
模型平均训练得分：0.9603291739546999
	
模型平均测试得分：0.8749722825998079


{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.8}
	
模型平均训练得分：0.960894823796824
	
模型平均测试得分：0.8738037221270639


{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.82}
	
模型平均训练得分：0.9615460090403143
	
模型平均测试得分：0.8739911847539901


参数的最佳取值:{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}
最佳模型得分:0.8763429083059412


[Parallel(n_jobs=1)]: Done 360 out of 360 | elapsed:   17.8s finished

res = gsearch.predict(train_tr)#这里的res就是布尔值
percent=[0 if res[i]!=y_train[i] else 1 for i in range(len(res))]

error_rate=1-np.array(percent,dtype=int).sum()/len(res)#个人偏好，二分类看error_rate。虽然这样肯定是不全面的。
print(error_rate)
roc_auc_score(y_train,res)

0.06846240179573515





0.9284584411849295

生成提交的测试集预测结果文件。

result = gsearch.predict(test_tr)
dataframe = pd.DataFrame({'PassengerId':test["PassengerId"],'Survived':result})
dataframe.to_csv("submission.csv",index=False,sep=',')