Tensorflow 实现鸢尾花数据集分类

根据北大的神经网络class1所有内容最后用实例来总结一下,通过tensorflow 2.0,不搭建Senquential搭建鸢尾花数据集分类的神经网络

# 导入所需模块     
import tensorflow as tf
from sklearn import datasets
from matplotlib import pyplot as plt
import numpy as np

# 导入数据,分别为输入特征和标签
x_data = datasets.load_iris().data
y_data = datasets.load_iris().target

# 随机打乱数据,如果不随机打乱,那么接下来在测试集准确率计算中将始终为1。
# seed: 随机数种子,是一个整数,当设置之后,每次生成的随机数都一样
np.random.seed(666)  # 使用相同的seed,保证输入特征和标签一一对应
np.random.shuffle(x_data)#对输入特征值进行随机打乱
np.random.seed(666)
np.random.shuffle(y_data)#对标签值随机打乱
tf.random.set_seed(666)

# 将打乱后的数据集分割为训练集和测试集,训练集为前120行,测试集为后30行
x_train = x_data[:-30]#因为总共数据集为150,x_data[:-30]=x_data[0:120]   这是训练集的特征值
y_train = y_data[:-30]#同上
x_test = x_data[-30:]#因为总共数据集为150,x_data[-30:]=x_data[120:150]   这是测试集的特征值
y_test = y_data[-30:]#同上

# 转换x的数据类型,否则后面矩阵相乘时会因数据类型不一致报错
x_train = tf.cast(x_train, tf.float32)#tf.cast()转换数据类型
x_test = tf.cast(x_test, tf.float32)

# from_tensor_slices函数使输入特征和标签值一一对应。(把数据集分批次,每个批次32组数据)
train_db = tf.data.Dataset.from_tensor_slices((x_train, y_train)).batch(32)
test_db = tf.data.Dataset.from_tensor_slices((x_test, y_test)).batch(32)

# 生成一层神经网络的参数,4个输入特征,所以输入层为4个输入节点;因为3分类,故输出层为3个神经元
# 用tf.Variable()标记参数可训练
w1 = tf.Variable(tf.random.truncated_normal([4, 3], stddev=0.1))
b1 = tf.Variable(tf.random.truncated_normal([3], stddev=0.1))

#设置超参数
lr = 0.1  # 学习率为0.1
epoch = 500  # 循环500轮
loss_all = 0  # 每轮分4个step,loss_all记录四个step生成的4个loss的和

# 训练部分
for epoch in range(epoch):  #数据集级别的循环,每个epoch循环一次数据集
    for step, (x_train, y_train) in enumerate(train_db):  #batch级别的循环 ,每个step循环一个batch
        with tf.GradientTape() as tape:  # with结构记录梯度信息
            y = tf.matmul(x_train, w1) + b1  # 神经网络乘加运算
            y = tf.nn.softmax(y)  # 使输出y符合概率分布
            y_ = tf.one_hot(y_train, depth=3)  # 将标签值转换为独热码格式,方便计算loss和accuracy
            loss = tf.reduce_mean(tf.square(y_ - y))  # 采用均方误差损失函数mse = mean(sum(y-out)^2)
            loss_all += loss.numpy()  # 将每个step计算出的loss累加,为后续求loss平均值提供数据,这样计算的loss更准确
        # 计算loss对各个参数的梯度
        grads = tape.gradient(loss, [w1, b1])

        # 实现梯度更新 w1 = w1 - lr * w1_grad    b = b - lr * b_grad
        w1.assign_sub(lr * grads[0])  # 参数w1自更新
        b1.assign_sub(lr * grads[1])  # 参数b自更新

    # 每个epoch,打印loss信息
    print("Epoch {}, loss: {}".format(epoch, loss_all/4))
    train_loss_results.append(loss_all / 4)  # 将4个step的loss求平均记录在此变量中
    loss_all = 0  # loss_all归零,为记录下一个epoch的loss做准备

    # 测试部分
    # total_correct为预测对的样本个数, total_number为测试的总样本数,将这两个变量都初始化为0
    total_correct, total_number = 0, 0
    for x_test, y_test in test_db:
        # 使用更新后的参数进行预测
        y = tf.matmul(x_test, w1) + b1
        y = tf.nn.softmax(y)
        pred = tf.argmax(y, axis=1)  # 返回y中最大值的索引,即预测的分类
        # 将pred转换为y_test的数据类型
        pred = tf.cast(pred, dtype=y_test.dtype)
        # 若分类正确,则correct=1,否则为0,将bool型的结果转换为int型
        correct = tf.cast(tf.equal(pred, y_test), dtype=tf.int32)
        # 将每个batch的correct数加起来
        correct = tf.reduce_sum(correct)
        # 将所有batch中的correct数加起来
        total_correct += int(correct)
        # total_number为测试的总样本数,也就是x_test的行数,shape[0]返回变量的行数
        total_number += x_test.shape[0]
    # 总的准确率等于total_correct/total_number
    acc = total_correct / total_number
    test_acc.append(acc)
    print("Test_acc:", acc)
    print("--------------------------")

下面是输出结果:

Epoch 0, loss: 0.28431667014956474
Test_acc: 0.16666666666666666
--------------------------
Epoch 1, loss: 0.1981075294315815
Test_acc: 0.23333333333333334
--------------------------
Epoch 2, loss: 0.18012284487485886
Test_acc: 0.5333333333333333
--------------------------
Epoch 3, loss: 0.1698448546230793
Test_acc: 0.5333333333333333
--------------------------
Epoch 4, loss: 0.16149691492319107
Test_acc: 0.5333333333333333
--------------------------
Epoch 5, loss: 0.15443307906389236
Test_acc: 0.5333333333333333
--------------------------
Epoch 6, loss: 0.14845269173383713
Test_acc: 0.5333333333333333
--------------------------
Epoch 7, loss: 0.1433694213628769
Test_acc: 0.5333333333333333
--------------------------
Epoch 8, loss: 0.13901774398982525
Test_acc: 0.5333333333333333
--------------------------
Epoch 9, loss: 0.13525934144854546
Test_acc: 0.5333333333333333
--------------------------
Epoch 10, loss: 0.1319823358207941
Test_acc: 0.5333333333333333
--------------------------
Epoch 11, loss: 0.12909754179418087
Test_acc: 0.5333333333333333
--------------------------
Epoch 12, loss: 0.1265342477709055
Test_acc: 0.5333333333333333
--------------------------
Epoch 13, loss: 0.12423631362617016
Test_acc: 0.5333333333333333
--------------------------
Epoch 14, loss: 0.12215906381607056
Test_acc: 0.5333333333333333
--------------------------
Epoch 15, loss: 0.12026669643819332
Test_acc: 0.5333333333333333
--------------------------
Epoch 16, loss: 0.1185303870588541
Test_acc: 0.5333333333333333
--------------------------
Epoch 17, loss: 0.11692673340439796
Test_acc: 0.5333333333333333
--------------------------
Epoch 18, loss: 0.11543663963675499
Test_acc: 0.5333333333333333
--------------------------
Epoch 19, loss: 0.11404440365731716
Test_acc: 0.5333333333333333
--------------------------
Epoch 20, loss: 0.112737026065588
Test_acc: 0.5333333333333333
--------------------------
Epoch 21, loss: 0.11150369234383106
Test_acc: 0.5333333333333333
--------------------------
Epoch 22, loss: 0.11033532582223415
Test_acc: 0.5333333333333333
--------------------------
Epoch 23, loss: 0.10922429896891117
Test_acc: 0.5333333333333333
--------------------------
Epoch 24, loss: 0.10816413164138794
Test_acc: 0.5333333333333333
--------------------------
Epoch 25, loss: 0.10714931972324848
Test_acc: 0.5333333333333333
--------------------------
Epoch 26, loss: 0.10617514699697495
Test_acc: 0.5333333333333333
--------------------------
Epoch 27, loss: 0.1052375566214323
Test_acc: 0.5333333333333333
--------------------------
Epoch 28, loss: 0.10433304496109486
Test_acc: 0.5333333333333333
--------------------------
Epoch 29, loss: 0.1034585814923048
Test_acc: 0.5333333333333333
--------------------------
Epoch 30, loss: 0.10261152870953083
Test_acc: 0.5333333333333333
--------------------------
Epoch 31, loss: 0.10178956016898155
Test_acc: 0.5333333333333333
--------------------------
Epoch 32, loss: 0.10099065490067005
Test_acc: 0.5333333333333333
--------------------------
Epoch 33, loss: 0.10021303966641426
Test_acc: 0.5333333333333333
--------------------------
Epoch 34, loss: 0.09945511817932129
Test_acc: 0.5333333333333333
--------------------------
Epoch 35, loss: 0.098715515807271
Test_acc: 0.5333333333333333
--------------------------
Epoch 36, loss: 0.09799297526478767
Test_acc: 0.5333333333333333
--------------------------
Epoch 37, loss: 0.0972864031791687
Test_acc: 0.5333333333333333
--------------------------
Epoch 38, loss: 0.09659480676054955
Test_acc: 0.5333333333333333
--------------------------
Epoch 39, loss: 0.09591729380190372
Test_acc: 0.5333333333333333
--------------------------
Epoch 40, loss: 0.09525307267904282
Test_acc: 0.5333333333333333
--------------------------
Epoch 41, loss: 0.09460142999887466
Test_acc: 0.5333333333333333
--------------------------
Epoch 42, loss: 0.09396171569824219
Test_acc: 0.5333333333333333
--------------------------
Epoch 43, loss: 0.09333333559334278
Test_acc: 0.5333333333333333
--------------------------
Epoch 44, loss: 0.09271577186882496
Test_acc: 0.5333333333333333
--------------------------
Epoch 45, loss: 0.09210851788520813
Test_acc: 0.5333333333333333
--------------------------
Epoch 46, loss: 0.09151115268468857
Test_acc: 0.5333333333333333
--------------------------
Epoch 47, loss: 0.0909232571721077
Test_acc: 0.5666666666666667
--------------------------
Epoch 48, loss: 0.09034446999430656
Test_acc: 0.5666666666666667
--------------------------
Epoch 49, loss: 0.08977444842457771
Test_acc: 0.5666666666666667
--------------------------
Epoch 50, loss: 0.08921287767589092
Test_acc: 0.5666666666666667
--------------------------
Epoch 51, loss: 0.08865946903824806
Test_acc: 0.6
--------------------------
Epoch 52, loss: 0.08811395615339279
Test_acc: 0.6
--------------------------
Epoch 53, loss: 0.08757609315216541
Test_acc: 0.6
--------------------------
Epoch 54, loss: 0.08704564720392227
Test_acc: 0.6
--------------------------
Epoch 55, loss: 0.08652240224182606
Test_acc: 0.6
--------------------------
Epoch 56, loss: 0.08600616082549095
Test_acc: 0.6
--------------------------
Epoch 57, loss: 0.08549674414098263
Test_acc: 0.6
--------------------------
Epoch 58, loss: 0.08499396033585072
Test_acc: 0.6
--------------------------
Epoch 59, loss: 0.08449766784906387
Test_acc: 0.6
--------------------------
Epoch 60, loss: 0.08400769345462322
Test_acc: 0.6
--------------------------
Epoch 61, loss: 0.08352390117943287
Test_acc: 0.6333333333333333
--------------------------
Epoch 62, loss: 0.08304615877568722
Test_acc: 0.6333333333333333
--------------------------
Epoch 63, loss: 0.08257432840764523
Test_acc: 0.6333333333333333
--------------------------
Epoch 64, loss: 0.0821082815527916
Test_acc: 0.6333333333333333
--------------------------
Epoch 65, loss: 0.08164790458977222
Test_acc: 0.6333333333333333
--------------------------
Epoch 66, loss: 0.08119309321045876
Test_acc: 0.6333333333333333
--------------------------
Epoch 67, loss: 0.08074375055730343
Test_acc: 0.6333333333333333
--------------------------
Epoch 68, loss: 0.0802997425198555
Test_acc: 0.6333333333333333
--------------------------
Epoch 69, loss: 0.0798610020428896
Test_acc: 0.6666666666666666
--------------------------
Epoch 70, loss: 0.0794274304062128
Test_acc: 0.6666666666666666
--------------------------
Epoch 71, loss: 0.07899892702698708
Test_acc: 0.7
--------------------------
Epoch 72, loss: 0.07857540994882584
Test_acc: 0.7
--------------------------
Epoch 73, loss: 0.07815680652856827
Test_acc: 0.7
--------------------------
Epoch 74, loss: 0.0777430310845375
Test_acc: 0.7
--------------------------
Epoch 75, loss: 0.07733399607241154
Test_acc: 0.7
--------------------------
Epoch 76, loss: 0.07692964188754559
Test_acc: 0.7333333333333333
--------------------------
Epoch 77, loss: 0.07652989029884338
Test_acc: 0.7333333333333333
--------------------------
Epoch 78, loss: 0.07613467052578926
Test_acc: 0.7333333333333333
--------------------------
Epoch 79, loss: 0.0757439099252224
Test_acc: 0.7333333333333333
--------------------------
Epoch 80, loss: 0.07535756006836891
Test_acc: 0.7333333333333333
--------------------------
Epoch 81, loss: 0.07497553713619709
Test_acc: 0.7333333333333333
--------------------------
Epoch 82, loss: 0.0745977833867073
Test_acc: 0.7333333333333333
--------------------------
Epoch 83, loss: 0.07422423176467419
Test_acc: 0.7333333333333333
--------------------------
Epoch 84, loss: 0.07385483663529158
Test_acc: 0.7333333333333333
--------------------------
Epoch 85, loss: 0.07348953373730183
Test_acc: 0.7333333333333333
--------------------------
Epoch 86, loss: 0.07312826719135046
Test_acc: 0.7333333333333333
--------------------------
Epoch 87, loss: 0.07277097087353468
Test_acc: 0.7666666666666667
--------------------------
Epoch 88, loss: 0.07241760101169348
Test_acc: 0.7666666666666667
--------------------------
Epoch 89, loss: 0.07206810917705297
Test_acc: 0.7666666666666667
--------------------------
Epoch 90, loss: 0.07172242272645235
Test_acc: 0.7666666666666667
--------------------------
Epoch 91, loss: 0.07138051465153694
Test_acc: 0.7666666666666667
--------------------------
Epoch 92, loss: 0.07104231137782335
Test_acc: 0.7666666666666667
--------------------------
Epoch 93, loss: 0.07070777844637632
Test_acc: 0.8
--------------------------
Epoch 94, loss: 0.0703768515959382
Test_acc: 0.8333333333333334
--------------------------
Epoch 95, loss: 0.07004949729889631
Test_acc: 0.8666666666666667
--------------------------
Epoch 96, loss: 0.06972566526383162
Test_acc: 0.8666666666666667
--------------------------
Epoch 97, loss: 0.06940531078726053
Test_acc: 0.8666666666666667
--------------------------
Epoch 98, loss: 0.06908838357776403
Test_acc: 0.8666666666666667
--------------------------
Epoch 99, loss: 0.06877483800053596
Test_acc: 0.8666666666666667
--------------------------
Epoch 100, loss: 0.06846463121473789
Test_acc: 0.8666666666666667
--------------------------
Epoch 101, loss: 0.06815772037953138
Test_acc: 0.8666666666666667
--------------------------
Epoch 102, loss: 0.06785407196730375
Test_acc: 0.9
--------------------------
Epoch 103, loss: 0.06755362544208765
Test_acc: 0.9
--------------------------
Epoch 104, loss: 0.06725634541362524
Test_acc: 0.9
--------------------------
Epoch 105, loss: 0.06696220207959414
Test_acc: 0.9
--------------------------
Epoch 106, loss: 0.06667114049196243
Test_acc: 0.9
--------------------------
Epoch 107, loss: 0.06638312805444002
Test_acc: 0.9
--------------------------
Epoch 108, loss: 0.06609812844544649
Test_acc: 0.9
--------------------------
Epoch 109, loss: 0.06581609137356281
Test_acc: 0.9
--------------------------
Epoch 110, loss: 0.06553698610514402
Test_acc: 0.9
--------------------------
Epoch 111, loss: 0.06526077724993229
Test_acc: 0.9
--------------------------
Epoch 112, loss: 0.06498742010444403
Test_acc: 0.9
--------------------------
Epoch 113, loss: 0.06471689231693745
Test_acc: 0.9
--------------------------
Epoch 114, loss: 0.0644491370767355
Test_acc: 0.9
--------------------------
Epoch 115, loss: 0.06418413948267698
Test_acc: 0.9
--------------------------
Epoch 116, loss: 0.06392183806747198
Test_acc: 0.9333333333333333
--------------------------
Epoch 117, loss: 0.06366223003715277
Test_acc: 0.9333333333333333
--------------------------
Epoch 118, loss: 0.06340525485575199
Test_acc: 0.9333333333333333
--------------------------
Epoch 119, loss: 0.06315089110285044
Test_acc: 0.9333333333333333
--------------------------
Epoch 120, loss: 0.06289910152554512
Test_acc: 0.9333333333333333
--------------------------
Epoch 121, loss: 0.06264986470341682
Test_acc: 0.9333333333333333
--------------------------
Epoch 122, loss: 0.06240313034504652
Test_acc: 0.9333333333333333
--------------------------
Epoch 123, loss: 0.06215887423604727
Test_acc: 0.9333333333333333
--------------------------
Epoch 124, loss: 0.061917063780128956
Test_acc: 0.9333333333333333
--------------------------
Epoch 125, loss: 0.06167767569422722
Test_acc: 0.9333333333333333
--------------------------
Epoch 126, loss: 0.0614406717941165
Test_acc: 0.9333333333333333
--------------------------
Epoch 127, loss: 0.061206008307635784
Test_acc: 0.9333333333333333
--------------------------
Epoch 128, loss: 0.060973694548010826
Test_acc: 0.9333333333333333
--------------------------
Epoch 129, loss: 0.06074365507811308
Test_acc: 0.9333333333333333
--------------------------
Epoch 130, loss: 0.06051589734852314
Test_acc: 0.9333333333333333
--------------------------
Epoch 131, loss: 0.06029036268591881
Test_acc: 0.9333333333333333
--------------------------
Epoch 132, loss: 0.060067045502364635
Test_acc: 0.9333333333333333
--------------------------
Epoch 133, loss: 0.05984591133892536
Test_acc: 0.9333333333333333
--------------------------
Epoch 134, loss: 0.05962692201137543
Test_acc: 0.9333333333333333
--------------------------
Epoch 135, loss: 0.059410061687231064
Test_acc: 0.9333333333333333
--------------------------
Epoch 136, loss: 0.05919529777020216
Test_acc: 0.9333333333333333
--------------------------
Epoch 137, loss: 0.05898261349648237
Test_acc: 0.9333333333333333
--------------------------
Epoch 138, loss: 0.058771959505975246
Test_acc: 0.9333333333333333
--------------------------
Epoch 139, loss: 0.05856333766132593
Test_acc: 0.9333333333333333
--------------------------
Epoch 140, loss: 0.05835672002285719
Test_acc: 0.9333333333333333
--------------------------
Epoch 141, loss: 0.05815205816179514
Test_acc: 0.9333333333333333
--------------------------
Epoch 142, loss: 0.05794934090226889
Test_acc: 0.9333333333333333
--------------------------
Epoch 143, loss: 0.057748555205762386
Test_acc: 0.9333333333333333
--------------------------
Epoch 144, loss: 0.057549663819372654
Test_acc: 0.9333333333333333
--------------------------
Epoch 145, loss: 0.05735263880342245
Test_acc: 0.9333333333333333
--------------------------
Epoch 146, loss: 0.057157471776008606
Test_acc: 0.9333333333333333
--------------------------
Epoch 147, loss: 0.056964135728776455
Test_acc: 0.9333333333333333
--------------------------
Epoch 148, loss: 0.056772587820887566
Test_acc: 0.9333333333333333
--------------------------
Epoch 149, loss: 0.056582833640277386
Test_acc: 0.9333333333333333
--------------------------
Epoch 150, loss: 0.056394835002720356
Test_acc: 0.9333333333333333
--------------------------
Epoch 151, loss: 0.05620857235044241
Test_acc: 0.9333333333333333
--------------------------
Epoch 152, loss: 0.05602401867508888
Test_acc: 0.9333333333333333
--------------------------
Epoch 153, loss: 0.0558411655947566
Test_acc: 0.9333333333333333
--------------------------
Epoch 154, loss: 0.055659991689026356
Test_acc: 0.9666666666666667
--------------------------
Epoch 155, loss: 0.05548046622425318
Test_acc: 0.9666666666666667
--------------------------
Epoch 156, loss: 0.05530256778001785
Test_acc: 0.9666666666666667
--------------------------
Epoch 157, loss: 0.05512629449367523
Test_acc: 0.9666666666666667
--------------------------
Epoch 158, loss: 0.054951599799096584
Test_acc: 0.9666666666666667
--------------------------
Epoch 159, loss: 0.054778482764959335
Test_acc: 0.9666666666666667
--------------------------
Epoch 160, loss: 0.05460691638290882
Test_acc: 0.9666666666666667
--------------------------
Epoch 161, loss: 0.05443689413368702
Test_acc: 0.9666666666666667
--------------------------
Epoch 162, loss: 0.05426838621497154
Test_acc: 0.9666666666666667
--------------------------
Epoch 163, loss: 0.054101383313536644
Test_acc: 0.9666666666666667
--------------------------
Epoch 164, loss: 0.053935843519866467
Test_acc: 0.9666666666666667
--------------------------
Epoch 165, loss: 0.05377177894115448
Test_acc: 0.9666666666666667
--------------------------
Epoch 166, loss: 0.05360914394259453
Test_acc: 0.9666666666666667
--------------------------
Epoch 167, loss: 0.05344794970005751
Test_acc: 0.9666666666666667
--------------------------
Epoch 168, loss: 0.05328815616667271
Test_acc: 0.9666666666666667
--------------------------
Epoch 169, loss: 0.05312975402921438
Test_acc: 0.9666666666666667
--------------------------
Epoch 170, loss: 0.052972735837101936
Test_acc: 0.9666666666666667
--------------------------
Epoch 171, loss: 0.05281707737594843
Test_acc: 0.9666666666666667
--------------------------
Epoch 172, loss: 0.05266275256872177
Test_acc: 1.0
--------------------------
Epoch 173, loss: 0.05250975862145424
Test_acc: 1.0
--------------------------
Epoch 174, loss: 0.052358074113726616
Test_acc: 1.0
--------------------------
Epoch 175, loss: 0.05220768600702286
Test_acc: 1.0
--------------------------
Epoch 176, loss: 0.052058578468859196
Test_acc: 1.0
--------------------------
Epoch 177, loss: 0.05191073380410671
Test_acc: 1.0
--------------------------
Epoch 178, loss: 0.05176414083689451
Test_acc: 1.0
--------------------------
Epoch 179, loss: 0.0516187883913517
Test_acc: 1.0
--------------------------
Epoch 180, loss: 0.05147465504705906
Test_acc: 1.0
--------------------------
Epoch 181, loss: 0.05133172497153282
Test_acc: 1.0
--------------------------
Epoch 182, loss: 0.051189983263611794
Test_acc: 1.0
--------------------------
Epoch 183, loss: 0.05104943085461855
Test_acc: 1.0
--------------------------
Epoch 184, loss: 0.05091002769768238
Test_acc: 1.0
--------------------------
Epoch 185, loss: 0.050771783106029034
Test_acc: 1.0
--------------------------
Epoch 186, loss: 0.05063467938452959
Test_acc: 1.0
--------------------------
Epoch 187, loss: 0.05049870163202286
Test_acc: 1.0
--------------------------
Epoch 188, loss: 0.050363825634121895
Test_acc: 1.0
--------------------------
Epoch 189, loss: 0.050230056047439575
Test_acc: 1.0
--------------------------
Epoch 190, loss: 0.05009737238287926
Test_acc: 1.0
--------------------------
Epoch 191, loss: 0.04996575601398945
Test_acc: 1.0
--------------------------
Epoch 192, loss: 0.04983521066606045
Test_acc: 1.0
--------------------------
Epoch 193, loss: 0.04970570746809244
Test_acc: 1.0
--------------------------
Epoch 194, loss: 0.04957723896950483
Test_acc: 1.0
--------------------------
Epoch 195, loss: 0.049449799582362175
Test_acc: 1.0
--------------------------
Epoch 196, loss: 0.04932337533682585
Test_acc: 1.0
--------------------------
Epoch 197, loss: 0.04919794853776693
Test_acc: 1.0
--------------------------
Epoch 198, loss: 0.049073513597249985
Test_acc: 1.0
--------------------------
Epoch 199, loss: 0.04895007237792015
Test_acc: 1.0
--------------------------
Epoch 200, loss: 0.048827577382326126
Test_acc: 1.0
--------------------------
Epoch 201, loss: 0.0487060584127903
Test_acc: 1.0
--------------------------
Epoch 202, loss: 0.048585476353764534
Test_acc: 1.0
--------------------------
Epoch 203, loss: 0.048465835861861706
Test_acc: 1.0
--------------------------
Epoch 204, loss: 0.04834711365401745
Test_acc: 1.0
--------------------------
Epoch 205, loss: 0.04822932556271553
Test_acc: 1.0
--------------------------
Epoch 206, loss: 0.04811242874711752
Test_acc: 1.0
--------------------------
Epoch 207, loss: 0.04799642879515886
Test_acc: 1.0
--------------------------
Epoch 208, loss: 0.04788132105022669
Test_acc: 1.0
--------------------------
Epoch 209, loss: 0.0477670868858695
Test_acc: 1.0
--------------------------
Epoch 210, loss: 0.04765371419489384
Test_acc: 1.0
--------------------------
Epoch 211, loss: 0.04754120670258999
Test_acc: 1.0
--------------------------
Epoch 212, loss: 0.04742954485118389
Test_acc: 1.0
--------------------------
Epoch 213, loss: 0.047318716533482075
Test_acc: 1.0
--------------------------
Epoch 214, loss: 0.047208729200065136
Test_acc: 1.0
--------------------------
Epoch 215, loss: 0.04709955025464296
Test_acc: 1.0
--------------------------
Epoch 216, loss: 0.0469911890104413
Test_acc: 1.0
--------------------------
Epoch 217, loss: 0.046883635222911835
Test_acc: 1.0
--------------------------
Epoch 218, loss: 0.04677686560899019
Test_acc: 1.0
--------------------------
Epoch 219, loss: 0.04667089320719242
Test_acc: 1.0
--------------------------
Epoch 220, loss: 0.04656569194048643
Test_acc: 1.0
--------------------------
Epoch 221, loss: 0.046461266465485096
Test_acc: 1.0
--------------------------
Epoch 222, loss: 0.04635759815573692
Test_acc: 1.0
--------------------------
Epoch 223, loss: 0.04625467676669359
Test_acc: 1.0
--------------------------
Epoch 224, loss: 0.04615251254290342
Test_acc: 1.0
--------------------------
Epoch 225, loss: 0.04605107754468918
Test_acc: 1.0
--------------------------
Epoch 226, loss: 0.04595038294792175
Test_acc: 1.0
--------------------------
Epoch 227, loss: 0.04585039149969816
Test_acc: 1.0
--------------------------
Epoch 228, loss: 0.045751129277050495
Test_acc: 1.0
--------------------------
Epoch 229, loss: 0.04565256554633379
Test_acc: 1.0
--------------------------
Epoch 230, loss: 0.04555471055209637
Test_acc: 1.0
--------------------------
Epoch 231, loss: 0.04545754473656416
Test_acc: 1.0
--------------------------
Epoch 232, loss: 0.045361065305769444
Test_acc: 1.0
--------------------------
Epoch 233, loss: 0.04526526387780905
Test_acc: 1.0
--------------------------
Epoch 234, loss: 0.0451701283454895
Test_acc: 1.0
--------------------------
Epoch 235, loss: 0.04507565312087536
Test_acc: 1.0
--------------------------
Epoch 236, loss: 0.04498184472322464
Test_acc: 1.0
--------------------------
Epoch 237, loss: 0.0448886901140213
Test_acc: 1.0
--------------------------
Epoch 238, loss: 0.04479617811739445
Test_acc: 1.0
--------------------------
Epoch 239, loss: 0.044704293832182884
Test_acc: 1.0
--------------------------
Epoch 240, loss: 0.044613052159547806
Test_acc: 1.0
--------------------------
Epoch 241, loss: 0.04452243912965059
Test_acc: 1.0
--------------------------
Epoch 242, loss: 0.044432430528104305
Test_acc: 1.0
--------------------------
Epoch 243, loss: 0.04434303846210241
Test_acc: 1.0
--------------------------
Epoch 244, loss: 0.04425426200032234
Test_acc: 1.0
--------------------------
Epoch 245, loss: 0.044166077859699726
Test_acc: 1.0
--------------------------
Epoch 246, loss: 0.044078496284782887
Test_acc: 1.0
--------------------------
Epoch 247, loss: 0.04399149212986231
Test_acc: 1.0
--------------------------
Epoch 248, loss: 0.04390507936477661
Test_acc: 1.0
--------------------------
Epoch 249, loss: 0.04381924029439688
Test_acc: 1.0
--------------------------
Epoch 250, loss: 0.04373397026211023
Test_acc: 1.0
--------------------------
Epoch 251, loss: 0.043649270199239254
Test_acc: 1.0
--------------------------
Epoch 252, loss: 0.04356513358652592
Test_acc: 1.0
--------------------------
Epoch 253, loss: 0.043481539003551006
Test_acc: 1.0
--------------------------
Epoch 254, loss: 0.04339849762618542
Test_acc: 1.0
--------------------------
Epoch 255, loss: 0.043316007591784
Test_acc: 1.0
--------------------------
Epoch 256, loss: 0.04323405586183071
Test_acc: 1.0
--------------------------
Epoch 257, loss: 0.04315263498574495
Test_acc: 1.0
--------------------------
Epoch 258, loss: 0.0430717384442687
Test_acc: 1.0
--------------------------
Epoch 259, loss: 0.04299136530607939
Test_acc: 1.0
--------------------------
Epoch 260, loss: 0.04291151277720928
Test_acc: 1.0
--------------------------
Epoch 261, loss: 0.042832170613110065
Test_acc: 1.0
--------------------------
Epoch 262, loss: 0.04275335278362036
Test_acc: 1.0
--------------------------
Epoch 263, loss: 0.04267502296715975
Test_acc: 1.0
--------------------------
Epoch 264, loss: 0.04259719233959913
Test_acc: 1.0
--------------------------
Epoch 265, loss: 0.04251985810697079
Test_acc: 1.0
--------------------------
Epoch 266, loss: 0.042443012818694115
Test_acc: 1.0
--------------------------
Epoch 267, loss: 0.042366660200059414
Test_acc: 1.0
--------------------------
Epoch 268, loss: 0.04229078255593777
Test_acc: 1.0
--------------------------
Epoch 269, loss: 0.04221538454294205
Test_acc: 1.0
--------------------------
Epoch 270, loss: 0.042140441946685314
Test_acc: 1.0
--------------------------
Epoch 271, loss: 0.04206597991287708
Test_acc: 1.0
--------------------------
Epoch 272, loss: 0.04199198726564646
Test_acc: 1.0
--------------------------
Epoch 273, loss: 0.041918426752090454
Test_acc: 1.0
--------------------------
Epoch 274, loss: 0.041845343075692654
Test_acc: 1.0
--------------------------
Epoch 275, loss: 0.04177270736545324
Test_acc: 1.0
--------------------------
Epoch 276, loss: 0.0417005093768239
Test_acc: 1.0
--------------------------
Epoch 277, loss: 0.0416287686675787
Test_acc: 1.0
--------------------------
Epoch 278, loss: 0.04155744984745979
Test_acc: 1.0
--------------------------
Epoch 279, loss: 0.04148657154291868
Test_acc: 1.0
--------------------------
Epoch 280, loss: 0.04141611512750387
Test_acc: 1.0
--------------------------
Epoch 281, loss: 0.04134609643369913
Test_acc: 1.0
--------------------------
Epoch 282, loss: 0.04127649776637554
Test_acc: 1.0
--------------------------
Epoch 283, loss: 0.04120731819421053
Test_acc: 1.0
--------------------------
Epoch 284, loss: 0.04113853815943003
Test_acc: 1.0
--------------------------
Epoch 285, loss: 0.04107018653303385
Test_acc: 1.0
--------------------------
Epoch 286, loss: 0.041002231650054455
Test_acc: 1.0
--------------------------
Epoch 287, loss: 0.04093468468636274
Test_acc: 1.0
--------------------------
Epoch 288, loss: 0.04086754657328129
Test_acc: 1.0
--------------------------
Epoch 289, loss: 0.04080079682171345
Test_acc: 1.0
--------------------------
Epoch 290, loss: 0.0407344289124012
Test_acc: 1.0
--------------------------
Epoch 291, loss: 0.04066846426576376
Test_acc: 1.0
--------------------------
Epoch 292, loss: 0.04060289170593023
Test_acc: 1.0
--------------------------
Epoch 293, loss: 0.04053768701851368
Test_acc: 1.0
--------------------------
Epoch 294, loss: 0.04047286417335272
Test_acc: 1.0
--------------------------
Epoch 295, loss: 0.040408430621027946
Test_acc: 1.0
--------------------------
Epoch 296, loss: 0.040344350039958954
Test_acc: 1.0
--------------------------
Epoch 297, loss: 0.040280651301145554
Test_acc: 1.0
--------------------------
Epoch 298, loss: 0.0402173176407814
Test_acc: 1.0
--------------------------
Epoch 299, loss: 0.040154339745640755
Test_acc: 1.0
--------------------------
Epoch 300, loss: 0.04009173717349768
Test_acc: 1.0
--------------------------
Epoch 301, loss: 0.04002948431298137
Test_acc: 1.0
--------------------------
Epoch 302, loss: 0.03996757743880153
Test_acc: 1.0
--------------------------
Epoch 303, loss: 0.03990603378042579
Test_acc: 1.0
--------------------------
Epoch 304, loss: 0.03984482493251562
Test_acc: 1.0
--------------------------
Epoch 305, loss: 0.03978396812453866
Test_acc: 1.0
--------------------------
Epoch 306, loss: 0.039723457768559456
Test_acc: 1.0
--------------------------
Epoch 307, loss: 0.03966327989473939
Test_acc: 1.0
--------------------------
Epoch 308, loss: 0.039603440556675196
Test_acc: 1.0
--------------------------
Epoch 309, loss: 0.03954394068568945
Test_acc: 1.0
--------------------------
Epoch 310, loss: 0.039484762120991945
Test_acc: 1.0
--------------------------
Epoch 311, loss: 0.03942591277882457
Test_acc: 1.0
--------------------------
Epoch 312, loss: 0.039367393124848604
Test_acc: 1.0
--------------------------
Epoch 313, loss: 0.03930919663980603
Test_acc: 1.0
--------------------------
Epoch 314, loss: 0.039251307025551796
Test_acc: 1.0
--------------------------
Epoch 315, loss: 0.0391937461681664
Test_acc: 1.0
--------------------------
Epoch 316, loss: 0.03913650056347251
Test_acc: 1.0
--------------------------
Epoch 317, loss: 0.039079560432583094
Test_acc: 1.0
--------------------------
Epoch 318, loss: 0.03902293462306261
Test_acc: 1.0
--------------------------
Epoch 319, loss: 0.038966610096395016
Test_acc: 1.0
--------------------------
Epoch 320, loss: 0.038910599425435066
Test_acc: 1.0
--------------------------
Epoch 321, loss: 0.038854886312037706
Test_acc: 1.0
--------------------------
Epoch 322, loss: 0.03879946889355779
Test_acc: 1.0
--------------------------
Epoch 323, loss: 0.03874435229226947
Test_acc: 1.0
--------------------------
Epoch 324, loss: 0.03868952440097928
Test_acc: 1.0
--------------------------
Epoch 325, loss: 0.03863499779254198
Test_acc: 1.0
--------------------------
Epoch 326, loss: 0.03858075523748994
Test_acc: 1.0
--------------------------
Epoch 327, loss: 0.038526798598468304
Test_acc: 1.0
--------------------------
Epoch 328, loss: 0.03847313718870282
Test_acc: 1.0
--------------------------
Epoch 329, loss: 0.03841974260285497
Test_acc: 1.0
--------------------------
Epoch 330, loss: 0.038366641849279404
Test_acc: 1.0
--------------------------
Epoch 331, loss: 0.038313813507556915
Test_acc: 1.0
--------------------------
Epoch 332, loss: 0.0382612687535584
Test_acc: 1.0
--------------------------
Epoch 333, loss: 0.038208982441574335
Test_acc: 1.0
--------------------------
Epoch 334, loss: 0.03815697692334652
Test_acc: 1.0
--------------------------
Epoch 335, loss: 0.038105251267552376
Test_acc: 1.0
--------------------------
Epoch 336, loss: 0.03805377194657922
Test_acc: 1.0
--------------------------
Epoch 337, loss: 0.03800258273258805
Test_acc: 1.0
--------------------------
Epoch 338, loss: 0.03795163659378886
Test_acc: 1.0
--------------------------
Epoch 339, loss: 0.03790096240118146
Test_acc: 1.0
--------------------------
Epoch 340, loss: 0.037850544322282076
Test_acc: 1.0
--------------------------
Epoch 341, loss: 0.037800392135977745
Test_acc: 1.0
--------------------------
Epoch 342, loss: 0.03775048675015569
Test_acc: 1.0
--------------------------
Epoch 343, loss: 0.03770083421841264
Test_acc: 1.0
--------------------------
Epoch 344, loss: 0.03765142755582929
Test_acc: 1.0
--------------------------
Epoch 345, loss: 0.03760228073224425
Test_acc: 1.0
--------------------------
Epoch 346, loss: 0.037553375121206045
Test_acc: 1.0
--------------------------
Epoch 347, loss: 0.037504717241972685
Test_acc: 1.0
--------------------------
Epoch 348, loss: 0.03745630802586675
Test_acc: 1.0
--------------------------
Epoch 349, loss: 0.03740813536569476
Test_acc: 1.0
--------------------------
Epoch 350, loss: 0.03736020205542445
Test_acc: 1.0
--------------------------
Epoch 351, loss: 0.03731251088902354
Test_acc: 1.0
--------------------------
Epoch 352, loss: 0.037265047896653414
Test_acc: 1.0
--------------------------
Epoch 353, loss: 0.03721782425418496
Test_acc: 1.0
--------------------------
Epoch 354, loss: 0.03717083437368274
Test_acc: 1.0
--------------------------
Epoch 355, loss: 0.0371240833774209
Test_acc: 1.0
--------------------------
Epoch 356, loss: 0.037077543791383505
Test_acc: 1.0
--------------------------
Epoch 357, loss: 0.037031250074505806
Test_acc: 1.0
--------------------------
Epoch 358, loss: 0.03698517242446542
Test_acc: 1.0
--------------------------
Epoch 359, loss: 0.036939325742423534
Test_acc: 1.0
--------------------------
Epoch 360, loss: 0.036893694661557674
Test_acc: 1.0
--------------------------
Epoch 361, loss: 0.03684829594567418
Test_acc: 1.0
--------------------------
Epoch 362, loss: 0.03680310631170869
Test_acc: 1.0
--------------------------
Epoch 363, loss: 0.03675813181325793
Test_acc: 1.0
--------------------------
Epoch 364, loss: 0.03671338176354766
Test_acc: 1.0
--------------------------
Epoch 365, loss: 0.036668846383690834
Test_acc: 1.0
--------------------------
Epoch 366, loss: 0.036624512169510126
Test_acc: 1.0
--------------------------
Epoch 367, loss: 0.03658040286973119
Test_acc: 1.0
--------------------------
Epoch 368, loss: 0.03653649287298322
Test_acc: 1.0
--------------------------
Epoch 369, loss: 0.036492806393653154
Test_acc: 1.0
--------------------------
Epoch 370, loss: 0.03644930897280574
Test_acc: 1.0
--------------------------
Epoch 371, loss: 0.03640603506937623
Test_acc: 1.0
--------------------------
Epoch 372, loss: 0.03636295720934868
Test_acc: 1.0
--------------------------
Epoch 373, loss: 0.03632007632404566
Test_acc: 1.0
--------------------------
Epoch 374, loss: 0.03627739567309618
Test_acc: 1.0
--------------------------
Epoch 375, loss: 0.03623492689803243
Test_acc: 1.0
--------------------------
Epoch 376, loss: 0.03619264578446746
Test_acc: 1.0
--------------------------
Epoch 377, loss: 0.03615056490525603
Test_acc: 1.0
--------------------------
Epoch 378, loss: 0.03610867401584983
Test_acc: 1.0
--------------------------
Epoch 379, loss: 0.03606699127703905
Test_acc: 1.0
--------------------------
Epoch 380, loss: 0.0360254873521626
Test_acc: 1.0
--------------------------
Epoch 381, loss: 0.03598418226465583
Test_acc: 1.0
--------------------------
Epoch 382, loss: 0.035943064372986555
Test_acc: 1.0
--------------------------
Epoch 383, loss: 0.03590213134884834
Test_acc: 1.0
--------------------------
Epoch 384, loss: 0.03586139436811209
Test_acc: 1.0
--------------------------
Epoch 385, loss: 0.03582083620131016
Test_acc: 1.0
--------------------------
Epoch 386, loss: 0.03578046336770058
Test_acc: 1.0
--------------------------
Epoch 387, loss: 0.035740265157073736
Test_acc: 1.0
--------------------------
Epoch 388, loss: 0.035700270906090736
Test_acc: 1.0
--------------------------
Epoch 389, loss: 0.03566044708713889
Test_acc: 1.0
--------------------------
Epoch 390, loss: 0.03562079882249236
Test_acc: 1.0
--------------------------
Epoch 391, loss: 0.03558133728802204
Test_acc: 1.0
--------------------------
Epoch 392, loss: 0.03554204432293773
Test_acc: 1.0
--------------------------
Epoch 393, loss: 0.035502918530255556
Test_acc: 1.0
--------------------------
Epoch 394, loss: 0.03546397993341088
Test_acc: 1.0
--------------------------
Epoch 395, loss: 0.03542521921917796
Test_acc: 1.0
--------------------------
Epoch 396, loss: 0.035386621952056885
Test_acc: 1.0
--------------------------
Epoch 397, loss: 0.03534820443019271
Test_acc: 1.0
--------------------------
Epoch 398, loss: 0.03530995547771454
Test_acc: 1.0
--------------------------
Epoch 399, loss: 0.035271866247057915
Test_acc: 1.0
--------------------------
Epoch 400, loss: 0.035233952570706606
Test_acc: 1.0
--------------------------
Epoch 401, loss: 0.03519619721919298
Test_acc: 1.0
--------------------------
Epoch 402, loss: 0.035158613696694374
Test_acc: 1.0
--------------------------
Epoch 403, loss: 0.03512119082733989
Test_acc: 1.0
--------------------------
Epoch 404, loss: 0.03508393885567784
Test_acc: 1.0
--------------------------
Epoch 405, loss: 0.03504684800282121
Test_acc: 1.0
--------------------------
Epoch 406, loss: 0.03500990755856037
Test_acc: 1.0
--------------------------
Epoch 407, loss: 0.03497313568368554
Test_acc: 1.0
--------------------------
Epoch 408, loss: 0.03493652539327741
Test_acc: 1.0
--------------------------
Epoch 409, loss: 0.03490006271749735
Test_acc: 1.0
--------------------------
Epoch 410, loss: 0.034863767214119434
Test_acc: 1.0
--------------------------
Epoch 411, loss: 0.03482761513441801
Test_acc: 1.0
--------------------------
Epoch 412, loss: 0.03479163674637675
Test_acc: 1.0
--------------------------
Epoch 413, loss: 0.03475578920915723
Test_acc: 1.0
--------------------------
Epoch 414, loss: 0.03472010465338826
Test_acc: 1.0
--------------------------
Epoch 415, loss: 0.03468457283452153
Test_acc: 1.0
--------------------------
Epoch 416, loss: 0.03464920772239566
Test_acc: 1.0
--------------------------
Epoch 417, loss: 0.03461397020146251
Test_acc: 1.0
--------------------------
Epoch 418, loss: 0.03457888122648001
Test_acc: 1.0
--------------------------
Epoch 419, loss: 0.03454395616427064
Test_acc: 1.0
--------------------------
Epoch 420, loss: 0.03450916334986687
Test_acc: 1.0
--------------------------
Epoch 421, loss: 0.03447452560067177
Test_acc: 1.0
--------------------------
Epoch 422, loss: 0.03444002754986286
Test_acc: 1.0
--------------------------
Epoch 423, loss: 0.03440567199140787
Test_acc: 1.0
--------------------------
Epoch 424, loss: 0.03437146591022611
Test_acc: 1.0
--------------------------
Epoch 425, loss: 0.03433739673346281
Test_acc: 1.0
--------------------------
Epoch 426, loss: 0.03430347004905343
Test_acc: 1.0
--------------------------
Epoch 427, loss: 0.03426968399435282
Test_acc: 1.0
--------------------------
Epoch 428, loss: 0.034236034378409386
Test_acc: 1.0
--------------------------
Epoch 429, loss: 0.034202526323497295
Test_acc: 1.0
--------------------------
Epoch 430, loss: 0.03416916402056813
Test_acc: 1.0
--------------------------
Epoch 431, loss: 0.034135926980525255
Test_acc: 1.0
--------------------------
Epoch 432, loss: 0.034102828707545996
Test_acc: 1.0
--------------------------
Epoch 433, loss: 0.03406985942274332
Test_acc: 1.0
--------------------------
Epoch 434, loss: 0.034037035424262285
Test_acc: 1.0
--------------------------
Epoch 435, loss: 0.03400434134528041
Test_acc: 1.0
--------------------------
Epoch 436, loss: 0.03397177252918482
Test_acc: 1.0
--------------------------
Epoch 437, loss: 0.03393934154883027
Test_acc: 1.0
--------------------------
Epoch 438, loss: 0.03390704747289419
Test_acc: 1.0
--------------------------
Epoch 439, loss: 0.03387487819418311
Test_acc: 1.0
--------------------------
Epoch 440, loss: 0.03384283697232604
Test_acc: 1.0
--------------------------
Epoch 441, loss: 0.033810924272984266
Test_acc: 1.0
--------------------------
Epoch 442, loss: 0.03377913776785135
Test_acc: 1.0
--------------------------
Epoch 443, loss: 0.033747484907507896
Test_acc: 1.0
--------------------------
Epoch 444, loss: 0.033715959172695875
Test_acc: 1.0
--------------------------
Epoch 445, loss: 0.033684548921883106
Test_acc: 1.0
--------------------------
Epoch 446, loss: 0.03365326812490821
Test_acc: 1.0
--------------------------
Epoch 447, loss: 0.03362210327759385
Test_acc: 1.0
--------------------------
Epoch 448, loss: 0.033591081853955984
Test_acc: 1.0
--------------------------
Epoch 449, loss: 0.03356016241014004
Test_acc: 1.0
--------------------------
Epoch 450, loss: 0.033529377076774836
Test_acc: 1.0
--------------------------
Epoch 451, loss: 0.03349870443344116
Test_acc: 1.0
--------------------------
Epoch 452, loss: 0.03346816310659051
Test_acc: 1.0
--------------------------
Epoch 453, loss: 0.03343772189691663
Test_acc: 1.0
--------------------------
Epoch 454, loss: 0.033407419454306364
Test_acc: 1.0
--------------------------
Epoch 455, loss: 0.03337721945717931
Test_acc: 1.0
--------------------------
Epoch 456, loss: 0.0333471498452127
Test_acc: 1.0
--------------------------
Epoch 457, loss: 0.03331718221306801
Test_acc: 1.0
--------------------------
Epoch 458, loss: 0.03328734589740634
Test_acc: 1.0
--------------------------
Epoch 459, loss: 0.0332576185464859
Test_acc: 1.0
--------------------------
Epoch 460, loss: 0.033227997832000256
Test_acc: 1.0
--------------------------
Epoch 461, loss: 0.033198502380400896
Test_acc: 1.0
--------------------------
Epoch 462, loss: 0.03316910658031702
Test_acc: 1.0
--------------------------
Epoch 463, loss: 0.033139838837087154
Test_acc: 1.0
--------------------------
Epoch 464, loss: 0.033110679127275944
Test_acc: 1.0
--------------------------
Epoch 465, loss: 0.03308162838220596
Test_acc: 1.0
--------------------------
Epoch 466, loss: 0.033052682876586914
Test_acc: 1.0
--------------------------
Epoch 467, loss: 0.033023848198354244
Test_acc: 1.0
--------------------------
Epoch 468, loss: 0.032995129469782114
Test_acc: 1.0
--------------------------
Epoch 469, loss: 0.03296651318669319
Test_acc: 1.0
--------------------------
Epoch 470, loss: 0.03293801099061966
Test_acc: 1.0
--------------------------
Epoch 471, loss: 0.032909611240029335
Test_acc: 1.0
--------------------------
Epoch 472, loss: 0.032881323248147964
Test_acc: 1.0
--------------------------
Epoch 473, loss: 0.032853142358362675
Test_acc: 1.0
--------------------------
Epoch 474, loss: 0.032825060188770294
Test_acc: 1.0
--------------------------
Epoch 475, loss: 0.032797076273709536
Test_acc: 1.0
--------------------------
Epoch 476, loss: 0.03276920411735773
Test_acc: 1.0
--------------------------
Epoch 477, loss: 0.03274143813177943
Test_acc: 1.0
--------------------------
Epoch 478, loss: 0.03271376574411988
Test_acc: 1.0
--------------------------
Epoch 479, loss: 0.03268621163442731
Test_acc: 1.0
--------------------------
Epoch 480, loss: 0.032658747397363186
Test_acc: 1.0
--------------------------
Epoch 481, loss: 0.03263138281181455
Test_acc: 1.0
--------------------------
Epoch 482, loss: 0.0326041323132813
Test_acc: 1.0
--------------------------
Epoch 483, loss: 0.032576972618699074
Test_acc: 1.0
--------------------------
Epoch 484, loss: 0.03254991164430976
Test_acc: 1.0
--------------------------
Epoch 485, loss: 0.03252295032143593
Test_acc: 1.0
--------------------------
Epoch 486, loss: 0.032496096566319466
Test_acc: 1.0
--------------------------
Epoch 487, loss: 0.03246932663023472
Test_acc: 1.0
--------------------------
Epoch 488, loss: 0.03244265867397189
Test_acc: 1.0
--------------------------
Epoch 489, loss: 0.032416089437901974
Test_acc: 1.0
--------------------------
Epoch 490, loss: 0.032389613799750805
Test_acc: 1.0
--------------------------
Epoch 491, loss: 0.032363226637244225
Test_acc: 1.0
--------------------------
Epoch 492, loss: 0.03233695309609175
Test_acc: 1.0
--------------------------
Epoch 493, loss: 0.0323107666336
Test_acc: 1.0
--------------------------
Epoch 494, loss: 0.0322846663184464
Test_acc: 1.0
--------------------------
Epoch 495, loss: 0.03225866658613086
Test_acc: 1.0
--------------------------
Epoch 496, loss: 0.032232760451734066
Test_acc: 1.0
--------------------------
Epoch 497, loss: 0.032206928823143244
Test_acc: 1.0
--------------------------
Epoch 498, loss: 0.0321812117472291
Test_acc: 1.0
--------------------------
Epoch 499, loss: 0.03215558174997568
Test_acc: 1.0
--------------------------

Process finished with exit code 0

你可能感兴趣的:(python,神经网络,深度学习)