zhqh100

keras 的 example 文件 cifar10_resnet.py 解析

该代码功能是卷积神经网络进行图像识别，数据集是cifar10

同时演示了回调函数 ModelCheckpoint， LearningRateScheduler， ReduceLROnPlateau 的用法

输入数据的shape

x_train shape: (50000, 32, 32, 3)
y_train shape: (50000, 1)

默认的神经网络结构：

____________________________________________________________________________________________________________________________________________
Layer (type)                                  Output Shape                   Param #         Connected to
============================================================================================================================================
input_1 (InputLayer)                          (None, 32, 32, 3)              0
____________________________________________________________________________________________________________________________________________
conv2d_1 (Conv2D)                             (None, 32, 32, 16)             448             input_1[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_1 (BatchNormalization)    (None, 32, 32, 16)             64              conv2d_1[0][0]
____________________________________________________________________________________________________________________________________________
activation_1 (Activation)                     (None, 32, 32, 16)             0               batch_normalization_1[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_2 (Conv2D)                             (None, 32, 32, 16)             2320            activation_1[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_2 (BatchNormalization)    (None, 32, 32, 16)             64              conv2d_2[0][0]
____________________________________________________________________________________________________________________________________________
activation_2 (Activation)                     (None, 32, 32, 16)             0               batch_normalization_2[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_3 (Conv2D)                             (None, 32, 32, 16)             2320            activation_2[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_3 (BatchNormalization)    (None, 32, 32, 16)             64              conv2d_3[0][0]
____________________________________________________________________________________________________________________________________________
add_1 (Add)                                   (None, 32, 32, 16)             0               activation_1[0][0]
                                                                                             batch_normalization_3[0][0]
____________________________________________________________________________________________________________________________________________
activation_3 (Activation)                     (None, 32, 32, 16)             0               add_1[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_4 (Conv2D)                             (None, 32, 32, 16)             2320            activation_3[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_4 (BatchNormalization)    (None, 32, 32, 16)             64              conv2d_4[0][0]
____________________________________________________________________________________________________________________________________________
activation_4 (Activation)                     (None, 32, 32, 16)             0               batch_normalization_4[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_5 (Conv2D)                             (None, 32, 32, 16)             2320            activation_4[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_5 (BatchNormalization)    (None, 32, 32, 16)             64              conv2d_5[0][0]
____________________________________________________________________________________________________________________________________________
add_2 (Add)                                   (None, 32, 32, 16)             0               activation_3[0][0]
                                                                                             batch_normalization_5[0][0]
____________________________________________________________________________________________________________________________________________
activation_5 (Activation)                     (None, 32, 32, 16)             0               add_2[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_6 (Conv2D)                             (None, 32, 32, 16)             2320            activation_5[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_6 (BatchNormalization)    (None, 32, 32, 16)             64              conv2d_6[0][0]
____________________________________________________________________________________________________________________________________________
activation_6 (Activation)                     (None, 32, 32, 16)             0               batch_normalization_6[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_7 (Conv2D)                             (None, 32, 32, 16)             2320            activation_6[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_7 (BatchNormalization)    (None, 32, 32, 16)             64              conv2d_7[0][0]
____________________________________________________________________________________________________________________________________________
add_3 (Add)                                   (None, 32, 32, 16)             0               activation_5[0][0]
                                                                                             batch_normalization_7[0][0]
____________________________________________________________________________________________________________________________________________
activation_7 (Activation)                     (None, 32, 32, 16)             0               add_3[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_8 (Conv2D)                             (None, 16, 16, 32)             4640            activation_7[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_8 (BatchNormalization)    (None, 16, 16, 32)             128             conv2d_8[0][0]
____________________________________________________________________________________________________________________________________________
activation_8 (Activation)                     (None, 16, 16, 32)             0               batch_normalization_8[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_9 (Conv2D)                             (None, 16, 16, 32)             9248            activation_8[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_10 (Conv2D)                            (None, 16, 16, 32)             544             activation_7[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_9 (BatchNormalization)    (None, 16, 16, 32)             128             conv2d_9[0][0]
____________________________________________________________________________________________________________________________________________
add_4 (Add)                                   (None, 16, 16, 32)             0               conv2d_10[0][0]
                                                                                             batch_normalization_9[0][0]
____________________________________________________________________________________________________________________________________________
activation_9 (Activation)                     (None, 16, 16, 32)             0               add_4[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_11 (Conv2D)                            (None, 16, 16, 32)             9248            activation_9[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_10 (BatchNormalization)   (None, 16, 16, 32)             128             conv2d_11[0][0]
____________________________________________________________________________________________________________________________________________
activation_10 (Activation)                    (None, 16, 16, 32)             0               batch_normalization_10[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_12 (Conv2D)                            (None, 16, 16, 32)             9248            activation_10[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_11 (BatchNormalization)   (None, 16, 16, 32)             128             conv2d_12[0][0]
____________________________________________________________________________________________________________________________________________
add_5 (Add)                                   (None, 16, 16, 32)             0               activation_9[0][0]
                                                                                             batch_normalization_11[0][0]
____________________________________________________________________________________________________________________________________________
activation_11 (Activation)                    (None, 16, 16, 32)             0               add_5[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_13 (Conv2D)                            (None, 16, 16, 32)             9248            activation_11[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_12 (BatchNormalization)   (None, 16, 16, 32)             128             conv2d_13[0][0]
____________________________________________________________________________________________________________________________________________
activation_12 (Activation)                    (None, 16, 16, 32)             0               batch_normalization_12[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_14 (Conv2D)                            (None, 16, 16, 32)             9248            activation_12[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_13 (BatchNormalization)   (None, 16, 16, 32)             128             conv2d_14[0][0]
____________________________________________________________________________________________________________________________________________
add_6 (Add)                                   (None, 16, 16, 32)             0               activation_11[0][0]
                                                                                             batch_normalization_13[0][0]
____________________________________________________________________________________________________________________________________________
activation_13 (Activation)                    (None, 16, 16, 32)             0               add_6[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_15 (Conv2D)                            (None, 8, 8, 64)               18496           activation_13[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_14 (BatchNormalization)   (None, 8, 8, 64)               256             conv2d_15[0][0]
____________________________________________________________________________________________________________________________________________
activation_14 (Activation)                    (None, 8, 8, 64)               0               batch_normalization_14[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_16 (Conv2D)                            (None, 8, 8, 64)               36928           activation_14[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_17 (Conv2D)                            (None, 8, 8, 64)               2112            activation_13[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_15 (BatchNormalization)   (None, 8, 8, 64)               256             conv2d_16[0][0]
____________________________________________________________________________________________________________________________________________
add_7 (Add)                                   (None, 8, 8, 64)               0               conv2d_17[0][0]
                                                                                             batch_normalization_15[0][0]
____________________________________________________________________________________________________________________________________________
activation_15 (Activation)                    (None, 8, 8, 64)               0               add_7[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_18 (Conv2D)                            (None, 8, 8, 64)               36928           activation_15[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_16 (BatchNormalization)   (None, 8, 8, 64)               256             conv2d_18[0][0]
____________________________________________________________________________________________________________________________________________
activation_16 (Activation)                    (None, 8, 8, 64)               0               batch_normalization_16[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_19 (Conv2D)                            (None, 8, 8, 64)               36928           activation_16[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_17 (BatchNormalization)   (None, 8, 8, 64)               256             conv2d_19[0][0]
____________________________________________________________________________________________________________________________________________
add_8 (Add)                                   (None, 8, 8, 64)               0               activation_15[0][0]
                                                                                             batch_normalization_17[0][0]
____________________________________________________________________________________________________________________________________________
activation_17 (Activation)                    (None, 8, 8, 64)               0               add_8[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_20 (Conv2D)                            (None, 8, 8, 64)               36928           activation_17[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_18 (BatchNormalization)   (None, 8, 8, 64)               256             conv2d_20[0][0]
____________________________________________________________________________________________________________________________________________
activation_18 (Activation)                    (None, 8, 8, 64)               0               batch_normalization_18[0][0]
____________________________________________________________________________________________________________________________________________
conv2d_21 (Conv2D)                            (None, 8, 8, 64)               36928           activation_18[0][0]
____________________________________________________________________________________________________________________________________________
batch_normalization_19 (BatchNormalization)   (None, 8, 8, 64)               256             conv2d_21[0][0]
____________________________________________________________________________________________________________________________________________
add_9 (Add)                                   (None, 8, 8, 64)               0               activation_17[0][0]
                                                                                             batch_normalization_19[0][0]
____________________________________________________________________________________________________________________________________________
activation_19 (Activation)                    (None, 8, 8, 64)               0               add_9[0][0]
____________________________________________________________________________________________________________________________________________
average_pooling2d_1 (AveragePooling2D)        (None, 1, 1, 64)               0               activation_19[0][0]
____________________________________________________________________________________________________________________________________________
flatten_1 (Flatten)                           (None, 64)                     0               average_pooling2d_1[0][0]
____________________________________________________________________________________________________________________________________________
dense_1 (Dense)                               (None, 10)                     650             flatten_1[0][0]
============================================================================================================================================
Total params: 274,442
Trainable params: 273,066
Non-trainable params: 1,376
____________________________________________________________________________________________________________________________________________

按说 ReduceLROnPlateau 和 LearningRateScheduler 都可以调整学习率，但是两个同时用就很奇怪，下面添加一个很无聊的日志打印，可以看到，在这个演示中， ReduceLROnPlateau 没有机会起到作用，实际学习率被 LearningRateScheduler 掌控了

Using real-time data augmentation.
Epoch 1/200
Learning rate:  0.001
2020-03-30 14:35:22.037154: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cublas64_10.dll
2020-03-30 14:35:22.308184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudnn64_7.dll
2020-03-30 14:35:23.351692: W tensorflow/stream_executor/gpu/redzone_allocator.cc:312] Internal: Invoking GPU asm compilation is supported on Cuda non-Windows platforms only
Relying on driver to perform ptx compilation. This message will be only logged once.
1563/1563 [==============================] - 98s 63ms/step - loss: 1.5917 - accuracy: 0.4782 - val_loss: 1.5505 - val_accuracy: 0.5016
C:\ProgramData\Miniconda3\lib\site-packages\keras\callbacks\callbacks.py:707: RuntimeWarning: Can save best model only with val_acc available, skipping.
  'skipping.' % (self.monitor), RuntimeWarning)
Epoch 2/200
Learning rate:  0.001
1563/1563 [==============================] - 94s 60ms/step - loss: 1.2313 - accuracy: 0.6161 - val_loss: 1.1633 - val_accuracy: 0.6397
Epoch 3/200
Learning rate:  0.001
1563/1563 [==============================] - 94s 60ms/step - loss: 1.0533 - accuracy: 0.6842 - val_loss: 1.0276 - val_accuracy: 0.6976
Epoch 4/200
Learning rate:  0.001
1563/1563 [==============================] - 92s 59ms/step - loss: 0.9482 - accuracy: 0.7261 - val_loss: 1.2751 - val_accuracy: 0.6241
Epoch 5/200
Learning rate:  0.001
1563/1563 [==============================] - 98s 63ms/step - loss: 0.8763 - accuracy: 0.7547 - val_loss: 1.1799 - val_accuracy: 0.6838
Epoch 6/200
Learning rate:  0.001
1563/1563 [==============================] - 93s 59ms/step - loss: 0.8290 - accuracy: 0.7732 - val_loss: 0.8725 - val_accuracy: 0.7599
Epoch 7/200
Learning rate:  0.001
1563/1563 [==============================] - 94s 60ms/step - loss: 0.7937 - accuracy: 0.7866 - val_loss: 1.1870 - val_accuracy: 0.6852
Epoch 8/200
Learning rate:  0.001
1563/1563 [==============================] - 97s 62ms/step - loss: 0.7625 - accuracy: 0.7994 - val_loss: 0.8278 - val_accuracy: 0.7790
Epoch 9/200
Learning rate:  0.001
1563/1563 [==============================] - 99s 63ms/step - loss: 0.7379 - accuracy: 0.8089 - val_loss: 0.9497 - val_accuracy: 0.7545
Epoch 10/200
Learning rate:  0.001
1563/1563 [==============================] - 91s 58ms/step - loss: 0.7212 - accuracy: 0.8143 - val_loss: 0.8850 - val_accuracy: 0.7719
Epoch 11/200
Learning rate:  0.001
1563/1563 [==============================] - 95s 60ms/step - loss: 0.6999 - accuracy: 0.8225 - val_loss: 0.8480 - val_accuracy: 0.7767
Epoch 12/200
Learning rate:  0.001
1563/1563 [==============================] - 93s 60ms/step - loss: 0.6896 - accuracy: 0.8265 - val_loss: 0.7616 - val_accuracy: 0.8063
Epoch 13/200
Learning rate:  0.001
1563/1563 [==============================] - 91s 58ms/step - loss: 0.6746 - accuracy: 0.8338 - val_loss: 0.8415 - val_accuracy: 0.7851
Epoch 14/200
Learning rate:  0.001
1563/1563 [==============================] - 98s 63ms/step - loss: 0.6642 - accuracy: 0.8378 - val_loss: 0.8608 - val_accuracy: 0.7775
Epoch 15/200
Learning rate:  0.001
1563/1563 [==============================] - 94s 60ms/step - loss: 0.6501 - accuracy: 0.8423 - val_loss: 0.8510 - val_accuracy: 0.7770
Epoch 16/200
Learning rate:  0.001
1563/1563 [==============================] - 89s 57ms/step - loss: 0.6393 - accuracy: 0.8479 - val_loss: 0.8638 - val_accuracy: 0.7814
Epoch 17/200
Learning rate:  0.001
1563/1563 [==============================] - 95s 61ms/step - loss: 0.6355 - accuracy: 0.8470 - val_loss: 0.7241 - val_accuracy: 0.8216
Epoch 18/200
Learning rate:  0.001
1563/1563 [==============================] - 91s 58ms/step - loss: 0.6221 - accuracy: 0.8524 - val_loss: 1.1078 - val_accuracy: 0.7379
Epoch 19/200
Learning rate:  0.001
1563/1563 [==============================] - 92s 59ms/step - loss: 0.6178 - accuracy: 0.8549 - val_loss: 0.7532 - val_accuracy: 0.8163
Epoch 20/200
Learning rate:  0.001
1563/1563 [==============================] - 96s 62ms/step - loss: 0.6091 - accuracy: 0.8578 - val_loss: 0.6477 - val_accuracy: 0.8508
Epoch 21/200
Learning rate:  0.001
1563/1563 [==============================] - 94s 60ms/step - loss: 0.6051 - accuracy: 0.8596 - val_loss: 0.8007 - val_accuracy: 0.8062
Epoch 22/200
Learning rate:  0.001
1563/1563 [==============================] - 94s 60ms/step - loss: 0.6003 - accuracy: 0.8621 - val_loss: 0.7801 - val_accuracy: 0.8096
Epoch 23/200
Learning rate:  0.001
1563/1563 [==============================] - 96s 62ms/step - loss: 0.6010 - accuracy: 0.8594 - val_loss: 0.7796 - val_accuracy: 0.8145
Epoch 24/200
Learning rate:  0.001
1563/1563 [==============================] - 95s 61ms/step - loss: 0.5891 - accuracy: 0.8652 - val_loss: 0.6671 - val_accuracy: 0.8459
Epoch 25/200
Learning rate:  0.001
1563/1563 [==============================] - 101s 65ms/step - loss: 0.5896 - accuracy: 0.8654 - val_loss: 0.7667 - val_accuracy: 0.8187
Epoch 26/200
Learning rate:  0.001
1563/1563 [==============================] - 103s 66ms/step - loss: 0.5820 - accuracy: 0.8691 - val_loss: 0.6568 - val_accuracy: 0.8508
Epoch 27/200
Learning rate:  0.001
1563/1563 [==============================] - 99s 63ms/step - loss: 0.5797 - accuracy: 0.8689 - val_loss: 0.7201 - val_accuracy: 0.8269
Epoch 28/200
Learning rate:  0.001
1563/1563 [==============================] - 94s 60ms/step - loss: 0.5771 - accuracy: 0.8702 - val_loss: 0.6693 - val_accuracy: 0.8477
Epoch 29/200
Learning rate:  0.001
1563/1563 [==============================] - 97s 62ms/step - loss: 0.5693 - accuracy: 0.8740 - val_loss: 1.0859 - val_accuracy: 0.7421
Epoch 30/200
Learning rate:  0.001
1563/1563 [==============================] - 101s 64ms/step - loss: 0.5706 - accuracy: 0.8738 - val_loss: 0.7400 - val_accuracy: 0.8251
Epoch 31/200
Learning rate:  0.001
1563/1563 [==============================] - 95s 61ms/step - loss: 0.5658 - accuracy: 0.8748 - val_loss: 0.7000 - val_accuracy: 0.8332
Epoch 32/200
Learning rate:  0.001
1563/1563 [==============================] - 99s 63ms/step - loss: 0.5626 - accuracy: 0.8774 - val_loss: 0.8014 - val_accuracy: 0.8078
Epoch 33/200
Learning rate:  0.001
1563/1563 [==============================] - 102s 66ms/step - loss: 0.5619 - accuracy: 0.8760 - val_loss: 0.8234 - val_accuracy: 0.7989
Epoch 34/200
Learning rate:  0.001
1563/1563 [==============================] - 93s 59ms/step - loss: 0.5573 - accuracy: 0.8785 - val_loss: 0.6726 - val_accuracy: 0.8442
Epoch 35/200
Learning rate:  0.001
1563/1563 [==============================] - 101s 65ms/step - loss: 0.5550 - accuracy: 0.8783 - val_loss: 0.9754 - val_accuracy: 0.7682
Epoch 36/200
Learning rate:  0.001
1563/1563 [==============================] - 101s 64ms/step - loss: 0.5540 - accuracy: 0.8799 - val_loss: 0.7412 - val_accuracy: 0.8246
Epoch 37/200
Learning rate:  0.001
1563/1563 [==============================] - 94s 60ms/step - loss: 0.5478 - accuracy: 0.8810 - val_loss: 0.7362 - val_accuracy: 0.8321
Epoch 38/200
Learning rate:  0.001
1563/1563 [==============================] - 94s 60ms/step - loss: 0.5461 - accuracy: 0.8832 - val_loss: 0.6396 - val_accuracy: 0.8605
Epoch 39/200
Learning rate:  0.001
1563/1563 [==============================] - 95s 61ms/step - loss: 0.5417 - accuracy: 0.8849 - val_loss: 0.6857 - val_accuracy: 0.8451
Epoch 40/200
Learning rate:  0.001
1563/1563 [==============================] - 94s 60ms/step - loss: 0.5427 - accuracy: 0.8840 - val_loss: 0.6789 - val_accuracy: 0.8469
Epoch 41/200
Learning rate:  0.001
1563/1563 [==============================] - 99s 64ms/step - loss: 0.5400 - accuracy: 0.8857 - val_loss: 0.7397 - val_accuracy: 0.8308
Epoch 42/200
Learning rate:  0.001
1563/1563 [==============================] - 101s 65ms/step - loss: 0.5460 - accuracy: 0.8836 - val_loss: 0.7218 - val_accuracy: 0.8360
Epoch 43/200
Learning rate:  0.001
1563/1563 [==============================] - 95s 61ms/step - loss: 0.5358 - accuracy: 0.8877 - val_loss: 0.6488 - val_accuracy: 0.8531
Epoch 44/200
Learning rate:  0.001
1563/1563 [==============================] - 98s 63ms/step - loss: 0.5342 - accuracy: 0.8867 - val_loss: 0.6707 - val_accuracy: 0.8507
Epoch 45/200
Learning rate:  0.001
1563/1563 [==============================] - 98s 63ms/step - loss: 0.5338 - accuracy: 0.8875 - val_loss: 0.6588 - val_accuracy: 0.8493
Epoch 46/200
Learning rate:  0.001
1563/1563 [==============================] - 96s 61ms/step - loss: 0.5307 - accuracy: 0.8870 - val_loss: 0.8961 - val_accuracy: 0.7928
Epoch 47/200
Learning rate:  0.001
1563/1563 [==============================] - 98s 63ms/step - loss: 0.5302 - accuracy: 0.8877 - val_loss: 0.7348 - val_accuracy: 0.8391
Epoch 48/200
Learning rate:  0.001
1563/1563 [==============================] - 100s 64ms/step - loss: 0.5333 - accuracy: 0.8873 - val_loss: 0.6815 - val_accuracy: 0.8498
Epoch 49/200
Learning rate:  0.001
1563/1563 [==============================] - 95s 61ms/step - loss: 0.5267 - accuracy: 0.8914 - val_loss: 0.7237 - val_accuracy: 0.8390
Epoch 50/200
Learning rate:  0.001
1563/1563 [==============================] - 101s 65ms/step - loss: 0.5304 - accuracy: 0.8882 - val_loss: 0.6860 - val_accuracy: 0.8454
Epoch 51/200
Learning rate:  0.001
1563/1563 [==============================] - 97s 62ms/step - loss: 0.5238 - accuracy: 0.8915 - val_loss: 0.6352 - val_accuracy: 0.8598
Epoch 52/200
Learning rate:  0.001
1563/1563 [==============================] - 94s 60ms/step - loss: 0.5250 - accuracy: 0.8898 - val_loss: 0.8026 - val_accuracy: 0.8173
Epoch 53/200
Learning rate:  0.001
1563/1563 [==============================] - 98s 63ms/step - loss: 0.5244 - accuracy: 0.8906 - val_loss: 0.6443 - val_accuracy: 0.8586
Epoch 54/200
Learning rate:  0.001
1563/1563 [==============================] - 99s 64ms/step - loss: 0.5236 - accuracy: 0.8918 - val_loss: 0.9139 - val_accuracy: 0.7908
Epoch 55/200
Learning rate:  0.001
1563/1563 [==============================] - 96s 61ms/step - loss: 0.5212 - accuracy: 0.8925 - val_loss: 0.6718 - val_accuracy: 0.8489
Epoch 56/200
Learning rate:  0.001
1563/1563 [==============================] - 99s 63ms/step - loss: 0.5193 - accuracy: 0.8938 - val_loss: 0.6052 - val_accuracy: 0.8678
Epoch 57/200
Learning rate:  0.001
1563/1563 [==============================] - 97s 62ms/step - loss: 0.5212 - accuracy: 0.8915 - val_loss: 0.8292 - val_accuracy: 0.8088
Epoch 58/200
Learning rate:  0.001
1563/1563 [==============================] - 96s 62ms/step - loss: 0.5177 - accuracy: 0.8933 - val_loss: 0.7282 - val_accuracy: 0.8370
Epoch 59/200
Learning rate:  0.001
1563/1563 [==============================] - 99s 63ms/step - loss: 0.5150 - accuracy: 0.8958 - val_loss: 0.6112 - val_accuracy: 0.8663
Epoch 60/200
Learning rate:  0.001
1563/1563 [==============================] - 101s 65ms/step - loss: 0.5133 - accuracy: 0.8945 - val_loss: 0.7822 - val_accuracy: 0.8178
Epoch 61/200
Learning rate:  0.001
1563/1563 [==============================] - 93s 60ms/step - loss: 0.5164 - accuracy: 0.8936 - val_loss: 0.6592 - val_accuracy: 0.8560
Epoch 62/200
Learning rate:  0.001
1563/1563 [==============================] - 100s 64ms/step - loss: 0.5141 - accuracy: 0.8953 - val_loss: 0.6427 - val_accuracy: 0.8583
Epoch 63/200
Learning rate:  0.001
1563/1563 [==============================] - 100s 64ms/step - loss: 0.5143 - accuracy: 0.8952 - val_loss: 0.6357 - val_accuracy: 0.8587
Epoch 64/200
Learning rate:  0.001
1563/1563 [==============================] - 97s 62ms/step - loss: 0.5101 - accuracy: 0.8953 - val_loss: 0.7361 - val_accuracy: 0.8427
Epoch 65/200
Learning rate:  0.001
1563/1563 [==============================] - 100s 64ms/step - loss: 0.5068 - accuracy: 0.8962 - val_loss: 0.6661 - val_accuracy: 0.8537
Epoch 66/200
Learning rate:  0.001
1563/1563 [==============================] - 101s 64ms/step - loss: 0.5126 - accuracy: 0.8959 - val_loss: 0.8921 - val_accuracy: 0.8074
Epoch 67/200
Learning rate:  0.001
1563/1563 [==============================] - 98s 62ms/step - loss: 0.5054 - accuracy: 0.8982 - val_loss: 0.6273 - val_accuracy: 0.8628
Epoch 68/200
Learning rate:  0.001
1563/1563 [==============================] - 98s 63ms/step - loss: 0.5067 - accuracy: 0.8973 - val_loss: 0.6847 - val_accuracy: 0.8505
Epoch 69/200
Learning rate:  0.001
1563/1563 [==============================] - 97s 62ms/step - loss: 0.5024 - accuracy: 0.8994 - val_loss: 0.7245 - val_accuracy: 0.8410
Epoch 70/200
Learning rate:  0.001
1563/1563 [==============================] - 96s 62ms/step - loss: 0.5029 - accuracy: 0.8985 - val_loss: 0.7776 - val_accuracy: 0.8251
Epoch 71/200
Learning rate:  0.001
1563/1563 [==============================] - 100s 64ms/step - loss: 0.5032 - accuracy: 0.8990 - val_loss: 0.8186 - val_accuracy: 0.8204
Epoch 72/200
Learning rate:  0.001
1563/1563 [==============================] - 101s 65ms/step - loss: 0.4986 - accuracy: 0.8993 - val_loss: 0.6269 - val_accuracy: 0.8642
Epoch 73/200
Learning rate:  0.001
1563/1563 [==============================] - 96s 61ms/step - loss: 0.5010 - accuracy: 0.9007 - val_loss: 0.6221 - val_accuracy: 0.8692
Epoch 74/200
Learning rate:  0.001
1563/1563 [==============================] - 97s 62ms/step - loss: 0.4985 - accuracy: 0.8998 - val_loss: 0.8424 - val_accuracy: 0.8088
Epoch 75/200
Learning rate:  0.001
1563/1563 [==============================] - 100s 64ms/step - loss: 0.5012 - accuracy: 0.8994 - val_loss: 0.7132 - val_accuracy: 0.8388
Epoch 76/200
Learning rate:  0.001
1563/1563 [==============================] - 92s 59ms/step - loss: 0.5027 - accuracy: 0.8987 - val_loss: 0.6768 - val_accuracy: 0.8448
Epoch 77/200
Learning rate:  0.001
1563/1563 [==============================] - 98s 62ms/step - loss: 0.4966 - accuracy: 0.9006 - val_loss: 0.6833 - val_accuracy: 0.8494
Epoch 78/200
Learning rate:  0.001
1563/1563 [==============================] - 96s 61ms/step - loss: 0.5039 - accuracy: 0.8976 - val_loss: 0.6121 - val_accuracy: 0.8681
Epoch 79/200
Learning rate:  0.001
1563/1563 [==============================] - 94s 60ms/step - loss: 0.4977 - accuracy: 0.9016 - val_loss: 0.7325 - val_accuracy: 0.8442
Epoch 80/200
Learning rate:  0.001
1563/1563 [==============================] - 96s 61ms/step - loss: 0.4955 - accuracy: 0.9009 - val_loss: 0.6505 - val_accuracy: 0.8569
Epoch 81/200
Learning rate:  0.001
1563/1563 [==============================] - 96s 62ms/step - loss: 0.4925 - accuracy: 0.9017 - val_loss: 0.6268 - val_accuracy: 0.8655
Epoch 82/200
Learning rate:  0.0001
1563/1563 [==============================] - 98s 62ms/step - loss: 0.4126 - accuracy: 0.9286 - val_loss: 0.5112 - val_accuracy: 0.8999
Epoch 83/200
Learning rate:  0.0001
1563/1563 [==============================] - 96s 61ms/step - loss: 0.3749 - accuracy: 0.9407 - val_loss: 0.5044 - val_accuracy: 0.9022
Epoch 84/200
Learning rate:  0.0001
1563/1563 [==============================] - 99s 63ms/step - loss: 0.3620 - accuracy: 0.9446 - val_loss: 0.4960 - val_accuracy: 0.9054
Epoch 85/200
Learning rate:  0.0001
1563/1563 [==============================] - 97s 62ms/step - loss: 0.3490 - accuracy: 0.9462 - val_loss: 0.4931 - val_accuracy: 0.9064
Epoch 86/200
Learning rate:  0.0001
1563/1563 [==============================] - 100s 64ms/step - loss: 0.3375 - accuracy: 0.9496 - val_loss: 0.4849 - val_accuracy: 0.9048
Epoch 87/200
Learning rate:  0.0001
1563/1563 [==============================] - 94s 60ms/step - loss: 0.3306 - accuracy: 0.9523 - val_loss: 0.4776 - val_accuracy: 0.9066
Epoch 88/200
Learning rate:  0.0001
1563/1563 [==============================] - 95s 60ms/step - loss: 0.3230 - accuracy: 0.9527 - val_loss: 0.4767 - val_accuracy: 0.9078
Epoch 89/200
Learning rate:  0.0001
1563/1563 [==============================] - 99s 63ms/step - loss: 0.3177 - accuracy: 0.9541 - val_loss: 0.4885 - val_accuracy: 0.9055
Epoch 90/200
Learning rate:  0.0001
1563/1563 [==============================] - 99s 63ms/step - loss: 0.3120 - accuracy: 0.9544 - val_loss: 0.4663 - val_accuracy: 0.9097
Epoch 91/200
Learning rate:  0.0001
1563/1563 [==============================] - 93s 59ms/step - loss: 0.3049 - accuracy: 0.9562 - val_loss: 0.4675 - val_accuracy: 0.9110
Epoch 92/200
Learning rate:  0.0001
1563/1563 [==============================] - 96s 61ms/step - loss: 0.2961 - accuracy: 0.9582 - val_loss: 0.4800 - val_accuracy: 0.9059
Epoch 93/200
Learning rate:  0.0001
1563/1563 [==============================] - 95s 61ms/step - loss: 0.2946 - accuracy: 0.9577 - val_loss: 0.4724 - val_accuracy: 0.9093
Epoch 94/200
Learning rate:  0.0001
1563/1563 [==============================] - 92s 59ms/step - loss: 0.2884 - accuracy: 0.9593 - val_loss: 0.4710 - val_accuracy: 0.9101
Epoch 95/200
Learning rate:  0.0001
1563/1563 [==============================] - 99s 63ms/step - loss: 0.2842 - accuracy: 0.9598 - val_loss: 0.4719 - val_accuracy: 0.9072
Epoch 96/200
Learning rate:  0.0001
1563/1563 [==============================] - 99s 63ms/step - loss: 0.2787 - accuracy: 0.9616 - val_loss: 0.4642 - val_accuracy: 0.9115
Epoch 97/200
Learning rate:  0.0001
1563/1563 [==============================] - 96s 62ms/step - loss: 0.2732 - accuracy: 0.9623 - val_loss: 0.4672 - val_accuracy: 0.9078
Epoch 98/200
Learning rate:  0.0001
1563/1563 [==============================] - 97s 62ms/step - loss: 0.2695 - accuracy: 0.9634 - val_loss: 0.4602 - val_accuracy: 0.9099
Epoch 99/200
Learning rate:  0.0001
1563/1563 [==============================] - 100s 64ms/step - loss: 0.2671 - accuracy: 0.9632 - val_loss: 0.4683 - val_accuracy: 0.9077
Epoch 100/200
Learning rate:  0.0001
1563/1563 [==============================] - 98s 62ms/step - loss: 0.2623 - accuracy: 0.9642 - val_loss: 0.4616 - val_accuracy: 0.9080
Epoch 101/200
Learning rate:  0.0001
1563/1563 [==============================] - 99s 63ms/step - loss: 0.2615 - accuracy: 0.9630 - val_loss: 0.4519 - val_accuracy: 0.9124
Epoch 102/200
Learning rate:  0.0001
1563/1563 [==============================] - 100s 64ms/step - loss: 0.2539 - accuracy: 0.9658 - val_loss: 0.4647 - val_accuracy: 0.9109
Epoch 103/200
Learning rate:  0.0001
1563/1563 [==============================] - 93s 60ms/step - loss: 0.2512 - accuracy: 0.9661 - val_loss: 0.4578 - val_accuracy: 0.9097
Epoch 104/200
Learning rate:  0.0001
1563/1563 [==============================] - 102s 65ms/step - loss: 0.2491 - accuracy: 0.9660 - val_loss: 0.4634 - val_accuracy: 0.9100
Epoch 105/200
Learning rate:  0.0001
1563/1563 [==============================] - 96s 61ms/step - loss: 0.2445 - accuracy: 0.9672 - val_loss: 0.4574 - val_accuracy: 0.9119
Epoch 106/200
Learning rate:  0.0001
1563/1563 [==============================] - 98s 63ms/step - loss: 0.2439 - accuracy: 0.9666 - val_loss: 0.4641 - val_accuracy: 0.9076
Epoch 107/200
Learning rate:  0.0001
1563/1563 [==============================] - 98s 63ms/step - loss: 0.2399 - accuracy: 0.9677 - val_loss: 0.4651 - val_accuracy: 0.9108
Epoch 108/200
Learning rate:  0.0001
1563/1563 [==============================] - 101s 65ms/step - loss: 0.2370 - accuracy: 0.9684 - val_loss: 0.4523 - val_accuracy: 0.9139
Epoch 109/200
Learning rate:  0.0001
1563/1563 [==============================] - 97s 62ms/step - loss: 0.2357 - accuracy: 0.9686 - val_loss: 0.4567 - val_accuracy: 0.9094
Epoch 110/200
Learning rate:  0.0001
1563/1563 [==============================] - 100s 64ms/step - loss: 0.2326 - accuracy: 0.9689 - val_loss: 0.4692 - val_accuracy: 0.9070
Epoch 111/200
Learning rate:  0.0001
1563/1563 [==============================] - 96s 61ms/step - loss: 0.2292 - accuracy: 0.9698 - val_loss: 0.4608 - val_accuracy: 0.9096
Epoch 112/200
Learning rate:  0.0001
1563/1563 [==============================] - 95s 61ms/step - loss: 0.2238 - accuracy: 0.9718 - val_loss: 0.4633 - val_accuracy: 0.9092
Epoch 113/200
Learning rate:  0.0001
1563/1563 [==============================] - 95s 61ms/step - loss: 0.2247 - accuracy: 0.9703 - val_loss: 0.4741 - val_accuracy: 0.9083
Epoch 114/200
Learning rate:  0.0001
1563/1563 [==============================] - 95s 61ms/step - loss: 0.2212 - accuracy: 0.9722 - val_loss: 0.4676 - val_accuracy: 0.9066
Epoch 115/200
Learning rate:  0.0001
1563/1563 [==============================] - 90s 58ms/step - loss: 0.2228 - accuracy: 0.9704 - val_loss: 0.4635 - val_accuracy: 0.9100
Epoch 116/200
Learning rate:  0.0001
1563/1563 [==============================] - 93s 59ms/step - loss: 0.2184 - accuracy: 0.9710 - val_loss: 0.4772 - val_accuracy: 0.9083
Epoch 117/200
Learning rate:  0.0001
1563/1563 [==============================] - 95s 61ms/step - loss: 0.2153 - accuracy: 0.9723 - val_loss: 0.4661 - val_accuracy: 0.9078
Epoch 118/200
Learning rate:  0.0001
1563/1563 [==============================] - 86s 55ms/step - loss: 0.2125 - accuracy: 0.9725 - val_loss: 0.4642 - val_accuracy: 0.9085
Epoch 119/200
Learning rate:  0.0001
1563/1563 [==============================] - 95s 61ms/step - loss: 0.2131 - accuracy: 0.9724 - val_loss: 0.4626 - val_accuracy: 0.9092
Epoch 120/200
Learning rate:  0.0001
1563/1563 [==============================] - 96s 61ms/step - loss: 0.2100 - accuracy: 0.9729 - val_loss: 0.4905 - val_accuracy: 0.9051
Epoch 121/200
Learning rate:  0.0001
1563/1563 [==============================] - 88s 57ms/step - loss: 0.2070 - accuracy: 0.9732 - val_loss: 0.4681 - val_accuracy: 0.9072
Epoch 122/200
Learning rate:  1e-05
1563/1563 [==============================] - 94s 60ms/step - loss: 0.1978 - accuracy: 0.9759 - val_loss: 0.4565 - val_accuracy: 0.9086
Epoch 123/200
Learning rate:  1e-05
1563/1563 [==============================] - 92s 59ms/step - loss: 0.1934 - accuracy: 0.9791 - val_loss: 0.4514 - val_accuracy: 0.9107
Epoch 124/200
Learning rate:  1e-05
1563/1563 [==============================] - 89s 57ms/step - loss: 0.1929 - accuracy: 0.9788 - val_loss: 0.4530 - val_accuracy: 0.9104
Epoch 125/200
Learning rate:  1e-05
1563/1563 [==============================] - 97s 62ms/step - loss: 0.1916 - accuracy: 0.9789 - val_loss: 0.4515 - val_accuracy: 0.9101
Epoch 126/200
Learning rate:  1e-05
1563/1563 [==============================] - 92s 59ms/step - loss: 0.1895 - accuracy: 0.9800 - val_loss: 0.4483 - val_accuracy: 0.9119
Epoch 127/200
Learning rate:  1e-05
1563/1563 [==============================] - 97s 62ms/step - loss: 0.1913 - accuracy: 0.9794 - val_loss: 0.4525 - val_accuracy: 0.9110
Epoch 128/200
Learning rate:  1e-05
1563/1563 [==============================] - 95s 61ms/step - loss: 0.1900 - accuracy: 0.9793 - val_loss: 0.4514 - val_accuracy: 0.9107
Epoch 129/200
Learning rate:  1e-05
1563/1563 [==============================] - 99s 64ms/step - loss: 0.1881 - accuracy: 0.9805 - val_loss: 0.4504 - val_accuracy: 0.9114
Epoch 130/200
Learning rate:  1e-05
1563/1563 [==============================] - 104s 66ms/step - loss: 0.1877 - accuracy: 0.9801 - val_loss: 0.4500 - val_accuracy: 0.9113
Epoch 131/200
Learning rate:  1e-05
1563/1563 [==============================] - 97s 62ms/step - loss: 0.1870 - accuracy: 0.9804 - val_loss: 0.4493 - val_accuracy: 0.9117
Epoch 132/200
Learning rate:  1e-05
1563/1563 [==============================] - 96s 62ms/step - loss: 0.1873 - accuracy: 0.9803 - val_loss: 0.4483 - val_accuracy: 0.9118
Epoch 133/200
Learning rate:  1e-05
1563/1563 [==============================] - 92s 59ms/step - loss: 0.1867 - accuracy: 0.9804 - val_loss: 0.4503 - val_accuracy: 0.9127
Epoch 134/200
Learning rate:  1e-05
1563/1563 [==============================] - 96s 61ms/step - loss: 0.1853 - accuracy: 0.9804 - val_loss: 0.4510 - val_accuracy: 0.9118
Epoch 135/200
Learning rate:  1e-05
1563/1563 [==============================] - 94s 60ms/step - loss: 0.1874 - accuracy: 0.9806 - val_loss: 0.4525 - val_accuracy: 0.9113
Epoch 136/200
Learning rate:  1e-05
1563/1563 [==============================] - 90s 58ms/step - loss: 0.1844 - accuracy: 0.9813 - val_loss: 0.4498 - val_accuracy: 0.9123
Epoch 137/200
Learning rate:  1e-05
1563/1563 [==============================] - 99s 63ms/step - loss: 0.1862 - accuracy: 0.9805 - val_loss: 0.4480 - val_accuracy: 0.9134
Epoch 138/200
Learning rate:  1e-05
1563/1563 [==============================] - 90s 58ms/step - loss: 0.1841 - accuracy: 0.9806 - val_loss: 0.4484 - val_accuracy: 0.9134
Epoch 139/200
Learning rate:  1e-05
1563/1563 [==============================] - 94s 60ms/step - loss: 0.1839 - accuracy: 0.9805 - val_loss: 0.4488 - val_accuracy: 0.9123
Epoch 140/200
Learning rate:  1e-05
1563/1563 [==============================] - 97s 62ms/step - loss: 0.1819 - accuracy: 0.9820 - val_loss: 0.4468 - val_accuracy: 0.9125
Epoch 141/200
Learning rate:  1e-05
1563/1563 [==============================] - 95s 61ms/step - loss: 0.1820 - accuracy: 0.9820 - val_loss: 0.4463 - val_accuracy: 0.9119
Epoch 142/200
Learning rate:  1e-05
1563/1563 [==============================] - 90s 58ms/step - loss: 0.1831 - accuracy: 0.9811 - val_loss: 0.4513 - val_accuracy: 0.9125
Epoch 143/200
Learning rate:  1e-05
1563/1563 [==============================] - 96s 61ms/step - loss: 0.1830 - accuracy: 0.9813 - val_loss: 0.4491 - val_accuracy: 0.9117
Epoch 144/200
Learning rate:  1e-05
1563/1563 [==============================] - 97s 62ms/step - loss: 0.1802 - accuracy: 0.9830 - val_loss: 0.4513 - val_accuracy: 0.9127
Epoch 145/200
Learning rate:  1e-05
1563/1563 [==============================] - 99s 64ms/step - loss: 0.1793 - accuracy: 0.9829 - val_loss: 0.4513 - val_accuracy: 0.9128
Epoch 146/200
Learning rate:  1e-05
1563/1563 [==============================] - 98s 63ms/step - loss: 0.1819 - accuracy: 0.9812 - val_loss: 0.4494 - val_accuracy: 0.9124
Epoch 147/200
Learning rate:  1e-05
1563/1563 [==============================] - 91s 58ms/step - loss: 0.1818 - accuracy: 0.9803 - val_loss: 0.4512 - val_accuracy: 0.9120
Epoch 148/200
Learning rate:  1e-05
1563/1563 [==============================] - 91s 58ms/step - loss: 0.1812 - accuracy: 0.9809 - val_loss: 0.4531 - val_accuracy: 0.9127
Epoch 149/200
Learning rate:  1e-05
1563/1563 [==============================] - 93s 59ms/step - loss: 0.1790 - accuracy: 0.9828 - val_loss: 0.4506 - val_accuracy: 0.9135
Epoch 150/200
Learning rate:  1e-05
1563/1563 [==============================] - 91s 59ms/step - loss: 0.1791 - accuracy: 0.9826 - val_loss: 0.4495 - val_accuracy: 0.9131
Epoch 151/200
Learning rate:  1e-05
1563/1563 [==============================] - 94s 60ms/step - loss: 0.1805 - accuracy: 0.9821 - val_loss: 0.4493 - val_accuracy: 0.9136
Epoch 152/200
Learning rate:  1e-05
1563/1563 [==============================] - 95s 61ms/step - loss: 0.1783 - accuracy: 0.9824 - val_loss: 0.4516 - val_accuracy: 0.9129
Epoch 153/200
Learning rate:  1e-05
1563/1563 [==============================] - 95s 60ms/step - loss: 0.1769 - accuracy: 0.9837 - val_loss: 0.4533 - val_accuracy: 0.9134
Epoch 154/200
Learning rate:  1e-05
1563/1563 [==============================] - 87s 56ms/step - loss: 0.1783 - accuracy: 0.9823 - val_loss: 0.4512 - val_accuracy: 0.9136
Epoch 155/200
Learning rate:  1e-05
1563/1563 [==============================] - 92s 59ms/step - loss: 0.1788 - accuracy: 0.9819 - val_loss: 0.4517 - val_accuracy: 0.9136
Epoch 156/200
Learning rate:  1e-05
1563/1563 [==============================] - 95s 61ms/step - loss: 0.1768 - accuracy: 0.9834 - val_loss: 0.4486 - val_accuracy: 0.9152
Epoch 157/200
Learning rate:  1e-05
1563/1563 [==============================] - 92s 59ms/step - loss: 0.1791 - accuracy: 0.9818 - val_loss: 0.4504 - val_accuracy: 0.9143
Epoch 158/200
Learning rate:  1e-05
1563/1563 [==============================] - 96s 62ms/step - loss: 0.1769 - accuracy: 0.9822 - val_loss: 0.4519 - val_accuracy: 0.9141
Epoch 159/200
Learning rate:  1e-05
1563/1563 [==============================] - 94s 60ms/step - loss: 0.1756 - accuracy: 0.9831 - val_loss: 0.4515 - val_accuracy: 0.9150
Epoch 160/200
Learning rate:  1e-05
1563/1563 [==============================] - 90s 58ms/step - loss: 0.1772 - accuracy: 0.9820 - val_loss: 0.4501 - val_accuracy: 0.9144
Epoch 161/200
Learning rate:  1e-05
1563/1563 [==============================] - 93s 60ms/step - loss: 0.1748 - accuracy: 0.9829 - val_loss: 0.4518 - val_accuracy: 0.9141
Epoch 162/200
Learning rate:  1e-06
1563/1563 [==============================] - 93s 60ms/step - loss: 0.1753 - accuracy: 0.9826 - val_loss: 0.4511 - val_accuracy: 0.9130
Epoch 163/200
Learning rate:  1e-06
1563/1563 [==============================] - 91s 58ms/step - loss: 0.1758 - accuracy: 0.9827 - val_loss: 0.4513 - val_accuracy: 0.9138
Epoch 164/200
Learning rate:  1e-06
1563/1563 [==============================] - 93s 59ms/step - loss: 0.1764 - accuracy: 0.9822 - val_loss: 0.4536 - val_accuracy: 0.9141
Epoch 165/200
Learning rate:  1e-06
1563/1563 [==============================] - 92s 59ms/step - loss: 0.1751 - accuracy: 0.9839 - val_loss: 0.4511 - val_accuracy: 0.9133
Epoch 166/200
Learning rate:  1e-06
1563/1563 [==============================] - 89s 57ms/step - loss: 0.1743 - accuracy: 0.9838 - val_loss: 0.4500 - val_accuracy: 0.9144
Epoch 167/200
Learning rate:  1e-06
1563/1563 [==============================] - 95s 61ms/step - loss: 0.1730 - accuracy: 0.9841 - val_loss: 0.4530 - val_accuracy: 0.9143
Epoch 168/200
Learning rate:  1e-06
1563/1563 [==============================] - 100s 64ms/step - loss: 0.1747 - accuracy: 0.9827 - val_loss: 0.4506 - val_accuracy: 0.9142
Epoch 169/200
Learning rate:  1e-06
1563/1563 [==============================] - 94s 60ms/step - loss: 0.1740 - accuracy: 0.9834 - val_loss: 0.4509 - val_accuracy: 0.9148
Epoch 170/200
Learning rate:  1e-06
1563/1563 [==============================] - 96s 61ms/step - loss: 0.1749 - accuracy: 0.9835 - val_loss: 0.4491 - val_accuracy: 0.9146
Epoch 171/200
Learning rate:  1e-06
1563/1563 [==============================] - 91s 58ms/step - loss: 0.1734 - accuracy: 0.9837 - val_loss: 0.4500 - val_accuracy: 0.9145
Epoch 172/200
Learning rate:  1e-06
1563/1563 [==============================] - 92s 59ms/step - loss: 0.1739 - accuracy: 0.9837 - val_loss: 0.4506 - val_accuracy: 0.9143
Epoch 173/200
Learning rate:  1e-06
1563/1563 [==============================] - 97s 62ms/step - loss: 0.1747 - accuracy: 0.9831 - val_loss: 0.4513 - val_accuracy: 0.9144
Epoch 174/200
Learning rate:  1e-06
1563/1563 [==============================] - 99s 63ms/step - loss: 0.1762 - accuracy: 0.9822 - val_loss: 0.4503 - val_accuracy: 0.9143
Epoch 175/200
Learning rate:  1e-06
1563/1563 [==============================] - 91s 58ms/step - loss: 0.1738 - accuracy: 0.9837 - val_loss: 0.4504 - val_accuracy: 0.9146
Epoch 176/200
Learning rate:  1e-06
1563/1563 [==============================] - 99s 63ms/step - loss: 0.1744 - accuracy: 0.9833 - val_loss: 0.4514 - val_accuracy: 0.9145
Epoch 177/200
Learning rate:  1e-06
1563/1563 [==============================] - 96s 61ms/step - loss: 0.1738 - accuracy: 0.9834 - val_loss: 0.4534 - val_accuracy: 0.9141
Epoch 178/200
Learning rate:  1e-06
1563/1563 [==============================] - 94s 60ms/step - loss: 0.1744 - accuracy: 0.9827 - val_loss: 0.4491 - val_accuracy: 0.9148
Epoch 179/200
Learning rate:  1e-06
1563/1563 [==============================] - 97s 62ms/step - loss: 0.1743 - accuracy: 0.9833 - val_loss: 0.4500 - val_accuracy: 0.9139
Epoch 180/200
Learning rate:  1e-06
1563/1563 [==============================] - 97s 62ms/step - loss: 0.1733 - accuracy: 0.9838 - val_loss: 0.4502 - val_accuracy: 0.9150
Epoch 181/200
Learning rate:  1e-06
1563/1563 [==============================] - 96s 61ms/step - loss: 0.1753 - accuracy: 0.9825 - val_loss: 0.4520 - val_accuracy: 0.9149
Epoch 182/200
Learning rate:  5e-07
1563/1563 [==============================] - 92s 59ms/step - loss: 0.1744 - accuracy: 0.9834 - val_loss: 0.4505 - val_accuracy: 0.9144
Epoch 183/200
Learning rate:  5e-07
1563/1563 [==============================] - 91s 58ms/step - loss: 0.1731 - accuracy: 0.9833 - val_loss: 0.4494 - val_accuracy: 0.9145
Epoch 184/200
Learning rate:  5e-07
1563/1563 [==============================] - 88s 56ms/step - loss: 0.1741 - accuracy: 0.9834 - val_loss: 0.4500 - val_accuracy: 0.9145
Epoch 185/200
Learning rate:  5e-07
1563/1563 [==============================] - 96s 61ms/step - loss: 0.1748 - accuracy: 0.9832 - val_loss: 0.4512 - val_accuracy: 0.9138
Epoch 186/200
Learning rate:  5e-07
1563/1563 [==============================] - 845s 541ms/step - loss: 0.1743 - accuracy: 0.9834 - val_loss: 0.4495 - val_accuracy: 0.9136
Epoch 187/200
Learning rate:  5e-07
1563/1563 [==============================] - 142s 91ms/step - loss: 0.1747 - accuracy: 0.9826 - val_loss: 0.4513 - val_accuracy: 0.9139
Epoch 188/200
Learning rate:  5e-07
1563/1563 [==============================] - 119s 76ms/step - loss: 0.1723 - accuracy: 0.9838 - val_loss: 0.4497 - val_accuracy: 0.9148
Epoch 189/200
Learning rate:  5e-07
1563/1563 [==============================] - 89s 57ms/step - loss: 0.1754 - accuracy: 0.9829 - val_loss: 0.4515 - val_accuracy: 0.9149
Epoch 190/200
Learning rate:  5e-07
1563/1563 [==============================] - 85s 54ms/step - loss: 0.1728 - accuracy: 0.9839 - val_loss: 0.4498 - val_accuracy: 0.9147
Epoch 191/200
Learning rate:  5e-07
1563/1563 [==============================] - 91s 58ms/step - loss: 0.1738 - accuracy: 0.9836 - val_loss: 0.4507 - val_accuracy: 0.9133
Epoch 192/200
Learning rate:  5e-07
1563/1563 [==============================] - 89s 57ms/step - loss: 0.1738 - accuracy: 0.9836 - val_loss: 0.4496 - val_accuracy: 0.9145
Epoch 193/200
Learning rate:  5e-07
1563/1563 [==============================] - 90s 58ms/step - loss: 0.1720 - accuracy: 0.9844 - val_loss: 0.4518 - val_accuracy: 0.9147
Epoch 194/200
Learning rate:  5e-07
1563/1563 [==============================] - 88s 56ms/step - loss: 0.1731 - accuracy: 0.9838 - val_loss: 0.4508 - val_accuracy: 0.9149
Epoch 195/200
Learning rate:  5e-07
1563/1563 [==============================] - 89s 57ms/step - loss: 0.1740 - accuracy: 0.9837 - val_loss: 0.4500 - val_accuracy: 0.9148
Epoch 196/200
Learning rate:  5e-07
1563/1563 [==============================] - 91s 58ms/step - loss: 0.1723 - accuracy: 0.9841 - val_loss: 0.4518 - val_accuracy: 0.9143
Epoch 197/200
Learning rate:  5e-07
1563/1563 [==============================] - 90s 58ms/step - loss: 0.1740 - accuracy: 0.9832 - val_loss: 0.4501 - val_accuracy: 0.9146
Epoch 198/200
Learning rate:  5e-07
1563/1563 [==============================] - 100s 64ms/step - loss: 0.1731 - accuracy: 0.9831 - val_loss: 0.4493 - val_accuracy: 0.9150
Epoch 199/200
Learning rate:  5e-07
1563/1563 [==============================] - 105s 67ms/step - loss: 0.1750 - accuracy: 0.9832 - val_loss: 0.4495 - val_accuracy: 0.9152
Epoch 200/200
Learning rate:  5e-07
1563/1563 [==============================] - 95s 61ms/step - loss: 0.1727 - accuracy: 0.9837 - val_loss: 0.4505 - val_accuracy: 0.9147
10000/10000 [==============================] - 8s 810us/step
Test loss: 0.45047624320983887
Test accuracy: 0.9146999716758728

——————————————————————

总目录

keras的example文件解析

你可能感兴趣的:(TensorFlow,python)

理解Gunicorn：Python WSGI服务器的基石范范0825 ipython linux 运维
理解Gunicorn：PythonWSGI服务器的基石介绍Gunicorn，全称GreenUnicorn，是一个为PythonWSGI（WebServerGatewayInterface）应用设计的高效、轻量级HTTP服务器。作为PythonWeb应用部署的常用工具，Gunicorn以其高性能和易用性著称。本文将介绍Gunicorn的基本概念、安装和配置，帮助初学者快速上手。1.什么是Gunico
Python数据分析与可视化实战指南 William数据分析 python python 数据
在数据驱动的时代，Python因其简洁的语法、强大的库生态系统以及活跃的社区，成为了数据分析与可视化的首选语言。本文将通过一个详细的案例，带领大家学习如何使用Python进行数据分析，并通过可视化来直观呈现分析结果。一、环境准备1.1安装必要库在开始数据分析和可视化之前，我们需要安装一些常用的库。主要包括pandas、numpy、matplotlib和seaborn等。这些库分别用于数据处理、数学
python os.environ 江湖偌大 python 深度学习
os.environ['TF_CPP_MIN_LOG_LEVEL']='0'#默认值，输出所有信息os.environ['TF_CPP_MIN_LOG_LEVEL']='1'#屏蔽通知信息（INFO）os.environ['TF_CPP_MIN_LOG_LEVEL']='2'#屏蔽通知信息和警告信息（INFO\WARNING）os.environ['TF_CPP_MIN_LOG_LEVEL']='
Python中os.environ基本介绍及使用方法鹤冲天Pro #Python python 服务器开发语言
文章目录python中os.environos.environ简介os.environ进行环境变量的增删改查python中os.environ的使用详解1.简介2.key字段详解2.1常见key字段3.os.environ.get()用法4.环境变量的增删改查和判断是否存在4.1新增环境变量4.2更新环境变量4.3获取环境变量4.4删除环境变量4.5判断环境变量是否存在python中os.envi
Pyecharts数据可视化大屏：打造沉浸式数据分析体验我的运维人生信息可视化数据分析数据挖掘运维开发技术共享
Pyecharts数据可视化大屏：打造沉浸式数据分析体验在当今这个数据驱动的时代，如何将海量数据以直观、生动的方式展现出来，成为了数据分析师和企业决策者关注的焦点。Pyecharts，作为一款基于Python的开源数据可视化库，凭借其丰富的图表类型、灵活的配置选项以及高度的定制化能力，成为了构建数据可视化大屏的理想选择。本文将深入探讨如何利用Pyecharts打造数据可视化大屏，并通过实际代码案例
Python教程：一文了解使用Python处理XPath 旦莫 Python进阶 python 开发语言
目录1.环境准备1.1安装lxml1.2验证安装2.XPath基础2.1什么是XPath？2.2XPath语法2.3示例XML文档3.使用lxml解析XML3.1解析XML文档3.2查看解析结果4.XPath查询4.1基本路径查询4.2使用属性查询4.3查询多个节点5.XPath的高级用法5.1使用逻辑运算符5.2使用函数6.实战案例6.1从网页抓取数据6.1.1安装Requests库6.1.2代
python os.environ_python os.environ 读取和设置环境变量 weixin_39605414 python os.environ
>>>importos>>>os.environ.keys()['LC_NUMERIC','GOPATH','GOROOT','GOBIN','LESSOPEN','SSH_CLIENT','LOGNAME','USER','HOME','LC_PAPER','PATH','DISPLAY','LANG','TERM','SHELL','J2REDIR','LC_MONETARY','QT_QPA
使用Faiss进行高效相似度搜索 llzwxh888 faiss python
在现代AI应用中，快速和高效的相似度搜索是至关重要的。Faiss（FacebookAISimilaritySearch）是一个专门用于快速相似度搜索和聚类的库，特别适用于高维向量。本文将介绍如何使用Faiss来进行相似度搜索，并结合Python代码演示其基本用法。什么是Faiss？Faiss是一个由FacebookAIResearch团队开发的开源库，主要用于高维向量的相似性搜索和聚类。Faiss
python是什么意思中文-在python中%是什么意思编程大乐趣
Python中%有两种：1、数值运算：%代表取模，返回除法的余数。如：>>>7%212、%操作符（字符串格式化，stringformatting），说明如下：%[(name)][flags][width].[precision]typecode(name)为命名flags可以有+，-，''或0。+表示右对齐。-表示左对齐。''为一个空格，表示在正数的左侧填充一个空格，从而与负数对齐。0表示使用0填
Day1笔记-Python简介&标识符和关键字&输入输出 ~在杰难逃~ Python python 开发语言大数据数据分析数据挖掘
大家好，从今天开始呢，杰哥开展一个新的专栏，当然，数据分析部分也会不定时更新的，这个新的专栏主要是讲解一些Python的基础语法和知识，帮助0基础的小伙伴入门和学习Python，感兴趣的小伙伴可以开始认真学习啦！一、Python简介【了解】1.计算机工作原理编程语言就是用来定义计算机程序的形式语言。我们通过编程语言来编写程序代码，再通过语言处理程序执行向计算机发送指令，让计算机完成对应的工作，编程
python八股文面试题分享及解析(1) Shawn________ python
#1.'''a=1b=2不用中间变量交换a和b'''#1.a=1b=2a,b=b,aprint(a)print(b)结果：21#2.ll=[]foriinrange(3):ll.append({'num':i})print(11)结果:#[{'num':0},{'num':1},{'num':2}]#3.kk=[]a={'num':0}foriinrange(3):#0,12#可变类型，不仅仅改变
每日算法&面试题，大厂特训二十八天——第二十天（树）肥学 ⚡算法题⚡面试题每日精进 java 算法数据结构
目录标题导读算法特训二十八天面试题点击直接资料领取导读肥友们为了更好的去帮助新同学适应算法和面试题，最近我们开始进行专项突击一步一步来。上一期我们完成了动态规划二十一天现在我们进行下一项对各类算法进行二十八天的一个小总结。还在等什么快来一起肥学进行二十八天挑战吧！！特别介绍小白练手专栏，适合刚入手的新人欢迎订阅编程小白进阶python有趣练手项目里面包括了像《机器人尬聊》《恶搞程序》这样的有趣文章
Python快速入门 —— 第三节：类与对象孤华暗香 Python快速入门 python 开发语言
第三节：类与对象目标：了解面向对象编程的基础概念，并学会如何定义类和创建对象。内容：类与对象：定义类：class关键字。类的构造函数：__init__()。类的属性和方法。对象的创建与使用。示例：classStudent:def__init__(self,name,age,major):self.name&#
pyecharts——绘制柱形图折线图 2224070247 信息可视化 python java 数据可视化
一、pyecharts概述自2013年6月百度EFE(ExcellentFrontEnd）数据可视化团队研发的ECharts1.0发布到GitHub网站以来，ECharts一直备受业界权威的关注并获得广泛好评，成为目前成熟且流行的数据可视化图表工具，被应用到诸多数据可视化的开发领域。Python作为数据分析领域最受欢迎的语言，也加入ECharts的使用行列，并研发出方便Python开发者使用的数据
Python 实现图片裁剪（附代码） | Python工具剑客阿良_ALiang
前言本文提供将图片按照自定义尺寸进行裁剪的工具方法，一如既往的实用主义。环境依赖ffmpeg环境安装，可以参考我的另一篇文章：windowsffmpeg安装部署_阿良的博客-CSDN博客本文主要使用到的不是ffmpeg，而是ffprobe也在上面这篇文章中的zip包中。ffmpy安装：pipinstallffmpy-ihttps://pypi.douban.com/simple代码不废话了，上代码
【华为OD技术面试真题 - 技术面】- python八股文真题题库（4) 算法大师华为od 面试 python
华为OD面试真题精选专栏：华为OD面试真题精选目录:2024华为OD面试手撕代码真题目录以及八股文真题目录文章目录华为OD面试真题精选**1.Python中的`with`**用途和功能自动资源管理示例：文件操作上下文管理协议示例代码工作流程解析优点2.\_\_new\_\_和**\_\_init\_\_**区别__new____init__区别总结3.**切片（Slicing）操作**基本切片语法
python os 环境变量 CV矿工 python 开发语言 numpy
环境变量：环境变量是程序和操作系统之间的通信方式。有些字符不宜明文写进代码里，比如数据库密码，个人账户密码，如果写进自己本机的环境变量里，程序用的时候通过os.environ.get（）取出来就行了。os.environ是一个环境变量的字典。环境变量的相关操作importos"""设置/修改环境变量：os.environ[‘环境变量名称’]=‘环境变量值’#其中key和value均为string类
Python爬虫解析工具之xpath使用详解 eqa11 python 爬虫开发语言
文章目录Python爬虫解析工具之xpath使用详解一、引言二、环境准备1、插件安装2、依赖库安装三、xpath语法详解1、路径表达式2、通配符3、谓语4、常用函数四、xpath在Python代码中的使用1、文档树的创建2、使用xpath表达式3、获取元素内容和属性五、总结Python爬虫解析工具之xpath使用详解一、引言在Python爬虫开发中，数据提取是一个至关重要的环节。xpath作为一门
【华为OD技术面试真题 - 技术面】- python八股文真题题库（1）算法大师华为od 面试 python
华为OD面试真题精选专栏：华为OD面试真题精选目录:2024华为OD面试手撕代码真题目录以及八股文真题目录文章目录华为OD面试真题精选1.数据预处理流程数据预处理的主要步骤工具和库2.介绍线性回归、逻辑回归模型线性回归（LinearRegression）模型形式：关键点：逻辑回归（LogisticRegression）模型形式：关键点：参数估计与评估：3.python浅拷贝及深拷贝浅拷贝（Shal
nosql数据库技术与应用知识点皆过客，揽星河 NoSQL nosql 数据库大数据数据分析数据结构非关系型数据库
Nosql知识回顾大数据处理流程数据采集(flume、爬虫、传感器)数据存储(本门课程NoSQL所处的阶段)Hdfs、MongoDB、HBase等数据清洗(入仓)Hive等数据处理、分析(Spark、Flink等)数据可视化数据挖掘、机器学习应用(Python、SparkMLlib等)大数据时代存储的挑战(三高)高并发(同一时间很多人访问)高扩展(要求随时根据需求扩展存储)高效率(要求读写速度快)
《Python数据分析实战终极指南》 xjt921122 python 数据分析开发语言
对于分析师来说，大家在学习Python数据分析的路上，多多少少都遇到过很多大坑**，有关于技能和思维的**：Excel已经没办法处理现有的数据量了，应该学Python吗？找了一大堆Python和Pandas的资料来学习，为什么自己动手就懵了？跟着比赛类公开数据分析案例练了很久，为什么当自己面对数据需求还是只会数据处理而没有分析思路？学了对比、细分、聚类分析，也会用PEST、波特五力这类分析法，为啥
Python中深拷贝与浅拷贝的区别 yuxiaoyu.
转自：http://blog.csdn.net/u014745194/article/details/70271868定义：在Python中对象的赋值其实就是对象的引用。当创建一个对象，把它赋值给另一个变量的时候，python并没有拷贝这个对象，只是拷贝了这个对象的引用而已。浅拷贝：拷贝了最外围的对象本身，内部的元素都只是拷贝了一个引用而已。也就是，把对象复制一遍，但是该对象中引用的其他对象我不复
Python开发常用的三方模块如下：换个网名有点难 python 开发语言
Python是一门功能强大的编程语言，拥有丰富的第三方库，这些库为开发者提供了极大的便利。以下是100个常用的Python库，涵盖了多个领域：1、NumPy，用于科学计算的基础库。2、Pandas，提供数据结构和数据分析工具。3、Matplotlib，一个绘图库。4、Scikit-learn，机器学习库。5、SciPy，用于数学、科学和工程的库。6、TensorFlow，由Google开发的开源机
Python编译器鹿鹿~ Python编译器 Python python 开发语言后端
嘿嘿嘿我又来了啊有些小盆友可能不知道Python其实是有编译器的，也就是PyCharm。你们可能会问到这个是干嘛的又不可以吃也不可以穿好像没有什么用，其实你还说对了这个还真的不可以吃也不可以穿，但是它用来干嘛的呢。用来编译你所打出的代码进行运行（可能这里说的有点不对但是只是个人认为）现在我们来说说PyCharm是用来干嘛的。PyCharm是一种PythonIDE，带有一整套可以帮助用户在使用Pyt
一文掌握python面向对象魔术方法（二）程序员neil python python 开发语言
接上篇：一文掌握python面向对象魔术方法（一）-CSDN博客目录六、迭代和序列化：1、__iter__(self):定义迭代器，使得类可以被for循环迭代。2、__getitem__(self,key):定义索引操作，如obj[key]。3、__setitem__(self,key,value):定义赋值操作，如obj[key]=value。4、__delitem__(self,key):定义
一文掌握python常用的list（列表）操作程序员neil python python 开发语言
目录一、创建列表1.直接创建列表：2.使用list()构造器3.使用列表推导式4.创建空列表二、访问列表元素1.列表支持通过索引访问元素，索引从0开始：2.还可以使用切片操作访问列表的一部分：三、修改列表元素四、添加元素1.append()：在末尾添加元素2.insert()：在指定位置插入元素五、删除元素1.del：删除指定位置的元素2.remove()：删除指定值的第一个匹配项3.pop()：
Python实现简单的机器学习算法 master_chenchengg python python 办公效率 python开发 IT
Python实现简单的机器学习算法开篇：初探机器学习的奇妙之旅搭建环境：一切从安装开始必备工具箱第一步：安装Anaconda和JupyterNotebook小贴士：如何配置Python环境变量算法初体验：从零开始的Python机器学习线性回归：让数据说话数据准备：从哪里找数据编码实战：Python实现线性回归模型评估：如何判断模型好坏逻辑回归：从分类开始理论入门：什么是逻辑回归代码实现：使用skl
python中的深拷贝与浅拷贝 anshejd70787 python
深拷贝和浅拷贝浅拷贝的时候，修改原来的对象，浅拷贝的对象不会发生改变。1、对象的赋值对象的赋值实际上是对象之间的引用：当创建一个对象，然后将这个对象赋值给另外一个变量的时候，python并没有拷贝这个对象，而只是拷贝了这个对象的引用。当对对象做赋值或者是参数传递或者作为返回值的时候，总是传递原始对象的引用，而不是一个副本。如下所示：>>>aList=["kel","abc",123]>>>bLis
用Python实现简单的猜数字游戏程序媛了了 python 游戏 java
猜数字游戏代码：importrandomdefpythonit():a=random.randint(1,100)n=int(input("输入你猜想的数字："))whilen!=a:ifn>a:print("很遗憾，猜大了")n=int(input("请再次输入你猜想的数字："))elifna::如果玩家猜的数字n大于随机数字a，则输出"很遗憾，猜大了"，并提示玩家再次输入。elifn
用Python实现读取统计单词个数程序媛了了 python 游戏 java
完整实例代码：fromcollectionsimportCounterdefpythonit():danci={}withopen("pythonit.txt","r",encoding="utf-8")asf:foriinf:words=i.strip().split()forwordinwords:ifwordnotindanci:danci[word]=1else:danci[word]+=
tomcat基础与部署发布暗黑小菠萝 Tomcat java web
从51cto搬家了，以后会更新在这里方便自己查看。做项目一直用tomcat，都是配置到eclipse中使用，这几天有时间整理一下使用心得，有一些自己配置遇到的细节问题。 Tomcat：一个Servlets和JSP页面的容器，以提供网站服务。一、Tomcat安装安装方式：①运行.exe安装包 &n
网站架构发展的过程 ayaoxinchao 数据库应用服务器网站架构
1.初始阶段网站架构：应用程序、数据库、文件等资源在同一个服务器上 2.应用服务和数据服务分离：应用服务器、数据库服务器、文件服务器 3.使用缓存改善网站性能：为应用服务器提供本地缓存，但受限于应用服务器的内存容量，可以使用专门的缓存服务器，提供分布式缓存服务器架构 4.使用应用服务器集群改善网站的并发处理能力：使用负载均衡调度服务器，将来自客户端浏览器的访问请求分发到应用服务器集群中的任何
[信息与安全]数据库的备份问题 comsci 数据库
如果你们建设的信息系统是采用中心-分支的模式,那么这里有一个问题如果你的数据来自中心数据库,那么中心数据库如果出现故障,你的分支机构的数据如何保证安全呢? 是否应该在这种信息系统结构的基础上进行改造,容许分支机构的信息系统也备份一个中心数据库的文件呢? &n
使用maven tomcat plugin插件debug关联源代码商人shang maven debug 查看源码 tomcat-plugin
*首先需要配置好'''maven-tomcat7-plugin'''，参见[[Maven开发Web项目]]的'''Tomcat'''部分。 *配置好后，在[[Eclipse]]中打开'''Debug Configurations'''界面，在'''Maven Build'''项下新建当前工程的调试。在'''Main'''选项卡中点击'''Browse Workspace...'''选择需要开发的
大访问量高并发 oloz 大访问量高并发
大访问量高并发的网站主要压力还是在于数据库的操作上，尽量避免频繁的请求数据库。下面简要列出几点解决方案： 01、优化你的代码和查询语句，合理使用索引 02、使用缓存技术例如memcache、ecache将不经常变化的数据放入缓存之中 03、采用服务器集群、负载均衡分担大访问量高并发压力 04、数据读写分离 05、合理选用框架，合理架构(推荐分布式架构)。
cache 服务器小猪猪08 cache
Cache 即高速缓存.那么cache是怎么样提高系统性能与运行速度呢？是不是在任何情况下用cache都能提高性能？是不是cache用的越多就越好呢？我在近期开发的项目中有所体会，写下来当作总结也希望能跟大家一起探讨探讨，有错误的地方希望大家批评指正。　　1.Cache 是怎么样工作的? 　　Cache 是分配在服务器上
mysql存储过程香水浓 mysql
Description:插入大量测试数据 use xmpl; drop procedure if exists mockup_test_data_sp; create procedure mockup_test_data_sp( in number_of_records int ) begin declare cnt int; declare name varch
CSS的class、id、css文件名的常用命名规则 agevs JavaScript UI 框架 Ajax css
CSS的class、id、css文件名的常用命名规则 (一)常用的CSS命名规则　　头：header 　　内容：content/container 　　尾：footer 　　导航：nav 　　侧栏：sidebar 　　栏目：column 　　页面外围控制整体布局宽度：wrapper 　　左右中：left right
全局数据源 AILIKES java tomcat mysql jdbc JNDI
实验目的：为了研究两个项目同时访问一个全局数据源的时候是创建了一个数据源对象，还是创建了两个数据源对象。 1：将diuid和mysql驱动包（druid-1.0.2.jar和mysql-connector-java-5.1.15.jar）copy至%TOMCAT_HOME%/lib下；2：配置数据源，将JNDI在%TOMCAT_HOME%/conf/context.xml中配置好,格式如下：&l
MYSQL的随机查询的实现方法 baalwolf mysql
MYSQL的随机抽取实现方法。举个例子，要从tablename表中随机提取一条记录，大家一般的写法就是：SELECT * FROM tablename ORDER BY RAND() LIMIT 1。但是，后来我查了一下MYSQL的官方手册，里面针对RAND()的提示大概意思就是，在ORDER BY从句里面不能使用RAND()函数，因为这样会导致数据列被多次扫描。但是在MYSQL 3.23版本中，
JAVA的getBytes()方法 bijian1013 java eclipse unix OS
在Java中，String的getBytes()方法是得到一个操作系统默认的编码格式的字节数组。这个表示在不同OS下，返回的东西不一样！ String.getBytes(String decode)方法会根据指定的decode编码返回某字符串在该编码下的byte数组表示，如： byte[] b_gbk = "
AngularJS中操作Cookies bijian1013 JavaScript AngularJS Cookies
如果你的应用足够大、足够复杂，那么你很快就会遇到这样一咱种情况：你需要在客户端存储一些状态信息，这些状态信息是跨session(会话)的。你可能还记得利用document.cookie接口直接操作纯文本cookie的痛苦经历。幸运的是，这种方式已经一去不复返了，在所有现代浏览器中几乎
[Maven学习笔记五]Maven聚合和继承特性 bit1129 maven
Maven聚合在实际的项目中，一个项目通常会划分为多个模块，为了说明问题，以用户登陆这个小web应用为例。通常一个web应用分为三个模块： 1. 模型和数据持久化层user-core, 2. 业务逻辑层user-service以 3. web展现层user-web， user-service依赖于user-core user-web依赖于user-core和use
【JVM七】JVM知识点总结 bit1129 jvm
1. JVM运行模式 1.1 JVM运行时分为-server和-client两种模式，在32位机器上只有client模式的JVM。通常，64位的JVM默认都是使用server模式，因为server模式的JVM虽然启动慢点，但是，在运行过程，JVM会尽可能的进行优化 1.2 JVM分为三种字节码解释执行方式：mixed mode, interpret mode以及compiler
linux下查看nginx、apache、mysql、php的编译参数 ronin47
在linux平台下的应用，最流行的莫过于nginx、apache、mysql、php几个。而这几个常用的应用，在手工编译完以后，在其他一些情况下（如：新增模块），往往想要查看当初都使用了那些参数进行的编译。这时候就可以利用以下方法查看。 1、nginx [root@361way ~]# /App/nginx/sbin/nginx -V nginx: nginx version: nginx/
unity中运用Resources.Load的方法？ brotherlamp unity视频 unity资料 unity自学 unity unity教程
问：unity中运用Resources.Load的方法？答：Resources.Load是unity本地动态加载资本所用的方法,也即是你想动态加载的时分才用到它,比方枪弹,特效,某些实时替换的图像什么的,主张此文件夹不要放太多东西,在打包的时分,它会独自把里边的一切东西都会集打包到一同,不论里边有没有你用的东西,所以大多数资本应该是自个建文件放置 1、unity实时替换的物体即是依据环境条件
线段树-入门 bylijinnan java 算法线段树
/** * 线段树入门 * 问题：已知线段[2,5] [4,6] [0,7]；求点2,4,7分别出现了多少次 * 以下代码建立的线段树用链表来保存，且树的叶子结点类似[i,i] * * 参考链接：http://hi.baidu.com/semluhiigubbqvq/item/be736a33a8864789f4e4ad18 * @author lijinna
全选与反选 chicony 全选
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <html> <head> <title>全选与反选</title>
vim一些简单记录 chenchao051 vim
mac在/usr/share/vim/vimrc linux在/etc/vimrc 1、问：后退键不能删除数据，不能往后退怎么办？答：在vimrc中加入set backspace=2 2、问：如何控制tab键的缩进？答：在vimrc中加入set tabstop=4 (任何
Sublime Text 快捷键 daizj 快捷键 sublime
[size=large][/size]Sublime Text快捷键：Ctrl+Shift+P：打开命令面板Ctrl+P：搜索项目中的文件Ctrl+G：跳转到第几行Ctrl+W：关闭当前打开文件Ctrl+Shift+W：关闭所有打开文件Ctrl+Shift+V：粘贴并格式化Ctrl+D：选择单词，重复可增加选择下一个相同的单词Ctrl+L：选择行，重复可依次增加选择下一行Ctrl+Shift+L：
php 引用(&)详解 dcj3sjt126com PHP
在PHP 中引用的意思是：不同的名字访问同一个变量内容. 与Ｃ语言中的指针是有差别的．Ｃ语言中的指针里面存储的是变量的内容在内存中存放的地址变量的引用 PHP 的引用允许你用两个变量来指向同一个内容复制代码代码如下: <? $a="ABC"; $b =&$a; echo
SVN中trunk,branches,tags用法详解 dcj3sjt126com SVN
Subversion有一个很标准的目录结构，是这样的。比如项目是proj，svn地址为svn://proj/，那么标准的svn布局是svn://proj/|+-trunk+-branches+-tags这是一个标准的布局，trunk为主开发目录，branches为分支开发目录，tags为tag存档目录（不允许修改）。但是具体这几个目录应该如何使用，svn并没有明确的规范，更多的还是用户自己的习惯。
对软件设计的思考 e200702084 设计模式数据结构算法 ssh 活动
软件设计的宏观与微观软件开发是一种高智商的开发活动。一个优秀的软件设计人员不仅要从宏观上把握软件之间的开发，也要从微观上把握软件之间的开发。宏观上，可以应用面向对象设计，采用流行的SSH架构，采用web层，业务逻辑层，持久层分层架构。采用设计模式提供系统的健壮性和可维护性。微观上，对于一个类，甚至方法的调用，从计算机的角度模拟程序的运行情况。了解内存分配，参数传
同步、异步、阻塞、非阻塞 geeksun 非阻塞
同步、异步、阻塞、非阻塞这几个概念有时有点混淆，在此文试图解释一下。同步：发出方法调用后，当没有返回结果，当前线程会一直在等待（阻塞）状态。场景：打电话，营业厅窗口办业务、B/S架构的http请求-响应模式。异步：方法调用后不立即返回结果，调用结果通过状态、通知或回调通知方法调用者或接收者。异步方法调用后，当前线程不会阻塞，会继续执行其他任务。实现：
Reverse SSH Tunnel 反向打洞實錄 hongtoushizi ssh
實際的操作步驟： # 首先，在客戶那理的機器下指令連回我們自己的 Server，並設定自己 Server 上的 12345 port 會對應到幾器上的 SSH port ssh -NfR 12345:localhost:22 [email protected] # 然後在 myhost 的機器上連自己的 12345 port，就可以連回在客戶那的機器 ssh localhost -p 1
Hibernate中的缓存 Josh_Persistence 一级缓存 Hiberante缓存查询缓存二级缓存
Hibernate中的缓存一、Hiberante中常见的三大缓存：一级缓存，二级缓存和查询缓存。 Hibernate中提供了两级Cache，第一级别的缓存是Session级别的缓存，它是属于事务范围的缓存。这一级别的缓存是由hibernate管理的，一般情况下无需进行干预；第二级别的缓存是SessionFactory级别的缓存，它是属于进程范围或群集范围的缓存。这一级别的缓存
对象关系行为模式之延迟加载 home198979 PHP 架构延迟加载
形象化设计模式实战 HELLO!架构一、概念 Lazy Load：一个对象，它虽然不包含所需要的所有数据，但是知道怎么获取这些数据。延迟加载貌似很简单，就是在数据需要时再从数据库获取，减少数据库的消耗。但这其中还是有不少技巧的。二、实现延迟加载实现Lazy Load主要有四种方法：延迟初始化、虚
xml 验证 pengfeicao521 xml xml解析
有些字符，xml不能识别，用jdom或者dom4j解析的时候就报错 public static void testPattern() { // 含有非法字符的串 String str = "Jamey친Ñ&#1282
div设置半透明效果 spjich css 半透明
为div设置如下样式： div{filter:alpha(Opacity=80);-moz-opacity:0.5;opacity: 0.5;} 说明： 1、filter：对win IE设置半透明滤镜效果，filter:alpha(Opacity=80)代表该对象80%半透明，火狐浏览器不认2、-moz-opaci
你真的了解单例模式么？ w574240966 java 单例设计模式 jvm
单例模式，很多初学者认为单例模式很简单，并且认为自己已经掌握了这种设计模式。但事实上，你真的了解单例模式了么。一，单例模式的5中写法。（回字的四种写法，哈哈。） 1，懒汉式（1）线程不安全的懒汉式 public cla