莫烦python中的DDPG运行结果

文章目录

  • 1、DDPG.py(267行)
  • 2、DDPG_update.py(151行)
  • 3、DDPG_update2.py(152行)
  • 结论

1、DDPG.py(267行)

/home/fyo/anaconda3/envs/py35/bin/python /home/fyo/PycharmProjects/MOFAN/Reinforcement-learning-with-tensorflow-master/contents/9_Deep_Deterministic_Policy_Gradient_DDPG/DDPG.py
/home/fyo/anaconda3/envs/py35/lib/python3.5/site-packages/gym/logger.py:30: UserWarning: WARN: Box bound precision lowered by casting to float32
  warnings.warn(colorize('%s: %s'%('WARN', msg % args), 'yellow'))
2020-04-03 20:31:19.950583: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2 AVX AVX2 FMA
2020-04-03 20:31:19.952073: I tensorflow/core/common_runtime/process_util.cc:63] Creating new thread pool with default inter op setting: 2. Tune using inter_op_parallelism_threads for best performance.
Episode: 0  Reward: -1271 Explore: 3.00
Episode: 1  Reward: -1300 Explore: 3.00
Episode: 2  Reward: -1238 Explore: 3.00
Episode: 3  Reward: -1480 Explore: 3.00
Episode: 4  Reward: -1423 Explore: 3.00
Episode: 5  Reward: -1664 Explore: 3.00
Episode: 6  Reward: -1115 Explore: 3.00
Episode: 7  Reward: -1179 Explore: 3.00
Episode: 8  Reward: -1168 Explore: 3.00
Episode: 9  Reward: -1043 Explore: 3.00
Episode: 10  Reward: -1261 Explore: 3.00
Episode: 11  Reward: -1133 Explore: 3.00
Episode: 12  Reward: -1810 Explore: 3.00
Episode: 13  Reward: -1196 Explore: 3.00
Episode: 14  Reward: -1274 Explore: 3.00
Episode: 15  Reward: -1518 Explore: 3.00
Episode: 16  Reward: -1331 Explore: 3.00
Episode: 17  Reward: -1247 Explore: 3.00
Episode: 18  Reward: -1338 Explore: 3.00
Episode: 19  Reward: -1413 Explore: 3.00
Episode: 20  Reward: -1605 Explore: 3.00
Episode: 21  Reward: -1197 Explore: 3.00
Episode: 22  Reward: -1340 Explore: 3.00
Episode: 23  Reward: -1686 Explore: 3.00
Episode: 24  Reward: -1367 Explore: 3.00
Episode: 25  Reward: -1251 Explore: 3.00
Episode: 26  Reward: -1128 Explore: 3.00
Episode: 27  Reward: -1170 Explore: 3.00
Episode: 28  Reward: -1274 Explore: 3.00
Episode: 29  Reward: -1129 Explore: 3.00
Episode: 30  Reward: -1269 Explore: 3.00
Episode: 31  Reward: -1189 Explore: 3.00
Episode: 32  Reward: -1325 Explore: 3.00
Episode: 33  Reward: -1338 Explore: 3.00
Episode: 34  Reward: -1199 Explore: 3.00
Episode: 35  Reward: -1311 Explore: 3.00
Episode: 36  Reward: -1202 Explore: 3.00
Episode: 37  Reward: -1137 Explore: 3.00
Episode: 38  Reward: -1092 Explore: 3.00
Episode: 39  Reward: -1177 Explore: 3.00
Episode: 40  Reward: -1298 Explore: 3.00
Episode: 41  Reward: -1250 Explore: 3.00
Episode: 42  Reward: -1056 Explore: 3.00
Episode: 43  Reward: -1178 Explore: 3.00
Episode: 44  Reward: -1235 Explore: 3.00
Episode: 45  Reward: -1513 Explore: 3.00
Episode: 46  Reward: -1344 Explore: 3.00
Episode: 47  Reward: -1633 Explore: 3.00
Episode: 48  Reward: -1289 Explore: 3.00
Episode: 49  Reward: -1595 Explore: 3.00
Episode: 50  Reward: -1312 Explore: 2.71
Episode: 51  Reward: -1295 Explore: 2.46
Episode: 52  Reward: -1325 Explore: 2.22
Episode: 53  Reward: -1298 Explore: 2.01
Episode: 54  Reward: -1608 Explore: 1.82
Episode: 55  Reward: -1111 Explore: 1.65
Episode: 56  Reward: -1309 Explore: 1.49
Episode: 57  Reward: -1516 Explore: 1.35
Episode: 58  Reward: -1505 Explore: 1.22
Episode: 59  Reward: -1132 Explore: 1.10
Episode: 60  Reward: -1265 Explore: 1.00
Episode: 61  Reward: -1320 Explore: 0.90
Episode: 62  Reward: -1470 Explore: 0.82
Episode: 63  Reward: -1545 Explore: 0.74
Episode: 64  Reward: -1251 Explore: 0.67
Episode: 65  Reward: -1375 Explore: 0.61
Episode: 66  Reward: -1169 Explore: 0.55
Episode: 67  Reward: -1549 Explore: 0.50
Episode: 68  Reward: -1554 Explore: 0.45
Episode: 69  Reward: -1535 Explore: 0.41
Episode: 70  Reward: -1633 Explore: 0.37
Episode: 71  Reward: -1547 Explore: 0.33
Episode: 72  Reward: -1287 Explore: 0.30
Episode: 73  Reward: -1161 Explore: 0.27
Episode: 74  Reward: -1628 Explore: 0.25
Episode: 75  Reward: -1095 Explore: 0.22
Episode: 76  Reward: -1382 Explore: 0.20
Episode: 77  Reward: -1647 Explore: 0.18
Episode: 78  Reward: -1514 Explore: 0.16
Episode: 79  Reward: -1211 Explore: 0.15
Episode: 80  Reward: -1513 Explore: 0.14
Episode: 81  Reward: -1543 Explore: 0.12
Episode: 82  Reward: -1501 Explore: 0.11
Episode: 83  Reward: -1459 Explore: 0.10
Episode: 84  Reward: -945 Explore: 0.09
Episode: 85  Reward: -1616 Explore: 0.08
Episode: 86  Reward: -1642 Explore: 0.07
Episode: 87  Reward: -1639 Explore: 0.07
Episode: 88  Reward: -1647 Explore: 0.06
Episode: 89  Reward: -1189 Explore: 0.05
Episode: 90  Reward: -1499 Explore: 0.05
Episode: 91  Reward: -1158 Explore: 0.04
Episode: 92  Reward: -1332 Explore: 0.04
Episode: 93  Reward: -1654 Explore: 0.04
Episode: 94  Reward: -1549 Explore: 0.03
Episode: 95  Reward: -1339 Explore: 0.03
Episode: 96  Reward: -1646 Explore: 0.03
Episode: 97  Reward: -1058 Explore: 0.02
Episode: 98  Reward: -721 Explore: 0.02
Episode: 99  Reward: -1474 Explore: 0.02
Episode: 100  Reward: -1525 Explore: 0.02
Episode: 101  Reward: -1631 Explore: 0.02
Episode: 102  Reward: -1494 Explore: 0.01
Episode: 103  Reward: -1607 Explore: 0.01
Episode: 104  Reward: -1608 Explore: 0.01
Episode: 105  Reward: -1562 Explore: 0.01
Episode: 106  Reward: -1520 Explore: 0.01
Episode: 107  Reward: -1119 Explore: 0.01
Episode: 108  Reward: -1365 Explore: 0.01
Episode: 109  Reward: -1136 Explore: 0.01
Episode: 110  Reward: -937 Explore: 0.01
Episode: 111  Reward: -1278 Explore: 0.01
Episode: 112  Reward: -1502 Explore: 0.01
Episode: 113  Reward: -1616 Explore: 0.00
Episode: 114  Reward: -1537 Explore: 0.00
Episode: 115  Reward: -1476 Explore: 0.00
Episode: 116  Reward: -1377 Explore: 0.00
Episode: 117  Reward: -1502 Explore: 0.00
Episode: 118  Reward: -1633 Explore: 0.00
Episode: 119  Reward: -1315 Explore: 0.00
Episode: 120  Reward: -1634 Explore: 0.00
Episode: 121  Reward: -1302 Explore: 0.00
Episode: 122  Reward: -1278 Explore: 0.00
Episode: 123  Reward: -1621 Explore: 0.00
Episode: 124  Reward: -1108 Explore: 0.00
Episode: 125  Reward: -1207 Explore: 0.00
Episode: 126  Reward: -1641 Explore: 0.00
Episode: 127  Reward: -838 Explore: 0.00
Episode: 128  Reward: -1551 Explore: 0.00
Episode: 129  Reward: -1568 Explore: 0.00
Episode: 130  Reward: -1540 Explore: 0.00
Episode: 131  Reward: -1510 Explore: 0.00
Episode: 132  Reward: -1292 Explore: 0.00
Episode: 133  Reward: -1648 Explore: 0.00
Episode: 134  Reward: -1490 Explore: 0.00
Episode: 135  Reward: -1654 Explore: 0.00
Episode: 136  Reward: -1503 Explore: 0.00
Episode: 137  Reward: -1397 Explore: 0.00
Episode: 138  Reward: -1345 Explore: 0.00
Episode: 139  Reward: -1283 Explore: 0.00
Episode: 140  Reward: -1286 Explore: 0.00
Episode: 141  Reward: -1483 Explore: 0.00
Episode: 142  Reward: -1651 Explore: 0.00
Episode: 143  Reward: -954 Explore: 0.00
Episode: 144  Reward: -1653 Explore: 0.00
Episode: 145  Reward: -1010 Explore: 0.00
Episode: 146  Reward: -1491 Explore: 0.00
Episode: 147  Reward: -1360 Explore: 0.00
Episode: 148  Reward: -1494 Explore: 0.00
Episode: 149  Reward: -1196 Explore: 0.00
Episode: 150  Reward: -1593 Explore: 0.00
Episode: 151  Reward: -1494 Explore: 0.00
Episode: 152  Reward: -1506 Explore: 0.00
Episode: 153  Reward: -1569 Explore: 0.00
Episode: 154  Reward: -1407 Explore: 0.00
Episode: 155  Reward: -1133 Explore: 0.00
Episode: 156  Reward: -1502 Explore: 0.00
Episode: 157  Reward: -1330 Explore: 0.00
Episode: 158  Reward: -1654 Explore: 0.00
Episode: 159  Reward: -1438 Explore: 0.00
Episode: 160  Reward: -1642 Explore: 0.00
Episode: 161  Reward: -1504 Explore: 0.00
Episode: 162  Reward: -1657 Explore: 0.00
Episode: 163  Reward: -1637 Explore: 0.00
Episode: 164  Reward: -1243 Explore: 0.00
Episode: 165  Reward: -1053 Explore: 0.00
Episode: 166  Reward: -1511 Explore: 0.00
Episode: 167  Reward: -1623 Explore: 0.00
Episode: 168  Reward: -1067 Explore: 0.00
Episode: 169  Reward: -946 Explore: 0.00
Episode: 170  Reward: -1433 Explore: 0.00
Episode: 171  Reward: -1495 Explore: 0.00
Episode: 172  Reward: -1656 Explore: 0.00
Episode: 173  Reward: -1651 Explore: 0.00
Episode: 174  Reward: -1656 Explore: 0.00
Episode: 175  Reward: -1036 Explore: 0.00
Episode: 176  Reward: -1629 Explore: 0.00
Episode: 177  Reward: -1219 Explore: 0.00
Episode: 178  Reward: -1218 Explore: 0.00
Episode: 179  Reward: -1213 Explore: 0.00
Episode: 180  Reward: -1652 Explore: 0.00
Episode: 181  Reward: -1516 Explore: 0.00
Episode: 182  Reward: -922 Explore: 0.00
Episode: 183  Reward: -947 Explore: 0.00
Episode: 184  Reward: -1389 Explore: 0.00
Episode: 185  Reward: -1346 Explore: 0.00
Episode: 186  Reward: -1112 Explore: 0.00
Episode: 187  Reward: -1650 Explore: 0.00
Episode: 188  Reward: -939 Explore: 0.00
Episode: 189  Reward: -1638 Explore: 0.00
Episode: 190  Reward: -1274 Explore: 0.00
Episode: 191  Reward: -1495 Explore: 0.00
Episode: 192  Reward: -1645 Explore: 0.00
Episode: 193  Reward: -1533 Explore: 0.00
Episode: 194  Reward: -1491 Explore: 0.00
Episode: 195  Reward: -1533 Explore: 0.00
Episode: 196  Reward: -1420 Explore: 0.00
Episode: 197  Reward: -1625 Explore: 0.00
Episode: 198  Reward: -1409 Explore: 0.00
Episode: 199  Reward: -1480 Explore: 0.00
Running time:  160.86654114723206

2、DDPG_update.py(151行)

/home/fyo/anaconda3/envs/py35/bin/python /home/fyo/PycharmProjects/MOFAN/Reinforcement-learning-with-tensorflow-master/contents/9_Deep_Deterministic_Policy_Gradient_DDPG/DDPG_update.py
/home/fyo/anaconda3/envs/py35/lib/python3.5/site-packages/gym/logger.py:30: UserWarning: WARN: Box bound precision lowered by casting to float32
  warnings.warn(colorize('%s: %s'%('WARN', msg % args), 'yellow'))
2020-04-03 20:17:24.242517: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2 AVX AVX2 FMA
2020-04-03 20:17:24.246205: I tensorflow/core/common_runtime/process_util.cc:63] Creating new thread pool with default inter op setting: 2. Tune using inter_op_parallelism_threads for best performance.
Episode: 0  Reward: -1457 Explore: 3.00
Episode: 1  Reward: -1513 Explore: 3.00
Episode: 2  Reward: -1490 Explore: 3.00
Episode: 3  Reward: -1550 Explore: 3.00
Episode: 4  Reward: -1481 Explore: 3.00
Episode: 5  Reward: -1645 Explore: 3.00
Episode: 6  Reward: -1627 Explore: 3.00
Episode: 7  Reward: -1570 Explore: 3.00
Episode: 8  Reward: -1178 Explore: 3.00
Episode: 9  Reward: -1665 Explore: 3.00
Episode: 10  Reward: -1074 Explore: 3.00
Episode: 11  Reward: -1536 Explore: 3.00
Episode: 12  Reward: -1659 Explore: 3.00
Episode: 13  Reward: -1512 Explore: 3.00
Episode: 14  Reward: -1350 Explore: 3.00
Episode: 15  Reward: -1748 Explore: 3.00
Episode: 16  Reward: -1553 Explore: 3.00
Episode: 17  Reward: -1393 Explore: 3.00
Episode: 18  Reward: -1504 Explore: 3.00
Episode: 19  Reward: -1620 Explore: 3.00
Episode: 20  Reward: -1660 Explore: 3.00
Episode: 21  Reward: -1461 Explore: 3.00
Episode: 22  Reward: -1402 Explore: 3.00
Episode: 23  Reward: -1635 Explore: 3.00
Episode: 24  Reward: -1431 Explore: 3.00
Episode: 25  Reward: -1567 Explore: 3.00
Episode: 26  Reward: -1569 Explore: 3.00
Episode: 27  Reward: -1488 Explore: 3.00
Episode: 28  Reward: -1193 Explore: 3.00
Episode: 29  Reward: -1332 Explore: 3.00
Episode: 30  Reward: -1169 Explore: 3.00
Episode: 31  Reward: -1613 Explore: 3.00
Episode: 32  Reward: -1259 Explore: 3.00
Episode: 33  Reward: -1311 Explore: 3.00
Episode: 34  Reward: -1409 Explore: 3.00
Episode: 35  Reward: -1445 Explore: 3.00
Episode: 36  Reward: -1441 Explore: 3.00
Episode: 37  Reward: -1202 Explore: 3.00
Episode: 38  Reward: -1543 Explore: 3.00
Episode: 39  Reward: -1433 Explore: 3.00
Episode: 40  Reward: -1344 Explore: 3.00
Episode: 41  Reward: -1655 Explore: 3.00
Episode: 42  Reward: -1453 Explore: 3.00
Episode: 43  Reward: -1444 Explore: 3.00
Episode: 44  Reward: -1153 Explore: 3.00
Episode: 45  Reward: -1568 Explore: 3.00
Episode: 46  Reward: -899 Explore: 3.00
Episode: 47  Reward: -1662 Explore: 3.00
Episode: 48  Reward: -1074 Explore: 3.00
Episode: 49  Reward: -1632 Explore: 3.00
Episode: 50  Reward: -1133 Explore: 2.71
Episode: 51  Reward: -1043 Explore: 2.46
Episode: 52  Reward: -1326 Explore: 2.22
Episode: 53  Reward: -1367 Explore: 2.01
Episode: 54  Reward: -1407 Explore: 1.82
Episode: 55  Reward: -1222 Explore: 1.65
Episode: 56  Reward: -1158 Explore: 1.49
Episode: 57  Reward: -1096 Explore: 1.35
Episode: 58  Reward: -854 Explore: 1.22
Episode: 59  Reward: -658 Explore: 1.10
Episode: 60  Reward: -915 Explore: 1.00
Episode: 61  Reward: -1283 Explore: 0.90
Episode: 62  Reward: -569 Explore: 0.82
Episode: 63  Reward: -261 Explore: 0.74
Episode: 64  Reward: -262 Explore: 0.67
Episode: 65  Reward: -387 Explore: 0.61
Episode: 66  Reward: -389 Explore: 0.55
Episode: 67  Reward: -386 Explore: 0.50
Episode: 68  Reward: -376 Explore: 0.45
Episode: 69  Reward: -382 Explore: 0.41
Episode: 70  Reward: -259 Explore: 0.37
Episode: 71  Reward: -390 Explore: 0.33
Episode: 72  Reward: -135 Explore: 0.30
Episode: 73  Reward: -128 Explore: 0.27
Episode: 74  Reward: -264 Explore: 0.25
Episode: 75  Reward: -275 Explore: 0.22
Episode: 76  Reward: -360 Explore: 0.20
Episode: 77  Reward: -262 Explore: 0.18
Episode: 78  Reward: -363 Explore: 0.16
Episode: 79  Reward: -252 Explore: 0.15
Episode: 80  Reward: -366 Explore: 0.14
Episode: 81  Reward: -1 Explore: 0.12
Episode: 82  Reward: -268 Explore: 0.11
Episode: 83  Reward: -364 Explore: 0.10
Episode: 84  Reward: -130 Explore: 0.09
Episode: 85  Reward: -125 Explore: 0.08
Episode: 86  Reward: -133 Explore: 0.07
Episode: 87  Reward: -127 Explore: 0.07
Episode: 88  Reward: -137 Explore: 0.06
Episode: 89  Reward: -137 Explore: 0.05
Episode: 90  Reward: -265 Explore: 0.05
Episode: 91  Reward: -854 Explore: 0.04
Episode: 92  Reward: -133 Explore: 0.04
Episode: 93  Reward: -130 Explore: 0.04
Episode: 94  Reward: -1 Explore: 0.03
Episode: 95  Reward: -131 Explore: 0.03
Episode: 96  Reward: -133 Explore: 0.03
Episode: 97  Reward: -130 Explore: 0.02
Episode: 98  Reward: -132 Explore: 0.02
Episode: 99  Reward: -381 Explore: 0.02
Episode: 100  Reward: -249 Explore: 0.02
Episode: 101  Reward: -134 Explore: 0.02
Episode: 102  Reward: -358 Explore: 0.01
Episode: 103  Reward: -4 Explore: 0.01
Episode: 104  Reward: -133 Explore: 0.01
Episode: 105  Reward: -8 Explore: 0.01
Episode: 106  Reward: -7 Explore: 0.01
Episode: 107  Reward: -130 Explore: 0.01
Episode: 108  Reward: -390 Explore: 0.01
Episode: 109  Reward: -134 Explore: 0.01
Episode: 110  Reward: -133 Explore: 0.01
Episode: 111  Reward: -132 Explore: 0.01
Episode: 112  Reward: -380 Explore: 0.01
Episode: 113  Reward: -143 Explore: 0.00
Episode: 114  Reward: -3 Explore: 0.00
Episode: 115  Reward: -379 Explore: 0.00
Episode: 116  Reward: -381 Explore: 0.00
Episode: 117  Reward: -251 Explore: 0.00
Episode: 118  Reward: -3 Explore: 0.00
Episode: 119  Reward: -437 Explore: 0.00
Episode: 120  Reward: -269 Explore: 0.00
Episode: 121  Reward: -409 Explore: 0.00
Episode: 122  Reward: -536 Explore: 0.00
Episode: 123  Reward: -6 Explore: 0.00
Episode: 124  Reward: -141 Explore: 0.00
Episode: 125  Reward: -141 Explore: 0.00
Episode: 126  Reward: -278 Explore: 0.00
Episode: 127  Reward: -292 Explore: 0.00
Episode: 128  Reward: -1 Explore: 0.00
Episode: 129  Reward: -1 Explore: 0.00
Episode: 130  Reward: 0 Explore: 0.00
Episode: 131  Reward: -282 Explore: 0.00
Episode: 132  Reward: -124 Explore: 0.00
Episode: 133  Reward: -130 Explore: 0.00
Episode: 134  Reward: -1007 Explore: 0.00
Episode: 135  Reward: -980 Explore: 0.00
Episode: 136  Reward: -258 Explore: 0.00
Episode: 137  Reward: -115 Explore: 0.00
Episode: 138  Reward: -266 Explore: 0.00
Episode: 139  Reward: -368 Explore: 0.00
Episode: 140  Reward: -133 Explore: 0.00
Episode: 141  Reward: -532 Explore: 0.00
Episode: 142  Reward: -272 Explore: 0.00
Episode: 143  Reward: -530 Explore: 0.00
Episode: 144  Reward: -393 Explore: 0.00
Episode: 145  Reward: -400 Explore: 0.00
Episode: 146  Reward: -500 Explore: 0.00
Episode: 147  Reward: -269 Explore: 0.00
Episode: 148  Reward: -528 Explore: 0.00
Episode: 149  Reward: -135 Explore: 0.00
Episode: 150  Reward: -169 Explore: 0.00
Episode: 151  Reward: -381 Explore: 0.00
Episode: 152  Reward: -285 Explore: 0.00
Episode: 153  Reward: -12 Explore: 0.00
Episode: 154  Reward: -361 Explore: 0.00
Episode: 155  Reward: -130 Explore: 0.00
Episode: 156  Reward: -533 Explore: 0.00
Episode: 157  Reward: -449 Explore: 0.00
Episode: 158  Reward: -376 Explore: 0.00
Episode: 159  Reward: -519 Explore: 0.00
Episode: 160  Reward: -390 Explore: 0.00
Episode: 161  Reward: -552 Explore: 0.00
Episode: 162  Reward: -423 Explore: 0.00
Episode: 163  Reward: -267 Explore: 0.00
Episode: 164  Reward: -131 Explore: 0.00
Episode: 165  Reward: -384 Explore: 0.00
Episode: 166  Reward: -1225 Explore: 0.00
Episode: 167  Reward: -644 Explore: 0.00
Episode: 168  Reward: -253 Explore: 0.00
Episode: 169  Reward: -134 Explore: 0.00
Episode: 170  Reward: -409 Explore: 0.00
Episode: 171  Reward: -679 Explore: 0.00
Episode: 172  Reward: -133 Explore: 0.00
Episode: 173  Reward: -128 Explore: 0.00
Episode: 174  Reward: -125 Explore: 0.00
Episode: 175  Reward: -130 Explore: 0.00
Episode: 176  Reward: -135 Explore: 0.00
Episode: 177  Reward: -132 Explore: 0.00
Episode: 178  Reward: -133 Explore: 0.00
Episode: 179  Reward: -130 Explore: 0.00
Episode: 180  Reward: -129 Explore: 0.00
Episode: 181  Reward: -267 Explore: 0.00
Episode: 182  Reward: -132 Explore: 0.00
Episode: 183  Reward: -130 Explore: 0.00
Episode: 184  Reward: -488 Explore: 0.00
Episode: 185  Reward: -133 Explore: 0.00
Episode: 186  Reward: -130 Explore: 0.00
Episode: 187  Reward: -129 Explore: 0.00
Episode: 188  Reward: -133 Explore: 0.00
Episode: 189  Reward: -133 Explore: 0.00
Episode: 190  Reward: -1503 Explore: 0.00
Episode: 191  Reward: -421 Explore: 0.00
Episode: 192  Reward: -132 Explore: 0.00
Episode: 193  Reward: -2 Explore: 0.00
Episode: 194  Reward: -401 Explore: 0.00
Episode: 195  Reward: -272 Explore: 0.00
Episode: 196  Reward: -122 Explore: 0.00
Episode: 197  Reward: 0 Explore: 0.00
Episode: 198  Reward: -123 Explore: 0.00
Episode: 199  Reward: -247 Explore: 0.00
Running time:  187.92221856117249

3、DDPG_update2.py(152行)

/home/fyo/anaconda3/envs/py35/bin/python /home/fyo/PycharmProjects/MOFAN/Reinforcement-learning-with-tensorflow-master/contents/9_Deep_Deterministic_Policy_Gradient_DDPG/DDPG_update2.py
/home/fyo/anaconda3/envs/py35/lib/python3.5/site-packages/gym/logger.py:30: UserWarning: WARN: Box bound precision lowered by casting to float32
  warnings.warn(colorize('%s: %s'%('WARN', msg % args), 'yellow'))
2020-04-03 20:27:37.005980: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2 AVX AVX2 FMA
2020-04-03 20:27:37.007911: I tensorflow/core/common_runtime/process_util.cc:63] Creating new thread pool with default inter op setting: 2. Tune using inter_op_parallelism_threads for best performance.
Episode: 0  Reward: -1096 Explore: 3.00
Episode: 1  Reward: -1213 Explore: 3.00
Episode: 2  Reward: -1284 Explore: 3.00
Episode: 3  Reward: -1780 Explore: 3.00
Episode: 4  Reward: -1188 Explore: 3.00
Episode: 5  Reward: -1367 Explore: 3.00
Episode: 6  Reward: -1165 Explore: 3.00
Episode: 7  Reward: -1303 Explore: 3.00
Episode: 8  Reward: -1184 Explore: 3.00
Episode: 9  Reward: -1099 Explore: 3.00
Episode: 10  Reward: -1327 Explore: 3.00
Episode: 11  Reward: -1232 Explore: 3.00
Episode: 12  Reward: -1640 Explore: 3.00
Episode: 13  Reward: -1279 Explore: 3.00
Episode: 14  Reward: -1247 Explore: 3.00
Episode: 15  Reward: -1476 Explore: 3.00
Episode: 16  Reward: -1338 Explore: 3.00
Episode: 17  Reward: -1360 Explore: 3.00
Episode: 18  Reward: -1099 Explore: 3.00
Episode: 19  Reward: -1332 Explore: 3.00
Episode: 20  Reward: -1414 Explore: 3.00
Episode: 21  Reward: -1245 Explore: 3.00
Episode: 22  Reward: -1342 Explore: 3.00
Episode: 23  Reward: -1499 Explore: 3.00
Episode: 24  Reward: -1157 Explore: 3.00
Episode: 25  Reward: -1206 Explore: 3.00
Episode: 26  Reward: -1285 Explore: 3.00
Episode: 27  Reward: -1218 Explore: 3.00
Episode: 28  Reward: -1317 Explore: 3.00
Episode: 29  Reward: -1351 Explore: 3.00
Episode: 30  Reward: -1262 Explore: 3.00
Episode: 31  Reward: -1294 Explore: 3.00
Episode: 32  Reward: -1174 Explore: 3.00
Episode: 33  Reward: -1189 Explore: 3.00
Episode: 34  Reward: -1199 Explore: 3.00
Episode: 35  Reward: -1282 Explore: 3.00
Episode: 36  Reward: -1302 Explore: 3.00
Episode: 37  Reward: -1087 Explore: 3.00
Episode: 38  Reward: -1281 Explore: 3.00
Episode: 39  Reward: -1107 Explore: 3.00
Episode: 40  Reward: -1175 Explore: 3.00
Episode: 41  Reward: -1408 Explore: 3.00
Episode: 42  Reward: -1190 Explore: 3.00
Episode: 43  Reward: -1232 Explore: 3.00
Episode: 44  Reward: -1128 Explore: 3.00
Episode: 45  Reward: -1796 Explore: 3.00
Episode: 46  Reward: -1188 Explore: 3.00
Episode: 47  Reward: -1622 Explore: 3.00
Episode: 48  Reward: -1353 Explore: 3.00
Episode: 49  Reward: -1537 Explore: 3.00
Episode: 50  Reward: -1279 Explore: 2.71
Episode: 51  Reward: -1325 Explore: 2.46
Episode: 52  Reward: -1632 Explore: 2.22
Episode: 53  Reward: -1557 Explore: 2.01
Episode: 54  Reward: -1651 Explore: 1.82
Episode: 55  Reward: -1267 Explore: 1.65
Episode: 56  Reward: -1141 Explore: 1.49
Episode: 57  Reward: -1103 Explore: 1.35
Episode: 58  Reward: -1294 Explore: 1.22
Episode: 59  Reward: -1507 Explore: 1.10
Episode: 60  Reward: -1330 Explore: 1.00
Episode: 61  Reward: -641 Explore: 0.90
Episode: 62  Reward: -1039 Explore: 0.82
Episode: 63  Reward: -888 Explore: 0.74
Episode: 64  Reward: -876 Explore: 0.67
Episode: 65  Reward: -897 Explore: 0.61
Episode: 66  Reward: -886 Explore: 0.55
Episode: 67  Reward: -958 Explore: 0.50
Episode: 68  Reward: -902 Explore: 0.45
Episode: 69  Reward: -905 Explore: 0.41
Episode: 70  Reward: -655 Explore: 0.37
Episode: 71  Reward: -272 Explore: 0.33
Episode: 72  Reward: -267 Explore: 0.30
Episode: 73  Reward: -259 Explore: 0.27
Episode: 74  Reward: -133 Explore: 0.25
Episode: 75  Reward: -400 Explore: 0.22
Episode: 76  Reward: -467 Explore: 0.20
Episode: 77  Reward: -126 Explore: 0.18
Episode: 78  Reward: -364 Explore: 0.16
Episode: 79  Reward: -376 Explore: 0.15
Episode: 80  Reward: -362 Explore: 0.14
Episode: 81  Reward: 0 Explore: 0.12
Episode: 82  Reward: -392 Explore: 0.11
Episode: 83  Reward: -486 Explore: 0.10
Episode: 84  Reward: -258 Explore: 0.09
Episode: 85  Reward: -121 Explore: 0.08
Episode: 86  Reward: -131 Explore: 0.07
Episode: 87  Reward: -122 Explore: 0.07
Episode: 88  Reward: -130 Explore: 0.06
Episode: 89  Reward: -135 Explore: 0.05
Episode: 90  Reward: -257 Explore: 0.05
Episode: 91  Reward: -131 Explore: 0.04
Episode: 92  Reward: -131 Explore: 0.04
Episode: 93  Reward: -128 Explore: 0.04
Episode: 94  Reward: -2 Explore: 0.03
Episode: 95  Reward: -256 Explore: 0.03
Episode: 96  Reward: -129 Explore: 0.03
Episode: 97  Reward: -127 Explore: 0.02
Episode: 98  Reward: -264 Explore: 0.02
Episode: 99  Reward: -382 Explore: 0.02
Episode: 100  Reward: -246 Explore: 0.02
Episode: 101  Reward: -130 Explore: 0.02
Episode: 102  Reward: -369 Explore: 0.01
Episode: 103  Reward: -1 Explore: 0.01
Episode: 104  Reward: -123 Explore: 0.01
Episode: 105  Reward: -1 Explore: 0.01
Episode: 106  Reward: -3 Explore: 0.01
Episode: 107  Reward: -125 Explore: 0.01
Episode: 108  Reward: -256 Explore: 0.01
Episode: 109  Reward: -136 Explore: 0.01
Episode: 110  Reward: -133 Explore: 0.01
Episode: 111  Reward: -132 Explore: 0.01
Episode: 112  Reward: -671 Explore: 0.01
Episode: 113  Reward: -687 Explore: 0.00
Episode: 114  Reward: -654 Explore: 0.00
Episode: 115  Reward: -950 Explore: 0.00
Episode: 116  Reward: -949 Explore: 0.00
Episode: 117  Reward: -1300 Explore: 0.00
Episode: 118  Reward: -1389 Explore: 0.00
Episode: 119  Reward: -1171 Explore: 0.00
Episode: 120  Reward: -397 Explore: 0.00
Episode: 121  Reward: -348 Explore: 0.00
Episode: 122  Reward: -382 Explore: 0.00
Episode: 123  Reward: -269 Explore: 0.00
Episode: 124  Reward: -268 Explore: 0.00
Episode: 125  Reward: -274 Explore: 0.00
Episode: 126  Reward: -140 Explore: 0.00
Episode: 127  Reward: -407 Explore: 0.00
Episode: 128  Reward: -5 Explore: 0.00
Episode: 129  Reward: -7 Explore: 0.00
Episode: 130  Reward: -6 Explore: 0.00
Episode: 131  Reward: -402 Explore: 0.00
Episode: 132  Reward: -279 Explore: 0.00
Episode: 133  Reward: -138 Explore: 0.00
Episode: 134  Reward: -416 Explore: 0.00
Episode: 135  Reward: -140 Explore: 0.00
Episode: 136  Reward: -870 Explore: 0.00
Episode: 137  Reward: -274 Explore: 0.00
Episode: 138  Reward: -415 Explore: 0.00
Episode: 139  Reward: -384 Explore: 0.00
Episode: 140  Reward: -270 Explore: 0.00
Episode: 141  Reward: -417 Explore: 0.00
Episode: 142  Reward: -138 Explore: 0.00
Episode: 143  Reward: -136 Explore: 0.00
Episode: 144  Reward: -134 Explore: 0.00
Episode: 145  Reward: -272 Explore: 0.00
Episode: 146  Reward: -385 Explore: 0.00
Episode: 147  Reward: -134 Explore: 0.00
Episode: 148  Reward: -1050 Explore: 0.00
Episode: 149  Reward: -395 Explore: 0.00
Episode: 150  Reward: -272 Explore: 0.00
Episode: 151  Reward: -383 Explore: 0.00
Episode: 152  Reward: -415 Explore: 0.00
Episode: 153  Reward: -4 Explore: 0.00
Episode: 154  Reward: -394 Explore: 0.00
Episode: 155  Reward: -137 Explore: 0.00
Episode: 156  Reward: -398 Explore: 0.00
Episode: 157  Reward: -495 Explore: 0.00
Episode: 158  Reward: -142 Explore: 0.00
Episode: 159  Reward: -598 Explore: 0.00
Episode: 160  Reward: -143 Explore: 0.00
Episode: 161  Reward: -296 Explore: 0.00
Episode: 162  Reward: -137 Explore: 0.00
Episode: 163  Reward: -137 Explore: 0.00
Episode: 164  Reward: -138 Explore: 0.00
Episode: 165  Reward: -267 Explore: 0.00
Episode: 166  Reward: -420 Explore: 0.00
Episode: 167  Reward: -268 Explore: 0.00
Episode: 168  Reward: -428 Explore: 0.00
Episode: 169  Reward: -137 Explore: 0.00
Episode: 170  Reward: -299 Explore: 0.00
Episode: 171  Reward: -470 Explore: 0.00
Episode: 172  Reward: -137 Explore: 0.00
Episode: 173  Reward: -267 Explore: 0.00
Episode: 174  Reward: -267 Explore: 0.00
Episode: 175  Reward: -136 Explore: 0.00
Episode: 176  Reward: -147 Explore: 0.00
Episode: 177  Reward: -421 Explore: 0.00
Episode: 178  Reward: -405 Explore: 0.00
Episode: 179  Reward: -139 Explore: 0.00
Episode: 180  Reward: -133 Explore: 0.00
Episode: 181  Reward: -292 Explore: 0.00
Episode: 182  Reward: -131 Explore: 0.00
Episode: 183  Reward: -258 Explore: 0.00
Episode: 184  Reward: -694 Explore: 0.00
Episode: 185  Reward: -138 Explore: 0.00
Episode: 186  Reward: -132 Explore: 0.00
Episode: 187  Reward: -135 Explore: 0.00
Episode: 188  Reward: -263 Explore: 0.00
Episode: 189  Reward: -266 Explore: 0.00
Episode: 190  Reward: -1352 Explore: 0.00
Episode: 191  Reward: -374 Explore: 0.00
Episode: 192  Reward: -134 Explore: 0.00
Episode: 193  Reward: -397 Explore: 0.00
Episode: 194  Reward: -546 Explore: 0.00
Episode: 195  Reward: -282 Explore: 0.00
Episode: 196  Reward: -264 Explore: 0.00
Episode: 197  Reward: -252 Explore: 0.00
Episode: 198  Reward: -390 Explore: 0.00
Episode: 199  Reward: -391 Explore: 0.00
Running time:  114.84853196144104

结论

训练效果上,3>2>1

你可能感兴趣的:(python函数学习)