（刘二大人）PyTorch深度学习实践-反向传播（作业）
1.针对y_hat = w1*x^2+w2*x+b的反向传播计算图构建
2.代码实现
import torch
import numpy as np
import matplotlib.pyplot as plt
#准备数据
x_data = torch.Tensor([1.0,2.0,3.0])
y_data = torch.Tensor([7.0,16.0,29.0])
w1 = torch.Tensor([1.0])#2为最佳
w1.requires_grad = True
w2 = torch.Tensor([2.0])#3为最佳
w2.requires_grad = True
b = torch.Tensor([1.0])#2为最佳
#前馈网络
def forward(x):
return w1*(x**2)+w2*x+b
def loss(x,y):
y_pred = forward(x)
return (y_pred-y)**2
print("Predict (before training)",4,forward(4).item())
#进行训练
for epoch in range(100):
for x,y in zip(x_data,y_data):
l = loss(x,y)
l.backward()
print("\tgrad:",x,y,w1.grad.item(),w2.grad.item())
#进行梯度更新
w1.data -= 0.01 * w1.grad.data
w2.data -= 0.01 * w2.grad.data
#梯度清零
w1.grad.data.zero_()
w2.grad.data.zero_()
print("Progress:",epoch,l.item())
print("Predict (after training)",4,forward(4).item())
#4 对应y值应该为46
3.结果展示
初始预测（Predict (before training) 4 25.0 ）VS 最终预测（Predict (after training) 4 45.65895462036133）VS 真实y值（4，46）
D:\Anaconda3\envs\pytorch\python.exe E:/learn_pytorch/LE/Back_homework.py
Predict (before training) 4 25.0
grad: tensor(1.) tensor(7.) -6.0 -6.0
grad: tensor(2.) tensor(16.) -53.12000274658203 -26.560001373291016
grad: tensor(3.) tensor(29.) -120.64320373535156 -40.21440124511719
Progress: 0 44.92216873168945
grad: tensor(1.) tensor(7.) -0.949249267578125 -0.949249267578125
grad: tensor(2.) tensor(16.) 13.623748779296875 6.8118743896484375
grad: tensor(3.) tensor(29.) 72.81600952148438 24.272003173828125
Progress: 1 16.36472511291504
grad: tensor(1.) tensor(7.) -3.261752128601074 -3.261752128601074
grad: tensor(2.) tensor(16.) -17.444747924804688 -8.722373962402344
grad: tensor(3.) tensor(29.) -18.236858367919922 -6.078952789306641
Progress: 2 1.0264908075332642
grad: tensor(1.) tensor(7.) -2.1216230392456055 -2.1216230392456055
grad: tensor(2.) tensor(16.) -2.640045166015625 -1.3200225830078125
grad: tensor(3.) tensor(29.) 24.161853790283203 8.053951263427734
Progress: 3 1.8018369674682617
grad: tensor(1.) tensor(7.) -2.6018733978271484 -2.6018733978271484
grad: tensor(2.) tensor(16.) -9.355560302734375 -4.6777801513671875
grad: tensor(3.) tensor(29.) 3.9725875854492188 1.3241958618164062
Progress: 4 0.04870818555355072
grad: tensor(1.) tensor(7.) -2.3230667114257812 -2.3230667114257812
grad: tensor(2.) tensor(16.) -5.981361389160156 -2.990680694580078
grad: tensor(3.) tensor(29.) 13.144454956054688 4.3814849853515625
Progress: 5 0.5332614183425903
grad: tensor(1.) tensor(7.) -2.4012231826782227 -2.4012231826782227
grad: tensor(2.) tensor(16.) -7.3434906005859375 -3.6717453002929688
grad: tensor(3.) tensor(29.) 8.550315856933594 2.8501052856445312
Progress: 6 0.225641667842865
grad: tensor(1.) tensor(7.) -2.312877655029297 -2.312877655029297
grad: tensor(2.) tensor(16.) -6.488037109375 -3.2440185546875
grad: tensor(3.) tensor(29.) 10.417957305908203 3.4726524353027344
Progress: 7 0.33498096466064453
grad: tensor(1.) tensor(7.) -2.3035335540771484 -2.3035335540771484
grad: tensor(2.) tensor(16.) -6.6764984130859375 -3.3382492065429688
grad: tensor(3.) tensor(29.) 9.25982666015625 3.08660888671875
Progress: 8 0.26464319229125977
grad: tensor(1.) tensor(7.) -2.258026123046875 -2.258026123046875
grad: tensor(2.) tensor(16.) -6.379051208496094 -3.189525604248047
grad: tensor(3.) tensor(29.) 9.525867462158203 3.1752891540527344
Progress: 9 0.28006836771965027
grad: tensor(1.) tensor(7.) -2.230358123779297 -2.230358123779297
grad: tensor(2.) tensor(16.) -6.3131866455078125 -3.1565933227539062
grad: tensor(3.) tensor(29.) 9.128814697265625 3.042938232421875
Progress: 10 0.25720757246017456
grad: tensor(1.) tensor(7.) -2.1951828002929688 -2.1951828002929688
grad: tensor(2.) tensor(16.) -6.142303466796875 -3.0711517333984375
grad: tensor(3.) tensor(29.) 9.047515869140625 3.015838623046875
Progress: 11 0.2526467442512512
grad: tensor(1.) tensor(7.) -2.1643733978271484 -2.1643733978271484
grad: tensor(2.) tensor(16.) -6.02423095703125 -3.012115478515625
grad: tensor(3.) tensor(29.) 8.822845458984375 2.940948486328125
Progress: 12 0.2402549386024475
grad: tensor(1.) tensor(7.) -2.1323471069335938 -2.1323471069335938
grad: tensor(2.) tensor(16.) -5.8848724365234375 -2.9424362182617188
grad: tensor(3.) tensor(29.) 8.669963836669922 2.8899879455566406
Progress: 13 0.23200084269046783
grad: tensor(1.) tensor(7.) -2.1017065048217773 -2.1017065048217773
grad: tensor(2.) tensor(16.) -5.7588958740234375 -2.8794479370117188
grad: tensor(3.) tensor(29.) 8.488037109375 2.829345703125
Progress: 14 0.2223665863275528
grad: tensor(1.) tensor(7.) -2.071218490600586 -2.071218490600586
grad: tensor(2.) tensor(16.) -5.630012512207031 -2.8150062561035156
grad: tensor(3.) tensor(29.) 8.324134826660156 2.7747116088867188
Progress: 15 0.21386179327964783
grad: tensor(1.) tensor(7.) -2.0414466857910156 -2.0414466857910156
grad: tensor(2.) tensor(16.) -5.50579833984375 -2.752899169921875
grad: tensor(3.) tensor(29.) 8.156112670898438 2.7187042236328125
Progress: 16 0.20531535148620605
grad: tensor(1.) tensor(7.) -2.0121116638183594 -2.0121116638183594
grad: tensor(2.) tensor(16.) -5.3826141357421875 -2.6913070678710938
grad: tensor(3.) tensor(29.) 7.994407653808594 2.6648025512695312
Progress: 17 0.19725479185581207
grad: tensor(1.) tensor(7.) -1.9833335876464844 -1.9833335876464844
grad: tensor(2.) tensor(16.) -5.26214599609375 -2.631072998046875
grad: tensor(3.) tensor(29.) 7.8339385986328125 2.6113128662109375
Progress: 18 0.18941541016101837
grad: tensor(1.) tensor(7.) -1.9550399780273438 -1.9550399780273438
grad: tensor(2.) tensor(16.) -5.143547058105469 -2.5717735290527344
grad: tensor(3.) tensor(29.) 7.677005767822266 2.559001922607422
Progress: 19 0.18190252780914307
grad: tensor(1.) tensor(7.) -1.9272527694702148 -1.9272527694702148
grad: tensor(2.) tensor(16.) -5.027130126953125 -2.5135650634765625
grad: tensor(3.) tensor(29.) 7.522579193115234 2.507526397705078
Progress: 20 0.17465801537036896
grad: tensor(1.) tensor(7.) -1.8999500274658203 -1.8999500274658203
grad: tensor(2.) tensor(16.) -4.9127197265625 -2.45635986328125
grad: tensor(3.) tensor(29.) 7.3708648681640625 2.4569549560546875
Progress: 21 0.16768410801887512
grad: tensor(1.) tensor(7.) -1.8731269836425781 -1.8731269836425781
grad: tensor(2.) tensor(16.) -4.800323486328125 -2.4001617431640625
grad: tensor(3.) tensor(29.) 7.22186279296875 2.40728759765625
Progress: 22 0.16097316145896912
grad: tensor(1.) tensor(7.) -1.8467750549316406 -1.8467750549316406
grad: tensor(2.) tensor(16.) -4.689910888671875 -2.3449554443359375
grad: tensor(3.) tensor(29.) 7.075469970703125 2.358489990234375
Progress: 23 0.1545131951570511
grad: tensor(1.) tensor(7.) -1.8208866119384766 -1.8208866119384766
grad: tensor(2.) tensor(16.) -4.5814208984375 -2.29071044921875
grad: tensor(3.) tensor(29.) 6.9316864013671875 2.3105621337890625
Progress: 24 0.14829714596271515
grad: tensor(1.) tensor(7.) -1.7954521179199219 -1.7954521179199219
grad: tensor(2.) tensor(16.) -4.474861145019531 -2.2374305725097656
grad: tensor(3.) tensor(29.) 6.790306091308594 2.2634353637695312
Progress: 25 0.14230942726135254
grad: tensor(1.) tensor(7.) -1.770462989807129 -1.770462989807129
grad: tensor(2.) tensor(16.) -4.3701324462890625 -2.1850662231445312
grad: tensor(3.) tensor(29.) 6.6515350341796875 2.2171783447265625
Progress: 26 0.13655221462249756
grad: tensor(1.) tensor(7.) -1.7459144592285156 -1.7459144592285156
grad: tensor(2.) tensor(16.) -4.2672882080078125 -2.1336441040039062
grad: tensor(3.) tensor(29.) 6.515098571777344 2.1716995239257812
Progress: 27 0.13100774586200714
grad: tensor(1.) tensor(7.) -1.7217950820922852 -1.7217950820922852
grad: tensor(2.) tensor(16.) -4.1662139892578125 -2.0831069946289062
grad: tensor(3.) tensor(29.) 6.381134033203125 2.127044677734375
Progress: 28 0.1256755292415619
grad: tensor(1.) tensor(7.) -1.6981010437011719 -1.6981010437011719
grad: tensor(2.) tensor(16.) -4.066925048828125 -2.0334625244140625
grad: tensor(3.) tensor(29.) 6.249504089355469 2.0831680297851562
Progress: 29 0.12054414302110672
grad: tensor(1.) tensor(7.) -1.6748218536376953 -1.6748218536376953
grad: tensor(2.) tensor(16.) -3.9693832397460938 -1.9846916198730469
grad: tensor(3.) tensor(29.) 6.120174407958984 2.040058135986328
Progress: 30 0.11560659110546112
grad: tensor(1.) tensor(7.) -1.651951789855957 -1.651951789855957
grad: tensor(2.) tensor(16.) -3.8735580444335938 -1.9367790222167969
grad: tensor(3.) tensor(29.) 5.993110656738281 1.9977035522460938
Progress: 31 0.11085609346628189
grad: tensor(1.) tensor(7.) -1.6294832229614258 -1.6294832229614258
grad: tensor(2.) tensor(16.) -3.7794189453125 -1.88970947265625
grad: tensor(3.) tensor(29.) 5.868244171142578 1.9560813903808594
Progress: 32 0.10628484189510345
grad: tensor(1.) tensor(7.) -1.6074085235595703 -1.6074085235595703
grad: tensor(2.) tensor(16.) -3.6869049072265625 -1.8434524536132812
grad: tensor(3.) tensor(29.) 5.745677947998047 1.9152259826660156
Progress: 33 0.1018914058804512
grad: tensor(1.) tensor(7.) -1.5857219696044922 -1.5857219696044922
grad: tensor(2.) tensor(16.) -3.596038818359375 -1.7980194091796875
grad: tensor(3.) tensor(29.) 5.625171661376953 1.8750572204589844
Progress: 34 0.09766221046447754
grad: tensor(1.) tensor(7.) -1.5644168853759766 -1.5644168853759766
grad: tensor(2.) tensor(16.) -3.50677490234375 -1.753387451171875
grad: tensor(3.) tensor(29.) 5.5067596435546875 1.8355865478515625
Progress: 35 0.09359383583068848
grad: tensor(1.) tensor(7.) -1.5434846878051758 -1.5434846878051758
grad: tensor(2.) tensor(16.) -3.4190521240234375 -1.7095260620117188
grad: tensor(3.) tensor(29.) 5.390510559082031 1.7968368530273438
Progress: 36 0.08968396484851837
grad: tensor(1.) tensor(7.) -1.5229206085205078 -1.5229206085205078
grad: tensor(2.) tensor(16.) -3.3328857421875 -1.66644287109375
grad: tensor(3.) tensor(29.) 5.276252746582031 1.7587509155273438
Progress: 37 0.08592235296964645
grad: tensor(1.) tensor(7.) -1.5027179718017578 -1.5027179718017578
grad: tensor(2.) tensor(16.) -3.24822998046875 -1.624114990234375
grad: tensor(3.) tensor(29.) 5.164054870605469 1.7213516235351562
Progress: 38 0.08230698108673096
grad: tensor(1.) tensor(7.) -1.482870101928711 -1.482870101928711
grad: tensor(2.) tensor(16.) -3.165069580078125 -1.5825347900390625
grad: tensor(3.) tensor(29.) 5.053779602050781 1.6845932006835938
Progress: 39 0.07882928848266602
grad: tensor(1.) tensor(7.) -1.4633703231811523 -1.4633703231811523
grad: tensor(2.) tensor(16.) -3.0833740234375 -1.54168701171875
grad: tensor(3.) tensor(29.) 4.945392608642578 1.6484642028808594
Progress: 40 0.07548428326845169
grad: tensor(1.) tensor(7.) -1.4442119598388672 -1.4442119598388672
grad: tensor(2.) tensor(16.) -3.003082275390625 -1.5015411376953125
grad: tensor(3.) tensor(29.) 4.838996887207031 1.6129989624023438
Progress: 41 0.07227126508951187
grad: tensor(1.) tensor(7.) -1.4253902435302734 -1.4253902435302734
grad: tensor(2.) tensor(16.) -2.924224853515625 -1.4621124267578125
grad: tensor(3.) tensor(29.) 4.7344207763671875 1.5781402587890625
Progress: 42 0.06918129324913025
grad: tensor(1.) tensor(7.) -1.406900405883789 -1.406900405883789
grad: tensor(2.) tensor(16.) -2.84674072265625 -1.423370361328125
grad: tensor(3.) tensor(29.) 4.6316986083984375 1.5438995361328125
Progress: 43 0.06621182709932327
grad: tensor(1.) tensor(7.) -1.3887338638305664 -1.3887338638305664
grad: tensor(2.) tensor(16.) -2.7706222534179688 -1.3853111267089844
grad: tensor(3.) tensor(29.) 4.53076171875 1.51025390625
Progress: 44 0.063357412815094
grad: tensor(1.) tensor(7.) -1.3708868026733398 -1.3708868026733398
grad: tensor(2.) tensor(16.) -2.6958389282226562 -1.3479194641113281
grad: tensor(3.) tensor(29.) 4.431644439697266 1.4772148132324219
Progress: 45 0.0606156550347805
grad: tensor(1.) tensor(7.) -1.353353500366211 -1.353353500366211
grad: tensor(2.) tensor(16.) -2.6223678588867188 -1.3111839294433594
grad: tensor(3.) tensor(29.) 4.3342437744140625 1.4447479248046875
Progress: 46 0.057980459183454514
grad: tensor(1.) tensor(7.) -1.3361272811889648 -1.3361272811889648
grad: tensor(2.) tensor(16.) -2.550201416015625 -1.2751007080078125
grad: tensor(3.) tensor(29.) 4.238491058349609 1.4128303527832031
Progress: 47 0.05544693395495415
grad: tensor(1.) tensor(7.) -1.3192024230957031 -1.3192024230957031
grad: tensor(2.) tensor(16.) -2.4792633056640625 -1.2396316528320312
grad: tensor(3.) tensor(29.) 4.144489288330078 1.3814964294433594
Progress: 48 0.053014788776636124
grad: tensor(1.) tensor(7.) -1.3025760650634766 -1.3025760650634766
grad: tensor(2.) tensor(16.) -2.4095993041992188 -1.2047996520996094
grad: tensor(3.) tensor(29.) 4.052135467529297 1.3507118225097656
Progress: 49 0.050678402185440063
grad: tensor(1.) tensor(7.) -1.2862424850463867 -1.2862424850463867
grad: tensor(2.) tensor(16.) -2.341156005859375 -1.1705780029296875
grad: tensor(3.) tensor(29.) 3.9613265991210938 1.3204421997070312
Progress: 50 0.04843243211507797
grad: tensor(1.) tensor(7.) -1.270193099975586 -1.270193099975586
grad: tensor(2.) tensor(16.) -2.273895263671875 -1.1369476318359375
grad: tensor(3.) tensor(29.) 3.8722686767578125 1.2907562255859375
Progress: 51 0.04627921059727669
grad: tensor(1.) tensor(7.) -1.2544288635253906 -1.2544288635253906
grad: tensor(2.) tensor(16.) -2.207855224609375 -1.1039276123046875
grad: tensor(3.) tensor(29.) 3.7845840454101562 1.2615280151367188
Progress: 52 0.044207025319337845
grad: tensor(1.) tensor(7.) -1.2389373779296875 -1.2389373779296875
grad: tensor(2.) tensor(16.) -2.1429290771484375 -1.0714645385742188
grad: tensor(3.) tensor(29.) 3.6986160278320312 1.2328720092773438
Progress: 53 0.04222148284316063
grad: tensor(1.) tensor(7.) -1.2237215042114258 -1.2237215042114258
grad: tensor(2.) tensor(16.) -2.079193115234375 -1.0395965576171875
grad: tensor(3.) tensor(29.) 3.6140213012695312 1.2046737670898438
Progress: 54 0.04031218960881233
grad: tensor(1.) tensor(7.) -1.208770751953125 -1.208770751953125
grad: tensor(2.) tensor(16.) -2.01654052734375 -1.008270263671875
grad: tensor(3.) tensor(29.) 3.531005859375 1.177001953125
Progress: 55 0.038481488823890686
grad: tensor(1.) tensor(7.) -1.1940841674804688 -1.1940841674804688
grad: tensor(2.) tensor(16.) -1.9550018310546875 -0.9775009155273438
grad: tensor(3.) tensor(29.) 3.449329376220703 1.1497764587402344
Progress: 56 0.03672182932496071
grad: tensor(1.) tensor(7.) -1.179652214050293 -1.179652214050293
grad: tensor(2.) tensor(16.) -1.8945159912109375 -0.9472579956054688
grad: tensor(3.) tensor(29.) 3.369232177734375 1.123077392578125
Progress: 57 0.03503619134426117
grad: tensor(1.) tensor(7.) -1.1654767990112305 -1.1654767990112305
grad: tensor(2.) tensor(16.) -1.8351287841796875 -0.9175643920898438
grad: tensor(3.) tensor(29.) 3.2904396057128906 1.0968132019042969
Progress: 58 0.03341664373874664
grad: tensor(1.) tensor(7.) -1.1515493392944336 -1.1515493392944336
grad: tensor(2.) tensor(16.) -1.776763916015625 -0.8883819580078125
grad: tensor(3.) tensor(29.) 3.2130889892578125 1.0710296630859375
Progress: 59 0.03186401352286339
grad: tensor(1.) tensor(7.) -1.1378669738769531 -1.1378669738769531
grad: tensor(2.) tensor(16.) -1.7194366455078125 -0.8597183227539062
grad: tensor(3.) tensor(29.) 3.137042999267578 1.0456809997558594
Progress: 60 0.030373577028512955
grad: tensor(1.) tensor(7.) -1.1244239807128906 -1.1244239807128906
grad: tensor(2.) tensor(16.) -1.6631011962890625 -0.8315505981445312
grad: tensor(3.) tensor(29.) 3.0624046325683594 1.0208015441894531
Progress: 61 0.0289454385638237
grad: tensor(1.) tensor(7.) -1.1112174987792969 -1.1112174987792969
grad: tensor(2.) tensor(16.) -1.6077728271484375 -0.8038864135742188
grad: tensor(3.) tensor(29.) 2.989002227783203 0.9963340759277344
Progress: 62 0.027574488893151283
grad: tensor(1.) tensor(7.) -1.0982418060302734 -1.0982418060302734
grad: tensor(2.) tensor(16.) -1.5533981323242188 -0.7766990661621094
grad: tensor(3.) tensor(29.) 2.9169387817382812 0.9723129272460938
Progress: 63 0.026260901242494583
grad: tensor(1.) tensor(7.) -1.085495948791504 -1.085495948791504
grad: tensor(2.) tensor(16.) -1.5 -0.75
grad: tensor(3.) tensor(29.) 2.8460769653320312 0.9486923217773438
Progress: 64 0.025000475347042084
grad: tensor(1.) tensor(7.) -1.0729713439941406 -1.0729713439941406
grad: tensor(2.) tensor(16.) -1.447509765625 -0.7237548828125
grad: tensor(3.) tensor(29.) 2.776519775390625 0.925506591796875
Progress: 65 0.023793401196599007
grad: tensor(1.) tensor(7.) -1.0606679916381836 -1.0606679916381836
grad: tensor(2.) tensor(16.) -1.3959503173828125 -0.6979751586914062
grad: tensor(3.) tensor(29.) 2.7081985473632812 0.9027328491210938
Progress: 66 0.02263684943318367
grad: tensor(1.) tensor(7.) -1.0485811233520508 -1.0485811233520508
grad: tensor(2.) tensor(16.) -1.345306396484375 -0.6726531982421875
grad: tensor(3.) tensor(29.) 2.6409759521484375 0.8803253173828125
Progress: 67 0.021527018398046494
grad: tensor(1.) tensor(7.) -1.0367050170898438 -1.0367050170898438
grad: tensor(2.) tensor(16.) -1.2955322265625 -0.64776611328125
grad: tensor(3.) tensor(29.) 2.5750579833984375 0.8583526611328125
Progress: 68 0.02046581357717514
grad: tensor(1.) tensor(7.) -1.0250396728515625 -1.0250396728515625
grad: tensor(2.) tensor(16.) -1.2466583251953125 -0.6233291625976562
grad: tensor(3.) tensor(29.) 2.5102386474609375 0.8367462158203125
Progress: 69 0.019448451697826385
grad: tensor(1.) tensor(7.) -1.0135784149169922 -1.0135784149169922
grad: tensor(2.) tensor(16.) -1.198638916015625 -0.5993194580078125
grad: tensor(3.) tensor(29.) 2.446552276611328 0.8155174255371094
Progress: 70 0.01847412995994091
grad: tensor(1.) tensor(7.) -1.0023174285888672 -1.0023174285888672
grad: tensor(2.) tensor(16.) -1.151458740234375 -0.5757293701171875
grad: tensor(3.) tensor(29.) 2.384033203125 0.794677734375
Progress: 71 0.017542019486427307
grad: tensor(1.) tensor(7.) -0.9912548065185547 -0.9912548065185547
grad: tensor(2.) tensor(16.) -1.1051101684570312 -0.5525550842285156
grad: tensor(3.) tensor(29.) 2.322509765625 0.774169921875
Progress: 72 0.0166483074426651
grad: tensor(1.) tensor(7.) -0.9803848266601562 -0.9803848266601562
grad: tensor(2.) tensor(16.) -1.0595550537109375 -0.5297775268554688
grad: tensor(3.) tensor(29.) 2.2621536254882812 0.7540512084960938
Progress: 73 0.015794256702065468
grad: tensor(1.) tensor(7.) -0.9697074890136719 -0.9697074890136719
grad: tensor(2.) tensor(16.) -1.0148086547851562 -0.5074043273925781
grad: tensor(3.) tensor(29.) 2.202861785888672 0.7342872619628906
Progress: 74 0.014977160841226578
grad: tensor(1.) tensor(7.) -0.9592180252075195 -0.9592180252075195
grad: tensor(2.) tensor(16.) -0.970855712890625 -0.4854278564453125
grad: tensor(3.) tensor(29.) 2.14453125 0.71484375
Progress: 75 0.014194488525390625
grad: tensor(1.) tensor(7.) -0.9489116668701172 -0.9489116668701172
grad: tensor(2.) tensor(16.) -0.92767333984375 -0.463836669921875
grad: tensor(3.) tensor(29.) 2.0873336791992188 0.6957778930664062
Progress: 76 0.013447413221001625
grad: tensor(1.) tensor(7.) -0.938786506652832 -0.938786506652832
grad: tensor(2.) tensor(16.) -0.88525390625 -0.442626953125
grad: tensor(3.) tensor(29.) 2.0310287475585938 0.6770095825195312
Progress: 77 0.012731721624732018
grad: tensor(1.) tensor(7.) -0.9288387298583984 -0.9288387298583984
grad: tensor(2.) tensor(16.) -0.8435592651367188 -0.4217796325683594
grad: tensor(3.) tensor(29.) 1.9757881164550781 0.6585960388183594
Progress: 78 0.012048576027154922
grad: tensor(1.) tensor(7.) -0.9190654754638672 -0.9190654754638672
grad: tensor(2.) tensor(16.) -0.8026123046875 -0.40130615234375
grad: tensor(3.) tensor(29.) 1.9215087890625 0.6405029296875
Progress: 79 0.011395666748285294
grad: tensor(1.) tensor(7.) -0.9094657897949219 -0.9094657897949219
grad: tensor(2.) tensor(16.) -0.76239013671875 -0.381195068359375
grad: tensor(3.) tensor(29.) 1.8681564331054688 0.6227188110351562
Progress: 80 0.010771631263196468
grad: tensor(1.) tensor(7.) -0.9000329971313477 -0.9000329971313477
grad: tensor(2.) tensor(16.) -0.7228622436523438 -0.3614311218261719
grad: tensor(3.) tensor(29.) 1.8157310485839844 0.6052436828613281
Progress: 81 0.010175553150475025
grad: tensor(1.) tensor(7.) -0.8907651901245117 -0.8907651901245117
grad: tensor(2.) tensor(16.) -0.68402099609375 -0.342010498046875
grad: tensor(3.) tensor(29.) 1.7642669677734375 0.5880889892578125
Progress: 82 0.009606907144188881
grad: tensor(1.) tensor(7.) -0.8816604614257812 -0.8816604614257812
grad: tensor(2.) tensor(16.) -0.6458740234375 -0.32293701171875
grad: tensor(3.) tensor(29.) 1.7136955261230469 0.5712318420410156
Progress: 83 0.009064050391316414
grad: tensor(1.) tensor(7.) -0.8727169036865234 -0.8727169036865234
grad: tensor(2.) tensor(16.) -0.6083984375 -0.30419921875
grad: tensor(3.) tensor(29.) 1.6640167236328125 0.5546722412109375
Progress: 84 0.008546147495508194
grad: tensor(1.) tensor(7.) -0.8639297485351562 -0.8639297485351562
grad: tensor(2.) tensor(16.) -0.5715866088867188 -0.2857933044433594
grad: tensor(3.) tensor(29.) 1.6151618957519531 0.5383872985839844
Progress: 85 0.008051691576838493
grad: tensor(1.) tensor(7.) -0.8552961349487305 -0.8552961349487305
grad: tensor(2.) tensor(16.) -0.5354080200195312 -0.2677040100097656
grad: tensor(3.) tensor(29.) 1.56719970703125 0.52239990234375
Progress: 86 0.0075806016102433205
grad: tensor(1.) tensor(7.) -0.8468141555786133 -0.8468141555786133
grad: tensor(2.) tensor(16.) -0.4998626708984375 -0.24993133544921875
grad: tensor(3.) tensor(29.) 1.5201301574707031 0.5067100524902344
Progress: 87 0.007132085505872965
grad: tensor(1.) tensor(7.) -0.8384828567504883 -0.8384828567504883
grad: tensor(2.) tensor(16.) -0.46495819091796875 -0.23247909545898438
grad: tensor(3.) tensor(29.) 1.4737815856933594 0.4912605285644531
Progress: 88 0.006703802850097418
grad: tensor(1.) tensor(7.) -0.8302955627441406 -0.8302955627441406
grad: tensor(2.) tensor(16.) -0.4306488037109375 -0.21532440185546875
grad: tensor(3.) tensor(29.) 1.4283256530761719 0.4761085510253906
Progress: 89 0.006296648643910885
grad: tensor(1.) tensor(7.) -0.8222522735595703 -0.8222522735595703
grad: tensor(2.) tensor(16.) -0.396942138671875 -0.1984710693359375
grad: tensor(3.) tensor(29.) 1.3836250305175781 0.4612083435058594
Progress: 90 0.005908698309212923
grad: tensor(1.) tensor(7.) -0.8143510818481445 -0.8143510818481445
grad: tensor(2.) tensor(16.) -0.36383056640625 -0.181915283203125
grad: tensor(3.) tensor(29.) 1.3397483825683594 0.4465827941894531
Progress: 91 0.005539894104003906
grad: tensor(1.) tensor(7.) -0.8065891265869141 -0.8065891265869141
grad: tensor(2.) tensor(16.) -0.3313140869140625 -0.16565704345703125
grad: tensor(3.) tensor(29.) 1.2966270446777344 0.4322090148925781
Progress: 92 0.00518901739269495
grad: tensor(1.) tensor(7.) -0.7989616394042969 -0.7989616394042969
grad: tensor(2.) tensor(16.) -0.29935455322265625 -0.14967727661132812
grad: tensor(3.) tensor(29.) 1.2542610168457031 0.4180870056152344
Progress: 93 0.004855465143918991
grad: tensor(1.) tensor(7.) -0.7914695739746094 -0.7914695739746094
grad: tensor(2.) tensor(16.) -0.2679595947265625 -0.13397979736328125
grad: tensor(3.) tensor(29.) 1.2125816345214844 0.4041938781738281
Progress: 94 0.004538130480796099
grad: tensor(1.) tensor(7.) -0.7841072082519531 -0.7841072082519531
grad: tensor(2.) tensor(16.) -0.2371063232421875 -0.11855316162109375
grad: tensor(3.) tensor(29.) 1.1717262268066406 0.3905754089355469
Progress: 95 0.004237476270645857
grad: tensor(1.) tensor(7.) -0.7768764495849609 -0.7768764495849609
grad: tensor(2.) tensor(16.) -0.2068023681640625 -0.10340118408203125
grad: tensor(3.) tensor(29.) 1.1315574645996094 0.3771858215332031
Progress: 96 0.003951920662075281
grad: tensor(1.) tensor(7.) -0.7697715759277344 -0.7697715759277344
grad: tensor(2.) tensor(16.) -0.17704010009765625 -0.08852005004882812
grad: tensor(3.) tensor(29.) 1.092041015625 0.364013671875
Progress: 97 0.0036807209253311157
grad: tensor(1.) tensor(7.) -0.7627906799316406 -0.7627906799316406
grad: tensor(2.) tensor(16.) -0.1477813720703125 -0.07389068603515625
grad: tensor(3.) tensor(29.) 1.053314208984375 0.351104736328125
Progress: 98 0.0034242926631122828
grad: tensor(1.) tensor(7.) -0.7559337615966797 -0.7559337615966797
grad: tensor(2.) tensor(16.) -0.119049072265625 -0.0595245361328125
grad: tensor(3.) tensor(29.) 1.0152053833007812 0.33840179443359375
Progress: 99 0.0031809937208890915
Predict (after training) 4 45.65895462036133Process finished with exit code 0