DeepLearning: Inspired by DSS ——Multi-layer merge loss and Relu

Contact Me:
王雪豪 [email protected]

In Paper , the author merge multi-level score layers to calculate the Loss value.

It used the structure shown as follow:

conv1 -> score1 -> loss1
conv2 -> score2 -> loss2
conv3 -> score3 -> loss3
conv4 -> score4 -> loss4
conv5 -> score5 -> loss5
conv6 -> score6 -> loss6

concat(score1, score2, score3, score4, score5, score6) -> score -> loss
INSTEAD OF
concat(score1, score2, score3, score4, score5, score6) -> Relu -> score -> loss

Meanwhile, I test the network with Relu and without Relu, it turned out to be better without Relu and converge faster.