深度学习应用到的数学知识

导数

  • 导数的定义

导数的基本求导法则传送门

梯度和Hessian矩阵

  • 一阶导数和梯度(gradient vector)

  • 二阶导数和Hessian矩阵

f''(x); H(x) = \Delta ^ 2 f(x) = \begin{bmatrix} \frac {\delta ^2 f(x)}{\delta x^2_1}&\frac {\delta ^2 f(x)}{\delta x_1\delta x_2}&\dots & \frac {\delta ^2 f(x)}{\delta x_1\delta x_n} & \dots \\ \frac {\delta ^2 f(x)}{\delta x_2\delta x_1}& \frac {\delta ^2 f(x)}{\delta x^2_2} \\ &&\ddots \\\frac {\delta ^2 f(x)}{\delta x_n\delta x_1}&\frac {\delta ^2 f(x)}{\delta x_n\delta x_2}&& \frac {\delta ^2 f(x)}{\delta x^2_n}\end{bmatrix}

你可能感兴趣的:(深度学习应用到的数学知识)