feed-forward layer (前馈层)(feed-forward network 前馈神经网络,FFN)

feed-forward layer指的是 a linear layer or a single-layer MLP

说白了就是一个fc层

出自牛津《Do You Even Need Attention? A Stack of Feed-Forward Layers Does Surprisingly Well on ImageNet》

你可能感兴趣的:(深度学习)