embedding到底进行了什么操作

用word embeddding  可以将一个词转换成固定长度的词向量表示!

word embedding 给每个单词分配一个固定长度的向量表示!

好博客:英文解释很清晰

https://jalammar.github.io/illustrated-transformer/

 

This softmax score determines how much how much each word will be expressed at this position. Clearly the word at this position will have the highest softmax score, but sometimes it’s useful to attend to another word that is relevant to the current word.g'g't't

你可能感兴趣的:(embedding到底进行了什么操作)