Behind chatGPT

2023-02-16

what is charGPT, chatGPT is a chat bot using Generative Pre-trained Transformer.
what is Transformer? It is a neural network model, which is proposed in a paper tiltled "Attention is all you need" in 2017.
After Transform model succeeded in NLP, it is applied in vision processing, which is called ViT. 
How Transformers Work? what is difference between CNN and ViT? Maithra Raghu show the  result ofpicking ViT apart. 

References:

1, ChatGPT: The Tech Behind the Hype (and What It Means for Your Support)

2, Will Transformers Take Over Artificial Intelligence?

3, The Analytics Science Behind ChatGPT: Human, Algorithm, or a Human-Algorithm Centaur?