In this video, we introduce the basics of how Neural Networks translate one language, like English, to another, like Spanish. The ideas is to convert one sequence of things into another sequence of things, and thus, this type of neural network can be applied to all sort so of problems, including translating amino acids into 3-dimensional structures.
NOTE: This StatQuest assumes that you are already familiar with...
Long, Short-Term Memory (LSTM): https://youtu.be/YCzL96nL7j0
...and...
Word Embedding: https://youtu.be/viZrOnJclY0
Also, if you'd like to go through Ben Trevett's tutorials, see: https://github.com/bentrevett/pytorch-seq2seq/tree/rewrite
Finally, here's a link to the original manuscript: https://arxiv.org/abs/1409.3215
If you'd like to support StatQuest, please consider...
Patreon: https://www.patreon.com/statquest
...or...
YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join
...buying my book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store...
https://statquest.org/statquest-store/
...or just donating to StatQuest!
https://www.paypal.me/statquest
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
https://twitter.com/joshuastarmer
0:00 Awesome song and introduction
3:43 Building the Encoder
8:27 Building the Decoder
12:58 Training The Encoder-Decoder Model
14:40 My model vs the model from the original manuscript
#StatQuest #seq2seq #neuralnetwork