This is my biggest project yet!
Voice type with Peach Beta 🍑:
https://peach-voice.com
Code:
https://gist.github.com/Gal-Lahat/154a39ce49298dadfb0ef87f31d56568
A new kind of AI.
0:00 - Intro: Building an AI That Thinks Differently
1:10 - How Standard Transformers Work (Simplified)
4:10 - Peach - Simple Voice Typing (Feel Free to Skip)
5:06 - The Core Limitation: Thinking is Outputting Words
5:37 - Designing the New Model: Encoder, Decoder & Latent Manipulator
6:47 - Understanding Latent Space with Autoencoders (Image Example)
8:41 - Applying Autoencoders to Text: Encoding Meaning
9:14 - The new design
13:37 - Why is it better
15:08 - Implementation
16:13 - Testing the New AI: Demo
20:25 - Final Thoughts
Auto-encoder base model:
https://huggingface.co/thesephist/contra-bottleneck-t5-base-wikipedia
Auto-encoder vis website:
https://douglasduhaime.com/posts/visualizing-latent-spaces.html
The music is created by my partner (AI) and me, feel free to use it commercially for your own projects but make sure to credit this video when you do:
https://drive.google.com/drive/folders/1WSKmpkQGOHb_jij4Ut2NpivTcljc7qLS?usp=sharing