In this video, I discuss Meta's recent release of the LLAMA 4 series of models and why it has generated significant controversy and backlash within the AI community. Despite promising big strides in AI with features like multimodal intelligence and colossal token contexts, the models face criticism for not meeting expectations. We compare the smaller LAMA 4 Scout, mid-sized LLAMA 4 Maverick, and the unreleased LLAMA 4 Behemoth against industry benchmarks. Moreover, reports suggest potential manipulations to inflate benchmark results, leading to severe credibility issues for Meta. I delve into community reactions, real-world test results, and industry opinion on the models' actual performance. This episode uncovers why LLAMA 4's launch has been deemed a tragic misstep for Meta.
▼ Link(s) From Today’s Video:
Official blog: https://ai.meta.com/blog/llama-4-multimodal-intelligence/
Huggingface Models: https://huggingface.co/meta-llama
Chubby's Initial Excitement: https://x.com/kimmonismus/status/1908797575265742911
Pliny's Llama 4 Jailbreak: https://x.com/elder_plinius/status/1908607836730372561
Jimmy Apples Vibe Check: https://x.com/apples_jimmy/status/1908993646504091839
Flavio Coding Test: https://x.com/flavioAd/status/1908908754659115356
EQ Bench: https://eqbench.com/creative_writing_longform.html
Kalomaze' Testing: https://x.com/kalomaze/status/1908695425286012959
Meta Nerfed benchmarks Reddit post: https://x.com/ns123abc/status/1909111648838688905/photo/1
https://x.com/Yuchenj_UW/status/1909061004207816960
https://x.com/kimmonismus/status/1909176824263053538
Misguided Attention Eval: https://x.com/teortaxesTex/status/1909074427116986457
Bad Context Window testing: https://x.com/kimmonismus/status/1909245779136348590
Polyglot test: https://x.com/techikansh/status/1909203507879477745
Old "leak" from 2 months ago: https://x.com/TheAhmadOsman/status/1908833792111906894
► MattVidPro Discord: https://discord.gg/mattvidpro
► Follow Me on Twitter: https://twitter.com/MattVidPro
► Buy me a Coffee! https://buymeacoffee.com/mattvidpro
-------------------------------------------------
▼ Extra Links of Interest:
General AI Playlist: https://www.youtube.com/playlist?list=PLrfI66qWYbW3acrBQ4qltDBsjxaoGSl3I
AI I use to edit videos: https://www.descript.com/?lmref=nA4fDg
Instagram: instagram.com/mattvidpro
Tiktok: tiktok.com/@mattvidpro
Gaming & Extras Channel: https://www.youtube.com/@MattVidProGaming
Let's work together!
- For brand & sponsorship inquiries: https://tally.so/r/3xdz4E
- For all other business inquiries: [email protected]
Thanks for watching Matt Video Productions! I make all sorts of videos here on Youtube! Technology, Tutorials, and Reviews! Enjoy Your stay here, and subscribe!
All Suggestions, Thoughts And Comments Are Greatly Appreciated… Because I Actually Read Them.
00:00 Meta's Weekend Blunder: Llama 4 Series Release
00:29 Diving into Llama 4 Models
03:31 Initial Community Reactions and Benchmarks
07:36 Vibe Checks and Community Tests
14:41 Allegations and Controversies
20:41 Concluding Thoughts on Llama 4