The OTHER AI Alignment Problem: Mesa-Optimizers and Inner Alignment

This "Alignment" thing turns out to be even harder than we thought. # Links The Paper: https://arxiv.org/pdf/1906.01820.pdf Discord Waiting List Sign-Up: https://forms.gle/YhYgjakwQ1Lzd4tJ8 AI Safety Career Bottlenecks Survey: https://www.guidedtrack.com/programs/n8cydtu/run Mesa-optimizers: https://aisafety.info/questions/8160/ What is deceptive alignment: https://aisafety.info/questions/8EL6/ Inner vs. outer alignment: https://aisafety.info/questions/8428/ Adversarial training: https://aisafety.info/questions/935A/ # Referenced Videos Intelligence and Stupidity - The Orthogonality Thesis: http://youtu.be/hEUO6pjwFOo 9 Examples of Specification Gaming: https://youtu.be/nKJlF-olKmg Why Would AI Want to do Bad Things? Instrumental Convergence: https://youtu.be/ZeecOKBus3Q Hill Climbing Algorithm & Artificial Intelligence - Computerphile: http://youtu.be/oSdPmxRCWws AI Gridworlds - Computerphile: http://youtu.be/eElfR_BnL5k Generative Adversarial Networks (GANs) - Computerphile: http://youtu.be/Sw9r8CL98N0 # Other Media The Simpsons Season 5 Episode 19: "Sweet Seymour Skinner's Baadasssss Song" 1970s Psychology study of imprinting in ducks. Behaviorism: http://youtu.be/2xd7o3z957c With thanks to my excellent Patreon supporters: https://www.patreon.com/robertskmiles - Timothy Lillicrap - Gladamas - James - Scott Worley - Chad Jones - Shevis Johnson - JJ Hepboin - Pedro A Ortega - Said Polat - Chris Canal - Jake Ehrlich - Kellen lask - Francisco Tolmasky - Michael Andregg - David Reid - Peter Rolf - Teague Lasser - Andrew Blackledge - Frank Marsman - Brad Brookshire - Cam MacFarlane - Jason Hise - Phil Moyer - Erik de Bruijn - Alec Johnson - Clemens Arbesser - Ludwig Schubert - Allen Faure - Eric James - Matheson Bayley - Qeith Wreid - jugettje dutchking - Owen Campbell-Moore - Atzin Espino-Murnane - Johnny Vaughan - Jacob Van Buren - Jonatan R - Ingvi Gautsson - Michael Greve - Tom O'Connor - Laura Olds - Jon Halliday - Paul Hobbs - Jeroen De Dauw - Lupuleasa Ionuț - Cooper Lawton - Tim Neilson - Eric Scammell - Igor Keller - Ben Glanton - anul kumar sinha - Duncan Orr - Will Glynn - Tyler Herrmann - Tomas Sayder - Ian Munro - Joshua Davis - Jérôme Beaulieu - Nathan Fish - Taras Bobrovytsky - Jeremy - Vaskó Richárd - Benjamin Watkin - Sebastian Birjoveanu - Andrew Harcourt - Luc Ritchie - Nicholas Guyett - James Hinchcliffe - 12tone - Oliver Habryka - Chris Beacham - Zachary Gidwitz - Nikita Kiriy - Parker - Andrew Schreiber - Steve Trambert - Mario Lois - Abigail Novick - Сергей Уваров - Bela R - Mink - Fionn - Dmitri Afanasjev - Marcel Ward - Andrew Weir - Kabs - Miłosz Wierzbicki - Tendayi Mawushe - Jake Fish - Wr4thon - Martin Ottosen - Robert Hildebrandt - Poker Chen - Kees - Darko Sperac - Paul Moffat - Robert Valdimarsson - Marco Tiraboschi - Michael Kuhinica - Fraser Cain - Robin Scharf - Klemen Slavic - Patrick Henderson - Oct todo22 - Melisa Kostrzewski - Hendrik - Daniel Munter - Alex Knauth - Kasper - Ian Reyes - James Fowkes - Tom Sayer - Len - Alan Bandurka - Ben H - Simon Pilkington - Daniel Kokotajlo - Peter Hozák - Diagon - Andreas Blomqvist - Bertalan Bodor - David Morgan - Zannheim - Daniel Eickhardt - lyon549 - Ihor Mukha - 14zRobot - Ivan - Jason Cherry - Igor (Kerogi) Kostenko - ib_ - Thomas Dingemanse - Stuart Alldritt - Alexander Brown - Devon Bernard - Ted Stokes - James Helms - Jesper Andersson - DeepFriedJif - Chris Dinant - Raphaël Lévy - Johannes Walter - Matt Stanton - Garrett Maring - Anthony Chiu - Ghaith Tarawneh - Julian Schulz - Stellated Hexahedron - Caleb - Scott Viteri - Conor Comiconor - Michael Roeschter - Georg Grass - Isak - Matthias Hölzl - Jim Renney - Edison Franklin - Piers Calderwood - Krzysztof Derecki - Mikhail Tikhomirov - Richard Otto - Matt Brauer - Jaeson Booker - Mateusz Krzaczek - Artem Honcharov - Michael Walters - Tomasz Gliniecki - Mihaly Barasz - Mark Woodward - Ranzear - Neil Palmere - Rajeen Nabid - Christian Epple - Clark Schaefer - Olivier Coutu - Iestyn bleasdale-shepherd - MojoExMachina - Marek Belski - Luke Peterson - Eric Eldard - Eric Rogstad - Eric Carlson - Caleb Larson - Braden Tisdale - Max Chiswick - Aron - David de Kloet - Sam Freedo - slindenau - A21 - Rodrigo Couto - Johannes Lindmark - Nicholas Turner - Tero K https://www.patreon.com/robertskmiles