Autodesk's journey into large-scale 3D generative AI has led to a powerful synergy between Ray and Metaflow. In this session, Thomas Gale and Peter Meltzer from Autodesk, joined by Savin Goyal from Outerbounds, unveil how they've harnessed these tools to process terabytes of data and train advanced 3D models.
The presenters dive into their innovative approach of integrating Ray's distributed computing capabilities with Metaflow's workflow orchestration. They showcase custom Metaflow flows designed for seamless Ray integration, exploring both ephemeral and pre-existing cluster strategies. The talk highlights Autodesk's contributions to the open-source community, including the @metaflow_ray decorator for native Ray cluster creation. Attendees will gain insights into orchestrating complex AI pipelines, from data extraction and deduplication to model training, all while maintaining robust artifact tracking and metadata management in a production environment.
--
Interested in more?
- Watch the full Day 1 Keynote: https://youtu.be/jwZHJthQvXo
- Watch the full Day 2 Keynote https://youtu.be/Lury2ad6KG8
- Check out the Ray Summmit Breakout sessions https://youtube.com/playlist?list=PLzTswPQNepXntmT8jr9WaNfqQ60QwW7-U&si=qPw-_SxT9lVmbRGE
--
🔗 Connect with us:
- Subscribe to our YouTube channel: https://www.youtube.com/@anyscale
- Twitter: https://x.com/anyscalecompute
- LinkedIn: https://linkedin.com/company/joinanyscale/
- Website: https://www.anyscale.com