Ray Meetup: LLMs on Ray + LanceDB

Catch the latest Ray meetup featuring our friends at LanceDB! 🔍 Topic: LLMs on Ray + LanceDB 🎙️ Speakers: Jonathan Hsieh (Software Engineer, LanceDB) - Scaling Multimodal Pipelines with LanceDB + Ray Richard Liaw (Product Manager, Anyscale) - Native Ray APIs for LLM Inference Modern AI workloads come with unique challenges—especially when it comes to multimodal data, scalability, and reproducibility. In this session: 🚀 Jonathan Hsieh explores how LanceDB is built from the ground up to tackle the multimodal data storage problem, highlighting features like zero-cost schema evolution that boost AI engineer productivity. He also covers how Ray and Ray Data help scale and streamline data processing pipelines. 🧠 Richard Liaw dives into Native Ray APIs for LLM inference, explaining the complexities of working with open-source LLMs. He introduces two powerful new APIs from the latest Ray release: 💾 Batch LLM Inference with Ray Data LLM ☼ Online LLM Inference with Ray Serve LLM 🌐 Learn how Anyscale and LanceDB partnered to level up the AI development experience. -- -- 🔗 Connect with us: - Subscribe to our YouTube channel: https://www.youtube.com/@anyscale - Twitter: https://x.com/anyscalecompute - LinkedIn: https://linkedin.com/company/joinanyscale/ - Website: https://www.anyscale.com #LanceDB #Ray #AI #LLM #Anyscale #MultimodalAI #MachineLearning #OpenSource ##LLMInference #RayServe #RayData