The needs of AI developers at LinkedIn go far beyond simple serving of models. In this talk, we will share our journey to serving complex real-world Machine Learning (ML) workflows. We will talk about how we leverage Ray serving now, and in the future. We will also discuss the solutions we are developing to address the growing complexity of AI-based applications and to make the work of AI engineers more productive.
Find the slide deck here: https://drive.google.com/file/d/12G6sEh8Ml7u_fbMPHTF-BVzNsBx9fB5S/view?usp=drive_link
About Anyscale
---
Anyscale is the AI Application Platform for developing, running, and scaling AI.
https://www.anyscale.com/
If you're interested in a managed Ray service, check out:
https://www.anyscale.com/signup/
About Ray
---
Ray is the most popular open source framework for scaling and productionizing AI workloads. From Generative AI and LLMs to computer vision, Ray powers the world’s most ambitious AI workloads.
https://docs.ray.io/en/latest/
#llm #machinelearning #ray #deeplearning #distributedsystems #python #genai