Join our Open NLP meetup: https://www.meetup.com/open-nlp-meetup/
🎤 00:37 - Bending LLMs To Your Will (and your will is to create structured data)
by Tuana Çelik
In this talk, we will have a look at how Haystack and its pipeline architecture (which is essentially a graph) allows you to build highly customized LLM applications. As an example, we will look at how we can create an application that can create structured data from text, that abides by our definition of structure. Let’s say you want to create a list of GitHub issues based on a conversation you had with colleagues. Wouldn’t it be great to have a system that extracts all of the relevant information from your meeting notes and creates GitHub issues that abide by your labels, and issue structure? Let’s see how Haystack’s custom components and pipeline architecture let you do just that.
🎤 22:46 - Challenges in Serving Self-Hosted LLM Applications at Enterprise Scale
by Fergus Finn
In this talk, we will explore the challenges and solutions in effectively designing, serving, and scaling Large Language Model (LLM) applications.
We’ll focus on the practical challenges we experienced when designing our efficient Takeoff inference server, including how to manage workload with different batching strategies and performance enhancements like quantization and caching. We’ll also discuss how to efficiently enforce LLM output formats, such as JSON and regex, which are vital for getting predictable and repeatable outputs in applications. This session aims to provide actionable insights for professionals looking to optimize their LLM applications for large-scale operations.
🎤 42:46 - From Lab to Life: The Evolution of Jina Embeddings in Practical Applications
by Isabelle Mohr
We released Jina Embeddings V2 in November 2023, the first open-source long context embedding models. This talk covers how we addressed technical challenges while building and training these models, and how they are effectively used in practical applications
Learn more about deepset: https://www.deepset.ai/
Learn more about TitanML: https://www.titanml.co/
Learn more about JinaAI: https://jina.ai/embeddings/
#LLM
#NLP
#opensource
#Haystack
#meetup
#startup
#machinelearning