Running your own ChatGPT - How to Set Up LLMs Locally - Chris McCabe - NIDC 2024 - Hall 1B

In this talk, we’ll explore the benefits of running your own large language models (LLMs), such as enhanced privacy, model flexibility, and uncensored usage. We’ll demystify key terms, showcase available models with practical examples, and walk through setting up tools like Ollama and a chat interface. Additionally, we’ll compare models, dive into prompt engineering, and demonstrate how to integrate python with local models to enhance functionality. Whether you're a developer or tech enthusiast, this session will equip you with the knowledge to run LLMs on your own terms.

-

Recorded in Hall 1B of The ICC Belfast, Northern Ireland
NIDC 2024 - Saturday, 23rd November 2024