MENU

Fun & Interesting

Prepare Fine-tuning Datasets with Open Source LLMs

Trelis Research 26,856 2 years ago
Video Not Working? Fix It Now

➡️ Get Life-time Access to the ADVANCED-fine-tuning Repo (incl. Data Prep Scripts): https://trelis.com/advanced-fine-tuning-scripts/ ➡️ Trelis Runpod Affiliate Link (supports the channel): https://runpod.io?ref=jmfkcdio Chapters: 0:00 Preparing data for fine-tuning 0:37 Video overview 1:04 Accessing the GitHub Repo w/ data preparation scripts 2:42 Q&A Dataset preparation using Llama 2 70B and chat-ui 7:29 How to set up a Llama 2 API for 70B 8:45 Using a Llama 2 API to prepare a Q&A dataset for fine-tuning 12:22 Pro tips for preparing fine-tuning datasets

Comment