To try everything Brilliant has to offer—free—for a full 30 days, visit https://brilliant.org/GosuCoder/ . You’ll also get 20% off an annual premium subscription.
00:00 - Introduction: Local Models and Tool Calling
00:34 - Demystifying Tool Calling: API vs. Text Tags
01:50 - How API-Based Function Calling Works
03:40 - Pros of Structured API-Based Calls
04:56 - Why Framework Tool Calls Slow You Down
05:52 - Alternative Method: Tag-Based Tool Calls
06:30 - RooCode’s XML Tagging Approach Explained
08:50 - Live Demo: My Production Tag-Based System
11:39 - Comparing Tag-Based vs API-Based Methods
12:36 - Latency vs Tokens: Key Trade-Offs
13:02 - Reliability & Tool Call Errors Explained
13:53 - Avoiding Vendor Lock-In with Tag-Based Calls
14:16 - Quick Sponsor Break
15:14 - Top Reasons to Use Tag-Based Tool Calling
16:00 - Downsides & Challenges of Tag-Based Approach
17:25 - Final Thoughts & Your Opinion
RooCode is amazing, in this video I attempt to explain how it does its tool calling, and how it compares to using it via the OpenAI client.
My Links 🔗
👉🏻 Subscribe: https://www.youtube.com/@GosuCoder
👉🏻 Twitter/X: https://x.com/GosuCoder
👉🏻 LinkedIn: https://www.linkedin.com/in/adamwilliamlarson/
👉🏻 Discord: https://discord.gg/YGS4AJ2MxA
My computer specs
GPU: 7900xtx
CPU: 7800x3d
RAM: DDR5 6000Mhz
Media/Sponsorship Inquiries ✅
gosucoderyt@gmail.com
This video was sponsored by Brilliant