Hi Friends, my name is Callum aka wanderloots. In today's video, I walk through How To Run Local AI (LLM & Text Embedding) In Obsidian with LM Studio (or Ollama). This method is Free, Private, & Local ππ‘I also compare the Smart Connections Plugin & the Obsidian Copilot Plugin. I was surprised how they each work better in different ways!
The Copilot Plugin is a free & private AI tool that ~can~ operate locally within Obsidian, with various features that leverage your existing note-taking through a local embeddings model
The Smart Connections Plugin is also a free & private AI tool that operates 100% locally.
New ideas, surfacing insights, making connections, distilling complex information, there is no end to how AI can boost the notes you're already taking β¨
One of the main reasons I use Obsidian for my note-taking is that it operates in markdown, producing a future-proof intellectual property asset that can connect seamlessly with AI tools.
It's truly an incredible way to take your static notes in obsidian and turn them into dynamic knowledge, while retaining the authenticity of your own writing to work WITH AI, rather than replace your thinking/writing.
I hope you enjoy! β¨
P.S. I greatly appreciate any feedback, please let me know what you think π
Join My Membership: https://www.youtube.com/channel/UCFiU1vIpPD3lQltke_18m3A/join
Check out my PKM & Digital Gardening Obsidian Playlist here: https://www.youtube.com/playlist?list=PLWhMzDKA7vJ7p50vW-oeZgKR2aDReZFW6
π Sign up for my free newsletter: Recalibrating https://paragraph.xyz/@wanderloots.eth?referrer=wanderloots.eth
π§ Join my Hypersub Exclusive Membership (coming soon)
π‘ Wander my Digital Garden https://wanderloots.xyz
π° Try Ground News For Research: 40% discount https://check.ground.news/wanderloots
Timestamps:
00:00 Intro To AI + Obsidian
01:09 Today's Outline
02:09 Context On Why I Care About IP/Secure Data
02:46 Phase 1: Reviewing, Installing & Enabling Obsidian Copilot
06:20 Local Embedding Models
07:11 Copilot Default Settings Overview
07:41 Can I Use Copilot WITHOUT A Local Model?
09:37 Phase 2: Running A Local Model (Ollama vs LM Studio)
11:02 Why I'm Using LM Studio Today
12:33 Reviewing LM Studio Privacy & System Requirements
14:15 Installing LM Studio & Loading A LLM Local Model
17:16 Testing Gemma 3 12B & LM Studio Settings
19:17 IMPORTANT NOTE On Default Context Length
19:29 Loading Text Embedding Model & Essential LM Studio Settings
21:16 Back To Obsidian With Local Model Running
22:10 Phase 3: Adding & Connecting Local Model To Obsidian Copilot
23:20 Adding Your Custom Text Embedding Model To Copilot
24:36 Reviewing Copilot Local Model Settings
26:15 Copilot Custom Commands
27:04 Recap: Local Model Set Up & Connecting Obsidian Copilot
29:15 Adding Local Models To Smart Connections (Smart Chat)
30:00 Phase 4: Testing Copilot Vs Smart Connections With Local Model
30:30 Related Notes Comparison (Smart Connections vs Relevant Notes)
31:03 Testing Copilot Vault Q&A (Chat With Vault)
35:49 Saving AI Conversations (Auto Note Move)
37:10 Testing Smart Chat (Smart Connections)
37:59 Summary of AI Chat (Copilot vs Smart Connections)
38:55 Testing Smart Lookup (Smart Connections)
39:40 Phase 5: How I Will Use These Plugins Move Forwards
42:30 Pros & Cons Of Local Models Via Obsidian AI Plugins
44:10 Overall Thoughts On Local Models + Obsidian
44:42 My Future AI System & Next Steps
WATCH NEXT
π± Obsidian & Digital Gardens https://www.youtube.com/playlist?list=PLWhMzDKA7vJ7p50vW-oeZgKR2aDReZFW6
π§ Recalibrating (Main Storyline) https://www.youtube.com/playlist?list=PLWhMzDKA7vJ4SLS2e6KiPmu9mku81B__Y
π¨The Creative Act (Art and Mindfulness) (coming soon)
LINKS (MY WORLD)
π§ [Recalibrating Newsletter Home](https://paragraph.xyz/@wanderloots.eth?referrer=wanderloots.eth)
ποΈTo start reading from the beginning: [Recalibrating Newsletter Entry 1: What Recalibrating Means To Me](https://wanderloots.substack.com/p/1-what-recalibrating-means-to-me)
π My [Website](https://wanderloots.com/)
πΈ My [Print Shop](https://wanderloots.darkroom.com/) β¨
SOCIALS
π£ Farcaster https://warpcast.com/wanderloots.eth
πΈ [Instagram](https://www.instagram.com/_wanderloots/)
π° [Flipboard](https://flipboard.com/@_wanderloots)
π [Pinterest](https://www.pinterest.ca/wanderloots/)
π¦ [X (Twitter)](https://twitter.com/_wanderloots)
π§΅ [Threads](https://www.threads.net/@_wanderloots)
π€ [Reddit](https://www.reddit.com/user/_wanderloots)
MY FAVOURITE TOOLS
π΄ π€― The Waking Up App(https://dynamic.wakingup.com/guestpass/SC4914439) (use this link for a 30 day free trial)
π [Obsidian](https://obsidian.md/) (decentralized note-taking)
πΉ [Adobe Suite](https://prf.hn/l/lQ9DwpA) (general creativity)
EQUIPMENT USED
6. Camera [Sony A7iii](https://amzn.to/3seSHv6)
7. Lens [Sony F2 28 mm](https://amzn.to/3TiWCT2)
8. Tripod [K&F Concept](https://amzn.to/3soCKCP)
9. Lighting [Ubeesize Ring Light](https://amzn.to/3GD02Zy)
10. Main Lighting Neewer 660 PRO RGB: https://amzn.to/3CEcU2V