How to Run Deepseek R1 671b Locally on $2K EPYC Server Writeup https://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/
$2K EPYC LOCAL AI SERVER
512GB DDR4 RAM https://geni.us/512GB_DDR4_RAM
MZ32-AR0 motherboard https://geni.us/mz32-ar0_motherboard
64 core EPYC CPU
7702 https://geni.us/EPYC_7702
7C13 https://geni.us/7C13_EPYC_CPU
7V13 https://geni.us/EPYC_7V13_CPU
Rack Frame https://geni.us/GPU_Rack_Frame
CPU cooler h170i elite capellix xt https://geni.us/Corsair_Elite_Cappelix
1TB NVMe - Samsung 980 Pro https://geni.us/Samsung_980_PRO
850W PSU https://geni.us/850W_PSU
AI Home Server Quad 3090 Build https://youtu.be/JN4EhaM7vyw
Quad GPU AI Training Rig Writeup https://digitalspaceport.com/ollama-gpu-3090-home-server-quad-gpu-ai-training-rig/
Running and Testing Deepseek R1 671B Locally on R930 Server https://youtu.be/yFKOOK6qqT8
Deepseek R1 671b Setup and Running Locally Writeup https://digitalspaceport.com/running-deepseek-r1-locally-not-a-distilled-qwen-or-llama/
Be sure to 👍✅Subscribe✅👍 for more content like this!
Join this channel https://www.youtube.com/@DigitalSpaceport/join
Digital Spaceport Website https://digitalspaceport.com
Patreon https://www.patreon.com/digitalspaceport
Buy Me a Coffee https://buymeacoffee.com/digitalspaceport
Please share this video to help spread the word and drop a comment below with your thoughts or questions. Thanks for watching!
Chapters
0:00 Running Deepseek R1 671b Local Ai Rig
2:55 Deepseek Performance Guide
8:40 Local Ai Deepseek R1 671b Tokens Per Second Benchmark
9:14 Oneshot Code Testing Deepseek R1
12:43 EPYC Deepseek CPUs
24:03 Armageddon with a Twist
26:39 Sentence parsing and counting
27:57 Deductive Arrays and offsets
29:18 Numeric Comparison
30:28 Parsing Peppermints
32:35 Timing for Pico de Gato
33:39 Hundred Decimals of Pi
35:03 Create and SVG of a Smiley
37:00 Classic two car word problem
40:11 AMD EPYC LLM Bios Tuning for CPU Inference
47:02 GPU and CPU Deepseek Ai Server
*****
As an Amazon Associate I earn from qualifying purchases.
When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
*****