MENU

Fun & Interesting

How to Create ARKit Face Tracking for 3D VTubing - FULL Tutorial

Dani Periapsis 129,076 lượt xem 2 years ago
Video Not Working? Fix It Now

*2024 UPDATE*
You can now do ARKIT face-tracking without selling a kidney to Apple! Praise be the devs at ifacialmocap! 神です!
Check link below:
https://twitter.com/ifacialmocap/status/1762455154270556308

5ish minute -Lazy- tutorial covering everything from blender blendshapes to esoteric Unity rituals & VSeeFace! ft. kidnapped sister from #genshinimpact

Very Quiet ARKit Discussion Discord - https://discord.gg/W2CEAYWyFf

— Software —
Blender — https://www.Blender.org
Unity (2019.4.31f1) — https://unity3d.com/unity/whats-new/2019.4.31
VSeeFace — https://www.vseeface.icu/#download
ifacialmocap —https://apps.apple.com/us/app/ifacialmocap/id1489470545

— Mr. Baldy —
*24/03/01 New Link* thx GBs & TheNidoqueer for the heads up! Mr. Baldy Never Dies
https://drive.google.com/file/d/1OBG-hJTQldP3xx73ErBsTaptMg4gvgXX/view?usp=sharing

— Blendshape Names —
https://docs.unity3d.com/Packages/com.unity.xr.arkit-face-tracking@1.0/api/UnityEngine.XR.ARKit.ARKitBlendShapeLocation.html#fields

— Unity Packages —
UniVRM (0.89) — https://github.com/vrm-c/UniVRM/releases/download/v0.89.0/UniVRM-0.89.0_9470.unitypackage
VSF_SDK — https://github.com/emilianavt/VSeeFaceSDK/releases/download/v1.13.38a/VSF_SDK_v1.13.38a.unitypackage
Poiyomi — https://www.patreon.com/poiyomi

— Stolen Goods —
SPEED — Ian Hubert
3D Model — miHoYo, Hoyoverse
3D Model MMD Edit — 观海
Mr. Baldy — Previous link was from mads/ocuuda’s website, his tweets inspired me to look into ARKit in the first place. Since that depreciated it is now a different Google Drive link.
Knowledge — Other great youtubers such as deat, fofamit, kanafuyuko, royalskies, priichu, kaideart, etc. I'm just regurgitating their videos.
04:25 Aranara Perspective Lumine — **鯛** https://www.pixiv.net/en/artworks/101599186
iphone 13 — Dad ᐕ)♡

— Timestamps —
00:09 Blender
01:34 Unity
04:04 ifacialmocap & VSeeFace

Comment