MENU

Fun & Interesting

Motion Capture / Mocap Sensor to Unreal (UE4 / UE5) using BNO055 and ESP32 Feather with perfection

OtherYATC 25,534 3 years ago
Video Not Working? Fix It Now

Mocap Suit Building Part 12 In this video, I have covered the steps required to integrate BNO055 all the way to Unreal (UE4 / UE5). While doing the integration, I have covered some essential and basic understanding of UDP and JSON. I have given a detail walkthrough of the sourcecode in ESP32 / Arduino to setup WiFi module and JSON construction. At unreal side, I have covered how to compile plugins between versions and how to create a custom plugins. Along with that, I have covered how to write a blueprint in Unreal (UE4 / UE5) and how to access static mesh from different blueprint object. Finally, I have shown how smooth BNO055's data is been appearing in Unreal. This post detailed writeup: https://www.patreon.com/posts/63554845 Important Information: Accelerometer: https://youtu.be/66kCX-QYZHA and Sourcecode: https://www.patreon.com/posts/61214703 Gyroscope: https://youtu.be/_v2_kIsf_OM (Part1) and https://www.patreon.com/posts/62003316 (sourcecode), https://youtu.be/hH4PHaEwwVk (Part2) and https://www.patreon.com/posts/62369320 (sourcecode) Magnetometer: https://youtu.be/wzjQ8L090s0 and Sourcecode: https://www.patreon.com/posts/63253114 Low Pass Filter: https://youtu.be/0dK7xoEagoo and https://www.patreon.com/posts/61781469 (sourcecode) Sensor Fusion: https://youtu.be/4T5AI1iF1Kc and https://www.patreon.com/posts/62675791 (Detail writeup) Complementary Filter: https://youtu.be/vknohSbR6ME and https://www.patreon.com/posts/63103835 (sourcecode) UDP Plugin links: http://github.com/getnamo/udp-ue4 Socket io client link: https://github.com/getnamo/socketio-client-ue4 How to download from Github: git clone with submodule: git clone --recurse-submodules https://github.com/socketio/socket.io-client-cpp.git How to compile plugins in different version: RunUAT.bat BuildPlugin -plugin="C:\Others\udp-ue4-1.0.0\UDPWrapper.uplugin" -package="C:\Users\arind\5" -TargetPlatforms=Win64 Video Chapters: 00:00 How to connect and visualize Motion Sensor data in Unreal Engine (UE4 / UE5) 01:07 Steps to connect BNO055 / ESP32 to Unreal (UE4 / UE5) 02:19 How to configure WiFi in ESP32 to connect to router 05:20 What is JSON and How to create JSON object in ESP32 / Arduino 06:25 How to use JSON in Arduino 07:54 Difference between TCP and USP 08:42 How to send data from ESP32 / Arduino to Unreal (UE4 / UE5) 10:27 How to receive data from external source in Unreal (UE4 / UE5) 11:25 How to configure UDP messaging in Unreal Engine (UE4 / UE5) 11:56 How to compile plugin in Unreal / How to compile UE4 plugins in UE5 (Unreal 5) 13:02 How to use custom plugins in Unreal (UE4 / UE5) / What is UDP Messaging Plugin in Unreal 14:04 What is a static mesh 14:43 How to access a static mesh from another blueprint in Unreal Engine (UE4 / UE5) 15:55 How to map rotation angle details programmatically in Unreal (UE4 / UE5) / What is Blueprint 17:27 How to reactive data in Unreal (UE4 / UE5) using blueprint 18:28 How to create custom event in Unreal (UE4 / UE5) 18:45 How to use JSON in Unreal (UE4 / UE5) 20:47 BNO055 to Unreal (UE4 / UE5) 21:20 Conclusion and coming next Music source: https://mixkit.co/free-sound-effects Other video sources: https://www.pexels.com/ I am not an expert, I am learning while I am making this video. If I am making mistakes please help and please comment your opinion Thank you for watching To support me please visit: https://www.patreon.com/themakingofothers

Comment