MENU

Fun & Interesting

Geometry Nodes AI-auto building/editing. (WIP)

Alexandr Khoz 61 6 days ago
Video Not Working? Fix It Now

My current stage of working on integrating AI into Blender's Geometry Node system via addon. Here are some extra info towards the video: 1. The cost is shown as attributed to Claude 3.7 usage, but the LLM model I'm using different free API, so there's no cost. 2. The example is simple, yet the AI struggles to generate a correct result and misses a proper bouncing curve arc—a feature that's not hard to implement. Previously, I got good results, but i didnt wanna show best what model can do, but an average! 3. The AI currently makes many errors during code execution because the nodes differense. I'm working on providing the best input options to fix the informational gap in the AI's knowledge. 4. There are many additional features that need to be added, including support for various AI models, extra fixes of execution etc. 5. AI models that work out-of-the-box without external APIs are usually slow and require a powerful GPU; I can't say for sure that I'll implement them. 6. Does it work with more complex systems? I tested it on some of my work-based geometry nodes, and it performed pretty well—although I might have been lucky. It will undoubtedly struggle with very complex setups, but in my opinion, this is just the beginning. 7. Jumping ball wasnt in example.py, its just python code to create around 10 geometry nodes and connect them properly. 8. Does it just create new node system or it can edit mine? - For now best approach is re-creating your current set-up and add extra nodes that neede or delete part of your nodes. Which is a bit more expensive, but im working on better approach! If you have any questions, feel free to ask in the comments!

Comment