The new #GodotEngine showreel is up! Or "are" actually, since there were so many submissions that we made two videos.
available here: https://gitlab.com/frankiezafe/4dface-osc
At last, a visually decent demo of all the modifiers included in the addon futari for Godot.walls or floor colliderattractors (positive and negative)windvortex
And, obviously, it would not be fun without a video!
I’ve spend my day testing several face tracking solutions. The idea is to generate data for Godot Engine and control the face of an avatar with mine, for a numediart project.
Here is what i’ve tested:OpenPose
Obviously, the famous library. Tricky to install: you need cuda toolkit & cuDNN to start compiling. As it is the first one, i didn’t manage to run it again at the end of the day, so no screenshot… There is no direct example for 3D face tracking, only 2D is working out-of-the-box, and fps is not sexy at all (~15fps)https://github.com/CMU-Perceptual-Computing-Lab/openposeDlib
Lightweight library, compared to openpose, and therefore much more friendly. Managed to have a decent framerate wit my webcam, but still no 3D here…
Something looking like a 3d head estimation is demonstrated here: https://www.learnopencv.com/head-pose-estimation-using-opencv-and-dlib/
But I didn’t managed to see any results for 3d with the code provided in his version of dlib: https://github.com/spmallick/dlib4dface
The original repository of the company 4dface, who has gone closed-source after starting to make some money.The software uses a lot of git submodules, but is quite easy to setup when you have recompiled opencv3 & cmake 3.14 from source.
The fps is terrible, but everything is there for 3d: mesh reconstruction and texture mapping! There is also lots of forks, maybe up-to-date… Definitively the best option, only have to focus on the poor framerate.
update: the Release flag was not set in CMake… By enabling it, the fps is jumping to 5fps. Not incredible, but enough to have the sensation of motion.
Next step is to extract landmarks in 3d and broadcast them in OSC!SentiMask
I even tested closed-source library today! Purely commercial, at 399$ as entry-fee, i was hoping for a super-fast solution, making all the other ones insignificant, and, no. SentiMask is clearly not doing better than 4dface out-of-the-box. The rendering is just better.
The huge restriction implied by the license does not worth the ethical cost of using it.
Futari walls, attractors, winds & vortex demo https://peertube.mastodon.host/videos/watch/14884905-f539-4aae-9a38-3b605433e1d5
Here's a non-animated view of the Godot MIDI keyboard input demo in action. Source code available here: https://github.com/follower/godot-midi-input-example/ #GodotEngine
basic physic collider (plane) for #godotengine https://peertube.mastodon.host/videos/watch/167d1c09-5280-45f1-95be-c2aaf39afd71
This game dev duo built a #bot that generates custom versions of the same mobile slot machine game and published 1,500 of them on the Play store. All the lessons learned in this wonderful #gdc talk:
#Godotengine generating images for stage performance https://peertube.mastodon.host/videos/watch/e45b294e-8072-4aba-94ed-05e4a641fedc
The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!