Jump to content
 
Lhannan

No way to track eyebrows?

Recommended Posts

I'm using the SRanipal Unreal plugin and I noticed the test avatar does have a blendshape for frown as well as blendshapes for wide eyes (that makes the brows arch a bit) but neither of these activate on my face. I'd think at least the wide eye one would work so what am I doing wrong?

Would also love to know any detailed info on tracking the brows in general, as I notice the camera probably doesn't catch much brow movement but it would maybe technically be possible to have it track the furrowing skin between the eyebrows? I'm making a thing for a specific use case so it doesn't have to work with all people and both me and the user have quite noticeable furrowing. I need to be able to show on an avatar when we're annoyed ;D

Thanks in advance for any help!

Share this post


Link to post
Share on other sites

@Lhannan Are you testing with the v2 framework version? Support for extra blendshapes was added in v2.

Share this post


Link to post
Share on other sites

@Corvus I was told about this and would love to try it, but I've never gotten the v2 test to work in my build. When I VR preview there's just nothing where there should have been a head. I've tried both test scenes, as well as swapping the v1 scene (where the v1 head works) to v2. Still got nothing...using 4.23. I'm used to blueprints so it hasn't been very easy for me to debug this stuff... Do you have any advice? Thank you for responding!

Share this post


Link to post
Share on other sites

@Lhannan Okay thanks for reporting this. We will look into Unreal 4.23 + v2 support and follow up with you if we can reproduce the issue.

Share this post


Link to post
Share on other sites

@Corvus Do you know if it's certain to work in a different engine version? I can easily switch and do a test as well 🙂

Share this post


Link to post
Share on other sites

@Lhannan I believe it works in 4.22 & 4.23 but haven't confirmed. I know that 4.24 & 4.25 require some code changes to work with the eye tracking SDK. Feel free to test 4.22. Make sure you're using the v2 test scene and v2 framework.

  • Like 1

Share this post


Link to post
Share on other sites

@Corvus For me it seems to work better in 4.22 than 4.23! In 4.22 I got the v2 to work, it tracks eyebrows well in the beginning but then seems to lose tracking a bit. Gonna try to darken my eyebrows a bit to see if that helps (they're pretty light naturally, so figure it's worth a shot). In 4.23 the face disappearing was also an ongoing bug in both tests, but with v1 I just needed to restart to get it to pop back in. Haven't had any similar trouble in 4.22 yet so very promising! Just thought I'd update you, thanks for your help so far! 

  • Thanks 1

Share this post


Link to post
Share on other sites

@Lhannan Interesting, thanks for sharing your test results! Also, make sure you have recently calibrated ( I find it helps with more accurate facial animation, less twitchy).

Share this post


Link to post
Share on other sites

Hey @Lhannan,

I tried UE 4.23 + v2 and everything worked fine. Are you using the EyeSample2 Level? 
Here is a capture showing the wide eyes blendshape animation
73c1478760be51e533a43971f936b088.gif 
 

  • Like 1

Share this post


Link to post
Share on other sites

Please sign in to comment

You need to be a member in order to leave a comment

Sign in

Already have an account? Sign in here.

Sign In Now

×
×
  • Create New...