Jump to content
 
davide445

Hand tracking test 0.91 Vive Cosmos

Recommended Posts

@VibrantNebula

looking at other options the only I can find are Occipital Structure, Intel RealSense and Orbbec Astra Mini, all with Gestoos sw for gesture recognition. 

Any experiences with one of them? 

Share this post


Link to post
Share on other sites
11 hours ago, davide445 said:

@VibrantNebula

looking at other options the only I can find are Occipital Structure, Intel RealSense and Orbbec Astra Mini, all with Gestoos sw for gesture recognition. 

Any experiences with one of them? 

PS also can anyone check if a 13x80mm (0.5x3.2 inch) object (the Leap Motion sensor) can fit horizontally into the Cosmos without occluding the cameras? Movements limited to the office here, so can't check by myself.

Share this post


Link to post
Share on other sites

IMG_20200312_124420.thumb.jpg.38921d47e1d31b189b4f2df16190e46b.jpg

I think will be possible. Next step I suppose receive a Leap Motion for a test. Problem will be to fix it, also not sure if is any better place under or over the two cameras, depending on what's behind. 

Share this post


Link to post
Share on other sites
Posted (edited)

@zzy @VibrantNebula Received the Leap Motion, was looking at the best way to mount it. Since the 3M stich it's one use didn't want to trial and error.

In this way I'm using his mouIMG_20200319_193901.thumb.jpg.e198837aa74936e9ff035a814dcae9ed.jpgIMG_20200319_193913.thumb.jpg.7c690211662f884c8503a18d21a01ae2.jpgnting kit, will create troubles with the headset tracking? Controllers tracking it's not more a problem in this case

Edited by davide445

Share this post


Link to post
Share on other sites
Posted (edited)

I finally mounted the Leap Motion using a biadhesive so to have (for test purpose) the most flexible installation

spacer.png

That said the experience it's better than with HTC SDK but not reliable as was supposed to be in my expectations. 

Waiting for any improvement suggestions from Ultraleap, wanted to ask @zzy if wearing a glove with stamped different markers on any finger will help improving the tracking using the native SDK.

I'm starting to wonder if in general the whole hand tracking its still an r&d topic and not ready for prime time. 

Edited by davide445

Share this post


Link to post
Share on other sites

Hi @davide445

Glad to know you have mounted leap motion successfully. About your question, wearing a glove does not help for Vive Hand Tracking SDK, since our SDK is trained with hands without gloves. Here are some suggestion you can try:

  1. Roll up sleeves and take off your watch if any
  2. Avoid light sources in the background, including window and lights
  3. Try to make your room brighter (e.g. turn on the lights even in day time), but don't look at light sources directly

Share this post


Link to post
Share on other sites

Thanks @zzy but my idea was not simply gloves but gloves with attached specific QR markers for each finger.

Since you are using a DNN I suppose you will need to train it with also this markers, but this might improve the recognition. 

Also from the user point of view I didn't see a problem in wearing passive simple gloves provided with markers stamped. 

I'm searching and effective solution to a problem I didn't see one so far. 

Share this post


Link to post
Share on other sites

spacer.png

Just to give an idea. In this way you can also I suppose increase your training set size by also generating it trough 3d simulation, since your focus will be not in fact a real hand but a glove, easier to render.

I know I'm now speaking more about R&D, but if correctly working reliably a native hand tracking using just Cosmos cameras would be the perfect solution.

Share this post


Link to post
Share on other sites

Hi @davide445

Thanks for the suggestion. I agree that a native working hand tracking using HMD front camera would be perfect solution, this is our goal for the Hand Tracking SDK.

We will consider your suggestion, however since this will require more resources and not as scalable as raw hands, we will put it at lower priority.

Share this post


Link to post
Share on other sites

@zzy in the meantime I need to find a working solution.

Apart Leap Motion own Orion software, was looking various suppliers of 3d depth cameras are suggesting Gestoos as gesture recognition software. Didn't find it mentioned in this forum, you ever have had experience with it

Share this post


Link to post
Share on other sites

Please sign in to comment

You need to be a member in order to leave a comment

Sign in

Already have an account? Sign in here.

Sign In Now

×
×
  • Create New...