zzy Posted March 28, 2019 Share Posted March 28, 2019 Hello everyone, I'm developer of Vive Hand Tracking SDK. This topic will include some suggestions and requirements for using Hand Tracking SDK. Before going through the following FAQ, I suggest you to read our official document, especially the overview section and corresponding plugin documents of your choice. This FAQ is intended for latest version (v0.9.1). If you are using older version, please upgrade to v0.9.1 first. About cosmos support Vive Cosmos support is added in v0.8.2 since it requires different camera API than Vive and Vive Pro. Please make sure version of your Vive Console is up to date. Pre-built samples Starting from version v0.8.2, prebuilt samples are provided in the package. Please refer to the "Prebuilt samples" folder in the zip file. The sample files are provided for Windows (Vive, Vive Po & Vive Cosmos) and WaveVR (Vive Focus & Vive Focus Plus). They are built using Sample scene in the Unity plugin. DllNotFoundException: aristo_interface To run inside Unity Editor, please make sure: Your are using 64bit Unity Editor. Make sure OpenVR is selected and loaded as VR/XR device. Start Detection Error: Camera Hand tracking SDK uses camera frames to detect hands, so make sure you have correct setup for camera device: On Windows, make sure you have setup SteamVR following our document. On Android phones & Focus, make sure you have granted camera permission before start detection. Some android phones does not support NDK camera2 API, therefore the camera cannot be started. Please try another mobile phone or upgrade system. You can use NDK camera2 sample to check if your phone supports this API. Some phones are reported that does not support NDK camera2 API: Xiaomi Redmi Note5, Meizu phones. Start Detection Error: OpenCL Hand tracking SDK on Windows requires OpenCL for GPU acceleration, therefore please make sure you have proper drivers installed: Upgrade your GPU driver to latest version from NVIDIA/AMD offical website. Make sure you closed SteamVR before running GPU installer If you have Intel integrated GPU, please make sure you installed latest driver of iGPU as well Unity 2018 series (before 2018.3.3f1) have issues for OpenCL in Unity Editor. See details in this Unity issue Bad hand detection accuracy Hand Tracking SDK uses a deep learning model to detection hands and fingers. So the accuracy depends largely on the training images, and we are consistently collecting data and improving accuracy. Therefore, hand detection, especially finger tracking, may vary based on your lighting condition and background. Here are some tips for temporarily improve accuracy: Roll you your sleeves, make sure wrest is fully visible. This can improve the finger accuracy a lot. On Vive Pro and Vive Focus, please hold your hand a little higher, since the camera vertical FOV is quite small. Try to have a high constract background with your hands. For example, avoid yellow wallpaper or wooden floor if you are East Asian; avoid white walls if you are European. The same goes for lighting. Try to use different light colors, and make sure it's neither too dark (cannot distinguish your hand from environment) nor too light (lossing hand texture details) in your room. On Android phone, make sure your phone is landscape left rotation. Link to comment Share on other sites More sharing options...
HarshKapoor Posted March 28, 2019 Share Posted March 28, 2019 Hey I am unable to figure out whats the problem here can you please help me with it? Its the sample scene, Unity 2018.3.5f1 Vive Hand Tracking SDK Link to comment Share on other sites More sharing options...
zzy Posted March 28, 2019 Author Share Posted March 28, 2019 1. Are you using 32-bit Unity? We only support 64-bit Unity Editor on 64-bit Windows. 2. Please check if Assets/Aristo/Plugins/x86_64/aristo_interface.dll exists. Link to comment Share on other sites More sharing options...
HarshKapoor Posted March 28, 2019 Share Posted March 28, 2019 It is a 64-bit Unity editor and yes the dll file exists at the given location. Link to comment Share on other sites More sharing options...
zzy Posted March 28, 2019 Author Share Posted March 28, 2019 Did you enable OpenVR in XRSettings? OpenVR must be loaded as the current XR device. Link to comment Share on other sites More sharing options...
HarshKapoor Posted March 28, 2019 Share Posted March 28, 2019 Yes it solved the problem. Thank you! Link to comment Share on other sites More sharing options...
zzy Posted March 28, 2019 Author Share Posted March 28, 2019 Good to see it works. I have editted the post to include your problem in FAQ. Link to comment Share on other sites More sharing options...
Venikovna Posted March 28, 2019 Share Posted March 28, 2019 Hello! Thank you for this post. But unfortunately, when I start the game in the "Sample" scene, I get the following error:"Start gesture detection failed: CameraUnityEngine.Debug:LogError(Object)Aristo.GestureProvider:StartGestureDetection()Aristo.<Start>c__Iterator0:MoveNext()UnityEngine.SetupCoroutine:InvokeMoveNext(IEnumerator, IntPtr"What can be wrong? Link to comment Share on other sites More sharing options...
zzy Posted March 29, 2019 Author Share Posted March 29, 2019 Please follow instructions in our document to setup camera on SteamVR: https://developer.viveport.com/documents/sdk/en/misc/steamvr.html Link to comment Share on other sites More sharing options...
MDV Games Posted April 2, 2019 Share Posted April 2, 2019 Hello, Could you tell me when the Vive Hand Tracking plugin will be available for Unreal Engine? I mean for Vive Focus (Android). Link to comment Share on other sites More sharing options...
Recommended Posts