zzy
-
Posts
219 -
Joined
-
Last visited
Content Type
Profiles
Forums
Blogs
Downloads
Posts posted by zzy
-
-
Hi @Tima
I've spent some time to check if we can support x86 in our current code base. There are some blockers:
- There are currently some dependencies (internal and external) missing x86 support.
- Performance of x86 is worse than x64, we need some time for tuning before release. Please note even after tuning, x64 still runs faster than x86.
Based on the current situation, I would expect at least 2-3 months before we can release the x86 version.
-
Hi @Tima
We only support x64 binaries in our SDK release for Windows due to the following reasons:
- Most VR developement tools supports x64 (Unity, Unreal) and are dropping x86 supports.
- VR applications usually can benefit from 64 bit advantages.
- Our QA process can be simplified.
-
Hi everyone,
Vive Hand Tracking SDK has a new release v0.9.2 today. You can download it from here.
Highlight of changes:
- Update deep learning models for all platform.
- Add pinch support and confidence value in hand result.
- Added support for Cosmos XR faceplate.
- Added a cartoon hand model.
- Add new demo for UI interaction.
For detailed changes, please refer to release notes.
-
Hi @LeRuf
After a few searching with Google, I think this might be a bug of Unity.
Here are related issues and forum discussion:
https://forum.unity.com/threads/fixed-memory-issues-on-android-since-2018-3-0f2.599551/
Although the issues are claimed to be fixed, but people are still experiencing this bug. You can even find people taking about Focus Plus in the first link.
Recommended solution:
- You can try the latest 2019.3 version (which should be 2019.3.13 according to this page: https://unity3d.com/cn/get-unity/download/archive)
- I would recommend using 2018.4 LTS version for stability.
- You to create a bug report to Unity to see if this can be fixed.
-
1
-
Hi @LeRuf
Yes, this seems like a memory leak. I'll try to see if I can reproduce it on my local side tomorrow.
-
Hi @LeRuf
From the log your pasted, I think the problem is here:
Quote0001/01/01 00:00:00.000 -1 -1 Info --------- beginning of crash2020/05/13 11:37:57.041 22605 22799 Fatal libc /buildbot/src/googleplex-android/ndk-release-r20/external/libcxx/../../external/libcxxabi/src/abort_message.cpp:73: abort_message: assertion "terminating with uncaught exception of type cv::Exception: OpenCV(3.4.7) D:\Project\deeplearning\aristo\3rdparty\download\opencv-3.4.7\modules\core\src\alloc.cpp:72: error: (-4:Insufficient memory) Failed to allocate 32768 bytes in function 'OutOfMemoryError'This seems like a out of memory. Some ways to fix:
- Build the app for arm64 using il2cpp. It should have more memory available than armv7.
- Remove some objects from the scene.
- I think some player settings can also help this, e.g. vertex compression, reduce number of shaders, etc.
-
Hi @LeRuf
Can you share the version of Vive Hand Tracking SDK and WaveVR SDK?
Please also provide the adb log about the crash, so we can help to analyze it.
-
Yes, Cosmos Elite is supported, it should be working fine using Vive Hand Tracking SDK 0.9.1 or newer. The tracking performance is same as the original Cosmos.
-
Hi @coloal
HandModel scene does work on Android phone, since this scene requires skeleton mode which is not supported on Android phone now.
I haven't used it with Vuforia or AR engine. Since we use NDK camera to get rear camera image, and Android only support one consumer for each camera, I think this will not work with other SDKs that also use rear camera.
-
Hi @davide445
Since we are now partly working from home, the next release will take some time. The estimated time now is first half of May.
-
Hi @nocanwin
We also have a 1060 notebook in office when we run tests. Though I didn't check the frame rate, but I don't feel any lagging when using the sample exe with Vive Pro. I'll check the frame time next week.
-
Hi @nocanwin
Hand tracking does not support running with CPU on Windows, so this error is expected behaviour.
As for the scene performance, do you have some break down about the time? What is the difference between 12ms and 5ms in Unity profiler? Can you identify some scripts that takes very long time, or the whole performance is slow? Please also check Windows Task Manager and see if CPU is at 100% utilization.
-
Hi @nocanwin
If the sample project runs at 9ms, then I would suggest you to check what is in your scene that makes the execution slow. I would suggest to use the same project for both sample and your scene to make a even compare.
What is your game engine, Unity or Unreal? What's your HMD? Do you have some detailed profiling result (provided by Unity or Unreal) that can show which functions is taking a very long time?
-
Hi @davide445
If you need to use Valve Index controllers, you must have lighthouse for it to work.
-
Hi @davide445
Sorry, I never used Gestoops before. There is not much info on their website, but they seems to be using seperate cameras. You might need to find places to attach these cameras like leap motion.
-
Hi @davide445
Thanks for the suggestion. I agree that a native working hand tracking using HMD front camera would be perfect solution, this is our goal for the Hand Tracking SDK.
We will consider your suggestion, however since this will require more resources and not as scalable as raw hands, we will put it at lower priority.
-
Hi @davide445
Glad to know you have mounted leap motion successfully. About your question, wearing a glove does not help for Vive Hand Tracking SDK, since our SDK is trained with hands without gloves. Here are some suggestion you can try:
- Roll up sleeves and take off your watch if any
- Avoid light sources in the background, including window and lights
- Try to make your room brighter (e.g. turn on the lights even in day time), but don't look at light sources directly
-
Hi @davide445
I'm not sure if the faceplate is purchasable by itself. You might need to buy the whole HMD.
-
Hi @davide445
If you what to use Vive knuckles, you need at least to use the HMD that supports lighthouse, be it either Vive Pro or Cosmos Elite. I'm not familiar with this, but I think you also need to use controllers that support knuckles.
-
Hi @davide445
Considering we collected more data from Vive Pro than Vive Cosmos, I think Vive Pro might perform better than Vive Cosmos, but that depends on your environment. If you already have a Vive Pro, I would suggest to test it yourself.
-
Hi @davide445
I haven't used Leap Motion for about 3 years, so I'm not sure if there is any place feasible on Cosmos for it. I think you have to test it yourself. As for the USB port, you might need the to connect to all the way back to your PC (ugly, but should be working).
Also, there is a new product that is announced recently: the Cosmos XR. We would expect hand tracking to perform better on it since camera is better.
-
Hi @davide445
Thanks for your video test. I think the problem is when your hand is small (e.g. fist gesture) or your hand is a little further from the camera, the result is not good enough. We will try to see how can we improve this situation.
As for the v1 release, we currently don't have a solid date for v1, but we definitely hope to have it this year. That's all I can say about the release date right now. We will keep using the same license as the current release.
Also, please note that due to the nature of the cameras, some self-occluded gestures may not have good performance, even in the v1 release. I would suggest you to avoid using such gestures in your application.
-
Hi @davide445
Please let me know what problem you encountered in UE4 so we help to solve the problem.
Regarding to the video, I think this is what to except at the moment, basically all your hands can be tracked correctly with small jitterness. There are some occasional wrong track result (especially for left hand) and we are trying to solve that issue.
To improve the situation, I think here are the things you can try:
- Try to increase the overall brightness of your environment. We have got reports that brighter room has better performance. Please avoid sunlight directly on your hand.
- Roll up your sleeves if any, this can help to reduce the chance of wrong track restuls.
- Try a cleaner environment.
Please let me know if this helps.
-
Hi @davide445
Since all your actions are quite similar to natural input, I think hand tracking is easier to learn than controllers, especially for non-gamers.
The SDK is in beta status because we think there are still much room for performance improvedment, but feel free to use it in your commercial projects.
As for the support, forum is the only public support for hand tracking currently. But if you already have Vive commercial support, you can raise your questions there and they will loop us to answer the questions for you.
@VibrantNebula, can you please help to comment about the commercial support?
-
1
-
Hand tracking not working unity
in VIVE Hand Tracking SDK
Posted
Hi @BruhMoment
I assume you are using Vive/Vive Pro, please follow the steps here to setup your steamvr for first time use: https://hub.vive.com/storage/tracking/misc/steamvr.html
I would suggest to read the our document first before develop, especially how to setup up the project and other settings: https://hub.vive.com/storage/tracking/unity/setup.html