Jump to content

[UPDATE][Wave 4.5.0] Demonstration on how to use WAVE Passthrough Underlay/Overlay APIs


Tony PH Lin

Recommended Posts

There’re many inquires on how to use Passthrough image or access raw camera images to create a Mixed Reality experience or MR effects.
Due to privacy policy, we do not offer ways to access the raw camera images, but here’re some examples on how to use our existing WAVE Passthrough Underlay/Overlay APIs.
The following message will show you the difference between the Passthrough Underlay and Overlay, you may choose which one is best suited for your content design.

Passthrough Underlay

By calling "WVR _ ShowPassthroughUnderlay" API, you can show the Passthrough images underneath the original rendering content.

OverlayUnderlay_Black_1.gif.11ef8957daf94ff3d0e07e1bd84fc2f2.gif

Here are some examples that use Passthrough Underlay, such as VIVE Room Setup, VR boundaries, and 3D Objects.

OverlayUnderlay_Black_2.gif.1ae5327ca2c416958815c1421bfe4ee9.gif

Passthrough Overlay

By calling "WVR _ ShowPassthroughOverlay", the Passthrough image will be showing on top of everything in the scene.

[UPDATE] From Wave 4.5.0, it's allowed to set passthrough overlay alpha value. 

Overlay_page.gif.f215ba42f793e115d5dbe567390ea71e.gif

Link to comment
Share on other sites

2 hours ago, Tony PH Lin said:

Hi @Tony PH Lin,

I am in need of using Passthrough Overlay/Underlay function on Focus 3 from Wave 4.x series.

Could you give me further detail info?

I have no experience in Wave Native SDK because I develop XR contents with Unity environment.

Could you let me know how to access Passthrough Overlay/Underlay function under Unity environment?

Specifically, I need further detail info regarding how to use access Wave Native SDK in C# script.

Thanks in advance.

 

Edited by Yeongjae_Choi
Link to comment
Share on other sites

On 3/10/2022 at 11:53 PM, Alex_HTC said:

An example showing how to use these apis is here:
https://github.com/hardcoded2/WavePassthroughOverlayExample

It is my understanding that the above will work on focus3 and flow support is forthcoming.

Hi, @Alex_HTC

Thank you for your sharing 'WavePassthroughOverlayExample' project.

To build and run your project, I did the following steps:

(Step 1) Open your project with Unity 2019.4.30f1.
(Step 2) Open 'SampleScene' under 'Assets > Scenes'
(Step 3) Switch 'Build Settings' from PC to Android by clicking 'Switch Platform' button
(Step 4) Click 'Build And Run' button

But, it fails to run on my Vive Focus 3 device with the following error message:
image

Could you give me some help for fixing the problem?

PS1.
To keep my Vive Focus 3 device up-to-date,
I updated to VIVE Focus 3 Software (FOTA 3.3) 3.0.999.368 which was released February 23rd, 2022.

PS2.
I also tried to change your project's minimum API level from 26 to 24 under 'Project Settings > Player > Other Settings > Minimum API Level',
but it still fails to run on my Vive Focus 3 device with the following error message:
image

Edited by Yeongjae_Choi
Link to comment
Share on other sites

19 hours ago, Yeongjae_Choi said:

Hi, @Alex_HTC

Thank you for your sharing 'WavePassthroughOverlayExample' project.

To build and run your project, I did the following steps:

(Step 1) Open your project with Unity 2019.4.30f1.
(Step 2) Open 'SampleScene' under 'Assets > Scenes'
(Step 3) Switch 'Build Settings' from PC to Android by clicking 'Switch Platform' button
(Step 4) Click 'Build And Run' button

But, it fails to run on my Vive Focus 3 device with the following error message:
image

Could you give me some help for fixing the problem?

PS1.
To keep my Vive Focus 3 device up-to-date,
I updated to VIVE Focus 3 Software (FOTA 3.3) 3.0.999.368 which was released February 23rd, 2022.

PS2.
I also tried to change your project's minimum API level from 26 to 24 under 'Project Settings > Player > Other Settings > Minimum API Level',
but it still fails to run on my Vive Focus 3 device with the following error message:
image

 

Sorry for giving you inconvenience.

I found that the problem was due to the improper recognition of Vive Focus3 device on my desktop PC.

I repeated connecting and disconnecting Vive Focus3 device to my desktop PC, several times.

And it is finally recognized correctly as follows:

image.png.f9ca705ef58ff6c4a899b7b2413523b7.png

 

Thank you for your help.

  • Like 1
Link to comment
Share on other sites

  • 3 weeks later...

>Yes, these APIs are supported on Focus 3 from Wave 4.x series.

 

On UE4.26.2 this example didn't work for us. Can you confirm 

 

Error	LNK2019	unresolved external symbol WVR_ShowPassthroughUnderlay referenced in function "public: virtual enum WVR_Result __cdecl FWaveVRAPIWrapper::ShowPassthroughUnderlay(bool)" (?ShowPassthroughUnderlay@FWaveVRAPIWrapper@@UEAA?AW4WVR_Result@@_N@Z)

from adding the following function to WaveVRAPIWrapper.h
Noting that WaveVRAPIWrapper is also using functions from the same Library (wvr_system.h)
/* Passthrough */
virtual WVR_Result ShowPassthroughUnderlay(bool show) { return WVR_ShowPassthroughUnderlay(show); }
  • Sad 1
Link to comment
Share on other sites

  • 1 month later...

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...