Live video directly to VR

[STom]

Hi, 

We would like to create an AR/XR experience where individuals can play a soccer game in their real environment. So basically we would place a 360 camera on the head of the player and track his/her feet and hands with VIVE Trackers and create a virtual ball and goal. 
To minimize latency, we would like to upload directly the video signal that comes from the 360 camera to the headset, so we opted out streaming services. 

Could anyone please advice us if there is already a solution for this, or even where to start? 

Thank you!

 

@Jad

[Jad]

On 3/16/2020 at 8:54 AM, STom said:

Hi, 

We would like to create an AR/XR experience where individuals can play a soccer game in their real environment. So basically we would place a 360 camera on the head of the player and track his/her feet and hands with VIVE Trackers and create a virtual ball and goal. 
To minimize latency, we would like to upload directly the video signal that comes from the 360 camera to the headset, so we opted out streaming services. 

Could anyone please advice us if there is already a solution for this, or even where to start? 

Thank you!

 

@Jad

Hi have you considered using the Vive Pro stereo pass-through cameras and the SRWorks SDK to mix the stereo camera view and the virtual world? https://developer.vive.com/resources/knowledgebase/intro-vive-srworks-sdk/