davide445

@VibrantNebula any sharable info about the new XR faceplate cameras specs?

@zzywas writing too soon. Discovered the realtime engine we are using does natively integrate with the previous release of the Leap Motion SDK, dating back to 2016. Integrate the latest SDK will need some effort we will not invest on for this project. So will need to understand if the 2016 SDK is reliable enough for our needs, but considering is lacking all the latest improvements, I'm really waiting to know when you will release your next SDK release to test it!

@acidarts confirm I got the models, my only problem was I can't find them, thus my suggestion of better indexing on Google and the links where I finally found them.

@VibrantNebula searching online seems Cosmos cameras might be these one, based on the firmware. If so having them 1600x1200 resolution seems what is visible activating passtrough it's really much worse than what expected. There is any subsampling activated so that what's visible it's less than the sensor output, the tiny 1/5" size is creating a lot of noise, or simply these are not the right cameras used in Cosmos?

@zzy discovered using recalibration does make Leap Motion much more reliable, so that we think using it, the only problem remaining the integration effort with our render engine.

@VibrantNebula what are current Cosmos front facing cameras specs? I can't find them anywhere.

@VibrantNebula https://uploadvr.com/vive-cosmos-ar-faceplate/ Not sure if was based on your press release but state a release to studios in Q2. It's something we can count on, or "studios" was meaning your partner developers? There is a public list of these partners? https://vivex.vive.com/eu/ Maybe these one?

@VibrantNebula you mean MWC 2021? A bit far a way a fear for our project.

For an upcoming applied R&D project we was evaluating XR options, didn't find any info about the upcoming Cosmos, there is anything about specs and availability that can be disclosed? Will be another faceplate that can be added to existing Cosmos?

@zzy another option: if the user is using a treadmill so just head position need to be tracked, and we want to use Valve Index controllers that does integrate finger tracking, does we need lighthouse sensors?

@zzy in the meantime I need to find a working solution. Apart Leap Motion own Orion software, was looking various suppliers of 3d depth cameras are suggesting Gestoos as gesture recognition software. Didn't find it mentioned in this forum, you ever have had experience with it

Just to give an idea. In this way you can also I suppose increase your training set size by also generating it trough 3d simulation, since your focus will be not in fact a real hand but a glove, easier to render. I know I'm now speaking more about R&D, but if correctly working reliably a native hand tracking using just Cosmos cameras would be the perfect solution.

Thanks @zzy but my idea was not simply gloves but gloves with attached specific QR markers for each finger. Since you are using a DNN I suppose you will need to train it with also this markers, but this might improve the recognition. Also from the user point of view I didn't see a problem in wearing passive simple gloves provided with markers stamped. I'm searching and effective solution to a problem I didn't see one so far.

I finally mounted the Leap Motion using a biadhesive so to have (for test purpose) the most flexible installation That said the experience it's better than with HTC SDK but not reliable as was supposed to be in my expectations. Waiting for any improvement suggestions from Ultraleap, wanted to ask @zzy if wearing a glove with stamped different markers on any finger will help improving the tracking using the native SDK. I'm starting to wonder if in general the whole hand tracking its still an r&d topic and not ready for prime time.

Interesting @RealGM thanks! So far my interest for wireless it's lowered as priority but for sure will return as interesting feature. Looking at my mobo specs seems all the slots except the first x16 are connected to the chipset, so really interesting to know.

@zzy @VibrantNebula Received the Leap Motion, was looking at the best way to mount it. Since the 3M stich it's one use didn't want to trial and error. In this way I'm using his mounting kit, will create troubles with the headset tracking? Controllers tracking it's not more a problem in this case

Reasoning what can be the architecture to achieve this scenario, for a VR training solution where all users are in the same room, but in two different scenarios A) one user act as master (either in VR or trough a control panel), controlling what it's shown in VR to all the other users. B) all users active in the VR simulation Max users about 20. I'm going trough all possible setups but there is always something I miss A SCENARIO there is any HTC technology enabling us to achieve the A) scenario? The users can be sit in the same room. Also how is supposed to physically connect let's say 10/20 headset to the same Image Generator workstation? DisplayPort replicators? I suppose I can also stream to YT and from there stream to the headsets using a media player, but prefer to avoid Internet connections. Using a local media player? Might we use Vive Cosmos in this settings? B SCENARIO about B I have read the Wireless kit will enable a multi user settings, but I fear having 20 headset to recharge and people hitting each other in a safety training scenario with a simulated emergency, also the real distances will be never respected. I can have the users sit and use something such as Cybershoes or 3dRudder for movements with wired headsets. Treadmills will be another option but total cost will be too high CAVE will be another option, but again the price will be too step as a starting point About software, I know using Photon Engine we can add multiplayer to the used realtime 3d engine, but here is any other HTC tech we can use? Same as before not clear to me the hw setup needed to connect all the headset to the Image Generator I suppose in this case external tracking, I can't think an alghoritm smart enough to maintain tracking trough cameras with the surrounding environment changing due to other users movement (even if i.e. on a chair)

Just to share my experience, received today a mail from Ultraleap, they are still selling the product, just using third parties such as https://www.arrow.com/en/products/90-0002/ultraleap We will purchase one for testing. Waiting to know enterprise licensing terms.

I think will be possible. Next step I suppose receive a Leap Motion for a test. Problem will be to fix it, also not sure if is any better place under or over the two cameras, depending on what's behind.

PS also can anyone check if a 13x80mm (0.5x3.2 inch) object (the Leap Motion sensor) can fit horizontally into the Cosmos without occluding the cameras? Movements limited to the office here, so can't check by myself.

@VibrantNebula looking at other options the only I can find are Occipital Structure, Intel RealSense and Orbbec Astra Mini, all with Gestoos sw for gesture recognition. Any experiences with one of them?

@VibrantNebula not interested in wireless, since I'm planning (if fits with the budget) to use a treadmill in the final setup. In this way no controllers (using Leap Motion) and no messing with teleportation, having the headset wired will be not a problem. If all of this will fail I'll need to return back to the knuckles and wireless path. The only point is if someone can check if Leap Motion is working with Vive Cosmos 😁

@ATAT thanks for answering. Since my interest it's only on the Leap Motion, will be possible for you to have a check if without the wireless adapter will be working correctly? @NRip i think this might be what I was searching in that thread.

@zzy @VibrantNebula https://www.vive.com/uk/support/cosmos/category_howto/connecting-a-usb-device.html Before looking at knuckles solution (with all the related costs for faceplate, base station and controllers that probably push the total price over the Index full package, and also will anyway let our inexperienced users with something to loose / break / hit) was looking if it's possible to attach a Leap Motion to Cosmos. From the above article seems an USB-C is available, so probably an USB-a to USB-C adapter will be needed. But will be good for power and use it? Did you have a Leap Motion hanging around to have a check? Just to not wait two weeks to receive the Leap Motion and discover I can't use it.

@VibrantNebula I think you might know more on this topic, was reading your posts on another thread. Will be the external tracking faceplate available for purchase? I will be honestly really discouraged if not.