Jump to content
 
Davey

Strabismus calibration and individual eye tracking

Recommended Posts

Hi
 
Before I purchase the Vive Pro Eye(which is pretty expensive for me), I was hoping someone could answer a few questions.
 
I'm interested in developing an application that provides real-time feedback of individual eye gaze location for people who have strabismus(primarily esotropia). I currently use an Oculus Rift CV1 and Unity and my current projects use a two camera setup to be able to display different target objects exclusively to one eye or the other(with all other objects visible to both eyes).  I'd like to be able to see what the individual eyes are doing in the environment and provide visual real-time feedback to the user. This obviously would require the use of eye tracking such as the Vive Pro Eye.
 
For people who have esotropia their "good eye" focuses on the target and the other eye is looking x degrees to the left of the target(if the right eye is affected) or to the right of the target (if the left eye is affected)
image.png
 
 
How does the calibration work for someone whose eyes converge at a point that is not on the target?  I've only seen a screenshot of the calibration but it looks like you have to converge your eyes on a dot to make it light up. Someone with esotropia would only be able to do this by looking to the left or right of the target(and slightly beyond the target). This would produce invalid data. I need to be able to show the user what the left eye is looking at when the right eye is looking at the target. For my application someone with esotropia would see two gaze objects side by side representing where each eye is looking instead of one merged object representing the convergence point of both eyes(which is what someone with normal vision would see).
 
image.png.ee9fb988a99d868b3d1e6a950f7774f0.png
 
The left eye data can't simply be an offset of right eye data because I need to show independent eye movement. Someone with esotropia can move that yellow circle in the example above closer or further away from the blue circle with their eyes muscles much in the same way a normal sighted person can cross their eyes and create double vision.
 
Can the calibration be done with only one eye? If the answer is "no", can I modify the calibration data? If the answer is "no", can I skip the calibration? If the answer is "yes", is the data produced by each eye then assumed to be relative to the sensors with the assumption that the HMD and sensors are centered perfectly over the eyes?(obviously never the case).
 
Thanks for your help!
 
 
 
 
 
 
Edited by Davey
image didnt post

Share this post


Link to post
Share on other sites

I cant seem to edit my post and one image didn't come through.  Anyway its just a simple visualization of esotropia:

esotropia.jpg.36c913142425d1ad3a57714f7860e395.jpg

 

Share this post


Link to post
Share on other sites

Hi Davey, I see what you are trying to achieve. To answer your first question, in the API, there is a method "ViveSR::anipal::Eye::TrackingImprovements" to modify calibration data; however, I am not sure how helpful it would be. Using raw data gaze data for each eye, one can write a custom calibrator. There is no built-in method to calibrate individual gaze. 
Since the default calibration process involves a six-point 2D plane calibration. In my opinion, even if the gaze is misaligned, it would lead to somewhat proper calibration maybe for some population. The user would still see a double image as natural.

image.thumb.png.6e3b84999a351c41fe055c97793975d3.png

 

  

Share this post


Link to post
Share on other sites

@Davey @nbhatia

Calibration is 3 step process that requires both eyes.
Step 1 is HMD placement, 
Step 2 is IPD adjustment, 
Step 3 is the gaze dots.


Can the calibration be done with only one eye?
    No, the calibration will not complete without both eyes.

can I modify the calibration data?
    No, currently not possible but a number of devs have requested this feature so we can re-examine.

can I skip the calibration?
    For accurate eye-tracking the calibration is performed for each user when they use the HMD. Every face and HMD placement is different so calibration optimizes for this variance. If calibration is skipped the eye-tracking usually funcitons but is less accurate.

is the data produced by each eye then assumed to be relative to the sensors with the assumption that the HMD and sensors are centered perfectly over the eyes?(obviously never the case).
    The calibration and runtime report the eye position relative to the HMD (usually not perfectly centered but ideally close).

Feel free to check the documentation included with the SDK or the webinars/guides for information about the calibration specifics.

Share this post


Link to post
Share on other sites

@Davey I will try to look into the research to see if there have been tests of eye tracking with strabismus/esotropia conditions, it may also be helpful for you to contact Tobii about this inquiry. The SDK does report gaze direction for each eye independently.

Share this post


Link to post
Share on other sites

Please sign in to comment

You need to be a member in order to leave a comment

Sign in

Already have an account? Sign in here.

Sign In Now

×
×
  • Create New...