EP4236755A1 - Systèmes et procédés de test de champ visuel dans des visiocasques - Google Patents

Systèmes et procédés de test de champ visuel dans des visiocasques

Info

Publication number
EP4236755A1
EP4236755A1 EP21887174.7A EP21887174A EP4236755A1 EP 4236755 A1 EP4236755 A1 EP 4236755A1 EP 21887174 A EP21887174 A EP 21887174A EP 4236755 A1 EP4236755 A1 EP 4236755A1
Authority
EP
European Patent Office
Prior art keywords
head
user
location
visual field
mounted display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP21887174.7A
Other languages
German (de)
English (en)
Inventor
Mohamed Abou Shousha
Rashed Kashem
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Miami
Original Assignee
University of Miami
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/082,983 external-priority patent/US10993612B1/en
Priority claimed from US17/392,664 external-priority patent/US20220125297A1/en
Priority claimed from US17/392,723 external-priority patent/US20220125298A1/en
Application filed by University of Miami filed Critical University of Miami
Publication of EP4236755A1 publication Critical patent/EP4236755A1/fr
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1113—Local tracking of patients, e.g. in a hospital or private home
    • A61B5/1114—Tracking parts of the body
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/02—Subjective types, i.e. testing apparatus requiring the active assistance of the patient
    • A61B3/028—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for testing visual acuity; for determination of refraction, e.g. phoropters
    • A61B3/032—Devices for presenting test symbols or characters, e.g. test chart projectors
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1121—Determining geometric values, e.g. centre of rotation or angular range of movement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802—Sensor mounted on worn items
    • A61B5/6803—Head-worn items, e.g. helmets, masks, headphones or goggles
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7271—Specific aspects of physiological measurement analysis
    • A61B5/7282—Event detection, e.g. detecting unique waveforms indicative of a medical condition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient ; user input means
    • A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2505/00—Evaluating, monitoring or diagnosing in the context of a particular type of medical care
    • A61B2505/09—Rehabilitation or training
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2560/00—Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
    • A61B2560/02—Operational features
    • A61B2560/0223—Operational features of calibration, e.g. protocols for calibrating sensors
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0219—Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0233—Special features of optical sensors or probes classified in A61B5/00
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0261—Improving the quality of display appearance in the context of movement of objects on the screen or movement of the observer relative to the screen
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0693—Calibration of display systems
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2380/00—Specific applications
    • G09G2380/08—Biomedical applications

Definitions

  • Diagnosis of visual defects can be determined with conventional testing machines, such as a Humphry visual field analyzer.
  • a patient is placed at the center of a curved portion of the analyzer and tests are performed by displaying images on the curved portion to determine where the blind spots are located in the patient’s visual field.
  • Humphry visual field analyzers as well as other testing machinery is both expensive for wide distribution and requires specialized personnel for operating the machinery.
  • head-mounted display devices and/or head-mounted display devices for visual field testing.
  • these devices for visual field testing lowers the costs related to performing visual field testing and improves accessibility to visual field testing to a wider patient base.
  • the adaption of visual field testing to these displays is not without its technical hurdles.
  • Cyclotorsion is the rotation of one eye around its visual axis. This rotation of the eye is what allows the visual field of a user to remain “right-side-up” even when the user tilts his or her head to one side or the other.
  • heads-up displays are fixed to the head of a user, cyclotorsion does not occur in the head-mounted display environment. That is, if a user tilts his or her head to one side or the other, the visual field of the user tilts accordingly.
  • the effects of cyclotorsion present a threshold technical problem to overcome when adapting introducing visual field testing into head-mounted display devices.
  • one solution to overcoming the technical problem caused by the differing effects of cyclotorsion in the head-mounted display environment is to prevent a user from tilting his or her head.
  • conventional optometry tools for preventing a user from tilting his or her head such as chin rests, or other structures built into optometry equipment are ill-suited for a head-mounted display environment.
  • a requirement for a specialized structure or modifications to head-mounted display devices negatively impacts the accessibility of the devices as well as their ease of use.
  • specialized structures such as chin rests do not prevent any tilting effects caused by the head-mounted display devices being improperly worn and/or worn in a manner that introduces a slight tilt.
  • the systems and methods disclosed herein may use specialized software and/or hardware elements implemented in the head-mounted display devices to detect a tilting head of a user.
  • the head-mounted display device may include specialized sensors and/or software used to interpret sensor data for the head-mounted display device.
  • the systems and methods may further generate alerts to a user based on detected head tilting and/or recommendations for corrections of any head tilting. These alerts and recommendation may further be presented on the head-mounted display to minimize the impact of head tilts during visual field testing.
  • a method can include retrieving a visual field testing pattern for a head-mounted display, wherein the visual field testing pattern comprises icons that are displayed at respective locations in a visual field of the head-mounted display.
  • the method can also include generating for display the visual field testing pattern on the head-mounted display; retrieving data from a tilt sensor, located at the head-mounted display, for detecting degrees of head tilt of a user wearing the head-mounted display; determining, based on the data retrieved from the tilt sensor, a degree of head tilt of the user; comparing, the degree of head tilt of the user to a first threshold degree; and in response to the degree of head tilt of the user meeting or exceeding the first threshold degree, generating for display, on the head-mounted display, a recommendation to the user.
  • calibrating a head-mounted display needs to compensate for unknown sources of error that may affect assessment of the calibration.
  • eye tracking data received from a device that needs sensor calibration may indicate that the user’s eyes are focused at a wrong location, and that data may then be interpreted as a visual defect rather than a calibration issue.
  • the visual test may progressing, the user may shift causing the sensors connected to the head-mounted display to lose alignment, thus, those sensors may need calibration to accurately perform eye tracking and detection of the user’s gaze.
  • the results of the visual test may be inaccurate because eye tracking may become inaccurate. This may result in the system incorrectly determining that the user has one or more visual defects.
  • some systems and methods disclosed herein facilitate calibration of a head-mounted display while a visual test is performed.
  • One mechanism that facilities calibration involves detecting, as a visual test is being performed, that the user’s eyes moved in the direction of a displayed stimulus but have not stopped at the point of where the stimulus is displayed, and instead stopped at a different point (e.g., a threshold distance away from the stimulus). Based on that detection, the system may determine that the user has seen the stimulus and that calibration of the sensors is needed. The system may then record that the user has seen the stimulus and perform sensor calibration before displaying the next stimulus.
  • the system may cause, during a visual field test, a first stimulus to be presented on a user device at a first visual field location.
  • the visual test may be a test to determine whether the user has any visual defects.
  • the user device may include a head-mounted display that displays the first stimulus (e.g., a visual indicator at some location on the display).
  • the system may start displaying stimuli to the user to assess whether the user has any visual defects.
  • the system may obtain, during the visual field test, first feedback data related to the first stimulus, the first feedback data indicating that the user has seen the first stimulus.
  • the user device e.g., a device including a head-mounted display
  • the user device may include one or more eye tracking sensors that are enabled to transmit eye tracking data to the user device for processing.
  • the eye tracking sensors may perform gaze detection and send that information to be processed by the user device.
  • the feedback data may include, for example, coordinates on the head-mounted display at which the user’s gaze was detected.
  • the system may then detect, based on the first feedback data, an eye of the user failing to fixate on the first visual field location corresponding to the first stimulus.
  • the first feedback data may indicate that the user’s eyes have moved towards the first stimulus but stopped short of gazing at the first stimulus or moved past the stimulus. This data may indicate that the user saw the stimulus (e.g., based on the user moving his eyes towards the stimulus) and that the eye tracking sensors need calibration (e.g., based on the gaze not being aligned with the visual field location of the stimulus itself).
  • the system may perform a calibration of the user device. For example, the system may adjust gaze location calculation as determined from the raw eye tracking data.
  • the system may store a first indication that the user has seen the first stimulus. This process may continue with every stimulus displayed on the head-mounted display. [0015] As another/second stimulus is displayed at a second field test location, the system may determine that the user’s gaze location aligns with the second field test location, thus no calibration is required at that iteration of the test. When the visual test is finished, the system may generate a visual defect assessment based on the results of the test (e.g., based on the number and locations of stimuli that the user was able to see).
  • calibrating a head-mounted display needs to compensate for unknown sources of error that may affect assessment of the calibration. For example, eye tracking data received during calibration would be affected if a head-mounted display was not being worn properly. This error (e.g., when the headmounted display is used for an eye examination) could then be interpreted as a visual defect rather than knowing it was caused by improper wearing during calibration.
  • the instant application discloses systems and methods that facilitate calibration of a head-mounted display.
  • the system may generate calibration patterns for the user to view while the system tracks the eye movement of the user to determine what they are seeing.
  • the analysis of the eye tracking data can generate a calibration for the head-mounted display as well as a “calibration score” representing the accuracy of the calibration.
  • a calibration score representing the accuracy of the calibration.
  • One method for calibrating a head-mounted display includes receiving edge eye tracking data during edge calibration periods; calculating a projective transform matrix based on the edge eye tracking data; receiving center eye tracking data during a center calibration period; applying the projective transform matrix to the center eye tracking data to determine a gaze location; and generating a calibration score based on a difference between a center location and the gaze location.
  • Figure 1A illustrates an example head-mounted display forming a wearable device for a subject in accordance with certain aspects of the present disclosure
  • Figure IB illustrates a front view of the head-mounted display in accordance with certain aspects of the present disclosure
  • Figure 1C an image of an example constructed head-mounted display in accordance with certain aspects of the present disclosure
  • Figures ID- IE illustrate another example embodiment of a head-mounted display, in accordance with certain aspects of the present disclosure
  • Figure 2 is a diagram illustrating correction of a visual field testing pattern by detecting and correcting for head tilt in accordance with certain aspects of the present disclosure
  • Figure 3 is a diagram illustrating an exemplary method of accurately replicating a visual field testing pattern from a curved surface on a flat surface in accordance with certain aspects of the present disclosure
  • Figure 4 is an illustrative system diagram for visual field testing using a head-mounted display in accordance with certain aspects of the present disclosure
  • Figure 5 is a process flow diagram for correction of a visual field testing pattern by detecting and correcting for head tilt in accordance with certain aspects of the present disclosure
  • Figure 6 is a process flow diagram for accurately replicating a visual field testing pattern from a curved surface on a flat surface in accordance with certain aspects of the present disclosure
  • Figure 7 illustrates a system for calibrating one or more sensors or other device components, in accordance with certain aspects of the present disclosure
  • Figure 8 illustrates a data structure for determining whether calibration is needed, in accordance with certain aspects of the present disclosure, and
  • Figure 9 is a process flow diagram for calibrating a head-mounted display or other user device, in accordance with certain aspects of the present disclosure.
  • Figure 10 is a diagram illustrating an exemplary relationship between a virtual plane and a display plane as used to calibrate a head-mounted display, in accordance with certain aspects of the present disclosure
  • Figure 11 is a diagram illustrating an exemplary central point and boundary as used to generate a calibration score, in accordance with certain aspects of the present disclosure
  • Figure 12 is a process flow diagram for calibrating a head-mounted display, in accordance with certain aspects of the present disclosure.
  • Figure 13 is illustrative pseudocode for calibrating a head-mounted display in accordance with certain aspects of the present disclosure.
  • the instant application describes systems and methods that facilitate performing visual field testing, particularly utilizing worn goggles that provide testing patterns.
  • One problem confronting optical care practitioners is the effect of a patient tilting their head during eye examinations. If the head is tilted, this causes cyclotorsion, which is the rotation of one eye around its visual axis. Uncorrected, this can introduce error in an eye examination and misdiagnosis of optical issues.
  • a conventional diagnostic device used for testing is a Humphry visual field analyzer “Humphry analyzer.”
  • Use of the Humphry analyzer includes a patient placing their head at the center of a semispherical region with testing patterns projected at varying locations of the semispherical region.
  • a heads up display device or a head-mounted display device.
  • a head-mounted display is a display device, worn on the head or as part of a helmet, that may have a small display optic in front of one (monocular HMD) or each eye (binocular HMD).
  • One technical problem is the occurrence of cyclotorsion in patients being tested using such goggles because while the goggles naturally provide compensation for head tilt, this only works if the goggles are worn properly (i.e., not tilted on the user’s head).
  • the instant application describes systems and methods for detection and correction of goggle tilt relative to the user’s head.
  • Another technical problem is the display of accurate testing patterns using the goggles, which have a flat viewing surface as compared to a Humphry analyzer, which has a curved viewing surface.
  • methods are disclosed for generation of testing patterns in goggles that are equivalent to those generated in a Humphry analyzer.
  • FIG. 1A illustrates an example head-mounted display 100 (e.g., goggles) forming a wearable device for a subject.
  • the head-mounted display 100 may be a part of a visioning system as described herein or in U.S. Patent Application No. 17/083,043, entitled “Vision Testing via Prediction-Based Setting of an Initial Stimuli Characteristic for a User Interface Location” and filed October 28, 2020, the contents of which are hereby incorporated by reference in its entirety.
  • the head-mounted display 100 includes a left eyepiece 102 and a right eyepiece 104. Each eyepiece 102 and 104 may contain and/or associate with a digital monitor configured to display (or project) recreated images to a respective eye of the subject.
  • digital monitors may include a display screen, projectors, and/or hardware to generate the image display on the display screen. It will be appreciated that digital monitors comprising projectors may be positioned at other locations to project images onto an eye of the subject or onto an eyepiece comprising a screen, glass, or other surface onto which images may be projected.
  • the left eye piece 102 and right eyepiece 104 may be positioned with respect to the housing 106 to fit an orbital area on the subject such that each eyepiece 102, 104 is able to collect data and display/project image data, which in a further example includes displaying/projecting image data to a different eye.
  • each eyepiece 102,104 may further includes one or more inward directed sensors 108, 110 may include infrared cameras, photodetectors, or other infrared sensors, configured to track pupil movement and to determine and track visual axes of the subject.
  • the inward directed sensors 108, 110 e.g., comprising infrared cameras, may be located in lower portions relative to the eye pieces 102, 104, so as to not block the visual field of the subject, neither their real visual field nor a visual field displayed or projected to the subject.
  • the inward directed sensors 108, 110 may be directionally aligned to point toward a presumed pupil region for better pupil and/or line of sight tracking.
  • head-mounted display 100 can include tilt sensor(s) 128 that can provide data on the degree of head tilt to a connected computing system.
  • the tilt sensors can be gyroscopes, water-based, etc.
  • FIG. IB illustrates a front view of the head-mounted display 100, showing the front view of the eye pieces 102, 104, where respective outward directed image sensors 112, 114 comprising field of vision cameras are positioned. In other embodiments, fewer or additional outward directed image sensors 112, 114 may be provided. The outward directed image sensors 112. 114 may be configured to capture continuous images.
  • FIG. 1C is an image of an example constructed head-mounted display 100 comprising eyepieces 102, 104 including two digital monitors, with focusing lens 116, 118.
  • only one inward directed optical sensor 110 is included for pupil and line of sight tracking, however, in other examples, multiple inward directed optical sensors 110 may be provided.
  • an alternative embodiment of head-mounted 170 can include, in any combination, a high-resolution camera (or cameras) 102, a power unit 193, a processing unit 194, a glass screen 195, a see-through display 196 (e.g., a transparent display), an eye tracking system 197, tilt sensor(s) 198 (similar to tilt sensors 122), and other components.
  • external sensors may be used to provide further data for assessing visual field of the subject.
  • data used to correct the captured image may be obtained from external testing devices, such as visual field testing devices, aberrometers, electro-oculograms, or visual evoked potential devices. Data obtained from those devices may be combined with pupil or line of sight tracking for visual axis determinations to create one or more modification profiles used to modify the images being projected or displayed to a user (e.g., correction profiles, enhancement profiles, etc., used to correct or enhance such images).
  • head-mounted display when referring to the “head-mounted display,” even where reference is made to the first embodiment (100), it is understood that the disclosed methods and operations apply to either head-mounted display 100 or 170, unless specifically stated otherwise. It should be noted that, although some embodiments are described herein with respect to calibration of headmounted displays, such techniques may be applied for calibration of one or more other user devices in other embodiments.
  • the head-mounted display 100 may be communicatively coupled with one or more imaging processor through wired or wireless communications, such as through a wireless transceiver embedded within the head-mounted display 100.
  • An external imaging processor may include a computer such as a laptop computer, tablet, mobile phone, network server, or other computer processing devices, centralized or distributed, and may be characterized by one or more processors and one or more memories.
  • the captured images are processed in this external image processing device; however, in other examples, the captured images may be processed by an imaging processor embedded within the digital spectacles.
  • the processed images (e.g., enhanced to improve functional visual field or other vision aspects and/or enhanced to correct for the visual field pathologies of the subject) are then transmitted to the head-mounted display 100 and displayed by the monitors for viewing by the subject.
  • the head-mounted display can be used to perform a visual assessments to identify ocular pathologies, such as, high and/or low order aberrations, pathologies of the optic nerve such as glaucoma, optic neuritis, and optic neuropathies, pathologies of the retina such as macular degeneration, retinitis pigmentosa, pathologies of the visual pathway as microvascular strokes and tumors and other conditions such as presbyopia, strabismus, high and low optical aberrations, monocular vision, anisometropia and aniseikonia, light sensitivity, anisocorian refractive errors, and astigmatism.
  • ocular pathologies such as, high and/or low order aberrations, pathologies of the optic nerve such as glaucoma, optic neuritis, and optic neuropathies, pathologies of the retina such as macular degeneration, retinitis pigmentosa, pathologies of the visual pathway as microvascular strokes and tumors and other conditions such as presbyopia
  • external sensors may be used to provide further data for assessing visual field of the subject.
  • data used to correct the captured image may be obtained from external testing devices such as visual field testing devices, aberromaters, electro-oculograms, or visual evoked potential devices. Data obtained from those devices may be combined with pupil or line of sight tracking for visual axis determinations to create the corrective profile of used to correct the images being projected of displayed to the viewer.
  • the head-mounted display 100 may be communicatively coupled with one or more imaging processor through wired or wireless communications, such as through a wireless transceiver embedded within the head-mounted display 100.
  • An external imaging processor may include a computer such as a laptop computer, tablet, mobile phone, network server, or other computer processing devices, centralized or distributed, and may be characterized by one or more processors and one or more memories.
  • real-time image processing of captured images may be executed by an imaging processor, e.g., using a custom-built MATLAB (MathWorks, Natick, MA) code, that runs on a miniature computer embedded in the head-mounted display.
  • the code may be run on an external image processing device or other computer wirelessly networked to communicate with the headmounted display.
  • FIG. 2 is a diagram illustrating correction of a visual field testing pattern by detecting and correcting for head tilt.
  • head tilt refers to the angle between an axis of the head-mounted display and an axis of the user’s head. For example, such an angle may be zero degrees when the head-mounted display 100 is worn correctly on the user.
  • a system for improving accuracy of visual field testing in head-mounted displays can include, in addition to the head-mounted display, a tilt sensor for detecting degrees of head tilt of a user wearing the head-mounted display.
  • the tilt sensor can be located at the headmounted display 100, though tilt sensors at other locations (e.g., external ones such as cameras that view the user and the head-mounted display 100) are contemplated.
  • the tilt sensor can be a water-based tilt sensor, similar to a level.
  • the tilt sensor can incorporate a gyro sensor or other types of rotation sensing hardware.
  • storage circuitry can be configured to store and/or retrieve a visual field testing pattern having stimuli (e.g., lights, patterns, icons, animations, etc.) that can be displayed at respective locations in the visual field of the headmounted display.
  • stimuli e.g., lights, patterns, icons, animations, etc.
  • control circuitry configured to generate for display the visual field testing pattern on the head-mounted display. Examples of a visual field testing pattern are shown in FIG. 2, with a fixation point 210 (typically near the center of the field of view) and a stimulus 220 that represents a displayed stimulus for determining the location of a blind spot.
  • FIG. 2 The top panel in FIG.
  • FIG. 2 shows an example location of a blind spot (coincident with stimulus 220), e.g., as determined by the user being unable to see a stimulus displayed at that location.
  • the middle panel illustrates the effect of head tilt.
  • the head tilt causes the stimulus 220 to be displayed at a different location in the user’s vision, outside of the blind spot 230.
  • the blind spot may not be identified by the user, possibly causing a misdiagnosis.
  • the system can determine, based on data retrieved from the tilt sensor, a degree of head tilt of the user.
  • the degree of head tilt can be determined, for example in the case of a water-based tilt sensor, the determination of water surface that indicates the degree of tilt.
  • One embodiment can include imaging a water surface with miniaturized cameras to capture the water surface relative to indicia that shows an un-tilted orientation. The angle between the water surface and the indicia would then be the degree of head tilt.
  • Another embodiment can include obtaining data from a plurality of water sensors (e.g., galvanic sensors) that are covered or exposed by water depending on the degree of tilt.
  • the particular sensors detecting water can then be used, such as via a lookup table, to determine the degree of head tilt.
  • the degree of head tilt can be determined from received data from a gyroscope.
  • the degree of head tilt of the user can be compared to a first threshold degree, such as 1, 2, 5, 10, degrees, or any threshold as desired.
  • the comparison itself can include one or more processors receiving the calculated degree of head tilt and performing a numerical comparison to the first threshold degree.
  • the system can generate for display, on the head-mounted display, a recommendation to the user for reducing the head tilt.
  • Such a recommendation can include a visual indication (e.g., red or green lights, a textual indication, etc.) that the head-mounted display 100 needs to be adjusted to remove the head tilt.
  • the recommendation can include a display of the degree of head tilt in, for example, a graphical format (e.g., depicting an angle) or textual format (e.g., the numerical value of the angle).
  • the system can automatically perform some corrections, e.g., if the tilt is relatively small.
  • the control circuitry can be further configured to compare the degree of head tilt of the user to a second threshold degree (e.g., 0.1, 0.5, 1, 2 degrees, etc.) that is generally smaller than the first threshold degree.
  • a second threshold degree e.g., 0.1, 0.5, 1, 2 degrees, etc.
  • Such a second threshold degree can be reflective of asymmetry in a user’s face that prevents perfect alignment, defects in the head-mounted display 100 construction, small incidental tilts occurring during measurements, etc.
  • the comparison of the degree of head tilt to the second threshold degree can be performed in a manner similar to that described for the first threshold degree.
  • the system can automatically adjust a respective location of the stimulus in the visual field of the head-mounted display by a first amount. For example, if a 0.1 degree tilt is detected, the system can automatically adjust the display location of the icon to compensate by changing the coordinates for display of the stimulus to reflect the detected tilt. In this way, the first amount can be based on a distance of the stimulus from a centerpoint 240 of the visual field of the head-mounted display and a direction of the head tilt of the user.
  • centerpoint 240 may correspond to a geometric center of the face of the headmounted display 100 and/or a center of fixation of the user.
  • different head-mounted displays may have different centerpoints. Accordingly, the system may determine the centerpoint of a head-mounted display and select respective locations of displayed icons based on the offset distance. For example, the system may determine a centerpoint of the head-mounted display based on receiving data from one or more sensors. Additionally or alternatively, the system may receive settings based on an initial calibration (e.g., an automatic calibration or a manual calibration) when the system is activated. Additionally or alternatively, the system may input a model or serial number (or other identifier) for the head-mounted display into a look-up table listing centerpoints for the model or serial number.
  • an initial calibration e.g., an automatic calibration or a manual calibration
  • centerpoint 240 can correspond to the center of the fixation point 210 and the direction 250 of the head tilt can be some angle (e.g., 10 degrees clockwise, 15 degrees, counterclockwise, etc.).
  • the terms are directional components (e.g., x/y, horizontal/vertical) of the vector r as a function of the head tilt angle 0.
  • the respective location of the icon can be defined by a first directional component (e.g., a horizontal component) and a second directional component (e.g., a vertical component).
  • correction can include where the first directional component is adjusted by a cosine of the degree of head tilt of the user and the second directional component is adjusted by a sine of the degree of head tilt.
  • the system can determine the difference between the location of the icon before and after head tilt. This difference (for each directional component) can then be the amount (e.g., in pixels, cm, etc.) by which the respective location of the icon can be adjusted.
  • FIG. 3 illustrates a simplified diagram depicting an exemplary method of accurately replicating a visual field testing pattern from a curved surface on a flat surface. Determining an angle of a visual defect can be important in diagnosing and treating it.
  • the Humphry analyzer with its semispherical testing region 310, as depicted in FIG. 3 (top) can provide a visual field testing pattern in the form of visual elements 320 at angles of constant separation (e.g., 10, 20, 30, 40, etc. degrees).
  • the head-mounted display 100 can have a flat surface 330 (shown simplified and greatly enlarged, for illustrative purposes). If stimuli 340 are displayed at equidistant locations as shown, they will not conform to the constant angular separation as described above with the Humphry analyzer, and thus not characterize the user’s vision accurately. Accordingly, the system may compensate for this difference.
  • the offset distance (dimension b in the bottom of FIG. 3) between the flat surface where stimuli are displayed and the eye of the user can vary, based on the particular construction of the head-mounted display 100, a user’s facial structure, etc. This offset distance can in turn affect where the stimuli 340 need to be displayed.
  • the disclosed methods allow respective locations of the stimuli 340 to be located in a row on the visual field and correspond to respective projections of points corresponding to different viewing angles along a curved surface onto a flat surface. This is depicted in FIG. 3 as can be seen by the stimuli 340, at their respective locations, being intersected by radial lines from visual elements 320.
  • the respective locations can be determined based on an offset distance of the head-mounted display and an angle to respective points on the visual testing machine.
  • the angle can be that referred to above, (e.g., 10, 20, 30 degrees, etc.).
  • the respective location corresponding to it is shown by dimension a, which is the distance from the center (e.g., 0 degrees) to the respective location on flat surface 330.
  • a is one of the respective locations
  • b is the offset distance
  • 0 is the angle.
  • the curvature of the head-mounted display can be determined, and the respective locations selected, based on the curvature.
  • the determination of the curvature can be known or accessed based on data from a known model of head-mounted display.
  • Such curvature values can be stored for retrieval or accessed via a network connection.
  • the exact relation of how the presence of curvature affects the shifting of the respective location is a function of the geometry of the system.
  • the disclosed methods contemplate a coordinate transformation from the intended angle 0 to, for example, an analogous angle c
  • FIG. 4 is an illustrative system diagram for visual field testing using a head-mounted display, in accordance with one or more embodiments.
  • system 400 may represent the components used to power the head-mounted displays of FIGS. 1 A-1C and perform the processes described in FIGS. 5-6.
  • system 400 may include heads up display device 422 and user terminal 424.
  • heads up display device 422 may be worn by a user, while progress of the user may be monitored via user terminal 424.
  • heads up display device 422 and user terminal 424 may be any computing device, including, but not limited to, a laptop computer, a tablet computer, a hand-held computer, other computer equipment (e.g., a server), including “smart,” wireless, wearable, and/or mobile devices.
  • FIG. 4 may also include additional components such as cloud components 410.
  • Cloud components 410 may alternatively be any computing device as described above and may include any type of mobile terminal, fixed terminal, or other device.
  • cloud components 410 may be implemented as a cloud computing system and may feature one or more component devices.
  • system 400 is not limited to three devices. Users, may, for instance, utilize one or more devices to interact with one another, one or more servers, or other components of system 400.
  • each of these devices may receive content and data via input/output (hereinafter “I/O”) paths.
  • I/O input/output
  • Each of these devices may also include processors and/or control circuitry to send and receive commands, requests, and other suitable data using the VO paths.
  • the control circuitry may comprise any suitable processing, storage, and/or input/output circuitry.
  • Each of these devices may also include a user input interface and/or user output interface (e.g., a display) for use in receiving and displaying data.
  • both head-mounted display device 422 and user terminal 424 include a display upon which to display data (e.g., a visual field test pattern).
  • the devices may have neither user input interface nor displays and may instead receive and display content using another device (e.g., a dedicated display device such as a computer screen and/or a dedicated input device such as a remote control, mouse, voice input, etc.).
  • a dedicated display device such as a computer screen and/or a dedicated input device such as a remote control, mouse, voice input, etc.
  • the devices in system 400 may run an application (or another suitable program). The application may cause the processors and/or control circuitry to perform operations related to visual field testing.
  • Each of these devices may also include electronic storages.
  • the electronic storages may include non-transitory storage media that electronically stores information.
  • the electronic storage media of the electronic storages may include one or both of (i) system storage that is provided integrally (e.g., substantially non-removable) with servers or client devices, or (ii) removable storage that is removably connectable to the servers or client devices via, for example, a port (e.g., a USB port, a firewire port, etc.) or a drive (e.g., a disk drive, etc.).
  • a port e.g., a USB port, a firewire port, etc.
  • a drive e.g., a disk drive, etc.
  • the electronic storages may include one or more of optically readable storage media (e.g., optical disks, etc.), magnetically readable storage media (e.g., magnetic tape, magnetic hard drive, floppy drive, etc.), electrical charge-based storage media (e.g., EEPROM, RAM, etc.), solid-state storage media (e.g., flash drive, etc.), and/or other electronically readable storage media.
  • the electronic storages may include one or more virtual storage resources (e.g., cloud storage, a virtual private network, and/or other virtual storage resources).
  • the electronic storages may store software algorithms, information determined by the processors, information obtained from servers, information obtained from client devices, or other information that enables the functionality as described herein.
  • FIG. 4 also includes communication paths 428, 430, and 432.
  • Communication paths 428, 430, and 432 may include the Internet, a mobile phone network, a mobile voice or data network (e.g., a 5G or LTE network), a cable network, a public switched telephone network, or other types of communications networks or combinations of communications networks.
  • Communication paths 428, 430, and 432 may separately or together include one or more communications paths, such as a satellite path, a fiber-optic path, a cable path, a path that supports Internet communications (e.g., IPTV), free-space connections (e.g., for broadcast or other wireless signals), or any other suitable wired or wireless communications path or combination of such paths.
  • the computing devices may include additional communication paths linking a plurality of hardware, software, and/or firmware components operating together. For example, the computing devices may be implemented by a cloud of computing platforms operating together as the computing devices.
  • Cloud components 410 may be a database configured to store user data for a user.
  • the database may include user data that the system has collected about the user through prior transactions. Alternatively, or additionally, the system may act as a clearing house for multiple sources of information about the user.
  • Cloud components 410 may also include control circuitry configured to perform the various operations needed to generate recommendations.
  • the cloud components 410 may include cloud-based storage circuitry configured to store a first machine learning model that is trained to detect head tilt, adjust visual testing patterns, and/or generate recommendations.
  • Cloud components 410 may also include cloud-based control circuitry configured to determine an intent of the user based on a machine learning model.
  • Cloud components 410 may also include cloud-based input/output circuitry configured to generate the dynamic conversational response during a conversational interaction.
  • Cloud components 410 includes machine learning model 402.
  • Machine learning model 402 may take inputs 404 and provide outputs 406.
  • the inputs may include multiple datasets such as a training dataset and a test dataset.
  • Each of the plurality of datasets (e.g., inputs 404) may include data subsets related to user data and visual testing patterns.
  • outputs 406 may be fed back to machine learning model 402 as input to train machine learning model 402 (e.g., alone or in conjunction with user indications of the accuracy of outputs 406, labels associated with the inputs, or with other reference feedback information).
  • the system may receive a first labeled feature input, wherein the first labeled feature input is labeled with a testing pattern adjustment for the first labeled feature input.
  • the system may then train the first machine learning model to classify the first labeled feature input with the known testing pattern adjustment.
  • FIG. 5 is a process flow diagram for correction of a visual field testing pattern by detecting and correcting for head tilt.
  • process 500 may represent the steps taken by one or more devices, as shown in FIGS. 1A-1C, when providing visual field testing using a head-mounted display.
  • process 500 retrieves a visual field testing pattern for a head-mounted display.
  • the system may retrieve a visual field testing pattern for a head-mounted display, wherein the visual field testing pattern comprises stimuli that are displayed at respective locations in a visual field of the headmounted display.
  • the respective location of the icon can be defined by a first directional component and a second directional component. The first directional component can be adjusted by a cosine of the degree of head tilt of the user and the second directional component can be adjusted by a sine of the degree of head tilt of the user.
  • the respective locations of the stimuli can be located in a row on the visual field and the respective locations can correspond to respective projections of points corresponding to different viewing angles along a curved surface onto a flat surface.
  • process 500 (e.g., using one or more components in system 400 (FIG. 4)) generate for display the visual field testing pattern.
  • the system may generate for display the visual field testing pattern on the head-mounted display.
  • process 500 retrieves data from a tilt sensor.
  • the system may retrieve data from a tilt sensor for detecting degrees of head tilt of a user wearing the head-mounted display.
  • the tilt sensor can be, for example, located at the head-mounted display.
  • process 500 determines a degree of head tilt of a user. For example, the system may determine, based on the data retrieved from the tilt sensor, a degree of head tilt of the user.
  • process 500 compare the degree of head tilts.
  • the system may compare, using the control circuitry, the degree of head tilt of the user to a first threshold degree.
  • process 500 can compare the degree of head tilt of the user to a second threshold degree and in response to the degree of head tilt of the user meeting or exceeding the second threshold degree, automatically adjusts a respective location of a stimulus of the plurality of icons in the visual field of the headmounted display by a first amount.
  • the first amount can be is based on a distance of the icon from a centerpoint of the visual field of the head-mounted display and a direction of the head tilt of the user.
  • process 500 (e.g., using one or more components in system 400 (FIG. 4)) generate a recommendation to the user.
  • the system may generate for display a recommendation to the user.
  • the recommendation can be displayed on the headmounted display.
  • the generation can also be in response to the degree of head tilt of the user meeting or exceeding the first threshold degree.
  • FIG. 5 it is contemplated that the steps or descriptions of FIG. 5 may be used with any other embodiment of this disclosure.
  • the steps and descriptions described in relation to FIG. 5 may be done in alternative orders or in parallel to further the purposes of this disclosure.
  • each of these steps may be performed in any order, in parallel, or simultaneously to reduce lag or increase the speed of the system or method.
  • any of the devices or equipment discussed in relation to FIGS. 1-3 could be used to perform one or more of the steps in FIG. 5.
  • FIG. 6 is a process flow diagram for accurately replicating a visual field testing pattern from a curved surface on a flat surface.
  • process 600 may represent the steps taken by one or more devices, as shown in FIGS. 1 A-1C, when providing visual field testing using a headmounted display.
  • process 600 retrieves a visual field testing pattern for a head-mounted display.
  • the system may retrieve a visual field testing pattern for a head-mounted display, wherein the visual field testing pattern comprises stimuli that are displayed at respective locations in a visual field of the headmounted display.
  • process 600 determines a curvature of the head-mounted display.
  • the system may determine a curvature of the head-mounted display based on receiving data from one or more sensors. Additionally or alternatively, the system may receive settings based on an initial calibration (e.g., an automatic calibration or a manual calibration) when the system is activated. Additionally or alternatively, the system may input a model or serial number (or other identifier) for the headmounted display into a look-up table listing curvatures for the model or serial number.
  • the system may determine an offset distance of the head-mounted display based on receiving data from one or more sensors. Additionally or alternatively, the system may receive settings based on an initial calibration (e.g., an automatic calibration or a manual calibration) when the system is activated indicating the offset distance. Additionally or alternatively, the system may input a model or serial number (or other identifier) for the head-mounted display into a look-up table listing offset distance for the model or serial number.
  • an initial calibration e.g., an automatic calibration or a manual calibration
  • the system may input a model or serial number (or other identifier) for the head-mounted display into a look-up table listing offset distance for the model or serial number.
  • process 600 selects the respective locations based on the curvature. For example, the system may automatically adjust the respective locations based on the curvature and/or offset distance determined by the system. In some embodiments, the system may receive the curvature and/or offset distance (e.g., via input entered into a user terminal (e.g., user terminal 424 (FIG. 4)) and adjust the respective locations accordingly.
  • a user terminal e.g., user terminal 424 (FIG. 4)
  • process 600 (e.g., using one or more components in system 400 (FIG. 4)) generates for display the visual field testing pattern on the head-mounted display.
  • the respective locations of the stimuli can be located in a row on the visual field.
  • the respective locations can correspond to respective projections of points corresponding to different viewing angles along a curved surface onto a flat surface.
  • each of these steps may be performed in any order, in parallel, or simultaneously to reduce lag or increase the speed of the system or method.
  • any of the devices or equipment discussed in relation to FIGS. 1-3 could be used to perform one or more of the steps in FIG. 6.
  • FIG. 7 illustrates a system diagram for calibrating one or more sensors or other device components.
  • FIG. 7 shows a processing system 702 and sensors 704.
  • Processing system 702 may include hardware (e.g., one or more processors, memory, etc.), software, or a combination of hardware and software.
  • Processing system 702 may include a testing subsystem 710, a communication subsystem 712, and calibration subsystem 714. Each of these subsystems may include both hardware and software components.
  • testing subsystem 710 may include processors and/or memory.
  • Communication subsystem 712 may include networking components (e.g., network card) and software to run the networking components, thus including software and hardware.
  • Calibration subsystem 714 may also include software and hardware components.
  • FIG. 7 shows a system diagram for calibrating one or more sensors or other device components.
  • FIG. 7 shows a processing system 702 and sensors 704.
  • Processing system 702 may include hardware (e.g., one or more processors, memory, etc.), software, or
  • FIG. 7 also shows sensor(s) 704.
  • Sensor(s) 704 may include one or more eye tracking sensors (e.g., inward directed sensors or other sensors). Sensors 704 may be able to perform eye tracking and gaze calculations. In some embodiments, gaze calculations may be performed using processing system 702.
  • FIG. 7 shows display 706 which may be any suitable display (e.g., a head-mounted display shown in FIGs. 1A-1C).
  • processing system 702 and sensors 704 may be located in the same enclosure as display 706.
  • the head-mounted display may include processing system 702 and sensors 704.
  • testing subsystem 710 and calibration subsystem 714 may be combined into a single subsystem.
  • Testing subsystem 710 may perform visual testing by causing display of stimuli, for example, on a head-mounted display or other interface of a user device.
  • testing subsystem 710 may cause, during a visual field test, a first stimulus to be presented on a user device at a first location.
  • the user device may include a head-mounted display or may be connected to a head-mounted display (e.g., using a wire or wirelessly).
  • Testing subsystem 710 may cause the first stimulus to be presented on the user device by transmitting a command to display 706 for displaying a stimulus (e.g., a visual indicator) at a specific location (e.g., the first location) on the display 706.
  • a stimulus e.g., a visual indicator
  • sensors(s) 704 may perform eye tracking and gaze detection operations on the user’s eye(s).
  • Sensor(s) 704 may include components that detect both the directional movement and a gaze location of the user’s eye(s).
  • Sensor(s) 704 may transmitthat data to processing system 702.
  • sensor(s) 704 may transmit raw tracking data to processing system 702 which may include components to detect both the directional movement and the gaze location of the user’s eyes.
  • Communication subsystem 712 may receive the tracking data (tracking data may be referred to as feedback data) and pass that data to calibration system 714 and/or testing subsystem 710.
  • calibration subsystem 714 may obtain, during the visual field test, first feedback data related to the first stimulus.
  • Calibration subsystem 714 may detect, based on the first feedback data, an eye of the user failing to fixate on the first location corresponding to the first stimulus.
  • the feedback data may include a gaze location of the user as a particular stimulus is displayed, for example, on a head-mounted display.
  • Calibration subsystem 714 may compare the gaze location as detected by the eye tracking sensors (e.g., sensor(s) 704) and the location of the stimulus to determine whether the two locations match. In some embodiments, calibration subsystem 714 may determine that the two locations match even if the two locations are not identical (e.g., if the locations are off by a threshold number, ratio, or percentage).
  • the threshold may be determined based on the type and accuracy of the eye tracking sensor(s). As an example, if the locations match, calibration subsystem 714 may detect that the eye(s) of the user fixated on the first location (i.e., the stimulus). However, if the locations do not match, calibration subsystem 714 may detect that the eye(s) of the user failed to fixate on the first location (i.e., the stimulus).
  • calibration subsystem 714 may determine that the eye of the user fixated on a different location that is within a threshold distance away from the first location.
  • the threshold may be one percent.
  • calibration subsystem 714 may determine that the user is gazing at the stimulus and no calibration is needed.
  • calibration subsystem 714 may determine that the user is also gazing at the stimulus and that calibration is needed.
  • Calibration subsystem 714 may determine that the user has seen the stimulus and is gazing at the stimulus based on, for example, eye movement direction.
  • the system may have a threshold detection of the user’s gaze.
  • the threshold number may be set at twenty percent or another suitable percentage.
  • calibration subsystem 714 may determine that the user is gazing at the stimulus and calibration is needed. The percentage may be based on the type of eye tracking sensors used.
  • testing subsystem 710 and/or calibration subsystem 714 may determine that the user has not seen the first stimulus based on determining that the eye of the user fixated on a different location that is outside the threshold distance away from the first location. For example, if the user fixated on a point that is more than twenty percent away from the stimulus, testing subsystem 710 and/or calibration subsystem 714 may determine that the user has not seen the stimulus.
  • Calibration subsystem 714 or testing subsystem 710 may determine that the user has seen the first stimulus even though the user failed to fixate on the first location. In some embodiments, testing subsystem 710 may determine that the user has seen the first stimulus when the difference between the first location (i.e., the location of the stimulus) and the gaze location determined by the eye tracking sensor(s) is within a threshold ratio or percentage. In some embodiments, calibration subsystem 714 may determine that the user has seen the first stimulus even when the difference between the first location (i.e., the location of the stimulus) and the gaze location determined by the eye tracking sensor(s) is above the threshold ratio or percentage.
  • calibration subsystem 714 may determine that the first stimulus was seen by the user by determining, based on the first feedback data, that user moved a threshold amount towards the first location.
  • eye tracking data e.g., feedback data
  • calibration subsystem 714 may determine whether the user’ s eye(s) moved toward the stimulus (e.g., the first location) by a threshold amount.
  • a threshold amount may be a percentage, a ratio, or another suitable threshold.
  • calibration subsystem 714 may determine that the first location (i.e., the location of the stimulus) does not match with the gaze location, calibration subsystem 714 may still determine that the user has seen the stimulus and in response update the visual test data and also calibrate the eye tracking sensors. For example, when testing subsystem 710 receives the eye tracking data from the sensors (e.g., sensor(s) 704), testing subsystem 710 may determine that the first location and the gaze location do not match and thus may determine that the user did not see the stimulus. However, calibration subsystem 714 may correct the determination by performing the operations above to indicate that the user has actually seen the stimulus and the determination is inaccurate due to a need for a calibration.
  • the sensors e.g., sensor(s) 704
  • testing subsystem 710 and calibration subsystem 714 may be part of the same subsystem.
  • calibration may be part of testing subsystem 710 and part of the visual testing process.
  • the operations described above may be performed by the same subsystem. That is, testing subsystem 710 may cause, during a visual field test, a first stimulus to be presented on a user device at a first visual field location, obtain, during the visual field test, first feedback data related to the first stimulus, the first feedback data indicating that the user has seen the first stimulus, and detect, based on the first feedback data, an eye of the user failing to fixate on the first visual field location corresponding to the first stimulus.
  • Processing system 702 may store a data structure for determining whether calibration is needed.
  • FIG. 8 illustrates a data structure for determining whether calibration is needed.
  • FIG 8 shows data structure 800 that includes identification field 802, display location field 804, gaze location field 806, eye movement direction field 808.
  • Stimulus identification field 802 stores an identifier for a particular stimulus that has been displayed or is being displayed to the user.
  • Display location field 804 includes a corresponding location of the stimulus (e.g., a visual field location).
  • Gaze location field 806 stores a location of the user’s gaze in connection with the corresponding stimulus as detected by the eye-tracking sensors.
  • Eye movement direction field 808 may indicate whether the user’s eyes moved toward the stimulus.
  • processing system 702 may use the data structure of FIG. 8. For example, when testing subsystem 710 instructs display 706 to display a stimulus, testing subsystem 710 may store a stimulus identifier for the stimulus in stimulus identifier field 802. In addition, testing subsystem 710 may store a visual field location for the stimulus in display location field 804. Display location field 804 may hold coordinates of the display where the stimulus is visible. When eye tracking data is received at processing system 702, calibration subsystem 714 or testing subsystem 710 may determine the gaze location of the user and store that information in gaze location field 806. The gaze location may include coordinates of the display. In addition, testing subsystem 710 or calibration subsystem 714 may store eye movement direction in eye movement direction field 808.
  • Testing subsystem 710 or calibration subsystem 714 may compare the data in display location field 804 and gaze location field 806. If the data in those fields matches, processing system 702 may determine that the user has seen the stimulus. If the data does not match, testing subsystem 710 or calibration subsystem 714 may use the data in the eye movement direction field 808 to determine whether the user’s eye(s) moved toward the stimulus. For example, calibration subsystem 714 or testing subsystem 710 may compare the eye tracking data with the location of the stimulus over time after the stimulus was displayed to make the determination.
  • calibration subsystem 714 may perform, during the visual field test, a calibration of the user device. For example, calibration subsystem 714 may calibrate the eye tracking sensor(s) so that the gaze location is aligned with the first visual field location (i.e., the location of the stimulus). Furthermore, calibration subsystems 714 or testing subsystem 710 may store, during the visual field test, a first indication that the user has seen the first stimulus. In some embodiments, to calibrate the user device, calibration subsystem 714 may adjust one or more parameters of a function for detecting a location that the user is viewing. For example, eye tracking sensors may be collecting raw tracking data.
  • the raw tracking data may include measurements of the motion of the eye(s) relative to the user’s head and/or measurement of the point of the user’s gaze.
  • Output of the sensor(s) may depend on the type of sensor is used.
  • Calibration subsystem 714 may then use one or more functions to determine the gaze location and/or eye movement direction. Thus, in the process of calibration one or more of those functions (e.g., the parameters of those functions) may be adjusted.
  • Data processing system 702 may repeat the test with another stimulus which can be displayed subsequent to the first stimulus.
  • testing subsystem 710 may cause, during the visual field test, a second stimulus to be presented on the user device at a second visual field location.
  • testing subsystem 710 may transmit a command to the head-mounted display to display the second stimulus at the second visual field location.
  • Testing subsystem 710 and/or calibration subsystem 714 may obtain, during the visual field test, second feedback data related to the second stimulus.
  • the second feedback data may be obtained using the same mechanism as the first feedback data.
  • Testing subsystem 710 and/or calibration subsystem 714 may detect, based on the second feedback data, that the eye of the user moved toward and fixated on the second visual field location. Based on this determination, processing system 702 may determine that the user has seen the second stimulus and store a second indication that the user has seen the second stimulus. Thus, no calibration of the user device (e.g., eye tracking sensors) is performed in response to detecting that the eye of the user fixated on the second visual field location. Based on the first indication and the second indication, processing system 702 may generate a visual defect assessment. For example, processing system 702 may determine whether the user has any visual defects. It should be noted that one advantage of calibrating the sensors during each stimulus enable the process to accurately adjust for user shifting or the user device otherwise providing inaccurate data.
  • FIG. 9 is a process flow diagram for calibrating a head-mounted display or other user device.
  • processing system 702 causes a stimulus to be presented to a user device at a visual field location.
  • Processing system 702 may use a processor to generate a command to a display (e.g., head-mounted display) to present a stimulus on the display at a particular location. The location may be included in the command.
  • Processing system 702 may pass the command to the display (e.g., head-mounted display).
  • processing system 702 obtains feedback data related to the stimulus.
  • Processing system 702 may obtain the feedback data from one or more eye tracking sensors. The feedback data may have been recorded for a time right after the stimulus has been presented and before the next stimulus is presented.
  • processing system 702 detects an eye of the user failing to fixate on the visual field location corresponding to the stimulus. For example, processing system 702 may analyze the feedback data using one or more processors to make the detection. At 908, processing system 702 performs a calibration of the user device. For example, in response to determining that the user failed to fixate on the visual field location corresponding to the stimulus, processing system 702 may adjust one or more functions for determining a gaze location and/or movement direction. At 910, processing system 702 stores an indication that the user has seen the stimulus. The indication may be stored in association with the corresponding stimulus to signal to the system that the user has seen the stimulus.
  • FIG. 9 may be used with any other embodiment of this disclosure.
  • the steps and descriptions described in relation to FIG. 9 may be done in alternative orders or in parallel to further the purposes of this disclosure.
  • each of these steps may be performed in any order, in parallel, or simultaneously to reduce lag or increase the speed of the system or method.
  • any of the devices or equipment discussed in relation to FIGS. 1 A-1E could be used to perform one or more of the steps in FIG. 9.
  • FIG. 10 illustrates a simplified diagram depicting an exemplary relationship between a virtual plane and a display plane as may be used to calibrate a head-mounted display.
  • the disclosed systems may generate a calibration pattern comprising a number of stimuli (e.g., one or more graphical elements, referred to herein as “icons”) for display at the headmounted display.
  • icons graphical elements
  • the calibration may take many forms and may comprises one or more stimuli being displayed in series and/or in parallel.
  • the system may display a pattern in which the stimuli are displayed at particular positions. The positions may be defined by the system in terms of a height, width and/or viewing angle.
  • the system may generate the stimuli at the extremes of the visual field in order to achieve the best calibration. For example, the system may display the stimuli in one or more corners of the visual field in order to receive the best measurement for calibrating a user’s gaze location on a single fixation point (e.g., a centerpoint in the visual field).
  • FIG. 10 depicts a simplified representation showing a viewing plane 1030 having a number of stimuli (e.g. edge stimuli 1032, 1034, 1036, 1038) that may be seen by a user.
  • a number of stimuli e.g. edge stimuli 1032, 1034, 1036, 1038
  • eye tracking data obtained from a user viewing any one of these edge stimuli may not correspond to where the eye tracking data would be expected based on where the edge stimulus is displayed by the head-mounted display.
  • Example eye tracking data 1010 is shown corresponding to edge stimulus 1034.
  • the eye tracking data is depicted as a dashed line representing the path of the eye over its acquisition time. In this example, even though the system generates edge stimulus 1034, the eye tracking data generally surrounds the perceived edge point 1024.
  • the system may retrieve calibration data of a given interval.
  • the use of the given interval allows the system to normalize data during this time to remove outlier that may occur as a natural result of the calibration process.
  • the edge point can be determined by receiving eye tracking data over periods of time referred to herein as edge calibration periods.
  • the edge calibration periods may be, for example, one second, five seconds, etc.
  • eye tracking data may be averaged over such periods of time to generate an average location. This process may be repeated for a number of edge stimuli, with four shown in the example of FIG. 10.
  • edge points 1032, 1034, 1036, and 1038 generate corresponding points 1022, 1024, 1026, and 1028.
  • the system may generate edge stimuli on edges of the field of view of the headmounted display. For example, along one or more of the left, right, upper, or lower edges.
  • edge stimuli may be generated at the comers of the field, for example, upper left, upper right, lower left, or lower right. It is also contemplated that stimuli may be generated anywhere within the field of view stimuli may be generated anywhere within the field of view such that the presently described calibrations may be performed.
  • the edge stimuli may define a display plane 1030 (i.e., a plane established by the system where the edge stimuli are displayed on)
  • the edge points may also define a virtual plane 1020.
  • the system may calculate a projective transform matrix based on the edge eye tracking data that converts any location in virtual plane 1020 to display plane 1030.
  • stimuli or other calibration patterns may be generated by the head-mounted display and the obtained eye tracking data may be mapped back onto the display plane for comparison with the calibration pattern.
  • the system may calculate a projective transform matrix that is especially useful for a general transformation (e.g., one that does not force parallelism to be observed as such may not be the case when formerly parallel stimuli are viewed by a person).
  • a general transformation e.g., one that does not force parallelism to be observed as such may not be the case when formerly parallel stimuli are viewed by a person.
  • the below example illustrates how the system may generate and/or utilize a projective transform matrix for a coordinate transformation between the two planes 1020 and 1030:
  • the 2x2 “a” submatrix is a rotation matrix
  • the 2x1 “Z>” submatrix is a translation vector
  • the 1x2 “c” submatrix is a projection vector.
  • the x,y elements correspond to the x,y coordinates of the edge stimulus in the display plane (e.g., edge stimulus 1034) and the x’,y’ elements corresponding to the x,y coordinates of the point in the virtual plane (e.g., point 1024).
  • the system may execute pseudocode such as shown in FIG. 10.
  • the projective transformation can be represented as transformation of an arbitrary quadrangle (i.e. system of four points) into another one.
  • the system may use a transform based on a different number of points.
  • the system may use an affine transformation, which is a transformation of a triangle.
  • the system may select the type of transform based on the number of stimuli generated.
  • the system may select the number of stimuli generated based on one or more criteria. For example, the system may determine a number of stimuli needed to achieve a determined amount of accuracy and/or meet a particular threshold level of precision.
  • the system may likewise select the number of stimuli based on a type of test, amount of calibration needed, and/or a frequency of calibration.
  • the system may determine that a four point (e.g., projective transform) calibration is used at the initiation of the user of a head mounted device.
  • the system may then determine (e.g., using a hierarchy of criteria) whether an additional calibration needs to be performed, and if so, how many stimuli are required to be displayed.
  • FIG. 11 illustrates a simplified diagram depicting an exemplary central point and boundary as used to generate a calibration score.
  • the system may generate for display a center stimulus 1100 on the headmounted display at a center location.
  • This system may also receive center eye tracking data during a center calibration period, similar to the edge calibration period(s) described above.
  • the calculated point in the virtual plane may be transformed to what is referred to herein as a “gaze location” in the display plane by the system utilizing the projective transform matrix.
  • the system may generate a calibration score based on a difference 1140 (e.g., a delta in pixels, mm, or other similar distance metrics) between the center stimulus 1100 and the gaze location 1110.
  • a difference 1140 e.g., a delta in pixels, mm, or other similar distance metrics
  • the inset shows this example in greater detail and includes exemplary eye tracking data 1130 and the difference 1140 between center stimulus 1100 and gaze location 1110.
  • the difference 1140 may be similarly calculated the virtual plane 1020 via a determination of equivalent points for the center stimulus and gaze location. In this way, is contemplated that any combination of points may be utilized in either plane and related to each other via the projective transform matrix to calculate differences, locations relative to a boundary (as described below), etc.
  • the system may assess the accuracy of the calibration based on whether the gaze location and/or eye tracking data is within a prescribed boundary. For example, as shown in FIG. 11, the system may generate boundary 1120. In some implementations, such a boundary may be a circle having a given radius from the center stimulus 1100, but other boundary shapes such as square, hexagonal, etc. may be used. While in some implementations the boundary may be visually displayed by the head-mounted display, this is not necessary and instead the boundary may merely reside as coordinates or other boundary defining algorithm in computer memory. Accordingly, the system may determine the calibration score based on the size (e.g. radius) of the boundary.
  • the calibration score may be indicative of the confidence in the calibration.
  • the system may repeat at least a portion of the calibration (e.g., the acquiring of edge eye tracking data, center eye tracking data, and/or calculation of the projective transform matrix), but making the size of the boundary larger (e.g., a larger radius boundary). For example, in one embodiment if the gaze location is calculated to be within the first (or initial) boundary generated, the calibration may be assigned a score of 100 (perhaps corresponding to the best possible calibration).
  • the radius of the boundary may be increased 20% and if that calibration succeeds then it may be assigned a score of 90. Any such relationship between boundary size and calibration score may be used by the system, as implemented by a person of skill.
  • the system may also determine, based on the gaze location, whether a user is looking at the center location. Such a determination may be made by the system, for example, if the gaze location is outside of a bounding box, an area defined by the edge stimuli, etc. Another related implementation can further refine the calibration is not allowing large, sustained deviations in the eye tracking data, even if the average location is within one of the above-described boundaries. For example, the system may determine that the user is not looking at the center location based on whether at least a portion of the center eye tracking data deviates from the gaze location more than a spatial deviation threshold and for longer than a temporal deviation threshold.
  • the spatial deviation threshold may be any distance outside the boundary, but may also be a larger boundary (e.g., l.lx, 1.5x the radius of the present boundary). While a brief excursion may be allowed, the temporal deviation threshold may be set by the system to be, for example, 1 ms, 10 ms, 100 ms, etc. In this way, the system would determine that the calibration failed if the user’s gaze drifted, for example, far to the left and stayed there, indicating a possible loss of focus or attention on the calibration process.
  • FIG. 12 is a process flow diagram for calibrating a head-mounted display.
  • process 1200 may represent steps taken by one or more devices, as shown in FIGS. 1 A-1E, when calibrating the head-mounted display.
  • process 1200 receives edge eye tracking data.
  • the system may receive edge eye tracking data during edge calibration periods. Additionally or alternatively, the system may generate for display a number of edge stimuli on the head-mounted display. Additionally or alternatively, the system may generate edge stimuli on edges or of a field of view of the head-mounted display.
  • process 1200 calculates a projective transform matrix.
  • the system may calculate a projective transform matrix based on the edge eye tracking data.
  • the system may use pseudocode 1300 (FIG. 13) and/or the process described in FIG. 10.
  • process 1200 receives center eye tracking data.
  • the system may receive center eye tracking data during a center calibration period. Additionally or alternatively, the system may generate for display a center stimulus on the head-mounted display at the center location. Additionally or alternatively, the system may generate a boundary around the center stimulus and may display the boundary at the head display.
  • process 1200 applies a projective transform matrix to the center eye tracking data.
  • the system may apply the projective transform matrix to the center eye tracking data to determine a gaze location.
  • process 1200 (e.g., using one or more components in system 400 (FIG. 4)) generates a calibration score.
  • the system may generate a calibration score based on a difference between a central location and the gaze location.
  • the calibration score may be indicative of the accuracy of an eye test performed with the head-mounted display. Additionally or alternatively, the system may determine, based on the difference, whether the gaze location is inside the boundary.
  • the calibration score may be based on a size of the boundary. Additionally or alternatively, the system, in response to the difference indicating that the gaze location is outside the boundary, may repeat at least a portion of the calibration, wherein the size of the boundary is larger. Additionally or alternatively, the system may determine whether a user is looking at the center location based on the gaze location. In response to the determination that the user is not looking at the center location, the system may repeat at least a portion of the calibration. Additionally or alternatively, the determination by the system that the user is not looking at the center location may require that at least a portion of the center eye tracking data deviates from the gaze location more than a spatial deviation threshold and for longer than a temporal deviation threshold.
  • FIG. 12 it is contemplated that the steps or descriptions of FIG. 12 may be used with any other embodiment of this disclosure.
  • the steps and descriptions described in relation to FIG. 12 may be done in alternative orders or in parallel to further the purposes of this disclosure. For example, each of these steps may be performed in any order, in parallel, or simultaneously to reduce lag or increase the speed of the system or method.
  • any of the devices or equipment discussed in relation to FIGS. 1 A-1E could be used to perform one or more of the steps in FIG. 12.
  • Figure 13 is illustrative pseudocode for calibrating a head-mounted display in accordance with certain aspects of the present disclosure.
  • pseudocode 1300 represents illustrative pseudocode for calculating a projective transform matrix as described herein.
  • the below example illustrates how the system may generate and/or utilize a projective transform matrix for a coordinate transformation between the two planes (e.g., planes 1020 and 1030 of FIG. 10).
  • pseudocode 1300 may generate values for 4x4 described in FIG. 10.
  • the points identified in pseudocode 1300 may correspond to the x,y coordinates of the edge stimulus in the display plane (e.g., edge stimulus 1034) and x,y coordinates of the point in the virtual plane (e.g., point 1024).
  • a method comprising: retrieving a visual field testing pattern for a head-mounted display; and generating for display the visual field testing pattern on the head-mounted display.
  • the first amount is based on a distance of the stimulus from a centerpoint of the visual field of the head-mounted display and a direction of the head tilt of the user.
  • the respective location of the stimulus is defined by a first directional component and a second directional component, and wherein the first directional component is adjusted by a cosine of the degree of head tilt of the user and the second directional component is adjusted by a sine of the degree of head tilt of the user.
  • the respective locations of the stimulus are located in a row on the visual field, and wherein the respective locations correspond to respective projections of points corresponding to different viewing angles along a curved surface onto a flat surface.
  • a method comprising: receiving edge eye tracking data during a plurality of edge calibration periods; calculating a projective transform matrix based on the edge eye tracking data; receiving center eye tracking data during a center calibration period; applying the projective transform matrix to the center eye tracking data to determine a gaze location; and generating a calibration score based on a difference between a center location and the gaze location.
  • 21 The method of embodiment 14 or any of the preceding embodiments that depend therefrom, further comprising: in response to the difference indicating that the gaze location is outside the boundary, repeating at least a portion of the calibration, wherein the size of the boundary is larger. 22: The method of embodiment 14 or any of the preceding embodiments that depend therefrom, further comprising: determining whether a user is looking at the center location based on the gaze location; and in response to the determination that the user is not looking at the center location, repeating at least a portion of the calibration.
  • a system comprising: a head-mounted display; inward directed sensors, located at the headmounted display, configured to track pupil movement; storage circuitry configured to store a plurality of stimuli that are displayed at respective locations in a visual field of the head-mounted display; and control circuitry configured to: to perform operations comprising those of any of embodiments 1-23.
  • a tangible, non-transitory, machine-readable medium storing instructions that, when executed by a data processing apparatus, cause the data processing apparatus to perform operations comprising those of any of embodiments 1-23.
  • a system comprising: one or more processors; and memory storing instructions that, when executed by the processors, cause the processors to effectuate operations comprising those of any of embodiments 1-23.
  • a system comprising means for performing any of embodiments 1-23.
  • a method comprising: causing a first stimulus to be presented on a user device at a first location; obtaining first feedback data related to the first stimulus presented at the first location; performing a calibration of the user device; and storing a first indication that the user has seen the first stimulus.
  • the first feedback data includes eye tracking data
  • detecting the eye and storing the first indication are based on the eye tracking data
  • performing the calibration of the user device based on the first feedback data indicating that the eye of the user failed to fixate on the first location comprises determining that the eye of the user fixated on a different location that is within a threshold distance away from the first location.
  • the calibration of the user device comprises adjusting one or more parameters of a function for detecting a location that the user is viewing.
  • the user device comprises a headmounted display.
  • a system comprising: inward directed sensors, located at a head-mounted display, configured to track movement of one or more eyes; storage circuitry configured to store data for generating stimuli that are presented at respective locations of the head-mounted display; and control circuitry configured to perform operations comprising those of any of embodiments 1-11.
  • a tangible, non-transitory, machine-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising those of any of embodiments 1-11.
  • a system comprising: one or more processors; and memory storing instructions that, when executed by the processors, cause the processors to effectuate operations comprising those of any of embodiments 1-11.
  • a system comprising means for performing operations of any embodiments 1-11.
  • One or more aspects or features of the subject matter described herein can be realized in digital electronic circuitry, integrated circuitry, specially designed application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) computer hardware, firmware, software, and/or combinations thereof.
  • ASICs application specific integrated circuits
  • FPGAs field programmable gate arrays
  • These various aspects or features can include implementation in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
  • the programmable system or computing system may include clients and servers.
  • a client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a clientserver relationship to each other.
  • machine-readable signal refers to any signal used to provide machine instructions and/or data to a programmable processor.
  • the machine-readable medium can store such machine instructions non-transitorily, such as for example as would a nontransient solid-state memory or a magnetic hard drive or any equivalent storage medium.
  • the machine-readable medium can alternatively or additionally store such machine instructions in a transient manner, such as for example as would a processor cache or other random access memory associated with one or more physical processor cores.
  • a computer having a display device, such as for example a cathode ray tube (CRT) or a liquid crystal display (LCD) or a light emitting diode (LED) monitor for displaying information to the user and a keyboard and a pointing device, such as for example a mouse or a trackball, by which the user may provide input to the computer.
  • a display device such as for example a cathode ray tube (CRT) or a liquid crystal display (LCD) or a light emitting diode (LED) monitor for displaying information to the user
  • a keyboard and a pointing device such as for example a mouse or a trackball
  • feedback provided to the user can be any form of sensory feedback, such as for example visual feedback, auditory feedback, or tactile feedback; and input from the user may be received in any form, including, but not limited to, acoustic, speech, or tactile input.
  • Other possible input devices include, but are not limited to, touch screens or other touch-sensitive devices such as single or multi-point resistive or capacitive trackpads, voice recognition hardware and software, optical scanners, optical pointers, digital image capture devices and associated interpretation software, and the like.
  • phrases such as “at least one of’ or “one or more of’ may occur followed by a conjunctive list of elements or features.
  • the term “and/or” may also occur in a list of two or more elements or features. Unless otherwise implicitly or explicitly contradicted by the context in which it used, such a phrase is intended to mean any of the listed elements or features individually or any of the recited elements or features in combination with any of the other recited elements or features.
  • the phrases “at least one of A and B;” “one or more of A and B;” and “A and/or B” are each intended to mean “A alone, B alone, or A and B together.”
  • a similar interpretation is also intended for lists including three or more items.
  • the phrases “at least one of A, B, and C;” “one or more of A, B, and C;” and “A, B, and/or C” are each intended to mean “A alone, B alone, C alone, A and B together, A and C together, B and C together, or A and B and C together.”
  • Use of the term “based on,” above and in the claims is intended to mean, “based at least in part on,” such that an unrecited feature or element is also permissible.

Abstract

Certains systèmes et procédés divulgués ici facilitent l'étalonnage d'un visiocasque pendant qu'un test visuel est effectué. Un mécanisme pour faciliter l'étalonnage consiste à détecter, pendant qu'un test visuel est effectué, que les yeux de l'utilisateur se déplacent dans la direction d'un stimulus affiché mais ne s'arrêtent pas au point d'affichage du stimulus, et s'arrêtent plutôt à un point différent (par exemple, à une distance seuil éloignée du stimulus). Sur la base de cette détection, le système peut déterminer que l'utilisateur a vu le stimulus et que l'étalonnage des capteurs est nécessaire. Le système peut ensuite enregistrer que l'utilisateur a vu le stimulus et effectuer un étalonnage de capteur avant d'afficher le stimulus suivant.
EP21887174.7A 2020-10-28 2021-10-08 Systèmes et procédés de test de champ visuel dans des visiocasques Pending EP4236755A1 (fr)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US17/082,983 US10993612B1 (en) 2020-10-28 2020-10-28 Systems and methods for visual field testing in head-mounted displays
US17/246,054 US20220125294A1 (en) 2020-10-28 2021-04-30 Systems and methods for visual field testing in head-mounted displays
US17/392,664 US20220125297A1 (en) 2020-10-28 2021-08-03 Device calibration via a projective transform matrix
US17/392,723 US20220125298A1 (en) 2020-10-28 2021-08-03 Active calibration of head-mounted displays
PCT/US2021/054228 WO2022093521A1 (fr) 2020-10-28 2021-10-08 Systèmes et procédés de test de champ visuel dans des visiocasques

Publications (1)

Publication Number Publication Date
EP4236755A1 true EP4236755A1 (fr) 2023-09-06

Family

ID=81384341

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21887174.7A Pending EP4236755A1 (fr) 2020-10-28 2021-10-08 Systèmes et procédés de test de champ visuel dans des visiocasques

Country Status (3)

Country Link
EP (1) EP4236755A1 (fr)
JP (1) JP2023550699A (fr)
WO (1) WO2022093521A1 (fr)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105960193A (zh) * 2013-09-03 2016-09-21 托比股份公司 便携式眼睛追踪设备
JP2018504733A (ja) * 2014-10-21 2018-02-15 フィリップス ライティング ホールディング ビー ヴィ 発光分布のハンズフリー設定のためのシステム、方法、及びコンピュータプログラム
US10531795B1 (en) * 2017-09-27 2020-01-14 University Of Miami Vision defect determination via a dynamic eye-characteristic-based fixation point
CN111511318B (zh) * 2017-09-27 2023-09-15 迈阿密大学 数字治疗矫正眼镜
AU2018367510A1 (en) * 2017-11-14 2020-06-25 Vivid Vision, Inc. Systems and methods for visual field analysis

Also Published As

Publication number Publication date
JP2023550699A (ja) 2023-12-05
WO2022093521A1 (fr) 2022-05-05

Similar Documents

Publication Publication Date Title
CN110573061B (zh) 眼科检查方法及仪器
CN105163649B (zh) 计算机化屈光和散光确定
US20190246889A1 (en) Method of determining an eye parameter of a user of a display device
US9323075B2 (en) System for the measurement of the interpupillary distance using a device equipped with a screen and a camera
US9545202B2 (en) Device and method for measuring objective ocular refraction and at least one geometric-morphological parameter of an individual
JP2021502130A (ja) デジタル治療用矯正眼鏡
US9664929B2 (en) Method for determining at least one head posture characteristic of a person wearing spectacles
US9671617B2 (en) Method for estimating a distance separating a pair of glasses and an eye of the wearer of the pair of glasses
JP6049750B2 (ja) 眼鏡レンズの輝度依存調整
US11448903B2 (en) Method for correcting centering parameters and/or an axial position and corresponding computer program and methods
CN107003752A (zh) 信息处理装置、信息处理方法以及程序
JP2019194702A (ja) 累進眼科用レンズの少なくとも１つの光学的設計パラメータを判断する方法
CN112689470B (zh) 用于使用计算装置执行散光力测试的方法以及相应的计算装置
JP2019215688A (ja) 自動キャリブレーションを行う視線計測装置、視線計測方法および視線計測プログラム
ES2932157T3 (es) Determinación de un error de refracción de un ojo
CN111699432A (zh) 使用沉浸式系统确定眼睛的耐力的方法及其电子设备
JP2007003923A (ja) 眼鏡装用パラメータ測定装置、眼鏡レンズ及び眼鏡
US20220125297A1 (en) Device calibration via a projective transform matrix
US20220125294A1 (en) Systems and methods for visual field testing in head-mounted displays
CN113138664A (zh) 基于光场感知的眼球追踪系统、方法
US20220125298A1 (en) Active calibration of head-mounted displays
EP4236755A1 (fr) Systèmes et procédés de test de champ visuel dans des visiocasques
US20230255473A1 (en) Integrated apparatus for visual function testing and method thereof
CN110414302A (zh) 非接触式的瞳距测量方法及系统
EP3801193B1 (fr) Système et procédé de correction automatique de torsion dans des mesures ophtalmiques de diagnostic

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20230426

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)