CN113693548B

CN113693548B - Head-wearing type vision detection and vision training equipment

Info

Publication number: CN113693548B
Application number: CN202111012892.3A
Authority: CN
Inventors: 杜煜; 詹培忠
Original assignee: Shanghai Qingyan Technology Co ltd
Current assignee: Shanghai Qingyan Technology Co ltd
Priority date: 2021-08-31
Filing date: 2021-08-31
Publication date: 2024-05-28
Anticipated expiration: 2041-08-31
Also published as: CN113693548A

Abstract

The invention relates to a head-mounted visual detection and visual training device which is characterized by comprising a display module; a control module; a housing; the left mirror frame is in a circular shape, and N left near infrared point light sources are distributed on one side of the left mirror frame facing eyes; a left semi-transparent semi-reflective lens; a left near infrared camera; the right mirror frame is in a circular shape, and N right near infrared point light sources are distributed on one side of the right mirror frame facing eyes; a right semi-transparent semi-reflective lens; a right near infrared camera; and the controllable covering module. The invention has the beneficial effects that: when the vision inspection and training are carried out, the state of the eyeball movement of the testee is automatically judged through the head-mounted optical device and the image processing technology, objective and quantitative results can be obtained, the time of doctors and testees is saved, and the operation is convenient.

Description

Head-wearing type vision detection and vision training equipment

Technical Field

The invention relates to ophthalmic medical equipment, in particular to head-mounted visual detection and visual training equipment capable of shooting eye images in real time

Background

Binocular vision inspection and training such as strabismus inspection, amblyopia training, simultaneous vision, fusion vision and three-dimensional vision are common visual inspection and training contents for ophthalmology. Currently, these examinations and training are performed clinically, mainly by manual operation of a doctor, and the eye state of a subject is determined by subjective experience.

For example, in the case of a strabismus examination, a method of "covering-uncovering" is currently commonly used, in which a doctor holds an eye-covering plate to cover a single eye in sequence, and the doctor visually observes whether or not there is eyeball movement in the opposite eye during the covering; and then removing the eye shielding plate, and observing whether the shielded eyes have eyeball movement or not by naked eyes after the eye shielding plate is removed, thereby judging whether strabismus or strabismus is displayed or not.

In the amblyopia training, the prior common method is to cover the dominant eye of a patient by using an eyeshade, and only use the amblyopia to watch pictures and videos for training. Because the amblyopia degrees of different patients are different, the training contents with different difficulties are needed to be selected to train the patients, and in order to judge whether the amblyopia eyes of the patients can see the training contents clearly and watch the corresponding positions, doctors can only watch the watching direction of the patients through naked eyes to subjectively judge at present.

When binocular vision inspection and training are performed, the gazing position of eyes and the depth of focusing of binocular vision of a trainer are useful information, and the gazing position and the depth of focusing of binocular vision are difficult to accurately judge only by naked eyes of doctors, so that the training effect is not easy to objectively and quantitatively evaluate.

Disclosure of Invention

The invention aims to solve the technical problems that: at present, when visual inspection and training are carried out, the state of eyeball movement of a detected person is judged mainly by naked eye observation and subjective experience judgment of doctors, so that the time is long and objective and accurate assessment is difficult.

In order to solve the technical problems, the technical proposal of the invention is to provide a head-mounted visual inspection and visual training device, which is characterized by comprising,

A display module;

A control module;

The shell is a head-wearing type, and the relative position of the shell and the head is kept fixed through a fixing device;

The left mirror frame is in a circular shape, N left near infrared point light sources are distributed on one side of the left mirror frame facing eyes, the left near infrared point light sources on the left mirror frame can emit near infrared light to irradiate the left eyes, N is more than or equal to 8, and the distances between the N left near infrared point light sources are equal; the left mirror frame is connected with the shell, and the relative positions of the left mirror frame and the shell can be adjusted;

the left semi-transparent and semi-reflective lens is a plane lens, is fixed at the relative position with the left lens frame, has an included angle theta with the plane of the left lens frame, wherein theta is more than 0 degrees and less than or equal to 45 degrees, can transmit visible light and reflect near infrared light;

the left near infrared camera is fixed at the relative position with the left mirror frame, and can shoot a left eye image through reflection of the left semi-transparent semi-reflective lens; the included angle between the central axis of the left near infrared camera and the plane of the left mirror frame is 90-2 theta; setting the intersection point of the central axis of the left near infrared camera and the left semi-transparent semi-reflecting lens as O ₁, and enabling a straight line passing through O ₁ and being perpendicular to the plane where the left lens frame is positioned to pass through the circle center of the circle where the left lens frame is positioned;

The right mirror frame is in a circular shape, N right near infrared point light sources are distributed on one side of the right mirror frame facing eyes, the right near infrared point light sources on the right mirror frame can emit near infrared light to irradiate the right eyes, N is more than or equal to 8, and the distances between the N right near infrared point light sources are equal; the right mirror frame is connected with the shell, and the relative positions of the right mirror frame and the shell can be adjusted;

The right semi-transparent and semi-reflective lens is a plane lens, is fixed at the relative position with the right mirror frame, has an included angle theta with the plane of the right mirror frame, wherein theta is more than 0 degrees and less than or equal to 45 degrees, can transmit visible light and reflect near infrared light;

the right near infrared camera is fixed at the relative position with the right mirror frame, and can shoot a right eye image through the reflection of the right semi-transparent semi-reflective lens; the included angle between the central axis of the right near infrared camera and the plane of the right mirror frame is 90-2 theta; setting the intersection point of the central axis of the right near infrared camera and the right semi-transparent semi-reflecting lens as O ₂, and enabling a straight line passing through O ₂ and being perpendicular to the plane where the right mirror frame is positioned to pass through the circle center of the circle where the right mirror frame is positioned;

The controllable covering module is connected with the shell and is divided into a left covering module and a right covering module, the left covering module is positioned at the outer side of the left semi-transparent semi-reflective lens, and the right covering module is positioned at the outer side of the right semi-transparent semi-reflective lens; the left covering module or the display module is controlled by the control module, so that the left eye can see or not see the content displayed by the display module; the control module is used for controlling the right covering module or the display module, so that the right eye can see or not see the content displayed by the display module; at any one time, at least one of the left eye and the right eye can see the content displayed by the display module.

Preferably, 8 left near infrared point light sources are distributed on one side of the left mirror frame facing eyes, and the 8 left near infrared point light sources are circularly arranged at equal intervals, wherein the arrangement mode is that one left near infrared point light source is arranged right above the left mirror frame, and each left near infrared point light source is arranged at an interval of 45 degrees;

the right mirror frame is towards the one side of eyes and distributes 8 right near infrared point light sources, and 8 right near infrared point light sources are along circular arrangement and interval equals, and the arrangement mode has a right near infrared point light source directly over, has a right near infrared point light source every 45 degrees intervals.

Preferably, a circular vision correction lens can be arranged on the left glasses frame; the right glasses frame can be provided with a round vision correcting lens.

Preferably, the relative positions of the left frame and the left eye are adjusted by:

Taking the horizontal direction of an image shot by the left near infrared camera as an X axis and the up-down direction as a Y axis; when the left eye is in front of the front view, the left and right positions of the left lens frame are adjusted to enable the X coordinate of the center coordinate of the left eye pupil and the X coordinate of the center coordinate of the left eye cornea reflecting point, which are shot by the left near infrared camera, to be overlapped, and the upper and lower positions of the left lens frame are adjusted to enable the Y coordinate of the center coordinate of the left eye pupil and the Y coordinate of the center coordinate of the left eye cornea reflecting point, which are shot by the left near infrared camera, to be overlapped;

The relative positions of the right mirror frame and the right eye are adjusted by adopting the following method:

Taking the horizontal direction of an image shot by the right near infrared camera as an X axis and the up-down direction as a Y axis; when the right eye looks ahead, through adjusting the left and right position of right picture frame, make the X coordinate of right eye pupil central coordinate and the X coordinate coincidence of right eye cornea reflection point central coordinate that right near infrared camera shot, through adjusting the upper and lower position of right picture frame, make the Y coordinate of right eye pupil central coordinate and the Y coordinate coincidence of right eye cornea reflection point central coordinate that right near infrared camera shot.

Preferably, the device further comprises a micro motor, and the pupil distance adjusting mode is automatic adjustment, and specifically comprises the following steps:

When the left eye looks ahead, if the left eye pupil center coordinate shot by the left near infrared camera is on the nose side of the left near infrared point light source average coordinate, the left eye mirror frame is driven by the micro motor to move to the nose side relative to the shell, if the left eye pupil center coordinate is on the temporal side of the left near infrared point light source average coordinate, the left eye mirror frame is driven by the micro motor to move to the temporal side relative to the shell until the X coordinate of the left eye pupil center coordinate and the X coordinate of the left eye cornea reflection point center coordinate coincide; if the center coordinate of the pupil of the left eye shot by the left near infrared camera is on the upper side of the average coordinate of the left near infrared point light source, driving the left mirror frame to move upwards relative to the left eye through a micro motor, and if the center coordinate of the pupil of the left eye is on the lower side of the center coordinate of the reflection point of the left cornea, driving the left mirror frame to move downwards relative to the left eye through the micro motor until the Y coordinate of the center coordinate of the pupil of the left eye and the Y coordinate of the center coordinate of the reflection point of the left cornea coincide;

When the right eye is in front of the front view, if the center coordinate of the pupil of the right eye shot by the right near infrared camera is on the nose side of the average coordinate of the right near infrared point light source, the right lens frame is driven by the micro motor to move to the nose side relative to the shell, and if the center coordinate of the pupil of the right eye is on the temporal side of the center coordinate of the reflection point of the right cornea, the right lens frame is driven by the micro motor to move to the temporal side relative to the shell until the X coordinate of the center coordinate of the pupil of the right eye and the X coordinate of the center coordinate of the reflection point of the right cornea coincide; if the center coordinate of the pupil of the right eye shot by the right near infrared camera is on the upper side of the center coordinate of the reflecting point of the pupil of the right eye, the right mirror frame is driven by the micro motor to move upwards relative to the right eye, and if the center coordinate of the pupil of the right eye is on the lower side of the center coordinate of the reflecting point of the pupil of the right eye, the right mirror frame is driven by the micro motor to move downwards relative to the right eye until the Y coordinate of the center coordinate of the pupil of the right eye and the Y coordinate of the center coordinate of the reflecting point of the pupil of the right eye coincide.

Preferably, the left covering module in the controllable covering module is a liquid crystal shutter device, the control module controls whether the left covering module is electrified or not, and the left covering module is transparent when electrified and opaque when not electrified; or opaque when energized and transparent when not energized; the right covering module in the controllable covering module is a liquid crystal shutter device, the control module controls whether the liquid crystal shutter device is electrified or not, and the liquid crystal shutter device is transparent when electrified and opaque when not electrified; or opaque when energized and transparent when not energized;

Or: the left covering module in the controllable covering module is a polarizer which can only transmit P1 type polarized light; the right covering module in the controllable covering module is a polarizer which can only transmit P2 type polarized light; when the control module controls the display module to display the image only containing the P1 type polarized light, only the left eye can see the image displayed by the display module through the left covering module; when the control module controls the display module to display the image only containing the P2 type polarized light, only the right eye can see the image displayed by the display module through the right covering module; when the control module controls the display module to display the images simultaneously containing the P1 type polarized light and the P2 type polarized light, the left eye can see the images displayed by the display module through the left covering module, and the right eye can see the images displayed by the display module through the right covering module;

Or: the left covering module in the controllable covering module is a band-pass filter which can only transmit visible light with the wavelength of lambda ₁, the right covering module in the controllable covering module is a band-pass filter which can only transmit visible light with the wavelength of lambda ₂, and lambda ₁ is not equal to lambda ₂; when the control module controls the display module to display the image only with the light-emitting wavelength lambda ₁, only the left eye can see the image displayed by the display module through the left covering module; when the control module controls the display module to display the image only with the light-emitting wavelength lambda ₂, only the right eye can see the image displayed by the display module through the right covering module; when the control module controls the display module to display the image simultaneously with the light-emitting wavelength lambda ₁ and the light-emitting wavelength lambda ₂, the left eye can see the image displayed by the display module through the left covering module, and the right eye can see the image displayed by the display module through the right covering module.

Preferably, the housing is composed of a side material and a front material; the side surface material of the shell is not transparent to visible light and near infrared light; the front material of the shell transmits visible light; the shell covers the left mirror frame, the left semi-transparent semi-reflective lens, the left near-infrared camera, the right mirror frame, the right semi-transparent semi-reflective lens, the right near-infrared camera and the controllable covering module from the outside; the casing does not block the front view of the eyes of the person, and simultaneously, external visible light and near infrared light cannot irradiate in through a gap between the left eye and the left lens frame or a gap between the right eye and the right lens frame.

Preferably, the casing is provided with a projection device, and the pattern is projected on a front plane by the projection device.

Preferably, the device further comprises a calibration-free eyeball motion direction judging module:

When the center coordinates of the pupils of the left eye and the average coordinates of the left near infrared point light sources are not coincident, the calibration-free eyeball motion direction judging module selects three left near infrared point light source cornea reflection points nearest to the center coordinates of the pupils of the left eye, and judges the direction of the eyeball motion of the left eye according to the directions of obtuse angles of triangles formed by the three cornea reflection points;

when the center coordinates of the pupils of the right eye and the average coordinates of the right near infrared point light sources are not coincident, the calibration-free eyeball motion direction judging module selects three cornea reflection points of the right near infrared point light sources closest to the center coordinates of the pupils of the right eye, and judges the direction of the eyeball motion of the right eye according to the directions of obtuse angles of triangles formed by the three cornea reflection points.

Preferably, the system further comprises a monocular calibration module and an eye movement point calculation module:

When the left eye is calibrated in a single eye manner, the single eye calibration module enables the left eye to be visible in the calibration visual target and the right eye to be invisible in the calibration visual target, and the single eye calibration module can perform the single eye calibration of the left eye by displaying 2 points to 9 points, and the left eye calibration function is obtained through calculation; the eye movement point calculation module quantitatively calculates the eye movement point of the left eye according to the left eye calibration function and the left eye image;

When the right eye is in monocular calibration, the monocular calibration module enables the right eye to be in visual calibration and the left eye to be in invisible calibration, and the monocular calibration module can perform monocular calibration of the right eye by displaying 2 points to 9 points, and a right eye calibration function is obtained through calculation; the eye movement point calculation module quantitatively calculates the eye movement point of the right eye according to the right eye calibration function and the image of the right eye.

Preferably, the system further comprises a calibration-free strabismus checking module:

Displaying a visual target right in front of a detected person, and switching three modes of binocular visual targets, left-eye visual targets only and right-eye visual targets only by controlling a controllable covering module; if only the left eye pupil center coordinate and the left eye cornea reflection point center coordinate coincide when the visual target is visible to the left eye, and only the right eye pupil center coordinate and the right eye cornea reflection point center coordinate coincide when the visual target is visible to the right eye, but the pupil center coordinate of one eye and the cornea reflection point center coordinate of the eye do not coincide when the visual target is visible to the two eyes, judging that strabismus is displayed; if the center coordinates of the pupils of the left eye and the center coordinates of the reflection points of the right eye are overlapped when the visual target is seen by the two eyes, but the center coordinates of the pupils of the right eye and the center coordinates of the reflection points of the right eye are not overlapped when the visual target is seen by the left eye only, or the center coordinates of the pupils of the left eye and the center coordinates of the reflection points of the left eye are not overlapped when the visual target is seen by the right eye only, then the hidden strabismus is judged.

Preferably, the system further comprises a strabismus checking module:

After the left eye monocular calibration is finished and the right eye monocular calibration is finished, displaying a visual target in front of the testee, wherein the visual target can be displayed at a single position or a plurality of positions; the controllable covering module is controlled to switch three modes of binocular visual targets, left-eye visual targets and right-eye visual targets; if the left eye movement point is overlapped with the position of the visual target when only the left eye sees the visual target, and the right eye movement point is overlapped with the position of the visual target when only the right eye sees the visual target, but the eye movement point of one eye is not overlapped with the position of the visual target when the two eyes see the visual target, judging that the oblique vision is displayed; if the left eye movement point is overlapped with the position of the visual target when the eyes see the visual target, and the right eye movement point is overlapped with the position of the visual target, but the right eye movement point is not overlapped with the position of the visual target when the eyes see the visual target only, or the left eye movement point is not overlapped with the position of the visual target when the eyes see the visual target only, then the hidden strabismus is judged.

Preferably, the amblyopia training module is further comprised of: the amblyopia training images displayed by the display module contain interactive contents, and the trainee interacts through eye movement points of amblyopia eyes.

Preferably, the binocular vision training module further comprises a binocular vision training module, wherein the binocular vision training module comprises simultaneous vision, fusion vision and stereoscopic vision training contents, and the binocular vision training module comprises the following components: training the simultaneous vision by alternately displaying images visible to only the left eye and images visible to only the right eye in a time-sharing manner, and judging the simultaneous vision training effect by whether left eye movement points, right eye movement points and training content images are overlapped or not; training the fusion vision by displaying images which are visible by both eyes at the same time, and judging the training effect of the fusion vision by whether the left eye movement point is overlapped with the right eye movement point; the stereoscopic vision is trained by displaying a stereoscopic image with a certain parallax between an image visible to only the left eye and an image visible to only the right eye, and the stereoscopic vision training effect is judged by the overlapping distance of the left eye moving point and the right eye moving point.

Another technical solution of the present invention is to provide a head-mounted visual inspection and visual training device, which is characterized by comprising:

A display module;

A control module;

The left mirror frame is connected with the shell, and the relative positions of the left mirror frame and the shell can be adjusted; the left mirror frame is a central symmetrical graph;

The left semi-transparent and semi-reflective lens is a plane lens, is fixed at the relative position with the left lens frame, has an included angle theta with the plane of the left lens frame of more than 0 DEG and less than or equal to 45 DEG, can transmit visible light and reflect near infrared light;

the number of the left near infrared point light sources is one, the left near infrared point light sources are fixed at the relative positions of the left lens frame, the emitted near infrared light irradiates the left eye through the reflection of the left semi-transparent semi-reflective lens, and reflection points are formed on the left eye cornea; the connection line of the left near infrared point light source at the symmetrical center of the virtual image of the left semi-transparent semi-reflecting lens and the left mirror frame is L ₁,L₁ vertical to the plane of the left mirror frame; setting the intersection point of the L ₁ and the left semi-transparent semi-reflecting lens as O ₃, and setting the included angle between the connecting line of the left near infrared point light source and O ₃ and the plane of the left lens frame as 90-2 theta;

The left near infrared camera is positioned on the side surface of the left near infrared point light source, and the distance between the left near infrared point light source and the left near infrared point light source is less than or equal to 2.5cm; the left eye image can be shot through the reflection of the left semi-transparent semi-reflective lens, and the included angle between the central axis of the left near infrared camera and the plane of the left mirror frame is 90-2 theta;

The right mirror frame is connected with the shell, and the relative positions of the right mirror frame and the shell can be adjusted; the right mirror frame is a central symmetrical graph;

The right semi-transparent and semi-reflective lens is a plane lens, is fixed at the relative position with the right mirror frame, has an included angle theta with the plane of the right mirror frame of more than 0 DEG and less than or equal to 45 DEG, can transmit visible light and reflect near infrared light;

the right near infrared point light sources are fixed at the opposite positions of the right mirror frame, and the emitted near infrared light irradiates the right eye through the reflection of the right semi-transparent semi-reflective mirror and forms reflection points on the right eye cornea; setting the connection line of the right near infrared point light source at the symmetrical center of the virtual image of the right semi-transparent semi-reflecting lens and the right mirror frame as L ₂,L₂ vertical to the plane of the right mirror frame; setting the intersection point of the L ₂ and the right semi-transparent semi-reflecting lens as O ₄, and setting the included angle between the connecting line of the right near infrared point light source and O ₄ and the plane of the right lens frame as 90-2 theta;

the right near infrared camera is positioned on the side surface of the right near infrared point light source, and the distance between the right near infrared point light source and the right near infrared point light source is less than or equal to 2.5cm; the right eye image can be shot through the reflection of the right semi-transparent semi-reflective lens, and the included angle between the central axis of the right near infrared camera and the plane of the right mirror frame is 90-2 theta;

Preferably, the left glasses frame can be provided with vision correction lenses; the right glasses frame can be provided with vision correction lenses.

Taking the horizontal direction of an image shot by the left near infrared camera as an X axis and the up-down direction as a Y axis; when the left eye is in front of the front view, the X coordinate of the center coordinate of the left eye pupil shot by the left near infrared camera is overlapped with the X coordinate of the cornea reflecting point coordinate of the left near infrared point light source by adjusting the left and right positions of the left eye frame, and the Y coordinate of the center coordinate of the left eye pupil shot by the left near infrared camera is overlapped with the Y coordinate of the cornea reflecting point coordinate of the left near infrared point light source by adjusting the upper and lower positions of the left eye frame;

taking the horizontal direction of an image shot by the right near infrared camera as an X axis and the up-down direction as a Y axis; when the right eye is in front of the front view, the X coordinate of the center coordinate of the right eye pupil shot by the right near infrared camera is overlapped with the X coordinate of the cornea reflection point coordinate of the right near infrared point light source by adjusting the left and right positions of the right eye frame, and the Y coordinate of the center coordinate of the right eye pupil shot by the right near infrared camera is overlapped with the Y coordinate of the cornea reflection point coordinate of the right near infrared point light source by adjusting the upper and lower positions of the right eye frame.

Preferably, the device further comprises a micro motor, and the pupil distance adjustment mode is automatic adjustment, and comprises the following steps:

When the left eye is in front of the front view, if the center coordinate of the left eye pupil shot by the left near infrared camera is on the nose side of the left near infrared point light source cornea reflection point coordinate, driving the left lens frame to move to the nose side relative to the shell by a micro motor, and if the center coordinate of the left eye pupil is on the temporal side of the left near infrared point light source cornea reflection point coordinate, driving the left lens frame to move to the temporal side relative to the shell by the micro motor until the X coordinate of the center coordinate of the left eye pupil and the X coordinate of the left near infrared point light source cornea reflection point coordinate coincide; if the center coordinate of the pupil of the left eye shot by the left near infrared camera is at the upper side of the cornea reflecting point coordinate of the left near infrared point light source, driving the left lens frame to move upwards relative to the left eye through a micro motor, and if the center coordinate of the pupil of the left eye is at the lower side of the cornea reflecting point coordinate of the left near infrared point light source, driving the left lens frame to move downwards relative to the left eye through the micro motor until the Y coordinate of the center coordinate of the pupil of the left eye and the Y coordinate of the cornea reflecting point coordinate of the left near infrared point light source coincide;

When the right eye is in front of the front view, if the center coordinate of the right eye pupil shot by the right near infrared camera is on the nose side of the coordinate of the cornea reflection point of the right near infrared point light source, the right lens frame is driven by the micro motor to move to the nose side relative to the shell, and if the center coordinate of the right eye pupil is on the temporal side of the coordinate of the cornea reflection point of the right near infrared point light source, the right lens frame is driven by the micro motor to move to the temporal side relative to the shell until the X coordinate of the center coordinate of the right eye pupil coincides with the X coordinate of the cornea reflection point of the right near infrared point light source; if the center coordinate of the pupil of the right eye shot by the right near-infrared camera is at the upper side of the cornea reflecting point coordinate of the right near-infrared point light source, the right mirror frame is driven by the micro motor to move upwards relative to the right eye, and if the center coordinate of the pupil of the right eye is at the lower side of the cornea reflecting point coordinate of the right near-infrared point light source, the right mirror frame is driven by the micro motor to move downwards relative to the right eye until the Y coordinate of the center coordinate of the pupil of the right eye and the Y coordinate of the cornea reflecting point coordinate of the right near-infrared point light source coincide.

Preferably, the shell is composed of a side material and a front material, wherein the side material of the shell is not transparent to visible light and not transparent to near infrared light; the front material of the shell transmits visible light; the left mirror frame, the left semi-transparent semi-reflective lens, the left near infrared camera, the left near infrared point light source, the right mirror frame, the right semi-transparent semi-reflective lens, the right near infrared camera, the right near infrared point light source and the controllable covering module are covered from the outside; the front view of the eyes is not blocked, and external visible light and near infrared light cannot be irradiated through the gap between the left eye and the left lens frame or the gap between the right eye and the right lens frame.

When the center coordinates of the left eye pupil and the coordinates of the cornea reflecting point of the left near infrared point light source are not coincident, the calibration-free eyeball motion direction judging module judges the direction of the left eye eyeball motion according to the direction of the center coordinates of the left eye pupil pointed by the coordinates of the cornea reflecting point of the left near infrared point light source; when the center coordinates of the pupil of the right eye and the coordinates of the cornea reflecting point of the right near infrared point light source are not coincident, the calibration-free eyeball motion direction judging module judges the direction of the eyeball motion of the right eye according to the direction of the center coordinates of the pupil of the right eye pointed by the coordinates of the cornea reflecting point of the right near infrared point light source.

Displaying a visual target right in front of a detected person, and switching three modes of binocular visual targets, left-eye visual targets only and right-eye visual targets only by controlling a controllable covering module; if only the left eye pupil center coordinate and the left near infrared point light source cornea reflection point coordinate coincide when the visual target is visible to the left eye, and only the right eye pupil center coordinate and the right near infrared point light source cornea reflection point coordinate coincide when the visual target is visible to the right eye, but the pupil center coordinate of one eye and the near infrared point light source cornea reflection point coordinate of the eye do not coincide when the visual target is visible to the two eyes, judging that strabismus is displayed; if the center coordinates of the pupils of the left eye and the coordinates of the cornea reflecting points of the left near infrared point light sources coincide when the visual target is seen by both eyes, and the center coordinates of the pupils of the right eye and the coordinates of the cornea reflecting points of the right near infrared point light sources coincide, but the center coordinates of the pupils of the right eye and the coordinates of the cornea reflecting points of the right near infrared point light sources do not coincide when the visual target is seen by only the left eye, or the center coordinates of the pupils of the left eye and the coordinates of the cornea reflecting points of the left near infrared point light sources do not coincide when the visual target is seen by only the right eye, then the hidden strabismus is judged.

Preferably, the system further comprises a strabismus checking module:

The invention has the beneficial effects that: when the vision inspection and training are carried out, the state of the eyeball movement of the testee is automatically judged through the head-mounted optical device and the image processing technology, objective and quantitative results can be obtained, the time of doctors and testees is saved, and the operation is convenient.

Drawings

FIG. 1 (a) is a schematic top view of the structure of the apparatus in the first embodiment; FIG. 1 (b) is a front view showing the construction of the apparatus in the first embodiment;

FIG. 2 is a schematic diagram of a subject wearing a device viewing display module in a first embodiment;

Fig. 3 is a left eye image captured by a left near infrared camera when the left eye is looking forward in the first embodiment;

Fig. 4 is a left eye image taken by the left near infrared camera when the left eye looks at 9 orientations in the first embodiment;

FIG. 5 (a) is a schematic top view of the apparatus in the second embodiment; fig. 5 (b) is a front view of a schematic diagram of the structure of the apparatus in the second embodiment;

fig. 6 is a left eye image captured by a left near infrared camera when the left eye is looking forward in the second embodiment;

Fig. 7 is a left eye image captured by a left near infrared camera when the left eye looks at 9 orientations in the second embodiment.

Detailed Description

The application will be further illustrated with reference to specific examples. It is to be understood that these examples are illustrative of the present application and are not intended to limit the scope of the present application. Furthermore, it should be understood that various changes and modifications can be made by one skilled in the art after reading the teachings of the present application, and such equivalents are intended to fall within the scope of the application as defined in the appended claims.

Example 1

The embodiment discloses a wear-type visual inspection and vision training equipment, including casing 1, left picture frame 2, left half mirror 3, left near infrared camera 4, right picture frame 5, right half mirror 6, right near infrared camera 7, controllable cover module, control module (not shown in the figure), display module 9. Fig. 1 (a) is a schematic plan view of the device structure. Fig. 1 (b) is a front view of a schematic diagram of the apparatus structure.

The casing 1 is a head-mounted type, the fixing device 10 is fixed relative to the head, the fixing device 10 can be a ring-shaped or T-shaped head band, and a helmet-type fixing device can also be used.

The left mirror frame 2 is in a circular ring shape, N left near infrared point light sources 201 are uniformly distributed on one side of the left mirror frame 2 facing eyes, the left near infrared point light sources 201 can emit near infrared light to irradiate the left eyes, N is more than or equal to 8, and the distances between the N left near infrared point light sources 201 are equal. The left mirror frame 2 is connected with the casing 1, and the relative positions of the left mirror frame 2 and the casing 1 are adjustable. The left frame 2 is provided with a clamping groove, and various round vision correction lenses, such as a myopia lens, a hyperopia lens or a strabismus correction lens, or any lens can be installed. The N left near infrared point light sources 201 on the left frame 2 serve to provide near infrared illumination for the left eye captured by the left near infrared camera 4, and the reflection point of the left near infrared point light sources 201 on the cornea of the left eye can be used as a reference point for calculating the movement of the eyeball of the left eye. Experiments show that when N is more than or equal to 8, the illumination is uniform, and at least 3 clear cornea reflection points can be arranged when the left eye looks at all directions, so that the calculation of eyeball movement is facilitated. In this embodiment, the number of left near infrared point light sources 201 on the left frame 2 is 8, and the 8 left near infrared point light sources 201 are arranged in a circular shape in such a way that one left near infrared point light source 201 is placed right above, and one left near infrared point light source 201 is placed every 45 ° apart. In this embodiment, the left near infrared point light source 201 is an LED lamp, and the emission wavelength is 940nm.

The left semi-transparent and semi-reflective lens 3 is a plane lens, is connected with the left lens frame 2 and is fixed in relative position, and has an included angle theta with the plane of the left lens frame 2, which is more than 0 DEG and less than or equal to 45 DEG, and can transmit visible light and reflect near infrared light. The left near infrared camera 4 is connected with the left mirror frame 2 and has a fixed relative position, and left eye images can be shot through reflection of the left semi-transparent semi-reflective lens 3. The included angle between the central axis of the left near infrared camera 4 and the plane of the left lens frame 2 is 90-2 theta, the intersection point of the central axis of the left near infrared camera 4 and the left semi-transparent semi-reflective lens 3 is O ₁, a straight line passing through O ₁ and perpendicular to the plane of the left lens frame 2 passes through the circle center of the circle of the left lens frame 3, and the left near infrared camera 4 can shoot left eye images through infrared light reflected by the left semi-transparent semi-reflective lens 3. In the present embodiment, θ=30°.

The right mirror frame 5 is circular, N right near infrared point light sources 501 are evenly distributed on one side of the right mirror frame 5 facing eyes, the right near infrared point light sources 501 can emit near infrared light to irradiate the right eyes, N is more than or equal to 8, and the distances between the N right near infrared point light sources 501 are equal. The right mirror frame 5 is connected with the casing 1, and the relative positions of the right mirror frame 5 and the casing 1 are adjustable. The right frame 5 is provided with a clamping groove, and various round vision correction lenses, such as a myopia lens, a hyperopia lens or a strabismus correction lens, or any lens can be installed. The N right near infrared point light sources 501 on the right frame 5 function similarly to the N left near infrared point light sources 201 on the left frame 2. In this embodiment, the number of right near infrared point light sources 501 on the right frame 5 is 8, and the 8 right near infrared point light sources 501 are arranged in a circular shape, wherein one right near infrared point light source 501 is arranged right above the right frame, and one right near infrared point light source 501 is arranged at each interval of 45 °. In this embodiment, the right near infrared point light source 501 is an LED lamp, and the emission wavelength is 940nm.

The right semi-transparent and semi-reflective lens 6 is a plane lens, is connected with the right lens frame 5 and is fixed in relative position, and has an included angle theta with the plane of the right lens frame 5 of more than 0 DEG and less than or equal to 45 DEG, and can transmit visible light and reflect near infrared light. The right near infrared camera 7 is connected with the right mirror frame 5 and is fixed in relative position, and a right eye image can be shot through reflection of the right semi-transparent semi-reflective lens 6. The included angle between the central axis of the right near infrared camera 7 and the plane of the right mirror frame 5 is 90 degrees to 2 degrees. Let the intersection point of the central axis of the right near infrared camera 7 and the right semi-transparent semi-reflective lens 6 be O ₂, the straight line passing through O ₂ and being perpendicular to the plane of the right mirror frame 5 passes through the circle center of the circle of the right mirror frame 5, and the right near infrared camera 7 can shoot the right eye image through the infrared light reflected by the right semi-transparent semi-reflective lens 6. In the present embodiment, θ=30°.

The display module 9 may display the content of visual detection or visual training, which may be a display device such as a display, a television, or a projection device, or may be a projection device provided on the casing 1. The display, television, projection, etc. may be a general flat display device or a polarization type or shutter type stereoscopic display device. The projection device arranged on the casing 1 can be a laser projection device based on DOE diffraction optics, and can project one or more light spots or patterns with other specific shapes on a curtain or a wall surface or other plane with a distance of 30cm to 6 m.

The controllable covering module is connected with the casing 1 and is divided into a left covering module 801 and a right covering module 802, the left covering module 801 is positioned on the outer side of the left semi-transparent semi-reflective lens 3, and the right covering module 802 is positioned on the outer side of the right semi-transparent semi-reflective lens 6. The left eye can see or not see the content displayed by the display module 9 through the control of the left covering module 801 or the display module 9 by the control module; the control module controls the right covering module 802 or the display module 9, so that the right eye can see or not see the content displayed by the display module 9. At any one time, at least one of the left eye and the right eye sees the content displayed by the display module 9.

The left cover module 801 and the right cover module 802 in the controllable cover module may be two liquid crystal shutter devices, which may be transparent when powered on and opaque when not powered on; or opaque when energized and transparent when not energized. The left covering module 801 and the right covering module 802 can control whether the left covering module 801 and the right covering module 802 are electrified or not through the control module, and respectively control the transparency or the opacity of the left covering module and the right covering module, so that an image displayed by the left-eye visible display module 9 only, an image displayed by the right-eye visible display module 9 only, or an image displayed by the two-eye visible display module 9 are realized.

The left and right cover modules 801, 802 in the controllable cover module may also be two polarizers that are transparent to different types of polarization. For example, left cover module 801 is a horizontally oriented linear polarized lens and right cover module 802 is a vertically oriented linear polarized lens. When the control module controls the display module 9 to enable the displayed image to be linearly polarized light in the horizontal direction, only the left eye can see the image displayed by the display module 9; when the control module controls the display module 9 to enable the displayed image to be linearly polarized light in the vertical direction, only the right eye can see the image displayed by the display module 9; when the control module controls the display module 9 so that the displayed image contains both linearly polarized light in the horizontal direction and linearly polarized light in the vertical direction, the image displayed by the display module 9 is visible to both eyes.

The left cover module 801 and the right cover module 802 in the controllable cover module may also be two bandpass filters that are transparent to different wavelengths of visible light. For example, the left mask module 801 is transparent only to green light having a center wavelength λ ₁, and the right mask module 802 is transparent only to red light having a center wavelength λ ₂. When the control module controls the display module 9 to display a green image, only the left eye can see the green image; when the control module controls the display module 9 to display the red light image, only the right eye can see the red light image; when the control module controls the display module 9 to display an image composed of a mixture of red light and green light, both left and right eyes can see the image.

The casing 1 is used for connecting or fixing the left mirror frame 2, the left semi-transparent semi-reflective lens 3, the left near infrared camera 4, the right mirror frame 5, the right semi-transparent semi-reflective lens 6, the right near infrared camera 7, the controllable covering module and other parts. The housing 1 may be of an open construction with only brackets connecting or fixing the individual components. The structure can also be a closed structure, can shade lateral light rays and has the function of dust prevention. The casing 1 of the embodiment is of a closed structure and is composed of a side material and a front material, wherein the side material is not transparent to visible light and not transparent to near infrared light; the front material of which is transparent to visible light. The casing 1 is externally covered with a left mirror frame 2, a left semi-transparent semi-reflective lens 3, a left near infrared camera 4, a right mirror frame 5, a right semi-transparent semi-reflective lens 6, a right near infrared camera 7, a controllable covering module and the like. Since the front material of the casing 1 is transparent, the casing 1 does not block the view in front of the human eyes. Meanwhile, because the side surface material of the casing 1 is opaque, external visible light and near infrared light cannot irradiate in through a gap between the left eye and the left lens frame 2 or a gap between the right eye and the right lens frame 5, and interference of external near infrared light on imaging of the left near infrared camera 4 or the right 1 near infrared camera 7 can be avoided. The housing 1 makes the whole apparatus more attractive and reduces the influence of dust on the internal more precise optical and electronic devices. Fig. 2 is a schematic view of a front display module 9, which is worn by a subject and is shown in the device, the casing 1 is of a closed structure, and is fixed to the head of the subject by using a T-shaped headband.

In this embodiment, the apparatus further comprises an electronic computer, and the program required for the control module to run runs on the electronic computer. In addition, in order that the doctor can observe the eye image of the subject in real time, the eye images shot by the left near infrared camera 4 and the right near infrared camera 7 can be transmitted to the computer in real time through the USB line, and can be displayed in real time through the display, and the images and the data can be stored in the database of the computer. The electronic computer can also supply power to devices such as a near infrared light source of the equipment through a USB wire.

The electronic computer comprises an image processing algorithm module, and the pupil center position and the cornea reflection point center position of the eye can be calculated in real time as a computer program. Taking the left eye image captured by the left near infrared camera 4 as an example, as shown in fig. 3, when the left eye is looking forward, the pupil and 8 cornea reflection points can be captured. Because the pupil has a lower gray level, the gray level is lower than 50; and the grayscales of the cornea reflection points are higher, and the grayscales are higher than 200. According to this feature, the image processing algorithm module finds a connected region having a grayscale below 50 and being nearly circular from the image as a pupil region, and finds a connected region having a grayscale above 200 and being positioned near the pupil region from the image as a corneal reflection point. According to the connected region of the pupil region of the left eye, calculating the average coordinate value of the connected region to obtain the center coordinate of the pupil of the left eye. From the connected areas of the 8 cornea reflection points of the left eye, the centers of the 8 connected areas are calculated, respectively, and the average value of the center coordinates of the 8 cornea reflection points is referred to as "left eye cornea reflection point center coordinates". In the same way, the "right eye pupil center coordinates" and "right eye cornea reflection point center coordinates" of the right eye can be obtained from the right eye image captured by the right near infrared camera 7.

Taking the direction of eye movement of the left eye and eye movement point calculation as an example. When the left eye looks right ahead, 8 cornea reflection points can all be detected, and the center coordinates of the pupils of the left eye and the center coordinates of the cornea reflection points of the left eye can be overlapped by adjusting the relative positions of the left eye frame 2 and the left eye. The cornea reflection point right above the pupil is taken as a reflection point I when the left eye looks at the middle point, and the other seven reflection points are sequentially numbered as a reflection point II, a reflection point III, a reflection point IV, a reflection point five, a reflection point six, a reflection point seven and a reflection point eight in a clockwise direction. When the left eye looks at other positions than the right front, the left eye pupil center coordinates and the left eye cornea reflection point center coordinates cannot coincide, and when the angle of view is large, such as when looking at four sides and four corners, 8 cornea reflection points may not be all detected, but at least 3 cornea reflection points may be detected. As shown in fig. 4, 9 images are left eye images captured by the left near infrared camera when a subject looks at 9 square points of the upper left corner, upper right corner, middle right corner, lower left corner, lower right corner, and lower right corner. When the left-eye pupil center coordinates and the left-eye cornea reflection point center coordinates do not coincide, 3 consecutive reflection points nearest to the pupil center are set as selected reflection points. The number of the selected reflection point may be determined based on the orientation of the obtuse angle of the triangle formed by the three selected reflection points. The specific method comprises the following steps: if the direction of the obtuse angle is approximately right above, the numbers of the three selected reflection points are eight reflection points, one reflection point and two reflection points clockwise in sequence; if the obtuse angle points to the approximate upper right, the numbers of the three selected reflection points are a first reflection point, a second reflection point and a third reflection point clockwise in sequence; if the obtuse angle points to the right of the approximate level, the numbers of the three selected reflection points are a second reflection point, a third reflection point and a fourth reflection point clockwise in sequence; if the obtuse angle points to the approximate lower right, the numbers of the three selected reflection points are a reflection point III, a reflection point IV and a reflection point V in turn clockwise; if the obtuse angle points to approximately right below, the numbers of the three selected reflection points are a reflection point IV, a reflection point V and a reflection point VI in turn clockwise; if the obtuse angle points to the approximate lower left, the numbers of the three selected reflection points are a reflection point five, a reflection point six and a reflection point seven in turn clockwise; if the obtuse angle points to the right and left of the approximate level, the numbers of the three selected reflection points are a reflection point six, a reflection point seven and a reflection point eight in turn clockwise; if the obtuse angle points to approximately the upper left, the numbers of the three selected reflection points are the reflection point seven, the reflection point eight and the reflection point one in turn clockwise. Wherein obtuse pointing is the direction from the bottom to the top of the obtuse midline.

The device also comprises a calibration-free eyeball movement direction judging module which is a program running on a computer, and the algorithm principle is as follows: when the center coordinates of the pupils of the left eye and the average coordinates of the left near infrared point light sources 201 do not coincide (if the viewing angle is too large to detect 8 cornea reflection points, the coordinates are considered to be misaligned), the direction of the eye movement of the left eye is judged according to the direction of the obtuse angle of the triangle formed by the 3 left eye selected reflection points; when the center coordinates of the pupils of the right eye and the average coordinates of the right near infrared point light sources 501 do not coincide, the direction of the movement of the eyeball of the right eye is judged according to the direction of the obtuse angle of the triangle formed by the 3 selected reflection points of the right eye.

The device also comprises a monocular calibration module and an eye movement point calculation module which can quantitatively calculate the eye movement point position, and the monocular calibration module and the eye movement point calculation module are programs running on a computer, and the algorithm principle is as follows: when the left eye is in monocular calibration, only the left eye can be used for calibrating the sighting mark, and the eye movement point of the left eye can be quantitatively calculated through the monocular calibration of the left eye from 2 points to 9 points; when the right eye single eye is calibrated, only the right eye can calibrate the visual target, and the eye movement point of the right eye can be quantitatively calculated through the right eye single eye calibration from 2 points to 9 points.

When defining the "calibration vector" as the eye's midpoint of vision, the relative positions of the 8 corneal glints and the pupil center. The "eye movement vector" is defined as the average value of the coordinate differences of the 3 selected reflection points and the corresponding 3 reflection points in the "calibration vector". The "eye movement vector" represents the relative displacement of the pupil and the glistening point in the eye image captured by the left near-infrared camera 4 or the right near-infrared camera 7 when the user's eye moves on the display screen at the point of gaze. In order to accurately calculate the one-to-one correspondence between the eye movement vector and the eye movement point position, calibration can be performed in a data fitting mode, and the number of calibration points is generally 2 to 9 points. Taking a 9-point monocular calibration of the left eye and a left eye movement point calculation as an example:

Let the left eye look at the index points of 9 positions of the upper left corner, upper right corner, left right, middle right, lower left corner, lower right corner, the coordinates of the index points on the plane of the display module 9 are known. Let x _s be the abscissa of the eye movement point on the display plane, and y _s be the ordinate of the eye movement point on the display plane; x _e is the abscissa of the eye movement vector and y _e is the ordinate of the eye movement vector.

The following calibration functions were used:

a₀、a₁、a₂、a₃、a₄、a₅、b₀、b₁、b₂、b₃、b₄、b₅ These 12 values are not known prior to calibration. Calibration is the process of solving these 12 unknowns.

Since the coordinates (x_s1,y_s1)、(x_s2,y_s2)、(x_s3,y_s3)、(x_s4,y_s4)、(x_s5,y_s5)、(x_s6,y_s6)、(x_s7,y_s7)、(x_s8,y_s8)、(x_s9,y_s9) of the 9 calibration points on the display plane are known. The left eye image shot by the left near infrared camera 4 can be calculated, and eye motion vectors of the left eye when looking at the 9 calibration targets are (x_e1,y_e1)、(x_e2,y_e2)、(x_e3,y_e3)、(x_e4,y_e4)、(x_e5,y_e5)、(x_e6,y_e6)、(x_e7,y_e7)、(x_e8,y_e8)、(x_e9,y_e9). substituted into the calibration function respectively, so that an equation set consisting of the following 18 equations can be obtained:

Because the equation number is larger than the number of unknown variables, the least square solution is needed to be calculated according to the least square solution overdetermined equation set a₀、a₁、a₂、a₃、a₄、a₅、b₀、b₁、b₂、b₃、b₄、b₅.

After the left eye monocular calibration is finished, since a₀、a₁、a₂、a₃、a₄、a₅、b₀、b₁、b₂、b₃、b₄、b₅ is solved into a known value, when the examinee looks at any position of the display module, the eye movement point calculation module can calculate the left eye movement vector (x _e,y_e) in real time, and the coordinates (x _s,y_s) of the position of the examinee looking at the left eye of the display module, namely the left eye movement point coordinates, can be calculated in real time by substituting the calibration function. A similar method may perform right eye monocular calibration and calculate right eye movement point coordinates.

Taking a process of strabismus inspection of a subject through the device as an example, the specific steps are as follows:

(1) The doctor wears the device to the subject. In this embodiment, the left covering module 801 and the right covering module 802 in the controllable covering module are liquid crystal shutter devices, and the oblique view examination optotype is projected onto the front curtain through the head-mounted projection device. The subject faces the curtain at a distance of 5 meters.

(2) The relative positions of the left mirror frame 2 and the left eye are adjusted to enable the center coordinates of the pupils of the left eye and the center coordinates of the reflection points of the cornea of the left eye to coincide. The specific method comprises the following steps: the left covering module 801 is transparent, the right covering module 802 is opaque, and the head-mounted projection device projects a visual target on a curtain right in front of the testee, wherein the visual target is positioned right in front of the vision of the testee, so that the left eye of the testee looks at the visual target; taking the horizontal directions of the left near infrared camera 4 and the photographed image as an X axis and the up-down direction as a Y axis; the left and right positions of the left lens frame 2 are adjusted to enable the X coordinate of the center coordinate of the left eye pupil and the X coordinate of the center coordinate of the left eye cornea reflecting point shot by the left near infrared camera 4 to coincide, and the upper and lower positions of the left lens frame 2 are adjusted to enable the Y coordinate of the center coordinate of the left eye pupil and the Y coordinate of the center coordinate of the left eye cornea reflecting point shot by the left near infrared camera 4 to coincide. The adjustment mode can be manual adjustment through a knob and the like, and also can be automatically adjusted through a micro motor. When the automatic adjustment is performed, if the center coordinate of the pupil of the left eye shot by the left near infrared camera 4 is on the nose side of the average coordinate of the left near infrared point light source 201, the left lens frame 2 is driven by the micro motor to move to the nose side relative to the shell 1, and if the center coordinate of the pupil of the left eye is on the temporal side of the average coordinate of the left near infrared point light source 201, the left lens frame 2 is driven by the micro motor to move to the temporal side relative to the shell 1 until the X coordinate of the center coordinate of the pupil of the left eye and the X coordinate of the center coordinate of the reflecting point of the left cornea coincide; if the center coordinates of the pupils of the left eye photographed by the left near infrared camera 4 are on the upper side of the average coordinates of the left near infrared point light sources 201, the left mirror frame 2 is driven to move upwards relative to the left eye by the micro motor, and if the center coordinates of the pupils of the left eye are on the lower side of the center coordinates of the reflective points of the left eye, the left mirror frame 2 is driven to move downwards relative to the left eye by the micro motor until the Y coordinates of the center coordinates of the pupils of the left eye and the Y coordinates of the center coordinates of the reflective points of the left eye coincide.

(3) In a similar manner to the previous step, the right masking module 802 is made transparent, the left masking module 801 is opaque, the head-mounted projection device projects a target on the curtain directly in front of the subject, the target is positioned directly in front of the field of view of the subject, the right eye of the subject looks at the target, the relative positions of the right eye frame 5 and the right eye are adjusted, and the center coordinates of the pupil of the right eye and the center coordinates of the reflection point of the cornea of the right eye are overlapped.

(4) And (5) checking the display strabismus. The control module makes the left covering module 801 and the right covering module 802 in the controllable covering module transparent, the head-mounted projection device projects a visual target on a curtain right in front of the testee, the visual target is positioned right in front of the vision field of the testee, eyes can both see the visual target in front, and if the pupil center coordinate of one eye is not coincident with the cornea reflection point center coordinate of the eye, the calibration-free strabismus inspection module judges that strabismus is displayed. If the center coordinates of the pupils of the left eyes are coincident with the center coordinates of the reflection points of the left eye and the center coordinates of the pupils of the right eyes are coincident with the center coordinates of the reflection points of the right eye, the strabismus inspection module without calibration judges that strabismus is not displayed.

(5) And (5) checking the hidden strabismus. In the above step, if the calibration-free strabismus inspection module determines that there is no strabismus display, the control module keeps the left cover module 801 in the controllable cover module transparent, the right cover module 802 becomes opaque, and the head-mounted projection device projects a visual target on the curtain in front of the subject, the visual target is located in front of the field of view of the subject, and only the left eye can see the visual target. And if the center coordinates of the pupil of the right eye and the center coordinates of the reflecting point of the cornea of the right eye are not coincident at the moment, judging that the strabismus exists by the strabismus inspection module without calibration. Or the control module keeps the right covering module 802 transparent in the controllable covering module, the left covering module 801 becomes opaque, the head-mounted projection device projects a sighting target on a curtain right in front of the testee, the sighting target is located right in front of the vision of the testee, and only the right eye can see the sighting target. And if the center coordinates of the pupils of the left eyes and the center coordinates of the reflecting points of the left cornea are not coincident at the moment, judging that the strabismus exists by the strabismus inspection module without calibration.

In the step (4) and the step (5), the calibration-free eye movement direction judging module and the calibration-free strabismus checking module can be used for qualitatively judging whether strabismus and strabismus are displayed or not without calibration.

If the oblique visibility is required to be measured quantitatively, after the left eye and the right eye are calibrated in a single eye mode through the single eye calibration module and the eye movement point calculation module, the visual targets are displayed in different directions in front of the testee, and three modes of binocular visual targets, left eye visual targets only and right eye visual targets only are switched through controlling the controllable covering module. If the left eye movement point coincides with the position of the visual target when only the left eye sees the visual target, and the right eye movement point coincides with the position of the visual target when only the right eye sees the visual target, but the eye movement point of one eye does not coincide with the position of the visual target when the two eyes see the visual target, the oblique vision is judged to be displayed, and the oblique vision degree of the oblique vision is the visual angle difference value between the eye movement point and the position of the visual target. If the left eye movement point is overlapped with the position of the visual target when the eyes see the visual target, and the right eye movement point is overlapped with the position of the visual target, but the right eye movement point is not overlapped with the position of the visual target when only the left eye sees the visual target, or the left eye movement point is not overlapped with the position of the visual target when only the right eye sees the visual target, then the hidden strabismus is judged, and the strabismus degree of the hidden strabismus is the visual angle difference value between the eye movement point and the position of the visual target. When the strabismus inspection is performed, although the covered eyes cannot see the optotype, the eye movement point calculating module can still calculate the eye movement points of the covered eyes, so as to judge whether the eye movement points are overlapped with the optotype or not and calculate the visual angle difference value.

Besides strabismus, the device can be used for amblyopia training, binocular vision training and other visual detection and training related to eyeball movement.

Taking amblyopia training as an example, the device comprises an amblyopia training module, is a program running on a computer, and has the working principle that: the amblyopia training module displays an amblyopia training image on the display module 9, for example, a dynamic game image played on a polarization display, wherein the left eye of the trainer is the amblyopia eye, the right eye has normal vision, and the dynamic game image comprises interactive contents. Such as a game in which a gun is fired to fly a balloon, the left eye can see the gun through the left mask module 801 polarizer, and the left eye's eye-movement point is the center of gravity on the gun for aiming, and the right eye can see the balloon through the right mask module 802 polarizer. When the left eye's eye movement point falls on the balloon for more than 2 seconds, the balloon can be inflated. The game can display the game score according to the number of the explosion balloons, and the checkpoints with different difficulties are set, so that the interest of the trainee is increased, and a better training effect is achieved.

Taking binocular vision training as an example, the equipment comprises a binocular vision training module, is a program running on a computer, and has the following working principle: the binocular vision training module trains simultaneous vision by alternately displaying images visible to only the left eye and images visible to only the right eye in a time-sharing manner, and judges the simultaneous vision training effect by whether left eye moving points, right eye moving points and training content images are overlapped or not. The binocular vision training module trains the fusion vision by displaying images which are visible by both eyes at the same time, and judges the fusion vision training effect by whether the left eye movement point and the right eye movement point are overlapped. The binocular vision training module trains stereoscopic vision by displaying stereoscopic graphics with certain parallax between images visible to only left eyes and images visible to only right eyes, and judges stereoscopic vision training effects by the overlapping distance of left eye movement points and right eye movement points. For example, the stereoscopic vision training content is to play a table tennis ball, the table tennis ball and the racket are stereoscopic figures with certain parallax between left and right eyes, the table tennis ball flies from the opposite side to the near side, and when a trainer judges that the distance between the table tennis ball and the racket is close, the user can hit the table tennis ball by pressing a key of a handle. The overlapping distance of the left eye movement point and the right eye movement point is the intersection point of the left eye sight line and the right eye sight line, and the binocular vision training module judges the effect of the stereoscopic vision training by calculating the intersection point of the left eye sight line and the right eye sight line, the distance between the eyes and the display distance deviation of the virtual three-dimensional ball. If the distance deviation is small, the stereoscopic vision training effect is good, the difficulty of training games can be properly increased, for example, the ball speed is faster; if the distance deviation is larger, the difficulty of training games can be properly reduced, for example, the ball speed is slower, so that the effective stereoscopic vision training effect is ensured.

Example two

The embodiment discloses a wear-type visual inspection and vision training equipment, including casing 1, left picture frame 2, left half mirror 3, left near infrared camera 4, left near infrared point light source 11, right picture frame 5, left half mirror 6, right near infrared camera 7, right near infrared point light source 12, controllable covering module, control module, display module. Fig. 5 (a) is a plan view of a schematic device structure, and fig. 5 (b) is a front view of the schematic device structure.

The casing 1 is a head-mounted type, and the fixing device is fixed relative to the head, and the fixing device can be an annular or T-shaped head band or a helmet type fixing device.

The left mirror frame 2 is connected with the casing 1, and the relative positions of the left mirror frame 2 and the casing 1 are adjustable. The left mirror frame 1 is a central symmetrical figure, and in this embodiment is circular. The left frame 1 is provided with a clamping groove, and can be provided with various vision correction lenses, such as a near vision lens, a far vision lens or a strabismus correction lens, or can be provided with no lens.

The left semi-transparent and semi-reflective lens 3 is a plane lens, is connected with the left lens frame 2 and is fixed in relative position, and has an included angle theta with the plane of the left lens frame 2, which is more than 0 DEG and less than or equal to 45 DEG, and can transmit visible light and reflect near infrared light.

The left near infrared point light source left half mirror 11 is fixed at a relative position to the left mirror frame 2, and the emitted near infrared light irradiates the left eye by reflection of the left half mirror 3 and forms a reflection point at the left eye cornea. A connecting line of the left near infrared point light source 11 at the symmetrical center of the virtual image of the left semi-transparent semi-reflecting lens 3 and the left mirror frame 2 is L ₁,L₁ vertical to the plane of the left mirror frame 2; let the intersection point of L ₁ and left semi-transparent semi-reflecting lens 3 be O ₃, the included angle between the connection line of left near infrared point light source 11 and O ₃ and the plane of left mirror frame 2 is 90-2 theta. The left near infrared point light source 11 is used for providing illumination for shooting a left eye image by the left near infrared camera 4, and in addition, a reflection point of the left near infrared point light source 11 on a cornea of a left eye can be used as a reference point for calculating the movement of an eyeball of the left eye. In this embodiment, the left near infrared point light source 11 is an LED lamp, and the emission wavelength is 940nm.

The left near infrared camera 4 is positioned on the side face of the left near infrared point light source 11, and the distance between the left near infrared point light source 11 and the left near infrared point light source is less than or equal to 2.5cm. The left near infrared camera 4 can shoot left eye images through reflection of the left semi-transparent semi-reflective lens 3, and an included angle between the central axis of the left near infrared camera 4 and the plane of the left mirror frame 2 is 90-2 theta.

The right mirror frame 5 is connected with the casing 1, and the relative positions of the right mirror frame 5 and the casing 1 are adjustable. The right frame 5 is a center symmetrical pattern, which is circular in this embodiment. The right frame 5 has a groove, and may be provided with or without a vision correction lens, such as a near vision lens, a far vision lens, or a strabismus correction lens.

The right semi-transparent and semi-reflective lens 6 is a plane lens, is connected with the right lens frame 5 and is fixed in relative position, and has an included angle theta with the plane of the right lens frame 5 of more than 0 DEG and less than or equal to 45 DEG, and can transmit visible light and reflect near infrared light.

The right near infrared point light sources 12 are fixed at a relative position to the right mirror frame 5, and the emitted near infrared light irradiates the right eye by reflection of the right half mirror 6 to form reflection points at the right eye cornea. The connection line of the virtual image of the right near infrared point light source 12 on the right semi-transparent semi-reflecting lens 6 and the symmetrical center of the right mirror frame 5 is L ₂,L₂ vertical to the plane of the right mirror frame 5; the intersection point of the L ₂ and the right semi-transparent semi-reflecting lens 6 is set as O ₄, and the included angle between the connecting line of the right near infrared point light source 12 and O ₄ and the plane of the right mirror frame 5 is set as 90-2 theta. The right near infrared point light source 12 is used for providing illumination for shooting a right eye image by the right near infrared camera 7, and in addition, a reflection point of the right near infrared point light source 12 on a right eye cornea can be used as a reference point for calculating the movement of a right eye eyeball. In this embodiment, the right near infrared point light source 12 is an LED lamp, and the emission wavelength is 940nm.

The right near infrared camera 7 is positioned on the side surface of the right near infrared point light source 12, and the distance between the right near infrared point light source 12 and the right near infrared camera is less than or equal to 2.5cm; the right eye image can be shot through the reflection of the right semi-transparent semi-reflecting lens 6, and the included angle between the central axis of the right near infrared camera 7 and the plane of the right mirror frame 5 is 90-2 theta.

The display module can display the content of visual detection or visual training, and can be a display device such as a display, a television, a projection and the like, and can also be a projection device arranged on the casing 1. The display, television, projection, etc. may be a common flat display device, or may be a polarized or shutter type stereoscopic display device. The projection device arranged on the casing 1 can be a laser projection device based on DOE diffraction optics, and can project one or more light spots or patterns with other specific shapes on a curtain or a wall surface or other plane with a distance of 30cm to 6 m.

The controllable module of covering is connected with the casing, falls into left module of covering 801 and right module of covering 802, and left module of covering 801 is located the outside of left half mirror 3, and right module of covering 802 is located the outside of right half mirror 6. The left covering module 801 or the display module is controlled by the control module, so that the left eye can see or not see the content displayed by the display module; the control module controls the right covering module 802 or the display module, so that the right eye can see or not see the content displayed by the display module. At any one time, at least one of the left eye and the right eye can see the content displayed by the display module. The left cover module 801 and the right cover module 802 in the controllable cover module may be two liquid crystal shutter devices, may be two polarizing plates that can transmit different types of polarized light, and may be two bandpass filters that can transmit different wavelengths of visible light.

The casing 1 is connected or fixed with a left lens frame 2, a left semi-transparent semi-reflecting lens 3, a left near infrared camera 4, a left near infrared point light source 11, a right lens frame 5, a right semi-transparent semi-reflecting lens 6, a right near infrared camera 7, a right near infrared point light source 12, a controllable covering module and other components, and can be worn on the head.

In this embodiment, the apparatus further comprises an electronic computer, and the program required for the control module to run runs on the electronic computer. In addition, in order that the doctor can observe the eye image of the subject in real time, the eye images shot by the left near infrared camera 4 and the right near infrared camera 7 can be transmitted to the computer in real time through the USB line, and can be displayed in real time through the display, and the images and the data can be stored in the database of the computer. The electronic computer can also supply power to devices such as near infrared point light sources of the equipment through USB wires.

The electronic computer comprises an image processing algorithm module, and the pupil center coordinate of the eye and the near infrared point light source cornea reflection point coordinate can be calculated in real time as a computer program. Taking the left eye image captured by the left near infrared camera 4 as an example, as shown in fig. 6, when the left eye is looking forward, the pupil and the reflection point of the left near infrared point light source on the cornea can be captured. Because the pupil has a lower gray level, the gray level is lower than 50; and the grayscales of the cornea reflection points are higher, and the grayscales are higher than 200. According to this feature, the image processing algorithm module finds a connected region having a grayscale below 50 and being nearly circular from the image as a pupil region, and finds a connected region having a grayscale above 200 and being positioned near the pupil region from the image as a corneal reflection point. According to the connected region of the pupil region of the left eye, calculating the average coordinate value of the connected region to obtain the center coordinate of the pupil of the left eye. Center coordinates of the cornea reflection points are calculated according to the communication areas of the cornea reflection points, and the center coordinates are called as left near infrared point light source cornea reflection point coordinates. In the same way, the "right eye pupil center coordinates" and the "right near infrared point light source cornea reflection point coordinates" of the right eye can be obtained by the right eye image shot by the right near infrared camera 7.

When the left eye looks right ahead, the left near infrared camera 4 can shoot the pupil center coordinate of the left eye and the cornea reflection point coordinate of the left near infrared point light source 11, because the virtual image of the left near infrared point light source 11 reflected by the left half-mirror 3 is positioned right ahead of the left eye, and the left near infrared camera 3 is positioned close to the left near infrared point light source 11, the pupil center coordinate of the left eye and the cornea reflection point coordinate of the left near infrared point light source 11 shot by the left near infrared camera 4 coincide according to the principle of cornea reflection method. By adjusting the relative positions of the left mirror frame 2 and the left eye, the center coordinates of the pupil of the left eye and the center coordinates of the reflection point of the left cornea of the left eye can be overlapped. When the right eye looks right ahead, the right near infrared camera 7 can shoot the pupil center coordinate of the right eye and the cornea reflection point coordinate of the right near infrared point light source, because the virtual image of the right near infrared point light source 12 reflected by the right half mirror 6 is positioned right ahead of the right eye, and the right near infrared camera 7 is positioned close to the right near infrared point light source 12, the pupil center coordinate of the right eye shot by the right near infrared camera 7 coincides with the cornea reflection point coordinate of the right near infrared point light source 12 according to the principle of cornea reflection method. By adjusting the relative positions of the right mirror frame 5 and the right eye, the center coordinates of the pupil of the right eye and the center coordinates of the reflection point of the cornea of the right eye can be overlapped.

The device comprises a calibration-free eyeball movement direction judging module, which is a program running on a computer, and the algorithm principle is as follows: when the left eye looks in other directions except the right front direction, the center coordinates of the left eye pupil and the center coordinates of the left eye cornea reflecting points are not overlapped, and the direction of the center coordinates of the left eye cornea reflecting points pointing to the center coordinates of the left eye pupil is the movement direction of the left eye eyeball. When the right eye looks in other directions except the right front direction, the center coordinates of the pupil of the right eye and the center coordinates of the reflection points of the cornea of the right eye are not overlapped, and the direction of the center coordinates of the reflection points of the cornea of the right eye pointing to the center coordinates of the pupil of the right eye is the movement direction of the eyeball of the right eye.

The device also comprises a monocular calibration module and an eye movement point calculation module which can quantitatively calculate the eye movement point position, and the monocular calibration module and the eye movement point calculation module are programs running on a computer, and the algorithm principle is as follows: when the left eye is in monocular calibration, only the left eye can be used for calibrating the sighting mark, and the eye movement point of the left eye can be quantitatively calculated through the monocular calibration of the left eye from 2 points to 9 points; when the right eye single eye is calibrated, only the right eye can calibrate the visual target, and the eye movement point of the right eye can be quantitatively calculated through the right eye single eye calibration from 2 points to 9 points. Taking a 9-point monocular calibration of the left eye and a left eye movement point calculation as an example: the left eye "eye movement vector" is defined as the difference between the center coordinates of the pupil of the left eye and the center coordinates of the reflecting point of the cornea of the left eye. Fig. 7 shows left eye images captured by the left near infrared camera 4 when a subject looks at 9 square points of the upper left corner, the upper right corner, the middle, the right corner, the lower left corner, the lower right corner, and the upper right corner, and the left pupil center coordinates and the left near infrared point light source 11 cornea reflection point coordinates can be calculated by the image processing algorithm module. In order to accurately calculate the one-to-one correspondence between the eye movement vector and the eye movement point position, calibration can be performed in a data fitting mode, and the number of calibration points is generally 2 to 9 points. The calibration method is similar to that of the embodiment. After the left eye monocular calibration and the right eye monocular calibration are completed, the left eye movement vector is substituted into the left eye calibration function, the right eye movement vector is substituted into the right eye calibration function, and the left eye movement point coordinates and the right eye movement point coordinates of the tested person are calculated in real time.

(2) The relative positions of the left lens frame 2 and the left eye are adjusted to enable the center coordinates of the pupils of the left eye to coincide with the coordinates of the cornea reflection points of the left near infrared point light source 11. The specific method comprises the following steps: the left covering module 801 is transparent, the right covering module 802 is opaque, and the head-mounted projection device projects a visual target on a curtain right in front of the testee, wherein the visual target is positioned right in front of the vision of the testee, so that the left eye of the testee looks at the visual target; taking the horizontal directions of the left near infrared camera 4 and the photographed image as an X axis and the up-down direction as a Y axis; the left and right positions of the left lens frame 2 are adjusted to enable the X coordinate of the center coordinate of the left eye pupil shot by the left near infrared camera 4 to coincide with the X coordinate of the cornea reflection point coordinate of the left near infrared point light source 11, and the upper and lower positions of the left lens frame 2 are adjusted to enable the Y coordinate of the center coordinate of the left eye pupil shot by the left near infrared camera 4 to coincide with the Y coordinate of the cornea reflection point coordinate of the left near infrared point light source 11. The adjustment mode can be manual adjustment through a knob and the like, and also can be automatically adjusted through a micro motor. When the automatic adjustment is performed, if the center coordinate of the left eye pupil photographed by the left near infrared camera 11 is on the nose side of the cornea reflecting point coordinate of the left near infrared point light source 11, the left eye mirror frame 2 is driven by the micro motor to move to the nose side relative to the machine shell 1, and if the center coordinate of the left eye pupil is on the temporal side of the cornea reflecting point coordinate of the left near infrared point light source 11, the left eye mirror frame 2 is driven by the micro motor to move to the temporal side relative to the machine shell 1 until the X coordinate of the center coordinate of the left eye pupil coincides with the X coordinate of the cornea reflecting point coordinate of the left near infrared point light source 11; if the center coordinates of the pupil of the left eye shot by the left near infrared camera 4 are above the coordinates of the cornea reflecting point of the left near infrared point light source 11, the left lens frame 2 is driven by the micro motor to move upwards relative to the left eye, and if the center coordinates of the pupil of the left eye are below the coordinates of the cornea reflecting point of the left near infrared point light source 11, the left lens frame 2 is driven by the micro motor to move downwards relative to the left until the Y coordinates of the cornea reflecting point of the left near infrared point light source 11 and the Y coordinates of the center coordinates of the cornea reflecting point of the left eye are coincident.

(4) And (5) checking the display strabismus. The control module makes the left covering module 801 and the right covering module 802 in the controllable covering module transparent, the head-mounted projection device projects a visual target on a curtain right in front of the testee, the visual target is positioned right in front of the vision field of the testee, and eyes can both see the visual target, if the pupil center coordinate of one eye is not overlapped with the cornea reflection point coordinate of the left near infrared point light source 11 or the right near infrared point light source 12 of the eye, the calibration-free strabismus checking module judges that strabismus is displayed. If the center coordinates of the left eye pupil and the cornea reflecting point coordinates of the left near infrared point light source 11 coincide, and the center coordinates of the right eye pupil and the cornea reflecting point coordinates of the right near infrared point light source 12 coincide, the strabismus inspection module without calibration judges that strabismus is not displayed.

(5) And (5) checking the hidden strabismus. In the last step, if the calibration-free strabismus inspection module judges that no strabismus is displayed, the control module enables the left covering module 801 in the controllable covering module to be transparent, the right covering module becomes 802 opaque, the head-mounted projection device projects a sighting target on a curtain right in front of the testee, the sighting target is located right in front of the vision of the testee, and only the left eye can see the sighting target. If the center coordinates of the pupil of the right eye and the coordinates of the cornea reflection point of the right near infrared point light source 12 are not coincident at the moment, the strabismus inspection module without calibration judges that strabismus exists. Or the control module keeps the right covering module 802 in the controllable covering module transparent, the left covering module becomes 801 opaque, the head-mounted projection device projects a sighting target on a curtain right in front of the testee, the sighting target is located right in front of the vision of the testee, and only the right eye can see the sighting target. If the center coordinates of the pupils of the left eyes and the coordinates of the cornea reflecting points of the left near infrared point light source 11 are not coincident at the moment, the strabismus inspection module without calibration judges that strabismus exists.

Besides strabismus, the device can be used for amblyopia training, binocular vision training and other visual detection and training related to eyeball movement. The amblyopia training module is a program running on a computer, and the working principle is as follows: the amblyopia training images displayed by the display module contain interactive contents, and the trainee interacts through eye movement points of amblyopia eyes. The binocular vision training module is a program running on a computer and comprises simultaneous vision, fusion vision and stereoscopic vision training contents, and the working principle is as follows: training the simultaneous vision by alternately displaying images visible to only the left eye and images visible to only the right eye in a time-sharing manner, and judging the simultaneous vision training effect by whether left eye movement points, right eye movement points and training content images are overlapped or not; training the fusion vision by displaying images which are visible by both eyes at the same time, and judging the training effect of the fusion vision by whether the left eye movement point is overlapped with the right eye movement point; the stereoscopic vision is trained by displaying a stereoscopic image with a certain parallax between an image visible to only the left eye and an image visible to only the right eye, and the stereoscopic vision training effect is judged by the overlapping distance of the left eye moving point and the right eye moving point.

Claims

1. A head-mounted visual inspection and visual training device is characterized by comprising,

A display module;

A control module;

The relative positions of the left mirror frame and the left eye are adjusted by adopting the following method:

Taking the horizontal direction of an image shot by the left near infrared camera as an X axis and the up-down direction as a Y axis; when the front of the left eye is seen, the X coordinate of the center coordinate of the pupil of the left eye shot by the left near infrared camera is overlapped with the X coordinate of the center coordinate of the reflecting point of the left eye by adjusting the left and right positions of the left eye frame, and the Y coordinate of the center coordinate of the pupil of the left eye shot by the left near infrared camera is overlapped with the Y coordinate of the center coordinate of the reflecting point of the left eye by adjusting the upper and lower positions of the left eye frame

Taking the horizontal direction of an image shot by the right near infrared camera as an X axis and the up-down direction as a Y axis; when the right eye looks ahead, the X coordinate of the center coordinate of the pupil of the right eye shot by the right near infrared camera is overlapped with the X coordinate of the center coordinate of the reflection point of the right eye by adjusting the left and right positions of the right eye frame, and the Y coordinate of the center coordinate of the pupil of the right eye shot by the right near infrared camera is overlapped with the Y coordinate of the center coordinate of the reflection point of the right eye by adjusting the upper and lower positions of the right eye frame;

2. The head-mounted visual inspection and visual training device according to claim 1, wherein 8 left near infrared point light sources are distributed on the side of the left glasses frame facing eyes, the 8 left near infrared point light sources are arranged in a circular shape with equal intervals, one left near infrared point light source is arranged right above the left glasses frame, and one left near infrared point light source is arranged at intervals of 45 degrees;

3. The head mounted vision inspection and vision training apparatus of claim 1, wherein the left frame has circular vision correcting lenses mounted thereon; the right glasses frame can be provided with a round vision correcting lens.

4. A head-mounted vision inspection and vision training apparatus as claimed in claims 1 to 3, further comprising a micro motor, the pupil distance adjustment being an automatic adjustment, comprising the steps of:

5. The head-mounted vision detection and vision training device according to any one of claims 1 to 4, wherein the left cover module of the controllable cover module is a liquid crystal shutter device, and the control module controls whether the control module is powered on or not, and is transparent when powered on and opaque when not powered on; or opaque when energized and transparent when not energized; the right covering module in the controllable covering module is a liquid crystal shutter device, the control module controls whether the liquid crystal shutter device is electrified or not, and the liquid crystal shutter device is transparent when electrified and opaque when not electrified; or opaque when energized and transparent when not energized;

6. The head mounted visual inspection and training device of any one of claims 1 to 5, wherein the housing is comprised of a side material and a front material; the side surface material of the shell is not transparent to visible light and near infrared light; the front material of the shell transmits visible light; the shell covers the left mirror frame, the left semi-transparent semi-reflective lens, the left near-infrared camera, the right mirror frame, the right semi-transparent semi-reflective lens, the right near-infrared camera and the controllable covering module from the outside; the casing does not block the front view of the eyes of the person, and simultaneously, external visible light and near infrared light cannot irradiate in through a gap between the left eye and the left lens frame or a gap between the right eye and the right lens frame.

7. The head-mounted vision inspection and vision training apparatus according to any one of claims 1 to 6, wherein a projection device is provided on the cabinet, and a pattern is projected on a front plane by the projection device.

8. The head mounted vision inspection and vision training device of any one of claims 1-7, further comprising a calibration-free eye movement direction determination module:

9. The head-mounted vision inspection and vision training device of any one of claims 1-7, further comprising a monocular calibration module and an eye movement point calculation module:

10. The head-mounted visual inspection and visual training apparatus of claim 9, further comprising a calibration-free strabismus inspection module:

11. The head-mounted vision inspection and vision training device of claim 9, further comprising a strabismus inspection module:

12. The head-mounted vision inspection and vision training device of claim 9, further comprising a amblyopia training module: the amblyopia training images displayed by the display module contain interactive contents, and the trainee interacts through eye movement points of amblyopia eyes.

13. The head-mounted vision inspection and vision training device of claim 9, further comprising a binocular vision training module comprising simultaneous vision, fusion vision, stereoscopic vision training content, wherein: training the simultaneous vision by alternately displaying images visible to only the left eye and images visible to only the right eye in a time-sharing manner, and judging the simultaneous vision training effect by whether left eye movement points, right eye movement points and training content images are overlapped or not; training the fusion vision by displaying images which are visible by both eyes at the same time, and judging the training effect of the fusion vision by whether the left eye movement point is overlapped with the right eye movement point; the stereoscopic vision is trained by displaying a stereoscopic image with a certain parallax between an image visible to only the left eye and an image visible to only the right eye, and the stereoscopic vision training effect is judged by the overlapping distance of the left eye moving point and the right eye moving point.

14. A head-mounted vision inspection and vision training device, comprising:

A display module;

A control module;

Taking the horizontal direction of an image shot by the left near infrared camera as an X axis and the up-down direction as a Y axis; when the front of the left eye is seen, the X coordinate of the center coordinate of the left eye pupil shot by the left near infrared camera is overlapped with the X coordinate of the cornea reflecting point coordinate of the left near infrared point light source by adjusting the left and right positions of the left eye frame, and the Y coordinate of the center coordinate of the left eye pupil shot by the left near infrared camera is overlapped with the Y coordinate of the cornea reflecting point coordinate of the left near infrared point light source by adjusting the upper and lower positions of the left eye frame

Taking the horizontal direction of an image shot by the right near infrared camera as an X axis and the up-down direction as a Y axis; when the right eye looks ahead, the X coordinate of the center coordinate of the right eye pupil shot by the right near infrared camera is overlapped with the X coordinate of the cornea reflecting point coordinate of the right near infrared point light source by adjusting the left and right positions of the right eye frame, and the Y coordinate of the center coordinate of the right eye pupil shot by the right near infrared camera is overlapped with the Y coordinate of the cornea reflecting point coordinate of the right near infrared point light source by adjusting the upper and lower positions of the right eye frame;

15. The head mounted vision inspection and vision training apparatus of claim 14, wherein the left frame has vision correcting lenses mounted thereon; the right glasses frame can be provided with vision correction lenses.

16. The head mounted vision inspection and vision training apparatus of any one of claims 14 to 15, further comprising a micro motor, the pupil distance adjustment being automatically adjusted, comprising the steps of:

17. The head-mounted visual inspection and visual training device according to any one of claims 14 to 16, wherein the left one of the controllable covering modules is a liquid crystal shutter device, and the control module controls whether it is powered on, transparent when powered on, and opaque when not powered on; or opaque when energized and transparent when not energized; the right covering module in the controllable covering module is a liquid crystal shutter device, the control module controls whether the liquid crystal shutter device is electrified or not, and the liquid crystal shutter device is transparent when electrified and opaque when not electrified; or opaque when energized and transparent when not energized;

18. The head mounted visual inspection and training device of any one of claims 14 to 17, wherein the housing is comprised of a side material and a front material, the side material of the housing being opaque to visible light and opaque to near infrared light; the front material of the shell transmits visible light; the left mirror frame, the left semi-transparent semi-reflective lens, the left near infrared camera, the left near infrared point light source, the right mirror frame, the right semi-transparent semi-reflective lens, the right near infrared camera, the right near infrared point light source and the controllable covering module are covered from the outside; the front view of the eyes is not blocked, and external visible light and near infrared light cannot be irradiated through the gap between the left eye and the left lens frame or the gap between the right eye and the right lens frame.

19. The head mounted vision inspection and vision training apparatus of any one of claims 14 to 18, wherein the housing is provided with projection means by which the pattern is projected on a front plane.

20. The head mounted vision inspection and vision training device of any one of claims 14-19, further comprising a calibration-free eye movement direction determination module:

21. The head-mounted vision inspection and vision training device of any one of claims 14-20, further comprising a monocular calibration module and an eye movement point calculation module:

22. The head-mounted visual inspection and visual training apparatus of claim 20, further comprising a calibration-free strabismus inspection module:

23. The head-mounted vision inspection and vision training device of claim 21, further comprising a strabismus inspection module:

24. The head-mounted vision inspection and vision training device of claim 21, further comprising a amblyopia training module: the amblyopia training images displayed by the display module contain interactive contents, and the trainee interacts through eye movement points of amblyopia eyes.

25. The head-mounted vision inspection and vision training device of claim 21, further comprising a binocular vision training module comprising simultaneous vision, fusion vision, stereoscopic vision training content, wherein: training the simultaneous vision by alternately displaying images visible to only the left eye and images visible to only the right eye in a time-sharing manner, and judging the simultaneous vision training effect by whether left eye movement points, right eye movement points and training content images are overlapped or not; training the fusion vision by displaying images which are visible by both eyes at the same time, and judging the training effect of the fusion vision by whether the left eye movement point is overlapped with the right eye movement point; the stereoscopic vision is trained by displaying a stereoscopic image with a certain parallax between an image visible to only the left eye and an image visible to only the right eye, and the stereoscopic vision training effect is judged by the overlapping distance of the left eye moving point and the right eye moving point.