CN112426333A - Auxiliary stereoscopic vision electronic equipment for hemianopsia patients and control method thereof - Google Patents
Auxiliary stereoscopic vision electronic equipment for hemianopsia patients and control method thereof Download PDFInfo
- Publication number
- CN112426333A CN112426333A CN202011328841.7A CN202011328841A CN112426333A CN 112426333 A CN112426333 A CN 112426333A CN 202011328841 A CN202011328841 A CN 202011328841A CN 112426333 A CN112426333 A CN 112426333A
- Authority
- CN
- China
- Prior art keywords
- image
- patient
- eye
- hemianopsia
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 206010019452 Hemianopia Diseases 0.000 title claims abstract description 57
- 208000007460 Hemianopsia Diseases 0.000 title claims abstract description 57
- 230000004438 eyesight Effects 0.000 title claims abstract description 56
- 238000000034 method Methods 0.000 title claims abstract description 27
- 230000000007 visual effect Effects 0.000 claims abstract description 51
- 238000012545 processing Methods 0.000 claims abstract description 44
- 230000009467 reduction Effects 0.000 claims description 11
- 230000006870 function Effects 0.000 claims description 8
- 230000004382 visual function Effects 0.000 claims description 8
- 230000004927 fusion Effects 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 230000000694 effects Effects 0.000 claims description 6
- 230000003287 optical effect Effects 0.000 claims description 6
- 230000003044 adaptive effect Effects 0.000 claims description 5
- 230000008859 change Effects 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 5
- 238000012937 correction Methods 0.000 claims description 4
- 238000009877 rendering Methods 0.000 claims description 4
- 230000005540 biological transmission Effects 0.000 claims description 3
- 238000013519 translation Methods 0.000 claims description 3
- 230000003321 amplification Effects 0.000 claims 1
- 238000006073 displacement reaction Methods 0.000 claims 1
- 238000003199 nucleic acid amplification method Methods 0.000 claims 1
- 206010047555 Visual field defect Diseases 0.000 description 4
- 239000011521 glass Substances 0.000 description 4
- 230000002123 temporal effect Effects 0.000 description 4
- 230000007547 defect Effects 0.000 description 3
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 206010028980 Neoplasm Diseases 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 2
- 230000002457 bidirectional effect Effects 0.000 description 2
- 230000002146 bilateral effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000002207 retinal effect Effects 0.000 description 2
- 208000024891 symptom Diseases 0.000 description 2
- 208000029257 vision disease Diseases 0.000 description 2
- 208000010412 Glaucoma Diseases 0.000 description 1
- 102000009331 Homeodomain Proteins Human genes 0.000 description 1
- 108010048671 Homeodomain Proteins Proteins 0.000 description 1
- 206010025421 Macule Diseases 0.000 description 1
- 206010029174 Nerve compression Diseases 0.000 description 1
- 244000062793 Sorghum vulgare Species 0.000 description 1
- 206010068268 Tumour compression Diseases 0.000 description 1
- 208000013521 Visual disease Diseases 0.000 description 1
- 206010047571 Visual impairment Diseases 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 210000004220 fundus oculi Anatomy 0.000 description 1
- 210000000320 geniculate body Anatomy 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000003902 lesion Effects 0.000 description 1
- 235000019713 millet Nutrition 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 201000001119 neuropathy Diseases 0.000 description 1
- 230000007823 neuropathy Effects 0.000 description 1
- 210000001328 optic nerve Anatomy 0.000 description 1
- 230000037361 pathway Effects 0.000 description 1
- 208000033808 peripheral neuropathy Diseases 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 210000001210 retinal vessel Anatomy 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
- 230000001502 supplementing effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000004393 visual impairment Effects 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H5/00—Exercisers for the eyes
- A61H5/005—Exercisers for training the stereoscopic view
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/363—Image reproducers using image projection screens
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/398—Synchronisation thereof; Control thereof
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2205/00—Devices for specific parts of the body
- A61H2205/02—Head
- A61H2205/022—Face
- A61H2205/024—Eyes
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Epidemiology (AREA)
- Pain & Pain Management (AREA)
- Physical Education & Sports Medicine (AREA)
- Rehabilitation Therapy (AREA)
- Life Sciences & Earth Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention discloses auxiliary electronic equipment for stereoscopic vision of a hemianopsia patient and a control method thereof, wherein the electronic equipment comprises: the system comprises an image acquisition system for acquiring external images, an image processing system for constructing pictures in a three-dimensional space, an image projection system for receiving data of the image processing system and displaying three-dimensional pictures, and an image control system connected with the image processing system and used for inputting instructions; the hardware and software of the invention can adjust the external image according to the residual visual field range of the patient, and then construct the three-dimensional image to help the hemianopia patient to establish the stereoscopic vision, ensure that the completely fused picture is input to the eyes of the patient, and effectively improve the vision of the patient.
Description
Technical Field
The invention relates to the field of medical auxiliary equipment, in particular to auxiliary electronic equipment for stereoscopic vision of a hemianopsia patient and a control method thereof.
Background
Hemianopia refers to a defect in a certain part of the visual field, and is often helpful for the localized diagnosis of neuropathy caused by the lesion of the visual path. If the visual cross is pressed by tumor, the typical double temporal side hemianopsia is caused. Certain ophthalmic diseases can also cause hemianopsia-type visual field defects, such as the paranasal visual field defect of late glaucoma, hemianopsia-type visual field defects when retinal blood vessels are blocked, visual field defects in opposite directions when retinal portions are detached, and the like. The hemianopsia is divided into: bilateral light stimulation cannot be received to cause the double temporal hemianopsia when fibers conducted from bilateral nerves to the nasal retinal vision are affected due to tumor compression. When the tumor grows up gradually, one side is totally blind when the visual function is lost due to the fact that one side is stressed heavily, the other side is temporal side hemianopsia, and finally both sides are totally blind.
Syntropy hemianopsia is characterized by damage to the posterior pathways of the optic bundle or lateral geniculate body, which can produce a defect in the visual field on one nasal side and the temporal side, called syndropsia. The optic bundle is different from the hemianopsia appearing in the center, the former disappears with the light reflection, and the latter exists with the light reflection; the former is partially blind and complete, while the latter is mostly incomplete and is partially blind in a quadrant; the former patients have more subjective symptoms than the latter patients do, and the latter patients have no subjective symptoms; the latter vision is preserved in the central vision, and the macula avoids.
Because the hemianopsia disease has no better auxiliary mode in clinic, most of the rehabilitation equipment aiming at the hemianopsia patient in the market at present is based on an optical prism structure, the anterior eye image of the patient is refracted into the residual visual field of the eyes of the patient, the product is easy to generate the phenomenon of light and shadow overlapping to generate light spot shielding when being worn, the visual field entering the patient is not expanded, only the central position of the visual field is biased, further, due to the limitation of the structure, more obstacles and barriers are caused to the user, the hemianopsia disease is often accompanied with the decline of the visual function, the visual perception capability of the patient on color and contrast is reduced, and the auxiliary means only for optical vision aid is difficult to meet the use of the patient.
Some manufacturers in the market at present complete the electronic vision-assisting function through an augmented reality glasses structure, but when the blind patient is achieved, the realized function is only a picture reduction function, the size of a binocular picture is asynchronous due to the auxiliary mode, the distance between the sight lines is enlarged, the binocular image fusion cannot be completed for the patient, the distance sense of the patient is lost due to lack of stereoscopic vision, great troubles are caused when the glasses are used in daily life, if the glasses are different in size when the vehicles cross a road, the vehicle cannot be judged by the patient, and danger is very easy to occur.
The market needs a hemianopia auxiliary device which adjusts the external image according to the residual visual field range of the patient and then constructs a three-dimensional image to help the hemianopia patient to establish the stereoscopic vision and ensure that the completely fused picture is input to the eyes of the patient.
Disclosure of Invention
In order to solve the defects of the prior art, the invention aims to provide an auxiliary electronic device for stereoscopic vision of a patient with hemianopia and a control method thereof, which can adjust an external image according to the residual visual field range of the patient, reconstruct a three-dimensional image to help the patient with hemianopia to establish stereoscopic vision, ensure that a completely fused picture is input to the eyes of the patient, and effectively improve the vision of the patient.
In order to achieve the above object, the present invention adopts the following technical solutions:
a stereoscopic vision assistance electronic device for a partially blind patient, comprising: the system comprises an image acquisition system for acquiring external images, an image processing system for constructing pictures in a three-dimensional space, an image projection system for receiving data of the image processing system and displaying three-dimensional pictures, and an image control system connected to the image processing system and used for inputting instructions.
The auxiliary electronic device for stereoscopic vision of the hemianopsia patient comprises an image acquisition system and a display system, wherein the image acquisition system comprises: camera, infrared sensor, light filling device.
The auxiliary electronic device for stereoscopic vision of the hemianopsia patient comprises: the image projection system comprises an ISP image processing unit for receiving information of the image acquisition system, a GPU image rendering unit for receiving the information of the ISP image processing unit, a communication unit for transmitting the information to the image projection system, a data reading unit for recording the adjusted information, and a CPU central processing unit connected with each unit.
The auxiliary electronic device for stereoscopic vision of the hemianopsia patient comprises: the system comprises an optical lens worn on a patient, a miniature projector, a two-degree-of-freedom angle regulator of the projector and a display screen.
The auxiliary electronic device for stereoscopic vision of the hemianopsia patient comprises: physical key controller, gesture controller, voice controller.
A control method of auxiliary stereoscopic vision electronic equipment for a hemianopsia patient comprises the following steps:
respectively acquiring residual vision field conditions of left and right eyes of a patient on a field tester of professional equipment in a hospital, marking the visual picture range of the patient by a circle, and evaluating the visual function of the patient;
step two, acquiring an external real image through an image acquisition system, wherein the image acquisition range is determined according to camera parameters and the size of a display screen, and is recorded as Sc；
Step three, importing the visual function parameters of the patient into the equipment through an image processing system, acquiring a picture range by a processor in the image processing system of the equipment according to the result marking points of the first step, and marking the worst eye picture range as SWOptimum eye picture range SN(ii) a The horizontal offset of the left eye and the right eye at the circle center position of the picture range is respectively recorded as delta X1，ΔX2And the vertical offsets are respectively marked as DeltaY1，ΔY2(ii) a The display range and the picture distance of the image need to set parameters according to the vision states of the left eye and the right eye, so that the visual field size of the hemianopsia patient is improved, and the sizes of the common vision pictures of the left eye and the right eye are consistent;
step four, the image control system is used for cooperating with the image acquisition system to send the image and the adaptive parameters to the image projection system;
step five, when the image projection system acquires a transmission image, the image processing system finishes the functions of translation and zooming of the image, in order to ensure the effect of binocular fusion, a three-dimensional space is constructed in the projection system according to an eye distance-angle conversion formula, human eyes are used as base points for angle rotation, and the rotation angle is converted according to the size of a visual field deviation value and the moving distance of a picture;
the projection angle is converted according to the distance of visual center point offset from the center point of each image plane of the left eye and the right eye, and the worst eye correction angle is recorded as thetawAnd the optimum eye angle is recorded as θN；
In the foregoing method for controlling stereoscopic vision auxiliary electronic device for a hemianopsia patient,
in the third step, a binocular separate control method is selected as the method for improving the visual field size of the hemianopsia patient, and the acquisition mode of the eye picture range is as follows: selecting a maximum visual field range under the condition of ensuring that a hemianopsia patient can clearly see objects, moving between the default display picture position of the equipment and human eyes, adjusting the distance, and recording the distance as D after the worst-vision eye observation picture is clear;
preferentially calculating the worst-eye reduction value alpha1，α1＝SW/SC(ii) a Secondly, calculating the optimal reduction value alpha of the eye picture2，α2＝SN/SC(ii) a Difference ratio of eyes
When in use
When the difference between the left eye and the right eye is too large, the patient is not advised to adopt the eye mask;
when in use
When the difference ratio of the two eyes meets the requirement, adjusting the picture moving distance of the optimal eye to be compared with the worst eye delta D according to an image space projection conversion method, and calculating the formula as
In the foregoing method for controlling stereoscopic vision auxiliary electronic device for a hemianopsia patient,
in the fourth step, the image control system is used for cooperating with the image acquisition system to send the image and the adaptive parameters to the image projection system;
after the parameters are automatically adjusted according to the visual field of the patient, the patient adjusts the picture distance back and forth through the image control system until the optimal visual effect is achieved, and the adjusted parameters are recorded in the data reading unit; the image control system includes: physical key controller, gesture controller, voice controller.
In the foregoing method for controlling stereoscopic vision auxiliary electronic device for a hemianopsia patient,
when the electronic equipment rotates, the digital image, the projection screen and the residual vision center point of the eyes keep a line, and the digital image ensures that the pictures displayed by the left eye and the right eye of the patient are kept consistent through the size change of the image and the adjustment of the distance between the digital image and the eyes in a three-dimensional space.
In the foregoing method for controlling stereoscopic vision auxiliary electronic device for a hemianopsia patient,
the ISP image processing unit of the image processing system supports the enlargement and reduction, color change, contrast adjustment and binarization processing of the real-time image, and the visual effect is improved through the image processing mode of the electronic typoscope.
The invention has the advantages that:
the hardware of the invention can realize bidirectional image display, help the hemianopsia patient to establish stereoscopic vision by constructing a picture display mode under a three-dimensional space, and ensure that a completely fused picture is input into the eyes of the patient;
after the invention obtains the external real image information, the system can adjust the image according to the residual visual field range of the patient, thereby ensuring the improvement of the vision of the patient;
the invention can set parameters for the left eye and the right eye respectively, so that the sizes of the common-view pictures of the left eye and the right eye are consistent, and the binocular image fusion can be completed.
Drawings
FIG. 1 is a block diagram of one embodiment of the hardware of the present invention;
FIG. 2 is a schematic diagram of the horizontal offset of the left and right eyes at the center of a circle of a frame range according to the present invention;
FIG. 3 is a schematic illustration of the vertical offset of the present invention;
FIG. 4 is a schematic view of the projection angle of the present invention.
Detailed Description
The invention is described in detail below with reference to the figures and the embodiments.
Hardware of the auxiliary electronic device for stereoscopic vision of the hemianopsia patient is shown in fig. 1 and comprises: the system comprises an image acquisition system, an image processing system, an image projection system and an image control system.
The image acquisition system includes: the camera, the infrared sensor, the light supplementing device and the like;
the image processing system comprises and: an ISP image processing unit, a CPU central processing unit, a GPU image rendering unit, a data reading unit, a communication unit and the like;
an image projection system includes: optical lens, micro projector, two-freedom angle regulator of projector, display screen, etc.;
the image control system includes: physical key controllers, gesture controllers, voice controllers, and the like; as an embodiment, the gesture controller adopts millet Ez More gesture control equipment, and the voice controller adopts Temple.
It should be noted that: the above are only examples, and are not exhaustive, and any hardware capable of implementing such functions is suitable for the apparatus of the present invention, and is within the scope of the present invention.
The camera captures an external image, image information passes through the ISP image processing unit, the GPU image rendering unit receives the information of the ISP image processing unit, the communication unit transmits the information to the image projection system, the CPU central processing unit is connected with each unit, and the data reading unit records the adjusted information. After the communication is finished, the central processing unit sets a proper picture display size according to the measured value of the patient, then adjusts the mode of picture display angle or screen rotation angle, respectively outputs different left and right images to the screens at two sides through the image projection system, projects image information onto the optical lens through the projector, realizes double-side image display, helps the hemianopia patient to establish stereoscopic vision by constructing a picture display mode under a three-dimensional space, and ensures that a complete and integrated picture is input into the eyes of the patient.
A control method of auxiliary stereoscopic vision electronic equipment for a hemianopsia patient comprises the following steps:
respectively acquiring residual vision field conditions of left and right eyes of a patient on a field tester of professional equipment in a hospital, marking the visual picture range of the patient by a circle, and evaluating the visual function of the patient;
step two, acquiring an external real image through an image acquisition system, wherein the image acquisition range is determined according to camera parameters and the size of a display screen, and is recorded as Sc；
Step three, importing the visual function parameters of the patient into the equipment through an image processing system, acquiring a picture range by a processor in the image processing system of the equipment according to the result marking points of the first step, and marking the worst eye picture range as SWOptimum eye picture range SN(ii) a The horizontal offset of the left eye and the right eye at the circle center position of the picture range is respectively recorded as delta X1，ΔX2As shown in fig. 2; the vertical offsets are respectively recorded as DeltaY1，ΔY2As shown in fig. 3; the display range and the picture distance of the image are determined according to the vision of the left eye and the right eyeEach parameter needs to be set for the state, the size of the visual field of a hemianopsia patient is improved, and the sizes of the left and right eye common-view pictures are consistent;
different parameters need to be set according to different vision states of left and right eyes in the display range and the picture distance of the image, and the sizes of the common-vision pictures of the left and right eyes need to be kept consistent in principle. In order to ensure the maximum improvement of the visual field size of the hemianopsia patient, the conventional binocular geometric scaling minimization scheme is avoided in the device.
A method for improving the visual field size of a hemianopsia patient is preferably selected, a binocular split control method is selected, and the acquisition mode of the eye picture range is as follows: selecting a maximum visual field range under the condition of ensuring that a hemianopsia patient can clearly see objects, moving between the default display picture position of the equipment and human eyes, adjusting the distance, and recording the distance as D after the worst-vision eye observation picture is clear;
preferentially calculating the worst-eye reduction value alpha1，α1＝SW/SC(ii) a Secondly, calculating the optimal reduction value alpha of the eye picture2，α2＝SN/SC(ii) a Difference ratio of eyes
When in use
When the difference between the left eye and the right eye is too large, the patient is not advised to adopt the eye mask;
when in use
When the difference ratio of the two eyes meets the requirement, adjusting the picture moving distance of the optimal eye to be compared with the worst eye delta D according to an image space projection conversion method, and calculating the formula as
Step four, the image control system is used for cooperating with the image acquisition system to send the image and the adaptive parameters to the image projection system;
after the parameters are automatically adjusted according to the visual field of the patient, the patient adjusts the picture distance back and forth through the image control system until the optimal visual effect is achieved, and the adjusted parameters are recorded in the data reading unit; the image control system includes: physical key controller, gesture controller, voice controller.
Step five, when the image projection system acquires a transmission image, the image processing system finishes the functions of translation and zooming of the image, in order to ensure the effect of binocular fusion, a three-dimensional space is constructed in the projection system according to an eye distance-angle conversion formula, human eyes are used as base points for angle rotation, and the rotation angle is converted according to the size of a visual field deviation value and the moving distance of a picture;
it should be noted that: the spatial rotation mode of the equipment is not limited to the rotation of a hardware projection screen structure or the rotation of pictures in a projection screen, and the equipment can be adjusted by selecting various modes according to specific forms, so that a better axial projection effect is achieved;
the projection angle is converted according to the distance of visual center point offset from the center point of each image plane of the left eye and the right eye, and the worst eye correction angle is recorded as thetawAnd the optimum eye angle is recorded as θN(ii) a As shown in fig. 4;
it should be noted that:
when the hardware structure rotates, the digital image, the projection screen and the residual vision field central point of the eyes keep a line, and the digital image ensures that the pictures displayed by the left eye and the right eye of the patient are kept consistent through the size change of the image and the adjustment of the distance between the digital image and the eyes in a three-dimensional space, so that better stereoscopic vision is formed in the visual center of the patient; when the picture in the screen is adjusted in a rotating way, the image-forming position of the projection picture is far greater than the distance between the screens of the glasses, so that the image-forming position can be ignored, and the effect can be achieved;
aiming at the problem of vision deterioration of partial hemianopsia patients, a chip in equipment or an ISP (internet service provider) processing system supports the functions of amplifying and reducing, changing color, adjusting contrast, carrying out binarization processing and the like on a real-time image, and the image processing mode of the traditional electronic typoscope is used for improving the visual effect and helping other visual disorders caused by optic nerve compression.
The ability of the present invention to restore visual impairment is demonstrated below by the case of patients with binocular homeotic hemianopsia.
The patient is anotropism with two eyes, the two eyes are bounded by the central vertical lines of the visual fields of the two eyes, and the visual fields on the left sides of the two eyes are simultaneously lost.
The software control method of the equipment comprises the following specific steps:
the visual field chart of the patient is initially tested, the residual visual field of the left eye is estimated to be 32 degrees, and the central deviation delta X of the visual field is estimated1Is 12 DEG and Delta Y13 deg., poor right eye, residual field of view 26 deg., central offset DeltaX of field of view2Is 14 DEG and Delta Y2The distance between the camera and the screen of the selected equipment is 5 degrees, the head-mounted augmented reality display equipment is adopted, the field of view range capable of displaying the picture is 60 degrees, the default distance D of the fundus oculi of the patient at the imaging position of the equipment picture is 1m, and the optimal eye is converted preferentially
Setting the display reduction value of the left screen picture to be 0.53; worst eye
The display reduction value of the right screen image is set to 0.43. Contrast difference
Satisfying the equipment use condition, further calculating the binocular difference picture adjustment distance delta D as 0.23m, adjusting the left eye optimal eye distance picture display distance to 1.23m, after picture adjustment synchronization, performing binocular fusion adjustment, and recording the worst eye correction angle as thetaw12.4 °, the optimum eye angle is denoted θNAt 14.9 °, the left-eye picture display center is positioned right aboveThe adjustment is 12.4 degrees, the display center of the right eye picture is adjusted by 14.9 degrees towards the upper right, and the sizes of the left picture and the right picture are consistent with the position of the center, so that a better three-dimensional effect is achieved.
And (3) testing results: the visual field range of the patient is improved to 60 degrees, the binocular fusion capability is obviously improved, and the invisible obstacle which is left in the original visual field can be effectively avoided in the using process, so that the using purpose of the equipment is achieved.
The above example shows that the hardware of the invention can realize bidirectional image display, help the hemianopsia patient to establish stereoscopic vision by constructing a picture display mode under a three-dimensional space, and ensure that a completely fused picture is input into the eyes of the patient; the system can adjust the image according to the residual visual field range of the patient after the software acquires the external real image information, so as to ensure that the vision improvement is brought to the patient, the display range and the picture distance of the image need to set various parameters according to various visual states of the left eye and the right eye, the visual field size of the patient with hemianopia is improved, and the sizes of the pictures viewed by the left eye and the right eye together are consistent; the device of the invention can effectively solve the problem of visual field obstruction.
The foregoing illustrates and describes the principles, general features, and advantages of the present invention. It should be understood by those skilled in the art that the above embodiments do not limit the present invention in any way, and all technical solutions obtained by using equivalent alternatives or equivalent variations fall within the scope of the present invention.
Claims (10)
1. An auxiliary electronic device for stereoscopic vision of a partially blind patient, comprising: the system comprises an image acquisition system for acquiring external images, an image processing system for constructing pictures in a three-dimensional space, an image projection system for receiving data of the image processing system and displaying three-dimensional pictures, and an image control system connected to the image processing system and used for inputting instructions.
2. The auxiliary electronic device for stereoscopic vision of a hemianopsia patient according to claim 1, wherein the image capturing system comprises: camera, infrared sensor, light filling device.
3. The auxiliary electronic device for stereoscopic vision of a hemianopsia patient according to claim 1, wherein the image processing system comprises: the image projection system comprises an ISP image processing unit for receiving information of the image acquisition system, a GPU image rendering unit for receiving the information of the ISP image processing unit, a communication unit for transmitting the information to the image projection system, a data reading unit for recording the adjusted information, and a CPU central processing unit connected with each unit.
4. The auxiliary electronic device for stereoscopic vision of a hemianopsia patient according to claim 1, wherein the image projection system comprises: the system comprises an optical lens worn on a patient, a miniature projector, a two-degree-of-freedom angle regulator of the projector and a display screen.
5. The auxiliary electronic device for stereoscopic vision of a hemianopsia patient according to claim 1, wherein the image control system comprises: physical key controller, gesture controller, voice controller.
6. A control method of auxiliary electronic equipment for stereoscopic vision of a hemianopsia patient is characterized by comprising the following steps:
respectively acquiring residual vision field conditions of left and right eyes of a patient on a field tester of professional equipment in a hospital, marking the visual picture range of the patient by a circle, and evaluating the visual function of the patient;
step two, acquiring an external real image through an image acquisition system, wherein the image acquisition range is determined according to camera parameters and the size of a display screen, and is recorded as Sc；
Step three, importing the visual function parameters of the patient into the equipment through an image processing system, acquiring a picture range by a processor in the image processing system of the equipment according to the result marking points of the first step, and marking the worst eye picture range as SWOptimum eye picture range SN(ii) a The horizontal offset of the left eye and the right eye at the circle center position of the picture range is respectively recorded as delta X1，ΔX2Perpendicular deviation ofThe displacement amounts are respectively recorded as DeltaY1，ΔY2(ii) a The display range and the picture distance of the image need to set parameters according to the vision states of the left eye and the right eye, so that the visual field size of the hemianopsia patient is improved, and the sizes of the common vision pictures of the left eye and the right eye are consistent;
step four, the image control system is used for cooperating with the image acquisition system to send the image and the adaptive parameters to the image projection system;
step five, when the image projection system acquires a transmission image, the image processing system finishes the functions of translation and zooming of the image, in order to ensure the effect of binocular fusion, a three-dimensional space is constructed in the projection system according to an eye distance-angle conversion formula, human eyes are used as base points for angle rotation, and the rotation angle is converted according to the size of a visual field deviation value and the moving distance of a picture;
the projection angle is converted according to the distance of visual center point offset from the center point of each image plane of the left eye and the right eye, and the worst eye correction angle is recorded as thetawAnd the optimum eye angle is recorded as θN；
7. The method for controlling the auxiliary electronic device for stereoscopic vision of a hemianopsia patient according to claim 6,
in the third step, a binocular separate control method is selected as the method for improving the visual field size of the patient with hemianopsia, and the acquisition mode of the eye picture range is as follows: selecting a maximum visual field range under the condition of ensuring that a hemianopsia patient can clearly see objects, moving between the default display picture position of the equipment and human eyes, adjusting the distance, and recording the distance as D after the worst-vision eye observation picture is clear;
preferentially calculating the worst-eye reduction value alpha1，α1＝SW/SC(ii) a Secondly, calculating the optimal reduction value alpha of the eye picture2，α2＝SN/SC；
Difference ratio of eyes
When in use
When the difference between the left eye and the right eye is too large, the patient is not advised to adopt the eye mask;
when in use
When the difference ratio of the two eyes meets the requirement, adjusting the picture moving distance of the optimal eye to be compared with the worst eye delta D according to an image space projection conversion method, and calculating the formula as
8. The method for controlling the auxiliary electronic device for stereoscopic vision of a hemianopsia patient according to claim 6,
in the fourth step, the image control system is used for cooperating with the image acquisition system to send the image and the adaptive parameters to the image projection system;
after the parameters are automatically adjusted according to the visual field of the patient, the patient adjusts the picture distance back and forth through the image control system until the optimal visual effect is achieved, and the adjusted parameters are recorded in the data reading unit; the image control system includes: physical key controller, gesture controller, voice controller.
9. The method for controlling the auxiliary electronic device for stereoscopic vision of a hemianopsia patient according to claim 6,
when the electronic equipment rotates, the digital image, the projection screen and the residual vision center point of the eyes keep a line, and the digital image ensures that the pictures displayed by the left eye and the right eye of the patient are kept consistent through the size change of the image and the adjustment of the distance between the digital image and the eyes in a three-dimensional space.
10. The method for controlling the auxiliary electronic device for stereoscopic vision of a hemianopsia patient according to claim 6,
the ISP image processing unit of the image processing system supports the amplification and reduction, color change, contrast adjustment and binarization processing of real-time images, and the visual effect is improved through the image processing mode of the electronic typoscope.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011328841.7A CN112426333A (en) | 2020-11-24 | 2020-11-24 | Auxiliary stereoscopic vision electronic equipment for hemianopsia patients and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011328841.7A CN112426333A (en) | 2020-11-24 | 2020-11-24 | Auxiliary stereoscopic vision electronic equipment for hemianopsia patients and control method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112426333A true CN112426333A (en) | 2021-03-02 |
Family
ID=74693945
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011328841.7A Pending CN112426333A (en) | 2020-11-24 | 2020-11-24 | Auxiliary stereoscopic vision electronic equipment for hemianopsia patients and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112426333A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113286019A (en) * | 2021-05-07 | 2021-08-20 | 南昌欧菲光电技术有限公司 | Optical module, camera and electronic equipment |
| CN113391449A (en) * | 2021-06-08 | 2021-09-14 | 温州医科大学附属眼视光医院 | Intelligent vision expanding visual aid and intelligent vision expanding visual aid method |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102045577A (en) * | 2010-09-27 | 2011-05-04 | 昆山龙腾光电有限公司 | Observer tracking system and three-dimensional stereo display system for three-dimensional stereo display |
| CN103313087A (en) * | 2013-06-28 | 2013-09-18 | 冠捷显示科技（厦门）有限公司 | Stereoscopic display method with tracking function for two-view naked-eye stereoscopic display |
| CN103781400A (en) * | 2011-09-07 | 2014-05-07 | 改进的视觉系统(I.V.S.)有限公司 | Method and system for treatment of visual impairment |
| CN104306102A (en) * | 2014-10-10 | 2015-01-28 | 上海交通大学 | Head wearing type vision auxiliary system for patients with vision disorder |
| CN104483754A (en) * | 2014-12-04 | 2015-04-01 | 上海交通大学 | Head-wearing type multimedia terminal assisted watching system aiming at patient with dysopia |
| CN104954777A (en) * | 2014-03-29 | 2015-09-30 | 罗恩·福里丹托尔 | Method and apparatus for displaying video data |
| CN107111749A (en) * | 2014-12-22 | 2017-08-29 | 诺瓦赛特有限公司 | System and method for improved display |
| CN110214339A (en) * | 2016-11-30 | 2019-09-06 | 诺瓦赛特有限公司 | For showing the method and apparatus with the image of the visual field changed |
| CN110708533A (en) * | 2019-12-16 | 2020-01-17 | 杭州融梦智能科技有限公司 | Visual assistance method based on augmented reality and intelligent wearable device |
| CN111511318A (en) * | 2017-09-27 | 2020-08-07 | 迈阿密大学 | Digital treatment correcting glasses |
| CN111770254A (en) * | 2020-07-13 | 2020-10-13 | 深圳市中科先见医疗科技有限公司 | AR (augmented reality) glasses-based vision-aiding rehabilitation aid, system and display method |
-
2020
- 2020-11-24 CN CN202011328841.7A patent/CN112426333A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102045577A (en) * | 2010-09-27 | 2011-05-04 | 昆山龙腾光电有限公司 | Observer tracking system and three-dimensional stereo display system for three-dimensional stereo display |
| CN103781400A (en) * | 2011-09-07 | 2014-05-07 | 改进的视觉系统(I.V.S.)有限公司 | Method and system for treatment of visual impairment |
| CN103313087A (en) * | 2013-06-28 | 2013-09-18 | 冠捷显示科技（厦门）有限公司 | Stereoscopic display method with tracking function for two-view naked-eye stereoscopic display |
| CN104954777A (en) * | 2014-03-29 | 2015-09-30 | 罗恩·福里丹托尔 | Method and apparatus for displaying video data |
| CN104306102A (en) * | 2014-10-10 | 2015-01-28 | 上海交通大学 | Head wearing type vision auxiliary system for patients with vision disorder |
| CN104483754A (en) * | 2014-12-04 | 2015-04-01 | 上海交通大学 | Head-wearing type multimedia terminal assisted watching system aiming at patient with dysopia |
| CN107111749A (en) * | 2014-12-22 | 2017-08-29 | 诺瓦赛特有限公司 | System and method for improved display |
| CN110214339A (en) * | 2016-11-30 | 2019-09-06 | 诺瓦赛特有限公司 | For showing the method and apparatus with the image of the visual field changed |
| CN111511318A (en) * | 2017-09-27 | 2020-08-07 | 迈阿密大学 | Digital treatment correcting glasses |
| CN110708533A (en) * | 2019-12-16 | 2020-01-17 | 杭州融梦智能科技有限公司 | Visual assistance method based on augmented reality and intelligent wearable device |
| CN111770254A (en) * | 2020-07-13 | 2020-10-13 | 深圳市中科先见医疗科技有限公司 | AR (augmented reality) glasses-based vision-aiding rehabilitation aid, system and display method |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113286019A (en) * | 2021-05-07 | 2021-08-20 | 南昌欧菲光电技术有限公司 | Optical module, camera and electronic equipment |
| CN113286019B (en) * | 2021-05-07 | 2022-06-21 | 南昌欧菲光电技术有限公司 | Optical module, camera and electronic equipment |
| CN113391449A (en) * | 2021-06-08 | 2021-09-14 | 温州医科大学附属眼视光医院 | Intelligent vision expanding visual aid and intelligent vision expanding visual aid method |
| CN113391449B (en) * | 2021-06-08 | 2023-02-07 | 温州医科大学附属眼视光医院 | Intelligent vision expanding visual aid and intelligent vision expanding visual aid method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10874297B1 (en) | System, method, and non-transitory computer-readable storage media related to correction of vision defects using a visual display | |
| US8820930B2 (en) | System, method, and apparatus for amblyopia and ocular deviation correction | |
| JP5414946B2 (en) | Head-mounted display and method for adjusting misalignment thereof | |
| US20190333480A1 (en) | Improved Accuracy of Displayed Virtual Data with Optical Head Mount Displays for Mixed Reality | |
| CN111511318A (en) | Digital treatment correcting glasses | |
| JP3089306B2 (en) | Stereoscopic imaging and display device | |
| US20220397959A1 (en) | Methods and Systems for Enabling the Remote Testing of Vision and Diagnosis of Vision-Related Issues | |
| TWI507729B (en) | Eye-accommodation-aware head mounted visual assistant system and imaging method thereof | |
| US11031120B1 (en) | System, method, and non-transitory computer-readable storage media related to correction of vision defects using a visual display | |
| US11216907B2 (en) | Image generating apparatus, method, and program for displaying image resolution with motion in head-mounted display (HMD) | |
| JP2015503934A (en) | Visual impairment treatment method and system | |
| JPWO2018055618A5 (en) | ||
| US11570426B2 (en) | Computer-readable non-transitory storage medium, web server, and calibration method for interpupillary distance | |
| CN112426333A (en) | Auxiliary stereoscopic vision electronic equipment for hemianopsia patients and control method thereof | |
| US10574966B2 (en) | Method for modifying at least one frame video of a digital video stream to be displayed on a displaying area and related system | |
| WO2020042638A1 (en) | Head-mounted display apparatus | |
| WO2017133160A1 (en) | Smart eyeglass perspective method and system | |
| CN111494177A (en) | Vision training method considering visual development of both eyes | |
| WO2018203297A1 (en) | Ocular misalignment | |
| US20230071841A1 (en) | System and method for improved electronic assisted medical procedures | |
| CN109917908B (en) | Image acquisition method and system of AR glasses | |
| JPWO2019203310A1 (en) | Image processing methods, programs, and image processing equipment | |
| TWI757727B (en) | Method for compensating visual field defects, electronic device, smart glasses, computer readable storage medium | |
| WO2022146514A1 (en) | System, method, and non-transitory computer-readable storage media related to correction of vision defects using a visual display | |
| CN115867238A (en) | Visual aid |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Tong Xiaoyu Inventor after: Gu Zhaoquan Inventor after: Chen Yang Inventor after: Chen Da Inventor after: Wang Yuexuan Inventor after: Xu Mo Inventor before: Dong Xiaoyu Inventor before: Gu Zhaoquan Inventor before: Chen Yang Inventor before: Chen Da Inventor before: Wang Yuexuan Inventor before: Xu Mo |
|
| CB03 | Change of inventor or designer information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210302 |
|
| RJ01 | Rejection of invention patent application after publication |