CN113393404A - Low-vision head-wearing electronic auxiliary vision equipment and image modification method thereof - Google Patents
Low-vision head-wearing electronic auxiliary vision equipment and image modification method thereof Download PDFInfo
- Publication number
- CN113393404A CN113393404A CN202110810605.7A CN202110810605A CN113393404A CN 113393404 A CN113393404 A CN 113393404A CN 202110810605 A CN202110810605 A CN 202110810605A CN 113393404 A CN113393404 A CN 113393404A
- Authority
- CN
- China
- Prior art keywords
- user
- image
- unit
- contour
- view
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 208000010415 Low Vision Diseases 0.000 title claims abstract description 34
- 230000004303 low vision Effects 0.000 title claims abstract description 34
- 238000002715 modification method Methods 0.000 title claims abstract description 15
- 230000004438 eyesight Effects 0.000 title claims description 29
- 230000000007 visual effect Effects 0.000 claims abstract description 47
- 238000012545 processing Methods 0.000 claims abstract description 30
- 238000000034 method Methods 0.000 claims description 12
- 238000012986 modification Methods 0.000 claims description 10
- 230000004048 modification Effects 0.000 claims description 10
- 241000226585 Antennaria plantaginifolia Species 0.000 claims description 8
- 206010047555 Visual field defect Diseases 0.000 abstract description 7
- 208000010412 Glaucoma Diseases 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 230000006978 adaptation Effects 0.000 description 5
- 208000002780 macular degeneration Diseases 0.000 description 5
- 230000015654 memory Effects 0.000 description 5
- 208000007014 Retinitis pigmentosa Diseases 0.000 description 4
- 208000002367 Retinal Perforations Diseases 0.000 description 3
- 239000003086 colorant Substances 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 208000029233 macular holes Diseases 0.000 description 3
- 208000001749 optic atrophy Diseases 0.000 description 3
- 201000004569 Blindness Diseases 0.000 description 2
- 206010010356 Congenital anomaly Diseases 0.000 description 2
- 206010012689 Diabetic retinopathy Diseases 0.000 description 2
- 201000002563 Histoplasmosis Diseases 0.000 description 2
- 208000035719 Maculopathy Diseases 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 230000002207 retinal effect Effects 0.000 description 2
- 230000037390 scarring Effects 0.000 description 2
- 206010001557 Albinism Diseases 0.000 description 1
- 206010003694 Atrophy Diseases 0.000 description 1
- 208000003174 Brain Neoplasms Diseases 0.000 description 1
- 208000002177 Cataract Diseases 0.000 description 1
- 206010007747 Cataract congenital Diseases 0.000 description 1
- 208000003569 Central serous chorioretinopathy Diseases 0.000 description 1
- 208000033379 Chorioretinopathy Diseases 0.000 description 1
- 208000025133 Congenital eye disease Diseases 0.000 description 1
- 206010012688 Diabetic retinal oedema Diseases 0.000 description 1
- 208000010038 Ischemic Optic Neuropathy Diseases 0.000 description 1
- 208000001344 Macular Edema Diseases 0.000 description 1
- 206010025415 Macular oedema Diseases 0.000 description 1
- 208000024080 Myopic macular degeneration Diseases 0.000 description 1
- 206010030924 Optic ischaemic neuropathy Diseases 0.000 description 1
- 201000007737 Retinal degeneration Diseases 0.000 description 1
- 206010038848 Retinal detachment Diseases 0.000 description 1
- 201000007058 anterior ischemic optic neuropathy Diseases 0.000 description 1
- 230000037444 atrophy Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 208000026106 cerebrovascular disease Diseases 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 201000011190 diabetic macular edema Diseases 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000004064 dysfunction Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000003902 lesion Effects 0.000 description 1
- 201000010230 macular retinal edema Diseases 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 206010029864 nystagmus Diseases 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004264 retinal detachment Effects 0.000 description 1
- 208000004644 retinal vein occlusion Diseases 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 201000008525 senile cataract Diseases 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
- 230000004393 visual impairment Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Optics & Photonics (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a low-vision head-mounted electronic auxiliary visual device and an image modification method thereof, and the low-vision head-mounted electronic auxiliary visual device comprises a user input unit, at least one image capturing unit, a storage unit, a processing unit and a display unit, wherein an image outside the visual field of a user self captured by the at least one image capturing unit is marked as at least two external areas, the processing unit is configured to modify the image of any one external area to form an image outline capable of being displayed on the display unit in the visual field of the user self, and the user input unit is configured to select the image outline of the external area required by the user to be displayed on the display unit in the visual field of the user self. Compared with the prior art, the user can independently select the image outline of the required external area to be displayed on the display unit in the visual field of the user according to the self requirement, the visual field defect user can intuitively operate the equipment to expand the visual field range of the visual field defect user, and the life quality is improved.
Description
Technical Field
The invention relates to the field of intelligent medical equipment, in particular to a low-vision head-wearing electronic auxiliary vision device and an image modification method thereof.
Background
Low vision (low vision) generally refers to visual dysfunction that cannot be improved by surgery, medication, or prescription spectacles, and mainly includes vision loss and visual field reduction. The causes of low vision vary greatly among people of different ages. According to foreign data, congenital eye diseases account for the vast majority of etiologies in people under 29 years old, and are congenital eye structure defect, nystagmus, congenital cataract, macular dystrophy, congenital optic atrophy, albinism, primary retinitis pigmentosa, retrocrystallina, and the like in sequential arrangement; in the population of 30-59 years old, the optic atrophy, the primary retinitis pigmentosa, the diabetic retinopathy, the macular dystrophy, the myopic retinal choroidopathy and the like are sequentially arranged; in people older than 60 years, the age-related macular lesions account for the majority, up to more than 50%, and glaucoma, senile cataract, diabetic retinopathy, optic atrophy, myopic retinal choroidopathies and the like are the second category.
Among them, retinal detachment, glaucoma, retinal vein occlusion, retinal pigment degeneration, and brain tumor or cerebrovascular disorder are common causes of visual field loss. In the case of glaucoma, the most prominent visual field defect of glaucoma is the tubular field. Glaucoma patients can only see scenery in their own tubular visual field and cannot see scenery outside their own visual field, greatly affecting life and learning of glaucoma patients.
In the prior art, with the technical development of AR/VR wearable devices, more and more Head Mounted Devices (HMDs) are designed to capture images of surrounding scenes of a user, display the captured scenes in real time through an AR display system, and enlarge or modify the displayed scenes to assist in enhancing the eyesight of a low-vision user. And no head-mounted device has emerged to assist low vision users, particularly patients with visual field defects, in improving their visual field. Therefore, a low-vision head-mounted electronic vision aid with image modification is needed to solve the deficiencies in the prior art.
Disclosure of Invention
In order to solve the technical problem that the low-vision head-mounted electronic vision auxiliary equipment in the prior art does not have the function of improving the visual field, the invention aims to provide the head-mounted electronic vision auxiliary equipment and the image modification method, which can independently operate to realize that the scenery outside the visual field of the user enters the visual field of the user through the image modification function aiming at the visual field requirements of different low-vision users.
In order to achieve one of the above objects, an embodiment of the present invention provides a low-vision head-mounted electronic auxiliary vision device, including a user input unit, at least one image capturing unit, a storage unit, a processing unit and a display unit, wherein an image captured by the at least one image capturing unit outside the user's own field of view is marked as at least two outer regions, the processing unit is configured to modify the image of any one of the outer regions to form an image contour displayable on the display unit within the user's own field of view, and the user input unit is configured to select an image contour of an outer region desired by the user to be displayed on the display unit within the user's own field of view.
As a further improvement of an embodiment of the present invention, the user input unit may adjust parameters such as a zoom factor, a contour color, and a contour line width of the image contour and/or the image in the user's own view according to a user requirement, the storage unit is configured to store the parameters such as the zoom factor, the contour color, and the contour line width, and the processing unit calls the parameters such as the zoom factor, the contour color, and the contour line width according to an instruction of the user input unit to display the modified image contour of the external area on the display unit in the user's own view.
As a further improvement of an embodiment of the present invention, the external area includes a first area located on an upper side of the field of view of the user himself, a second area located on both sides of the field of view of the user himself in a horizontal direction, and a third area located on a lower side of the field of view of the user himself, and the user input unit may select to display an image contour of any one or any combination of the first area, the second area, and the third area in the field of view of the user himself on the display unit in a superimposed and/or zoomed manner.
As a further improvement of an embodiment of the present invention, the user input unit includes a toggle switch, a remote controller, a key, a gesture recognition device, or a voice recognition device, and the user input unit is configured to select the external area or confirm parameters such as the zoom factor, the contour color, the contour line width, and the like.
As a further improvement of an embodiment of the present invention, the user input unit is configured to select an amount of detail information that a target object outside the user's own field of view is displayed on the display unit.
The invention also provides an image modification method for the low-vision head-wearing type electronic auxiliary vision equipment, wherein the equipment comprises a user input unit, at least one image capturing unit, a storage unit, a processing unit and a display unit, and the method comprises the following steps:
a: marking images captured by the at least one image capturing unit outside the user's own field of view as at least two outer regions;
b: the processing unit modifies the image of any one of the outer regions to form an image outline which can be displayed on a display unit in the visual field of the user;
c: the user input unit selects an image contour of an external area desired by a user to be displayed on a display unit within the user's own field of view.
As a further improvement of an embodiment of the present invention, the user input unit may adjust parameters such as a zoom factor, a contour color, and a contour line width of the image contour and/or the image in the user's own view according to a user requirement, the storage unit is configured to store the parameters such as the zoom factor, the contour color, and the contour line width, and the processing unit calls the parameters such as the zoom factor, the contour color, and the contour line width according to an instruction of the user input unit to display the modified image contour of the external area on the display unit in the user's own view.
As a further improvement of an embodiment of the present invention, the external area includes a first area located on an upper side of the field of view of the user himself, a second area located on both sides of the field of view of the user himself in a horizontal direction, and a third area located on a lower side of the field of view of the user himself, and the user input unit may select to display an image contour of any one or any combination of the first area, the second area, and the third area in the field of view of the user himself on the display unit in a superimposed and/or zoomed manner.
As a further improvement of an embodiment of the present invention, the user input unit includes a toggle switch, a remote controller, a key, a gesture recognition device, or a voice recognition device, and the user input unit is configured to select the external area or confirm parameters such as the zoom factor, the contour color, the contour line width, and the like.
As a further improvement of an embodiment of the present invention, the amount of detail information that the target object outside the user's own view is displayed on the display unit may be selected by the user input unit.
The invention also provides an image modification method for the low-vision head-wearing type electronic auxiliary vision equipment, wherein the equipment comprises a user input unit, at least one image capturing unit, a storage unit, a processing unit and a display unit, and the method comprises the following steps:
a: the at least one image capturing unit captures images outside the user's own field of view;
b: the processing unit performs pincushion distortion and reduction modification on the image of the external area;
c: and displaying the pincushion distortion and the reduced and modified image on a display unit in the visual field of the user.
Compared with the prior art, the invention has the beneficial effects that: the image outside the field of view of the user captured by the image capturing unit is marked as at least two external areas, the image of any one external area is modified to form an image outline which can be displayed on the display unit in the field of view of the user, the user can independently select the required image outline of the external area to be displayed on the display unit in the field of view of the user according to the requirement of the user, the purpose that the scene image outside the field of view of the user is displayed in the field of view of the user is achieved visually, the operation is simple and convenient, the field of view range of the user with the field of view defect is expanded, and the life quality is improved.
Drawings
FIG. 1 is a hardware block diagram of one embodiment of a head mounted electronic assisted vision apparatus 100;
FIG. 2 is a schematic illustration of an image outside of the low-vision user's own field of view labeled as three outer regions in accordance with an embodiment of the present invention;
FIG. 3 is a diagram illustrating a scene in a first area being displayed in the user's own field of view according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating a scene in a second area being displayed in the user's own field of view according to an embodiment of the present invention;
FIG. 5 is a diagram illustrating a third area of a scene displayed in the user's own field of view according to an embodiment of the present invention;
FIG. 6 is a diagram illustrating outlines of scenes in a first region, a second region and a third region of a user's own field of view according to an embodiment of the present invention;
fig. 7 is a flow chart diagram of the image modification method of the present invention.
Wherein:
100. a vision head-mounted electronic auxiliary vision device; 101. a user input unit; 102. an image capturing unit; 103. a storage unit; 104. a processing unit; 105. a display unit; 200. an outer region; 201. a first region; 202. a second region 202; 203. a third region; 300. within the user's own field of view.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
The technical scheme of the invention is further explained by the specific implementation mode in combination with the attached drawings.
Referring to fig. 1, an embodiment of the present invention is provided to achieve one of the above objects, and an embodiment of the present invention provides a low-vision head-mounted electronic auxiliary vision device 100 including a user input unit 101, at least one image capturing unit 102, a storage unit 103, a processing unit 104, and a display unit 105, the processing unit 103 being operatively connectable to a database via a link connected to an input/output (I/O) circuit. The storage unit 102 may include a plurality of RAMs and a plurality of program memories, which may be, for example, semiconductor memories, magnetically readable memories, and/or optically readable memories.
The low-vision head-mounted electronic assistive vision device 100 may be AR augmented reality type vision-assistive glasses that incorporate optical and electrical hardware and software, and the magnified and/or modified image may be presented to the user on a display unit of the head-mounted AR glasses. The low-vision head-mounted electronic auxiliary vision device 100 has at least two working modes, namely an adaptation mode and a use mode, when the device is in the adaptation mode, images captured outside the user's own visual field by at least one image capturing unit 102 are marked as at least two outer areas 200, the processing unit 104 is configured to modify the image of any one of the outer areas 200 to form an image contour which can be displayed on the display unit 105 in the user's own visual field, and the user input unit 101 is configured to select the image contour of the outer area 200 required by the user to be displayed on the display unit 105 in the user's own visual field 300.
Referring to fig. 2, in an embodiment of the present invention, the image capturing unit 102 is a camera, the image captured by the camera outside the user's own field of view is marked as three outer regions, namely a first region 201 located on the upper side of the user's own field of view, a second region 202 located on both sides of the user's own field of view in the horizontal direction, and a third region 203 located on the lower side of the user's own field of view, and the user input unit can select to display the image contour of any one or any combination of the first region 201, the second region 202, and the third region 203 on the display unit 105 in the user's own field of view in an overlapping and/or zooming manner. Of course in other embodiments, the images outside the user's own field of view may also be labeled as two, four, five, etc. distinct regions.
The user input unit 101 can adjust parameters such as scaling times, contour colors, contour line widths and the like of the image contour and/or the image in the user's own visual field 300 according to user requirements, and the storage unit 103 is configured to store the parameters such as the scaling times, the contour colors, the contour line widths and the like. For example, the scene in the user's own field of view is clearer, and the image E in the user's own field of view 300 may not be modified or reduced appropriately; if the scene in the user's own field of view is still unclear, the image E in the user's own field of view 300 may be magnified. Since the modified image contour of the image in the outer area 200 can be displayed on the display unit 105 in an overlapping manner, when the device is in the adaptation mode, the user can adjust parameters such as the zoom factor, contour color, contour line width and the like of the image contour according to the user's needs. When the device is in the use mode, the processing unit 104 calls parameters such as zoom factor, contour color, contour line width, etc. according to the instruction of the user input unit 101 to display the modified image contour of the external area 200 on the display unit 105 within the user's own field of view 300.
Referring to fig. 3, if the user desires to view the subject in the first region 201 on the upper side of his own visual field, the first region 201 may be selected through the user input unit 101, and the subject B1 in the first region 201 may be displayed in the outline of the subject B1 superimposed on the display unit 105 within the user's own visual field 300 after being modified by image enlargement or reduction. Referring to fig. 4, if the user desires to view the scenes of the second regions 202 on both sides of the user's own field of view in the horizontal direction, the second region 202 may be selected through the user input unit 101, and the scene B2 in the second region 202 may be displayed in the outline of the scene B2 superimposed on the display unit 105 within the user's own field of view 300 after being modified by image enlargement or image reduction. Referring to fig. 5, if the user desires to view the subject of the third region 203 on the lower side of the user's own field of view, the third region 203 may be selected through the user input unit 101, and the subject B3 in the third region 203 may be displayed in an overlapping manner with the outline of the subject B3 on the display unit 105 within the user's own field of view 300 after being modified by image enlargement or reduction. Referring to fig. 6, the subjects B1, B2, B3 in the first, second, and third regions 201, 202, 203 are simultaneously displayed on the display unit 105 in the user's own field of view 300 through reduction modification and contour superimposition. In other alternative embodiments, the scene in the outer region 200 may be subjected to image recognition, and a target object of interest to the user may be further captured into the user's own field of view 300.
Of course, in the above operation, the user may select to display only the external region 200 scene in the outline overlapping manner on the display unit within the user's field of view 300 without modification such as image enlargement or reduction. The low-vision user can freely select parameters such as zoom factors, contour colors, contour line widths and the like suitable for the visual field range of the user and an external area to be observed in the self-adaptive mode through autonomous operation. Compared with the prior art, the user can independently select the image outline of the required external area to be displayed on the display unit in the visual field of the user according to the self requirement, the visual field defect user can intuitively operate the equipment to expand the visual field range of the visual field defect user, and the life quality is improved.
The user input unit 101 includes a toggle switch, a remote controller, a key, a gesture recognition device, or a voice recognition device, and the user input unit 101 is configured to select the external area 200 or confirm parameters such as the zoom factor, the contour color, the contour line width, and the like. The user input unit 101 is also configured to select the amount of detail information that the target object outside the user's own view is displayed on the display unit 105. For example, the information amount of the target object may be arbitrarily selected from 0 to 100%, where 0 is selected to represent that only the outer contour of the target object outside the user's own view is displayed without displaying its internal details, 100% is selected to represent that both the outer contour and the internal details of the target object are displayed, and 0 to 100% is selected, for example, 50% is selected to represent that both the outer contour and the internal details of the target object are displayed. Since the image of the outer area 200 is converted into an outline to be displayed superimposed on the display unit 105, the remaining visual field range of a low-vision user, particularly a user with a defective visual field, is fully utilized, and the visual field range thereof is greatly expanded. The image contour may be set to have a color with high contrast for easy recognition by a low-vision user.
Referring to fig. 7, an embodiment of the present invention provides an image modification method for a low-vision head-mounted electronic auxiliary vision device, where the device includes a user input unit, at least one image capturing unit, a storage unit, a processing unit and a display unit 105, and the device has at least two working modes, namely an adaptation mode and a usage mode, and includes the following steps:
a: tagging images captured by the at least one image capturing unit outside the user's own field of view as at least two outer regions 200 when the device is in the adaptation mode;
b: the processing unit modifies the image of any of the outer regions 200 to form an image outline that can be displayed on the display unit 105 within the user's own field of view;
c: the image outline of the outer region 200 desired by the user selected by the user input unit is displayed on the display unit 105 within the user's own field of view.
The user input unit 101 may adjust parameters such as a zoom factor, a contour color, a contour line width, and the like of an image contour and/or an image in the user's own view according to a user requirement, the storage unit 103 is configured to store the parameters such as the zoom factor, the contour color, the contour line width, and the like, and when the apparatus is in a use mode, the processing unit 104 calls the parameters such as the zoom factor, the contour color, the contour line width, and the like according to an instruction of the user input unit 101 to display a modified image contour of the external region 200 on the display unit 105 in the user's own view.
The outer region 200 includes a first region 201 located on the upper side of the user's own field of view, a second region 202 located on both sides of the user's own field of view in the horizontal direction, and a third region 203 located on the lower side of the user's own field of view, and the user input unit may select to superimpose and/or zoom an image contour of any one or any combination of the first region 201, the second region 202, and the third region 203 on the display unit 105 within the user's own field of view.
The user input unit 101 includes a toggle switch, a remote controller, a key, a gesture recognition device or a voice recognition device, and the user input unit 101 is configured to select the external area 200 or confirm parameters such as a zoom factor, a contour color, a contour line width, and the like. The amount of detailed information that the target object outside the user's own view is displayed on the display unit 105 can be selected by the user input unit 101.
An embodiment of the present invention further provides an image modification method for a low-vision head-mounted electronic auxiliary vision device, where the device includes a user input unit 101, at least one image capturing unit 102, a storage unit 103, a processing unit 104, and a display unit 105, and the method includes the following steps:
a: the at least one image capturing unit 102 captures images outside the user's own field of view;
b: the processing unit performs pincushion distortion and reduction modification on the image of the outer area 200;
c: the pincushion distorted and reduced modified image is displayed on the display unit 105 within the user's own field of view 300.
The image modification method of the present embodiment is different from the image modification method of the previous embodiment in that the present invention performs pincushion distortion and reduction modification on the entire image outside the field of view of the user himself, and the magnification of the content in the captured image changes with different positions of the image according to the distortion characteristics. The content at the center of the image is magnified by less than 1 and the content at the edges of the image is magnified by more than 1. For the distorted image, the content at the central position only occupies a small part of the area of the display area (the visual field of the user), and the content at the edge, namely the content outside the visual field of the user per se, only occupies most of the area of the display area (the visual field of the user), so that the step of selecting the external area in the visual field of the user per se is omitted, the scenery outside the visual field of the user per se can be obtained in one step, and the problem of the expanded visual field range of the visual field defect user caused by glaucoma, retinitis pigmentosa and other reasons is solved. It is understood that the pincushion distortion described in the present embodiment is only one of the modification methods for modifying an image for expanding a field of view, and may be other similar image deformation methods that may occur to those skilled in the art.
In other alternative embodiments of the present invention, the low-vision head-mounted electronic assistive vision device 100 may also be communicatively coupled via wired or wireless communication with one or more external image processors, which may include computers, such as laptop computers, tablet computers, mobile communication terminal devices, and other computer processing devices, and which may include one or more processors and one or more memories. In embodiments including an external image processor, the image after image modification processing is sent to the display unit of the head-mounted electronic auxiliary vision device 100 for viewing by the subject.
Users of the present invention include low vision users such as patients with early stage macular degeneration, macular degeneration (AMD), glaucoma, macular holes and other FOV vision related blindness or vision deficiency conditions, e.g., central macular scarring, histoplasmosis, advanced glaucoma, macular degeneration, central serous retinopathy, myopic macular degeneration, diabetic macular edema, bladder ID macular edema, macular holes, macular atrophy, central macular scarring, histoplasmosis, macular holes, anterior ischemic optic neuropathy, retinitis pigmentosa, and the like.
It should be understood that although the present description refers to embodiments, not every embodiment contains only a single technical solution, and such description is for clarity only, and those skilled in the art should make the description as a whole, and the technical solutions in the embodiments can also be combined appropriately to form other embodiments understood by those skilled in the art.
The above-listed detailed description is only a specific description of a possible embodiment of the present invention, and they are not intended to limit the scope of the present invention, and equivalent embodiments or modifications made without departing from the technical spirit of the present invention should be included in the scope of the present invention.
Claims (10)
1. A low vision head-mounted electronic auxiliary vision device comprises a user input unit, at least one image capturing unit, a storage unit, a processing unit and a display unit, and is characterized in that: the image captured by the at least one image capturing unit outside the user's own field of view is marked as at least two outer regions, the processing unit is configured to modify the image of any one of the outer regions to form an image profile that can be displayed on the display unit within the user's own field of view, and the user input unit is configured to select the image profile of the outer region desired by the user to be displayed on the display unit within the user's own field of view.
2. A low vision head-mounted electronic assistive vision device as recited in claim 1, wherein: the user input unit can adjust parameters such as the scaling factor, the contour color, the contour line width and the like of the image contour and/or the image in the user view according to user requirements, the storage unit is configured to store the parameters such as the scaling factor, the contour color, the contour line width and the like, and the processing unit calls the parameters such as the scaling factor, the contour color, the contour line width and the like according to instructions of the user input unit to display the modified image contour of the external area on a display unit in the user view.
3. A low vision head-mounted electronic assistive vision device as recited in claim 1, wherein: the external area comprises a first area positioned on the upper side of the user self visual field, a second area positioned on two sides of the user self visual field in the horizontal direction and a third area positioned on the lower side of the user self visual field, and the user input unit can select to superpose and/or zoom and display the image contour of any one area or any combination of the first area, the second area and the third area on the display unit in the user self visual field.
4. A low vision head-mounted electronic assistive vision device as recited in claim 1, wherein: the user input unit comprises a toggle switch, a remote controller, a key, a gesture recognition device or a voice recognition device, and is used for selecting the external area or confirming parameters such as the zoom factor, the contour color, the contour line width and the like.
5. A low vision head-mounted electronic assistive vision device as recited in claim 1, wherein: the user input unit is configured to select an amount of detail information that a target object outside the user's own field of view is displayed on the display unit.
6. An image modification method for a low-vision head-mounted electronic auxiliary vision device, the device comprising a user input unit, at least one image capturing unit, a storage unit, a processing unit and a display unit, characterized in that: the method comprises the following steps:
a: marking images captured by the at least one image capturing unit outside the user's own field of view as at least two outer regions;
b: the processing unit modifies the image of any one of the outer regions to form an image outline which can be displayed on a display unit in the visual field of the user;
c: the user input unit selects an image contour of an external area desired by a user to be displayed on a display unit within the user's own field of view.
7. The method of claim 6, wherein the method further comprises: the user input unit can adjust parameters such as the scaling factor, the contour color, the contour line width and the like of the image contour and/or the image in the user view according to user requirements, the storage unit is configured to store the parameters such as the scaling factor, the contour color, the contour line width and the like, and the processing unit calls the parameters such as the scaling factor, the contour color, the contour line width and the like according to instructions of the user input unit to display the modified image contour of the external area on a display unit in the user view.
8. The method of claim 6, wherein the method further comprises: the external area comprises a first area positioned on the upper side of the user self visual field, a second area positioned on two sides of the user self visual field in the horizontal direction and a third area positioned on the lower side of the user self visual field, and the user input unit can select to superpose and/or zoom and display the image contour of any one area or any combination of the first area, the second area and the third area on the display unit in the user self visual field.
9. The method of claim 6, wherein the method further comprises: the amount of detail information that the target object outside the user's own view is displayed on the display unit may be selected by the user input unit.
10. An image modification method for a low-vision head-mounted electronic auxiliary vision device, the device comprising a user input unit, at least one image capturing unit, a storage unit, a processing unit and a display unit, characterized in that: the method comprises the following steps:
a: the at least one image capturing unit captures images outside the user's own field of view;
b: the processing unit performs pincushion distortion and reduction modification on the image of the external area;
c: and displaying the pincushion distortion and the reduced and modified image on a display unit in the visual field of the user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110810605.7A CN113393404A (en) | 2021-07-19 | 2021-07-19 | Low-vision head-wearing electronic auxiliary vision equipment and image modification method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110810605.7A CN113393404A (en) | 2021-07-19 | 2021-07-19 | Low-vision head-wearing electronic auxiliary vision equipment and image modification method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113393404A true CN113393404A (en) | 2021-09-14 |
Family
ID=77626324
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110810605.7A Pending CN113393404A (en) | 2021-07-19 | 2021-07-19 | Low-vision head-wearing electronic auxiliary vision equipment and image modification method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113393404A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114302129A (en) * | 2021-12-27 | 2022-04-08 | 杭州瑞杰珑科技有限公司 | Eyesight assisting method and system based on AR |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013160255A1 (en) * | 2012-04-23 | 2013-10-31 | Inria Institut National De Recherche En Informatique Et En Automatique | Display device suitable for providing an extended field of vision |
| CN107592521A (en) * | 2017-09-14 | 2018-01-16 | 陈乐春 | Panoramic view rendering method based on human eye vision feature |
| US20180081175A1 (en) * | 2016-09-21 | 2018-03-22 | Craig Hospital | Visual field enhancement system |
| CN108259838A (en) * | 2018-03-19 | 2018-07-06 | 杭州度康科技有限公司 | Electronic viewing aid and the image browsing method for electronic viewing aid |
| CN108519676A (en) * | 2018-04-09 | 2018-09-11 | 杭州瑞杰珑科技有限公司 | A kind of wear-type helps view apparatus |
| US20190180421A1 (en) * | 2017-10-31 | 2019-06-13 | Eyedaptic Inc. | Demonstration Devices and Methods for Enhancement for Low Vision Users & Systems Improvements |
| US20200111240A1 (en) * | 2018-10-05 | 2020-04-09 | Amitabha Gupta | Systems and methods for enhancing vision |
-
2021
- 2021-07-19 CN CN202110810605.7A patent/CN113393404A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013160255A1 (en) * | 2012-04-23 | 2013-10-31 | Inria Institut National De Recherche En Informatique Et En Automatique | Display device suitable for providing an extended field of vision |
| US20180081175A1 (en) * | 2016-09-21 | 2018-03-22 | Craig Hospital | Visual field enhancement system |
| CN107592521A (en) * | 2017-09-14 | 2018-01-16 | 陈乐春 | Panoramic view rendering method based on human eye vision feature |
| US20190180421A1 (en) * | 2017-10-31 | 2019-06-13 | Eyedaptic Inc. | Demonstration Devices and Methods for Enhancement for Low Vision Users & Systems Improvements |
| CN108259838A (en) * | 2018-03-19 | 2018-07-06 | 杭州度康科技有限公司 | Electronic viewing aid and the image browsing method for electronic viewing aid |
| CN108519676A (en) * | 2018-04-09 | 2018-09-11 | 杭州瑞杰珑科技有限公司 | A kind of wear-type helps view apparatus |
| US20200111240A1 (en) * | 2018-10-05 | 2020-04-09 | Amitabha Gupta | Systems and methods for enhancing vision |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114302129A (en) * | 2021-12-27 | 2022-04-08 | 杭州瑞杰珑科技有限公司 | Eyesight assisting method and system based on AR |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10867449B2 (en) | Apparatus and method for augmenting sight | |
| US20180104106A1 (en) | A system and method for displaying a video image | |
| EP2502410B1 (en) | A method for augmenting sight | |
| US10049599B2 (en) | System and method for assisting a colorblind user | |
| CN113391449B (en) | Intelligent vision expanding visual aid and intelligent vision expanding visual aid method | |
| CN113393404A (en) | Low-vision head-wearing electronic auxiliary vision equipment and image modification method thereof | |
| CN108398811A (en) | glasses, display server, display, display system and its working method | |
| CN113377210B (en) | Image display method, head-mounted electronic auxiliary vision device and readable medium | |
| CN110706164A (en) | Tubular visual field image deformation display method and glasses based on augmented reality | |
| CN110728651A (en) | Tubular visual field image deformation detection method based on augmented reality and glasses | |
| JP6887824B2 (en) | Image processing equipment, image processing methods and programs | |
| CN110536044B (en) | Automatic certificate photo shooting method and device | |
| CN111208964B (en) | Low vision aiding method, terminal and storage medium | |
| US20220414842A1 (en) | Head-mounted electronic vision aid device and visual distortion correction method thereof | |
| CN107578460B (en) | Image splicing progress display method | |
| CN113379722B (en) | Data acquisition system for nasal-temporal suppression position and degree and application method thereof | |
| JP2000123053A (en) | Spectacle wearing simulation method | |
| US20220148332A1 (en) | Appearance based dominant eye selector systems and methods for gaze estimation from passive imagery | |
| CN115877573A (en) | Display method, head-mounted display device, and storage medium | |
| CN111491104A (en) | Image shooting method, device and system and controller | |
| CN110584588A (en) | Method and device for detecting visual field defect | |
| CN112315753A (en) | Visual field expansion training device based on glaucoma late-stage disease and training method thereof | |
| CN110584587A (en) | Method and device for compensating visual field defect |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240131 Address after: Unit 102, Building C2, Phase I of the Biomedical Industry Park, No. 218 Xinghu Street, Suzhou Area, Suzhou Free Trade Zone, Jiangsu Province Applicant after: Aisiya Health Technology (Suzhou) Co.,Ltd. Country or region after: China Address before: 215123 unit 102, C2 building, phase I project, biomedical industrial park, 218 Xinghu street, Suzhou area, China (Suzhou) pilot Free Trade Zone, Suzhou, Jiangsu Province Applicant before: Aisiya Health Technology (Suzhou) Co.,Ltd. Country or region before: China Applicant before: BRILLIMEDICAL INTERNATIONAL Corp. Country or region before: U.S.A. |
|
| TA01 | Transfer of patent application right |