CN113709440A - Visual impairment auxiliary device and image processing method thereof - Google Patents
Visual impairment auxiliary device and image processing method thereof Download PDFInfo
- Publication number
- CN113709440A CN113709440A CN202110975878.7A CN202110975878A CN113709440A CN 113709440 A CN113709440 A CN 113709440A CN 202110975878 A CN202110975878 A CN 202110975878A CN 113709440 A CN113709440 A CN 113709440A
- Authority
- CN
- China
- Prior art keywords
- module
- image
- visual
- vision
- chip module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 208000029257 vision disease Diseases 0.000 title claims abstract description 23
- 238000003672 processing method Methods 0.000 title claims abstract description 14
- 206010047571 Visual impairment Diseases 0.000 title claims description 11
- 230000004393 visual impairment Effects 0.000 title claims description 10
- 230000004438 eyesight Effects 0.000 claims abstract description 35
- 230000000007 visual effect Effects 0.000 claims abstract description 27
- 238000013461 design Methods 0.000 claims abstract description 9
- 238000012545 processing Methods 0.000 claims abstract description 4
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 claims description 19
- 229910052710 silicon Inorganic materials 0.000 claims description 19
- 239000010703 silicon Substances 0.000 claims description 19
- 238000004891 communication Methods 0.000 claims description 7
- 230000002093 peripheral effect Effects 0.000 claims description 7
- 230000006735 deficit Effects 0.000 claims description 4
- 238000013507 mapping Methods 0.000 claims description 3
- 238000000034 method Methods 0.000 claims description 3
- 238000004806 packaging method and process Methods 0.000 claims description 3
- 230000003993 interaction Effects 0.000 claims description 2
- 239000011159 matrix material Substances 0.000 abstract description 10
- 230000000694 effects Effects 0.000 abstract description 3
- 238000005259 measurement Methods 0.000 abstract description 2
- 230000003287 optical effect Effects 0.000 description 26
- 238000010586 diagram Methods 0.000 description 5
- 150000001875 compounds Chemical class 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012634 optical imaging Methods 0.000 description 2
- 208000010415 Low Vision Diseases 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 238000010030 laminating Methods 0.000 description 1
- 230000004303 low vision Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 208000001491 myopia Diseases 0.000 description 1
- 238000012536 packaging technology Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
Abstract
The invention discloses a vision disorder auxiliary device and an image processing method thereof, wherein the device comprises: a lens; the 3D vision ranging chip module; an image sensor; the image sensor collects image data, the image sensor is connected with the 3D visual ranging chip module, the 3D visual ranging chip module obtains the image data, and the image data is converted into analog signals/digital signals. The auxiliary device and the image processing method adopt a matrix type 3D distance measurement visual chip module, and the visual chip module can realize the miniaturization design of the visual disorder auxiliary device. The auxiliary device and the image processing method adopt an intelligent chip, and the use effect of the auxiliary device is improved and the cost is reduced through an image recognition processing model carried by the intelligent chip.
Description
Technical Field
The invention relates to the technical field of vision auxiliary tools, in particular to a vision disorder auxiliary device and an image processing method thereof.
Background
Most of the vision aids for low vision patients in the current market are optical vision aids. Optical typologies can be divided into: far-vision optical typoscope and near-vision optical typoscope. The far-use optical typoscope can enlarge a far target and improve the far vision. The disadvantage is that the field of vision is obviously reduced and the user can not wear the glasses to walk. The near-use optical typoscope mainly comprises a vertical magnifier, a handheld electronic typoscope and a desktop electronic typoscope. The vertical magnifier is mainly used at home, and is simple and convenient to operate. The vertical magnifier has the defects that the magnification is fixed, and the higher the power of the convex lens is, the closer the reading distance is. The magnification of the handheld electronic typoscope can be changed, and the reading distance can be changed within a certain range, so that the handheld electronic typoscope is suitable for reading fine materials. But it needs to be moved by hand when in use, and the visual field is small. The desktop electronic typoscope has larger magnification than a handheld electronic typoscope, has higher image quality and can adjust the range of the visual field. But it is bulky and inconvenient to carry.
The above prior art has the following problems: (1) the vision field of the remote vision aid is obviously reduced in the using process, the use is inconvenient, and the remote vision aid cannot be worn to walk generally. (2) The operation of the visual aid is inconvenient when the user holds the visual aid by hands, and the visual aid needs to be continuously moved by hands. The desktop typoscope is inconvenient to carry, and the universal function of the product is not strong, and the like. Compared with the common typologies of visual aids, the wearable glasses type visual aids have great advantages, but can not meet all-weather requirements of users.
Disclosure of Invention
One of the objectives of the present invention is to provide an auxiliary device for visual impairment and an image processing method thereof, wherein a matrix type 3D ranging vision chip module is adopted in the auxiliary device and the image processing method, and the vision chip module can realize the miniaturization design of the auxiliary device for visual impairment.
Another object of the present invention is to provide a vision disorder assisting device and an image processing method thereof, in which a semi-transparent optical module is used, and optical distortion is compensated by software using an optical lightweight design, so as to improve the experience effect of the vision disorder assisting device.
Another object of the present invention is to provide a vision disorder assisting apparatus and an image processing method thereof, in which an intelligent chip is used, and an image recognition processing model carried by the intelligent chip is used to improve the use effect of the assisting apparatus and reduce the cost.
In order to achieve at least one of the above-mentioned objects, the present invention further provides a vision disorder assisting device comprising:
a lens;
the 3D vision ranging chip module;
an image sensor;
the image sensor collects image data, the image sensor is connected with the 3D visual ranging chip module, the 3D visual ranging chip module obtains the image data, and the image data is converted into analog signals/digital signals.
According to a preferred embodiment of the present invention, the 3D visual ranging chip module comprises a silicon optical circuit, and the silicon optical circuit comprises a photon frequency modulation module, a photon scanning module and a photon emission module, and is configured to receive a sensor signal.
According to another preferred embodiment of the present invention, the silicon photonic circuit adopts an ON-DIE manner to integrally design the structure and connection manner of the photonic frequency modulation module, the photonic scanning module and the photonic emission module, so as to reduce the design volume and power consumption of the silicon photonic circuit.
According to another preferred embodiment of the present invention, the 3D vision ranging chip module comprises an analog circuit module, the analog circuit module acquires an image and detects a distance between the acquired image, and the analog circuit module is connected to the silicon photonic circuit and is configured to drive the silicon photonic circuit.
According to another preferred embodiment of the present invention, the 3D visual ranging chip module comprises a digital circuit module, and the digital circuit module stores therein image processing logic and algorithms for performing image fitting and mapping after converting analog signals into digital signals.
According to another preferred embodiment of the present invention, the digital circuit module comprises at least one peripheral circuit communication interface, and is connected to other peripheral circuits through the peripheral circuit communication interface, and realizes interaction with the peripheral circuits.
According to another preferred embodiment of the present invention, the 3D visual ranging chip module is packaged in an O-SIP packaging manner, and the 3D visual ranging chip module has a weight of less than 2g and a power consumption of less than 100 mW.
In accordance with another preferred embodiment of the present invention the vision aid includes at least one distance sensor mounted above a lens mounted on a frame and a frame.
According to another preferred embodiment of the present invention, the foot of the frame has a power supply battery, and the power supply battery is connected to the 3D visual ranging chip module and the distance sensor and is used for supplying power to the distance sensor and the 3D visual ranging chip module.
In order to achieve at least one of the objects, the present invention further provides a vision disorder assisting apparatus image processing method, comprising the steps of:
the image sensor acquires image information, and the distance sensor acquires distance information of an image;
converting the image information and the distance information into analog signals/digital signals;
inputting the converted digital signal into a 3D visual ranging chip module, wherein an image recognition model and an image fitting algorithm stored in the chip module execute image recognition and image fitting;
and visually displaying the identified and fitted images.
Drawings
Fig. 1 is a schematic structural view showing a vision disorder service apparatus according to the present invention.
Fig. 2 is a block diagram of a circuit of a vision impairment services device according to the present invention.
Fig. 3 is a flowchart illustrating an image processing method of a force disorder assistance apparatus according to the present invention.
The system comprises a spectacle frame-10, an image sensor-11, a 3D vision distance measurement chip module-12, a distance sensor-13, a display module-14, a spectacle leg-15, a battery module-16 and a lens-20.
Detailed Description
The following description is presented to disclose the invention so as to enable any person skilled in the art to practice the invention. The preferred embodiments in the following description are given by way of example only, and other obvious variations will occur to those skilled in the art. The basic principles of the invention, as defined in the following description, may be applied to other embodiments, variations, modifications, equivalents, and other technical solutions without departing from the spirit and scope of the invention.
It is understood that the terms "a" and "an" should be interpreted as meaning that a number of one element or element is one in one embodiment, while a number of other elements is one in another embodiment, and the terms "a" and "an" should not be interpreted as limiting the number.
Referring to fig. 1 to 3, the present invention discloses a vision disorder service device and an image processing method thereof, the device uses a matrix type ranging chip module with ultra-low power consumption, preferably a matrix type 3D ranging vision chip module, the optical module is designed with light weight through structural arrangement, and software is used to compensate optical distortion caused by the light weight optical design, so that optical acquisition and display meet the requirement of vision disorder.
Specifically, matrix 3D range finding vision chip module includes silicon optical circuit, wherein silicon optical circuit includes photon frequency modulation module, photon scanning module and photon emission module, each module of silicon optical circuit constitutes receiving sensor's construction, wherein photon frequency modulation module adopts the mode realization of ON-DIE (laminating) between photon scanning module and the photon emission module, and its compound mode is highly integrated's device compound mode, reduces whole volume, cost and consumption by a wide margin. It should be noted that the silicon optical circuit needs to combine the wavelength to perform different types of photon frequency modulation modules, photon scanning modules and photon emission modules in the prior period.
Matrix 3D range finding vision chip module includes chip analog module, analog module connects silicon optical circuit is used for the drive silicon optical circuit work makes silicon optical circuit can launch the range finding photon and receive the reflection photon. Silicon optical circuit is after acquireing the photon of transmission, through analog module converts the photoelectric signal of sensor into analog signal, and analog module still is used for converting analog signal into digital signal for accomplish relevant driven debugging, analog module is integrated the encapsulation inside the system, can practice thrift holistic wiring area and reduce the consumption by a wide margin.
Matrix 3D range finding vision chip module includes chip digital module, chip analog module is connected to digital module, just digital module includes a plurality of external communication interfaces for realize the communication with external network, digital module preserves including but not only limited to image recognition algorithm, figure fitting algorithm, figure mapping algorithm. And the mature MCU packaging technology in the prior art is adopted for unified packaging, so that the power consumption of the system can be reduced.
The vision disorder service device comprises an image sensor, the device is of a glasses-shaped structure, the image sensor is installed in the front of the device, a lens is further arranged in the front of the device, an optical imaging system is arranged on the inner side of the lens, the device further comprises a display module, the display module is connected with the optical imaging system, and the image sensor is connected with the display module and used for displaying on the display module. The device includes mirror holder and lens, wherein mirror holder the place ahead installation the lens, the lens design as an organic whole, image sensor install in mirror holder the place ahead for catch the image information in mirror holder the place ahead, install the mirror holder bottom matrix 3D range finding vision chip module, just matrix 3D range finding vision chip module can realize realizing the hidden installation through integrating the assembly be equipped with on the mirror foot of mirror holder outside communication interface, outside communication interface connects matrix 3D range finding vision chip module. The tail of mirror foot still has pluggable battery module, battery module connects 3D range finding vision chip module and image sensor, visual disturbance service device includes distance sensor, just battery module connects distance sensor is used for right 3D range finding vision chip module, image sensor and distance sensor power supply.
According to the invention, through integrated ultra-small optical chip system-in-package (O-SIP), the length, width and height of the 3D ranging vision chip module can be smaller than 10 x 5 x 3mm, the weight of the 3D ranging vision chip module is smaller than 2g, and the overall power consumption is smaller than 100 mW. It should be noted that the chip described in the present invention can be designed to be light-weighted by using a structure including, but not limited to, a LIDAR chip in combination with a package. And an optical distortion compensation algorithm is stored in the chip to compensate the optical distortion caused by the lightweight structural design.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
It will be understood by those skilled in the art that the embodiments of the present invention described above and illustrated in the drawings are given by way of example only and not by way of limitation, the objects of the invention having been fully and effectively achieved, the functional and structural principles of the present invention having been shown and described in the embodiments, and that various changes or modifications may be made in the embodiments of the present invention without departing from such principles.
Claims (10)
1. A vision impairment assistance device, the device comprising:
a lens;
the 3D vision ranging chip module;
an image sensor;
the image sensor collects image data, the image sensor is connected with the 3D visual ranging chip module, the 3D visual ranging chip module obtains the image data, and the image data is converted into analog signals/digital signals.
2. The visual impairment assist device of claim 1, wherein the 3D visual ranging chip module comprises a silicon photonic circuit comprising a photon frequency modulation module, a photon scanning module and a photon emission module for receiving sensor signals.
3. The visual impairment assisting device of claim 2, wherein the silicon photonic circuit adopts an ON-DIE manner to integrate the structure and connection manner of the photon frequency modulation module, the photon scanning module and the photon emission module, so as to reduce the design volume and power consumption of the silicon photonic circuit.
4. The visual impairment assistant device of claim 2, wherein the 3D visual ranging chip module comprises an analog circuit module, the analog circuit module acquires images and detects the distance of the acquired images, and the analog circuit module is connected to the silicon photonic circuit and is used for driving the silicon photonic circuit.
5. The visual impairment support device of claim 1, wherein the 3D vision ranging chip module comprises a digital circuit module, and image processing logic and algorithms are stored in the digital circuit module for converting analog signals into digital signals and performing image fitting and mapping.
6. A visual impairment support device according to claim 5, wherein the digital circuit module comprises at least one peripheral circuit communication interface via which other peripheral circuits are connected and which enables interaction with the peripheral circuits.
7. The visual impairment assisting device of claim 1, wherein the 3D visual ranging chip module is packaged in an O-SIP packaging manner, and the 3D visual ranging chip module has a weight of less than 2g and a power consumption of less than 100 mW.
8. A vision impairment assistance device as claimed in claim 1, wherein the vision assistance device comprises at least one distance sensor mounted above a lens mounted on a frame.
9. A vision impairment assisting device according to claim 1, wherein the foot of the frame has a power supply battery, and the power supply battery is connected with the 3D vision distance measuring chip module and the distance sensor and is used for supplying power to the distance sensor and the 3D vision distance measuring chip module.
10. An image processing method for a vision disorder assisting apparatus, the method comprising the steps of:
the image sensor acquires image information, and the distance sensor acquires distance information of an image;
converting the image information and the distance information into analog signals/digital signals;
inputting the converted digital signal into a 3D visual ranging chip module, wherein an image recognition model and an image fitting algorithm stored in the chip module execute image recognition and image fitting;
and visually displaying the identified and fitted images.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110975878.7A CN113709440A (en) | 2021-08-24 | 2021-08-24 | Visual impairment auxiliary device and image processing method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110975878.7A CN113709440A (en) | 2021-08-24 | 2021-08-24 | Visual impairment auxiliary device and image processing method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113709440A true CN113709440A (en) | 2021-11-26 |
Family
ID=78654441
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110975878.7A Pending CN113709440A (en) | 2021-08-24 | 2021-08-24 | Visual impairment auxiliary device and image processing method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113709440A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101318491A (en) * | 2008-05-14 | 2008-12-10 | 合肥工业大学 | Built-in integrated visual sensation auxiliary driving safety system |
| CN101404738A (en) * | 2008-11-06 | 2009-04-08 | 西安交通大学 | Stereo glasses television apparatus supporting mobile television receiving function |
| US20140009591A1 (en) * | 2006-12-19 | 2014-01-09 | Imi Intelligent Medical Implants Ag | Vision aid with three-dimensional image acquisition |
| WO2016054860A1 (en) * | 2014-10-10 | 2016-04-14 | 上海交通大学 | Head wearing type vision auxiliary system for patient with vision disorder |
| CN106772793A (en) * | 2017-01-20 | 2017-05-31 | 北京邮电大学 | Integrated-type luminous power beam splitter on a kind of piece based on silicon substrate Meta Materials |
| CN109425866A (en) * | 2017-09-01 | 2019-03-05 | 姚晓天 | Using the ligh-ranging radar (LIDAR) and optical frequency domain reflectometer (OFDR) system of optical-electronic oscillator (OEO) |
| CN109782299A (en) * | 2019-02-14 | 2019-05-21 | 深圳市迈测科技股份有限公司 | A kind of solid-state laser radar installations |
| CN111938608A (en) * | 2020-09-15 | 2020-11-17 | 安徽理工大学 | AR (augmented reality) glasses, monitoring system and monitoring method for intelligent monitoring of old people |
| CN112859338A (en) * | 2021-01-14 | 2021-05-28 | 无锡集沁智能科技有限公司 | Night blindness patient vision auxiliary equipment based on head-mounted typoscope and control method thereof |
| US20210240988A1 (en) * | 2018-05-28 | 2021-08-05 | Samsung Life Public Welfare Foundation | Visual aid device and visual aid method by which user uses visual aid device |
-
2021
- 2021-08-24 CN CN202110975878.7A patent/CN113709440A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140009591A1 (en) * | 2006-12-19 | 2014-01-09 | Imi Intelligent Medical Implants Ag | Vision aid with three-dimensional image acquisition |
| CN101318491A (en) * | 2008-05-14 | 2008-12-10 | 合肥工业大学 | Built-in integrated visual sensation auxiliary driving safety system |
| CN101404738A (en) * | 2008-11-06 | 2009-04-08 | 西安交通大学 | Stereo glasses television apparatus supporting mobile television receiving function |
| WO2016054860A1 (en) * | 2014-10-10 | 2016-04-14 | 上海交通大学 | Head wearing type vision auxiliary system for patient with vision disorder |
| CN106772793A (en) * | 2017-01-20 | 2017-05-31 | 北京邮电大学 | Integrated-type luminous power beam splitter on a kind of piece based on silicon substrate Meta Materials |
| CN109425866A (en) * | 2017-09-01 | 2019-03-05 | 姚晓天 | Using the ligh-ranging radar (LIDAR) and optical frequency domain reflectometer (OFDR) system of optical-electronic oscillator (OEO) |
| US20210240988A1 (en) * | 2018-05-28 | 2021-08-05 | Samsung Life Public Welfare Foundation | Visual aid device and visual aid method by which user uses visual aid device |
| CN109782299A (en) * | 2019-02-14 | 2019-05-21 | 深圳市迈测科技股份有限公司 | A kind of solid-state laser radar installations |
| CN111938608A (en) * | 2020-09-15 | 2020-11-17 | 安徽理工大学 | AR (augmented reality) glasses, monitoring system and monitoring method for intelligent monitoring of old people |
| CN112859338A (en) * | 2021-01-14 | 2021-05-28 | 无锡集沁智能科技有限公司 | Night blindness patient vision auxiliary equipment based on head-mounted typoscope and control method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10613625B2 (en) | Eyeball tracking module for video glasses | |
| US20140204021A1 (en) | Eyeglasses type operation device, eyeglasses type operating system and electronic devices | |
| CN112214106B (en) | High-precision anti-interference VR system and operation method | |
| CN103246062A (en) | Novel wearing type intelligent electronic equipment | |
| CN113709440A (en) | Visual impairment auxiliary device and image processing method thereof | |
| CN111880301B (en) | Multifunctional all-weather telescope with common aperture fusion | |
| WO2023231674A1 (en) | Driving method for liquid crystal grating, and display apparatus and display method for display apparatus | |
| CN210223049U (en) | Panorama integration vehicle type recognizer | |
| CN107015364A (en) | A kind of intelligent glasses with 3D imaging functions | |
| CN216487059U (en) | Intelligent interactive display device with holographic effect | |
| CN205945932U (en) | Big area array CCD imaging system of high -speed low noise | |
| CN106610538A (en) | Intelligent glasses | |
| CN105898122B (en) | A kind of photoelectricity sensory perceptual system | |
| CN211557362U (en) | Front-end image acquisition device capable of adapting to image scene | |
| CN100526969C (en) | Multifunctional integrated digital picture processing system | |
| CN206619135U (en) | A kind of Quick Response Code reading code PDA | |
| CN206193352U (en) | Come back and show navigation head based on transparent OLED screen | |
| KR102339358B1 (en) | Vehicular device for improving visibility in adverse weather conditions | |
| CN219065887U (en) | Head-mounted display capable of controlling picture zooming through touch control slide bar | |
| CN106610539A (en) | Multimedia glasses | |
| CN216696881U (en) | Vehicle-mounted head-up display device | |
| CN107015365A (en) | A kind of new line display device and vehicle | |
| CN218830421U (en) | Electronic magnifier | |
| CN217133467U (en) | Monocular telescope with night vision function | |
| CN217982570U (en) | Laser radar and camera integrated machine for fusion perception of traffic flow information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211126 |
|
| RJ01 | Rejection of invention patent application after publication |