TW541504B - Digital low-vision auxiliary system with a respective adjusting function - Google Patents

Abstract

There is provided a digital low-vision auxiliary system with a respective adjusting function. Its structure comprises: an original image input, a system processing core and an adjusted image output terminal, which is characterized in that: the system processing core is able to perform an adjustment in vision dedicated to a respective low-vision patient, determine image contrast strengthening parameters using linear and nonlinear methods to simulate the images viewed by the vision impairment sufferer, and further adjust the image contrast strengthening parameters suitable for the user based on the image strengthened effect desired by the user, thereby strengthening the contrast information of the image and providing the optimal image effect. The system can be applied in an electronic image enlarging system, and adding into Internet function for use as a system for the vision impairment sufferer to read in lecture. Furthermore, in consideration of outdoor activity and increasing the convenience for the user, DSP can be used to add an exclusive image contrast strengthening function into a portable auxiliary tool, thereby providing more convenience and practicability to the vision impairment sufferer.

Description

541504 V. Description of the invention (1) The present invention relates to a digital amblyopia image assistance system with individual adjustment functions, especially a visually impaired person can adjust the contrast enhancement parameters of the image that suits him according to the degree of attenuation of his vision. It is used to enhance the contrast information of the image to provide the best image effect. The system can be applied to electronic expansion systems and the function of joining the Internet, making it a reading system for visually impaired people in the classroom. At the same time, in order to go out and increase the convenience of use, you can use a digital signal processor ( DSP), which adds the exclusive image contrast enhancement function to the portable assistive device, can bring greater convenience and practicality to the visually impaired. Most people need to receive sensory messages to communicate with her / their people around them. This has a very important impact on our daily lives. Compared to touch, taste and smell, we often live Most of these functions rely heavily on visual and auditory functions. Our sensory function has the function of acquired adjustment ability. Usually when one of the two functions is lost, the other function will automatically enhance its function to make up for the deficiency, and when both of them are injured and lose their function, they will turn. Instead, use the remaining sensory functions. When a person unfortunately loses his sensory functions, especially vision and hearing, it is more likely to cause a decline in life function and quality, especially in terms of communication with people, message transmission, athletic ability, work, leisure, etc. The reasons for the loss of sensory function may be due to congenital inheritance, acquired diseases or accidents, especially in Taiwan, which has entered an aging society. Convenient, effective and inexpensive rehabilitation aids will improve the productivity and activity of these people. It is also important because it is an important factor in quality of life. With the gradual popularization of computer technology, the function of assistive devices for the disabled has gradually changed from a relatively low level of science.

Page 5 541504 5. Description of the invention (2) Application to high technology to assist users in normal, safe and normal restoration of their proper functions in signal transmission, movement and work. Although the application of technology is aimed at mass production to reduce costs, the design of assistive devices should still be based on the personal use point of view. Therefore, the design of assistive devices for the disabled must be accompanied by a deep understanding of personal medical history. Better results include age, category, degree of sensory loss and more important educational and cultural experiences. In the definition of Vision impairment, it refers to Acuity 'Clarity of vision and field vision. A normal person's vision is generally 20/20 ~ 20/40, and the field of vision is about 160. Between 180 ° horizontal and 120 ° vertical >, if the measurement proves that it is below this range, it can be considered as a visual impairment. Legally blindness is for visual acuity below 20/2 0 or field of vision below 20 degrees after the bridge. Usually, even if a person is defined as blind, he may still have a slight vision, but whether the remaining vision can be used normally is related to the type of vision impairment and the age of occurrence, and in a lot of cases, by appropriate Lighting conditions and methods to reduce glare (G 1 are) have been improved. At the same time, there is still a lot of vision available between full blindness and legal blindness, and amblyopia (L owvisi ο η) is a term used for vision conditions with incomplete visual function but better than full blindness, according to the definition of experts π Amblyopia π is a visual impairment of the same degree as f, but at the same time, it has considerable available residual vision. Because how each person uses visual aids to improve the use of their residual vision, it has a great relationship with the state of their visual impairment, such as the age of onset:

Page 6 541504 V. Description of the invention (3) Visual impairments at different ages can cause differences in learning abilities, thinking patterns, and other specific and abstract objects, skills, and concepts. Visual field lesions caused by the disease: the loss of central visual field caused by macular degeneration in the mouth of Shikou will affect its reading ability; the peripheral visual field loss caused by cataract (retinitis pigmentosa) and its ability to move are somewhat different influences. Therefore, how to effectively use engineering technology to design and manufacture assistive devices suitable for the special circumstances of individual visually impaired people to increase the effectiveness of their remaining vision is a considerable challenge. This must integrate efforts at different levels of physiology, pathology, psychology, society, etc., so that engineering technology can make concrete contributions in this field. Assistive devices mostly use touch or sound to increase the vitality of the visually impaired, but the definition of visually impaired includes many degrees of amblyopia (1 0w-visi ο η) and blindness (b 1 ind), A large proportion of the visually impaired are progressive amblyopia. It is generally believed that if good visual information can be given at this stage, whether it is young or older, the visually impaired will be in the later rehabilitation. Can be of considerable help. At present, the auxiliary systems developed for the visually impaired visually impaired are mainly based on the functions of magnification and telephoto. The following two technologies can be used to achieve their goals: optical amplifiers and electronic expanders. The following will focus on the development status of these two technologies. Finishing description: Optical Aids (Optical aids): It is mainly composed of optical systems, including special glasses, handheld or stand-up telescopes or telescopes | 丨 system. Most of these systems are mainly assisting reading, so the main design considerations are proper and comfortable reading distance, location and coverage. But in need

Page 7 541504 V. Description of the invention (4) In the case of high magnification, because of the inverse relationship between the field of view and the magnification, it usually needs to be very close to the object or file to achieve the purpose, which usually causes considerable inconvenience to the user, including Inconvenience caused by body position adjustment (bent over), insufficient illumination, visual discomfort, etc. The same situation also exists when using a computer screen, for example: how to effectively provide a complete picture of a learning document in the field of vision and speed up the performance of verbatim reading are extremely important research issues. Therefore, X-y controllable scanning platform is used in some systems. While some use the type of glasses to achieve magnification and telephoto effects, but usually at high magnification, it will cause users to feel dizzy and nauseous (caused by the asymmetry between the vestibular system and vision), which is usually also There are applications for putting a small mirror > (Minifier). The application of the glasses-type telescope is generally suitable for users who are stationary (reading a book or television). In the mobile room, a design similar to a bifocal lens is required to make the part of the telescope lens in a defocused position, only when looking into the distance. It is only used. In addition, there is currently an application of automatic zoom. Finally, the important consideration for users is weight, which can also be expected to continue to improve with the advancement of materials and electronic technology. For control over the improvement of illumination, there are currently battery-powered head-mounted lighting devices to improve the disadvantages of high-end use under high magnification. Electronic magnifier and Image enhancement: In order to overcome the problem of large magnification in optical imaging, there are currently quite a few reading systems, and CCTVs can be used to increase Reading ability of the visually impaired. In the desktop system, it is mainly composed of cameras, lighting systems and screens.

Page 8 541504 V. Description of the invention (5) Magnification of about 50 times. The files to be read are placed on the X-y dual-axis scanning platform to facilitate scanning by the camera. In most systems, users can freely adjust the contrast they need to reduce glare. In addition, they can be reversed for light scattering problems in elderly patients such as cataracts. At present, there are quite a few handheld electronic expander systems to choose from, but they usually have lower magnifications, and they must even be used in conjunction with rehabilitation education to achieve the best results. At present, in the development of virtual reality, there has been the use of (Visor) or Goggle Mounted Display (GMD) as a replacement for display screens. Although it is not popular because of its high price, it has considerable development potential. In addition to the efforts in the above directions, visual scientists will also further understand the vision system and apply it to the new generation of system design, so that the adjustment of the system is no longer limited to the adjustment of magnification and contrast, which includes complex Function parameters are adjusted to conform to the visual characteristics of individual visually impaired people, and the new developments such as remaping the image to fit their remaining field of vision. In short, the current technology for amblyopia is to effectively use contrast improvement and lighting. The adjustment of the situation is the primary goal. Although many of the above problems can be improved by the use of these two methods, the problem of adaptability still needs to be further breakthrough. In view of the above-mentioned shortcomings of the optical amplifiers and electronic amplifiers, the inventor felt that they were not perfect, and exhausted his mind to research and overcome them. Based on his accumulated experience in the industry for many years, he developed a tool with Digital amblyopia image assistance system with individual adjustment function, especially a kind of visual adjustment for amblyopia patients with individual φ, using linear and non-linear methods to simulate the image of the visually impaired to determine the contrast enhancement parameters of the image, and Can

541504 V. Description of the invention (6) According to the image enhancement effect required by the user, adjust the image contrast enhancement parameters that are suitable for them to enhance the contrast information of the image and provide the best image effect; and the system can be applied to electronic expansion The system and the function of adding the Internet make it a reading system for the visually impaired in the classroom. At the same time, in order to take care of going out and increase the convenience of use, you can use a digital signal processor (DSP) to enhance the exclusive image contrast. The functions are added to the portable assistive device, which can bring greater convenience and practicality to the visually impaired. Therefore, the main purpose of the present invention is to design a digital amblyopia image assistance system with individual adjustment functions, especially a visually impaired person can adjust the image contrast ratio of 1 to 1 according to the degree of attenuation of his vision. , Used to enhance the contrast information of the image to provide the best impact image effect; and the system can be applied to the electronic expansion system, the function of adding the Internet, making it a visually impaired person in the classroom teaching reading system, and at the same time Considering going out and increasing the convenience of use, a digital signal processor (DSP) can be used to add the exclusive image contrast enhancement function to the portable assistive device, which can bring greater convenience and practicality to the visually impaired Sex. To achieve the above object, the present invention is implemented as follows: a digital amblyopia image assistance system with individual adaptation functions, the architecture of which is at least composed of: an original image input, a system processing core, and an adjusted image output terminal; The feature is that the system's processing core can make visual adjustments for individual patients with amblyopia, and use linear and non-linear methods to simulate the images seen by the visually impaired to determine the contrast enhancement parameters of the image. Users need the image enhancement effect, adjust the image contrast enhancement parameters that are suitable for them to enhance the contrast information of the image and provide the best image effect;

Page 10 541504 V. Description of the invention (7) The system can be applied to the electronic expansion system and the function of joining the Internet, making it a reading system for the visually impaired in the classroom. At the same time, in order to take care of going out and increase the use of Convenience, you can use a digital signal processor (DSP) to add the exclusive image contrast enhancement function to the portable assistive device, which can bring greater convenience and practicality to the visually impaired. In order to make your reviewing committee understand the purpose, features and effects of the present invention, the following specific examples and the accompanying drawings will be used to describe the present invention in detail. The description will be as follows: The present invention will be directed to visual impairment According to the existing residual vision, adaptive image enhancement processing can be performed, and the contrast enhancement parameter of each user's image can be determined according to the degree of visual loss of different users and the image that can be analyzed by simulating the human visual system. This parameter can be used It shows the enhancement degree of the high-frequency information contrast value in the image information to improve the ability of the user to analyze the image information. Please refer to FIG. 1, which is a system diagram of the overall structure of the present invention. As shown in the figure: The electronic reading assistance system is applied to: electronic expansion system architecture 1, Internet-based teaching reading system 2 and portable reading system 3; the electronic expansion system architecture 1, as shown in Figure 2 Shown: It is divided into hardware part 1 1 and personal computer processing software part 1 2. In the hardware part 1 1 The main function of the system is to obtain external image information, so we will design its hardware-based vision aid for the reading and use of the visually impaired, and match the software part of the exclusive image processing 1 2 To improve the ability of visually impaired people to recognize image information, and

(Page 11) 41504 V. Description of the invention (8) Equipped with a computer (PC display 1 to 3 are used for electronic reading, which). The hardware image is used as the main principle to make it appropriate. It is easier to connect the hardware 1 1 with the control I (PC) to obtain the image data (the image system) 1 3 1 or the output image. The sub-expansion system architecture is divided into hard points 1 1 Mainly, and enhance the image of the reading book and part 1 1, the system (C ο nt 1 3 1, which is used by the back-end software (Image Sy lens for photographic images immediately, users can go through image processing 1 1 process) The figure is as shown in Figure 4 1 1

It is head-mounted glasses (GMD) 1 3 2 and other display to facilitate reading and use of visually impaired people. The research and development of 1 focuses on providing visually impaired people's reading 1 1 and software 1 2 (Figure 3 is able to control the reading platform and obtain external image information in real time and pass it to the image of software part 12 to generate visually impaired people. Image information that can be recognized by the elderly. It is composed of an imaging system 1 rol system 1 1 2, and the purpose can be programmed and controlled for easy processing. stem) 1 1 1 is a magnified image captured by a high-magnification machine 1 1 1 1 and converted to a digital signal by an image capture card, so that (PC) 1 3 1 is used as the image information image 1 2. (Shown in the stream of Image System 1 1) and its CCD camera lens 1 1 magnification, and the maximum magnification of the total system can be obtained using the following formula: Optical magnification magnification): 0.84 ~ 0.084 times

Page 12 541504 V. Description of the invention (9) Dimensions of the starting screen CCZ?

System magnification = optical magnification X In this system, for example, the screen size of the displayed image is 17 忖, and the size of the sensor is 6mm; the maximum magnification of this system can be obtained by formula calculation, which is 60 times. System amplification requirements. This control system (Control System) 1 1 2, in order to allow users to get a better operating environment, so the user's reading platform 1 1 2 1 adopts an electric mobile platform, and is equipped with appropriate lighting control 1 1 2 2 So that users can use and read it. (The flow chart of its Control System 12 is shown in Figure 5.) And the reading mobile platform 1 1 2 1 is a motorized X-Y-axis moving platform for users to easily read books. , Which allows users to move the appropriate book according to their reading speed. And (PC) 1 3 1 serial port can be used to output control signals to achieve platform control functions. In order to allow users to easily control the reading platform, a set of programs that can directly grasp the arrow keys is also developed, allowing users to directly use the arrow keys on the peripheral system 1 1 2 3 keyboard to control the reading platform 1 1 2 1 Simplified procedures for reading platform 1 1 2 1 operations. The lighting control 1 1 2 2

Page 13 54Γ504 V. Description of the Invention (ίο) Light is mainly used in conjunction with filters to achieve polarization polarized light sources. In the software part 12, what the human sees is no longer the information of the original image. Due to the difference, the ability to see the image should not be the same, and the ability of the information of visual decline caused by visual diseases is reduced. As people get older, their vision will gradually lose. High-frequency imaging can only see near objects and increase the patient's ability to pre-process the image according to the patient's vision and enhance the contrast information of the image. Will read books and Identify pictures in books. Therefore, we measure the visual impairment of the visually impaired by each patient, and use the analyzed image to determine the contrast enhancement of the image.) This parameter is used to provide the contrast information of the adaptive image. The enhanced image is used for identification (see Figure 6). Therefore, the software system 121 and the image processing core 1 2 2 are mainly used to quantify the patient's vision and simulate the image in the patient's eyes. Then add this contrast enhancement parameter 1 2 1 2 2 so that the physical core 1 2 2 captured by the hardware part 1 1 is used for image contrast enhancement to the optimal lighting conditions. The shadows included are the same, retreat, and long. For the attenuation of the information, it is necessary to increase the score of the unit 1 in the parameterization of the perceptual simulation. The unit 1 determines the implantation of the image theory. The image data will especially make the visual sense of the patient's electronic system. The reduced-range output image can be 2 2 messages, and its personal view is that they are visually impaired, and the proper sleep can be used to expand the characteristics of the system. The system like the enhanced strong 4 dagger shadow obstacle is divided into the top 7), Degree 1 2 The image contrast processing core is immediately changed from 1 to the actual obscuration of the characteristics. Obtaining external disturbances and old age causes other disturbances. If the images can be easily integrated, and the root can be solved to a degree like the two-frequency vision system front system 11 ， Enhance Samson 1 2 Enhance the image at the image

Page 14 541504 V. Description of the invention (11) Contrast intensity of the boundary part in the image. In the front-end system 1 2 1, the image contrast enhancement parameter 1 2 1 in the image processing core 1 2 2 is mainly provided. Therefore, the function of the front system 1 2 1 should first energize the patient's visual loss 1 2 1 1, and simulate the image seen by the patient according to the degree of visual loss 1 2 1 1, and then process the shadow processing core 1 The image with enhanced boundary contrast intensity in 2 2 is then simulated by the image seen by the patient to obtain the optimal enhancement parameter 1 22 1. The degree of visual acuity attenuation 1 2 1 1 can be regarded as the sum of the spatial filter characteristics of different bandwidths in the human visual system, and the visual acuity can be measured by the graph of sinusoidal grating multiplied by the gaussian function (called Gabor function). For the smallest stimulus intensity in space frequency, its reciprocal is the sensitivity to unit pulse stimulation. The contrast sensitivity at many spatial frequencies can be collectively referred to as the contrast sensitivity function (C ο ntrast Sensitivity Function for short: CSF). We can know the decline of visual acuity for different spatial frequencies under unit pulse stimulation according to the CSF of the patient (Figure 8 is the result of actual measurement). In addition, the image of the patient is simulated based on the CSF of the visual system obtained from the sinusoidal grating pattern. The value of the CSF can be used to indirectly convert and use it to simulate the image of the patient. The simulation method can be divided into linear and non In a linear fashion, these two simulation methods can be used to simulate cataract patients and patients with macular degeneration, respectively.

Page 15 541504 V. Description of the invention (12) In determining the contrast enhancement parameters 1 2 1 2 of the image, the correlation coefficient between the image seen by the simulated patient and the image before the simulation is used. Correlation coefficient between scene multi-image and unenhanced image; use the value between the two to find an optimal image contrast enhancement parameter value 1 2 2 1. In this linear simulation method, the ratio of the patient's CSF to the normal person's CSF is a normal contrast sensitive function (normailized CSF; NCSF), and the linear simulation method can be regarded as a transfer function of the optical characteristics in the crystalline lens of cataract patients, so NCSF is used as The characteristics of the patient's image filter can be used to simulate the image information seen by cataract patients (Figure 9 is the result of the simulation). This non-linear simulation method is used to simulate the image seen by patients with macular degeneration. Macular degeneration (macu 1 ar degeneration) is a small spot in the center of the retina called the macula. It suffers damage and damage, so it loses the resolution of high-frequency components of the image, making the center of the image blurred, but other areas of the retina The images are still clearly visible, and patients with macular degeneration have trouble reading or near vision. The human visual system is the addition of filters that are seen in many different frequency bands,

Page 16 541504 V. Description of the invention (13) Therefore, the images can be separated by bandpass filters with different center frequencies, and the contrast of the images in different frequency bands can be obtained separately, and then the patient's response at different spatial frequencies can be set. The contrast stimulation intensity measured by unit pulse stimulation can simulate the images seen in the eyes of patients at different spatial frequencies. Finally, the images of different spatial frequencies can be added to simulate the images seen by patients. (Figure 10) The linear and non-linear k-methods can be used to simulate the images seen by cataract patients and patients with macular degeneration, respectively. We put the image contrast enhanced image into linear simulation method or non-linear simulation method to obtain the best image contrast enhancement parameter 1 2 2 1. The next step is to determine the image contrast parameter 1 2 2 1. According to the visual acuity of the patient's vision, the image can be extracted from the image information at different frequencies in the image using a band-pass M filter with different center frequencies. And _ use the correlation coefficient to compare the images included in the different frequency bands after the simulation with the images included in the different frequency bands before the simulation. r =. ^ n_ 2 ..................] / mnm η, where A two mean, A), B two mean {B) (Figure 1) can know the patient The image you see is very unsatisfactory, and you can't even distinguish the image. If we can give

Page 17 541504

By adjusting the image contrast enhancement parameter value 1 2 2 1, the image contrast enhancement between the pre- and post-simulation images and between the enhanced and un-enhanced images can be repeatedly requested to provide patients with more imaging effects. Correlation coefficient, and quantify the results into a graph. This chart can be used to determine the image contrast enhancement parameters 1 2 1 2. According to (shown in Figure 12), when the fcontrast gairi increases, it can be clearly seen that the correlation coefficient between the image seen by the simulated patient and the input image at the same frequency has increased significantly, and the contrast gain has increased. When it exceeds 4, the rising rate of the correlation coefficient has gradually slowed down. The red dotted line indicates the c 0 rre 1 ati ο η coefficient between the original image and the enhanced image. When the contrast gain is greater (the stronger the contrast enhancement effect of the image), the correlation coefficient of the two will gradually decrease. Therefore, over-enhancement will cause the image information to be too different from the original image, so that the original subtle image information of the image will become a high-contrast image. Therefore, according to this chart, and taking into account c 〇rre 1 ati ο nc efficient between the original image and the contrast-enhanced image, the image contrast enhancement parameter (contrast gain) is set to 4 to provide the patient with suitable imaging parameters, so that Patients get the best imaging results, and also take into account the similarity between the contrasted image and the original image. (Figure 1 3) b, J Jingjing

Φ The result after image enhancement compensation can be obtained by simulating the image seen by the patient. / A In addition, Image System image processing in hardware part 1 1

541504 V. Description of the invention (15) Provide basic image processing 1113 and image pair enhancement part ^ ^ 1 1 4 Image processing unit of two parts (as shown in Figure 4): Native image processing 1 1 1 3 ·· Made by hardware The digital shirt image data obtained in Part 11 can be used for immediate image processing such as enlargement, brightening, highlighting, image storage, and color adjustment of foreground and background. (Figure 14 is a flowchart) Because the visually impaired person will feel that the image is clearer when the contrast between the text and the background is higher, we have provided the function of highlighting the color of the text and the background. Some specific colors will be more sensitive, so we also add the text and background colors in the system to adjust themselves, so that users can get the best reading quality. In addition to the optical magnification of 60 times, the back-end image processing can also be used to enlarge the image by 2 to 3 times or more, so that the system's overall magnification can reach more than 120 times. The shirt image contrast enhancement process 1 1 1 4 is obtained by the front system 1 2 1 after obtaining the best image contrast enhancement parameter 1 2 2 1 and then this parameter is provided to the image contrast enhancement process 1 1 1 4 to make the image boundary Contrast enhancement, and the use of adaptive filtering in image processing to enhance the contrast information of the image boundary.

^ As shown in (Figure 15), to enhance the contrast information of the image, it can be beneficial to change the local brightness mean 1 1 1 4 1 and local contrast 1 1 1 42 of the shirt image. ▲ Achieved. Use low-pass Gaussian filter to

Page 19 541504 V. Description of the invention (16)

The local luminance mean component fL (ni, n2) and the local contrast component "(n!, n2) are taken out 'and the modified local luminance mean is obtained by multiplying the enhancement parameters g (L), g (fH)' of different proportions 1 1 1 4 1 f 'l (n " n2) and local contrast 1 1 1 4 2 f, H (Πι, n2), and finally the corrected local luminance mean 1 1 1 4 i and local contrast 1 1 1 4 2 add up, you can get the image contrast enhanced image, flowchart (as shown in Figure 16). We use the image contrast enhancement method to enhance the border contrast intensity of text and image images, so that visually impaired people can more easily identify Text and picture information (Figures 17, 18). 'Φ Linear simulation method and non-linear simulation method of simulated cataract and simulated macular degeneration patients in the front system 1 2 1 will be used to enhance the image information after image contrast enhancement. Used as an input image to learn the effect of image contrast enhancement (Figures 19 and 20). From (Figures 19 and 20), it can be understood that after the image contrast enhancement processing is performed, there is a better image for the visually impaired. Quality effect and increase Vision, obstacles ^ the understanding and recognition of the image. In addition to the front system 1 2 ^ can provide image contrast enhancement parameter value 1 2 2 1 in advance. Vision P early hindrance can be based on their own visual recognition, and then make Adjust the contrast strength moderately so as to get the best recognition effect on the image. In the image processing μ μ ff: we provide the basic image processing 1 1 1 3 and image contrast enhancement 1 1 1 4 function.

P.20 541504 V. Description of the invention (17) The images obtained by reading and matching can be more unified 1 2 1 can 1, so this has already been combined in the Internet. Its technology 1 · Internet system 1 , And then used in the visual server 2 1). After the server, and the user information, and can. When the teacher's material or the blackboard image is transmitted to the user to adjust it, a clearly planned Internet server can be used. 2 1 (Reading platform 1121 can be used for image contrast enhancement. 1 Easy to read and identify images for quantification of patients. 1 Regardless of the level, but also the teaching 2 or the characteristics of the department are described as follows: Road-based teaching reading system 2 Road-based teaching reading system 2 Increased Internet (TCP / classroom teaching reading for people with disabilities (server end ) And use 2 1 (server end) to send image data to the user 2 2, it is required that the client 2 2 can provide video in the classroom, if the text can be captured into an image multiplayer system, and The user needs to understand the image processing and recognize the image web-based teaching and reading system server end) and the user's programmatic control, and integrate the functions of 1 1 4 with visual impairment, and also match the front vision The degree of attenuation 1 2 1 is functionally integrated with the electronic expansion system 1 in terms of system integrity. The application simplification and portable assistive devices 3 are functions that transmit the current electronic expansion / IP), and And used in reading. The architecture can be divided into client 2 2 (ciient end, which mainly digitizes external images, and client 2 2 (client end converts the obtained data back into image processing and image magnification.) Teaching and digitizing, and the client 2 2 system can be used at the same time each parameter can make the information of the visually impaired. For visually impaired people 2 ', its main system can be divided into the clieilt 2 system ❹

541504 V. Description of the invention (18) The two major parts of the system, and the system architecture is mainly as shown in (Figure 2 1) The server 2 1 system, its main function is to capture images by I mage System 2 and use Control Sysyem 2 1 2 to read the platform (PC) 1 3 1 The position of the X-Y axis, and post-fix the image (TCP / material transmission 5 The client 2 2 system, you can obtain (Process 2 2 1 1 system users The end 2 2 affects the servo 2 1 system and consists of each parameter. It is the image information with saturation and the use of the network data system via (TCP / 1/1 client 2 2 system, and 2 2 1 and presentation. And After it is stored in the memory, open the IP) 23, and wait for its flowchart such as (Figure 2 2), when the Internet protocol 2 3 and server 23 are turned on, and the client 2 1 and the server The same function is available in the client 2 1 system, but the images of the two systems are processed. The image information of the client 2 1 system can be transmitted to different users at the same time. The client 2 2 system uses the same image. Image processing, such as Tibi enhancement processing. Concept, the image-owned P) 2 3 transmitted to the UE: multiple users can simultaneously taken up in each user client terminal 22 based architecture of the system 22 Internet network client 2. The image of the communication server 2 2 system is divided, its shadow, so the client 2 will handle it 2 for comparison. Lutong 2 will determine 2 1 in the processing of the standing image, and the server 2 will make the film 2 1 ， Ming 11 Adjusted the image information 2 after the video association asked for funds 3, it will not serve the system, the image function is bright, the server is in the server 2 2 system, and the server 2 system is also added to the image. Processing Servo

Page 22 541504 V. Description of the invention (19) The end 2 1 system ’s own eyesight can get the most written computer 1 3 1 with the popularity of image enhancement parameters and increase the server side to open a pre-opened (TCP / 3 is turned on and communicated with each other. The inter-system network frame client is adjusted at client 2 to cross-page data between data to fit the system ’s operating capacity, and within the customized image (Active X The function 'allows the visually impaired: to make contrast-enhanced parameters-adjustment and quality. We will use the client 2 2 system program ^ f :, Shen can carry out Liu Lanjing' image, so that the client 1J1, no additional Install the program, only 2 browsers can be viewed and adjusted in real time. It is suitable for speeding up the Internet-based teaching and reading system plus the convenience of use. 2 1 The image information obtained by the system, the server 2 1 system Storage data 'memory space to store image data, IP 2 3 waits for client 2 2 system (TCP / Ιρ 4 two-party communication protocol 2 3 is connected, the two parties (Figure 24) are server 2 1 system Gamma, science composition. The client 2 2 2 system obtains the image information from the network, and the 2 programs can make '1' visual impairment according to the needs of vision to obtain the best image effect. The parameter comparison platform on the network is extremely important, and the client side today , Can solve the platform problem of the program, there is no need for the 2 system program system (NT or UNIX) whether it is related to the client or not. The client 2 system only needs to be cut. 2 system program & 范 就 VT 1 ,, & amp Content, and the system architecture is shown in the figure, using as a weapon to see) and the server side (tcp / ip) 2 component side 2 1 after the image data in the system, 4 mesh link and the user side according to the problematic change 2 2 The computer has unified the system 2) and 2 (that is, 2 people who can strengthen the network-based 2 2 style page > ϋ

541504 V. Description of the invention (20) Appeared in the system Client 2 2 System transmission Client 2 2 The convenience and convenience of the client 2 2 The browser can obtain the visually impaired person's own 2 2 system program network 2 quickly spread. 2. The portable electronic has completed the teaching and reading P effect on the table I on the table, that is, the image control system 3, so that the video capture of the portable electronic front-end image is converted into handheld to image information. -digit bit signal processor 3 after 'can be connected to the headset | out. In the portable system (DSP kernel software part 1 2' (Figure 25)) is the actual server end image data display diagram. System program network It will bring benefits, without the need to additionally install the program server 2 1 system image data visual acuity to enhance the contrast of the image of the road, will make the Internet-based auxiliary reading system 3: electronic expansion system 1, and its system 2, it is more convenient to implant portable impairment for the visually impaired function than to enhance the function of reading the system 2 and 2 before the system ;; only through adjustment, use The road reading department; 2 in the Internet ί image ^ electronic subsidy department used the "assisted reading system 3 architecture such as (Figure 26, hardware part, the desktop reading platform scanning system 3 1, and Handheld ^ \ z 1 with class -The digital converter converts the al converter obtained from the field into a digital signal, and then passes it to the operation to convert the digital signal into analog signal glasses. 1 2 2 The image is enhanced for image output. It mainly focuses on the writing of the digital signal processor core program, and writes the program of the DSP system 1 into the DSP system and downloads it to the DSP 3.

541504 V. Invention Description (21) 2 to meet the needs of the portable electronic auxiliary reading 3 system. Through the above system integration, it has the following various features and functions: 1 · Electronic expansion system architecture: The electronic expansion system architecture is divided into two parts: hardware and software. In the hardware part, it is mainly able to control the reading platform and obtain external images in real time, and the image information is transferred to the image processing in the soft part to do appropriate image enhancement, which can make it easier for the visually impaired and the elderly. Reading books and recognizing image information. Hardware part The hardware part is composed of Image Sytem and Control System and is connected to a personal computer for programmatic control and processing. __ Through the high magnification lens and camera in the Image System, you can obtain up to 60 times magnification. The control system can programmatically control the movement of the reading platform, and the use of the arrow keys of the keyboard can be used to control the application. (Figure 27) is a control interface diagram. Software part In the software part, we hope to pre-process the images according to the degree of vision loss of the patient and enhance the contrast information of the image, which will make it easier for patients to read books and identify pictures in books. Therefore, the software part is divided into two single 4 yuan for the front system and the image processing core. The front system is mainly to quantify the degree of the patient's vision loss, and to determine the contrast of the image by simulating the image in the patient's eyes

Page 25 541504 V. Description of the invention (22) Parameterization. This contrast enhancement parameter is then implanted into the image processing core, so that the image captured by the hardware part can be immediately processed by the image processing core for image contrast enhancement processing to enhance the contrast intensity of the boundary portion of the image. Front-end system Therefore, in the front-end system, we have integrated the function of measuring the degree of patient's visual loss and can simulate the image seen by the patient, and then can determine the image contrast enhancement parameters to provide the most suitable image contrast enhancement effect for the patient. In order to quantify the degree of visual loss of the patient, we use sinusoidal grading to measure the contrast sensitivity function of the patient (referred to as CSF), and can use the CSF of the patient to use linear simulation and non-linear simulation to separately simulate cataract The images seen in the eyes of patients and patients with macular degeneration, and then determine the parameters of image contrast enhancement, and then substitute the image contrast enhancement processing to enhance the contrast of image boundaries, so that patients can get the best visual effects under the existing vision conditions, ( Figure 2 9) shows the interface of the measurement contrast sensitive function system. The measured contrast sensitivity function of the patient can be immediately converted into a graph and a quantitative curve can be drawn (Figure 30). According to the measured contrast sensitivity function, it can also be immediately incorporated into the simulation system to simulate the images seen in the eyes of patients with macular degeneration and cataracts, and the image contrast enhancement parameters can be adjusted to enhance the image and then simulate it. The images seen by the patients are used to understand the enhancement of the image information obtained by the patients (Figure 31, Figure 3 2). We also provide parameters that determine the ground strength of the image here.

Page 26 541504 = ^ face private type, providing patients to determine more contrast contrast parameters of the image = flood. In (Figure 3 3), the first interface to quantify the contrast contrast parameter of the image provides the adjustable c 0 rre between different image contrast enhancement parameters (contrast gain) after the image enhancement and the patient's actual enhancement image. 1 ati 〇η coefficient. In addition, the contrast enhancement parameter (contras1: ga 1 η) can be adjusted from 1 to 10 times or the user can determine the factor between the enhanced shirt image and the image seen by patients across the border. The quantization table of coefficients (Figure 3 4), and then the correlation coefficient between the original unreinforced image and the enhanced image at different contrast gain (the larger the contrast gain ', the worse the similarity between the original image and the enhanced image ), As an index to determine the contrast gain parameter (contrast gain) of the image. Image processing core In the image processing core, it provides an image processing unit consisting of basic image processing and image pair enhancement processing. Basic image processing In terms of basic image processing, the digital image data obtained from the hardware can be used for immediate image processing such as magnification, brightness, highlighting, image storage and color adjustment of foreground and background. Because the visually impaired people have a higher contrast between text and background, the image will be clearer, so we have provided a function to reverse the text and background color, and the visually impaired person may be more sensitive to certain specific colors So we are also

Page 27 541504 V. Description of the invention (24) The color of the text and background added to the system can be adjusted on its own, so that users can get the best reading quality. Image contrast enhancement processing After obtaining the best image contrast enhancement parameters from the front-end system, this parameter is provided to the image contrast enhancement processing for contrast enhancement of image boundaries. To enhance image boundary contrast processing, we have used adaptive filtering in image processing to enhance the contrast information of image boundaries. Our separate image contrast enhancement method strengthens the border contrast intensity between text and image images, making it easier for visually impaired people to recognize text and image information. (Figures 17, 18, 19, and 20) are the results after strengthening. It can be seen from (Figures 19 and 20) that for the image > contrast enhancement process, it has better image quality for the visually impaired, and increases the understanding and recognition of the visually impaired for the image. In addition to the front system can provide image contrast enhancement parameter (contrast gain) in advance. The visually impaired can adjust the contrast and enhancement conditions appropriately according to their own visual recognition degree, in order to obtain the best recognition effect for the image. 2 · Internet-based teaching and reading system The Internet-based teaching and reading system is a combination of the existing electronic expansion system and the Internet transmission function, and is used in the classroom teaching and reading of the visually impaired. Its architecture can be divided into server end and client end. The server end (s e r v e r e n d) mainly digitizes the external image and immediately transmits the image data to the client (c 1 i e n t e n d), and the function of the client is

Page 28 541504 V. Description of the invention (25) The obtained data should be converted back into image information, and the client can provide functions such as image processing and image magnification. When the teacher teaches in the classroom, if a system can be provided, the text on the textbook or blackboard can be captured into an image and digitized, and the image can be transmitted to a multiplayer system at the same time, and the client system can allow each person The user adjusts the image processing parameters required by the user, so that the visually impaired can clearly understand and recognize the image information. The webpage system rewrites the client-side system program to view images using only a browser, so that no additional program is required on the client-side computer, as long as the computer has a browser to view it in real time, g | And adjusting the image enhancement parameters suitable for you will speed up the popularity of Internet-based teaching and reading systems and increase the convenience of use. In today's networked world, cross-platform between network data is extremely important, and the webpage of the client system program can just solve the platform problem of the program, regardless of whether the operating system (NT or UNIX) of the client system is related to The client system programs are compatible, and only a browser is required in the client system to view the web-based video content. The system architecture is shown in the figure. After using Active X components to connect to the server's TCP / IP communication protocol, and obtain After the image data in the server system is displayed in the client system, (Figure 25) is a display diagram of the image data transmitted by the actual server system and the client system. The network of client $ system programs will bring unprecedented convenience and convenience to the reading system. No additional program software needs to be installed. Only through the browser

Page 29 541504 V. Description of the invention (26) The server's own vision can be obtained. 3 · Portable electronic auxiliary function for visual impairment, the visually impaired can be (Figure 2 6) front-end image capture replaced by handheld image information, (analog-dig from digital signal to analog signal conversion The enhanced image is made in the software and processor of DSP Kerne 1 to meet the requirements. 俾 With the invention of the visually impaired, he can fit his own image pair to provide the best image quality of the system. Contrast 2 can be based on visual impairment will make the network two = integrated, user-side system, the same way Internet reading system quick reading aid system = ί [image contrast enhanced processing power moon dagger implanted portable electronic auxiliary system Use when reading. System architecture:

The hardware part ☆, will be a desktop reading; special J-scanning system, and the analog-to-digital converter. The converter converts the ital converter to a digital signal, and then performs a calculation by a processor (DSP). After that, the digital signal can be connected at the back, and the headset can be connected to GMD to output the image. In the portable system, the main focus is on the writing of the program ', and the code of the DSP system is written in the electronic expansion system and then downloaded to the ds P to form the image processing and design of the portable electronic auxiliary reading system. The electronic assisted reading system adjusts the ratio enhancement parameter according to the degree of attenuation of visual acuity, which is used to enhance the contrast information image effect of the image, and also adds the electronic assisted reading system.

Hi Page 30 541504 V. Description of the invention (27) The function of accessing the Internet makes it a reading system for the visually impaired in the classroom. At the same time, in order to take care of going out and increase the convenience of using the electronic expansion system, you can use it. The DSP processor adds the exclusive image contrast enhancement function, which can bring greater convenience and practicality to the visually impaired. According to the foregoing description, the digital amblyopia image auxiliary system of the present invention with individual adaptation functions is a high degree of using the technical ideas of the natural law. It is more innovative than the conventional optical amplifier and electronic expander, and also has substantial improvement in effectiveness, which is fully compatible with The statutory elements of an invention patent shall be filed in accordance with the law.

No. 2 CO 2 strong C 0 3 is the overall architecture diagram of the present invention. It is a physical diagram of the electronic imaging system of the present invention. It is a structural diagram of an electronic imaging system of the present invention. It is a flowchart of I m a g e S y s t e m of the electronic imaging system. It is a control system architecture diagram of the electronic imaging system. It is a software architecture diagram of the electronic expansion system. It is a detailed architecture diagram of the software part of the electronic imaging system. It is a grat ng graph of the measurement visual CSF of the electronic imaging system; it is an E measurement result chart. ° is the original figure and the linear system that simulates the cataract patients see the original picture and the non-linear simulation of the macular degeneration syndrome. 'It means that the upper row image is the unenhanced original image, the lower row image is the original image, and the right-most center frequency is 0.5 cycle / deg, 1 cle / deg, 2 cycle / deg, 4 cycle / deg, and eye le / deg band-pass filters, and at the same spatial frequency, the rrelation coefficient ° between the upper image and the lower image is used for different image contrast parameters. , Simulate the patient's image and subsequent images' efficiency chart between the two. The upper image is an enhanced image, and the lower image simulates the effect of the patient.

The 541504 diagram on page 32 shows a brief description of the strengthened image, and the upper left image is a contrast enhanced image, and the center frequencies in order to the right are 0.5 cycle / deg, 1 cycle / deg, and 2 eye 1 e. / deg, 4cycle / deg, and 8cycle / deg bandpass filters are used to filter the images, and the correlation coefficients between the upper row image and the lower row shirt image are made at different spatial frequencies, respectively. Figure 14 is a flowchart of image processing. Figure 15 shows the relationship between local luminance mean and locai contrast. Figure 16 is an illustration of image contrast enhancement. Figure 17 shows the original text and enhanced text graphics. Figure 8 shows the untreated figure and its image pair = the strengthened figure. 0 1st 2nd 2nd 2nd 2nd 2nd 2 9th is the untreated cataract ratio compared with the strengthened image. 〇 The picture shows the image of the untreated macular disease patients. 1 is an Internet-based teaching system of the present invention 2 is an Internet-based teaching system 3 is an Internet-based teaching system 4 is an architecture diagram of an Internet-based teaching system # Seeing the image, and its image I see, and its diagram of the teaching system architecture. Server-side system architecture diagram. Client-side architecture diagram. < The network between the server and the client 5 The picture is the word of the Internet-based teaching system. Between the server and the client,

Page 33 541504 Brief description of the drawings Figures 2 to 6 show the architecture of the portable computer-aided reading system. Figure 27 shows the control interface of the reading platform. Figure 28 is an integrated interface diagram of the front system. Figure 29 is the interface diagram of the system for measuring contrast-sensitive functions. Figure 30 is an interface diagram of the measurement contrast sensitivity function; the right side can immediately simulate the images seen by patients with macular and cataracts. Figure 31 is an image interface view of a patient with simulated macular degeneration. Figure 32 shows the image interface of a simulated cataract patient. Figure 33 is the first interface diagram of the quantized image contrast intensity parameter. Figures 3 and 4 are interface diagrams for quantifying image contrast intensity parameters.

• 0〇44. CX1. 1 ± ·. • 11122 · 12 · 2 System IX IX IX 1 ± IX 1 ± oo oo 1 ± IX 1 ± 1 ± IX 1 ± 1 ± 1 ± 1 ± 1 ± The system of digital control and mathematics is controlled by the reference system. The system is controlled by the system. The extension of the system is opposite to the system of the flat system. The sub-image is read while the image is fixed. Weeks before the power grid t £ ···· 2 ....... Single ·· 2 4 4 1 3 · 2 1. · • TX IX 1 ± IX 0A- 1 ± lx 0A- · No. · — — -1 ± 1 ± 1 ± IX 0〇Iflj IX TX IX IX IX IX IX IX IX IX IX IX hardware part camera basic image processing local average brightness control system lighting control software part vision attenuation degree image processing core display head-mounted glasses

Page 541 504

Page 35

Claims (1)

541504 6. Scope of patent application1. A digital amblyopia image assistance system with individual adaptation functions, at least including: an image input device, which is used to obtain the original image of the outside world and send it to the image processing device for processing; an image processing device , It is mainly to quantify the degree of attenuation of the patient's vision and simulate the image in the patient's eyes to determine the image contrast enhancement parameters, and then use the enhancement parameters to immediately obtain the original image as the basic image and the image boundary contrast image enhancement processing. To obtain the actual image suitable for the individual viewing of the patient; an image output device is used to display the actual > image after the enhanced processing. p 2 · Digital amblyopia image assistance system with individual adjustment function as described in item 1 of the scope of patent application; wherein the image input device is composed of a front-end system and an image processing core. 3 · Digital amblyopia image assistance system with individual adjustment function as described in item 2 of the scope of patent application; wherein the pre-system is responsible for quantifying the degree of patient's vision loss and simulating the image in the patient's eyes to determine the image Contrast enhanced parameters. 4 · Digital amblyopia image assistance system with individual adjustment function as described in item 2 of the scope of patent application; wherein, the pre-system uses the correlation coefficients that interact with each other at different frequencies to perform simulation.丨 Compare with the simulated image information to find the best image contrast enhancement parameters. 5 · Digits with individual adaptation functions as described in item 2 of the patent application Page 36 541504 VI. Patent application scope Amblyopia image assistance system; Among them, this pre-system is for the visual adjustment of individual amblyopia patients. The linear and non-linear methods are used to simulate the image of the visually impaired. Determine the image contrast enhancement parameters, and adjust the image contrast enhancement parameters that are suitable for you according to the image enhancement effect required by the user to enhance the contrast information of the image and provide the best image effect. '6 · Digital amblyopia image assistance system with individual adjustment function as described in item 5 of the scope of patent application; among them, the image information used to simulate cataract patients can be recognized by linear simulation method. 7 · Digital amblyopia image assistance system with individual adjustment function as described in item 5 of the scope of patent application; among them, the image information used to simulate the macular disease patients' recognition || is a non-linear simulation method. 8 · Digital amblyopia image assistance system with individual adjustment function as described in item 2 of the scope of patent application; wherein the image processing core includes a basic image processing unit and an image contrast enhancement processing unit. 9 · Digital amblyopia image assistance system with individual adjustment function as described in item 8 of the scope of patent application; wherein the basic image processing unit refers to the enhancement parameters to enlarge, brightness, highlight, and store the original image Adjuster with background color before and after. 1 · Digital amblyopia image assistance system with individual adjustment function as described in item 8 of the scope of patent application; wherein the image contrast enhancement processing unit uses the enhancement parameter as the basis for image contrast enhancement $, thereby enhancing the image Boundaries. 1 1 · Individual adjustment function as described in item 10 of the scope of patent application Page 37 541504 VI. Patented Digital Amblyopia Image Assistance System; Among them, the image processing core uses local average mean brightness and local contrast to change the image information, and then multiplies them forward Set the enhancement parameter value of the operation to achieve the effect of image contrast enhancement. 1 2 · A digital amblyopia image assistance system with individual adaptation functions as described in item 1 of the scope of patent application; wherein the image input device is an electronic amplifying machine to obtain external images in real time. 1 3 · A digital amblyopia image assistance system with individual adaptation functions as described in item 1 of the scope of patent application; wherein the image input device is a server end of the Internet to obtain external images in real time. 14 · The digital amblyopia image assistance system with individual adaptation function as described in item 1 of the scope of patent application; wherein the image input device is a scanner to obtain the external image in real time. 15 · A digital amblyopia image assistance system with individual adaptation functions as described in item 14 of the scope of patent application; where the scanner is a handheld micro-camera. 16 · The digital amblyopia image assistance system with individual adaptation function as described in item 14 of the scope of patent application; wherein the scanner is a desktop scanner. 17 · The digital amblyopia image assistance system with individual adjustment function as described in item 1 of the scope of patent application; wherein the image output device is a computer reading platform for displaying the processed image. 1 8 · Individual adjustment function as described in item 17 of the scope of patent application Page 38 541504 VI. Patented digital amblyopia image assistance system; Among them, the image output device is equipped with a control system to change the reading platform to the X-γ-axis mobile platform, and the computer's direction keys can be used to control the mobile of the platform . 19 · The digital amblyopia image assistance system with individual adaptation function as described in item 1 of the scope of patent application; wherein the image output device is a head-mounted display for displaying the image after passing through. 20 · Digital amblyopia image assistance system with individual adaptation function as described in item 1 of the scope of patent application; among them, the client system can be converted into a web page by using a communication protocol, that is, no additional installation program is required. Use the browser on the client to obtain the server-side image data, and perform image enhancement processing according to the image contrast enhancement parameters required by the individual, thereby simplifying the inconvenience of the installation program, and has the effect of achieving Internet-based teaching reading across platforms By. 2 1 • Digital amblyopia image assistance system with individual adaptation function as described in item 15 of the scope of patent application; wherein the handheld scanner uses a digital signal processor (DSP) and integrates the electronic photography system The software part is changed to (DSP) program to meet the needs of the system. I Page 39