CN111208964B - Low vision aiding method, terminal and storage medium - Google Patents
Low vision aiding method, terminal and storage medium Download PDFInfo
- Publication number
- CN111208964B CN111208964B CN202010030657.8A CN202010030657A CN111208964B CN 111208964 B CN111208964 B CN 111208964B CN 202010030657 A CN202010030657 A CN 202010030657A CN 111208964 B CN111208964 B CN 111208964B
- Authority
- CN
- China
- Prior art keywords
- image
- vision
- aiding
- low
- processing request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 208000010415 Low Vision Diseases 0.000 title claims abstract description 201
- 230000004303 low vision Effects 0.000 title claims abstract description 199
- 238000000034 method Methods 0.000 title claims abstract description 87
- 238000012545 processing Methods 0.000 claims abstract description 82
- 230000003287 optical effect Effects 0.000 claims description 48
- 230000000694 effects Effects 0.000 claims description 12
- 210000001747 pupil Anatomy 0.000 claims description 10
- 239000013589 supplement Substances 0.000 claims description 10
- 238000003672 processing method Methods 0.000 claims description 4
- 230000004438 eyesight Effects 0.000 abstract description 40
- 230000008569 process Effects 0.000 description 18
- 230000006870 function Effects 0.000 description 17
- 238000004891 communication Methods 0.000 description 14
- 230000000007 visual effect Effects 0.000 description 11
- 238000003708 edge detection Methods 0.000 description 7
- 238000013519 translation Methods 0.000 description 4
- 238000012360 testing method Methods 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000004064 dysfunction Effects 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 206010047531 Visual acuity reduced Diseases 0.000 description 1
- 230000003213 activating effect Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000001627 detrimental effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/02—Methods for producing synthetic speech; Speech synthesisers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Studio Devices (AREA)
Abstract
The application discloses a low vision aiding method, a terminal and a computer readable storage medium, wherein an application scene of a low vision aiding program is detected firstly, and the application scene comprises single-screen display and split-screen display; then obtaining an original image projected by a shooting device; processing the original image according to a preset method to obtain a vision-aiding image; and finally outputting the vision-aiding image, the quality of the low-vision viewing image is guaranteed through a preset method, and the different vision requirements of different low-vision users are met, so that the external environment can be clearly seen by the auxiliary low-vision users, the viewing definition, convenience and comfort of the low-vision users are improved, and the vision-aiding cost of the low-vision users is saved.
Description
Technical Field
The present application relates to the field of vision assistance technologies, and in particular, to a low vision assistance method, a terminal, and a computer readable storage medium.
Background
The vision of the low-vision users is often poor due to visual dysfunction, and a considerable part of the low-vision users in real life bring great inconvenience to the life, work, study, friend making and the like of the low-vision users due to the problem of too low vision. To help low vision users see the world, some vision aids have been electronically or optically enlarged to allow the low vision user to perform certain viewing activities.
The current use mode and the use effect of the vision aid are limited to a certain extent, and in the use mode, although the desk type electronic vision aid is large in screen, the resolution of a camera is high, the vision aid effect is good, the cost is high, and the desk type electronic vision aid can only be used in a fixed scene; the hand-held electronic or optical vision aid is inconvenient in the scene that a user needs to write or other hands; in the use effect, the handheld electronic type vision assistor has smaller screen, poorer image quality and limited display content; for the optical vision aid, the magnification is single and low, when the user uses the optical vision aid in an incorrect sitting posture, the optical vision aid is easily affected by a light source, and when the user enlarges objects, the visual field is reduced, so that the visual requirement of the user with low vision is difficult to meet. For some existing head-mounted vision aids, the pictures are smaller, a certain heating problem exists, the price is often expensive, and each low-vision user is difficult to get.
Disclosure of Invention
The main purpose of the application is to provide a low vision aiding method, a terminal and a computer storage medium, and aims to solve the technical problems that in the prior art, the quality of a displayed image of a vision aiding device is poor, the display content is limited and the using convenience is low.
In order to achieve the above object, an embodiment of the present application provides a low vision aiding method, where the steps of low vision aiding include:
detecting an application scene of a low-vision aid program, wherein the application scene comprises single-screen display and split-screen display;
acquiring an original image projected by a shooting device;
processing the original image according to a preset method to obtain a vision-aiding image;
and outputting the vision-aiding image.
Optionally, the step of acquiring the original image projected by the photographing device includes:
if the application scene is displayed on a single screen, acquiring an image displayed by the shooting device as the original image;
and if the application scene is split-screen display, acquiring a first image and a second image displayed by the shooting device as the original images, wherein the first image is displayed on a first display screen of the shooting device, and the second image is displayed on a second display screen of the shooting device.
Optionally, after the step of acquiring the first image and the second image displayed by the photographing device as the original image, the method includes:
based on the acquired focal length adjustment operation, adjusting the distances between a first optical lens and a second optical lens in the low vision aid device and the first display screen and the second display screen;
and/or the number of the groups of groups,
and adjusting the distance between the first optical lens and the second optical lens in the low-vision aid based on the acquired pupil distance adjustment operation.
Optionally, the step of processing the original image according to a preset method to obtain the vision-aiding image further includes:
acquiring an image primary processing request of the original image;
and obtaining the vision-aiding image based on the image preliminary processing request.
Optionally, the step of obtaining the vision-aiding image based on the image preliminary processing request includes:
if the image preliminary processing request belongs to a color processing request, executing a preset image enhancement algorithm to obtain the vision-aiding image;
if the image preliminary processing request belongs to an edge enhancement request, executing a preset edge enhancement algorithm to obtain the vision-aiding image, wherein the edge enhancement request comprises an original image added edge, a white display edge and a black display edge;
and if the image preliminary processing request belongs to an image basic processing request, adjusting parameters of the shooting device based on the image basic processing request and/or executing a preset image basic processing algorithm to obtain the vision-aiding image, wherein the image basic processing request comprises adjustment of image brightness, image contrast and image size.
Optionally, after the step of outputting the visual aid image, the method includes:
acquiring an image processing request of the vision-aiding image, wherein the image processing request comprises an image shooting request and/or an image recording request;
based on the image processing request, processing the auxiliary view image according to a preset image processing method to obtain a processed auxiliary view image;
and outputting the processed vision-aiding image.
Optionally, after the step of outputting the visual aid image, the method further includes:
based on the acquired voice playing request of the vision-aiding image, recognizing characters in the vision-aiding image, and obtaining a character recognition result, wherein the voice playing request is to output the characters in the vision-aiding image in a voice mode;
playing the character recognition result by voice;
and/or the number of the groups of groups,
and starting a flash lamp to supplement light to the surrounding environment of the auxiliary image based on the acquired light supplement request.
The application also provides a terminal, the terminal includes: a memory, a processor, and a low vision aid program stored on the memory and executable on the processor, which when executed by the processor, performs the steps of the low vision aid method as described above.
The present application also provides a computer storage medium having stored thereon a low vision aid program which when executed by a processor implements the steps of the low vision aid method as described above.
In the low vision aid process, firstly detecting an application scene of a low vision aid program, wherein the application scene comprises single-screen display and split-screen display; then obtaining an original image projected by a shooting device; processing the original image according to a preset method to obtain a vision-aiding image; and finally outputting the vision-aiding image, the quality of the low-vision viewing image is guaranteed through a preset method, and the different vision requirements of different low-vision users are met, so that the external environment can be clearly seen by the auxiliary low-vision users, the viewing definition, convenience and comfort of the low-vision users are improved, and the vision-aiding cost of the low-vision users is saved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
Fig. 1 is a schematic hardware structure of an optional terminal according to an embodiment of the present application;
FIG. 2 is a flow chart of a first embodiment of the low vision aiding method of the present application;
FIG. 3 is a flow chart showing a third embodiment of the low vision aiding method according to the present invention for the step 22 in FIG. 2;
FIG. 4 is a detailed flow chart of a fourth embodiment of the low vision aid method of the present application for step 30 of FIG. 2;
FIG. 5 is a flow chart of a sixth embodiment of the present invention for a new low vision improvement method after step 40 in FIG. 2;
fig. 6 is a schematic diagram of another flow chart of a seventh embodiment of the low vision aiding method according to the present invention, which is added after step 40 in fig. 2.
The realization, functional characteristics and advantages of the present application will be further described with reference to the embodiments, referring to the attached drawings.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
In the following description, suffixes such as "module", "component", or "unit" for representing elements are used only for facilitating the description of the present application, and are not of specific significance per se. Thus, "module," "component," or "unit" may be used in combination.
As shown in fig. 1, fig. 1 is a schematic diagram of a terminal structure of a hardware running environment according to an embodiment of the present application.
The terminal of the embodiment of the application can be a fixed terminal, such as a desk-top vision aid; but also a mobile terminal, such as a handheld vision aid, to which the present application is not limited.
As shown in fig. 1, the architecture design of the low vision assistance system includes nodes and servers, and the device structure may include: a processor 1001, such as a CPU, memory 1005, and a communication bus 1002. Wherein a communication bus 1002 is used to enable connected communication between the processor 1001 and a memory 1005. The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
Optionally, the low vision aid system may further include a user interface, a network interface, a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module, and the like. The user interface may include a Display screen (Display), touch screen, camera (including AR/VR devices), etc., and the optional user interface may also include standard wired interfaces, wireless interfaces. The network interface may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface, bluetooth interface, probe interface, 3G/4G/5G networking communication interface, etc.).
It will be appreciated by those skilled in the art that the low vision aid system architecture shown in fig. 1 is not limiting of the low vision aid system and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, and an early wake-up program may be included in a memory 1005, which is a type of computer storage medium. The operating system is a program that manages and controls the hardware and software resources of the low vision aid system, supporting the operation of the low vision aid program and other software and/or programs. The network communication module is used to enable communication between components within the memory 1005 and with other hardware and software in the low vision aid system.
In the low vision aid system shown in fig. 1, the processor 1001 is configured to execute a low vision aid program stored in the memory 1005, and implement the following steps:
detecting an application scene of a low-vision aid program, wherein the application scene comprises single-screen display and split-screen display;
acquiring an original image projected by a shooting device;
processing the original image according to a preset method to obtain a vision-aiding image;
and outputting the vision-aiding image.
Further, the processor 1001 may call the low vision aid program stored in the memory 1005, and further perform the following operations:
if the application scene is displayed on a single screen, acquiring an image displayed by the shooting device as the original image;
and if the application scene is split-screen display, acquiring a first image and a second image displayed by the shooting device as the original images, wherein the first image is displayed on a first display screen of the shooting device, and the second image is displayed on a second display screen of the shooting device.
Further, the processor 1001 may call the low vision aid program stored in the memory 1005, and further perform the following operations:
based on the acquired focal length adjustment operation, adjusting the distances between a first optical lens and a second optical lens in the low vision aid device and the first display screen and the second display screen;
and/or the number of the groups of groups,
and adjusting the distance between the first optical lens and the second optical lens in the low-vision aid based on the acquired pupil distance adjustment operation.
Further, the processor 1001 may call the low vision aid program stored in the memory 1005, and further perform the following operations:
acquiring an image primary processing request of the original image;
and obtaining the vision-aiding image based on the image preliminary processing request.
Further, the processor 1001 may call the low vision aid program stored in the memory 1005, and further perform the following operations:
if the image preliminary processing request belongs to a color processing request, executing a preset image enhancement algorithm to obtain the vision-aiding image;
if the image preliminary processing request belongs to an edge enhancement request, executing a preset edge enhancement algorithm to obtain the vision-aiding image, wherein the edge enhancement request comprises an original image added edge, a white display edge and a black display edge;
and if the image preliminary processing request belongs to an image basic processing request, adjusting parameters of the shooting device based on the image basic processing request and/or executing a preset image basic processing algorithm to obtain the vision-aiding image, wherein the image basic processing request comprises adjustment of image brightness, image contrast and image size.
Further, the processor 1001 may call the low vision aid program stored in the memory 1005, and further perform the following operations:
acquiring an image processing request of the vision-aiding image, wherein the image processing request comprises an image shooting request and/or an image recording request;
based on the image processing request, processing the auxiliary view image according to a preset image processing method to obtain a processed auxiliary view image;
and outputting the processed vision-aiding image.
Further, the processor 1001 may call the low vision aid program stored in the memory 1005, and further perform the following operations:
based on the acquired voice playing request of the vision-aiding image, recognizing characters in the vision-aiding image, and obtaining a character recognition result, wherein the voice playing request is to output the characters in the vision-aiding image in a voice mode;
playing the character recognition result by voice;
and/or the number of the groups of groups,
and starting a flash lamp to supplement light to the surrounding environment of the auxiliary image based on the acquired light supplement request.
Based on the above hardware structure, various embodiments of the low vision aiding method are presented.
Referring to fig. 2, a first embodiment of the low vision aiding method of the present application provides a low vision aiding method comprising:
step S10, detecting an application scene of a low vision aid program, wherein the application scene comprises single-screen display and split-screen display;
step S20, obtaining an original image projected by a shooting device;
step S30, processing the original image according to a preset method to obtain a vision-aiding image;
and step S40, outputting the vision-aiding image.
The usage scenario of the embodiment may be that the low-vision users often have poor vision due to visual dysfunction, and a significant part of the low-vision users in real life have great inconvenience for their life, work, study, friends making, etc. due to the problem of too low vision. A low vision user assists viewing using a photographing device mounted with a low vision aid program in order to better see the external environment or in order to be able to normally view text or picture information.
Specifically, when the shooting device and the parameter adjusting handle perform data communication in a preset communication mode, the shooting device, the parameter adjusting handle (which communicates with the shooting device) and the low-vision assisting device (which is provided with the first optical lens and the second optical lens) are used together, namely a split screen mode is used; when the photographing device is provided with the low vision aid program and is used as the portable vision aid independently (when the photographing device provided with the low vision aid program is provided with the low vision aid program, the low vision aid program can call and open a camera of the photographing device so as to photograph images), a single screen mode is used, and an application scene, namely the single screen mode and the double screen mode, can be manually switched by a user; the utility model provides a low vision helps visual device belongs to wear-type helps visual device, and low vision user wears at the head through low vision helps visual device promptly to carry out communication connection with parameter adjustment handle and shooting device, thereby low vision user can watch shooting device projected image information that enlarges the effect better through low vision helps visual device, and can adjust the parameter of image through parameter adjustment handle, thereby the display effect of adjustment image. The shooting device and the parameter adjusting handle are in data communication in a preset communication mode, for example, the shooting device and the parameter adjusting handle can be in data communication in a Bluetooth connection or wifi connection mode, the shooting device and the parameter adjusting handle can be flexibly arranged in an implementation process, and the shooting device and the parameter adjusting handle are not limited here; the shooting device refers to a device with shooting function, the shooting device can be a component part of a mobile terminal with any shooting function, for example, a shooting module of a mobile phone belongs to the shooting device, and the shooting device also has a display function, namely, a shot image is displayed; the type of the photographing device can be flexibly set in the implementation process, and is not limited herein. Of course, the low vision aid method can also be directly applied to a terminal with a shooting function, can be flexibly set in the implementation process, and is not limited here. The photographing device photographs pictures or words which a low-vision user wants to watch, or external scenery, buildings, people and the like in the walking process to obtain an original image, the original image is projected to the low-vision assisting device, after the low-vision assisting program obtains the original image, the original image is processed according to a preset method to obtain a vision assisting image, wherein the preset method is executed according to the input requirement of the low-vision user, so that the different vision requirements of different low-vision users can be met, the pertinence of the output of the vision assisting image is improved, and the watching experience of the low-vision user is improved.
It should be noted that, the information that the user wants to watch may be text information, picture information, or may be a building, a person, an external landscape, etc., and the information that the user needs to watch more clearly may all watch through wearing the low vision aid device (the photographing device with the low vision aid program installed is placed in the low vision aid device according to the preset method), that is, the information that the user wants to watch may be flexibly set in the implementation process, which is not limited herein.
According to the low vision aid method, a mobile phone (the mobile phone can be replaced by a mobile terminal with a shooting function, and is not limited in the position) provided with a low vision aid program can be communicated with a parameter adjusting handle in a Bluetooth connection mode (or other connection modes), and the low vision aid device is worn on the head of a low vision user to realize aid (which is equivalent to a mode of wearing glasses); the low vision aided program is installed on a terminal with shooting function, such as a mobile phone, so that the aided vision function is transplanted to the mobile phone through the low vision aided program to achieve aided vision, namely, the mobile phone with the low vision aided program is used as a portable aided vision device, a user only needs to open the low vision aided program on the mobile phone, the camera of the mobile phone is opened to prepare for shooting, and thus, the low vision user can read books and newspaper or enjoy activities such as scenery through the help of the low vision aided vision program and the camera of the mobile phone, so that the low vision user can watch more clearly.
In this embodiment, an application scene of a low vision assisting program is detected first, where the application scene includes single-screen display and split-screen display; then obtaining an original image projected by a shooting device; processing the original image according to a preset method to obtain a vision-aiding image; and finally outputting the vision-aiding image, the quality of the low-vision viewing image is guaranteed through a preset method, and the different vision requirements of different low-vision users are met, so that the external environment can be clearly seen by the auxiliary low-vision users, the viewing definition, convenience and comfort of the low-vision users are improved, and the vision-aiding cost of the low-vision users is saved.
Further, in the second embodiment of the low vision aiding method of the present application, step S20 includes:
step S21, if the application scene is single-screen display, acquiring an image displayed by a shooting device as the original image;
step S22, if the application scene is split-screen display, a first image and a second image displayed by the shooting device are obtained as original images, wherein the first image is displayed on a first display screen of the shooting device, and the second image is displayed on a second display screen of the shooting device.
In this embodiment, if the application scene is single-screen display, an image displayed by the photographing device is obtained as an original image; if the application scene is split-screen display, the obtained original images are respectively displayed on a first display screen and a second display screen, then the image displayed on the first display screen of the shooting device is called a first image, and the image displayed on the second display screen of the shooting device is called a second image.
Specifically, the principle of simulating binocular vision is utilized, the acquired original images are respectively displayed on a first display screen and a second display screen, the first display screen corresponds to a first optical lens, the second display screen corresponds to a second optical lens, and the positions of the first optical lens and the second optical lens correspond to two eyes of a low-vision user respectively, so that the split-screen display of the images can simulate binocular vision of the low-vision user. Split-screen is a superimposed effect in that the lower vision user sees a more stereoscopic image.
It should be noted that, when the photographing device is in communication connection with the parameter adjustment handle and is placed in the low vision aid device through the preset method, the photographing device and the low vision aid device are described to be used in cooperation, that is, a split screen mode is used, that is, the low vision aid program can divide the original image photographed by the photographing device into two images, and meanwhile, the two images are displayed on the mobile phone display interface, that is, the first display screen and the second display screen are displayed on the mobile phone display interface, and the low vision user can adjust or control and adjust the image function through the parameter adjustment handle, the image adjustment function is not limited here, the image adjustment function includes but is not limited to image amplification, image reduction, color mode switching, contrast adjustment, brightness adjustment, edge enhancement, photographing and video recording, text-to-speech, text recognition, text translation and the like.
In addition, when the photographing device is installed with a low vision aid program and is used alone as a portable vision aid, a single screen mode is used and an original image is directly displayed. In addition, the low vision user can adjust the image function by directly operating or controlling voice on the mobile phone, the image adjusting function is not limited herein, the image adjusting function comprises but not limited to image amplification, image reduction, color mode switching, contrast adjustment, brightness adjustment, edge enhancement, photographing video, text-to-speech, text recognition, text translation and the like, the low vision assisting device is not limited herein, namely, the vision assisting function can be realized as long as the terminal (such as the mobile phone) with the photographing function and the low vision assisting program is installed, the user can conveniently watch the low vision assisting method, and the user experience is improved.
Further, in a third embodiment of the low vision aiding method of the present application, referring to fig. 3, after step S22, the method includes:
step S23, adjusting the distance between the first optical lens and the second optical lens in the low vision aid device and the first display screen and the second display screen based on the acquired focal length adjustment operation;
step S24, and/or adjusting a distance between the first optical lens and the second optical lens in the low vision aid based on the pupil distance adjustment operation.
In this embodiment, the low vision aid has 2 optical lenses, namely, a first optical lens and a second optical lens, which are respectively positioned corresponding to two eyes of a low vision user. The first optical lens and the second optical lens have the amplifying function, so that the auxiliary view projected by the shooting device can be amplified, the visual effects of an oversized screen and a feeling of presence are presented, the watching of a low-vision user is facilitated, and the watching experience of the low-vision user is improved. In addition, since the optical lens can enlarge an image and is not detrimental to the image quality, a user with low vision can view a clearer image. It should be noted that, the image may be enlarged by a nearest neighbor method, a bilinear interpolation method, a cubic interpolation method, or the like by obtaining the magnification of the input of the low-vision user, and may be flexibly set in the implementation process, which is not limited herein.
Focal length refers to a measure of the concentration or divergence of light in an optical system, meaning the distance from the optical center of a lens to the focal point of light concentration when parallel light is incident, and an optical system with a short focal length has better light concentration than an optical system with a long focal length. The focal length determines the viewing angle, that is, determines the viewing range, the smaller the focal length is, the wider the viewing field is, the wider the viewing range is, but the smaller the ratio of the scenery in the picture to the picture is; the larger the focal length, the narrower the field of view, and the narrower the viewing range, but the larger the scene in the screen is in the screen. Because the content of the images which are required to be watched by different low-vision users is different, the low-vision users need to adjust the focal length according with the watching test conditions of the users in the watching process. The first optical lens and the second optical lens of the low vision aid device are respectively positioned corresponding to the eyes of a low vision user, so that the distance between the first optical lens and the second optical lens and the first display screen and the distance between the second optical lens and the second display screen are adjusted, the focal length can be adjusted to the distance required by the user, and the watching experience of the low vision user is improved.
Pupil distance is simply the distance of the pupil. The eyes of a normal person watch the same object, the objects are respectively imaged at the retinas of the eyes and are overlapped at the central vision of the brain to form a complete single object with three-dimensional sense, and the function is called binocular single vision. Because the interpupillary distances of different low-vision users are quite different, the low-vision users need to adjust the interpupillary distances according with the viewing test conditions before viewing. The first optical lens and the second optical lens of the low vision aid device are respectively positioned corresponding to the two eyes of the low vision user, so that the pupil distance can be adjusted to the distance required by the user by adjusting the distance between the first optical lens and the second optical lens, and the watching experience of the low vision user is improved.
Specifically, the viewing test refers to an operation of adjusting the focal length and the interpupillary distance according to own needs and the image display effect before viewing using the low vision assisting device by a low vision user.
The user can manually adjust the positions of the two optical lenses so as to adjust the focal length and the pupil distance, and can also input the focal length parameter and the pupil distance parameter so as to adjust the focal length and the pupil distance, and the optical lens can be flexibly set in the implementation process without limitation.
In this embodiment, through adjustment focus and interpupillary distance to satisfied different low vision users ' mutually different vision thing demands, realized assisting low vision user can see the external environment clearly more clearly, promoted low vision user's definition, convenience and comfort level of watching, practiced thrift low vision user's cost of helping to look.
Further, in a fourth embodiment of the low vision aiding method of the present application, referring to fig. 4, step S30 includes:
step S31, acquiring an image primary processing request of an original image;
step S32, based on the image preliminary processing request, a vision-aiding image is obtained.
In this embodiment, after the low vision assisting program displays the obtained original images on the first display screen and the second display screen respectively, the first image and the second image are correspondingly obtained, and it should be noted that the distinction between the first image and the second image is to reflect the split screen effect presented by the photographing device (the low vision assisting program divides the image photographed by the photographing device into two identical images), and after the split screen display, only one image is still seen by the low vision user, that is, the original image.
Specifically, the low vision aiding program firstly acquires a primary processing request of an image seen by a low vision user about him, and then performs corresponding operation based on the primary processing request of the image, so that an aiding image which the low vision user wants to see is obtained, namely, the display effect of the image is adjusted according to the requirements of different low vision users, so that the different vision requirements of the different low vision users are met, the aim that the low vision user can see the external environment more clearly is achieved, the viewing definition, the viewing convenience and the comfort of the low vision user are improved, and the aiding cost of the low vision user is saved.
Further, in a fifth embodiment of the low vision aiding method of the present application, step S32 includes:
step S321, if the image preliminary processing request belongs to the color processing request, executing a preset image enhancement algorithm to obtain a vision-aiding image;
step S322, if the image preliminary processing request belongs to an edge enhancement request, executing a preset edge enhancement algorithm to obtain a vision-aiding image, wherein the edge enhancement request comprises an original image added edge, a white display edge and a black display edge;
in step S323, if the image preliminary processing request belongs to the image basic processing request, parameters of the photographing device are adjusted based on the image basic processing request and/or a preset image basic processing algorithm is executed to obtain the auxiliary image, wherein the image basic processing request includes adjustment of image brightness, image contrast and image size.
In this embodiment, after the low vision aiding program obtains the primary processing request of the image seen by the user, it first determines the type of the primary processing request of the image, that is, whether it is a color processing request, an edge enhancement request or an image basic processing request; if the image preliminary processing request belongs to the color processing request, executing a preset image enhancement algorithm, performing color mode conversion on the image to obtain a vision-aiding image, and meeting different requirements of different users on viewing colors, wherein the color modes comprise, but are not limited to, a color mode, a black-and-white mode, a white-and-black mode, a blue-and-yellow mode and the like.
The image preliminary processing request belongs to an edge enhancement request, and an image is obtained by detecting and enhancing the edge of the image, wherein the edge enhancement request comprises an original image added edge, a white display edge and a black display edge; methods of image edge detection include, but are not limited to, roberts edge detection, canny edge detection, sobel edge detection, prewitt edge detection, laplacian edge detection, deep learning-based edge detection, and the like.
If the image preliminary processing request belongs to the image basic processing request, adjusting parameters of the shooting device based on the image preliminary processing request to obtain a vision-aiding image, or executing a preset image basic processing algorithm to obtain the vision-aiding image, or adjusting parameters of the shooting device and executing the preset image basic processing algorithm to obtain the vision-aiding image, wherein the image preliminary processing request comprises image brightness, image contrast and image size and can be flexibly set in the implementation process without limitation.
In this embodiment, by adjusting any one or more of color mode, image brightness, image contrast, image size and edge enhancement, different vision requirements of different low-vision users are satisfied, so that the external environment can be more clearly seen by the low-vision users, the viewing definition, convenience and comfort of the low-vision users are improved, and the viewing assisting cost of the low-vision users is saved.
Further, in a sixth embodiment of the low vision aiding method of the present application, referring to fig. 5, after step S40, the method includes:
step S50, an image processing request of a vision-aiding image is obtained, wherein the image processing request comprises an image shooting request and/or an image recording request;
step S60, processing the auxiliary image according to a preset image processing method based on the image processing request to obtain a processed auxiliary image;
step S70, outputting the processed vision-aiding image.
In this embodiment, after the auxiliary view image is output, if the low-vision user needs to save the image in the viewing process, the interested image can be saved in a shooting or video recording mode, so that the low-vision user can watch the image again in a later period, and the time of the low-vision user is saved.
Further, in a seventh embodiment of the low vision aiding method of the present application, referring to fig. 6, after step S40, the method further includes:
step S80, based on the acquired voice playing request of the vision-aiding image, identifying characters in the vision-aiding image, and obtaining a character identification result, wherein the voice playing request is that the characters in the vision-aiding image are output in a voice mode;
step S90, playing a character recognition result by voice;
step S100, and/or, based on the acquired light filling request, activating a flash to fill the surrounding environment of the auxiliary image with light.
In this embodiment, after the auxiliary view image is output, if the low-vision user needs to identify the text in the image in the viewing process, the low-vision user may output a voice playing request, so that the low-vision auxiliary view program may identify the corresponding text in the image, and play the text identifying result in a voice form, thereby implementing the auxiliary low-vision user to normally view text or picture information, or external environment, etc., improving the viewing convenience and comfort of the low-vision user, and saving the viewing cost of the low-vision user, where the identification may be text recognition, chinese translation or foreign language translation, etc., and may be flexibly set in the implementation process, without limitation.
Or, when the brightness of the surrounding environment is insufficient, the low-vision user needs to start the flash lamp to supplement light to the surrounding environment of the image, and then the low-vision user can output a light supplement request, so that the low-vision-aiding program can supplement light to the surrounding environment (referred to as an image acquisition environment or a shooting environment) of the image by starting the flash lamp, thereby improving the brightness of the surrounding environment of the image and facilitating the viewing of the user. It should be noted that the number and the positions of the flash lamps can be flexibly set in the implementation process, and the invention is not limited herein.
In this embodiment, the text recognition result is played through the voice, and the flash lamp is started to supplement light to the surrounding environment of the auxiliary view image, wherein any one or two operations are performed, so that the different vision requirements of different low-vision users are met, the auxiliary low-vision users can see the image more clearly, the viewing definition, the viewing convenience and the viewing comfort of the low-vision users are improved, and the viewing assisting cost of the low-vision users is saved.
The present application reduces to the body now: 1. the mobile phone is commonly available, and the low-vision assisting device can realize vision assistance 2 only by installing low-vision assisting software, so that the cost is quite low compared with other vision assisting devices. Meanwhile, the vision-assisting physical examination of the low-vision user is improved, the experience is 1, the mobile phone is portable 2, the low-vision-assisting device belongs to the head-mounted type, and hands can be liberated and optimized.
The application also provides a terminal, the terminal includes: the system comprises a memory, a processor and a low vision aid program stored on the memory and capable of running on the processor, wherein the low vision aid program realizes the steps of the low vision aid method when being executed by the processor.
The present application also provides a computer readable storage medium having stored thereon a low vision aid program which when executed by a processor implements the steps of the low vision aid method described above.
In the embodiments of the low vision aiding method, the terminal and the readable storage medium of the present application, all technical features of each embodiment of the low vision aiding method are included, and the expansion and explanation contents of the description are basically the same as those of each embodiment of the low vision aiding method, which are not described in detail herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), comprising several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method described in the embodiments of the present application.
The foregoing description is only of the preferred embodiments of the present application, and is not intended to limit the scope of the claims, and all equivalent structures or equivalent processes using the descriptions and drawings of the present application, or direct or indirect application in other related technical fields are included in the scope of the claims of the present application.
Claims (7)
1. A method of low vision aid, the method comprising:
detecting an application scene of a low-vision aid program, wherein the application scene comprises single-screen display and split-screen display;
acquiring an original image projected by a shooting device;
processing the original image according to a preset method to obtain a vision-aiding image;
outputting the vision-aiding image;
the step of obtaining the original image projected by the shooting device comprises the following steps:
if the application scene is displayed on a single screen, acquiring an image displayed by the shooting device as the original image;
if the application scene is split-screen display, acquiring a first image and a second image displayed by the shooting device as the original image, wherein the first image is displayed on a first display screen of the shooting device, the second image is displayed on a second display screen of the shooting device, and the split-screen comprises a superposition effect for enabling an image seen by a user to be more stereoscopic;
based on the acquired focal length adjustment operation, adjusting the distances between a first optical lens and a second optical lens in the low vision aid device and the first display screen and the second display screen;
and/or the number of the groups of groups,
and adjusting the distance between the first optical lens and the second optical lens in the low-vision aid based on the acquired pupil distance adjustment operation.
2. The low vision aiding method of claim 1, wherein the step of processing the original image according to a preset method to obtain the aiding image comprises:
acquiring an image primary processing request of the original image;
and obtaining the vision-aiding image based on the image preliminary processing request.
3. The low vision aiding method of claim 2, wherein the step of obtaining the aiding image based on the image preliminary processing request comprises:
if the image preliminary processing request belongs to a color processing request, executing a preset image enhancement algorithm to obtain the vision-aiding image;
if the image preliminary processing request belongs to an edge enhancement request, executing a preset edge enhancement algorithm to obtain the vision-aiding image, wherein the edge enhancement request comprises an original image added edge, a white display edge and a black display edge;
and if the image preliminary processing request belongs to an image basic processing request, adjusting parameters of the shooting device based on the image basic processing request and/or executing a preset image basic processing algorithm to obtain the vision-aiding image, wherein the image basic processing request comprises adjustment of image brightness, image contrast and image size.
4. A low vision aiding method according to claim 3, wherein after the step of outputting the aiding image, comprising:
acquiring an image processing request of the vision-aiding image, wherein the image processing request comprises an image shooting request and/or an image recording request;
based on the image processing request, processing the auxiliary view image according to a preset image processing method to obtain a processed auxiliary view image;
and outputting the processed vision-aiding image.
5. The low vision aiding method of claim 3, wherein after the step of outputting the aiding image, further comprising:
based on the acquired voice playing request of the vision-aiding image, recognizing characters in the vision-aiding image, and obtaining a character recognition result, wherein the voice playing request is to output the characters in the vision-aiding image in a voice mode;
playing the character recognition result by voice;
and/or the number of the groups of groups,
and starting a flash lamp to supplement light to the surrounding environment of the auxiliary image based on the acquired light supplement request.
6. A terminal, the terminal comprising: a memory, a processor, and a low vision aid program stored on the memory and executable on the processor, which when executed by the processor, performs the steps of the low vision aid method of any one of claims 1 to 5.
7. A storage medium having stored thereon a low vision aid program which when executed by a processor performs the steps of the low vision aid method of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010030657.8A CN111208964B (en) | 2020-01-13 | 2020-01-13 | Low vision aiding method, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010030657.8A CN111208964B (en) | 2020-01-13 | 2020-01-13 | Low vision aiding method, terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111208964A CN111208964A (en) | 2020-05-29 |
| CN111208964B true CN111208964B (en) | 2023-08-01 |
Family
ID=70790101
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010030657.8A Active CN111208964B (en) | 2020-01-13 | 2020-01-13 | Low vision aiding method, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111208964B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113132653B (en) * | 2021-04-14 | 2022-05-17 | 杭州恒生数字设备科技有限公司 | Automatic split screen implementation method capable of being split into screens with any playing number |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001346085A (en) * | 2000-06-05 | 2001-12-14 | Canon Inc | Image processor, image processing method, and storage medium |
| CN101542584A (en) * | 2006-10-16 | 2009-09-23 | 索尼株式会社 | Display device and display method |
| CN109670445A (en) * | 2018-12-19 | 2019-04-23 | 宜视智能科技（苏州）有限公司 | Low vision aid intelligent glasses system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8957835B2 (en) * | 2008-09-30 | 2015-02-17 | Apple Inc. | Head-mounted display apparatus for retaining a portable electronic device with display |
-
2020
- 2020-01-13 CN CN202010030657.8A patent/CN111208964B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001346085A (en) * | 2000-06-05 | 2001-12-14 | Canon Inc | Image processor, image processing method, and storage medium |
| CN101542584A (en) * | 2006-10-16 | 2009-09-23 | 索尼株式会社 | Display device and display method |
| CN109670445A (en) * | 2018-12-19 | 2019-04-23 | 宜视智能科技（苏州）有限公司 | Low vision aid intelligent glasses system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111208964A (en) | 2020-05-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220284844A1 (en) | Dark mode display interface processing method, electronic device, and storage medium | |
| US10146304B2 (en) | Methods and apparatus for vision enhancement | |
| US9838597B2 (en) | Imaging device, imaging method, and program | |
| WO2020192458A1 (en) | Image processing method and head-mounted display device | |
| RU2672502C1 (en) | Device and method for forming cornea image | |
| US11546527B2 (en) | Methods and apparatuses for compensating for retinitis pigmentosa | |
| CN108762501B (en) | AR display method, intelligent terminal, AR device and AR system | |
| CN110263617B (en) | Three-dimensional face model obtaining method and device | |
| JP2010004118A (en) | Digital photograph frame, information processing system, control method, program, and information storage medium | |
| CN105607263A (en) | Head mounted electronic equipment | |
| CN110708533A (en) | Visual assistance method based on augmented reality and intelligent wearable device | |
| US11573629B2 (en) | Image processing and display method, augmented reality device, image processing device, and display system | |
| US10162997B2 (en) | Electronic device, computer readable storage medium and face image display method | |
| US20150172553A1 (en) | Display device, display method, and computer-readable recording medium | |
| CN113850726A (en) | Image transformation method and device | |
| CN111208964B (en) | Low vision aiding method, terminal and storage medium | |
| WO2022147151A1 (en) | Real-time video communication interface with haptic feedback | |
| KR20140141419A (en) | Display apparatus and control method thereof | |
| JP2014197802A (en) | Work support system and program | |
| JP2014006604A (en) | Image formation device, image formation method, and program | |
| JP2017173455A (en) | Information processing device, information processing method, and program | |
| CN111736692B (en) | Display method, display device, storage medium and head-mounted device | |
| CN115237363A (en) | Picture display method, device, equipment and medium | |
| JP7128347B2 (en) | Image processing device, image processing method and program, imaging device | |
| JP2015133549A (en) | Image processing system, image processing method and computer program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |