CN105718067B - Augmented reality system and method capable of assisting color discrimination - Google Patents
Augmented reality system and method capable of assisting color discrimination Download PDFInfo
- Publication number
- CN105718067B CN105718067B CN201610118103.7A CN201610118103A CN105718067B CN 105718067 B CN105718067 B CN 105718067B CN 201610118103 A CN201610118103 A CN 201610118103A CN 105718067 B CN105718067 B CN 105718067B
- Authority
- CN
- China
- Prior art keywords
- color
- image
- auxiliary
- augmented reality
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 52
- 238000000034 method Methods 0.000 title claims abstract description 20
- 230000004456 color vision Effects 0.000 claims abstract description 44
- 238000012545 processing Methods 0.000 claims abstract description 44
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 8
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 8
- 239000003086 colorant Substances 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims description 6
- 208000036693 Color-vision disease Diseases 0.000 claims 2
- 238000002372 labelling Methods 0.000 claims 2
- 230000002194 synthesizing effect Effects 0.000 abstract description 6
- 241000220317 Rosa Species 0.000 description 7
- 238000004590 computer program Methods 0.000 description 4
- 238000012937 correction Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 2
- 230000004438 eyesight Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 210000001508 eye Anatomy 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
- Image Processing (AREA)
Abstract
The invention provides an augmented reality system and method capable of assisting in color discrimination. The augmented reality system capable of assisting color discrimination comprises an image capturing module, an auxiliary color discrimination processing module and an augmented reality synthesizing module. The auxiliary color distinguishing processing module performs color vision auxiliary processing on at least one color block in the image according to the auxiliary color distinguishing parameters after the image is obtained by the image capturing module. And the augmented reality synthesis module connected with the auxiliary color distinguishing processing module displays the image subjected to the color vision auxiliary processing through the augmented reality image. By the technical scheme provided by the scheme, the user can obtain the actual color of the image by amplifying the real-world image, and further make up the inconvenience caused by the color discrimination obstacle.
Description
Technical Field
The invention relates to an augmented reality technical scheme, in particular to an augmented reality system and method capable of assisting color discrimination.
Background
In the eyes of people with dyschromatosis, the eyeball is abnormal in distinguishing light waves of specific wavelengths, so that it is quite difficult to identify specific colors. In the prior art, the color correction aid is provided to allow a user to wear glasses capable of processing specific light waves, and the light waves are filtered by the lenses and converted into colors that are sufficiently recognizable by the user.
Because each person with color-distinguishing disorder has different conditions, the color correction effect provided by the standard lens specification is limited, so the lens of the color correction auxiliary tool must be selected according to the degree and type of the color-distinguishing disorder of the user to achieve the best effect. Therefore, the purchasing specification of the color correction auxiliary tool is difficult to judge, the price is high, and the technology cannot be popularized.
In summary, it is an urgent need in the art to provide a technical solution for displaying a corresponding augmented reality to assist color discrimination according to a user's color identification obstacle.
Disclosure of Invention
In order to solve the above problems, the present invention provides a technical solution of augmented reality capable of assisting color discrimination.
The invention provides an augmented reality system capable of assisting in color discrimination. The image capturing module is used for capturing an external image. The auxiliary color distinguishing processing module connected with the image acquisition module can carry out color vision auxiliary processing on at least one color block in the image according to the auxiliary color distinguishing parameters after the image is acquired. And the augmented reality synthesis module connected with the auxiliary color distinguishing processing module displays the image subjected to the color vision auxiliary processing through the augmented reality image.
The invention provides an augmented reality method capable of assisting color discrimination, which comprises the following steps: first, an external image is captured. Then, at least one color block in the image is processed with color vision assistance according to the auxiliary color distinguishing parameter. Then, the image subjected to the color vision auxiliary processing is displayed through the augmented reality image.
In summary, the augmented reality system and method capable of assisting color discrimination of the present invention perform appropriate color vision auxiliary processing on the color blocks in the image through the auxiliary color discrimination parameters corresponding to the user color identification barriers, so that the user can know in real time what the color of the image is watched.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a block diagram illustrating an augmented reality system capable of assisting color discrimination according to an embodiment of the present disclosure.
FIG. 2 is a flowchart illustrating an augmented reality method capable of assisting color discrimination according to an embodiment of the present disclosure.
Fig. 3 is a schematic diagram of an example of an augmented reality capable of assisting color discrimination according to an embodiment of the present disclosure.
In the figure:
1-augmented reality system capable of assisting color discrimination
11-color vision detecting module
12-image acquisition module
13-auxiliary color discrimination processing module
14-augmented reality synthesis module
2-color vision detection database
Detailed Description
Specific examples are described below to illustrate embodiments of the present invention, but are not intended to limit the scope of the invention.
Please refer to fig. 1, which is a block diagram illustrating an augmented reality system 1 capable of assisting color discrimination according to the present invention. The system includes a color vision detecting module 11, an image capturing module 12, an auxiliary color distinguishing processing module 13, and an augmented reality synthesizing module 14. The auxiliary color-distinguishing processing module 13 is connected to the color vision detecting module 11, the image capturing module 12 and the augmented reality synthesizing module 14. The color vision detecting module 11, the auxiliary color distinguishing processing module 13, and the augmented reality synthesizing module 14 are software modules, and the software modules can be implemented by program languages such as ASP, C/C + +/C #, JAVA, Python, PHP, Perl, etc., but the types of the program languages are not limited thereto. The image capturing module 12 may be selected from a camera and an image reading device, but the type of the image capturing module 12 is not limited thereto.
The color vision detecting module 11 is a user interface for detecting the type and degree of the color vision recognition disorder of the user. The color vision detecting module 11 can be connected to the remote color vision detecting database 2 through a network (if the system is in a non-network environment, the color vision detecting database 2 can be built in and integrated into the system). The color vision detecting database 2 provides the color vision detecting module 11 with the data for detecting the color discrimination power, and detects the user color discrimination power through the data to determine the type (red, green, blue) and the degree of the user color vision identification obstacle. The color vision database 2 provides detection data (e.g., Kirschner's blind detection map, etc.) for detecting color discrimination.
In operation, the color vision detecting module 11 can obtain the color distinguishable by the user with color vision feedback information, for example, can inquire whether the user can distinguish a certain color currently displayed to obtain the resolution capability by using the web interface (for example, a user with slight greenness may distinguish several greenness such as dark green, light green, yellow green, blue green, etc., and a user with severe greenness may distinguish only dark green and light green). And analyzing the user's response after the query to output a set of auxiliary color discrimination parameters (including the type and degree of color vision recognition disorder and user color vision feedback information).
The image capturing module 12 is used for capturing an image of an external target. The auxiliary color distinguishing module 13 performs color vision auxiliary processing on at least one color block in the image according to the auxiliary color distinguishing parameters after the image is obtained. The augmented reality synthesizing module 14 displays the color vision auxiliary processed image through the augmented reality image.
Further, the image capturing module 12 can capture an image that needs to be assisted by color recognition, where the image can be a movie dynamically captured by the user or a specific image file case selected by the user.
In another embodiment, the color vision auxiliary processing of the auxiliary color distinguishing processing module 13 marks color description words on at least one color block according to the auxiliary color distinguishing parameters. For example, if it is known that the user has difficulty identifying the brown rose from the auxiliary color-distinguishing parameter, at this time, when the auxiliary color-distinguishing processing module 13 identifies the brown rose region block in the image, the character mark is "brown rose" at the position corresponding to the region block, and the augmented reality synthesizing module 14 synthesizes the original image and the region block (marked character) processed by the auxiliary color-distinguishing processing module 13 with the original image to form an augmented reality image, so that the user can know that the color of the region block of the image is brown rose.
In another embodiment, after analyzing the image, the auxiliary color-distinguishing processing module 13 respectively extracts the portions to be processed according to the auxiliary color-distinguishing parameters to perform the color vision auxiliary processing, replaces the target color region with the color that can be recognized by the user, and synthesizes the replaced color region with the original image by the augmented reality synthesis module 14 to form the augmented reality image.
For example, when the auxiliary color-distinguishing parameter indicates that the user has difficulty in identifying the brown rose, the auxiliary color-distinguishing processing module 13 will perform a deepening process (replacing the image block with a dark red color) on the image block belonging to the brown rose color in the image, and after the user views the image through the augmented reality, the user can know that the image block is a red block.
Tables 1 and 2 are the aforementioned auxiliary color discrimination parameters, and when the color vision detection module 11 finds that the degree of the user's identification obstacle for red and green colors is weak, the auxiliary color discrimination parameters will generate a corresponding replacement color (replacement color code: 0X00FF0000) for the target color (primary color code: 0X00BC8F8F) through the internal database.
| The kind of disorder of color vision recognition | Red and green |
| Degree of disorder in color vision recognition | Weakness of color |
Table 1: color vision test result
Table 2: color permutation table
The augmented reality composition module 14 superimposes the blocks (such as color description characters or deepened colors) processed by the auxiliary color discrimination processing module 13 on the original image information to form an augmented reality image (such as obtaining the superimposed position according to the pixel coordinates), and transmits the augmented reality image to an external display, so that the display displays the augmented reality image, and at this time, a user can know the color by watching the augmented reality image of the display, thereby achieving the purpose of auxiliary color discrimination.
Please refer to fig. 2, which is a flowchart illustrating an augmented reality method capable of assisting color discrimination according to another embodiment of the present invention. The method is applied to an electronic device and comprises the following steps:
s101: an external image is captured.
S102: and performing color vision auxiliary processing on at least one color block in the image according to the auxiliary color distinguishing parameters.
S103: and displaying the image subjected to the color vision auxiliary processing through the augmented reality image.
The electronic device may be a computer device, a handheld electronic device (e.g., a smart phone, a tablet computer, etc.), or a wearable device (e.g., a Google Glass)TM)。
In another embodiment, the color vision auxiliary processing is to mark color description words on at least one color block.
In another embodiment, the color vision auxiliary processing is to replace colors of at least one color block. Furthermore, the color vision auxiliary processing is to perform deepening processing on the colors of at least one color block.
In another embodiment, the present invention further provides a computer program product for an augmented reality method capable of assisting color discrimination, wherein the steps of the method can be completed when the computer program product is loaded and executed by a computer device.
FIG. 3 is a schematic diagram of an example of an amplification reality capable of assisting color discrimination, wherein the black circles are blue, the blank circles are green, the dotted circles are rose brown, the grid circles are dark red, the first row of three circles is a first group, the second row of three circles is a second group, and the third row of three circles is a third group. As shown, when the aforementioned augmented reality system 1, method or computer program product capable of assisting color discrimination is executed to obtain the image of the first group, and when it is known that the user has a color discrimination failure with respect to red, the color descriptive text "brown-rosy" is selectively generated and displayed through the augmented reality image as the image of the second group; or replacing the original color code (brown rose color: 0X00BC8F8F) with the image block of the replacement color code (0X00FF0000), and displaying the image as the third set through the augmented reality image. Therefore, through the system, the method or the computer program product of the invention, users with various types of dyschromatosis can know in real time and properly what the color of the viewed image is.
The detailed description is specific to one possible embodiment of the invention, but the embodiment is not intended to limit the scope of the invention, and all equivalent implementations or modifications that do not depart from the technical spirit of the invention are intended to be included within the scope of the invention.
Claims (6)
1. An augmented reality system capable of assisting color discrimination, comprising:
the image acquisition module is used for acquiring an external image;
the auxiliary color distinguishing processing module is connected with the image acquisition module to acquire the image, wherein the auxiliary color distinguishing processing module respectively acquires at least one color block in the image according to the auxiliary color distinguishing parameters to carry out color vision auxiliary processing;
the color vision detection module is connected with the auxiliary color distinguishing processing module, wherein the color vision detection module detects the state of color vision disorder of a user through a user interface so as to generate the auxiliary color distinguishing parameters; and
the augmented reality synthesis module is connected with the auxiliary color distinguishing processing module, wherein the augmented reality synthesis module displays the image subjected to the color vision auxiliary processing through the augmented reality image;
the color vision auxiliary processing is to generate a corresponding replacement color for the at least one color block captured by the auxiliary color distinguishing processing module through a database, and replace the at least one color block with an identifiable color block;
the augmented reality synthesis module synthesizes the color blocks which can be identified after the replacement and the original image respectively so as to form the color blocks which can be identified after the color blocks are directly viewed in the augmented reality image after the replacement.
2. The system of claim 1, wherein the color vision-aided process further comprises labeling the at least one color block with a color descriptor.
3. The system of claim 1, wherein the color vision-aided processing further comprises deepening the color of the at least one color block.
4. An augmented reality method capable of assisting color discrimination, applied to an electronic device, comprising the steps of:
capturing an external image;
detecting a color vision disorder state of a user via a user interface to generate an auxiliary color discrimination parameter;
respectively capturing at least one color block in the image according to the auxiliary color distinguishing parameter to perform color vision auxiliary processing; and
displaying the image subjected to color vision auxiliary processing through the augmented reality image;
the color vision auxiliary processing is to generate a corresponding replacement color for the at least one color block captured by the auxiliary color distinguishing processing module through the database, and replace the at least one color block with an identifiable color block;
the augmented reality synthesis module synthesizes the color blocks which can be identified after the replacement with the original image respectively so as to form the color blocks which can be identified after the color blocks are directly viewed in the augmented reality image after the replacement.
5. The method of claim 4, wherein the color vision-aided reality process further comprises labeling the at least one color block with a color descriptor.
6. The method of claim 4, wherein the color vision-aided reality process further comprises deepening the colors of the at least one color block.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW104140274A TW201721520A (en) | 2015-12-02 | 2015-12-02 | An augmented reality system realizing assisted color identification and a method thereof |
| TW104140274 | 2015-12-02 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105718067A CN105718067A (en) | 2016-06-29 |
| CN105718067B true CN105718067B (en) | 2020-07-31 |
Family
ID=56157349
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610118103.7A Expired - Fee Related CN105718067B (en) | 2015-12-02 | 2016-03-02 | Augmented reality system and method capable of assisting color discrimination |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105718067B (en) |
| TW (1) | TW201721520A (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI762970B (en) * | 2020-07-14 | 2022-05-01 | 中華電信股份有限公司 | Method and mobile device for guiding optical fiber jumping connection |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104268508A (en) * | 2014-09-15 | 2015-01-07 | 济南大学 | Portable traffic light distinguishing method for color blindness and color amblyopia people |
| CN204168399U (en) * | 2014-09-18 | 2015-02-18 | 华东师范大学 | A kind of colour blindness colour vision servicing unit |
| CN104821000A (en) * | 2015-05-22 | 2015-08-05 | 京东方科技集团股份有限公司 | Color identification system, color identification method and display device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3970052B2 (en) * | 2002-02-27 | 2007-09-05 | キヤノン株式会社 | Image processing device |
-
2015
- 2015-12-02 TW TW104140274A patent/TW201721520A/en unknown
-
2016
- 2016-03-02 CN CN201610118103.7A patent/CN105718067B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104268508A (en) * | 2014-09-15 | 2015-01-07 | 济南大学 | Portable traffic light distinguishing method for color blindness and color amblyopia people |
| CN204168399U (en) * | 2014-09-18 | 2015-02-18 | 华东师范大学 | A kind of colour blindness colour vision servicing unit |
| CN104821000A (en) * | 2015-05-22 | 2015-08-05 | 京东方科技集团股份有限公司 | Color identification system, color identification method and display device |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201721520A (en) | 2017-06-16 |
| CN105718067A (en) | 2016-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106446873B (en) | Face detection method and device | |
| US9342751B2 (en) | User hand detecting device for detecting user's hand region and method thereof | |
| US9807300B2 (en) | Display apparatus for generating a background image and control method thereof | |
| CN110675373B (en) | Component installation detection method, device and system | |
| CN104700424B (en) | Medical color fujinon electronic video endoscope dead pixel points of images detection means | |
| CN102708383A (en) | System and method for detecting living face with multi-mode contrast function | |
| CN107005655A (en) | Image processing method | |
| CN113066195A (en) | Power equipment inspection method and device, AR glasses and storage medium | |
| WO2019066373A1 (en) | Method of correcting image on basis of category and recognition rate of object included in image and electronic device implementing same | |
| KR20110128574A (en) | Method for recognizing human face and recognizing apparatus | |
| WO2019061659A1 (en) | Method and device for removing eyeglasses from facial image, and storage medium | |
| CN104751419A (en) | Picture display regulation method and terminal | |
| WO2018174493A1 (en) | Method for correcting image processing region corresponding to skin and electronic device | |
| CN112949437A (en) | Gesture recognition method, gesture recognition device and intelligent equipment | |
| CN105718067B (en) | Augmented reality system and method capable of assisting color discrimination | |
| CN104077784B (en) | Extract the method and electronic equipment of destination object | |
| KR20160087591A (en) | Method for recognition of road information and position information using quick response code and apparatus using thereof | |
| CN110441318A (en) | A kind of chemical fibre spinneret hole defect inspection method based on machine vision | |
| CN104813341A (en) | Image processing apparatus using differential camera | |
| CN112689151B (en) | Live broadcast method and device, computer equipment and storage medium | |
| CN105976001A (en) | False-proofing license plate making QR code and serial number identifier identification method | |
| CN112907571A (en) | Target judgment method based on multispectral image fusion recognition | |
| Bangar et al. | Vocal vision for visually impaired | |
| CN115797280A (en) | Transformer surface defect detection system based on image AI recognition algorithm | |
| KR102282373B1 (en) | Position Verification System For Confirming Change In MMS Image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200731 Termination date: 20210302 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |