TW201721520A - An augmented reality system realizing assisted color identification and a method thereof - Google Patents

Abstract

The invention provides an augmented reality system realizing assisted color identification and a method thereof. The augmented reality system realizing assisted color identification comprises an image capturing module, an assisted color identification processing module and an augmented reality synthesis module. After the image is obtained through the image capturing module, the assisted color identification processing module carries out color vision assisted processing on at least one color block in an image according to assisted color identification parameters. The augmented reality synthesis module connected to the assisted color identification processing module displays the image processed by the color vision assisted processing in the form of an augmented reality image. A user can know the real color of the image by means of the augmented reality image so as to compensate for inconvenience due to color identification barriers.

Description

Augmented reality system, method and computer program product capable of assisting color discrimination

The invention relates to an augmented reality technical solution, in particular to an augmented reality system, method and computer program product capable of assisting color discrimination.

In the eyes of people with color discrimination, since the eyeball is abnormal in distinguishing light waves of a specific wavelength, there is considerable difficulty in identifying a specific color. Conventional color correction aids allow the user to wear glasses that can handle specific light waves, and when the light waves are processed through the lens filtering, they can be converted into colors that the user can recognize.

Due to the different conditions of each color-disappearing person, the standard lens size can provide a limited color correction effect, so the lens of the color-correcting accessory must be selected according to the degree and type of the user's color-discussion to achieve the best effect. . Because of this, the purchase specifications of the color correction aids are difficult to judge and the price remains high, making the technology unable to achieve universalization.

In summary, how to provide a technical solution that can identify the obstacle according to the color of the user to display the corresponding amplifying and augmented reality to assist in color discrimination is a technical problem that needs to be solved in the field.

In order to solve the problems disclosed above, it is an object of the present invention to provide a technical solution that can assist in the augmentation of color recognition.

In order to achieve the above object, the present invention proposes an augmented reality system capable of assisting in color discrimination. System. The system includes an image capture module, an auxiliary color recognition processing module, and an augmented reality synthesis module. The image capturing module is configured to capture an external image. The auxiliary color processing module connected to the image capturing module performs color vision assist processing on at least one color block in the image according to the auxiliary color determining parameter after acquiring the image. The augmented reality synthesis module connected to the auxiliary color recognition processing module further displays the image of the color vision auxiliary processing through the augmented reality image.

In order to achieve the above object, the present invention proposes an augmented reality side that can assist in color discrimination. law. The method includes the following steps: First, an external image is captured. Then, color vision assist processing is performed on at least one color block in the image according to the auxiliary color discrimination parameter. Furthermore, the image of the color vision assisted processing is displayed via the augmented reality image.

In order to achieve the above object, the present invention provides an augmented reality computer capable of assisting in color discrimination. Program product. When the computer device loads and executes the computer program product, the steps described in the foregoing method can be completed.

In summary, the augmented reality system and method for assisting color discrimination of the present invention The computer program product performs appropriate color vision assist processing on the color blocks in the image through the auxiliary color discrimination parameters corresponding to the color recognition obstacles of the respective users, so that the user can immediately know the color of the viewing image.

1‧‧‧Augmented Reality System

11‧‧‧ Color vision detection module

12‧‧‧Image capture module

13‧‧‧Auxiliary color processing module

14‧‧‧Augmented Reality Synthesis Module

2‧‧‧Color detection database

FIG. 1 is a block diagram showing an augmented reality system capable of assisting color discrimination according to an embodiment of the present invention.

FIG. 2 is a flow chart of an augmented reality method capable of assisting color discrimination according to an embodiment of the present invention.

The specific embodiments are described below to illustrate the embodiments of the invention, but are not intended to limit the scope of the invention.

Please refer to FIG. 1, which is a block diagram of an augmented reality system 1 for assisting color discrimination according to the present invention. The foregoing system includes a color vision detection module 11 , an image capture module 12 , an auxiliary color recognition processing module 13 , and an augmented reality synthesis module 14 . The auxiliary color recognition processing module 13 is connected to the color vision detection module 11 , the image capturing module 12 , and the augmented reality composition module 14 . The color vision detection module 11, the auxiliary color recognition processing module 13, and the augmented reality synthesis module 14 are software modules, and the software module can be ASP, C/C++/C#, JAVA, It is implemented in Python, PHP, Perl, etc., but the category of the programming language is not limited to this. The image capturing module 12 can be selected as a photographic device or an image reading device. The type of the image capturing module 12 is not limited thereto.

The color vision detection module 11 is configured to detect a user interface of the user to detect the type and extent of the color vision recognition disorder. The color vision detection module 11 can be externally connected to the remote color detection database 2 through the network (if the network is not available, the color detection database 2 can be built into the system). The color vision detection database 2 provides the color vision detection module 11 to detect the color discrimination data, and uses the data to detect the user's color discrimination power to determine the user's color perception recognition type (red, green, blue) and severity. . The aforementioned color vision database color vision detection database 2 provides detection data for detecting color discrimination (for example, Ishihara's color blind detection map, etc.).

In operation, the color vision detection module 11 can learn the color distinguishable by the color vision recognition obstacle through the color vision feedback information of the user. For example, the user can distinguish whether the user can distinguish a certain color currently displayed by the web interface. Know the resolving power (such as a light green weak user It can still distinguish several kinds of green such as dark green, light green, yellow green, blue green, etc. Users with heavy green weakness may only distinguish between dark green and light green. After the inquiry, the user's response is analyzed to output a set of auxiliary color discrimination parameters (including the color perception recognition type, degree and user color perception feedback information).

The image capturing module 12 is configured to capture an image of an external target. And auxiliary After acquiring the image, the color processing module 13 performs color vision assist processing on at least one color block in the image according to the auxiliary color discrimination parameter. The augmented reality composition module 14 displays the image of the color vision assist processing via the augmented reality image.

Further, the foregoing image capturing module 12 can be customized for the user. The image of the auxiliary color discrimination is used for capturing, and the image can be a movie that the user dynamically shoots or select a specific image file by himself.

In another embodiment, the color vision assisting portion of the auxiliary color discrimination processing module 13 is as described above. The system marks the color description text of at least one color block according to the auxiliary color discrimination parameter. For example, if it is known by the auxiliary color discrimination parameter that the user has difficulty in identifying the brown rose red, the auxiliary color processing module 13 will recognize the brown rose red block in the image when it is recognized. The position is marked as "brown rose red" by the character, and the augmented reality synthesis module 14 synthesizes the block (marked text) processed by the original image and the auxiliary color recognition processing module 13 with the original image to form an expansion. Enrich the image so that the user can know that the block color of the image is brown rose red.

In another embodiment, the auxiliary color recognition processing module 13 will root after analyzing the image. According to the auxiliary color discrimination parameter, the parts to be processed are separately extracted for color vision auxiliary processing, the target color block is replaced with a color recognizable by the user, and the real-time synthesis module 14 is amplified and the replaced color block is obtained. Synthesize with the original image to form an augmented reality image.

For example, when the auxiliary color discrimination parameter indicates that the user has recognized the brown rose red Difficult, at this time, the auxiliary color recognition processing module 13 deepens the image block belonging to the brown rose red in the image (replaces the image block of the deep red color), and when the user views the image through the augmented reality , you can know that the block of the image is a red block.

Table 1 and Table 2 are the aforementioned auxiliary color discrimination parameters when passing through the color vision detection module 11 When it is known that the degree of recognition of the red-green color is weak, the auxiliary color discrimination parameter generates a corresponding replacement color (replacement color code: 0X00FF0000) through the internal database to the target color (primary color code: 0X00BC8F8F).

The augmented reality synthesis module 14 described above will assist the color recognition processing module 13 to image The processed blocks (such as color description text or deep color) are superimposed on the original image information to form an augmented reality image (for example, the overlapping position is obtained according to pixel coordinates), and transmitted to an external display. In order for the display to display the augmented reality image, at which time the user views the display Amplify the real-world image to know what the color is, in order to achieve the purpose of assisting color discrimination.

Please refer to FIG. 2 , which is a flowchart of a method for augmenting reality that can assist in color discrimination according to another embodiment of the present invention. The method is applied to an electronic device and includes the following steps: S101: capturing an external image.

S102: Perform color vision assist processing on at least one color block in the image according to the auxiliary color discrimination parameter.

S103: Display the image of the color vision auxiliary processing through the augmented reality image.

Of the electronic device may be a computer device, a handheld electronic device (for example: smartphones, tablet, etc.), or wearable devices (e.g.: Google Glass ^TM).

In another embodiment, the aforementioned color vision assisting process marks the color description text for at least one color block.

In another implementation, the aforementioned color vision assisting process replaces the color of at least one color block. Further, the color sensation processing described above deepens the color of at least one color block.

In another embodiment, the present invention further provides a computer program product for augmented reality method for assisting color discrimination. When the computer device loads and executes the computer program product, the steps described in the foregoing method can be completed.

Please refer to the descriptions in Annex 1, Annex 2 and Annex 3. When the augmented reality system 1, method or computer program product capable of assisting color discrimination obtains an image as shown in Annex 1 during execution, and selects a color when it is known that the user has a color discrimination obstacle to red Describe the text "Brown Rose Red" and display the image as shown in Attachment 2 through the augmented reality image; or replace the original color code (Brown Rose Red: 0X00BC8F8F) with the image block of the replacement color code (0X00FF0000) and pass through the amplification The real image shows the image as shown in Annex 3. According to the system, method or computer program of the present invention Products, users of various types of color discrimination can instantly and appropriately know the color of the viewing image.

The above detailed description is specific to one of the possible embodiments of the present invention, The examples are not intended to limit the scope of the invention, and the equivalents of the embodiments of the invention are intended to be included in the scope of the invention.

1‧‧‧Augmented Reality System

11‧‧‧ Color vision detection module

12‧‧‧Image capture module

13‧‧‧Auxiliary color processing module

14‧‧‧Augmented Reality Synthesis Module

2‧‧‧Color detection database

Claims (12)

An augmented reality system capable of assisting in color discrimination, comprising: an image capturing module for capturing an external image; an auxiliary color processing module, connecting the image capturing module to obtain the image, wherein the color matching is assisted The processing module further performs color vision assist processing on at least one color block in the image according to the auxiliary color discrimination parameter; and augments the real-time synthesis module, and connects the auxiliary color recognition processing module, wherein the augmented reality synthesis module system The image of the color vision assisted processing is displayed via the augmented reality image. The augmented reality system for assisting color discrimination according to claim 1, further comprising a color vision detection module connected to the auxiliary color recognition processing module, wherein the color vision detection module is further The user interface detects the color vision disorder state of the user to generate an auxiliary color discrimination parameter. An augmented reality system capable of assisting color discrimination as described in claim 1, wherein the color vision assisting process marks the color description text for the color block. An augmented reality system as claimed in claim 1, wherein the color vision assisting process replaces the color of the color block. An augmented reality system capable of assisting color discrimination as described in claim 1, wherein the color vision assisting process deepens the color of the color block. An augmented reality system capable of assisting color discrimination as described in claim 1, wherein the auxiliary color discrimination parameter defines a color vision disorder state of the user. An augmented reality method capable of assisting color discrimination, applied to an electronic device, comprising the steps of: capturing an external image; Color vision assist processing is performed on at least one color block in the image according to the auxiliary color discrimination parameter; and the color vision assisted image is displayed through the augmented reality image. An augmented reality method for assisting color discrimination as described in claim 7, wherein the color vision assisting process marks the color description text for the color block. An augmented reality method as claimed in claim 7, wherein the color vision assisting process replaces the color of the color block. An augmented reality method capable of assisting color discrimination as described in claim 7, wherein the color vision assisting process deepens the color of the color block. An augmented reality method capable of assisting color discrimination as described in claim 7, wherein the auxiliary color discrimination parameter defines a color vision disorder state of the user. A computer program product for augmented reality method for assisting color discrimination, wherein the method of any one of claims 7 to 11 is completed when the computer device loads and executes the computer program product.