KR102087720B1 - Infrared light based Vision device - Google Patents

Abstract

The present invention relates to a visual assistance device using an optical system based on infrared light. An infrared light-based visual assistance device comprises: an infrared light source which irradiates infrared light toward an object located in front; an infrared light camera which detects infrared light reflected by the object and generates a monochromatic infrared light image composed of a plurality of infrared light pixels having infrared light brightness values; a graphic processing unit having an infrared light brightness value corresponding to brightness values of two or more color elements within a range of the infrared light brightness value, and determining a brightness value of two or more color elements corresponding to an infrared light brightness value for each infrared light pixel to generate a color pixel; and a color augmented image display device displaying a color augmented image consisting of a plurality of color pixels.

Description

Infrared light based vision device

The present invention relates to a visual aid device using an optical system based on infrared light.

The eye is a body organ that visually recognizes things through light. Light passing through the lens and the vitreous reaches the retina. Among the rod and cone cells located in the retina, the rod cells detect minute differences and changes in light in a dark environment below a certain illuminance, and the cone cells detect color differences and changes in relatively bright conditions above a certain illuminance. Signals generated by light-sensitive cells are transmitted to the brain via bipolar cells, ganglion cells, and the optic nerve, thereby allowing humans to visually recognize objects. Since only cone cells exist in the central macula or fovea located in the center of the apes and the human retina, only color can be detected, and minute light changes in dark environments can not be detected, and color loss is lost, as well as central vision. It leads to the loss of the real name.

On the other hand, if the rod cells, which are present in the entire retina except for the center and the region, are damaged, the entire field of vision is lost except for the central vision, so that the brightness of the light cannot be felt in the dark, and the field of view is narrowed. You will feel as if you are seeing through a hole, and you will have extreme night blindness at night when the brightness of the light drops considerably in the surrounding environment. Therefore, the axons of retinal ganglion cells, which are not only patients with rod cells damaged by various hereditary retinopathy or other causes, such as retinal pigmentosa, but also the cells of the optic nerve in the medial retina, such as glaucoma. In neurodegenerative diseases due to degeneration, patients with ophthalmic diseases with stenosis of the surrounding field cannot visually perceive objects in the dark. In addition, all retinal cells in areas other than the macular may be damaged, and since only the cone cells are present in the macular, the patient cannot visually recognize objects in the dark.

The present invention relates to a patient in which visual ability is significantly reduced in a narrow or dark area, for example, at night, due to limitation of visual function due to damage of rod cells or damage of retinal ganglion cells or other retinal cells. To provide an infrared light-based visual aid device for.

According to one aspect of the invention, there is provided an infrared light-based visual aid device. An infrared light-based visual aid device detects an infrared light source that irradiates infrared light toward an object located in front of the object, detects infrared light reflected by the object, and generates a monochrome infrared image including a plurality of infrared pixels having an infrared brightness value. An infrared camera, within the range of the infrared brightness value, the infrared brightness value corresponds to the brightness value of two or more color elements, and by determining the brightness value of the two or more color elements corresponding to the infrared brightness value for each infrared pixel color It may include a graphic processing unit for generating a pixel and a color augmented image display for displaying a color augmented image composed of a plurality of the color pixels.

In one embodiment, the infrared pixel includes two or more fields in which brightness values of two or more color elements are recorded, the infrared brightness value is an average of brightness values of color elements recorded in the two or more fields, and the color pixel. May be generated by recording brightness values of the determined two or more color elements in the two or more fields.

In one embodiment, the infrared brightness value and the brightness value of the color element may have a linear relationship.

In an embodiment, the infrared brightness value may be different from at least one of the two or more color elements based on a reference brightness value.

In one embodiment, the sum of the brightness values of the determined color elements may be the same in all color pixels.

In one embodiment, the infrared brightness value and the brightness value of the two or more color elements may have a non-linear relationship.

In one embodiment, the brightness values of the two or more color elements corresponding to the infrared brightness value may be determined using a chromaticity distribution table configured such that the sum of the brightness values of the color elements is the same throughout the boundary.

According to the present invention, when applied to a patient with damage of nerve cells located in the inner retina including rod cells or retinal ganglion cells, it is possible to visually recognize objects within a certain field of view even in the dark, thereby overcoming the limitation of night activity. can do. In addition, not only patients who are unable to identify objects in dark places, but also users who are temporarily experiencing such handicap can ensure improved night vision by the present invention.

Hereinafter, the present invention will be described with reference to the embodiments shown in the accompanying drawings. For clarity, the same components have been assigned the same reference numerals throughout the accompanying drawings. Configurations shown in the accompanying drawings are only exemplary embodiments to illustrate the present invention, but are not intended to limit the scope of the present invention. In particular, the accompanying drawings, in order to facilitate understanding of the invention, some of the components are somewhat exaggerated.
1 is a diagram illustrating an infrared light-based visual aid device by way of example.
FIG. 2 is a diagram illustrating a functional configuration of the infrared light-based visual aid shown in FIG. 1.
FIG. 3 is a flowchart illustrating an operation of an infrared light-based visual aid shown in FIG. 1.
FIG. 4 is a diagram illustrating an embodiment for implementing step 220 of FIG. 3.
5A and 5B exemplarily illustrate another embodiment for implementing step 220 of FIG. 3.
6 is a diagram illustrating still another embodiment for implementing step 220 of FIG. 3.
7 and 8 are diagrams illustrating an implementation example of the infrared visual aid.

As the inventive concept allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. Like elements are referred to by like reference numerals throughout the accompanying drawings.

1 is a diagram illustrating an infrared light-based visual aid device by way of example.

1 and 2 together, the infrared light-based visual aid 10 is integrated into eyewear 30 such as, for example, glasses, goggles, a head-mounted display (HMD), or the like. It can be implemented as. The eyewear 30 consists of a visually transparent optical element 31 and a frame 32 which places the optical element 31 in the human field of view.

The optical element 31 is formed of an optically transparent material and may be, for example, a lens, a flat glass plate, a prism, or the like. The lens has one or two curved surfaces, the flat glass plate includes two planes, and the prism has three or more planes. The curved surface or plane of the optical element 31 may be a projection surface on which the color enhancement image 22 is displayed. The projection surface passes the light coming from the front of the optical element 31 as it is, and the color enhancement image 22 may be displayed or reflected.

The frame 32 is made of metal, alloy, synthetic resin, or a combination thereof. The frame 32, when worn by the user, causes the optical element 31 to be placed in the user's field of view and directs the infrared light source 110 and the infrared camera 120 to the front. In FIG. 1, the infrared light source 110 and the infrared camera 120 are illustrated as being disposed on the side of the frame 32, but this is only an example and is not limited to a specific position. The frame 32 may include an electronic device, for example, a graphic processing unit 140, that converts an infrared image into a color augmented image.

The infrared light-based visual aid 10 displays the color enhancement image generated based on the infrared image on the projection surface. In general, in devices such as night vision, infrared images are represented in monochrome or gray scale. Even ordinary users can recognize objects in front of them even with monochrome or gray scale images, but it is difficult to use such images for a relatively long time. The infrared light source 110 disposed toward the front irradiates infrared light not recognized by the user's vision. The infrared light reflected by the object in front is detected by the infrared camera 120 and used to generate an infrared image. In comparison with the image 20 recognized by a user with normal vision, the infrared image 21 is expressed in a single color or gray scale. The infrared light-based visual aid device 10 processes the infrared image 21 to display the color augmented image 22 to the user.

FIG. 2 is a diagram illustrating a functional configuration of the infrared light-based visual aid shown in FIG. 1.

Referring to FIG. 2, the infrared light-based visual aid device 10 includes an infrared light source 110, an infrared camera 120, a color enhanced image display device 130, and a graphics processing unit 140. In addition, the infrared light-based visual aid 10 may further include a sensor 150.

One or more infrared light sources 110 may be fixed on the frame of the eyewear. The infrared light source 110 irradiates the directional infrared light toward the front of the user. Referring back to FIG. 1, the infrared light source 110 is disposed in front of the eyewear 30, and the direction of irradiating infrared light may be changed along the line of sight of the user. Infrared light is long-wavelength light that cannot be detected by human vision. Therefore, it can be used to generate color-enhanced images without harming other people around.

The infrared camera 120 detects the infrared light reflected by the infrared light source 110 to the object located in front. The infrared camera 120 generates the infrared image 21 expressed in gray scale using the detected infrared light. In the infrared image 21, the infrared pixel exhibits, for example, an infrared brightness value I _gray of 0 to 255 or 0 to 1023 steps. The infrared camera 120 is disposed in front of the eyewear 30, and the direction of detecting the infrared rays may be changed along the line of sight of the user. Meanwhile, two or more infrared cameras 120 may be disposed in the eyewear. For example, the two or more infrared cameras 120 may generate two or more infrared images 21 according to the parallax between the left and right eyes of the user. The left infrared image generated by the infrared camera 120 disposed on the left and the right infrared image generated by the infrared camera 120 disposed on the right are processed and converted into a left color enhanced image and a right color enhanced image, respectively. The left color augmented image and the right color augmented image are displayed on the left projection surface and the right projection surface, respectively, so that the user can recognize the distance to the front object.

The color augmented image display device 130 optically outputs the color augmented image 22. In one embodiment, the color enhancement image display device 130 may be a projector that displays the color enhancement image 22 on the projection surface of the optical element 31. In another embodiment, the color augmented image display device 130 may irradiate the color augmented image 22 directly on the eyes of the user without passing through the projection surface. The two color augmented image display devices 130 may be disposed on both sides of the eyewear to display a left color augmented image and a right color augmented image on the projection surface of the left and right optical elements, respectively, or irradiate the left and right eyes of the user. In another embodiment, the color augmented image display device 130 may be an electronic device separated from the infrared ray-based visual aid 10, for example, a mobile phone equipped with a flat panel display.

The graphics processing unit (hereinafter, referred to as GPU) 140 converts the infrared image 21 into the color augmented image 22. The GPU 140 converts an infrared pixel to a color pixel for each pixel of the infrared image 21. The conversion method of the GPU 140 will be described below with reference to FIGS. 3 to 5. In addition, the GPU 140 may correct the color augmented image 22 according to the sensing value output from the sensor 150. The sensor 150 may include, for example, a distance sensor 151. The distance sensor 151 measures a distance to an object in front of the user. The GPU 140 corrects the size of the object displayed in the color augmented image 22 or the entire size of the color augmented image 22 according to the sensing value of the distance sensor 151, or displays information indicating the distance to the object. It may be inserted into the augmented image 22. On the other hand, the sensor 150 may include a gaze tracking sensor 152. The GPU 140 may correct the left and right and / or vertical ratios of the color augmented image 22 or correct the position at which the color augmented image 22 is displayed according to the sensing value of the gaze tracking sensor 152.

The infrared light-based visual aid 10 may further include a wired or wireless communication module 160. The color augmented image 22 output from the GPU 140 may be displayed on a flat panel display separated from the infrared light-based visual aid 10. The communication module 160 may transmit the color augmented image 22 to the flat panel display through, for example, short range wireless communication such as WLAN or ultra short range wireless communication such as Bluetooth.

FIG. 3 is a flowchart illustrating an operation of an infrared light-based visual aid shown in FIG. 1.

Referring to FIG. 3, the infrared camera 130 generates an infrared image 21 and provides it to the GPU 140 as an input (step 200).

The GPU 140 obtains the infrared brightness value I _{grey_n} of the nth infrared pixel from the input infrared image 21 (step 210). N is a value between 1 and the total number of pixels of the infrared image 21. As an example, the infrared image 21 may include an infrared pixel having a plurality of fields in which brightness values of a plurality of color elements, for example, R, G, and B, are recorded. Hereinafter, the brightness value of the color element is called a color value. The length of each field is the same, and the length of the field determines the infrared brightness value I _gray . In this case, the infrared brightness value I _gray may be an arithmetic mean of the plurality of color values. On the other hand, the plurality of color values may be substantially the same. In this case, any one of the plurality of color values may be the infrared brightness value I _gray of the corresponding infrared pixel. When the length of the field is 8 bits, the infrared brightness value I _gray has a value between 0 and 255. When the length of the field is 10 bits, the infrared brightness value I _gray may have a value between 0 and 1023. In another embodiment, the infrared image 21 may include an infrared pixel having one field in which the infrared brightness value I _gray is recorded. Hereinafter, the infrared brightness value and the color value are displayed as a ratio (%) with respect to each maximum brightness value.

The GPU 140 determines the color value of the nth color pixel using the infrared brightness value I _{grey_n} of the nth infrared pixel of the infrared image 21 (step 220). The format for representing colors is not only RGB, but also YUV, YCbCr and the like. Color elements for expressing color, for example, R, G, B or Y, Cr, Cb and the like can be mutually converted. In the following, only the RGB color format, which is intuitively easy to understand, is described as an example, but it should be understood that this is only an example. An embodiment in which the GPU 140 determines the color value will be described in detail with reference to FIGS. 4 to 6.

The color augmented image display device 130 displays the color augmented image 22 output from the GPU 140 (step 230).

4 is a diagram illustrating an exemplary embodiment for implementing step 220 of FIG. 3. FIG. 4A illustrates an infrared brightness value for converting an infrared image into a color augmented image, according to an exemplary embodiment. (B) is a process of determining the color value according to the infrared brightness value of each pixel of the infrared image.

Referring to FIG. 4A, the reference brightness value I _th is a reference for determining R, G, and B color values. Here, the reference brightness value I _th may be a value between 0 and the maximum brightness value I _max , and the maximum brightness value I _max may be determined by the length of a field in which the color value or the infrared brightness value of the infrared pixels is recorded. For example, the reference brightness value I _th may be set to 50% of the average brightness value, that is, the maximum brightness value I _max . That is, when the length of the field is 8 bits, the average brightness value may be 127.

R, G, B color values and IR brightness value I _gray have a linear relationship. Color value of R is, the infrared intensity values I _grey a linear reduction between 0% based on the brightness value I _th, when the IR intensity values I _grey = 0%, 0% from 100%, based on the brightness value I _th is do. The color value of G decreases linearly between the infrared brightness value I _gray between 0% and the reference brightness value I _th and linearly decreases between the reference brightness value I _th and the infrared brightness value I _gray between 100%. At this time, the color value of G is 0% and 100% to 0% at the infrared brightness value I _{gray, and} becomes 100% at the reference brightness value I _th . Color value of B, from the reference luminance value I _th, and infrared intensity values I _grey linear decrease between 100%, when the reference brightness value I _th 100% and an infrared intensity values I _grey = 100%, is 0% . Therefore, the sum of R, G, and B color values always has a relationship of 100% regardless of the infrared brightness value I _grey . This is to show an image expressed at substantially the same brightness to a patient who can recognize only color.

Referring to FIG. 4B, the GPU 140 compares the infrared brightness value I _{grey_n} and the reference brightness value I _th of the nth infrared pixel (step 221). N is a value between 1 and the total number of pixels of the infrared image 21. If the infrared brightness value I _{grey_n} is less than the reference brightness value I _th , the process proceeds to step 222. If the infrared brightness value I _{grey_n} is equal to or greater than the reference brightness value I _th , the process proceeds to step 223.

GPU 140 determines R, G, and B color values using the nth infrared brightness value I _{grey_n} (steps 222 and 223). The R, G, and B color values may be determined according to the linear relationship shown in (a). Here, the color value is determined as a ratio with respect to the maximum brightness value I _max , and the sum of the determined color values does not exceed 100%.

을 결정된 R, G, B 컬러값에 곱하여 컬러 증강 영상을 보정할 수 있다.Meanwhile, a step of correcting the determined color value may be optionally added. The R, G, and B color values determined in steps 222 and 223 may be corrected according to a condition set by a user. For example, a user who has a rejection of red may be difficult to use for a long time when the overall color of the color enhancement image is red. Accordingly, the user may express the color augmented image in a color that he feels comfortable, and the same may be applied to green (G) or blue (B). For example, the ratio of R, G, B color values determined in steps 222 and 223

The color enhancement image may be corrected by multiplying the determined R, G, and B color values.

은 결정된 R의 컬러값(%),

는 결정된 G의 컬러값(%),

는 결정된 B의 컬러값(%)이며,

는 0% 내지 100% 사이의 값을 가질 수 있다. Where R ', G', and B 'are corrected R, B, G color values,

Is the color value (%) of the determined R,

Is the color value (%) of G determined,

Is the determined color value (%) of B,

May have a value between 0% and 100%.

The method of correcting the color value in the color augmented image may be variously implemented in addition to the above-described method.

GPU 140 completes the nth color pixel with the determined R, G, and B color values (step 224). As an example, if the infrared pixel has a plurality of fields in which a plurality of color values are recorded, the GPU 140 records the determined R, G, and B color values in each field. In another embodiment, if the infrared pixel has only an infrared brightness value, the GPU 140 adds a plurality of fields for recording the color value, and records the determined R, G, and B color values in the added field.

5A and 5B exemplarily illustrate another embodiment for implementing step 220 of FIG. 3, and FIG. 5A illustrates an infrared brightness value for converting an infrared image into a color-enhanced image according to another embodiment. 5B is a process of determining a color value according to an infrared brightness value of each pixel of an infrared image.

In comparison with FIG. 4, the chromaticity distribution table illustrated in FIG. 5A may be used to generate a color augmented image in a color desired by a user. Here, the types of chromaticity distribution tables are various, and elements for mixing colors may also vary according to the types of chromaticity distribution tables. Therefore, it should be understood that the manner described below is only one example. The user can determine any color C ₁ , C ₂ , C ₃ to be used in the color enhancement image, in the illustrated chromaticity distribution table. Connecting the selected colors C ₁ , C ₂ and C ₃ with a line makes a triangle. The color located within the triangle can be generated by combining the colors C ₁ , C ₂ and C ₃ . Therefore, the color element corresponding to the pixel-specific infrared brightness value of the infrared image is converted into the color element located in the triangle.

In the chromaticity distribution table illustrated in FIG. 5A, the colors C ₁ , C ₂ , and C ₃ selected at the boundary of the chromaticity distribution table may be expressed using R, G, and B color values as coordinate values. For example, color C ₁ is (255, 0, 0), and if it moves clockwise along the boundary of the chromaticity distribution table, R color values in the order of (254, 1, 0), (253, 2, 0), etc. Decreases, the G color value increases, and the B color value does not change. On the other hand, color C ₂ is (0, 255, 0), and when it moves clockwise along the boundary of the chromaticity distribution table, G color values decrease in the order of (0, 254, 1), (0, 243, 2) The B color value is increased and the R color value is not changed. Similarly, color C ₃ is (0, 0, 255), and when it moves clockwise along the boundary of the chromaticity distribution table (1, 0, 254), B color values decrease in the order of (2, 0, 253), etc. R color value is increased, and G color value is not changed. Therefore, the R, G, and B color values of the colors C ₁ , C ₂ , and C ₃ satisfy the following relationship at the boundary of the chromaticity distribution table.

이다. 따라서, 컬러 C₁, C₂, C₃의 R, G, B 컬러값의 합은 항상 100%이다.here,

to be. Therefore, the sum of the R, G, B color values of the colors C ₁ , C ₂ , C ₃ is always 100%.

Referring to FIG. 5B, the GPU 140 compares the infrared brightness value I _{grey_n} and the reference brightness value I _th of the nth infrared pixel (step 221). If the infrared brightness value I _{grey_n} is less than the reference brightness value I _th , the process proceeds to step 222. If the infrared brightness value I _{grey_n} is equal to or greater than the reference brightness value I _th , the process proceeds to step 223.

GPU 140 determines the color values of C ₁ , C ₂ , C ₃ (steps 222 ', 223'). The colors C ₁ , C ₂ , C ₃ can be expressed by, for example, R, G, B color values as coordinates.

Here, the first coordinate value is an R color value, the second coordinate value is a G color value, and the third coordinate value is a B color value.

Color C _1, C _2, C ₃ has been selected at the boundary of the chromaticity distribution table, the color C _1, C _2, C ₃ are assumed to correspond to the vertices of an equilateral triangle. Applying the relationship expressed in Equation 5 above, the coordinates of the colors C ₁ , C ₂ , C ₃ can be expressed as follows.

When this relationship is satisfied, the brightness values I ₁ , I ₂ , and I ₃ of the colors C ₁ , C ₂ , and C ₃ are determined as follows. Here, the relationship between the colors C ₁ , C ₂ , C ₃ and the brightness values I ₁ , I ₂ , and I ₃ may use Equations 1 and 2.

On the other hand, since the total RGB coordinate value of the color enhancement image is equal to the sum of the RGB coordinate values of the brightness values I ₁ , I ₂ , and I ₃ , the following is satisfied.

Finally, the R, G, and B color values determined for the nth infrared pixel using the nth infrared brightness value I _{grey_n} are as follows.

GPU 140 completes the nth color pixel with the determined R, G, and B color values (step 224). Meanwhile, the step of correcting the determined color may be optionally added.

는 컬러 C₁, C₂, C₃의 밝기값에 대한 백분율(%)이다.Where ratio

Is a percentage of the brightness values of colors C ₁ , C ₂ , C ₃ .

6 is a diagram illustrating still another embodiment for implementing step 220 of FIG. 3.

5A and 5B illustrate an embodiment in which a pixel of an infrared image is converted into an arbitrary color within a triangle composed of three colors C ₁ , C ₂ , and C ₃ selected at the boundary of a chromaticity distribution table, while FIG. 6 is a pixel of an infrared image. This embodiment converts the colors to be located at the boundary of the chromaticity distribution table. In detail, the user selects at least two or more colors at the boundaries of the chromaticity distribution table. The selected color corresponds to the infrared brightness value range. The pixel-by-pixel brightness value of the infrared image is converted into a color located on the boundary of the chromaticity distribution table between the selected colors.

Referring to the example shown in FIG. 6, three colors C ₁ , C ₂ and C ₃ are selected at the boundary of the chromaticity distribution table. The color C ₁ corresponds to the infrared brightness value 0%, the color C ₂ corresponds to the infrared brightness value 50%, and the color C ₃ corresponds to the infrared brightness value 100%. Thus, the color located at the border of the chromaticity distribution table between colors C ₁ and C ₂ is mapped to the infrared brightness value 0% to 50%, and the color located at the border of the chromaticity distribution table between colors C ₂ and color C ₃ is the infrared brightness value. Mapped from 50% to 100%. That is, the color C ₁ to the color C ₂ may be divided into, for example, 50 sections, and the color C ₂ to color C ₃ may be divided into, for example, 50 sections. When the nth infrared brightness value I _{grey_n} is 30%, the color of the nth infrared pixel may be determined as the color C ₄ belonging to the 30th section between the color C ₁ and the color C ₂ . Similarly, when the m-th infrared brightness value I _{grey_m} is 80%, the color of the m-th infrared pixel may be determined as the color C ₅ belonging to the 30th section between the color C ₂ and the color C ₃ .

The principle of determining the color value for each pixel using the infrared brightness value can be summarized as follows from the embodiment described with reference to FIGS. 4 to 6.

First, the sum of one or more color values that make up any color pixel is, for example, constant at 100%. The user can only distinguish the color and cannot distinguish minute light. Therefore, it is desirable to always provide the user with a color enhancement image at substantially the same brightness.

Secondly, the rate of change of the color value should follow the rate of change of the infrared brightness value I _gray . In other words, if the change in the infrared brightness value I _gray is small, the change in the color value should also be small. If the change in the infrared brightness value I _gray is large, the change in the color value should also be large.

If the change in the infrared brightness value I _gray is small, the change in the color value should also be small. The chromaticity distribution table for determining the color value of the infrared pixel can be variously selected in addition to those shown in the accompanying drawings. Even if any chromaticity distribution table is determined, the color value, i.e. the brightness value of the color element, should be a continuous function, whether linear or nonlinear. For example, the reference brightness value I _{th of} FIGS. _4-5B or the colors C ₁ , C ₂ , C ₃ of FIG. 6 were used to determine the color value of the infrared pixel. The reference brightness value I _th is the point at which the slope of the function of the G color value changes. For this reason, the G color value does not change rapidly before and after the reference brightness value I _th . On the other hand, in Fig. 6, colors C ₁ , C ₂ , and C ₃ are used to equally divide the boundaries of the chromaticity distribution table, whereby the color value does not change rapidly between the two close divisions. That is, the similar infrared brightness values must be converted to similar colors so that the user can recognize the object in the color enhancement image.

On the other hand, if the change in the infrared brightness value I _grey is large, the change in the color value should also be large. While the change in the infrared brightness value I _gray is large, the change in the color value is small, and the boundary between the object and its surroundings may become unclear in the color enhancement image, so that the user cannot recognize the object. For example, when the infrared brightness value I _{grey_n} of the nth infrared pixel is 30% (R, G, B) is (20, 30, 50), and the infrared brightness value I _{grey_m} of the mth infrared pixel is 80%. At the time (21, 29, 50), the difference between the brightness values of the two infrared pixels is large, but the difference in the color enhancement image is not large. Therefore, the user hardly feels the difference between the two pixels.

7 and 8 are views illustrating an implementation example of an infrared light-based visual aid device, and FIG. 7 shows an example of a removable type in eyewear, and FIG. 8 is a mobile phone equipped with a flat panel display. For example.

Infrared light-based vision aids may be applied to users or fields requiring improved night vision, as well as users who permanently lost night vision. For example, a user who has undergone an ophthalmic procedure, such as LASIK or LASEK surgery, may experience decreased night vision temporarily or permanently. In addition, the user having a symptom that the pupil is not enlarged even at night due to enlargement or reduction according to the ambient brightness is difficult to identify an object in a dark place. Such a user can obtain improved night vision by using an infrared light-based visual aid as needed. On the other hand, when driving at night, even if you have a normal night vision, it may be difficult to recognize the object in front. For example, roads without street lamps, foggy roads, or rainy nights, it is difficult for even a normal driver to identify things in front of them. Therefore, the infrared light-based visual aid may be implemented in a form that a user can conveniently use as needed.

Referring to FIG. 7, the infrared light-based visual aid 10 includes a housing 11 and a coupling member 12 that is detachably coupled to the eyewear 30. The housing 11 includes an infrared light source 110 disposed on the front surface and irradiating infrared light, an infrared camera 120 disposed on the front surface, and an infrared image 21 exposed to the outside as a color enhancement image 22. The GPU 140 for converting and the color augmented image display device 130 for displaying the color augmented image 22 are embedded. The coupling member 12 may be, for example, a clip coupled to the housing 11, but is not limited thereto. Since the optical element 31 of the eyewear 30 such as glasses is transparent, the color enhancement image 22 may not be displayed on one surface of the optical element 31. Accordingly, the color augmented image display device 130 may directly irradiate the color augmented image 22 to the user's eye without passing through the projection surface.

Meanwhile, referring to FIG. 8, the infrared light-based visual aid device 10 may display the color augmented image 22 through the mobile phone 40 or be coupled to the mobile phone 40. In this form, the infrared light-based visual aid 10 may not include the color enhancement image display device 130. In order to display the color augmented image 22 through the mobile phone 40, the infrared ray-based visual aid 10 may be integrated or detachably coupled to the eyewear 30. When coupled to the mobile phone 40, the mobile phone 40 includes an infrared light source and an infrared camera, and an AP (Application Processor) of the mobile phone 40 may serve as a GPU.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive.

The scope of the present invention is shown by the following claims rather than the above description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. .

Claims (7)

An infrared light source for irradiating infrared light toward an object located in front;
An infrared camera which detects infrared light reflected by the object and generates a monochromatic infrared image composed of a plurality of infrared pixels having an infrared brightness value;
Within the range of the infrared brightness value, the infrared brightness value corresponds to the brightness value of two or more color elements, and determines the brightness value of the two or more color elements corresponding to the infrared brightness value for each infrared pixel to generate color pixels. A graphics processing unit; And
Including a color augmented image display device for displaying a color augmented image consisting of a plurality of the color pixels,
The sum of the brightness values of the determined color elements is the same for all color pixels. An infrared light source for irradiating infrared light toward an object located in front;
An infrared camera which detects infrared light reflected by the object and generates a monochromatic infrared image composed of a plurality of infrared pixels having an infrared brightness value;
Within the range of the infrared brightness value, the infrared brightness value corresponds to the brightness value of two or more color elements, and determines the brightness value of the two or more color elements corresponding to the infrared brightness value for each infrared pixel to generate color pixels. A graphics processing unit; And
Including a color augmented image display device for displaying a color augmented image consisting of a plurality of the color pixels,
The brightness value of the at least two color elements corresponding to the infrared brightness value is determined using a chromaticity distribution table configured such that the sum of the brightness values of the color elements is equal across the boundary. The method according to claim 1 or 2,
The infrared pixel includes two or more fields in which the brightness values of the two or more color elements are recorded, the infrared brightness value is an average of the brightness values of the color elements recorded in the two or more fields,
And the color pixel is generated by recording brightness values of two or more determined color elements in the two or more fields. The infrared light-based visual aid of claim 1, wherein the infrared brightness value and the brightness value of the color element have a linear relationship. The apparatus of claim 4, wherein the infrared brightness value is different from at least one of the two or more color elements based on a reference brightness value. The infrared light-based visual aid of claim 1, wherein the infrared brightness value and the brightness value of the two or more color elements are nonlinear. delete

Images