KR20210120334A - System for sinus diagnosis and method of synchroniz near-infrared image using the same - Google Patents

Abstract

The present invention relates to a system for sinus diagnosis and a method of synchronizing a near-infrared image using the same. In accordance with the present invention, the method of synchronizing a near-infrared image using the system for sinus diagnosis comprises: a step of photographing the face of a subject through a near-infrared camera included in a device for sinus measurement and acquiring a reference image with the subject holding a mouthpiece for examining the oral cavity; a step of making an LED attached to the mouthpiece for examining the oral cavity emit light, and acquiring a near-infrared image by using the near-infrared camera; a step of recognizing a specific part of the face of the subject in the reference image; a step of acquiring a pixel value of the face of the subject in the near-infrared image; and a step of synchronizing the reference image with the near-infrared image. As such, in accordance with the present invention, an image photographed with the lighting irradiated into the oral cavity is synchronized with an image photographed with no lighting irradiated into the oral cavity, so a specific part of the face of a subject can be recognized in the image photographed with the lighting irradiated into the oral cavity.

Description

Sinus diagnosis system and method for synchronizing near-infrared images using the same

The present invention relates to a sinus diagnosis system and a method for synchronizing near-infrared images using the same, and to a sinus diagnosis system for synchronizing a plurality of near-infrared images to determine the state of the inside of the sinuses, and a method for synchronizing near-infrared images using the same.

Currently, the number of patients with sinusitis (sinusitis) due to air pollution such as fine dust is continuously increasing, and as of 2016, it has already exceeded 6.6 million (Status of Sinusitis Health Insurance Patients, National Health Insurance Corporation).

Sinusitis can be classified into watery rhinorrhea (low viscosity), mucinous rhinorrhea (medium viscosity), and purulent rhinorrhea (high viscosity) according to the viscosity of rhinorrhea (nasal drip) accumulated in the sinuses. Several types of treatment methods can be applied.

However, there is currently no method to accurately measure the concentration of rhinorrhea, so an indirect method is used to measure the amount of pus in the sinuses using optical equipment such as X-ray and CT.

Due to this, the abuse of antibiotics for sinusitis due to the absence of an accurate diagnosis is a continuous social issue, and the use of equipment such as X-ray and CT for indirect diagnosis shows that 30% of sinusitis patients are children under 9 years of age. Considering that, there is a problem that serious damage due to radiation exposure may occur.

To solve this problem, Finnish Mediq Suomi proposed a product for diagnosing blockage in the sinuses using the echo of ultrasound, but because ultrasound is used, the results are inconsistent depending on the location of the measuring device, and systematic data interpretation is not possible. There is this.

Therefore, there is a need for a technology that can accurately measure sinusitis by consistently interpreting data without using optical equipment such as X-ray and CT.

However, there is a disadvantage in that it is difficult to recognize specific parts such as eyes, nose, and mouth of a subject to be measured when shooting using a near-infrared camera in a state where illumination is irradiated into the oral cavity.

Therefore, in order to recognize specific parts of the subject's face, such as eyes, nose, and mouth, a photo taken using a near-infrared camera in a state in which illumination is irradiated into the oral cavity, and a near-infrared camera in a state in which illumination is not irradiated in the oral cavity. There was a need for a way to synchronize multiple photos taken.

The technology that is the background of the present invention is disclosed in Republic of Korea Patent Registration No. 10-1653180 (2016.08.286. Announcement).

An object of the present invention is to provide a sinus diagnosis system for synchronizing a plurality of near-infrared photographs in order to determine the state of the inside of the sinuses, and a method for synchronizing near-infrared photographs using the same.

According to an embodiment of the present invention for achieving this technical problem, in a method for synchronizing a near-infrared photo using a sinus diagnosis system, a near-infrared camera included in the sinus measuring device in a state in which the subject to be measured has a mouthpiece for oral examination in his/her mouth Acquiring a reference picture by photographing the face of the subject to be measured through, acquiring a near-infrared photograph using the near-infrared camera in a state in which an LED attached to the mouthpiece for oral irradiation is emitted, and in the reference photograph Recognizing a specific part of the face of the subject to be measured, obtaining a pixel value of the face of the subject to be measured from the near-infrared photograph, and synchronizing the reference photograph and the near-infrared photograph.

The method may further include calculating a sinus index in the sinuses using the synchronized photo.

The specific part of the face may correspond to the eyes, nose, and mouth of the measurement subject.

The synchronizing may include synchronizing a specific part of the face of the measurement target corresponding to the near-infrared photo by combining it with a specific part of the face of the reference photo.

The reference photo and the near-infrared photo may be acquired by being photographed by the near-infrared camera while the same exposure time and focus are set.

As described above, according to the present invention, since the picture taken in the state of irradiating the intraoral illumination with the picture taken in the state of not irradiating the intraoral illumination is synchronized, in the picture taken in the state of irradiating the illumination in the oral cavity, the face of the measurement subject A specific part can be recognized.

1 is a view for explaining a sinus diagnosis system according to an embodiment of the present invention.
Figures 2a to 2c is a view showing the appearance of the mouthpiece for oral irradiation according to an embodiment of the present invention.
3 is a flowchart illustrating a method for synchronizing near-infrared photos according to an embodiment of the present invention.
4 is an exemplary view for explaining a reference photo according to an embodiment of the present invention.
5 is a flowchart for explaining step S360 of FIG. 3 .
6 is a view for explaining a first divided area to a third divided area according to an embodiment of the present invention.
7 is an exemplary diagram illustrating first to third points set according to an embodiment of the present invention.
8A is an exemplary view providing a diagnosis result according to a case in which the sinus index of a measurement subject is 0;
FIG. 8B is an exemplary view providing a diagnosis result according to the case where the sinus index of the measurement target is 93 points and 78 points on the left and right sides, respectively.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily carry out the present invention. However, the present invention may be embodied in many different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part "includes" a certain element, it means that other elements may be further included, rather than excluding other elements, unless otherwise stated.

Then, with reference to the accompanying drawings, embodiments of the present invention will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily implement them.

Hereinafter, a sinus diagnosis system according to an embodiment of the present invention will be described with reference to FIGS. 1 to 2C .

1 is a view for explaining a sinus diagnosis system according to an embodiment of the present invention, Figures 2a to 2c is a view showing the appearance of the mouthpiece for oral examination according to the embodiment of the present invention.

As shown in FIG. 1 , the sinus diagnosis system according to an embodiment of the present invention includes a mouthpiece 100 for oral examination and a sinus measuring device 200 .

Here, the sinus diagnosis system according to an embodiment of the present invention analyzes a photograph taken using near-infrared rays, and analyzes the sinus index of the subject to be measured based on the analysis result.

First, the mouthpiece 100 for oral irradiation according to an embodiment of the present invention is implemented in the form of a mouthpiece, and irradiates near-infrared rays using an LED in the oral cavity of the subject to be measured.

In addition, the sinus measuring apparatus 200 acquires a plurality of near-infrared photos in a state of irradiating near-infrared rays, and analyzes the sinus index of the subject to be measured by using the acquired photos.

As shown in Fig. 1, when the subject to be measured puts his or her face in close contact with the sinus measuring device 200 with the mouthpiece 100 for oral irradiation in the mouth, the sinus measuring device 200 takes the subject to be measured and shows a general picture and You can take near-infrared photos. Then, the sinus measuring device 200 may take two types of pictures, a reference picture and a near-infrared picture, depending on whether the LED of the mouthpiece 100 for oral irradiation is turned on.

As shown in FIGS. 2A to 2C , the mouthpiece 100 for oral irradiation includes an outer portion 110 , an inner portion 120 , and a support portion 130 .

The outer part 110 supplies power to the mouthpiece 100 for oral irradiation because a battery is included therein.

The inner portion 120 is a portion to be inserted into the oral cavity of the measurement subject, and a plurality of LEDs 140 are included therein, and as shown in FIG. 2a , the plurality of LEDs 140 are symmetrically disposed on both sides as the center of the inner portion. . In addition, as shown in Figure 2b, the inner portion 120 is implemented in a state inclined to the side, so that the measurement target can be easily inserted into the oral cavity.

The plurality of LEDs 140 includes a first LED 140a, a second LED 140b, and a third LED 140c, and the measurement target puts the inner part 120 of the mouthpiece 100 for oral irradiation into the mouth. When biting, the first LED (140a) is located in the innermost portion of the mouth of the measurement subject, the third LED (140c) is located in the outermost portion of the mouth of the measurement subject.

In addition, the support part 130 is located between the outer part 110 and the inner part 120, and is a part where the lips of the measurement subject touch. The support 130 is implemented in a curved shape so that the oral subject can easily adhere to it.

As shown in FIG. 2C , identification marks 150a and 150b are attached to the right side and the left side, respectively, in the outer direction of the support unit 130 .

The sinus measuring apparatus 200 may determine whether the subject to be measured is accurately biting the mouthpiece 100 for oral examination through the left and right recognition marks 150a and 150b shown in the near-infrared photograph. That is, the sinus measuring device 200 measures the balance of the left and right recognition marks 150a and 150b located at a point spaced apart from each other to measure the exact position of the mouthpiece 100 for oral examination held by the subject to be measured. can determine whether

At this time, in FIGS. 2a to 2c, the number of LEDs 140 is expressed in the form of two pairs of three (140a, 140b, 140c), but the number and installation position of the LEDs are to be changed according to the oral structure of the subject to be measured. The symmetrical left and right LEDs may emit wavelengths of the same size, and neighboring LEDs may emit different wavelengths.

Hereinafter, a method for synchronizing near-infrared photos according to an embodiment of the present invention will be described with reference to FIGS. 3 to 8B .

3 is a flowchart illustrating a method for synchronizing near-infrared photos according to an embodiment of the present invention.

First, the sinus measuring device 200 obtains a reference picture by photographing the subject's face through a near-infrared camera in a state in which the subject to be measured holds the mouthpiece 100 for oral examination in his/her mouth. (S310).

Here, the sinus measuring device 200 photographs the face of the subject to be measured in a state in which the plurality of LEDs 140a, 140b, and 140c present in the mouthpiece 100 for oral irradiation are turned off to obtain a reference picture.

Next, the sinus measuring device 200 acquires a near-infrared photograph by photographing the face of the subject to be measured through a near-infrared camera in a state in which the LEDs 140a, 140b, and 140c attached to the mouthpiece 100 for oral irradiation emit light. (S320).

At this time, the sinus measuring apparatus 200 takes the reference photo and the near-infrared photo by the same setting of the near-infrared camera.

That is, the reference photo and the near-infrared photo have the same exposure time and focus set values.

Next, the sinus measuring device 200 recognizes a specific part of the face of the subject to be measured from the reference photo ( S330 ).

4 is an exemplary view for explaining a reference photo according to an embodiment of the present invention.

Here, the specific part of the face corresponds to the eyes, nose, and mouth.

As shown in FIG. 4 , the sinus measuring device 200 provides an outer point (E1) of the right eye, an inner point (E2) of the right eye, and the inner side of the left eye in the reference photo to clearly distinguish the eyes, nose and mouth of the face. Select the point E3, the outer point of the left eye (E4).

Also, the sinus measuring apparatus 200 selects the right end point N1 of the nose, the left end point N2 of the nose, the right end point M1 of the lips, and the left end point M2 of the lips.

That is, the sinus measuring device 200 measures using the outer point (E1) of the right eye, the inner point (E2) of the right eye, the inner point (E3) of the left eye, and the outer point (E4) of the left eye. Recognize the subject's right and left eyes.

In addition, the sinus measuring device 200 recognizes the nose of the subject to be measured using the right end point N1 of the nose and the left end point N2 of the nose, and the right end point of the lips (M1) and the left end point of the lips (M2) to recognize the mouth of the subject to be measured.

Next, the sinus measuring apparatus 200 acquires a pixel value of the face of the measurement subject from the near-infrared photograph (S340).

That is, the sinus measuring apparatus 200 acquires a pixel value for each of a plurality of pixels included in the near-infrared photograph.

Here, the obtained pixel value is used to calculate the sinus index of the sinuses.

Next, the sinus measuring device 200 synchronizes the reference picture and the near-infrared picture (S350).

Here, the sinus measuring device 200 synchronizes the specific part of the face of the measurement target corresponding to the near-infrared photo by combining it with the specific part of the face of the reference photo.

That is, the sinus measuring device 200 synchronizes the near-infrared photo by setting each point to the same location as the location of each point (E1, E2, E3, E4, N1, N2, M1, M2) recognized in the reference photo. .

Next, the sinus measuring apparatus 200 calculates a sinus index in the sinuses by using the near-infrared photograph of which synchronization is completed ( S360 ).

Hereinafter, step S360 will be described in more detail with reference to FIGS. 5 to 8B .

5 is a flowchart for explaining step S360 of FIG. 3 .

As shown in FIG. 5 , the sinus measuring apparatus 200 according to an embodiment of the present invention sets a pair of first, second, and third points on the left and right sides of the near-infrared photograph ( S361 ).

Hereinafter, a process of setting the first point, the second point, and the third point in step S361 will be described with reference to FIGS. 6 and 7 .

The sinus measuring apparatus 200 divides the near-infrared image into a plurality of divided regions in order to set each point.

6 is a view for explaining a first divided area to a third divided area according to an embodiment of the present invention.

As shown in FIG. 6 , the sinus measuring apparatus 200 sets a plurality of virtual lines in vertical and horizontal directions in each near-infrared photograph to distinguish the first to third divided areas.

The first vertical line (V1), the second vertical line (V2), the third vertical line (V3), and the fourth vertical line (V4) are the outer point of the right eye (E1) and the inner point of the right eye (E2) for the near-infrared photograph. , represents an imaginary line passing through each of the inner point (E3) of the left eye and the outer point (E4) of the left eye.

In addition, the first horizontal line H1 and the second horizontal line H2 represent virtual lines passing through the lip end points M1 and M2 and the nose end points N1 and N2, respectively, in a picture taken through a near-infrared camera.

In addition, the third horizontal line H3 is an imaginary line passing through the center points T1 and T2 of the pupil in the picture taken through the near-infrared camera, and the fourth horizontal line H4 is the second horizontal line H2 and the third horizontal line (H3) represents an imaginary line passing through the center between

When the plurality of virtual vertical lines V1, V2, V3, and V4 and the plurality of virtual horizontal lines H1, H2, H3, and H4 are set in this way, a plurality of divided regions are generated by the intersecting lines.

That is, as shown in FIG. 6 , the first divided area exists in a region where the plurality of virtual vertical lines V1 , V2 , V3 and V4 and the plurality of virtual horizontal lines H1 and H2 intersect, and the second divided area is present in a region where the plurality of virtual vertical lines V1, V2, V3, and V4 and the plurality of virtual horizontal lines H2 and H4 intersect, and the third division region includes the plurality of virtual vertical lines V1, V2, V3 , V4) and the plurality of imaginary horizontal lines H3 and H4 intersect each other.

When a plurality of divided areas are set as shown in FIG. 6 , the sinus measuring apparatus 200 according to an embodiment of the present invention sets each point for each divided area.

7 is an exemplary diagram illustrating first to third points set according to an embodiment of the present invention.

As shown in FIG. 7 , the first to third points are respectively set on the left and right sides of the face in the near-infrared photograph.

That is, as shown in FIG. 7 , the sinus measuring apparatus 200 sets the first points LP1 and RP1 having the largest pixel value in the first divided region, and sets the first point having the largest pixel value in the second divided region. Two points LP2 and RP2 are set, and third points LP3 and RP3 having the largest pixel value in the third divided area are set.

In addition, the first to third points respectively set on the left and right sides may be set at positions symmetrical to each other or set at different positions, respectively.

Then, the sinus measuring apparatus 200 calculates each of the left and right sinus indices using the near-infrared image (S362).

That is, the sinus measuring apparatus 200 applies the pixel values at the first point P1, the second point P2, and the third point P3 in the near-infrared photograph to Equation 1 below to the left of the near-infrared photograph. and compute the right sinus index for each.

where X, Y, and Z are pixel coefficients and F is the sinus coefficient.

At this time, the sinus index refers to the amount of pus present in the sinuses.

When each of the left and right sinus indices of the measurement subject are calculated in step S362, the sinus measuring apparatus 200 displays the calculated sinus indices (S363).

At this time, the sinus measuring apparatus 200 displays the calculated sinus index on the screen in numerical form or normalizes the sinus index and displays it on the screen in the form of a shaded area according to the normalized value.

8A and 8B are exemplary views providing a sinus diagnosis result according to an embodiment of the present invention.

8A is an exemplary view providing a diagnosis result according to a case in which the sinus index of the subject to be measured is 0, and FIG. 8B is an example of providing a diagnosis result according to the case where the sinus index of the subject to be measured is 93 points and 78 points on the left and right, respectively. It is also

That is, when the sinus index is 0 as shown in FIG. 8A , since there is no pus in the sinuses, the sinus measuring apparatus 200 provides the diagnosis result without displaying the shadows.

On the other hand, when the sinus index is 93 points and 78 points on the left and right sides, respectively, as shown in FIG. 8B , the sinus measuring apparatus 200 provides a diagnostic result by changing colors according to the sinus index.

That is, as shown in Figure 8b, if the sinus index is 0 or more and less than 40 points, the sinus measuring device 200 shows the color of the shade in green, and if the sinus index is 40 or more and less than 70 points, the sinus measuring device 200 indicates the color of the shade in orange, and when the sinus index is 70 or more and 100 or less, the sinus measuring apparatus 200 indicates the color of the shade in red.

As described above, according to an embodiment of the present invention, since the picture taken in the state in which illumination is irradiated in the oral cavity and the picture taken in the state in which the illumination is not irradiated in the oral cavity is synchronized, the subject to be measured in the picture taken in the state in which illumination is irradiated in the oral cavity It can recognize a specific part of the face.

Although the present invention has been described with reference to the embodiment shown in the drawings, which is merely exemplary, those skilled in the art will understand that various modifications and equivalent other embodiments are possible therefrom. Accordingly, the true technical protection scope of the present invention should be determined by the technical spirit of the appended claims.

100: mouthpiece for oral irradiation, 110: outer part,
120: inner portion, 130: support portion,
140a, 140b , 140c: LED, 150a, 150b: recognition mark,
200: sinus measuring device

Claims (5)

A method for synchronizing near-infrared images using a sinus diagnosis system, the method comprising:
obtaining a reference picture by photographing the subject's face through a near-infrared camera included in the sinus measuring device in a state in which the subject to be measured has a mouthpiece for oral examination in his/her mouth;
Obtaining a near-infrared photograph using the near-infrared camera in a state in which the LED attached to the mouthpiece for oral irradiation is emitted;
Recognizing a specific part of the face of the measurement subject in the reference photo;
obtaining a pixel value of the face of the measurement subject from the near-infrared photograph, and
and synchronizing the reference photo and the near-infrared photo. According to claim 1,
The method of synchronizing near-infrared pictures further comprising the step of calculating a sinus index in the sinuses using the synchronized picture. According to claim 1,
The specific part of the face,
A method of synchronizing near-infrared images corresponding to the eyes, nose, and mouth of the subject to be measured. According to claim 1,
The synchronizing step is
A method of synchronizing a near-infrared photo by combining a specific part of the subject's face corresponding to the near-infrared photo to a specific part of the face of the reference photo for synchronization. 5. The method of claim 4,
The reference photograph and the near-infrared photograph are,
A method for synchronizing near-infrared photos obtained by taking pictures with the same exposure time and focus set by the near-infrared camera.

Images