WO2018155630A1

WO2018155630A1 - Photography evalulation/detection unit and optical device

Info

Publication number: WO2018155630A1
Application number: PCT/JP2018/006707
Authority: WO
Inventors: 正樹神原
Original assignee: 正樹神原
Priority date: 2017-02-23
Filing date: 2018-02-23
Publication date: 2018-08-30
Also published as: JP2018134418A

Abstract

This photography evaluation/detection unit is provided with: an illumination unit for emitting light onto a subject; a lens unit for forming an image of reflected light from the subject being illuminated with the light from the illumination unit; a photography unit for photographing the image formed by the lens unit; a slide-type filter unit that is located between the lens unit and the photography unit, configured to be attachable and detachable, and allowing only light of a specific wavelength included in the reflected light to pass therethrough; an image processing unit for color-coding the imaging subject and an affected region in the imaging subject in the image photographed by the photography unit; a quantification unit for calculating the area for the imaging subject and the affected region from the image after the color-coding processing by the image processing unit, and quantifying the area ratio between the imaging subject and the affected region; and a display screen for displaying the image after the color-coding processing by the image processing unit and the proportion quantified by the quantification unit.

Description

Imaging evaluation / detection unit and optical device

The present invention relates to an imaging evaluation / detection unit that extracts anomalous parts to be imaged and quantifies them, and an optical device used therefor.

In recent years, in the field of dentistry and medical use, a diagnostic apparatus utilizing the fact that fluorescence is generated when an anomalous portion exists in an imaging target when the imaging target is irradiated with excitation light having a specific wavelength. Various types have been developed (see, for example, Patent Documents 1 to 3). In addition, it is configured so that it can be detachably attached to an existing photographing device such as a digital camera or a mobile phone equipped with a digital camera function. There has also been proposed a photographing auxiliary device that enables diagnosis (see, for example, Patent Document 4).

The inventor of the present application has proposed a photographing evaluation / detection unit that can be easily mounted on an existing portable terminal, can be easily used by a general person, and can accurately extract anomalous portions of a photographing target (for example, patents). Reference 5).

JP-A-5-337142 Japanese Patent Laid-Open No. 10-314194 Japanese Patent Laid-Open No. 10-328129 JP 2006-81842 A International Publication No. 2015/016377

Although the anomalous part of the photographing target can be accurately extracted by the technique of the above-mentioned Patent Document 5, it is necessary for a person to appropriately determine how much the anomalous part occupies the subject to be photographed. . For this reason, a general person knows that there is an anomaly, but it is difficult to judge the size. Moreover, the fact that the size of the anomalous part is not digitized can be a factor that hinders accurate and rapid oral diagnosis for dentists.

Therefore, in view of the above, an object of the present invention is to provide a photographing evaluation / detection unit that can extract an anomalous portion of a photographing target, image it (visualize), and digitize it, and an optical device used therefor. is there. In particular, an object of the present invention is to realize an imaging evaluation / detection unit that can accurately extract an abnormal part in the oral cavity, image it (visualize), and digitize it, and an optical device used therefor.

In order to solve the above problems, a photographing evaluation / detection unit according to an aspect of the present invention includes:
An illumination unit for irradiating the subject with light;
A lens unit that forms an image of reflected light from a subject irradiated with light by the illumination unit;
A photographing unit for photographing an image formed by the lens unit;
A filter unit that is interposed between the lens unit and the imaging unit, is configured to be detachably slidable, and allows only light of a specific wavelength included in the reflected light to pass through;
An image processing unit that color-codes the object to be imaged and the anomaly part in the imaged object in the image captured by the image capturing unit;
Calculating the areas of the object to be imaged and the anomalous part from the image after the color-separation processing by the image processing unit, and quantifying the area ratio between the object to be imaged and the anomalous part,
An image after the color-separation processing by the image processing unit and a display screen for displaying the ratio digitized by the digitizing unit are provided.

According to the photographing evaluation / detection unit according to one aspect of the present invention, the optical device can be used by being mounted on a mobile terminal, and thus can be easily used not only by an expert but also by a general person. Parts can be extracted easily. Furthermore, in the image photographed by the photographing unit, the object to be photographed and the anomalous part in the object to be photographed are color-coded, and the ratio of the anomalous part to the object to be photographed is quantified, and the image after the color coding process and the object to be photographed The ratio of the anomalous part to the object is displayed on the display screen. Thus, the ratio of the anomalous portion to the object to be imaged is indicated by a numerical value, so that an accurate and quick diagnosis can be performed.

In the imaging evaluation / detection unit according to one aspect of the present invention,
The image photographed by the photographing unit is an intraoral photographic image,
The subject is a tooth,
It is preferable that the abnormal part is plaque.

In particular, this imaging evaluation / detection unit can quantify the proportion of dental plaque relative to teeth, confirming the brushing status, checking for the presence of unpolished plaque, plaque, tartar, etc. It can contribute to pre-sickness testing.

In the imaging evaluation / detection unit according to one aspect of the present invention,
The image photographed by the photographing unit is an intraoral photographic image,
The subject is the tongue,
It is preferable that the abnormal part is tongue coating.

This imaging evaluation / detection unit can particularly quantify the ratio of tongue coating to the tongue, and can contribute to the confirmation of the cause of bad breath and the examination of aspiration pneumonia.

In the imaging evaluation / detection unit according to one aspect of the present invention,
It is preferable to have a hood that has an opening that covers the entire mouth of the person to be photographed and that houses the illumination unit therein.

The main photographing evaluation / detection unit includes a large hood that covers the entire mouth of the person to be photographed, so that a good image can be photographed so that outside light does not enter the object to be photographed even in a bright room. .

In the imaging evaluation / detection unit according to one aspect of the present invention,
The illumination unit has a light source that emits white light, and a slide type optical filter that covers the light source and that can slide between a position that allows white light to pass through and a position that allows only blue light to pass through. preferable.

In this manner, a device that emits white light as a light source is employed, and the light emitted from the illumination unit can be easily switched between blue light and white light by the slide type optical filter. Therefore, it is possible to configure an illumination unit that can emit blue light and white light at low cost.

In the imaging evaluation / detection unit according to one aspect of the present invention,
The photographing unit, the image processing unit, the digitizing unit, and the display screen are components of the mobile terminal,
It is preferable that the illumination unit, the lens unit, and the filter unit are components of the optical device that is detachable from the portable terminal.

In this way, the photographing evaluation / detection unit can be configured by mounting the optical device on the portable terminal. Therefore, the photographing evaluation / detection unit can be provided at low cost.

In the imaging evaluation / detection unit according to one aspect of the present invention,
It is preferable that the image processing unit and the digitizing unit are realized by an application downloaded to the mobile terminal.

In this way, the image processing unit and the digitizing unit can be created by software, the image processing unit and the digitizing unit can be easily modified and updated, and the photographing evaluation / detection unit can be reduced in cost. Will be able to provide in.

In the imaging evaluation / detection unit according to one aspect of the present invention,
The shooting unit is a component of the mobile device,
The illumination unit, the lens unit, and the filter unit are components of the optical device that is detachable from the portable terminal.
The image processing unit and the digitizing unit are preferably constituent elements of an evaluation apparatus that receives an image captured by a mobile terminal and processes the image.

In this way, it is possible to send an image captured by the portable terminal to the evaluation device and perform image processing and digitization processing in the evaluation device. As a result, it is possible to collect and evaluate and manage images taken with various portable terminals in one evaluation apparatus.

An optical device according to an aspect of the present invention is an optical device that is detachable from a mobile terminal,
An illumination unit for irradiating the subject with light;
A lens unit that forms an image of reflected light from a subject irradiated with light by the illumination unit;
A filter unit that is interposed between the lens unit and the imaging unit of the mobile terminal, and allows only light of a specific wavelength included in the reflected light to pass through;
A lighting unit, a lens unit, and a filter unit are attached, and a clip unit that fixes the lens unit and the filter unit at the position of the photographing unit by sandwiching the portable terminal from both front and back sides,
The light emitting surface of the illumination unit is a donut shape in plan view, and a lens unit and a filter unit are arranged at the center thereof,
Blue light emitting elements and white light emitting elements are alternately arranged on the light emitting surface, and the illumination unit is configured to be able to switch between blue light and white light for irradiation.

According to the optical device of one aspect of the present invention, an image necessary for extraction and quantification of an anomalous portion of an object to be photographed in a photographing evaluation / detection unit for any type of portable terminal regardless of the model of the portable terminal. Will be able to shoot.

According to the photographing evaluation / detection unit of the present invention, since the optical device can be used by being mounted on a portable terminal, it can be easily used not only by professionals but also by ordinary people, and the anomalous part of the subject to be photographed can be easily obtained. Can be extracted. Furthermore, in the image photographed by the photographing unit, the object to be photographed and the anomalous part in the object to be photographed are color-coded, and the ratio of the anomalous part to the object to be photographed is quantified, and the image after the color coding process and the object to be photographed The ratio of the anomalous part to the object is displayed on the display screen. Thus, the ratio of the anomalous portion to the object to be imaged is indicated by a numerical value, so that an accurate and quick diagnosis can be performed.

In addition, it is possible to hear the opinions of experts by sending the obtained images to a dental clinic or hospital anytime and anywhere. Experts (doctors, dentists, nurses, etc.) can send back findings to the images that have been sent, and can provide health guidance and recommendations based on the findings. This leads to the elimination of the information gap regarding health between residents and specialists, leading to a reduction in distance.

Further, according to the optical device of the present invention, an image necessary for extraction and quantification of the anomalous portion of the object to be imaged is captured by the imaging evaluation / detection unit using the portable terminal of his / her hand regardless of the model of the portable terminal. Can be made available as a device for

It is a figure which shows the structural example of the imaging | photography evaluation / detection unit which concerns on one Embodiment of this invention. It is a figure which shows the structural example of the imaging | photography evaluation / detection unit provided with the slide type optical filter in the illumination part, (a) is the state which irradiates blue light, (b) is the state which irradiates white light, ( c) is a sectional view taken along line II-II in FIG. It is a figure which shows an example of the imaging | photography screen of the application downloaded to the portable terminal in the imaging | photography evaluation / detection unit which concerns on one Embodiment of this invention. (A) And (b) is a figure which shows an example of the mirror in the imaging | photography evaluation / detection unit which concerns on one Embodiment of this invention. The example of the picked-up image of the to-be-photographed object in the imaging | photography evaluation / detection unit which concerns on one Embodiment of this invention is shown, (a) is the picked-up image image | photographed using natural light and white light, without passing through a filter part, b) is a photographed image photographed using light having a predetermined wavelength and blue light through a filter unit. It is a perspective view of the imaging | photography evaluation / detection unit which has a large hood. (A) is a photographed image example of a tooth as an intraoral photographic image, and (b) is a display example of an intraoral photographic image and a numerical control window after color coding processing. (A) is a photographed image example of the tongue as an intraoral photograph image, and (b) is a display example of an intraoral photograph image and a numerical control window after color-coding processing. It is an image which shows a plaque adhesion change when having a subject continue brushing teeth. It is a graph which shows the change of plaque adhesion rate when having 4 test subjects use another trial toothbrush, respectively. It is an image which shows a tongue coating adhesion change when having a subject continue brushing teeth. It is a graph which shows the change of tongue coating adhesion rate when having 4 test subjects use another trial toothbrush, respectively. It is a figure which shows the structural example of the imaging | photography evaluation / detection unit which concerns on a modification. (A) And (b) is a figure which shows the variation of the example of mounting | wearing of the optical apparatus with respect to the portable terminal in the imaging | photography evaluation / detection unit which concerns on one Embodiment of this invention. It is a front view of the optical apparatus which concerns on a modification. It is a side view of the optical apparatus which concerns on a modification.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In addition, although one Embodiment described below demonstrates an example of suitable implementation of this invention, it does not limit the range and various deformation | transformation implementation is within the range which does not deviate from the summary of this invention. Is possible.

FIG. 1 is a diagram showing a configuration example of a photographing evaluation / detection unit 1 according to an embodiment of the present invention.

The imaging evaluation / detection unit 1 according to the present embodiment extracts, for example, an anomalous portion of an object to be imaged in the oral cavity and enables the quantification thereof. For example, a camera function called a smartphone or a tablet terminal The mobile terminal 100 having an information communication function including the photographing unit 102 and the like, and the optical device 300 attached to the mobile terminal 100 are provided.

The optical device 300 has a main body 350 that is attached to the portable terminal 100 via the attachment member 200 on the back surface side, a light source 304 that is attached to the front surface side of the main body 350, and is blue with respect to the subject to be photographed. And an illumination unit 306 capable of emitting light or white light.

Here, although the case where the optical device 300 is attached to the mobile terminal 100 through a gel seal made of gel as the attachment member 200 is taken as an example, the optical device 300 is used as a case for the mobile terminal 100 as the attachment member 200. It can also be attached to the portable terminal via a screw. When a gel sheet is used, the optical device 300 can be easily attached to the portable terminal 100 regardless of the position of the photographing unit 102 provided in the portable terminal 100. Further, the optical device 300 can be easily and firmly attached to the portable terminal 100 by screwing using an existing portable terminal case formed so that the photographing unit 102 is exposed.

The main body 350 is provided at a position corresponding to the imaging unit 102, is configured to be detachably slidable and allows only light of a desired wavelength to pass therethrough, and is provided on the front side of the filter 320. The lens unit 302 and a driving unit 310 such as a battery for driving the illumination unit 306 are included. Here, for example, as shown in FIG. 1, the filter unit 320 is configured to be detachable by manually sliding up and down. However, the configuration of the filter unit 320 is not limited to this example, and the filter unit 320 may have a different sliding direction, or may be various types of configurations that can switch the necessity of the filter unit 320 even in an embedded type. Good. Moreover, it is preferable that the filter part 320 is a filter which cuts light with a wavelength of 400 nm or more, for example. The lens unit 302 may be provided on the rear surface side of the filter unit 320.

In addition, about the drive part 310, by making the structure which can use the power supply of the portable terminal 100 (for example, connecting the power supply of the portable terminal 100 to the main-body part 350 with a cable etc.), the illumination part 306 is driven. It may be a configuration. Alternatively, a removable external battery may be connected to the main body 350.

The main body 350 is provided with a blower 308 that sends air to the lens unit 302 and the photographing unit 102. The blower 308 takes in air from the bottom surface of the main body 350 through the vent 312, for example. Then, air is sent to the photographing unit 102 through the lens unit 302, the filter unit 320, and the opening 314. In this way, when the inside of the oral cavity is imaged as an object to be imaged, the air blowing unit 308 can prevent fogging of the imaging unit 102 and the lens unit 302 due to exhalation, and a clear image without fogging can be captured. The opening 314 is provided between the photographing unit 102 and the filter unit 320 of the mobile terminal 100 so as to communicate with each other.

In the imaging evaluation / detection unit 1 having the above configuration, when the imaging unit 102 captures an image through the filter unit 320 that cuts a wavelength of 400 nm or more, the light from the illumination unit 306 is blue light. An image that can be accurately extracted can be taken based on the fluorescence that generates the anomalous portion in the subject to be photographed. In addition, when the imaging unit 102 captures an image without passing through the filter unit 320, the light from the illumination unit 306 is white light, and for example, a subject to be imaged in a relatively dark oral cavity can be easily imaged. In this embodiment, the light emitted from the illumination unit 306 is described as an example of blue light or white light. However, a desired irradiation light can be created using a combination of these colors, It is also possible to create desired illumination light including other colors such as yellow.

Alternatively, a slide type optical filter that can fix blue light or white light as light from the illumination unit 306 while fixing the light source 304 to white light may be provided. 2A and 2B are diagrams illustrating a configuration example of the imaging evaluation / detection unit 1 in which the slide type optical filter 318 is provided in the illumination unit 306. FIG. 2A illustrates a state in which blue light is irradiated, and FIG. FIG. 2C is a sectional view taken along line II-II in FIG.

The sliding optical filter 318 covers the light source 304 and is configured to be slidable between a position that allows white light to pass through and a position that allows only blue light to pass. Specifically, the slide type optical filter 318 is formed of an annular thin plate having an opening at the center, and a filter portion 318a that allows blue light to pass through and a transparent portion 318b that allows white light to pass through as it is in total 16 in total. They are arranged at equal intervals. That is, eight filter parts 318a and eight transparent parts 318b are formed corresponding to the eight light sources 304 arranged in an annular shape in the illumination part 306.

The entire slide optical filter 318 may be formed of an annular filter that allows only blue light to pass through, and a hole may be formed at a position corresponding to the transparent portion 318b.

A knob 318c is provided on a part of the outer periphery of the slide optical filter 318. Further, the outer periphery of the slide optical filter 318 is loosely fitted in the groove 316a on the inner peripheral surface of the hood 316 covering the outer periphery of the eight light sources 304 arranged in an annular shape. It is configured to be rotatable in the circumferential direction. That is, the slide type optical filter 318 is configured to be slidable between a position that allows white light to pass as it is and a position that allows only blue light to pass.

The slit 316b is provided in a part of the side surface of the hood 316, and the knob 318c of the slide optical filter 318 is inserted into the slit 316b. Accordingly, the illumination unit 306 is irradiated with blue light as shown in FIG. 2A by sliding the knob 318c in the circumferential direction of the hood 316, or as shown in FIG. It can switch to the state which irradiates such white light.

Returning to FIG. 1, the photographing evaluation / detection unit 1 according to the present embodiment can download and use a developed dedicated application on the mobile terminal 100. In this case, for example, as shown in FIG. 3, the display screen of the mobile terminal 100 (the display screen 101 of FIG. 1. Note that the display screen 101 is the surface opposite to the surface on which the photographing unit 102 is arranged in the mobile terminal 100. By pressing the shooting button 104c through the shooting image display area 104b of the shooting screen 104 displayed in (2), for example, the subject to be shot in the oral cavity can be easily shot at an appropriate size. . Depending on the user of the photographic evaluation / detection unit 1, it is assumed that variations in the size of the photographic image cause variations in the extraction of the anomalous portion of the photographic subject. By using such a shooting screen 104 in addition to the angle of view set by the unit 302, the shooting target can be shot at a predetermined size. Further, the captured image display area 104b of the imaging screen 104 displayed on the display screen 101 of the mobile terminal 100 may include markings for adjusting the size of the image to be captured. In this way, a photographed image having a predetermined size can be obtained, which is likely to vary for each person using the photographing evaluation / detection unit 1 with the aid of marking indicating, for example, the photographing position and size on the photographing screen of the application. It becomes easier to obtain as an image.

Also, as shown in FIG. 3, for example, information corresponding to the shooting location of the subject to be photographed and the type of light to be switched may be displayed on the photographing screen 104, for example, to display the subject to be photographed. it can. Further, FIG. 3 shows a photographing screen 104 in which an image obtained by photographing the front part of the oral cavity as a subject to be photographed is displayed in the photographed image display area 104 b of the photographing screen 104. Note that the shooting screen 104 in FIG. 3 is an example, and is not limited to this example, and the configuration can be variously modified.

In addition, when imaging the intraoral area as an object to be imaged and extracting the anomalous part, in addition to the front part in the oral cavity, the upper right side, upper left side, lower right side, lower left side in the oral cavity It is preferable to extract the abnormal part in the whole oral cavity by photographing each of the above. In this case, when photographing a portion other than the front part in the oral cavity, for example, an ordinary person can easily perform the photographing by using a photographing auxiliary mirror configured as shown in FIGS. 4 (a) and 4 (b). be able to. Note that the numerical values shown in FIGS. 4A and 4B are examples, and the present invention is not limited to these.

FIG. 5 shows an example of an image obtained by photographing the front part of the subject to be imaged using the imaging evaluation / detection unit 1 according to the present embodiment. For example, FIG. 5A shows a photographed image taken using natural light and white light without the filter unit 320 (with the filter unit 320 removed), and FIG. 5B shows the filter unit. This is a photographed image photographed using light having a predetermined wavelength and blue light through 320 (with the filter unit 320 attached). As shown to Fig.5 (a), the image of the front part in an oral cavity is image | photographed clearly by using white light in imaging | photography with natural light. Moreover, as shown in FIG.5 (b), the image of the state which fluoresced by the image of the front part in an oral cavity is obtained by using the light and blue light which have a predetermined wavelength after passing through the filter part 320. It is taken clearly. The abnormal part in the oral cavity of the subject to be imaged can be accurately extracted from the image of FIG. For example, it can contribute to early detection of invisible caries, confirmation of brushing status, confirmation of the presence of unpolished plaque, dental plaque, calculus, etc., and inspection before periodontal disease.

Note that in order to obtain an image as shown in FIG. 5A, it is desirable to take a picture in a dark room as much as possible so that external light does not enter the subject. However, since shooting in a dark room may be difficult, the hood 316 shown in FIG. 1 may be enlarged. FIG. 6 is a perspective view of the photographing evaluation / detection unit 1 having a large hood. The hood 316 has an opening that covers the entire mouth of the subject, and houses the illumination unit 306 therein. At the time of shooting, the opening of the hood 316 closes the subject's mouth. Thereby, external light does not enter the oral cavity, and a good image as shown in FIG. 5A can be taken even in a bright room.

In addition, the application downloaded to the mobile terminal 100 includes a function for color-coding the object to be imaged and the anomalous part (image processing unit 105 in FIG. 1), and a function for quantifying the ratio of the anomalous part to the object to be imaged. (Numericalizing unit 106 in FIG. 1) is included.

The image processing unit 105 color-codes the subject to be photographed and the anomalous portion in the subject to be photographed in the image photographed by the photographing unit 102. The digitizing unit 106 calculates the areas of the object to be imaged and the anomalous part from the image after the color coding processing by the image processing unit 105, and quantifies the ratio of the anomalous part to the object to be imaged. The image color-coded by the image processing unit 105 and the ratio digitized by the digitizing unit 106 are displayed on the display screen 101 of the mobile terminal 100.

Next, specific examples of the above-described color coding of the object to be imaged and the anomalous part and quantification of the ratio of the anomalous part to the object to be imaged will be shown.

FIG. 7A is an example of a photographed image of a tooth as an intraoral photographic image, using light having a predetermined wavelength and blue light through the filter unit 320 (in a state where the filter unit 320 is attached). This is a photographed image. Moreover, FIG.7 (b) is a display example of the intraoral photograph image and numerical control window after a color-coding process.

As shown in FIG. 7B, gums, teeth, caries, plaque, and the like are displayed in different colors in the intraoral photographic image 108a after the color classification process. The color tone of the color classification can be adjusted by a color bar 108b displayed on the right side of the intraoral photographic image 108a after the color classification processing.

The user can cause the digitizing unit 106 to perform a digitization process by inputting a numeric value into each item in the digitization control window 109. By inputting a percentage in each column of “Trimming: Top, Bottom, Left, Right” in the digitization control window 109, it is possible to designate a target area for the digitization process in the intraoral photographic image 108a after the color coding process. . In the “color: maximum value”, “tooth”, and “plaque” fields in the numerical control window 109, the color tone value of the color bar 108b is input.

When the “diagnosis” button in the digitization control window 109 is pressed, the digitization unit 106 displays the “tooth” and “plaque” columns in the digitization control window 109 in the intraoral photo image 108a after the division processing. The area of the portion corresponding to the specified tone value, that is, each area of the tooth and plaque is calculated, and the ratio of plaque to the tooth (hereinafter referred to as plaque adhesion rate) is quantified. In the example of FIG. 7B, the tooth area is 71092, the plaque area is 11165, and the plaque adhesion rate is quantified as 15.71%.

Fig. 8 (a) is an example of a photographed image of the tongue as an intraoral photographic image, and Fig. 8 (b) is an example of display of the intraoral photographic image and the numerical control window after color-coding processing. 8A is an intraoral photograph image 107 photographed using white light for convenience, and the intraoral photograph image to be processed by the image processing unit 105 is not a photographed image using white light. FIG. 6 is a photographed image taken using light having a predetermined wavelength and blue light through the filter unit 320 (in a state where the filter unit 320 is attached).

As shown in FIG. 8B, the tongue, tongue coating and the like are displayed in different colors in the intraoral photographic image 108a after the color classification process. The color tone of the color classification can be adjusted by a color bar 108b displayed on the right side of the intraoral photographic image 108a after the color classification processing.

The user can cause the digitizing unit 106 to perform a digitization process by inputting a numeric value into each item in the digitization control window 109. By inputting a percentage in each column of “Trimming: Top, Bottom, Left, Right” in the digitization control window 109, it is possible to designate a target area for the digitization process in the intraoral photographic image 108a after the color coding process. . Further, the color value of the color bar 108 b is input to the “color: maximum value”, “tongue”, and “tongue” fields in the numerical control window 109.

When the “diagnosis” button in the digitization control window 109 is pressed, the digitization unit 106 specifies the “tongue” and “tongue” in the digitization control window 109 in the intraoral photographic image 108a after the division processing. The area of the portion corresponding to the color tone value, that is, each area of the tongue and tongue coating is calculated, and the ratio of tongue coating to the tongue (hereinafter referred to as tongue coating adhesion rate) is quantified. In the example of FIG. 8B, the tongue area is 71092, the tongue coating area is 52676, and the tongue coating adhesion rate is quantified as 74.10%.

FIG. 9 is an image showing changes in plaque adhesion when a subject continues brushing his teeth. This figure summarizes the results of intraoral radiographing every 5 weeks, from left to right maxillary right central incisor, mandibular left central incisor, dental fluorescence image (having a predetermined wavelength) Images taken using light and blue light) are arranged in this order. The percentage shown on the right side is the plaque adhesion rate quantified by the quantification unit 106. The number of times shown in the figure indicates the shooting time. The second time is one week after the first time (first time), and the fifth time is four weeks after the first time.

FIG. 10 is a graph showing changes in the plaque adhesion rate when different test toothbrushes are used by 4 subjects. The vertical axis of the graph is the plaque adhesion rate, and the horizontal axis is the photographing time. The interval between each photographing period is one week. As can be seen from the graph, by using each trial toothbrush, the plaque adhering to the teeth decreases over time, and in the fifth time (after 4 weeks from the first), every subject has plaque adhesion rate. Became 5% or less.

FIG. 11 is an image showing changes in tongue coating when a certain subject continues brushing his teeth. Another fluorescent image of the tongue shows the miso that appeared after tongue coating removal. The figure summarizes the results of five intraoral radiographs taken every other week. From the left, a normal image of the tongue (photographed using white light) and a fluorescent image of the tongue (predetermined) Are taken in the order of a fluorescent image of the tongue). The percentage shown on the right side is the tongue coating adhesion rate quantified by the quantification unit 106. The number of times shown in the figure indicates the shooting time. The second time is one week after the first time (first time), and the fifth time is four weeks after the first time.

FIG. 10 is a graph showing changes in tongue coating adhesion rate when different test toothbrushes are used by 4 subjects. The vertical axis of the graph is the tongue coating adhesion rate, and the horizontal axis is the photographing time. The interval between each photographing period is one week. As can be seen from the graph, by using each trial toothbrush, the adhesion rate of tongue coating decreases to an average of 10% by the third time, but then varies between 10% and 20%. The fact that the tongue coating adhesion rate is more than 10% is a high value compared with the plaque adhesion rate, which is considered to be because tongue coating remains on the tongue base portion behind the tongue. Since the swallowing reflex occurs when the toothbrush is applied to the back of the tongue, tongue coating remains on the part where the toothbrush cannot reach due to the inability to apply the toothbrush to the back of the tongue, which indicates the limit of tongue cleaning by the toothbrush. However, it became clear that the adhesion rate of tongue coating could be removed to a few ten percent with a toothbrush.

According to the imaging evaluation / detection unit according to one aspect of the present invention described above, since the optical device 300 can be used by being mounted on the mobile terminal 100, it can be easily used not only by professionals but also by general people. In particular, it is possible to easily extract an abnormal part of an object to be imaged such as in the oral cavity. Further, in the image photographed by the photographing unit 102, the object to be photographed and the anomalous part in the object to be photographed are color-coded, and the ratio of the anomalous part to the object to be photographed is quantified. A ratio of the anomalous portion to the photographing target is displayed on the display screen 101. Thus, the ratio of the anomalous portion to the object to be imaged is indicated by a numerical value, so that an accurate and quick diagnosis can be performed. In addition, the taste buds after tongue coating removal can be observed from the fluorescence image of the tongue, which can be used for diagnosis of diseases such as taste disorders.

In the above embodiment, it has been described that the image processing unit 105 and the digitizing unit 106 are realized by an application downloaded to the mobile terminal 100. However, the image processing unit 105 and the digitizing unit 106 are connected to the mobile terminal 100. May be mounted on another device, and the imaging evaluation / detection unit may be modified so that the intraoral photographic image captured by the portable terminal 100 is sent to the device and the intraoral photographic image is processed in the device.

FIG. 13 is a diagram illustrating a configuration example of a photographing evaluation / detection unit according to a modification. The imaging evaluation / detection unit 1A according to the modification is connected to the mobile terminal 100 having an information communication function including the imaging unit 102, the optical device 300 attached to the mobile terminal 100, the evaluation device 110, and the evaluation device 110. Display screen 101. The evaluation device 110 is a computer device such as a personal computer, a workstation, a server, or a cloud, and is mounted with the above-described image processing unit 105 and digitizing unit 106. The image processing unit 105 and the digitizing unit 106 may be configured by either hardware or software. When the evaluation apparatus 110 is a laptop personal computer, the evaluation apparatus 110 and the display screen 101 are integrated. The intraoral photograph image photographed by the portable terminal 100 is transmitted to the evaluation apparatus 110 by radio. The evaluation device 110 receives an image from the mobile terminal 100 and processes the image. Specifically, the image processing unit 105 color-codes the object to be imaged and the anomaly part in the object to be imaged in the image received from the image capturing unit 102. Then, the digitizing unit 106 calculates the areas of the object to be imaged and the anomalous part from the image after the color classification processing by the image processing unit 105, and quantifies the ratio of the anomalous part to the object to be imaged. The image color-coded by the image processing unit 105 and the ratio digitized by the digitizing unit 106 are displayed on the display screen 101 connected to the evaluation apparatus 110.

As described above, by mounting the image processing unit 105 and the digitizing unit 106 in the evaluation device 110 different from the mobile terminal 100, images captured by various mobile terminals 100 are integrated into one evaluation device 110. Can be evaluated and managed.

In the above-described embodiment, the photographing evaluation / detection unit having the same size as that of the portable terminal 100 has been described as shown in FIG. 1, but the present invention is limited to this embodiment. Instead, for example, as shown in FIGS. 14A and 14B, the filter unit 320 and the lens unit 302 in the main body unit 350 and the lens unit 302 are arranged so as to correspond to the arrangement of the

imaging units

102 a and 102 b that are different for each portable terminal 100. Modifications can be made as appropriate so that the illumination unit 306 is positioned. 14A shows an example of the photographing evaluation / detection unit 1 in which the optical device 300A is mounted when the photographing unit 102a is arranged at the upper left position on the back surface of the mobile terminal 100. FIG. (B) shows an example of the photographing evaluation / detection unit 1 in which the optical device 300B is mounted when the photographing unit 102b is arranged at the upper center position on the back surface of the mobile terminal 100.

Alternatively, the optical device 300 may be made detachable from the portable terminal 100 independently of the photographing evaluation / detection unit 1 so that the position of the photographing unit 102 that is different for each portable terminal 100 may be accommodated. 15 and 16 are a front view and a side view of an optical device according to a modification. The optical device 300C according to the modified example includes an illumination unit 306 that irradiates light to the subject, a lens unit 302 that forms an image of reflected light from the subject irradiated with light by the illumination unit 306, the lens unit 302, and the mobile terminal 100. A filter unit 320 that passes only light of a specific wavelength included in the reflected light from the subject, an illumination unit 306, a lens unit 302, and a filter unit 320 are attached to the mobile terminal. The clip unit 340 is provided with the lens unit 302 and the filter unit 320 fixed to the position of the photographing unit 102 by sandwiching 100 from both front and back sides.

The light emitting surface 330 of the illumination unit 306 has a donut shape in plan view. In addition, a lens unit 302 and a filter unit 320 are disposed at the center. Since the lens unit 302 and the filter unit 320 have already been described, the description thereof is omitted here.

The illumination unit 306 includes a plurality (eight in this example) of blue light emitting elements 304a and a plurality (eight in this example) of white light emitting elements 304b as light sources 304. The blue light emitting element 304a and the white light emitting element 304b are alternately arranged on the light emitting surface 330, and the light emitting surface 330 is covered with a donut-shaped light diffusion cover. Further, a switch 331 for switching the emission color is provided on the side surface of the illumination unit 306, and the illumination unit 306 switches between irradiation of only blue light, irradiation of only white light, and extinction by pressing the switch 331. It is configured as follows.

The clip portion 340 includes a bowl-shaped first member 341, a bowl-shaped second member 342, and a push coil spring 343. One end of each of the first member 341 and the second member 342 is connected to a hinge shaft 344, and the distal end portion 341c in the extending direction of the first member 341 and the distal end portion 342c in the extending direction of the second member 342 are opened and closed. It is like that. The illumination unit 306, the lens unit 302, and the filter unit 320 are attached to the tip 341c of the first member 341.

Knob portions

341 a and 342 a are provided at positions close to the hinge shaft 344 in the first member 341 and the second member 342. The push coil spring 343 is disposed on the opposing inner surfaces of the

knob portions

341a and 342a.

A slit 341b is provided in the middle of the extending direction of the first member 341, and a constricted portion 342b having a width similar to that of the slit portion 341b is provided in the middle of the extending direction of the second member 342. The constricted portion 342b is slidably passed through the slit 341b, and the first member 341 and the second member 342 intersect at this portion. The distal end portion 341c of the first member 341 and the distal end portion 342c of the second member 342 are always closed by the biasing force of the push coil spring 343. And the distal end portion 342c of the second member 342 is opened, and the mobile terminal 100 is sandwiched between the front and back surfaces by an appropriate force by the distal end portion 341c of the first member 341 and the distal end portion 342c of the second member 342 by the biasing force of the push coil spring 343. It is like that.

The optical device 300C having such a configuration can be mounted on any type of portable terminal 100. As a result, it is possible to use the portable terminal 100 of one's own hand as an apparatus that captures an image necessary for extraction and quantification of the anomalous part to be photographed in the photographing evaluation / detection unit 1 regardless of the model of the portable terminal. can do.

In the above-described imaging evaluation / detection unit of the present embodiment, the case where the subject to be imaged is in the oral cavity has been described as an example, but the present invention is not limited to this example. That is, the imaging evaluation / detection unit of this embodiment can be applied to areas such as ophthalmology, dermatology, plastic surgery, otolaryngology, and the like. In the ophthalmologic region, the surface condition of the eyeball can be confirmed, and the presence or absence of a wound, the inflammation condition, etc. can be confirmed. In particular, by conducting simple inspections (screening) of elderly people, construction sites, disaster sites, etc., it will lead to appropriate treatment. Further, in the otolaryngology area, for example, the condition of the eardrum can be confirmed, and the condition such as otitis media can be confirmed in school screening.

In addition, in the shooting evaluation / detection unit of the present embodiment, the case where a shooting target still image is shot by the shooting unit has been described, but the present invention is not limited to a still image, for example, by shooting a moving image, depending on the application target, By implementing the present invention in the same manner using moving images, it is also possible to achieve better effects.

1, 1A Imaging evaluation / detection unit 100 Mobile terminal 101 Display screen 102 Imaging unit 102a Imaging unit 102b Imaging unit 105 Image processing result 106 Digitization unit 300 Optical device

300A Optical device

300B Optical device

300C Optical device 302 Lens unit 304 Light source 304a Blue Light emitting element 304b White light emitting element 306 Illuminating unit 316 Hood 318 Sliding optical filter 320 Filter unit 330 Light emitting surface 340 Clip unit

Claims

An illumination unit for irradiating the subject with light;
A lens unit that forms an image of reflected light from a subject irradiated with light by the illumination unit;
A photographing unit for photographing an image formed by the lens unit;
A filter unit that is interposed between the lens unit and the photographing unit, is configured to be detachably slidable, and allows only light of a specific wavelength included in the reflected light to pass through;
An image processing unit for color-coding the object to be imaged and the anomalous part in the object to be imaged in the image captured by the image capturing unit;
Calculating each area of the object to be imaged and the anomalous part from the image after the color-separation processing by the image processing unit, and quantifying the ratio of the anomalous part to the object to be imaged,
An image after color coding processing by the image processing unit and a display screen for displaying a ratio digitized by the digitizing unit;
An imaging evaluation / detection unit characterized by this.
In the photographing evaluation / detection unit according to claim 1,
The image photographed by the photographing unit is an intraoral photographic image,
The subject to be photographed is a tooth,
The anomalous part is plaque,
An imaging evaluation / detection unit characterized by this.
In the photographing evaluation / detection unit according to claim 1,
The image photographed by the photographing unit is an intraoral photographic image,
The subject is a tongue;
The abnormal part is tongue coating,
An imaging evaluation / detection unit characterized by this.
In the photographing evaluation / detection unit according to claim 2 or 3,
It has an opening that covers the entire mouth of the subject, and includes a hood that houses the illumination unit inside.
An imaging evaluation / detection unit characterized by this.
The photographing evaluation / detection unit according to any one of claims 1 to 4,
The illumination unit includes a light source that emits white light, and a slide type optical filter that covers the light source and is slidable between a position that allows white light to pass through and a position that allows only blue light to pass through.
An imaging evaluation / detection unit characterized by this.
In the photographing evaluation / detection unit according to any one of claims 1 to 5,
The photographing unit, the image processing unit, the digitizing unit, and the display screen are components of a mobile terminal,
The illumination unit, the lens unit, and the filter unit are components of an optical device that is detachable from the portable terminal.
An imaging evaluation / detection unit characterized by this.
In the photographing evaluation / detection unit according to claim 6,
The imaging evaluation / detection unit, wherein the image processing unit and the digitizing unit are realized by an application downloaded to the mobile terminal.
In the photographing evaluation / detection unit according to any one of claims 1 to 5,
The photographing unit is a component of a mobile terminal,
The illumination unit, the lens unit, and the filter unit are components of an optical device that is detachable from the portable terminal,
The imaging evaluation / detection unit, wherein the image processing unit and the digitizing unit are components of an evaluation device that receives an image captured by the portable terminal and processes the image.
An optical device that is detachable from a portable terminal,
An illumination unit for irradiating the subject with light;
A lens unit that forms an image of reflected light from a subject irradiated with light by the illumination unit;
A filter unit that is interposed between the lens unit and the imaging unit of the mobile terminal, and allows only light of a specific wavelength included in the reflected light to pass through;
The illumination unit, the lens unit, and the filter unit are attached, and the clip unit fixes the lens unit and the filter unit at the position of the photographing unit by sandwiching the portable terminal from both front and back sides,
The light emitting surface of the illumination unit has a donut shape in plan view, and the lens unit and the filter unit are arranged at the center thereof,
An optical device, wherein blue light emitting elements and white light emitting elements are alternately arranged on the light emitting surface, and the illumination unit is configured to be able to switch between blue light and white light for irradiation.