JP2020054646A - Oral state determination device, oral state determination method, and program - Google Patents

Abstract

To provide an oral state determination device, oral state determination method, and program that improve determination accuracy of a state of a gingiva.SOLUTION: An oral state determination device 10 comprises: an identification unit 130 that identifies teeth one by one out of a picture in which one or more teeth and a gingiva's part corresponding to the teeth are imaged; a first determination unit 140 that on the basis of a result identified by the identification unit, determines a state of the gingiva's part corresponding to the teeth identified by the identification unit of the gingiva's part imaged in the picture for each of the teeth identified by the identification unit; a second determination unit 150 that on the basis of a determination result by the first determination unit, determines a state of the whole gingiva imaged in the picture; and a presentation unit for presenting the determination result by the first determination unit or a determination result by the second determination unit.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an oral state determination device, an oral state determination method, and a program.

  2. Description of the Related Art Conventionally, a technique for evaluating an image of a gingival tissue has been disclosed (for example, see Patent Document 1).

JP-T-2009-543654

  According to the technique disclosed in Patent Literature 1, an image of a gingival tissue is extracted based on color values of the image, thereby evaluating the health condition. However, according to the technique disclosed in Patent Document 1, it may be difficult to recognize the position and shape of the gingival tissue. In such a case, a specialist such as a dentist or a dental hygienist visually evaluates the gingival tissue. There is a problem that the accuracy of the evaluation result is lower than in the case where the evaluation is performed.

  One embodiment of the present invention includes an identification unit that identifies one tooth at a time from an image of one or more teeth and a portion corresponding to the tooth in the gum, and an identification unit that identifies the tooth. Based on the result, the state of the gum corresponding to the tooth identified by the identification unit among the gums captured in the image is determined for each tooth identified by the identification unit. A determination unit, a second determination unit that determines the state of the entire gum taken in the image based on the determination result of the first determination unit, and a determination result by the first determination unit or the second determination unit And a presentation unit for presenting a result of the determination by the user.

  In one embodiment of the present invention, in the above-mentioned intraoral state determination device, the first determination unit determines the state of the gum by at least three evaluation steps.

  In one embodiment of the present invention, in the above-mentioned intraoral state determination device, the second determination unit statistically calculates a determination result for each tooth by the first determination unit for a plurality of teeth captured in the image. Thus, the state of the entire gum is determined.

  In one embodiment of the present invention, in the above-mentioned mouth condition determination device, the first determination unit determines the state of the gum by at least two types of evaluation items, and the second determination unit includes the first determination unit. The state of the entire gum is determined by performing statistical calculation on the plurality of teeth captured in the image for each evaluation item based on the determination result for each tooth.

  According to one embodiment of the present invention, in the above-described oral state determination device, oral care information that acquires oral care information according to the determination result based on the determination result by the first determination unit or the determination result by the second determination unit. An acquisition unit is further provided, and the presentation unit further presents the oral care information acquired by the oral care information acquisition unit.

  In one embodiment of the present invention, a computer includes an identification step of identifying teeth one by one from an image obtained by imaging one or more teeth and a portion corresponding to the teeth of the gums; Based on the result identified in the identification step, of the gums captured in the image, the state of the gum corresponding to the tooth identified in the identification step, the tooth identified in the identification step A first determination step of determining the state of the entire gum taken in the image based on the determination result in the first determination step; A presentation step of presenting the determination result determined in the first determination step or the determination result determined in the second determination step This is a state determination method.

  One embodiment of the present invention provides a computer including an identification step of identifying one tooth at a time from an image of one or more teeth and a portion of the gum corresponding to the tooth, Based on the result identified in the step, the state of the gum corresponding to the tooth identified in the identification step among the gums captured in the image is determined for each tooth identified in the identification step A first determination step, a second determination step of determining the state of the entire gum taken in the image based on the determination result in the first determination step, and a determination result determined in the first determination step Or a presentation step of presenting the determination result determined in the second determination step.

  According to the present invention, it is possible to provide an oral state determining apparatus, an oral state determining method, and a program that can improve the determination accuracy of a gum state.

It is a figure showing an example of the functional composition of the mouth state judging system of a 1st embodiment. It is a figure showing an example of operation of the mouth state judging system of this embodiment. It is a figure showing an example of the home screen of this embodiment. It is a figure showing an example of a photography screen of this embodiment. It is a figure showing an example of an image check screen of this embodiment. It is a figure showing an example of the identification result of tooth T by the identification part of this embodiment. It is a figure showing an example of each tooth image of this embodiment. It is a figure which shows an example of the evaluation stage of the color of the gum of this embodiment. It is a figure which shows an example of the evaluation stage of the swelling of the gum of this embodiment. It is a figure showing an example of an evaluation stage of gum fall of this embodiment. It is a figure showing an example of the 1st judgment result screen of this embodiment. It is a figure showing an example of the 2nd judgment result screen of this embodiment. It is a figure showing an example of the functional composition of the mouth state judging system of a 2nd embodiment. It is a figure showing an example of a mouth care information display screen of this embodiment.

[First Embodiment]
Hereinafter, the oral state determination system 1 of the present embodiment will be described with reference to the drawings.
FIG. 1 is a diagram illustrating an example of a functional configuration of an intraoral state determination system 1 according to the first embodiment.
The oral state determination system 1 includes an oral state determination device 10 and a terminal device 20. The oral state determination device 10 and the terminal device 20 are connected to each other via a network N.
The oral state determination device 10 is configured by, for example, a server device. The terminal device 20 is configured by, for example, a smartphone or a tablet.

[Functional Configuration of Terminal Device 20]
The terminal device 20 includes a camera CAM and a display unit DP. The camera CAM performs imaging based on an operation of an operator of the terminal device 20. The display unit DP includes, for example, a liquid crystal display, and displays an image captured by the camera CAM and information transmitted from the oral state determination device 10 via the network N.
The terminal device 20 transmits information such as an image captured by the camera CAM to the mouth state determination device 10 via the network N.
In addition, information such as images and characters is communicated between the mouth state determination device 10 and the terminal device 20 via the network N as described above. Description is omitted.

In an example of the present embodiment, the terminal device 20 transmits the intraoral image OP to the intraoral state determination device 10. The intraoral image OP is an image of the subject's intraoral image. As an example, the intraoral image OP is an intraoral image of the operator of the terminal device 20 captured by the camera CAM of the terminal device 20. In the intraoral image OP, one or more teeth T and gums G around the teeth T are imaged.
In the following description, the gum G around the tooth T is also referred to as a portion of the gum G corresponding to the tooth T. In other words, the intraoral image OP is an image in which one or more teeth T and a portion corresponding to the teeth T in the gum G are captured.
Further, in the following description, a case where 18 teeth T (teeth T1 to T18) are imaged in the intraoral image OP will be described as an example.

[Functional Configuration of Oral Condition Determination Apparatus 10]
The oral state determination device 10 includes a communication unit 110, an image acquisition unit 120, an identification unit 130, a first determination unit 140, and a second determination unit 150.

The communication unit 110 performs communication with the terminal device 20. The following communication unit 110 receives information transmitted from the terminal device 20. In addition, the communication unit 110 transmits the information generated by the mouth state determination device 10 to the terminal device 20.
The communication unit 110 outputs the information received from the terminal device 20 to the image acquisition unit 120. In an example of the present embodiment, the information received by the communication unit 110 includes the above-described intraoral image OP.
The image acquisition unit 120 acquires the intraoral image OP from the information received by the communication unit 110. The image acquisition unit 120 outputs the acquired intraoral image OP to the identification unit 130.

The identification unit 130 identifies the teeth T captured in the intraoral image OP one by one. As described above, one or more teeth T are captured in the intraoral image OP. When 18 teeth T are captured in the intraoral image OP as in the above example, the identification unit 130 identifies these teeth T1 to T18 one by one.
As a specific example, the identification unit 130 outputs the coordinate value of the region where the tooth T is captured in the intraoral image OP as the tooth T identification result for each tooth T.
In the following description, the image of each tooth T identified by the identification unit 130 is also referred to as an image STP for each tooth.
The identification unit 130 outputs the identification result of the tooth T of the intraoral image OP to the first determination unit 140.

As described above, the teeth T and the gums G are imaged in the intraoral image OP.
The first determination unit 140 determines the state of the gum G corresponding to the tooth T identified by the identification unit 130 among the gums G captured in the intraoral image OP for each tooth T identified by the identification unit 130. Is determined.
In the case of the above example, the first determination unit 140 determines the state of the gum G1 corresponding to the tooth T1 for the tooth T1. Also, the first determination unit 140 determines the state of the gums G2, G3,..., G18 corresponding to the respective teeth T for the teeth T2, T3,.
The first determination unit 140 outputs the state of the gum G determined for each tooth T to the second determination unit 150 as a determination result RS1 for each tooth. Further, the first determination unit 140 outputs the determination result RS1 for each tooth to the communication unit 110.

The second determination unit 150 determines the state of the entire gum G captured in the intraoral image OP based on the determination result RS1 for each tooth of the first determination unit 140.
In the case of the above example, the determination result RS1 for each tooth includes information indicating the state of each of the gums G1 to G18. The second determination unit 150 determines the state of the entire gum G based on the information indicating the state of each of the gums G1 to G18.
The second determination unit 150 outputs the determination result of the state of the entire gum G to the 110 as the entire gum determination result RS2.

  The communication unit 110 presents the determination result RS1 for each tooth by the first determination unit 140 or the determination result RS2 for the entire gum by the second determination unit 150. Here, presenting the determination result includes transmitting the determination result to the terminal device 20 and displaying the result on a display device (not shown) included in the mouth state determination device 10.

[Operation of the oral state determination system 1 (operation stage)]
Next, an example of the operation of the mouth state determination system 1 will be described with reference to FIG.
FIG. 2 is a diagram illustrating an example of an operation of the intra-oral state determination system 1 of the present embodiment.

(Step S210) The terminal device 20 displays a home screen (image P1). An example of the home screen (image P1) will be described with reference to FIG.

  FIG. 3 is a diagram illustrating an example of the home screen according to the present embodiment. On the home screen (image P1), an image (image P11) for receiving the display operation of the previous determination result, images (image P12, image P13) indicating the previous determination result, and an operation for starting the determination of the mouth state are received. The image (image P14) is displayed. When the image (image P14) for accepting the start operation of the oral state determination is operated (for example, a tap operation) by the operator, the terminal device 20 advances the process to step S220.

(Step S220) Returning to FIG. 2, the terminal device 20 displays a shooting screen (image P2). An example of the shooting screen (image P2) will be described with reference to FIG.

FIG. 4 is a diagram illustrating an example of a shooting screen according to the present embodiment. On the shooting screen (image P2), a moving image shot by the camera CAM is displayed in a so-called live view format. Further, on the shooting screen (image P2), a shooting guide image (images P21 to P23) and an image (image P24) for receiving a shooting operation are displayed.
Here, the photographing guide image (image P21) is a guide frame for aligning the outer shape of the lips of the subject. The subject pulls the lips left and right so that the teeth T and the gums G are displayed on the display unit DP, and adjusts the outline of the lips to the guide frame.
The imaging guide image (image P22) is a horizontal line for aligning the positions of meshing of the upper and lower teeth T of the subject. The subject adjusts the meshing position of the upper and lower teeth T to this horizontal line.
The imaging guide image (image P23) is a vertical line for aligning the front (middle) of the subject's face. The subject adjusts the position of the front of the face to this vertical line.
When an image (image P24) for accepting a photographing operation is operated (for example, a tap operation) by the operator, the terminal device 20 switches the photographed image of the camera CAM displayed on the display unit DP from a moving image to a still image. , The process proceeds to step S230.

(Step S230) Returning to FIG. 2, the terminal device 20 displays an image confirmation screen (image P3). An example of the image confirmation screen (image P3) will be described with reference to FIG.

FIG. 5 is a diagram illustrating an example of the image confirmation screen according to the present embodiment. On the image confirmation screen (image P3), a still image captured by the camera CAM is displayed. The image confirmation screen (image P3) accepts a comment sentence for image confirmation (image P31), a shooting guide image (image P32), a comment sentence for image enlargement / reduction operation (image P33), and a retake operation. An image (image P34) and an image (image P35) for receiving a determination start operation are displayed.
When a still image displayed on the image confirmation screen (image P3) is operated by the operator (for example, a pinch-out operation or a pinch-in operation), the terminal device 20 changes the size of the still image displayed on the display unit DP to Enlarge or reduce. Further, when the image (image P34) for accepting the retake operation is operated (for example, a tap operation) by the operator, the terminal device 20 returns the process to step S220. Further, when an image (image P35) for accepting the determination start operation is operated (for example, a tap operation) by the operator, terminal device 20 proceeds with the process to step S240.

(Step S240) Returning to FIG. 2, the terminal device 20 transmits the still image confirmed in step S230 to the intra-oral state determination device 10 as the intra-oral image OP.

(Step S110) The communication unit 110 and the image acquisition unit 120 of the intraoral state determination device 10 acquire the intraoral image OP transmitted from the terminal device 20 in step S240.

(Step S120) The identification unit 130 of the intraoral state determination device 10 identifies the teeth T one by one with respect to the intraoral image OP acquired in step S110. FIG. 6 shows an example of the identification result of the tooth T by the identification unit 130.

  FIG. 6 is a diagram illustrating an example of the identification result of the tooth T by the identification unit 130 of the present embodiment. The identification unit 130 cuts out, from the intraoral image OP, an image STP for each tooth corresponding to each tooth T included in the intraoral image OP. In an example of the present embodiment, the identification unit 130 identifies the 18 teeth T from the teeth T1 to T18 one by one. In the case of this example, the identification unit 130 cuts out an image of the nth (n is a natural number) tooth Tn of the teeth T1 to T18 from the intraoral image OP as a tooth-by-teeth image STPn. For example, the identification unit 130 cuts out the image of the tooth T1 from the intraoral image OP as the image for each tooth STP1.

(Step S130) Returning to FIG. 2, the first determination unit 140 of the intraoral state determination device 10 determines the state of the gum G corresponding to each tooth T identified in step S120. The first determination unit 140 determines the state of the gum G based on the image STP for each tooth. FIG. 7 shows an example of the image STP for each tooth.

FIG. 7 is a diagram illustrating an example of an image STP for each tooth according to the present embodiment. The image STP for each tooth includes a tooth region TP and a gum region GP. Here, it is desirable that the lip is not included in the image STP for each tooth. Examples of a method that does not include the lips include a method of cutting out the intraoral image OP with a predetermined length from the gum G2 so as not to include the lips, and a method of not including the lips by using a machine learning model that is trained to recognize the lips. A method of cutting out from the intraoral image OP can be used. The first determination unit 140 determines the state of the gum region GP included in the image STP for each tooth.
In addition, the first determination unit 140 includes, in the determination target, the state of the interdental papilla (for example, the gum G1 and the gum G3) and the gingival margin (for example, the gum G2) in the gum region GP, The state of the gum region GP may be determined. In addition, when the subject captures the captured image (image P2), the gum region GP may not be sufficiently exposed by the lips. In that case, the state of the gum region GP may be determined only at the interdental papilla and the gingival margin, or at only one of the interdental papilla and the gingival margin. In this case, the first determination unit 140 may set the evaluation score of the part with the worst condition among the gums G1 to G3 as the evaluation score for the tooth T.

The first determination unit 140 determines the state of the gum G based on at least two types of evaluation items EV. In an example of the present embodiment, the first determination unit 140 determines the state of the gum G based on the three types of evaluation items EV of the gum G, color, swelling, and gum fall.
An example of the evaluation level LV for each evaluation item by the first determination unit 140 will be described with reference to FIGS.

FIG. 8 is a diagram illustrating an example of the evaluation stage LV of the color of the gum G according to the present embodiment. The first determination unit 140 evaluates the color of the gum G based on three evaluation levels LV of evaluation score 0 to evaluation score 2.
FIG. 9 is a diagram illustrating an example of the evaluation stage LV of the swelling of the gum G according to the present embodiment. The first determination unit 140 evaluates the swelling of the gum G based on three evaluation levels LV of evaluation score 0 to evaluation score 2.
FIG. 10 is a diagram illustrating an example of an evaluation stage LV of gum fall according to the present embodiment. The first determination unit 140 evaluates the gum drop using three evaluation levels LV of evaluation score 0 to evaluation score 2.
Each of the evaluation scores is associated with an evaluation comment. The correspondence table between the evaluation score and the evaluation comment is stored in advance in a storage unit (not shown) included in the mouth state determination device 10 or an external device.

As described above, the first determination unit 140 determines the state of the gum G based on at least three evaluation levels LV.
The first determination unit 140 outputs the result of the determination of the state of the gum G to the second determination unit 150 and the communication unit 110 as a determination result RS1 for each tooth.

[Operation in the learning stage of the oral state determination system 1]
Note that the above-described identification unit 130 and first determination unit 140 may each be configured by a machine learning model.
As an example, the identification unit 130 is configured by a machine learning model that is good at object recognition. In this case, in the learning stage of the identification unit 130, various images of the intraoral image OP are given to the identification unit 130, and a teacher can extract a tooth-based image STP including the tooth T and the gum G from the intraoral image OP. We perform learning with attached.
Further, as an example, the first determination unit 140 is configured by a machine learning model that is good at image classification. In this case, in the learning stage of the first determination unit 140, various images of each tooth image STP are given to the first determination unit 140, and the determination result of each tooth image STP by a specialist such as a dentist or a dental hygienist. Is used as teacher data to perform supervised learning.

(Step S140) Returning to FIG. 2, the second determination unit 150 of the intra-oral state determination device 10 determines the state of the entire gum G captured in the intra-oral image OP based on the determination result RS1 for each tooth. Here, the second determination unit 150 statistically calculates the determination result RS1 for each tooth T for each tooth T by the first determination unit 140 with respect to the plurality of teeth T captured in the intraoral image OP, thereby obtaining the entire gum G. Determine the status. As an example of the statistical calculation by the first determination unit 140, there is a calculation for calculating any one of an average value, a median value, a mode value, a minimum value, and a maximum value of the determination result RS1 for each tooth T for each tooth.

In addition, the second determination unit 150 performs a statistical operation on the determination result RS1 for each tooth for each evaluation item EV. That is, the second determination unit 150 statistically calculates the determination result RS1 for each tooth by the first determination unit 140 for each of the plurality of teeth T captured in the intraoral image OP for each evaluation item EV, thereby obtaining the entire gum G. Is determined.
The second determination unit 150 outputs the result of the determination on the state of the entire gum G to the communication unit 110 as the entire gum determination result RS2.

(Step S150) The communication unit 110 of the intra-oral state determination device 10 transmits the determination result RS1 for each tooth in step S130 and the determination result RS2 for the entire gum in step S140 to the terminal device 20.

(Step S250) The terminal device 20 receives the determination result transmitted in step S150, and causes the display unit DP to display the received determination result. An example of the determination result displayed on the display unit DP will be described with reference to FIGS.

  FIG. 11 is a diagram illustrating an example of a first determination result screen (image P4) of the present embodiment. The first determination result screen (image P4) includes an image (P41) for accepting a display switching operation to the second determination result screen (image P5) and a determination result of the entire gum G based on the entire gum determination result RS2. (Image P42, image P43) and an image (image P44) that accepts a display operation of the home screen (image P1).

  FIG. 12 is a diagram illustrating an example of the second determination result screen (image P5) of the present embodiment. The second determination result screen (image P5) includes an image (P51) for receiving a display switching operation to the first determination result screen (image P4), and an evaluation item for the entire gum G based on the entire gum determination result RS2. An image (image P52) indicating the determination result for each EV, an image (image P53, image P54) indicating the determination result for each tooth T based on the determination result RS1 for each tooth, and a comment image (image P55) are displayed. You.

[Summary of First Embodiment]
As described above, the oral state determination system 1 includes the two determination units, the first determination unit 140 and the second determination unit 150. Here, the first determination unit 140 determines the state of the gum G for each tooth T based on the identification result of the identification unit 130. The second determination unit 150 determines the state of the entire gum G based on the determination result of the first determination unit 140.

  Here, according to the conventional image processing method, it was sometimes difficult to recognize the position and shape of the gum G from the image of the inside of the mouth. For this reason, according to the conventional image processing method, the automatic recognition result of the position and the shape of the gum G to be determined is not stable, and compared with a case where a specialist such as a dentist or a dental hygienist visually determines, There has been a problem that the determination accuracy is low.

On the other hand, if the position and shape of the gum G to be determined can be automatically and stably recognized, the accuracy of determining the state of the gum G can be increased. Here, the position and shape of the tooth T are easier to recognize automatically than the position and shape of the gum G. The intraoral state determination system 1 of the present embodiment is configured by focusing on the ease of automatic recognition of the teeth T. That is, the intraoral state determination system 1 of the present embodiment determines the state of the gum G for each tooth T, and determines the state of the entire gum G by statistically calculating the determination result for each tooth T.
Therefore, according to the intraoral state determination system 1 of the present embodiment, the accuracy of determining the state of the gum G can be improved.

  Further, according to the intraoral state determination system 1 of the present embodiment, the first determination unit 140 determines the state of the gum G by at least three evaluation levels LV. Here, in the case of the prior art that is determined based on two evaluation stages, there are cases where only two types of advice, such as whether to consult a specialist such as a dentist or a dental hygienist about the state of the gum G, can be presented. is there. According to the mouth state determination system 1 of the present embodiment, in order to make a determination based on at least three evaluation levels LV, in addition to the above two types of advice, for example, a third type of advice that self-care should be performed is presented. Can be.

In addition, according to the intraoral state determination system 1 of the present embodiment, the second determination unit 150 determines the determination result RS1 for each tooth T by the first determination unit 140 for each tooth T in the plurality of teeth captured in the intraoral image OP. By performing a statistical operation on T, the state of the entire gum G is determined.
According to the mouth state determination system 1 of the present embodiment, various determination results can be presented according to the type of statistical calculation performed by the second determination unit 150.
For example, when the statistical calculation performed by the second determination unit 150 sets the worst value (maximum value) of the determination result RS1 for each tooth as the state of the entire gum G, the state of the gum G is poor for at least one tooth T. If so, its presence can be presented.
When the statistical operation performed by the second determination unit 150 sets the average value (or the median value or the mode value) of the determination result RS1 for each tooth as the state of the entire gum G, the state may be determined depending on the state of the image. Even when the state of the tooth T of the part is erroneously determined, the influence on the determination result of the entire gum G can be reduced.

  Further, according to the intraoral state determination system 1 of the present embodiment, the state of the gum G is determined by at least two types of evaluation items EV. Therefore, according to the intraoral state determination system 1 of the present embodiment, for example, the determination accuracy can be improved as compared with a case where the state of the gum G is determined only by the color of the gum G or only by the shape of the gum G. .

[Second embodiment]
Next, a second embodiment will be described with reference to FIGS. Note that the same functions and operations as those in the above-described embodiment are denoted by the same reference numerals, and description thereof will be omitted.

  FIG. 13 is a diagram illustrating an example of a functional configuration of the mouth state determination system 1a according to the present embodiment. The oral state determination system 1a includes an oral state determination device 10a. This intraoral state determination device 10a differs from the first embodiment in that an intraoral care information acquisition unit 160 is provided.

The oral care information acquisition unit 160 acquires the oral care information OCD according to the determination result based on the determination result RS1 for each tooth by the first determination unit 140 or the entire gum determination result RS2 by the second determination unit 150.
Here, the oral care information OCD includes a comment explaining the procedure and method of oral care, information introducing oral care products, and the like. The determination result RS1 for each tooth or the whole gum determination result RS2 is associated with the above-described commentary comment or product introduction information, and is stored in advance in a storage unit (not shown) of the oral state determination device 10a or another device. I have.
In addition, the oral care information OCD is associated with information about the dentist (for example, presence of implants, silver teeth, gold teeth, and orthodontic appliances) separately obtained through a survey such as a subject questionnaire, so that appropriate commentary or product introduction information can be obtained. Can be provided to the subject.
The oral care information acquisition unit 160 searches using the tooth-based determination result RS1 or the entire gum determination result RS2 as a search key, and provides a commentary or product introduction information associated with the tooth-based determination result RS1 or the entire gum determination result RS2. Is obtained as the oral care information OCD. The oral care information acquisition unit 160 transmits the acquired oral care information OCD to the terminal device 20 via the communication unit 110. That is, the communication unit 110 (presentation unit) presents the oral care information OCD acquired by the oral care information acquisition unit 160.

  FIG. 14 is a diagram illustrating an example of a display screen of the oral care information OCD according to the present embodiment. On the display unit DP of the terminal device 20, a determination result screen (image P4a) is displayed. On this determination result screen (image P4a), screens (images P45 and P46) based on the oral care information OCD transmitted from the oral care information acquisition unit 160 are displayed.

  As described above, according to the oral state determination system 1a of the present embodiment, in addition to the determination result of the state of the gums G, information (oral care information OCD) useful for oral self-care can be presented. For this reason, according to the oral state determination system 1a, at the stage before the state of the gum G worsens, that is, at the stage before the state where it is necessary to consult an expert such as a dentist or a dental hygienist, Present self-care procedures and methods.

  In each of the above-described embodiments, an example of the function sharing between the oral state determination device 10 (or the oral state determination device 10a) and the terminal device 20 has been described. However, each device is configured to have a different function allocation from the above. May be. For example, in the mouth state determination system 1, all or a part of the functions of the mouth state determination device 10 may be realized as software that operates on the terminal device 20.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and may be appropriately changed without departing from the spirit of the present invention. it can.

  Each of the above devices has a computer inside. The process of each process of each device described above is stored in a computer-readable recording medium in the form of a program, and the above process is performed by reading and executing the program by the computer. Here, the computer-readable recording medium refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like. Alternatively, the computer program may be distributed to a computer via a communication line, and the computer that has received the distribution may execute the program.

Further, the program may be for realizing a part of the functions described above.
Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, what is called a difference file (difference program) may be sufficient.

  DESCRIPTION OF SYMBOLS 1 ... Mouth condition judgment system, 10 and 10a ... Mouth condition judgment device, 110 ... Communication part, 120 ... Image acquisition part, 130 ... Identification part, 140 ... First judgment part, 150 ... Second judgment part, 160 ... Mouth care Information acquisition unit, 20: terminal device, CAM: camera, DP: display unit, P: image, OP: intraoral image, STP: image for each tooth, TP: tooth region, GP: gum region, G: gum, T: tooth , RS1 ... decision result for each tooth, RS2 ... decision result for the entire gum, N ... network, LV ... evaluation stage, EV ... evaluation item, OCD ... oral care information

Claims (7)

An identification unit that identifies one tooth at a time from one or more teeth and an image of a portion corresponding to the tooth in the gums,
Based on the result identified by the identification unit, among the gums captured in the image, the state of the gum corresponding to the tooth identified by the identification unit is determined for each tooth identified by the identification unit. A first determination unit for determining
A second determination unit that determines a state of the entire gum that is captured in the image based on a determination result of the first determination unit;
A presentation unit that presents a determination result by the first determination unit or a determination result by the second determination unit;
An oral state determination device comprising: The first determination unit includes:
The oral state determination device according to claim 1, wherein the state of the gum is determined by at least three evaluation steps. The second determination unit includes:
The intraoral state determination according to claim 1 or 2, wherein a determination result for each tooth by the first determination unit is statistically calculated for a plurality of teeth captured in the image to determine a state of the entire gum. apparatus. The first determination unit includes:
The state of the gums is determined by at least two types of evaluation items,
The second determination unit includes:
The intraoral state according to claim 3, wherein a state of the entire gum is determined by performing a statistical operation on a plurality of teeth captured in the image for each evaluation item based on a determination result of each tooth by the first determination unit. State determination device. An oral care information acquisition unit that acquires oral care information according to the determination result based on the determination result by the first determination unit or the determination result by the second determination unit,
The oral state determination device according to any one of claims 1 to 4, wherein the presentation unit further presents the oral care information acquired by the oral care information acquisition unit. An identification step of identifying one tooth at a time from a captured image of one or more teeth and a portion of the gum corresponding to the tooth;
The computer, based on the result identified in the identification step, among the gums captured in the image, the state of the gum corresponding to the tooth identified in the identification step, identified in the identification step, A first determination step of determining for each tooth that
A second determining step in which the computer determines the state of the entire gum taken in the image based on the determination result in the first determining step;
A computer for presenting a determination result determined in the first determination step or a determination result determined in the second determination step;
Mouth condition determination method having On the computer,
An identification step of identifying one tooth at a time from an image in which one or more teeth and a portion of the gum corresponding to the tooth are captured;
Based on the result identified in the identification step, among the gums captured in the image, the state of the gum corresponding to the tooth identified in the identification step is determined for each tooth identified in the identification step. A first determination step for determining
A second determination step of determining a state of the entire gum taken in the image based on a determination result in the first determination step;
A presentation step of presenting the determination result determined in the first determination step or the determination result determined in the second determination step;
A program for executing

Images