KR102074887B1 - Oral conditon management remote monitoring system using image analysis - Google Patents

Abstract

The present invention relates to a remote oral monitoring system and method using image analysis. According to the present invention, in the oral condition remote monitoring system using the image analysis, the oral imaging device that can shoot the interior of the oral cavity, paired with the oral imaging device, the user terminal for transmitting the image taken from the oral imaging device, Oral condition management server that stores the image taken by the subject and the oral condition analysis result data of the subject, and receiving the captured image from the oral condition management server, by detecting the tartar or plaque through the previously learned oral condition determination algorithm, And an oral condition determining apparatus displaying the detected calculus or plaque portion on the photographed image and transmitting the analysis result to the user terminal.
As described above, according to the present invention, it is possible to prevent oral periodontal disease in advance by accurately determining whether tartar and plaque are properly removed in real time.
In addition, by diagnosing or monitoring the tartar and plaque of teeth or gums in the oral cavity in real time, there is an effect that can manage the teeth in the long term.

Description

Oral condition remote monitoring system using image analysis and its method {ORAL CONDITON MANAGEMENT REMOTE MONITORING SYSTEM USING IMAGE ANALYSIS}

The present invention relates to a remote oral condition monitoring system and method using image analysis, and more particularly to a remote oral condition monitoring system and method using image analysis that can monitor the state of the tooth in real time remotely. .

Oral disease is a chronic disease with a high prevalence and a high socioeconomic burden. It is necessary to monitor the scale and related risk factors at the national level and establish management measures based on it. Oral examination refers to a process of visually diagnosing oral cavity, such as dental caries and periodontal disease, using alveolar or periodontal probe (Probe).

In most cases, oral diseases are diagnosed by a doctor and diagnosed, but most visits to the dentist to check the condition of the teeth, most people are afraid of dental visits in many cases.

Periodontal disease is an inflammatory disease of the gums and supporting tissues surrounding the teeth, which can be said to be the root cause of bacteria in tartar or plaque. Bacteria form plaque or tartar with food residues, which act as biofilms and adhere to teeth continuously attacking the gums. In addition, periodontal disease is an inflammatory disease and is closely related to systemic diseases, and as the age increases, periodontal diseases may occur or worsen due to various systemic diseases such as cardiovascular diseases or respiratory diseases and weakened immunity.

In the treatment of periodontal disease, the most basic thing is to remove bacterial plaque and tartar without creating a favorable environment for bacterial growth. Eating gum medications do not help much. You can use chlorhexidine, a dentifrice, or place a special agent between your gums and teeth, or use antibiotics to kill special bacteria in your gums.

To prevent gum disease, the most important thing is to get rid of the bacteria in the form of plaque and tartar in your mouth by brushing your teeth after meals or before bedtime.

However, in order to remove plaque and tartar, they brush their teeth or gargle, but most people are satisfied with the freshness of their mouths and most of them do not check whether plaque and tartar are properly removed. These plaques and tartar should be removed as soon as they occur, but it prevents periodontal disease, but there is no way to identify them.

There is a method of confirming plaque and tartar using oral liquid substance, but this is expensive and it is difficult to check the condition of the inner tooth even if confirmed through this. By removing plaque and tartar from oral disease, various oral diseases can be prevented.

The background technology of the present invention is disclosed in Korean Patent Registration No. 10-1654853 (2016.09.22. Notification).

The technical problem to be achieved by the present invention is to provide an oral condition remote monitoring system and method using an image analysis that can remotely monitor the state of the tooth in real time.

According to an embodiment of the present invention for achieving the technical problem, in the oral condition remote monitoring system using the image analysis, the oral imaging device that can photograph the interior of the oral cavity, paired with the oral imaging device, from the oral imaging device A user terminal for transmitting the photographed image, an oral condition management server storing the captured image and the oral condition analysis result data of the test subject, and receiving the captured image from the oral condition management server, and previously learned oral condition determination algorithm And an oral condition determining apparatus for detecting tartar or plaque and displaying the detected tartar or plaque on the captured image and transmitting the plaque or plaque to the user terminal.

The oral cavity device is formed in a cylindrical shape, the camera is provided to shoot 360 degrees inside, the main body is provided with a lighting module on each of the upper and lower surfaces, and the bar on the main body so that the examiner can grip ( bar) is connected, and may include a support including a power button and a shooting button.

The user terminal has an oral condition monitoring application installed therein, and may receive an oral condition analysis result from the spherical condition determining apparatus through the oral condition monitoring application.

The user terminal may be displayed while rotating the image inside the mouth 360 degrees by the user's operation.

The oral condition determination apparatus inputs a plurality of oral internal images displaying calculus or plaque into the oral condition determination algorithm, and determines the oral condition determination algorithm to determine whether or not tartar or plaque according to the tooth color, the location of occurrence and the size of the site of occurrence. I can learn.

According to an embodiment of the present invention, in the oral condition remote monitoring method using the oral condition remote monitoring system, when the oral imaging device to take the image of the oral cavity of the subject, the user terminal paired with the oral imaging device is taken in the oral cavity Transmitting the image to the oral condition management server, the oral care server storing the photographed image, and transmitting the captured image to the oral condition determination device, wherein the oral condition determining device is previously learned oral state of the photographed image. Detecting a tartar or plaque by applying it to a determination algorithm, and the oral cavity state judging device displays the detected tartar or plaque on the photographed image and transmits the analysis result to the user terminal.

According to the present invention, oral periodontal disease can be prevented in advance by accurately determining whether tartar and plaque are properly removed in real time.

In addition, by diagnosing or monitoring the tartar and plaque of teeth or gums in the oral cavity in real time, there is an effect that can manage the teeth in the long term.

1 is a view for explaining the oral condition remote monitoring system using the image analysis according to an embodiment of the present invention.
2A and 2B are diagrams for describing an oral cavity imaging apparatus according to an exemplary embodiment of the present invention.
3 is a flowchart illustrating a process of generating an oral state determination algorithm by the oral state determination apparatus according to an embodiment of the present invention.
4 is a flowchart illustrating a method for monitoring oral condition using image analysis according to an exemplary embodiment of the present invention.
5 is an exemplary view showing an image analyzed by the oral cavity condition determining apparatus.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is said to "include" a certain component, it means that it can further include other components, except to exclude other components unless specifically stated otherwise.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention.

1 is a view for explaining the oral condition remote monitoring system using the image analysis according to an embodiment of the present invention.

As shown in Figure 1, the oral condition remote monitoring system using the image analysis according to an embodiment of the present invention oral imaging apparatus 100, the user terminal 200, the oral condition management server 300 and the oral condition determination device ( 500, and may further include a medical staff terminal 400.

First, the oral cavity imaging apparatus 100 is equipped with a small camera and a lighting device in the front of the support is made of a synthetic iron material that allows the user to shoot the state of the oral cavity, the user terminal 200 To pass).

Next, the user terminal 200 includes a short-range or telecommunication module and includes a CPU, a RAM, a display, and the like. The user terminal 200 includes a smart phone, a smart pad, a smart terminal, and is not limited to a device such as a smart phone.

The user terminal 200 is controlled through the oral condition monitoring application (hereinafter, referred to as an app (APP)), and the application may be provided by Google, i * j's, or the like.

In addition, the oral condition monitoring app communicates with the oral condition management server 300 in real time, and performs the function of displaying the oral condition diagnosis results received from the oral condition management server 300 on the user terminal (200).

Next, the oral cavity state management server 300 performs the function of oral cavity state information management, user management, communication between the medical staff terminal 400 and communication between the oral cavity state determination device 500, in particular, oral state information management of the subject For this purpose, the captured image is stored and managed in a personal database.

In addition, the oral condition management server 300 may transmit the stored photographed image to the oral condition determining apparatus 500 for diagnosing tartar and plaque. In addition, the oral condition management server 300 receives a diagnosis result for the oral condition from the oral condition determining apparatus 500 and transmits the result of the diagnosis to the oral condition monitoring app of the user terminal 200.

Medical staff terminal 400 is a generic term for a terminal used by an individual or institution specialized in dental care, it refers to a terminal that can diagnose or determine the oral condition of the individual. Medical staff terminal 400 can be provided as a single application, it can be provided in the form of a smart application.

The oral cavity condition determining apparatus 500 may be a judgment module or a device equipped with an oral cavity judgment algorithm, and determines the oral cavity state using artificial intelligence, deep learning, and machine learning. The oral condition determining apparatus 500 detects plaque or tartar of the subject using the result of learning the photographed image and performs a function of notifying the analysis result to the user terminal 200 in real time.

2A and 2B are diagrams for describing an oral cavity imaging apparatus according to an exemplary embodiment of the present invention.

As shown in FIG. 2A, the oral cavity imaging apparatus 100 includes a main body 110 and a support 120. In addition, the main body 110 includes a camera 111, a lighting module 112, a battery (not shown), and a communication module (not shown), and the support 120 has a power button 121 and a shooting button 122. ) Is installed.

As shown in Figure 2a, the main body 110 is formed in a cylindrical shape, the camera 111 is mounted inside the main body, and the illumination module 112 is mounted on the upper side and the lower side, respectively. In addition, the support 120 connected to the main body 110 is composed of an iron composite material that allows the user to photograph the state of the oral cavity.

The camera 111 and the lighting module 112 may be controlled by an oral condition monitoring app installed in the user terminal 200.

Camera 111 is composed of a camera capable of 360-degree measurement, each side is provided with a lens. In addition, the lighting module 112 may be configured together to brightly photograph a dark place in the oral cavity.

That is, since one lens of the camera 111 is formed on both the upper side and the lower side of the main body as shown in FIG. 2B, all 360 degrees of the oral cavity can be taken by the inspector's operation. When the inspector presses the photographing button 122, the inspector may photograph an image currently being photographed. The captured image is transmitted to the user terminal 200 by the oral condition monitoring app. In this case, the oral cavity imaging apparatus 100 may transmit the captured image to the user terminal 200 via wireless, or may transmit the captured image to the user terminal 200 through a wired communication such as USB.

Hereinafter, a process of generating the oral cavity state determination algorithm by the oral cavity state determination apparatus 500 will be described with reference to FIG. 3.

3 is a flowchart illustrating a process of generating an oral state determination algorithm by the oral state determination apparatus according to an embodiment of the present invention.

In order to determine the oral condition, an algorithm for determining an oral condition is required. For this, the oral condition determining apparatus 500 may be implemented by using a machine learning algorithm.

First, when the inside of the various oral images are taken through the camera (S310), the dental professional analyzes the photographed image and displays a portion having tartar or plaque (S320).

In operation S330, the photographed image in which calculus or plaque is displayed is input to a machine algorithm using AI.

In other words, calculus or plaque has different characteristics according to the color of the tooth, the location of occurrence, the size of the site of development, and the like. By repeatedly inputting photographed images displaying a plurality of calculus or plaque into the machine algorithm, the machine algorithm is learned to determine the oral condition. It generates (S340).

Here, the oral cavity determination algorithm may be generated through not only a machine learning algorithm, but also a supervised learning algorithm, a deep learning algorithm, and the like.

The oral condition judgment algorithm receives the stereotyped and atypical big data accumulated on the basis of the intraoral imaging image in which tartar or plaque is generated, and repeatedly learns through artificial neural network (AI). Infers and stores the function.

Hereinafter, a method for monitoring oral condition using image analysis according to an embodiment of the present invention will be described with reference to FIGS. 4 and 5.

4 is a flowchart illustrating a method for monitoring oral condition using image analysis according to an exemplary embodiment of the present invention.

First, the examiner presses the power button 121 of the oral cavity imaging apparatus 100 to turn on the oral cavity imaging apparatus 100 (S410).

Next, when the inspector executes the oral condition monitoring app of the user terminal 200, the user terminal 200 performs pairing with the oral imaging apparatus 100 (S420).

When pairing between the oral cavity image pickup device 100 and the user terminal 200, the inspector puts the oral cavity image pickup device 100 into the mouth of the subject and then photographs the corresponding teeth using the image capture button 122 (S430). .

The user terminal 200 transmits the captured image to the oral condition determining apparatus 500 through the oral condition management server 300 through the oral condition monitoring app (S440).

At this time, the captured image is stored in the oral condition management server 300 for each individual examinee.

In addition, the user terminal 200 may transmit the captured image to the medical staff terminal 400 to diagnose the condition of the oral cavity from the medical staff.

The oral cavity condition determining apparatus 500 inputs the received photographed image to the oral cavity condition determination algorithm. The oral condition determining apparatus 500 detects calculus or plaque from an image photographed through an oral condition determination algorithm, displays the detected part, and transmits the detected part to the user terminal 200 (S450). In this case, the oral condition determining apparatus 500 may receive the tartar or plaque examination result from the medical staff through the medical staff terminal 400.

5 is an exemplary view showing an image analyzed by the oral cavity condition determining apparatus.

As shown in FIG. 5, the oral cavity condition determining apparatus 500 determines calculus or plaque from the photographed image, and displays the detected calculus or plaque on the image and transmits the same to the user terminal 200.

Then, the examinee may check the analysis result as shown in FIG. 5 through the oral condition monitoring app installed in the user terminal 200.

In this case, the examinee may check the image at various angles through the oral condition monitoring app. That is, since the photographed image is an image captured at 360 degrees, the examinee may check the state of the mouth in detail while moving the screen from side to side.

Therefore, according to the exemplary embodiment of the present invention, the remote diagnosis may be performed in real time through the oral cavity state determining apparatus 500 using only the captured image.

In addition, according to an embodiment of the present invention, the oral condition information can be received from the medical staff through the medical staff terminal 400, it is possible to personally check the oral condition without being limited to medical.

As described above, according to the embodiment of the present invention, it is possible to prevent oral periodontal disease in advance by accurately determining whether tartar and plaque are properly removed in real time.

In addition, by diagnosing or monitoring the tartar and plaque of teeth or gums in the oral cavity in real time, there is an effect that can manage the teeth in the long term.

Although the present invention has been described with reference to the embodiments illustrated in the drawings, this is merely exemplary, and it will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

100: oral imaging device 110: main body
111: camera 112: lighting module
120: support 121: power button
122: shooting button 200: user terminal
300: oral condition management server 400: medical staff terminal
500: oral condition judgment device

Claims (10)

In the oral condition remote monitoring system using image analysis,
Oral imaging device that can photograph the inside of the oral cavity,
A user terminal wirelessly paired with the oral cavity imaging apparatus and transmitting an image captured by the oral cavity imaging apparatus;
Oral condition management server that stores the image taken by the subject and the oral condition analysis result data of the subject, and
Receiving a photographed image from the oral condition management server, detects tartar or plaque through a pre-learned oral condition determination algorithm, and displays the detected tartar or plaque part on the photographed image and transmits the analysis result to the user terminal. An oral condition determination device,
The oral condition determination device,
Inputs a plurality of oral cavity internal images showing calculus or plaque into an oral condition determination algorithm, and learns the oral condition determination algorithm to determine whether tartar or plaque is determined according to the color of the tooth, the location of occurrence and the size of the site of occurrence;
The oral cavity imaging device,
It consists of a cylindrical shape, the lighting module is installed on the upper side and the lower side, respectively, the main body is provided with a lens of the camera on the upper side and the lower side to enable 360-degree shooting, and
Is connected to the body in the form of a bar (bar), so that the examiner can hold, including a support including a power button and a shooting button,
The lighting module and the camera are controlled by an oral condition monitoring application installed in the user terminal,
The user terminal,
Receiving oral condition analysis results from the oral condition determining device through the oral condition monitoring application, and oral state remote monitoring system for displaying while rotating the image inside the oral cavity by 360 degrees. delete delete delete delete In the oral condition remote monitoring method using the oral condition remote monitoring system,
When the oral cavity imaging apparatus photographs the intraoral image of the subject, the user terminal wirelessly paired with the oral cavity imaging apparatus transmits the captured intraoral image to the oral condition management server;
The oral condition management server storing the photographed image and transmitting the photographed image to the oral condition determining apparatus;
The oral cavity state determination device detects tartar or plaque by applying the photographed image to a previously learned oral state determination algorithm;
The oral condition determining apparatus displaying the detected calculus or plaque portion on the captured image and transmitting an analysis result to the user terminal; and
And storing the image taken for each subject and the result of analyzing the oral condition of the subject.
The oral condition determination device,
Inputs a plurality of oral cavity internal images showing calculus or plaque into an oral condition determination algorithm, and learns the oral condition determination algorithm to determine whether tartar or plaque is determined according to the color of the tooth, the location of occurrence and the size of the site of occurrence;
The oral cavity imaging device,
It consists of a cylindrical shape, the lighting module is installed on the upper side and the lower side, respectively, the main body is provided with a lens of the camera on the upper side and the lower side to enable 360-degree shooting, and
Is connected to the body in the form of a bar (bar), so that the examiner can hold, including a support including a power button and a shooting button,
The lighting module and the camera are controlled by an oral condition monitoring application installed in the user terminal,
The user terminal,
Receiving an oral condition analysis result from the oral condition determination device through the oral condition monitoring application, and oral state remote monitoring method for displaying while rotating the image inside the mouth 360 degrees by the user's operation. delete delete delete delete

Images