KR20230147839A - Personalized oral care product recommendation system and method thereof - Google Patents

Abstract

The present invention relates to a system and method for recommending a personalized oral care product. More specifically, the present invention relates to a system and method for recommending a personalized oral care product, and more specifically, to obtain oral information including an image of the user's oral cavity, analyze the acquired oral information to diagnose the user's oral condition, and diagnose the user's oral condition. This relates to a personalized oral care product recommendation system and method that recommends oral care products suitable for the user's oral condition.

Description

Personalized oral care product recommendation system and method {Personalized oral care product recommendation system and method there}

The present invention relates to a system and method for recommending a personalized oral care product. More specifically, the present invention relates to a system and method for recommending a personalized oral care product, and more specifically, to obtain oral information including an image of the user's oral cavity, analyze the acquired oral information to diagnose the user's oral condition, and diagnose the user's oral condition. This relates to a personalized oral care product recommendation system and method that recommends oral care products suitable for the user's oral condition.

Although people invest a lot of time and money in health care, they tend to neglect oral care, which plays a very important role in our bodies.

Typically, people brush their teeth three times a day to take care of their oral teeth, gums, and tongue, but in many cases, the focus is on the teeth.

In addition, it is difficult to keep the oral cavity healthy through toothbrushing alone, and various oral diseases such as various gum diseases, periodontitis, cavities, and fractured teeth occur frequently.

Whenever an oral disease occurs, you go to the dentist to receive treatment, but this is an afterthought and can result in great costs and pain, so it is desirable to prevent oral disease in advance.

Recently, as Dental IQ has increased, various oral care products that can provide more efficient oral care have been developed and commercialized, and consumer interest in these products is also increasing.

However, information on the characteristics of various oral care products is insufficient, and users of oral care products do not know their oral condition accurately, so it is difficult to know which oral care product is right for them.

Currently, users who are interested in oral care products often visit a dentist and purchase oral care products recommended by the dentist, but oral care products are usually limited and expensive.

Meanwhile, it may be necessary to take supplements for oral care, but information on oral care supplements is usually poor, making it difficult for users to select supplements directly.

There is a need for a way to purchase and recommend oral care products, supplements, medicines, and tools appropriate for the user's oral condition.

Republic of Korea Patent No. 10-0760351 (announced on September 20, 2007) Republic of Korea Patent Publication No. 10-2021-0043592 (published on April 21, 2021)

Therefore, the purpose of the present invention is to obtain oral information including the user's oral image, analyze the acquired oral information to diagnose the user's oral condition, and recommend personalized oral care products suitable for the diagnosed user's oral condition. To provide an oral care product recommendation system and method.

The personalized oral care product recommendation system according to the present invention for achieving the above object includes: a storage unit including a database defining oral care product types by oral condition and oral care product types by oral care product type; An oral information input unit including a display unit and a camera, which receives and outputs oral information including an oral image taken of the user's oral cavity through the camera; And analyzing the oral condition by analyzing the oral information acquired through the oral information input unit, generating oral condition information including information on the condition of the oral cavity including teeth and gums according to the oral image, and oral care Determine the product type, extract oral care products corresponding to the oral condition information from oral care products of the oral care product type determined by referring to the database, and oral care including oral care products of the extracted oral care product type. It is characterized by including a control unit that generates product recommendation information and displays it on the display unit.

The storage unit includes a medicine DB that stores medicine information for each oral condition, where the type of oral care product is medicine, and information on at least one medicine according to oral condition; The oral care product type is an oral care product, and an oral care product DB that stores oral care product information for each oral state, which is information about at least one oral care product according to the oral state; The oral care product type is an oral care tool, and an oral care tool DB that stores oral care tool information for each oral condition, which is information about at least one oral care tool according to the oral condition. An oral care food DB that stores oral care food information by oral condition, where the oral care product type is food, and is information about at least one oral care food according to oral condition; and an oral care expert DB that stores oral care expert information by oral condition, which is information about at least one oral care expert according to oral condition and is an expert in the type of oral care product.

The oral information input unit includes a camera that outputs an image of a scene entering the angle of view of the lens to the control unit; and an input/output unit including a display unit that displays various information in the form of one or more of text, graphics, still images, and images, and an input unit that selects and inputs functions and information in conjunction with the display unit.

The control unit includes an oral care event monitoring unit that monitors whether an oral care event occurs through the oral information input unit; An oral information acquisition unit that acquires oral information including the oral image through the oral information input unit when the oral care event occurs; Analyzing oral information including the acquired oral image, diagnosing the condition of the oral cavity including teeth and gums by analyzing the oral image, and oral status information including status information of the diagnosed teeth, gums, and tongue Oral condition diagnosis unit that generates; And determining the type of oral care product of the oral condition corresponding to the oral condition information generated by referring to the database, extracting the oral care product of the determined oral care product type, and oral care product information of the extracted oral care product type. It is characterized in that it includes an oral care recommendation unit that generates oral care product recommendation information including and displays it on the display unit.

The oral condition diagnosis unit is provided with a dental disease artificial intelligence model learned from a plurality of dental disease images with dental disease, and applies the oral image of the oral information to the dental disease artificial intelligence model to determine whether or not the tooth is diseased. A tooth analysis unit that classifies the type, detects the tooth color, and outputs dental disease status information including the tooth color, whether the tooth is diseased, and the type of disease; Equipped with a gum disease artificial intelligence model learned from multiple gum disease images with gum disease, and applying the oral images to the gum disease artificial intelligence model to classify whether gum disease is present and the type of disease, and to detect gum color A gum analysis unit that outputs gum disease status information including the gum color, gum disease, and disease type; and a tongue disease artificial intelligence model learned from a plurality of tongue disease images with tongue disease, and apply the oral images to the tongue disease artificial intelligence model to classify whether the tongue is diseased and the type of disease, and the classified tongue It is characterized by comprising an oral image analysis unit including a tongue analysis unit that outputs tongue disease status information including the presence of disease and the type of disease.

The tooth analysis unit includes a tooth color analysis unit that detects teeth from the oral image, detects the tooth color of the detected tooth, and outputs the tooth color information as one of oral condition information; The dental disease artificial intelligence model is provided, and the oral image is applied to the dental disease artificial intelligence model to classify the dental disease and disease type of the teeth in the oral image, and dental disease information including the dental disease and disease type. A dental disease analysis unit that outputs as one of oral condition information; and a dental material classification artificial intelligence model that learns dental materials and prosthetics based on oral images showing any one or more of various dental materials and prosthetics applied to teeth, and applying the oral image to the dental material classification artificial intelligence model, It is characterized by including a dental material analysis unit that classifies dental materials and prosthetics applied to teeth and outputs the classified dental material and prosthesis classification information as one of oral condition information.

The oral condition diagnosis unit includes a genetic information analysis unit that detects genetic information from a document image containing genetic information acquired through the oral information acquisition unit and the camera and outputs it as one of the oral condition information; and a text information analysis unit that displays a medical questionnaire through a display unit of the input/output unit, and includes a medical questionnaire analysis unit that receives questionnaire information for questions in the questionnaire and outputs it as one of oral condition information.

The oral care recommendation unit includes a product type determination unit that determines an oral care product type for one or more oral care products to be provided in response to oral condition information input from the oral condition diagnosis unit; a drug information generation unit that is activated by the oral care product type determined by the product type determination unit and extracts recommended drug information corresponding to the oral condition information by referring to the drug DB of the storage unit; An oral care product information generation unit that is activated by the oral care product type determined by the product type determination unit and extracts recommended oral care product information corresponding to the oral condition information by referring to the oral care product DB of the storage unit; An oral care tool information generation unit that is activated by the oral care product type determined by the product type determination unit and extracts recommended oral care tool information corresponding to the oral condition information by referring to the oral care tool information DB of the storage unit; An oral care food information generation unit that is activated by the oral care product type determined by the product type determination unit and extracts recommended oral care food information corresponding to the oral condition information by referring to the oral care food DB of the storage unit; An expert recommendation information generation unit that is activated by the oral care product type determined by the product type determination unit and extracts recommended oral care expert information corresponding to the oral condition information by referring to the oral care expert DB of the storage unit; And an oral care product type determined by the product type determination unit from any one or more of the drug information generation unit, the oral care product information generation unit, the oral care equipment information generation unit, the oral care food information generation unit, and the expert recommendation information generation unit. It is characterized in that it includes an oral care recommendation information providing unit that receives recommendation information corresponding to the input, generates oral care recommendation information, and displays it through the display unit.

When registering as a member, logging in, and purchasing an oral care product, the control unit sends product management information indicating the time for replacement and repurchase of the purchased oral care product according to the recommended period for each oral care product purchased to the user mobile terminal of the user who is the member. It is characterized in that it further includes an oral care product management unit that transmits.

The method of recommending a personalized oral care product according to the present invention to achieve the above object includes: an oral care event monitoring process in which a control unit monitors whether an oral care event occurs from the oral information input unit through an oral care event monitoring unit; An oral information acquisition process in which the control unit acquires oral information including the oral image from the oral information input unit through an oral information acquisition unit when the oral care event occurs; The control unit analyzes oral information including the oral image obtained through the oral condition diagnosis unit, analyzes the oral image to diagnose the condition of the oral cavity including teeth and gums, and includes the diagnosed teeth and gums. An oral condition diagnosis process that generates oral condition information including condition information about the condition of the oral cavity; And the control unit determines the type of oral care product through the oral care recommendation unit, extracts the oral care product corresponding to the oral condition information from the oral care product of the oral care product type determined by referring to the database, and extracts the extracted oral care product. It is characterized by comprising an oral care recommendation process of generating oral care product recommendation information including oral care product information of the product type and displaying it on the display unit.

The oral information acquisition process includes an oral image acquisition step in which the oral information acquisition unit of the control unit acquires the oral image through a camera of the oral information input unit; and a text oral information acquisition step in which the oral information acquisition unit acquires text oral information in text form through an input/output unit including a display unit and an input unit of the oral information input unit.

In the oral condition diagnosis process, the control unit classifies the presence or absence of dental disease and the type of disease through a dental disease artificial intelligence model learned from dental disease images with multiple dental diseases, detects tooth color, and detects the tooth color. , a tooth analysis step of outputting dental disease status information including whether the tooth is diseased and the type of disease; The control unit classifies gum disease and disease type through a gum disease artificial intelligence model learned from gum disease images with multiple gum diseases, and detects the gum color to determine the gum color, gum disease, and disease type. A gum analysis step of outputting gum disease status information including; And the control unit classifies the tongue disease and disease type through a tongue disease artificial intelligence model learned from tongue disease images with multiple tongue diseases, and the tongue disease status including the classified tongue disease and disease type. It is characterized by comprising an oral image analysis step including a tongue analysis step for outputting information.

The tooth analysis step includes: a tooth color analysis step in which the control unit detects a tooth from the oral image, detects the tooth color of the detected tooth, and outputs the tooth color information as one of oral condition information; The control unit applies the oral image to the dental disease artificial intelligence model to classify the dental disease and disease type of the oral image, and uses dental disease information, including dental disease and disease type, as one of the oral condition information. Dental disease analysis step for output; And the control unit applies the oral image to a dental material classification artificial intelligence model that has learned dental materials and prosthetics based on the oral image in which any one or more of various dental materials and prosthetics are applied to the teeth, and determines the dental materials and prosthetics applied to the teeth. It is characterized by including a dental material analysis step of classifying and outputting the classified dental material and prosthesis classification information as one of the oral condition information.

The oral condition diagnosis process includes a genetic information analysis step in which the control unit detects genetic information from an image containing genetic information acquired through the oral information acquisition unit and the camera and outputs it as one of the oral condition information; And a text information analysis step in which the control unit displays a medical questionnaire through the display unit of the input/output unit, receives questionnaire information for questions in the questionnaire, and outputs it as one of the oral condition information. Characterized by further comprising a text information analysis step. do.

The oral care recommendation process includes a product type determination step in which the control unit determines an oral care product type for one or more oral care products to be provided in response to oral condition information input from the oral condition diagnosis unit through a product type determination unit; A drug information generation step in which the control unit is activated by the oral care product type determined by the product type determination unit through the drug information generation unit, and extracts recommended drug information corresponding to the oral condition information by referring to the drug DB of the storage unit; The control unit is activated by the oral care product type determined by the product type determination unit through the oral care product information generation unit, and extracts recommended oral care product information corresponding to the oral condition information by referring to the oral care product DB of the storage unit. Oral care product information generation step; The control unit is activated by the oral care product type determined by the product type determination unit through the oral care tool information generation unit, and generates recommended oral care tool information corresponding to the oral condition information by referring to the oral care tool information DB of the storage unit. Extracting oral care device information generating step; The control unit is activated by the oral care product type determined by the product type determination unit through the oral care food information generation unit, and extracts recommended oral care food information corresponding to the oral condition information by referring to the oral care food DB of the storage unit. Oral care food information generation step; The control unit is activated by the oral care product type determined by the product type determination unit through the expert recommendation information generation unit, and extracts recommended oral care expert information corresponding to the oral condition information by referring to the oral care expert DB of the storage unit. Expert recommendation information generation step; And the control unit determines the oral cavity determined by the product type determination unit from any one or more of the drug information generation unit, the oral care product information generation unit, the oral care equipment information generation unit, the oral care food information generation unit, and the expert recommendation information generation unit. It is characterized in that it includes a recommended oral care recommendation information generation step of receiving recommendation information corresponding to the type of management product, generating oral care recommendation information, and displaying it through the display unit.

The above method is: When the control department registers as a member, logs in, and purchases an oral care product, product management information is sent to the oral care product management department indicating that it is time to replace and repurchase the oral care product purchased according to the recommended period for each oral care product purchased through the oral care product management department. It is characterized by further comprising an oral care product management process of transmitting to the user mobile terminal of the member user.

The present invention is effective in accurately analyzing the user's oral condition because it analyzes images of the oral cavity including teeth, gums, tongue, etc.

In addition, the present invention acquires not only oral images but also oral information including easy-period information, age, and unique points, so it provides oral care products optimized for the user based on the color and arrangement of the user's teeth and gums, user characteristics, genetic information, etc. There is an effect that can be recommended.

In addition, the present invention analyzes the oral condition and guides the expert if it is determined that help from an expert is needed, so that oral disease can be treated quickly before or in the early stages, which has the effect of performing proactive treatment.

1 is a diagram showing the configuration of a personalized oral care product recommendation system according to the present invention.
Figure 2 is a diagram showing the configuration of the tooth analysis unit of the personalized oral care product recommendation system according to the present invention.
Figure 3 is a diagram for explaining a method of obtaining oral information in a personalized oral care product recommendation system according to an embodiment of the present invention.
Figure 4 is a diagram for explaining an oral condition analysis method and a corresponding oral care product recommendation method in a personalized oral care product recommendation system according to an embodiment of the present invention.
Figure 5 is a diagram for explaining a method of providing recommended products in a personalized oral care product recommendation system according to an embodiment of the present invention.
Figure 6 is a diagram illustrating an application example of a personalized oral care product recommendation system according to an embodiment of the present invention.
Figure 7 is a diagram showing the configuration of a user mobile terminal of a personalized oral care product recommendation system according to an embodiment of the present invention.
Figure 8 is a flow chart showing a method of recommending a personalized oral care product according to the present invention.

Hereinafter, with reference to the attached drawings, the configuration and operation of the personalized oral care product recommendation system according to the present invention will be described in detail, and the oral care product recommendation method in the system will be described.

Figure 1 is a diagram showing the configuration of a personalized oral care product recommendation system according to the present invention, Figure 2 is a diagram showing the configuration of a tooth analysis unit of the personalized oral care product recommendation system according to the present invention, and Figure 3 is a diagram showing the configuration of the personalized oral care product recommendation system according to the present invention. is a diagram illustrating a method of obtaining oral information in a personalized oral care product recommendation system according to an embodiment of the present invention, and Figure 4 is a method of analyzing oral condition in a personalized oral care product recommendation system according to an embodiment of the present invention. and a method for recommending corresponding oral care products, and Figure 5 is a view for explaining a method for providing recommended products in a personalized oral care product recommendation system according to an embodiment of the present invention. Hereinafter, description will be made with reference to FIGS. 1 to 5.

The personalized oral care product recommendation system 100 according to the present invention includes a storage unit 110, a communication unit 120, an oral information input unit 130, and a control unit 140.

The storage unit 110 includes a program area for storing a control program for controlling the overall operation of the personalized oral care product recommendation system 100 according to the present invention, a temporary area for temporarily storing data generated during execution of the control program, It includes a data area that semi-permanently stores data required for executing the control program and data generated during executing the control program. According to the present invention, the data area includes a drug database (DB) 111, an oral care product DB 112, an oral care tool DB 113, an oral care food DB 114, and an oral care expert DB 115. A database (Database: DB) such as an oral care management DB 116 is configured, and a member DB that stores member information, which is information of users who have signed up as members to receive the oral care product recommendation service according to the present invention, is further configured. may be included. The DBs may be configured to be stored on a DB server.

The medicine DB 111 stores medicine information for each oral condition, which is information about at least one medicine corresponding to various oral conditions, and the type of oral care product is medicine. The medicine may be a periodontal disease treatment, an external toothache, an antitussive expectorant, a sterilizing liniment, a medicated throat lozenge, a gargle, a stomatitis treatment, etc. The drug information may include information such as the usage, dosage, and repurchase period (repurchase cycle) according to the dosage and dosage of the drug.

The oral care product DB 112 stores oral care product information for each oral state, which is information about at least one oral care product according to the oral state, and the oral care product type is an oral care product. The oral care products may include toothpaste, mouthwash, mouth freshener, denture detergent, denture stabilizer, oral moisturizer, whitening related products, etc. The oral care product information may include information such as a repurchase cycle of the oral care product.

The oral care product DB 113 stores oral care tool information for each oral condition, which is information on at least one oral care tool according to the oral condition, and the type of oral care product is oral care equipment. The oral care tool may be a toothbrush, electric toothbrush, oral irrigator, dental floss, interdental brush, tongue cleaner, toothpaste sheet, sponge brush, etc. For example, the repurchase period (period of use) of toothbrush A may be 2 months, the repurchase period of toothbrush B may be 3 months, etc.

The oral care food DB 114 stores oral care food information for each oral condition, where the type of oral care product is food, and is information on at least one oral care food according to oral condition. The oral care food may be functional gum, functional candy, oral refreshing snack, oral care supplement, etc.

The oral care expert DB 115 is an expert in the types of oral care products and stores oral care expert information by oral condition, which is information about at least one oral care expert according to oral condition. The expert may be a dentist, etc., and the oral care expert information will include location (hospital location) information of the expert.

The oral care management DB 116 stores oral care management information such as oral care product information, purchase date, and recommended replacement and repurchase period for oral care products provided by users registered as members.

The communication unit 120 is connected either wired or wirelessly to the wired or wireless data communication network 10 of FIG. 5, which will be described later, so that the control unit 140 can perform data communication with other devices connected to the wired or wireless data communication network 10. or connects to other devices in a short distance through either direct wireless communication or wired communication to perform mutual data communication.

The oral information input unit 130 includes a camera 131 and an input/output unit 132, and receives oral information of a user who wishes to receive oral care product recommendations and outputs the input to the control unit 140.

The camera 131 outputs an image of the scene entering the field of view to the control unit 140, and according to the present invention, the control unit 140 uses at least one oral image taken of the oral cavity as shown in 301 of FIG. 2 as oral information. Provided as. Additionally, the camera 131 may provide the control unit 140 with a genetic information image captured by a genetic information document presented by the user.

The input/output unit 132 includes a display unit 133 and an input unit 134.

The display unit 133 displays various information in the form of one or more of text, graphics, still images, and videos.

The input unit 134 is a keyboard that can input a number of functions and characters, displays a cursor on the screen of the display unit 133, moves the position of the cursor, and outputs location information about the position of the moved cursor. When a button provided is clicked, location information of the location where the button is clicked, a mouse that outputs a button signal for the button, and a mouse that outputs a button signal for the button are integrated into the screen of the display unit 133 to provide location information about the location touched on the screen. It includes one or more of the following: a touchpad that outputs output.

The input/output unit 132 displays an oral information input means for acquiring the user's oral information on the display unit 133, and converts text oral information input through the oral information input means and the input unit 134 into oral information. It is output to the control unit 140 as one of. The oral information input means may be provided in the form of a questionnaire containing a number of questions about an oral image taken of the user's oral cavity as indicated at 302 in FIG. 2.

The control unit 140 includes an oral care event monitoring unit 150, an oral information acquisition unit 160, an oral condition diagnosis unit 170, an oral care recommendation unit 180, and an oral care product management unit 190. Controls the overall operation of the personalized oral care product recommendation system 100 according to the invention.

The oral care event monitoring unit 150 monitors whether an oral care event occurs from the oral information input unit 130. The oral care event may occur when an oral care product recommendation request command is input by the oral care product recommendation means provided through the input/output unit 132, and a random user's teeth are selected from the oral image input from the camera 131. This may occur when the containing mouth is detected.

When an oral care event occurs through the oral care event monitoring unit 150, the oral information acquisition unit 160 displays an image oral information input means and 302 such as 301 of FIG. 3 on the display unit 133 of the input/output unit 132. By displaying one or more of the text oral information input means simultaneously or sequentially, oral information including an oral image and text oral information is acquired and provided to the oral condition diagnosis unit 170. As shown in FIG. 3, the oral image oral information input means 301 displays one or more mouth shape patterns for accurately capturing the user's oral state, and is preferably configured to guide the user to match the mouth shape to the mouth shape pattern. something to do.

In addition, the oral information acquisition unit 160 displays an easyperio (genetic information) registration means on the display unit 133 of the input/output unit 132 of the oral information input unit 130, and displays the easyperio (genetic information) registration means of the oral information input unit 130. An image of a genetic information document captured through the camera 131 will be obtained and provided to the genetic information analysis unit 176 of the oral condition diagnosis unit 170.

Additionally, the oral information acquisition unit 160 may receive and acquire genetic information stored in another device, such as the user's mobile terminal, through the communication unit 120. To achieve this, other devices close to the oral care product recommendation system 100 must be connected through the communication unit 120.

The oral state diagnosis unit 170 includes an oral image analysis unit 171 and a text information analysis unit 172, and analyzes the oral information input from the oral information acquisition unit 160 to generate spherical state information. , output to the oral care recommendation unit 180.

The oral image analysis unit 171 includes one or more of the tooth analysis unit 173, the gum analysis unit 174, and the tongue analysis unit 175, and analyzes the oral image included in the oral information to determine the oral cavity based on the image. Prints status information.

Specifically, the tooth analysis unit 173 is equipped with a dental disease artificial intelligence model learned from a plurality of dental disease images with dental disease, and the oral information acquired through the oral information acquisition unit 160 Apply the oral image to the dental disease artificial intelligence model to classify the tooth disease and type of disease, detect the tooth color, and output dental disease status information including the tooth color, tooth disease, and disease type. .

The tooth analysis unit 173 is one of the tooth color analysis unit 191, the dental disease analysis unit 192, the interdental gap analysis unit 193, the tooth arrangement analysis unit 194, and the dental material analysis unit 195. It may include more.

The tooth color analysis unit 191 detects teeth from the oral image, detects the tooth color of the detected tooth, and outputs the tooth color information as one of the oral condition information. The tooth color information may be defined as a level according to the color and saturation of the tooth color (e.g., levels 5, 1, and 2 are levels that do not require whitening, levels 3 to 5 are levels that require whitening, etc.) ) information may be included. For example, in the case of 312 in FIG. 3, the tooth color analysis unit 191 may output tooth color information in yellow, 4 levels of saturation, etc. In the case of the tooth 312 in FIG. 3, the saturation level is 4, so the oral care recommendation unit 180, which will be described later, determines that the tooth 312 requires whitening treatment, and recommends oral care products such as whitening toothpaste. There will be.

The dental disease analysis unit 192 is provided with the dental disease artificial intelligence model learned from images with various dental diseases (cavities, tooth cracks, tooth damage, etc.), and applies the oral image to the dental disease artificial intelligence model. By applying this method, the dental disease and disease type of the teeth in the oral image are classified, and dental disease information including the dental disease and disease type is output as one of the oral condition information.

The interdental gap analysis unit 193 analyzes whether interdental gaps of a certain size or more exist between teeth, as shown at 315 in FIG. 4, and outputs interdental gap information including the presence or absence of interdental gaps as oral state information. The interdental gap information may include information on the size of the interdental gap.

The tooth arrangement analysis unit 194 detects the upper and lower tooth arrangement from the oral cavity image as shown 316 in FIG. 4, analyzes the degree of distortion and tooth size of each upper and lower tooth arrangement, and determines the deviation and size of the tooth arrangement for each upper and lower tooth arrangement. The information is output as one of the oral state information.

The dental material analysis unit 195 is equipped with a dental material classification artificial intelligence model that learns dental materials and prosthetics from oral images showing one or more of various dental materials and prosthetics applied to teeth, as shown in 311 and 313 of FIG. 4, By applying the oral image to the dental material classification artificial intelligence model, dental materials and prosthetics applied to teeth are classified, and the classified dental material and prosthesis classification information is output as one of the oral condition information. For example, when an oral image such as 311 in FIG. 4 is applied to a dental material classification artificial intelligence model, classification information for transparent orthodontic materials will be output as an output.

The gum analysis unit 174 is equipped with a gum disease artificial intelligence model learned from a number of gum disease images with gum disease such as periodontal disease at 314 in FIG. 4, and applies the oral image to the gum disease artificial intelligence model. It classifies gum disease and type of disease, detects gum color, and outputs gum disease status information including gum color, gum disease, and type of disease.

The tongue analysis unit 175 is equipped with a tongue disease artificial intelligence model learned from a plurality of tongue disease images with tongue disease, classifies the tongue disease and type of disease through the tongue disease artificial intelligence model, and classifies the classified Tongue disease status information, including whether the tongue is diseased and the type of disease, is output.

The text information analysis unit 172 includes a genetic information analysis unit 176 and a questionnaire analysis unit 177.

The genetic information analysis unit 176 extracts genetic information from a genetic information document image acquired through the oral information acquisition unit 160 or a received genetic information file and outputs it as oral condition information.

The questionnaire analysis unit 177 receives and analyzes the oral information of the questionnaire text input from the oral information acquisition unit 160 and outputs the questionnaire analysis information according to the user's answers in the questionnaire as oral condition information. For example, if smoking and bad breath are selected in the questionnaire, the questionnaire analysis information including smoking and bad breath is output as oral condition information.

The oral care recommendation unit 180 includes a product type determination unit 181, a drug information generation unit 182, an oral care product information generation unit 183, an oral care tool information generation unit 184, and an oral care food information generation unit. (185), an expert recommendation information generation unit 186, and an oral care recommendation information provision unit 187.

When oral condition information is input from the oral condition diagnosis unit 170, the product type determination unit 181 determines the product type corresponding to the input oral condition information.

For example, if the oral condition information is level 3 with periodontal disease and tooth color yellow, the product type determination unit 181 is a medicine for recommending a medicine for periodontal disease, an expert for recommending a specialist for treating periodontal disease. , oral care products to recommend teeth whitening products according to the 3 levels of tooth color yellow, etc. may be determined as a product type.

The product type determination unit 181 may display a recommended product type selection means on the display unit 133 and determine a product type to be recommended by receiving a selection from the user through the recommended product type selection means.

Additionally, the product type determination unit 181 may display the automatically determined product types through a recommended product type selection means and allow the user to select one or more of the displayed product types to determine the product type to recommend.

The drug information generation unit 182 is activated by the type of oral care product determined by the product type determination unit 181, and makes recommendations in response to the oral condition information by referring to the drug DB 111 of the storage unit 110. Extract recommended drug information for at least one drug to do.

The oral care product information generation unit 183 is activated by the oral care product type determined by the product type determination unit 181, and generates the oral condition information by referring to the oral care product DB 112 of the storage unit 110. In response, recommended oral care product information for at least one oral care product to be recommended is extracted.

The oral care tool information generation unit 184 is activated by the oral care product type determined by the product type determination unit 181, and refers to the oral care tool information DB 113 of the storage unit 110 to determine the oral condition. Recommended oral care tool information for at least one oral care tool to be recommended is extracted in response to the information.

The oral care food information generation unit 185 is activated by the oral care product type determined by the product type determination unit 181, and refers to the oral care food DB 114 of the storage unit 110 to provide the oral condition information. In response, recommended component care food information for at least one recommended oral care food to be recommended is extracted.

The expert recommendation information generation unit 186 is activated by the oral care product type determined by the product type determination unit 181, and provides the oral condition information by referring to the oral care expert DB 115 of the storage unit 110. In response, recommended oral care expert information about the expert to be recommended is extracted.

The oral care recommendation information providing unit 187 includes the drug information generating unit 182, the oral care product information generating unit 183, the oral care tool information generating unit 184, the oral care food information generating unit 185, and the expert. Recommendation information corresponding to the oral care product type determined by the product type determination unit 181 is input from one or more of the recommendation information generation units 186, and oral care recommendation information is generated as shown at 241 in FIG. 5 and displayed. It is displayed through unit 133.

The oral care recommendation information providing unit 187 may add other oral care products related to the recommended oral care product as shown at 242 in FIG. 5 and display them on the display unit 133.

When the oral care product management department (190) registers as a member, logs in, and purchases an oral care product, the oral care product information and purchase date purchased for each user are stored in the oral care management DB (116), and recommendations are made for each purchased oral care product. Product management information indicating that it is time to replace and repurchase oral care products purchased for each period is transmitted to the user mobile terminal registered by the member user. For this purpose, information on the replacement cycle and repurchase cycle for oral care products registered in the medicine DB (111), oral care product DB (112), oral care tool DB (113), and oral care food DB (114) is provided. It must be defined.

Figure 6 is a diagram for explaining an application example of a personalized oral care product recommendation system according to an embodiment of the present invention, and Figure 7 is a diagram of a user mobile terminal of a personalized oral care product recommendation system according to an embodiment of the present invention. This is a drawing showing the composition. Hereinafter, it will be described with reference to FIGS. 6 and 7.

The personalized oral care product recommendation system 100 of the present invention may be configured in the form of a terminal 200, which is a single device such as a mobile terminal 210 or a kiosk 220, and may include the terminal 200 and an oral care product recommendation server. It may be configured in the form (300).

Figure 6 shows a case configured in the form of a plurality of terminals 200 and an oral care product recommendation server 300. The oral information input unit 130 of the personalized oral care product recommendation system 100 is a mobile terminal 210 or It may be configured in the kiosk 220, and the storage unit 110 and control unit 140 will be configured in the oral care product recommendation server 300.

One or more of the oral information input unit 200 and the oral care product recommendation server 300 are connected to the wired or wireless data communication network 10 either wirelessly or wirelessly to perform mutual data communication.

The terminal 200 includes a terminal storage unit 201, a terminal communication unit 202, a camera 203, an input/output unit 204, and a terminal control unit 205, as shown in FIG. 7, to obtain oral information from the user. It will be transmitted to the oral care product recommendation server 300.

Specifically, the terminal storage unit 201 includes a program area for storing a control program for controlling the overall operation of the terminal 200 according to the present invention, and a temporary area for temporarily storing data generated during execution of the control program. , and a data area that semi-permanently stores data necessary for executing the control program and data generated during executing the control program.

The terminal communication unit 202 is connected to the wired or wireless data communication network 10 either wired or wirelessly, so that the terminal control unit 205 can perform mutual data communication with the oral care product recommendation server 300.

The camera 203 and the input/output unit 204 perform the same operation as the oral information input unit 130, but output the acquired oral information to the terminal control unit 205.

The terminal control unit 205 controls the overall operation of the terminal 200 according to an embodiment of the present invention.

Specifically, when running the control program, the terminal control unit 205 is connected to the oral care product recommendation server 300 through the terminal communication unit 202 and displays an oral information input means through the display unit 211.

When an oral care event occurs through any one of the camera 203 and the input/output unit 204 and the oral information input means, the terminal control unit 205 communicates with the terminal communication unit 202, the camera 203, the input/output unit 204, and the above. Oral information is acquired through an oral information input means, and the acquired oral information is transmitted to the oral care product recommendation server 300 through the terminal communication unit 202.

The terminal control unit 205 receives oral care recommendation information from the oral care product recommendation server 300 in response to the transmitted oral information and displays it on the display unit 211.

Figure 8 is a flowchart showing a method of recommending a personalized oral care product according to the present invention, which is explained with reference to Figures 1 and 8.

First, the control unit 140 monitors whether an oral care event occurs from the oral information input unit 130 (S111).

When an oral care event occurs, the control unit 140 requests input of oral information through the display unit 133 (S113).

After requesting the input of the oral information, the control unit 140 checks whether the oral information is obtained through the oral information input means provided through the oral information input unit 130 (S115).

When oral information is acquired, the control unit 140 determines whether the acquired oral information includes both oral image and text information, only oral image, or only text information (S117, S119).

If both oral image and text information are included, the control unit 140 separates the oral image and text information (S121), then applies and analyzes the oral image to the oral image analysis unit 171 and analyzes the oral image and text information analysis unit 172. ), and if it contains only oral images, only the oral images are applied to the oral image analysis unit 171 for analysis, and if it contains only text information, only the text information is analyzed by the text information analysis unit 172. ) is applied to perform the analysis.

When the analysis is completed, the control unit 140 generates oral condition information according to the analysis (S129) and determines the type of oral care product to recommend in response to the generated oral condition information (S131). A DB defining the types of oral care products to be recommended for each oral condition information may be separately configured, but the pre-configured medicine DB (111), oral care supplies DB (112), oral care equipment DB (113), and oral care food DB ( 114), the type may be determined by referring to the oral condition information of the oral care expert DB (115).

When the type of oral care product to be recommended is determined, the control unit 140 extracts the oral care product corresponding to the oral condition information among the products of the determined oral care product type (S133), and provides oral care product information for the extracted oral care products. Generate oral care recommendation information including (S135).

The generated oral care recommendation information is displayed through the display unit 133 of the oral information input unit 130 (S137).

Meanwhile, it is common knowledge in the technical field that the present invention is not limited to the above-described typical preferred embodiments, but can be implemented by various improvements, changes, substitutions, or additions without departing from the gist of the present invention. Anyone who has will be able to understand it easily. If the implementation by such improvement, change, replacement or addition falls within the scope of the appended patent claims below, the technical idea thereof should also be regarded as belonging to the present invention.

10: Wired and wireless data communication network
100: Personalized oral care product recommendation system
110: Storage unit 111: Medicine DB
112: Oral care equipment DB 113: Oral care equipment DB
114: Oral care food DB 115: Oral care expert DB
116: Oral Care Management DB 120: Department of Communications
130: Oral information input unit 131: Camera
132: input/output unit 133: display unit
134: input unit 140: control unit
150: Oral care event monitoring unit 160: Oral information acquisition unit
170: Oral condition diagnosis unit 171: Oral image analysis unit
172: Text information analysis unit 173: Tooth analysis unit
174: Gum analysis unit 175: Tongue analysis unit
176: Genetic information analysis department 177: Questionnaire analysis department
180: Oral care recommendation unit 181: Product type determination unit
182: Drug information generation unit 183: Oral care product information generation unit
184: Oral care equipment information generation unit 185: Oral care food information generation unit
186: Expert recommendation information generation unit 187: Oral care recommendation information provision unit
190: Oral care product management department 191: Tooth color analysis department
192: Dental disease analysis unit 193: Interdental gap analysis unit
194: Tooth arrangement analysis unit 195: Dental material analysis unit
200: terminal 210: mobile terminal
220: Kiosk 300: Oral care product recommendation server

Claims (16)

A storage unit including a database defining oral care product types by oral condition and oral care product types by oral care product type;
An oral information input unit including a display unit and a camera, which receives and outputs oral information including an oral image taken of the user's oral cavity through the camera; and
The oral condition is analyzed by analyzing the oral information acquired through the oral information input unit, and oral condition information containing information about the condition of the oral cavity including teeth and gums according to the oral image is generated, and an oral care product is generated. Determine the type, extract oral care products corresponding to the oral condition information from oral care products of the oral care product type determined by referring to the database, and oral care products including oral care products of the extracted oral care product type. A personalized oral care product recommendation system comprising a control unit that generates recommendation information and displays it on the display unit.
According to paragraph 1,
The storage unit,
The oral care product type is a medicine, and a medicine DB that stores medicine information by oral condition, which is information about at least one medicine according to the oral condition;
The oral care product type is an oral care product, and an oral care product DB that stores oral care product information for each oral state, which is information about at least one oral care product according to the oral state;
The oral care product type is an oral care tool, and an oral care tool DB that stores oral care tool information for each oral condition, which is information about at least one oral care tool according to the oral condition.
An oral care food DB that stores oral care food information by oral condition, where the oral care product type is food, and is information about at least one oral care food according to oral condition; and
Personalized service, characterized in that the oral care product type is an expert and includes at least one of the oral care expert databases that store oral care expert information by oral condition, which is information about at least one oral care expert according to oral condition. Oral care product recommendation system.
According to paragraph 1,
The oral information input unit,
a camera that outputs an image captured by a scene entering the angle of view of the lens to the control unit; and
A personalized customization device comprising a display unit that displays various information in the form of one or more of text, graphics, still images, and images, and an input unit that selects and inputs functions and information in conjunction with the display unit. Oral care product recommendation system.
According to paragraph 3,
The control unit,
An oral care event monitoring unit that monitors whether an oral care event occurs through the oral information input unit;
An oral information acquisition unit that acquires oral information including the oral image through the oral information input unit when the oral care event occurs;
Analyzing oral information including the acquired oral image, diagnosing the condition of the oral cavity including teeth and gums by analyzing the oral image, and oral status information including status information of the diagnosed teeth, gums, and tongue Oral condition diagnosis unit that generates; and
Determine the type of oral care product of the oral condition corresponding to the oral condition information generated by referring to the database, extract the oral care product of the determined oral care product type, and extract the oral care product information of the extracted oral care product type. A personalized oral care product recommendation system comprising an oral care recommendation unit that generates oral care product recommendation information and displays it on the display unit.
According to paragraph 4,
The oral condition diagnosis unit,
Equipped with a dental disease artificial intelligence model learned from a plurality of dental disease images, and applying the oral image of the oral information to the dental disease artificial intelligence model to classify the presence or absence of dental disease and the type of dental disease. A tooth analysis unit that detects color and outputs dental disease status information including the tooth color, whether the tooth is diseased, and the type of disease;
Equipped with a gum disease artificial intelligence model learned from multiple gum disease images with gum disease, and applying the oral images to the gum disease artificial intelligence model to classify whether gum disease is present and the type of disease, and to detect gum color A gum analysis unit that outputs gum disease status information including the gum color, gum disease, and disease type; and
Equipped with a tongue disease artificial intelligence model learned from a plurality of tongue disease images, and applying the oral images to the tongue disease artificial intelligence model to classify the tongue disease and the type of disease, and the classified tongue disease A personalized oral care product recommendation system comprising an oral image analysis unit including a tongue analysis unit that outputs tongue disease status information including the presence and type of disease.
According to clause 5,
The tooth analysis unit,
a tooth color analysis unit that detects teeth from the oral image, detects the tooth color of the detected tooth, and outputs the tooth color information as one of oral condition information;
The dental disease artificial intelligence model is provided, and the oral image is applied to the dental disease artificial intelligence model to classify the dental disease and disease type of the teeth in the oral image, and dental disease information including the dental disease and disease type. A dental disease analysis unit that outputs as one of oral condition information; and
Equipped with a dental material classification artificial intelligence model that learns dental materials and prosthetics from oral images in which one or more of various dental materials and prosthetics are applied to teeth, and applying the oral image to the dental material classification artificial intelligence model, A personalized oral care product recommendation system comprising a dental material analysis unit that classifies dental materials and prosthetics applied to and outputs the classified dental material and prosthesis classification information as one of oral condition information.
According to clause 5,
The oral condition diagnosis unit,
A genetic information analysis unit that detects genetic information from a document image containing genetic information acquired through the oral information acquisition unit and the camera and outputs it as one of the oral condition information; and
Personalized oral care, characterized in that it further comprises a text information analysis unit that displays a medical questionnaire through a display unit of the input and output unit, and includes a medical questionnaire analysis unit that receives questionnaire information for questions in the questionnaire and outputs it as one of the oral condition information. Product recommendation system.
According to paragraph 4,
The oral care recommendation section,
a product type determination unit that determines the type of oral care product for one or more oral care products to be provided in response to the oral condition information input from the oral condition diagnosis unit;
a drug information generation unit that is activated by the oral care product type determined by the product type determination unit and extracts recommended drug information corresponding to the oral condition information by referring to the drug DB of the storage unit;
An oral care product information generation unit that is activated by the oral care product type determined by the product type determination unit and extracts recommended oral care product information corresponding to the oral condition information by referring to the oral care product DB of the storage unit;
An oral care tool information generation unit that is activated by the oral care product type determined by the product type determination unit and extracts recommended oral care tool information corresponding to the oral condition information by referring to the oral care tool information DB of the storage unit;
An oral care food information generation unit that is activated by the oral care product type determined by the product type determination unit and extracts recommended oral care food information corresponding to the oral condition information by referring to the oral care food DB of the storage unit;
An expert recommendation information generation unit that is activated by the oral care product type determined by the product type determination unit and extracts recommended oral care expert information corresponding to the oral condition information by referring to the oral care expert DB of the storage unit; and
From any one or more of the drug information generation unit, oral care product information generation unit, oral care equipment information generation unit, oral care food information generation unit, and expert recommendation information generation unit to the oral care product type determined by the product type determination unit. A personalized oral care product recommendation system comprising an oral care recommendation information providing unit that receives corresponding recommendation information, generates oral care recommendation information, and displays it through the display unit.
According to paragraph 4,
The control unit,
When you register as a member, log in, and purchase an oral care product, oral care information is sent to the member's user mobile terminal informing you that it is time to replace and repurchase the purchased oral care product according to the recommended period for each oral care product purchased. A personalized oral care product recommendation system further comprising a product management unit.
An oral care event monitoring process in which the control unit monitors whether an oral care event occurs from the oral information input unit through an oral care event monitoring unit;
An oral information acquisition process in which the control unit acquires oral information including the oral image from the oral information input unit through an oral information acquisition unit when the oral care event occurs;
The control unit analyzes oral information including the oral image obtained through the oral condition diagnosis unit, analyzes the oral image to diagnose the condition of the oral cavity including teeth and gums, and includes the diagnosed teeth and gums. An oral condition diagnosis process that generates oral condition information including condition information about the condition of the oral cavity; and
The control unit determines the type of oral care product through the oral care recommendation unit, extracts the oral care product corresponding to the oral condition information among the oral care products of the oral care product type determined by referring to the database, and extracts the extracted oral care product. A personalized oral care product recommendation method comprising an oral care recommendation process of generating oral care product recommendation information including types of oral care product information and displaying the oral care product recommendation information on the display unit.
According to clause 10,
The oral information acquisition process is,
An oral image acquisition step in which the oral information acquisition unit of the control unit acquires the oral image through a camera of the oral information input unit; and
A method of recommending a personalized oral care product, characterized in that the oral information acquisition unit acquires text oral information in text form through an input/output unit including a display unit of the oral information input unit and an input unit.
According to clause 11,
The oral condition diagnosis process is,
The control unit classifies dental disease and disease type through a dental disease artificial intelligence model learned from dental disease images with multiple dental diseases, detects tooth color, and detects the tooth color, dental disease, and disease. A tooth analysis step of outputting dental disease status information including the type;
The control unit classifies gum disease and disease type through a gum disease artificial intelligence model learned from gum disease images with multiple gum diseases, and detects the gum color to determine the gum color, gum disease, and disease type. A gum analysis step of outputting gum disease status information including; and
The control unit classifies the tongue disease and disease type through a tongue disease artificial intelligence model learned from tongue disease images with multiple tongue diseases, and tongue disease status information including the classified tongue disease and disease type. A method of recommending a personalized oral care product, comprising an oral image analysis step including a tongue analysis step of outputting.
According to clause 12,
The tooth analysis step is,
A tooth color analysis step in which the control unit detects teeth from the oral image, detects the tooth color of the detected tooth, and outputs the tooth color information as one of oral condition information;
The control unit applies the oral image to the dental disease artificial intelligence model to classify the dental disease and disease type of the oral image, and uses dental disease information, including dental disease and disease type, as one of the oral condition information. Dental disease analysis step for output; and
The control unit classifies dental materials and prosthetics applied to teeth by applying the oral images to a dental material classification artificial intelligence model that learns dental materials and prosthetics from images of the oral cavity in which one or more of various dental materials and prosthetics are applied to teeth. A method of recommending a personalized oral care product, comprising a dental material analysis step of outputting classified dental materials and prosthesis classification information as one of oral condition information.
According to clause 12,
The oral condition diagnosis process is,
A genetic information analysis step in which the control unit detects genetic information from an image containing genetic information acquired through the oral information acquisition unit and the camera and outputs it as one of oral condition information; and
The control unit displays a medical questionnaire through the display unit of the input/output unit, and the text information analysis step includes a medical questionnaire analysis step in which the control unit receives questionnaire information for questions in the questionnaire and outputs it as one of the oral condition information. Characterized in that it further comprises a text information analysis step. How to recommend personalized oral care products.
According to clause 10,
The oral care recommendation process is,
A product type determination step in which the control unit determines an oral care product type for one or more oral care products to be provided in response to oral condition information input from the oral condition diagnosis unit through a product type determination unit;
A drug information generation step in which the control unit is activated by the oral care product type determined by the product type determination unit through the drug information generation unit, and extracts recommended drug information corresponding to the oral condition information by referring to the drug DB of the storage unit;
The control unit is activated by the oral care product type determined by the product type determination unit through the oral care product information generation unit, and extracts recommended oral care product information corresponding to the oral condition information by referring to the oral care product DB of the storage unit. Oral care product information generation step;
The control unit is activated by the oral care product type determined by the product type determination unit through the oral care tool information generation unit, and generates recommended oral care tool information corresponding to the oral condition information by referring to the oral care tool information DB of the storage unit. Extracting oral care device information generating step;
The control unit is activated by the oral care product type determined by the product type determination unit through the oral care food information generation unit, and extracts recommended oral care food information corresponding to the oral condition information by referring to the oral care food DB of the storage unit. Oral care food information generation step;
The control unit is activated by the oral care product type determined by the product type determination unit through the expert recommendation information generation unit, and extracts recommended oral care expert information corresponding to the oral condition information by referring to the oral care expert DB of the storage unit. Expert recommendation information generation step; and
Oral care determined by the product type determination unit from one or more of the drug information generation unit, oral care product information generation unit, oral care tool information generation unit, oral care food information generation unit, and expert recommendation information generation unit, wherein the control unit A method of recommending a personalized oral care product comprising a step of generating recommended oral care recommendation information by receiving recommendation information corresponding to a product type, generating oral care recommendation information, and displaying the recommended oral care information through the display unit.
According to clause 10,
When the control department registers as a member, logs in, and purchases an oral care product, the user who is the member receives product management information indicating that it is time to replace and repurchase the oral care product purchased according to the recommended period for each oral care product purchased through the oral care product management department. A method of recommending a personalized oral care product, further comprising an oral care product management process transmitted to the user's mobile terminal.