TWI775565B - Interactive augmented reality oral care training system - Google Patents

Abstract

The interactive augmented reality oral care training system of the present invention includes: a handheld positioning part, including a tooth cleaning part, the tooth cleaning part is provided with a force sensor; a positioning plate, including a bracket, the bracket connected to a tooth model; an image tracking and capturing unit obtaining the plural relative position data of the cleaning tooth part and the tooth model; a server pre-storing a cleaning tooth standard data and a tartar distribution data, and obtaining the relative position data and plural cleaning tooth stress data is converted into plural cleaning tooth data, and the cleaning tooth data compared with the cleaning tooth standard data and the tartar distribution data respectively to generate a cleaning tooth score and a tartar removal image; and a display unit displaying the actual image of the tooth model and the cleaning tooth part and the virtual image of the cleaning tooth score and the tartar removal image.

Description

Interactive Augmented Reality Oral Care Training System

The present invention relates to an oral care training system, in particular to an interactive augmented reality oral care training system.

The concept of oral hygiene and care needs to be cultivated from an early age. The general public, young children, the elderly and the disabled have great demands for oral hygiene and care. Poor oral hygiene often leads to bad breath, periodontal disease, tooth decay, and even aspiration pneumonia. Therefore, it is very important to develop good oral hygiene and care habits for health. The most important part of oral cleaning and care is to properly clean the teeth, so that the tartar, plaque on the tooth surface, or the vegetable residue between the teeth can be fully removed and cleaned.

In view of the above-mentioned needs of the prior art, the inventor of the present case provides an interactive augmented reality oral care training system, which enables oral cleaning and care to change from the clinical education of professional dentists to the concept of home health care for the general public, so that everyone can Develop good habits of proper oral hygiene and care.

The main purpose of the present invention is to provide an interactive augmented reality oral care training system, which uses a solid dental model as operation training, and displays the dental model and the cleaning part (such as toothbrush, interdental brush and sponge stick) by displaying the dental model. The actual image and the virtual image corresponding to the cleaning score and the tartar removal image are displayed, so as to correctly train the skills of oral cleaning and care.

Another object of the present invention is to provide an interactive augmented reality oral care training system, which can score the strength, angle and cleanliness of teeth from the built-in scoring system, so as to train correct teeth cleaning skills.

The present invention provides an interactive augmented reality oral care training system, comprising: a handheld positioning part, a positioning board, an image tracking capture unit, a server and a display unit. The hand-held positioning portion includes a cleaning portion and a plurality of first positioning marks, the cleaning portion is arranged at the front end of the hand-held positioning portion, and a force sensor is arranged in the cleaning portion. The positioning plate includes a plurality of second positioning marks and a bracket, the bracket is connected to a tooth model, so that the positioning plate is fixed within the detection range. The image tracking capture unit is used for obtaining a plurality of first positioning signals of the first positioning marks, obtaining a plurality of second positioning signals of the second positioning marks, and obtaining the image data of the tooth model and the cleaning part, According to the image data of the tooth model and the tooth model, as well as the first positioning signals and the second positioning signals, a plurality of relative position data between the tooth model and the tooth model are obtained. A memory unit is arranged in the server for pre-storing a scale standard data and a tartar distribution data of the tooth model, and a processing unit of the server obtains the relative position data from the signal connection of the image tracking capture unit and obtaining a plurality of cleaning stress data from the signal connection of the force sensor, converting the relative position data and the cleaning stress data into a plurality of cleaning data, and performing the cleaning through an analysis unit of the server The data are respectively compared and analyzed with the cleaning standard data and the tartar distribution data, thereby generating a cleaning score and a tartar removal image. The display unit can display the actual image of the tooth model and the cleaning part and the virtual image corresponding to the cleaning score and the tartar removal image.

The interactive augmented reality oral care training system of the present invention, wherein the first positioning signals are a plurality of first tracking signals emitted by the first positioning markers of the handheld positioning part, and the second positioning signals are the positioning A plurality of second tracking signals emitted by the second positioning marks of the board; or the first positioning signals are a plurality of first positioning marks transmitted by the image tracking capture unit to the first positioning marks and reflected by the first positioning marks The first tracking signal and the second positioning signals are a plurality of second tracking signals transmitted by the image tracking capturing unit to the second positioning marks and reflected by the second positioning marks.

The interactive augmented reality oral care training system of the present invention, wherein the analysis unit of the server further generates a cleaning error data according to the difference between the cleaning data and the cleaning standard data, and the image tracking capture unit receives The tooth cleaning error data makes at least one indicator light device directly illuminate the correct tooth cleaning position, thereby guiding a user to correct tooth cleaning.

The interactive augmented reality oral care training system of the present invention, wherein the analysis unit of the server generates the dental cleaning score or the dental cleaning error data according to the difference between the dental cleaning data and the dental cleaning standard data; or The analyzing unit of the server performs path comparison according to the cleaning data and the cleaning standard data, and converts the difference into the cleaning score or the cleaning error data.

The interactive augmented reality oral care training system of the present invention, wherein the analysis unit of the server further has a built-in scoring module, after comparing and analyzing the cleaning data with the pre-stored cleaning standard data, The correctness of the steps of the cleaning method, the force, angle and cleanliness of the teeth were scored.

The interactive augmented reality oral care training system of the present invention, wherein the cleaning standard data stored in the server includes a cleaning standard teaching image, which is displayed on the display unit, thereby guiding a user to correct teeth cleaning.

The interactive augmented reality oral care training system of the present invention, wherein the standard teaching image for cleaning teeth is a shell brushing course, an interdental brushing course or a sponge brushing course.

The interactive augmented reality oral care training system of the present invention, wherein the cleaning part is a toothbrush, an interdental brush or a sponge brush.

The interactive augmented reality oral care training system of the present invention, wherein the plaque removal image includes a plaque removal image or a food residue removal image.

The interactive augmented reality oral care training system of the present invention, wherein the memory unit of the server further builds a data function module, the data function module includes a 3D model of a toothbrush, a 3D model of an interdental brush, and a 3D sponge brush Model, a whole upper jaw model, a lower jaw whole tooth model, a food residue marking color block, a detection function of the inner brushing method of anterior teeth, a detection function of the angle between the teeth and the gums, a detection function of the brushing force, a detection function of the brushing force The cleanliness of brushing, the correctness of one brushing force, the correctness of the position of the toothbrush, the correctness of the front toothbrush method, the correction function of the upper chin mold, the correction function of the lower jaw mold, the brushing prompt of the one-beam brushing method, and the brushing of the teeth. Sequence diagram, one interdental brushing course, one interdental brushing correctness of left brushing method, one interdental brushing right brushing method correctness, one sponge brushing course and one sponge brushing scoring item.

Please refer to FIG. 1 and FIG. 2 , the present invention provides an interactive augmented reality oral care training system 1 , comprising: a handheld positioning unit 20 , a positioning board 30 , an image tracking capture unit 40 , a server 50 and A display unit 60 .

The handheld positioning portion 20 is used for a user to hold. The handheld positioning portion 20 includes a cleaning portion 201 and a plurality of first positioning marks 202. The cleaning portion 201 is disposed at the front end of the handheld positioning portion 20, and a force sensor 203 is arranged in the cleaning portion 201. The force The sensor 203 is used for sensing the stress that the cleaning portion 201 bears when cleaning the oral cavity, that is, the force exerted by the cleaning portion 201 on the teeth during operation.

The positioning plate 30 includes a plurality of second positioning marks 301 and a bracket 302, the bracket 302 is connected to a tooth model 10, the tooth model 10 is set at the mouth of the human head model H, and includes a tooth model body 103, an upper The jaw mold 101 and the lower jaw mold 102 make the positioning plate 30 fixed within the detection range (within the detection range of the image tracking capture unit 40 ).

The image tracking and capturing unit 40 is used for obtaining a plurality of first positioning signals of the first positioning marks 202, obtaining a plurality of second positioning signals of the second positioning marks 301, and obtaining the tooth model 10 and the cleaning part The image data of 201, according to the image data of the dental model 10 and the dental cleaning part 201, and the first positioning signals and the second positioning signals, to obtain the complex relative position data between the dental cleaning part 201 and the dental model 10 .

A memory unit 501 in the server 50 pre-stores a cleaning standard data and a tartar distribution data of the tooth model 10 , and a processing unit 502 of the server 50 obtains these data from the signal connection of the image tracking capture unit 40 The relative position data and the signal connection from the force sensor 203 obtain complex cleaning stress data, convert the relative position data and the cleaning stress data into complex cleaning data, and then perform an analysis by the server 50 The unit 503 compares and analyzes the cleaning data with the cleaning standard data and the tartar distribution data respectively, thereby generating a cleaning score and a tartar removal image; and a display unit 60 displaying the tooth model 10 and the tartar removal image. The actual image of the cleaning part 201 and the virtual image corresponding to the cleaning score and the tartar removal image are displayed, so as to achieve the purpose of correct cleaning of teeth, that is, to achieve the purpose of correctly training oral cleaning and care.

The first positioning signals are a plurality of first tracking signals emitted by the first positioning marks 202 of the handheld positioning portion 20 , and the second positioning signals are emitted by the second positioning marks 301 of the positioning plate 30 a plurality of second tracking signals; or the first positioning signals are a plurality of first tracking signals transmitted by the image tracking capture unit 40 to the first positioning marks 202 and reflected by the first positioning marks 202, and the The second positioning signals are a plurality of second tracking signals transmitted by the image tracking capturing unit 40 to the second positioning marks 301 and reflected by the second positioning marks 301 .

The analyzing unit 503 of the server 50 further generates a cleaning error data according to the difference between the cleaning data and the cleaning standard data, and the image tracking capturing unit 40 receives the cleaning error data, so that at least An indicator light device 41 directly illuminates the correct teeth cleaning position, thereby guiding a user to correct teeth cleaning. In addition, the analysis unit 503 of the server generates the cleaning score or the cleaning error data according to the difference between the cleaning data and the cleaning standard data; or the analysis unit 503 of the server generates the cleaning score or the cleaning error data according to the The cleaning data is compared with the cleaning standard data, and the difference is converted into the cleaning score or the cleaning error data.

Furthermore, the analysis unit 503 of the server 50 has a built-in scoring module, which compares and analyzes the cleaning data with the pre-stored cleaning standard data, and evaluates the correctness of the cleaning method steps, the cleaning method and the cleaning method. The strength, angle and cleanliness of the teeth are scored to train the correct cleaning skills.

The cleaning standard data stored in the server 50 includes a cleaning standard teaching image, which is displayed on the display unit 60 to guide a user to clean his teeth correctly. Interval brushing sessions or sponge brushing sessions. In addition, the cleaning part 201 is a toothbrush, an interdental brush or a sponge brush, and the tartar removal image includes a plaque removal image or a food residue removal image.

Furthermore, the memory unit 501 of the server 50 further builds a data function module, and the data function module includes a 3D model of a toothbrush, a 3D model of an interdental brush, a 3D model of a sponge brush, a model of the upper jaw and full teeth, One chin model, one food residue marking color block, one front tooth brushing detection function, one tooth and gum junction angle detection function, one brushing force detection function, one brushing cleanliness, one brushing force accuracy , The correctness of the position of the toothbrush, the correctness of the front toothbrush method, the upper chin mold correction function, the lower chin mold correction function, the brushing tips of the shell-style brushing method, the brushing sequence diagram, the interdental brushing course, The accuracy of the left brushing method of an interdental brush, the correctness of the right brushing method of an interdental brush, a sponge brush course and a sponge brush scoring item, in order to facilitate the interactive augmented reality oral care training system of the present invention and user interactive training , extract the above data and functions to meet the needs of users.

To sum up, the interactive augmented reality oral care training system of the present invention uses a solid dental model as the operation training, and displays the relationship between the tooth model and the cleaning part (such as a toothbrush, interdental brush and sponge stick). The actual image and the virtual image corresponding to the cleaning score and the tartar removal image can be used to correctly train the oral cleaning and care skills, and the built-in scoring system can be used to score the cleaning strength, angle and tooth cleanliness. , in order to train the skills of proper cleaning.

Although the present invention has been disclosed above by the embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, The protection scope of the present invention shall be determined by the scope of the appended patent application.

1: Interactive Augmented Reality Oral Care Training System

10: Teeth Model

101: Upper jaw mold

102: Lower jaw tooth mold

103: Tooth model body

20: Hand-held positioning part

201: dental cleaning department

202: The first positioning mark

203: Force Sensor

30: Positioning plate

301: Second positioning mark

302: Bracket

40: Image tracking capture unit

41: Indicator light device

50: Server

501: Memory Unit

502: Processing unit

503: Analysis Unit

60: Display unit

H: Human head model

FIG. 1 is a three-dimensional schematic diagram of the interactive augmented reality oral care training system of the present invention.

2 is a schematic diagram of a unit of the interactive augmented reality oral care training system of the present invention.

1: Interactive Augmented Reality Oral Care Training System

10: Teeth Model

101: Upper jaw mold

102: Lower jaw tooth mold

103: Tooth model body

20: Hand-held positioning part

201: dental cleaning department

202: The first positioning mark

203: Force Sensor

30: Positioning plate

301: Second positioning mark

302: Bracket

40: Image tracking capture unit

41: Indicator light device

50: Server

60: Display unit

H: Human head model

Claims (10)

An interactive augmented reality oral care training system, comprising: a handheld positioning part, including a teeth cleaning part and a plurality of first positioning marks, the teeth cleaning part is arranged at the front end of the handheld positioning part, and inside the teeth cleaning part A force sensor is provided; a positioning plate includes a plurality of second positioning marks and a bracket, the bracket is connected to a tooth model, so that the positioning plate is fixed within the detection range; an image tracking capture unit obtains Plural first positioning signals of the first positioning marks, and obtaining a plurality of second positioning signals of the second positioning marks, and obtaining the image data of the tooth model and the cleaning part, according to the tooth model and the cleaning the image data of the part and the first positioning signals and the second positioning signals to obtain the relative position data between the cleaning part and the tooth model; a server, a memory unit of which pre-stores a cleaning part of the tooth model Tooth standard data and a tartar distribution data, and a processing unit of the server obtains the relative position data from the signal connection of the image tracking capture unit and obtains a plurality of cleaning stress data from the signal connection of the force sensor, and uses The relative position data and the scaling stress data are converted into complex scaling data, and an analysis unit of the server compares and analyzes the scaling data with the scaling standard data and tartar distribution data. This generates a cleaning score and a tartar removal image; and a display unit that displays the actual image of the tooth model and the cleaning part and a virtual image corresponding to the tooth cleaning score and the tartar removal image. The interactive augmented reality oral care training system as described in claim 1, wherein the first positioning signals are a plurality of first tracking signals emitted by the first positioning markers of the handheld positioning portion, and the The second positioning signals are a plurality of second tracking signals emitted by the second positioning marks of the positioning plate; or the first positioning signals are transmitted to the first positioning marks by the image tracking capture unit and are transmitted by the first positioning mark A plurality of first tracking signals reflected by the first positioning marks, and the second positioning signals are a plurality of second tracking signals transmitted by the image tracking capture unit to the second positioning marks and reflected by the second positioning marks . The interactive augmented reality oral care training system as described in claim 1, wherein the analyzing unit of the server further generates a cleaning error data according to the difference between the cleaning data and the standard cleaning data , the image tracking and capturing unit receives the cleaning error data, so that at least one indicator light device on it directly illuminates the correct cleaning position, thereby guiding a user to clean the teeth correctly. The interactive augmented reality oral care training system as described in item 3 of the claimed scope, wherein the analysis unit of the server generates the cleaning score or the dental cleaning error data; or the analysis unit of the server performs path comparison according to the dental cleaning data and the dental cleaning standard data, and converts the difference into the dental cleaning score or the dental cleaning error data. The interactive augmented reality oral care training system as described in item 1 of the scope of application, wherein the analysis unit of the server further has a built-in scoring module for comparing the cleaning data with the pre-stored cleaning standards After comparative analysis of the data, the correctness of the steps of the cleaning method, the strength, angle and cleanliness of the cleaning method were scored. The interactive augmented reality oral care training system as described in claim 1, wherein the cleaning standard data stored in the server includes a cleaning standard teaching image, which is displayed on the display unit, thereby guiding a The user cleans their teeth correctly. The interactive augmented reality oral care training system as described in item 6 of the patent application scope, wherein the standard teaching image for cleaning teeth is a shell brushing course, an interdental brushing course or a sponge brushing course. The interactive augmented reality oral care training system as described in item 1 of the patent application scope, wherein the tooth cleaning part is a toothbrush, an interdental brush or a sponge brush. The interactive augmented reality oral care training system as described in item 1 of the patent application scope, wherein the tartar removal image includes a dental plaque removal image or a food residue removal image. The interactive augmented reality oral care training system as described in claim 1, wherein the memory unit of the server further has a built-in data function module, and the data function module includes a 3D model of a toothbrush, an interdental model Brush 3D model, a sponge brush 3D model, a full upper jaw model, a lower jaw full tooth model, a food residue marking color block, a detection function of the inner brushing method of anterior teeth, a detection function of the angle between the teeth and the gums, One brushing force detection function, one brushing cleanliness, one brushing force correctness, one toothbrush placement correctness, one front toothbrush method correctness, one upper jaw mold correction function, one lower jaw mold correction function, one bezel Brushing tips, a brushing sequence diagram, an interdental brushing course, the correctness of the left brushing method of an interdental brush, the correctness of the right brushing method of an interdental brush, a sponge brushing course and a sponge brush scoring item.

Images