KR102481893B1 - Augmented reality-based dentistry practice system and augmented reality-based dentistry practice method using the system - Google Patents

Abstract

The present invention relates to an augmented reality-based dentistry practice system and an augmented reality-based dentistry practice method using the same, and more particularly, to an augmented reality-based dentistry practice system which enables a practice to form and process a tooth piece practice object through a piece forming process by using augmented reality, to improve the degree of processing a tooth that the shape of a tooth is elaborately sculpted and formed while understanding the shape of each tooth, and an augmented reality-based dentistry practice method using the same.

Description

Augmented reality-based dentistry practice system and augmented reality-based dentistry practice method using the system

The present invention relates to an augmented reality-based tooth morphology practice system and an augmented reality-based tooth morphology practice method using the same. It relates to an augmented reality-based tooth morphology practice system that accurately sculpts and molds the shape of a corresponding tooth while acquiring morphological theoretical knowledge, and an augmented reality-based tooth morphology practice method using the same.

Recently, the 4th industrial revolution has a great impact on medical education.

Dental morphology practice is conducted by learning complex tooth morphological characteristics, measuring and sculpting a rectangular mold made of gypsum or wax with a ruler, and it takes a lot of concentration and time for practitioners, so it is immersed in learning and arouses interest. Not only is it difficult, but it is also difficult for educators and administrators to accurately evaluate it.

Therefore, the need for advanced education in line with the changes and trends of the times is emerging, and the introduction of advanced IT technology and smart devices is particularly urgent.

Recently, dental design technology using AR (augmented reality) objects has been proposed in the field of teeth.

Korea Patent Publication No. 10-2016-0143654 augmented reality dental design method and system proposes to build a new augmented reality environment for medical care, and is a presentation for dental morphology education as a prior art in dental morphology education. A presentation system has been proposed.

This technology provides a technology to rotate the image by displaying virtual teeth as a 3D image through a system that reconstructs and outputs the 3D image data of the tooth based on the viewpoint so that the image of the tooth rotates. .

However, this technology provides a learning by doing effect through interaction with virtual objects in real space, so it is difficult to achieve the effect of promoting concentration on learning and improving the educational effect.

To solve this problem, a tooth carving practice system using a mobile device (Patent No. 10-1973787) has been proposed.

The above technology displays a virtual wax model image on the display unit of the practitioner's mobile device, and the operation processing unit of the practitioner's mobile device receives the motion signal of the touch pen on the virtual wax model image from the display unit of the practitioner's mobile device. A system for displaying a virtual tooth wax model image, which is an image of a practice result, is provided by recognizing the motion signal of the pen as a sculpting signal by a sculpting tool to virtually sculpt a virtual wax model in the form of a tooth.

Due to this, the practitioner can virtually practice sculpting according to the sculpting stage of each tooth, and compare and evaluate the virtual tooth wax model image, which is the result of the virtual practice, and the tooth image set for practice.

However, the above technique is a virtual practice using a touch pen and is not suitable for a plaster model. In addition, it is difficult to determine whether the practitioner is operating accurately during the practice process, and there is no objective standard for educators or managers to evaluate it.

KR 10-2016-0143654 A KR 10-2107019 B1 JP 2012094128 A

The purpose of the present invention, which has been devised to solve the above problems, is that in forming a tooth model by sculpting a gypsum mold by a practitioner, by grafting augmented reality to accurately understand each tooth shape and to elaborately sculpt the shape of the tooth. Augmented reality that improves tooth processing proficiency by doubling the learning effect and proposing a support device to secure the precision and convenience of sculptural molding of the tooth model by promoting the fixation of the standardized arrangement of the practice terminal and the gypsum mold to be sculpted It is to provide a tooth morphology practice system based on tooth morphology, and an augmented reality-based tooth morphology practice method using the same.

The above object is achieved by the following structure provided by the present invention.

The augmented reality-based tooth morphology practice system according to the present invention,

an input module; a camera module for photographing the processed surface of the gypsum mold; a memory module; An output module including a display module for outputting an image on a screen and a speaker for generating an auditory signal; And an application execution module for executing the tooth morphology practice application stored in the memory module, and a practice terminal equipped with a control module for controlling their driving, a rectangular surface plaster mold requiring sculptural molding, and a practice terminal. It is composed of a support device,

The application execution module executes the practice application to provide a dental image in which the upper and lower arches are combined and a standard tooth alignment image arranged in the arch selected from the dental image, which requires practice in the standard tooth alignment image. a standard tooth selection process mode in which one standard tooth is finally selected; It is characterized in that it is configured to provide tooth morphology practice information including a practice learning process mode for providing an augmented reality-based augmented reality image for the tooth selected by the standard tooth selection process mode.

Preferably, in the hands-on learning process mode, the control module activates a camera module to obtain an image of the processed surface of the gypsum mold aligned on the support device in real time, and the standard for the standard tooth selected in the standard tooth selection process mode. After extracting the tooth image, an augmented reality image obtained by overlapping the processed surface image of the gypsum mold obtained by the camera module and the processed surface of the extracted standard tooth image is displayed on the screen.

More preferably, the support device includes a support table; a terminal holding unit for holding practice terminals spaced apart from each other on the upper part of the support table; and a movable holder formed on the support table to align and fix the gypsum mold,

The movable holder unit includes a gypsum holder having a port for inserting and fixing a gypsum mold; The gypsum holder is installed in a vertical hinge structure through a hinge shaft member, and includes a holder bracket installed in a horizontal rotation structure on the support table through a rotation shaft member.

On the other hand, the augmented reality-based tooth morphology practice method according to the present invention,

An alignment and arrangement step of arranging and arranging the practice terminal and the gypsum mold on the support device;

A practice application execution step of executing a tooth morphology learning application on the practice terminal to enter a standard tooth selection mode;

A standard tooth selection step of selecting a dental arch from the dental image displayed on the screen of the practice terminal and selecting a standard tooth from the standard tooth arrangement image arranged in the selected dental arch;

The camera module is activated to obtain an image of the processed surface of the gypsum mold arranged on the mounting device in real time, while the image of the selected standard tooth is extracted, and then the image of the processed surface of the gypsum mold obtained by the camera module is extracted. An augmented reality image marking step of marking an augmented reality image overlapping the standard tooth guide image on a screen; and

While changing the processing surface of the gypsum mold fixed to the support device step by step, through the augmented reality image according to the processing surface of the gypsum mold, a tooth model carving step of designing and sculpting each processing surface of the gypsum mold aligned with the support device step by step consists of including

As described above, in the present invention, it is possible to double the learning effect by incorporating augmented reality to elaborately sculpt the shape of a tooth while accurately understanding each tooth shape.

In addition, in the augmented reality-based tooth morphology practice system according to the present invention, a standardized alignment arrangement of a gypsum mold and a practice terminal is possible through a support device, and in particular, the support device has a fixed gypsum mold at an angle and direction required. Since a movable holder unit for aligning is added, it is possible to align and fix the gypsum mold at the required angle and direction, so that convenience and precision according to sculptural molding can be secured.

1 is a flowchart showing each step of the augmented reality-based tooth carving practice method proposed as a preferred embodiment in the present invention;
2 is a block diagram of a practice terminal constituting an augmented reality-based tooth carving practice system proposed as a preferred embodiment in the present invention;
Figure 3 shows a tooth image and a standard tooth arrangement image displayed on the screen in the standard tooth selection step of the augmented reality-based tooth sculpting practice method proposed in the present invention as a preferred embodiment,
Figure 4 shows an augmented reality image displayed on the screen in the augmented reality image marking step of the augmented reality-based tooth carving practice method proposed in the present invention as a preferred embodiment,
Figure 5 shows an example of a sculptural image step by step by the sculpting step view option window in the augmented reality image marking step of the augmented reality-based tooth sculpting practice method proposed in the present invention as a preferred embodiment,
6 to 7 show the detailed configuration of the augmented reality-based tooth sculpture practice system and the movable holder part proposed as a preferred embodiment of the present invention,
8 shows a cross-sectional configuration of the movable holder part and a state in which a gypsum mold is inserted;
9 shows a detailed action state of the movable holder part.

Hereinafter, with reference to the accompanying drawings, an augmented reality-based tooth morphology practice system proposed as a preferred embodiment of the present invention and an augmented reality-based tooth morphology practice method using the same will be described in detail.

1 is a flowchart showing each step of the augmented reality-based tooth sculpting practice method proposed as a preferred embodiment in the present invention, and FIG. 2 is a tooth sculpting practice system based on augmented reality proposed as a preferred embodiment in the present invention. Fig. 3 is a block diagram of a practice terminal constituting a , and FIG. 3 shows a tooth image and a standard tooth arrangement image displayed on the screen in the standard tooth selection step of the augmented reality-based tooth sculpting practice method proposed in the present invention as a preferred embodiment. 4 shows an augmented reality image displayed on the screen in the augmented reality image marking step of the augmented reality-based tooth carving practice method proposed as a preferred embodiment in the present invention, and FIG. In the augmented reality image marking step of the augmented reality-based tooth sculpting practice method proposed as a preferred embodiment, the sculpting image for each step by the sculpting step view option window is exemplified and shown, and FIGS. It shows the detailed configuration of the augmented reality-based tooth sculpture practice system and the movable holder part proposed as an example, and FIG. 8 shows the cross-sectional configuration of the movable holder part and the insertion state of the gypsum mold, and FIG. 9 shows the movable holder part It shows detailed operation status.

The augmented reality-based tooth morphology practice system 1 proposed as a preferred embodiment in the present invention includes a practice terminal 10; It includes a support device 100 for arranging and mounting the rectangular gypsum mold 200 requiring sculptural molding and the practice terminal 10.

The gypsum mold 200 is composed of a rectangular block on which the grip part 220 is integrally formed on one side of the sculptural molded part 210, and the sculpted molded part 210 has an occlusal surface processing surface 211a, mesial Five processing surfaces including a surface processing surface 211b, a centrifugal surface processing surface 211c, a buccal surface processing surface 211d, and a snow surface processing surface 211e are formed.

In addition, the practice terminal 10 includes an input module 11 such as a touch pad as shown in FIG. 2; a camera module 12 for photographing the processed surface of the gypsum mold 200; a memory module 13; an output module 15 including a display module 14 outputting an image on a screen and a speaker generating an auditory signal; and an application execution module 16 for executing the tooth morphology practice application stored in the memory module 13, and a general-purpose smartphone or tablet PC equipped with a control module 17 for controlling their driving, augmented by It provides practice-based dental morphology practice information to practitioners.

In addition, the application execution module executes the practice application to provide tooth morphology practice information, and the tooth morphology practice information provided by the practice application includes a dental image in which the upper and lower arches are combined and a dental arch selected from the dental image. a standard tooth selection process mode in which a standard tooth alignment image is provided, and one standard tooth that requires practice is finally selected from the standard tooth alignment image; A practice learning process mode for providing augmented reality-based tooth morphology practice information for the tooth selected by the standard tooth selection process mode is included.

In the standard tooth selection process mode, the standard tooth learning information including the name, description, and characteristics of each standard tooth selected from the standard tooth alignment image by the practitioner is displayed, Provide learning information.

Therefore, when the practitioner executes the tooth morphology practice application through the practice terminal 10, the standard tooth selection process mode is executed through the intro, and the dental implant image is displayed on the screen as shown in FIG. When selected, the standard tooth arrangement image arranged in the selected arch is displayed on the screen.

Then, when the practitioner selects one standard tooth that requires tooth model molding from the standard tooth arrangement image displayed on the screen, a practice learning process mode based on the selected standard tooth is executed.

In the practice learning process mode switched from the standard tooth selection process mode, as shown in FIG. 5, the image of the processed surface of the plaster mold provided by the practitioner through the practice terminal 10 and the augmented reality image overlapping the guide surface of the image of the standard tooth While checking with the naked eye, the processing surfaces of the gypsum mold 200 aligned with the support device 100 are sequentially molded according to the shape of the standard tooth provided through the augmented reality image, and the plaster mold corresponds to the standard tooth. Sculpture the dental model.

To describe this in detail, when switched to the hands-on learning process mode, the control module 17 activates the camera module 12 to obtain an image of the processing surface of the gypsum mold 200 aligned with the support device 100 in real time, After extracting the standard tooth image of the selected standard tooth, an augmented reality image obtained by overlapping the processed image of the gypsum mold obtained by the camera module 12 and the processed surface of the extracted standard tooth image is displayed on the screen.

At this time, it is preferable that the control module 17 performs image processing such as removal of unwanted images from the practice image obtained through the camera module 12, pre-extraction, and creation of a boundary group, and provides the gypsum mold and the background separately. Do.

In addition, the standard tooth image extracted by the control module 17 is composed of a stereoscopic image having five guide surfaces including the occlusal surface, mesial surface, distal surface, buccal surface, and lingual surface, so that the three-dimensional shape of the standard tooth can be confirmed. It is possible, and an augmented reality image overlapping the guide surface corresponding to the processing surface of each gypsum mold is displayed on the screen.

In addition, an option window having various option windows is formed on the screen converted to the practice learning process mode, providing convenience and sophistication according to sculptural molding of the tooth model, and also providing theoretical learning information about the standard tooth. .

In this embodiment, the option window displayed on the screen switched to the practice learning process mode includes: a grid display option window formed by overlapping a grid on an augmented reality image; a 3D view option window for displaying a standard tooth image in 3D; a length value measurement option window for measuring a partial length in the augmented reality image; a stopwatch option window displaying the required time according to the practical learning; a projection setting option window for setting a projection of the image of the standard tooth overlapped with the image of each processing surface of the gypsum base material; a 2D graphic display option window providing 2D images of each guide surface of standard teeth; A practice image display option window that provides a practice example image of the selected standard tooth in the form of a video; and a morphology lecture provision option window for guiding the morphology theory of the selected tooth by voice, a screen lock option window, and a zoom control option window for adjusting the zoom of the camera module.

In particular, in this embodiment, as shown in FIG. 5, a sculpting step viewing option window is provided in the option window to display step-by-step sculpting images of the standard tooth guide surface step by step, so that the practitioner sculpts the processed surface of the gypsum mold in the sculptural molding process. You can check the step-by-step sculpting images provided through the step view option window, or overlap the image of the gypsum mold processing surface to visually check whether the dental model to be sculpted matches.

Referring to the augmented reality-based tooth morphology practice method through the augmented reality-based tooth morphology practice system configured as described above with reference to FIGS. and (S 10); A practice application execution step of executing a tooth morphology learning application on the practice terminal to enter a standard tooth selection mode (S20); A standard tooth selection step of selecting a dental arch from the dental image displayed on the screen of the practice terminal and selecting a standard tooth from the standard tooth arrangement image arranged in the selected dental arch (S30); The camera module is activated to obtain an image of the processed surface of the gypsum mold arranged on the mounting device in real time, while the image of the selected standard tooth is extracted, and then the image of the processed surface of the gypsum mold obtained by the camera module is extracted. Augmented reality image marking step (S 40) of marking an augmented reality image overlapping the standard tooth guide image on the screen; and a tooth model carving step of step by step designing and carving each processed surface of the gypsum mold arranged on the support device through an augmented reality image according to the sculpted surface of the gypsum mold while changing the sculpted surface of the gypsum mold mounted on the support device step by step. (S 50).

On the other hand, in the present invention, the plaster mold (200 ) and a support device 100 for fixing the practice terminal 10 in a standard manner, so that the plaster mold 200 and the practice terminal 10 are aligned and fixed.

The support device 100 proposed in the present invention includes a support table 110 as shown in FIGS. 6 to 9; A terminal holder 120 for holding the practice terminal 10 at a distance on the upper part of the support table 110; and a movable holder part 130 formed on the support table 110 to align and fix the gypsum mold 200 .

The terminal holder 120 includes a pair of support arms 121 formed by standing on the support table 110; Including the terminal holder 122 disposed between the support arms 121, the practice terminal 10 is placed on top of the support table 110 so that the camera module 12 is installed on the support table 110. It faces the holder part 130.

The movable holder part 130 includes a hollow gypsum holder 131 having a port 131a for inserting and fixing the gypsum mold 200 in the longitudinal direction; The gypsum holder 131 is installed in a vertical hinge structure through a hinge shaft member 132a, and a holder bracket 132 installed in a horizontal rotation structure on the support table 110 through a rotation shaft member 132b; A first conformal driving unit 134 providing vertical and downward rotational force to the hollow gypsum holder 131 and a second conformal driving unit 135 providing horizontal and equiangular rotational force to the holder bracket 132; and a drive control unit 136 controlling driving of the first conformal driving unit 134 and the second conformal driving unit 135 .

Preferably, the holder bracket 132 is composed of a molded body having a "c"-shaped plane that is open up and down, and fixes the gypsum holder 131 in a vertical hinge structure through a hinge shaft member 132a.

And, as shown in FIGS. 7 to 8, an elastic support piece 131b made of a leaf spring is formed on the inner surface of the port 131a formed in the gypsum holder 131, and the gypsum inserted into the port 131a. The mold 200 is fixed by elastically pressing the sidewall by the elastic supporting piece 131b.

In addition, an insertion depth adjusting bolt 131c is formed on the bottom surface of the port 131a into which the gypsum mold 131 is inserted to adjust the insertion depth of the gypsum mold 200 inserted into the port 131a according to the amount of fastening. , It is possible to set the protruding height of the sculptural molding part 210 protruding to one side of the gypsum holder 131.

Therefore, as shown in FIG. 9, by the normal and reverse rotation of the first equal angle drive unit 134, the gypsum holder 131 is rotated up and down in an equal angle around the hinge shaft member 132a to stand upright or lay down horizontally, When the gypsum holder 131 is erected upright, the occlusal surface of the gypsum mold in which the occlusal surface is carved faces the practice terminal 10 toward the upper part, and the gypsum holder 131 is laid horizontally so that the centrifugal surface, buccal surface, The side processing surface of the gypsum mold forming the mesial surface, the snow surface, etc. is exposed toward the top in a state facing the practice terminal 10.

In addition, in a state where the gypsum holder 131 is laid horizontally, the second equal angle driving unit 135 rotates at an equal angle so that the gypsum holder 131 and the gypsum mold 200 fixed to the gypsum holder 131 rotate at an angle of 90°. When rotated at an equal angle, the processing surface of the gypsum mold 200 forming the centrifugal processing surface, buccal processing surface, mesial surface processing surface, snow surface processing surface, etc. of the gypsum mold 200 fixed to the gypsum hold 131 They are exposed sequentially facing the practice terminal 10 toward the top.

Therefore, the movable holder part 130 vertically uprights the gypsum mold 200 requiring sculptural molding so that the occlusal processing surface is exposed, or the gypsum mold 200 requiring sculptural molding is laid down. The centrifugal surface processing surface, the buccal surface processing surface, the mesial surface processing surface, and the snow surface processing surface are arranged to be exposed in a standardized manner while being rotated horizontally and at an angle.

In particular, in the present invention, the first conformal unit 134 and the second conformal unit 135 are mutually linked with the practice terminal 10 through short-range communication, etc., so that the movable holder unit is provided according to the guide surface image of the selected standard tooth. (130) rotates the gypsum mold vertically or horizontally to arrange the processing surface of the gypsum mold 200 that matches the guide surface of the standard tooth, so that when sculpting the tooth model, the sculpted surface can be changed quickly and formally. make it possible

1. Dental morphology practice system based on augmented reality
10. Practice terminal 11. Input module
12. Camera module 13. Memory module
14. Display module 15. Output module
16. Application execution module 17. Control module
100. Support device 110. Support table
120. Terminal holding part 121. Support arm
122. Terminal holder
130. Movable holder 131. Plaster holder
131a. port 131b. elastic support
131c. Insertion Depth Adjustment Bolt
132. Holder Bracket
132a. Hinge shaft member 132b. Pivot axis member
134. First conformal drive unit 135. Second conformal drive unit
136. Drive control
200. Gypsum mold 210. Sculpture forming part
211a. Occlusal processing surface 211b. mesial surface processing surface
211c. Centrifugal surface Machining surface 211d. buccal processing surface
211e. snow processing surface
220. Grip part

Claims (4)

an input module; a camera module for photographing the processed surface of the gypsum mold; a memory module; An output module including a display module for outputting an image on a screen and a speaker for generating an auditory signal; And an application execution module for executing the tooth morphology practice application stored in the memory module, and a practice terminal equipped with a control module for controlling their driving, a rectangular surface plaster mold requiring sculptural molding, and a practice terminal. It is composed of a support device,
The application execution module executes the practice application to provide a dental image in which the upper and lower arches are combined and a standard tooth alignment image arranged in the arch selected from the dental image, which requires practice in the standard tooth alignment image. a standard tooth selection process mode in which one standard tooth is finally selected; With respect to the tooth selected by the standard tooth selection process mode, it is configured to provide tooth morphology practice information including a practice learning process mode that provides an augmented reality-based augmented reality image,
The support device includes a support table; a terminal holding unit for holding practice terminals spaced apart from each other on the upper part of the support table; and a movable holder formed on the support table to align and fix the gypsum mold,
The movable holder unit includes a gypsum holder having a port for inserting and fixing a gypsum mold; The gypsum holder is installed in a vertical hinge structure through a hinge axis member, and a holder bracket installed in a horizontal rotation structure on a support table through a pivot member. Augmented reality-based tooth morphology practice system. The method of claim 1, wherein in the hands-on learning process mode, the control module activates a camera module to obtain an image of the processed surface of the gypsum mold aligned on the support device in real time, and the standard tooth selected in the standard tooth selection process mode After extracting the standard tooth image for the image, augmented reality based on augmented reality, characterized in that configured to display on the screen an augmented reality image overlapping the processed surface image of the gypsum mold obtained by the camera module and the processed surface of the extracted standard tooth image. Dental morphology practice system.
delete delete

Images