WO2019031658A1

WO2019031658A1 - Orthodontic guide system and orthodontic guide method using same

Info

Publication number: WO2019031658A1
Application number: PCT/KR2017/014057
Authority: WO
Inventors: 이남기
Original assignee: 서울대학교병원
Priority date: 2017-08-11
Filing date: 2017-12-04
Publication date: 2019-02-14
Also published as: KR102024988B1; KR20190017377A

Abstract

Provided are an orthodontic guide system and an orthodontic guide method for providing augmented reality (AR) such that an orthodontist can adhere a bracket to an accurate location of teeth. According to the orthodontic guide system, a virtual grid and a virtual bracket are defined on the basis of a 3D image of the teeth, and the virtual grid and the virtual bracket are displayed on AR glasses. Therefore, the orthodontist can adhere an actual bracket to an accurate location with the aid of the AR virtual grid and virtual bracket by wearing the AR glasses during orthodontic treatment.

Description

Guide system for orthodontics and method of orthodontic correction using the same

The present invention relates to a guide system for orthodontic treatment and a method of guiding teeth using the same, and more particularly, to a guiding system for orthodontic treatment using an augmented reality and a method of guiding a tooth using the same.

Traditionally, orthodontic treatment of the teeth uses brackets for fine and precise movement of the teeth. The brackets are attached to the teeth to deliver the corrective force of the rubber or wire to the teeth. The doctor uses an oral mirror, a bracket positioner, etc. to attach the bracket to a certain position in the clinical crown of teeth. According to these direct adhesions, the visual environment is limited within the oral cavity, and depending on the clinical experience or vision, or the position of the bracket positioner, many errors occur in the bracket adhesion. In order to correct the error of bracket bonding, the orthodontist resolved by reattaching the bracket at the beginning of the orthodontic treatment or by bending the orthodontic wire at the end of the treatment.

Direct bonding of such brackets is difficult for corrective beginners, and it is not easy to adhere brackets to teeth consistently even for the skilled person. Accordingly, the inventor of the present invention has completed a long period of research and effort on an apparatus which can effectively help direct orthodontic treatment by the orthodontist, and thus completed the present invention.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a guide system for orthodontics that provides an augmented reality so that the orthodontist can adhere the bracket to the correct position of the teeth.

Another problem to be solved by the present invention is to provide a method of guiding a tooth using the guide system for orthodontic treatment.

The problems to be solved by the present invention are not limited to the above-mentioned problems, and other matters not mentioned can be clearly understood by those skilled in the art from the following description.

According to another aspect of the present invention, there is provided a guide system for orthodontic treatment, comprising: an imaging device for generating a 3D image of a tooth using 3D digital photography; A service server for setting a tooth axis of the clinical crown of the teeth on the 3D image and defining a virtual grid based on the tooth axis; And an AR glass for transmitting the 2D image generated during the photographing of the teeth to the service server. Here, the service server converts the 3D image and the virtual grid to match the 2D image, and the AR glass receives the converted virtual grid from the service server and displays the virtual grid so as to overlap with the tooth.

The service server defines a position of a virtual bracket for orthodontic correction on the virtual grid, and the AR glass can display the virtual bracket together with the virtual grid.

When the physician places the bracket in the teeth for orthodontic correction, the AR glass captures the bracket and transmits the bracket to the server server. The service server determines whether the bracket is positioned and the virtual bracket is matched It can be judged.

The service server may match the 2D image and the 3D image with reference to the facial surface and the occlusal surface of the tooth.

An index is attached to at least three of the teeth, and the 2D image and the 3D image may be matched based on the index.

The virtual grid may consist of vertical lines and horizontal lines with respect to the axle, and the interval of the virtual grid may be between 0.25 and 0.5 mm.

The AR glass may display the converted 3D image so as to overlap with the tooth.

According to another aspect of the present invention, there is provided a method of correcting a tooth according to an embodiment of the present invention, comprising: receiving a 3D image of a tooth taken by a video device; Setting a tooth axis of the clinical crown of the tooth on the 3D image and defining a virtual grid based on the tooth axis; Receiving a 2D image of the tooth taken by an AR glass; Transforming the 3D image and the virtual grid to match the 2D image; And transmitting the converted virtual grid to the AR glass to display the virtual grid so as to overlap with the tooth.

The details of other embodiments are included in the detailed description and drawings.

As described above, according to the guide system for the orthodontic treatment of the present invention and the orthodontic guide method using the same, the orthodontist can confirm the virtual grid and the virtual bracket superimposed on the patient's teeth by wearing the AR glass. Therefore, with the aid of the virtual grid and the virtual bracket, the bracket can be attached to the tooth more accurately. In addition, the attitude of the orthodontist can be improved, and even the orthodontist whose eyesight is reduced by the presbyopia can perform the medical treatment smoothly through the augmented reality provided from the AR glass without the magnifying glasses.

Further, since the orthodontist can confirm the augmented reality image in which the 3D image is superimposed on the patient's teeth through the AR glass, information can be obtained to the area that can not be directly visually recognized in the oral cavity. For example, since root information obtained from CBCT as well as crown information can be confirmed, errors due to direct bonding of the bracket can be significantly reduced.

FIG. 1 is a schematic view showing a guide system for orthodontic treatment according to an embodiment of the present invention.

FIG. 2 is a flowchart sequentially illustrating a method of correcting teeth according to an embodiment of the present invention.

3 schematically shows a 3D image of teeth imaged by the imaging device of FIG.

Fig. 4 shows the orthodontist looking at the patient wearing the AR glass of Fig.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

FIG. 1 is a schematic view showing a guide system for orthodontic treatment according to an embodiment of the present invention. The guiding system for orthodontic appliances according to the present invention is a system for providing a guide so that the orthodontist can adhere the bracket to the patient's teeth at an accurate position. The guiding system includes a video device 10 for photographing a patient's tooth, A service server 20 for receiving a tooth image and processing the teeth image, and an AR glass 30 worn by the orthodontist during a medical examination. Here, the bracket is attached to the tooth and is a device that transfers the correcting force of the rubber band or wire to the tooth.

The imaging device 10 is a device for generating a 3D image of a patient's teeth and facial bone structure using 3D digital photography, for example, a 3D oral scanner 12 or a Cone Beam Computerized Tomography (CBCT) ), A 3D model scanner, or the like. The 3D oral scanner 12 senses the reflected light when the incident light irradiated in the oral cavity is reflected on the tooth or the subject, and generates the 3D shape of the entire shape of the subject in the oral cavity. The CBCT 14 two-dimensionally detects a conical transmission X-ray using an area detector and acquires three-dimensional volume information using the detected X-ray to generate a 3D image by only one rotation scan on the subject in the oral cavity. The 3D image by the 3D mouth scanner 12 has an advantage of accurately expressing the surface shape of the subject (tooth, gum, and the like), and the 3D image by the CBCT 14 has not only the tooth crown information but also the alveolar bone and root information There is an advantage to express.

The AR glass 30 is a device in the form of a spectacle, which is worn on the face of the orthodontist. The AR glass 30 may include a camera for photographing a patient's teeth and a display for displaying an augmented reality image. The display unit is disposed between the eye of the orthodontist and the object, and is configured in any form capable of simultaneously recognizing the augmented reality image while the orthodontist looks at the object. For example, when the display unit is constituted by a spectacle lens and the augmented reality image is displayed on the lens, the calibrator can recognize the augmented reality image while viewing the object through the lens. The AR glass 30 captures a 2D image of the patient's tooth through the camera unit and transmits the 2D image to the service server 20. Here, the 2D image of the tooth may include moving picture information.

The service server 20 receives the 3D image of the tooth from the imaging device 10 and generates augmented reality data for providing an orthodontic treatment guide based on the 3D image. Specifically, the service server 20 sets the tooth axis of the teeth of the teeth on the 3D image, and defines the virtual grid based on the tooth axis. Here, the virtual grid may be composed of vertical lines and horizontal lines with respect to the axle, and the interval between the lines may be 0.25 to 0.5 mm. These virtual grids are expressed as augmented reality to the orthodontist and help in the calibration work such as bracket bonding.

In addition, the service server 20 can define the position of the virtual bracket for orthodontic correction on the virtual grid. Here, the virtual bracket is a virtual simulation of the bracket on the 3D image of the tooth before the actual bracket is attached to the tooth for orthodontic treatment.

This virtual grid or virtual bracket may be automatically defined by the service server 20 in the 3D image of the tooth or may be defined by connecting to the service server 20 by a calibration engineer.

When the service server 20 receives the 2D image of the tooth from the AR glass 30, it converts the 3D image, the virtual grid, and the virtual bracket to match the 2D image. Specifically, since the 2D image photographed by the AR glass 30 varies depending on the angle of the AR glass 30 toward the patient and the opening state of the patient, the 3D image, the virtual grid, Shape, direction, size, etc. need to be transformed.

The service server 20 preferably matches the 2D image with the 3D image based on the facial surface and / or occlusal surface of the tooth. For example, a 2D image (hereinafter, referred to as a " cusp tip ") based on a cut surface of the teeth of the upper teeth (the maxillary arch) or the entire lower teeth And 3D images can be matched. However, this is merely an example, and various changes are possible. Furthermore, when a 3D image and a 2D image of a tooth are generated in the state where an index is attached to at least three of the teeth of the patient, the matching process can be performed more smoothly. Specifically, when the position of the index displayed on the 3D image is matched with the index displayed on the 2D image, the shape, direction, size, and the like of the 3D image are automatically converted. Once the 3D image has been transformed, the virtual grid and virtual brackets can also be automatically converted.

When the service server 20 transmits the converted data (i.e., 3D image, virtual grid, and virtual bracket) to the AR glass 30, the AR glass 30 displays the converted data on the display unit. The AR glass 30 displays the converted virtual grid on the display unit so as to overlap with the actual teeth of the patient. Therefore, the orthodontist wearing the AR glass 30 can attach the brackets to the patient's teeth with the help of the virtual reality-enhanced virtual grid.

Further, the AR glass 30 can display the converted virtual brackets together with the virtual grid on the display unit. The orthodontist wearing the AR glass 30 can visually confirm the virtual bracket on the patient's actual tooth, so that the bracket can be bonded to the correct position.

Furthermore, the AR glass 30 can display the converted 3D image on the display unit so as to overlap the actual teeth. Since the orthodontist wearing the AR glass 30 can confirm not only the crown information of the patient's teeth but also the reinforced and realized root information while bonding the bracket to the teeth, the error of the bracket bonding can be remarkably reduced.

Hereinafter, a method of correcting teeth according to an embodiment of the present invention will be described in detail with reference to FIGS. 2 to 4. FIG. FIG. 2 is a flowchart sequentially illustrating a method of correcting teeth according to an embodiment of the present invention. 3 schematically shows a 3D image of teeth imaged by the imaging device of FIG. Fig. 4 shows the orthodontist looking at the patient wearing the AR glass of Fig.

The imaging device 10 generates and transmits a 3D image 100 of the patient's teeth and facial bone structure to the service server 20 (S10). At this time, the 3D image 100 may be photographed with the index 120 attached to at least three of the teeth of the patient. However, the position of the index 120 shown in FIG. 3 is merely an example, and the present invention is not limited by these positions. Another example of an index is to attach an index to the three teeth of the maxillary arch or mandibular arch, that is, the near side of the cut face of the central incisor and the cusp tip of the left and right first molars It is possible.

The service server 20 generates a virtual grid 112 and a virtual bracket 114 that are augmented reality data for guiding orthodontic treatment based on the 3D image 100 of the received tooth. Specifically, the service server 20 sets the tooth axis 110 of the teeth of the teeth on the 3D image 100, and defines the virtual grid 112 based on the tooth axis 110 (S20). The virtual grid 112 is preferably defined separately from the upper and lower dental arches. Further, the service server 20 defines the position of the virtual bracket 114 on the 3D image 100 or the virtual grid 112. When the 3D image 100 is created with the index 120 attached to the patient's teeth, it can be confirmed that the index 120 is displayed as it is on the 3D image 100 as well.

Then, the AR glass 30 transmits the 2D image of the patient's tooth to the service server 20 (S30).

The service server 20 converts the 3D image based on the 2D image so that the 2D image and the 3D image are matched with each other (S40). As the 3D image of the tooth is transformed, the virtual grid 112 and the virtual bracket 114 located on the 3D image are also transformed.

The service server 20 transmits the converted 3D image, the virtual grid 112, and the virtual bracket 114 to the AR glass 30. The AR glass 30 displays the converted virtual grid 112 on the display unit so that the orthodontist can visually confirm the patient's actual tooth 130 and the augmented reality virtual grid 112 through the AR glass 30 (S50). Further, the AR glass 30 may display the converted virtual bracket 114 and / or the converted 3D image on the display unit.

When the orthodontist places the actual bracket on the patient's teeth 130, the camera part of the AR glass 30 photographs the actual bracket position and transmits it to the service server 20. When the service server 20 receives the actual bracket position And the virtual bracket 114 are matched with each other (S60). If the orthodontist has misplaced the bracket, the service server 20 provides an alarm to the orthodontist through the AR glass 30 (S70). Here, the alarm is made up of vibration, sound, light, etc., and includes any means that can be recognized by the calibrator.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

Claims

A video device for generating a 3D image of a tooth using three-dimensional digital photography;

A service server for setting a tooth axis of the clinical crown of the teeth on the 3D image and defining a virtual grid based on the tooth axis; And

And an AR glass for transmitting the 2D image generated during the photographing of the tooth to the service server,

Wherein the service server converts the 3D image and the virtual grid to match the 2D image and the AR glass receives the converted virtual grid from the service server and displays the virtual grid to be superimposed on the tooth. Guide system for.
The method according to claim 1,

Wherein the service server defines a position of a virtual bracket for orthodontic correction on the virtual grid, and the AR glass displays the virtual bracket together with the virtual grid.
3. The method of claim 2,

When the physician places the bracket in the teeth for orthodontic correction, the AR glass captures the bracket and transmits the bracket to the server server. The service server determines whether the bracket is positioned and the virtual bracket is matched And a guide member for guiding the tooth.
The method according to claim 1,

Wherein the service server matches the 2D image and the 3D image with reference to a pure surface and an occlusal surface of the tooth.
The method according to claim 1,

Wherein an index is attached to at least three of the teeth, and the 2D image and the 3D image are matched based on the index.
The method according to claim 1,

Wherein the virtual grid comprises vertical lines and horizontal lines with respect to the tooth axis, and the interval between the virtual grids is between 0.25 and 0.5 mm.
The method according to claim 1,

And the AR glass displays the converted 3D image so as to overlap with the teeth.
The orthodontic service server is:

Receiving a 3D image of a tooth taken by a video device;

Setting a tooth axis of the clinical crown of the tooth on the 3D image and defining a virtual grid based on the tooth axis;

Receiving a 2D image of the tooth taken by an AR glass;

Transforming the 3D image and the virtual grid to match the 2D image; And

And transmitting the converted virtual grid to the AR glass to display the virtual grid so as to overlap with the tooth.