KR102424096B1 - Service Apparatus for Coordinating of Images for Dental Implant Procedure and Method for Coordinating of Images for thereof - Google Patents

Abstract

The present invention relates to a service apparatus for image registration for artificial tooth treatment and an image registration method therefor, and to an image registration service apparatus for artificial tooth treatment that generates a registration image for artificial tooth treatment from a CT scan image and an oral scan image. In the following, a data management unit that compares the data format of at least one of the CT scan image and the oral scan image with the registered standard data format, and converts the data format to the registered standard data format if it is different from the registered standard data format, and the CT scan image and the oral scan image It includes a registration judging unit that confirms the possibility of image registration success based on a preset image registration success criterion, and an image registration unit that creates a registration image for the subject by registering the CT scan image and the oral scan image, but the confirmed image registration success possibility Accordingly, at least one of the CT scan image or the oral scan image may be reacquired from the operator's device that has acquired the CT scan image and the oral scan image, and other embodiments may also be applied.

Description

Service apparatus for image registration for artificial tooth procedure and image registration method for the same

The present invention relates to a service apparatus for image registration for artificial tooth treatment and an image registration method for the same, by matching the CT photographed image and the oral scan image at the time when the CT photographed image and the oral scan image obtained from the recipient are received. To a service apparatus for image registration for artificial tooth surgery that generates an image, and an image registration method therefor.

In general, an implant means a substitute that can replace human tissue when the original human tissue is lost, and in particular, in dentistry, including a fixture, an abutment, and a crown. It refers to implanting artificially made teeth using prostheses at the actual positions of teeth.

That is, the implant operation is performed in the form of forming a hole in the alveolar bone, placing a fixture in the hole, and coupling the abutment and the crown to the fixture when the fixture is fused to the alveolar bone. The operator forms the perforation through various processes such as gum removal, alveolar bone positioning, planarization, initial hole formation and expansion, and thread formation. To this end, the operator provides the dental condition of the operator to the planner, and then uses the planning data, abutments, and crowns provided from the planner to operate the artificial teeth to the operator.

As such, when the planner designs the planning data for the artificial tooth treatment of the recipient, he uses the computed tomography (CT) image and the oral scan image of the recipient. However, in the case of an oral scan image, since it is an image obtained by directly scanning the inside of the recipient's oral cavity with an oral scanner, distortion occurs. Also, since the CT scan image and the oral scan image have different data formats, there is a problem in that it is not easy to match the two images.

Various embodiments of the present invention for solving these conventional problems are artificial teeth treatment that converts the data format of the two images immediately after the service device receives the CT scan image and the oral scan image acquired from the recipient to generate a registered image. An object of the present invention is to provide a service apparatus for image registration for use and an image registration method therefor.

In addition, various embodiments of the present invention provide for image registration for artificial tooth surgery, which corrects the distortion of the oral scan image, which is distorted when generating the registration image, and then registers the CT scan image and the oral scan image to generate a registered image. To provide a service device and an image matching method therefor.

The service apparatus for image registration for artificial tooth treatment according to an embodiment of the present invention is an image registration service apparatus for artificial tooth treatment that generates a registration image for artificial tooth treatment from a CT scan image and an oral scan image, A data management unit that compares the data format of at least one of the CT scan image and the oral scan image with a standard matched data format, and converts the data format to the standard data format when different from the standard standard data format, the CT scan image and the oral scan image Based on a preset image registration success criterion, a registration judging unit for confirming the possibility of image registration success, and an image matching unit for generating a registration image for the subject by registering the CT scan image and the oral scan image, wherein the confirmed image and improving the speed and accuracy of generating the registered image by reacquiring at least one of the CT scan image or the oral scan image from the operator's device that has acquired the CT scan image and the oral scan image according to the possibility of successful registration .

In addition, the image registration unit automatically matches the CT photographed image and the oral scanned image by an automatic registration algorithm when it is further confirmed that the predetermined automatic registration criterion of the CT photographed image and the oral scan image is satisfied by the registration determination unit. .

In addition, the image matching unit displays the overlaid CT scan image and the oral scan image, and extracts a specific reference marker from among at least one reference marker included in each image.

In addition, the reference marker includes at least one of an attachable reference marker attached to the inside of the mouth of the recipient or a generative reference marker applied to the CT image and the oral scan image.

In addition, the image matching unit controls the ratio, direction, and angle of the oral scan image based on the extracted reference marker to overlap the specific reference marker to match the CT scan image and the oral scan image.

In addition, the image matching unit selects at least one reference marker from the registered image to improve accuracy of the registered image and adjusts a depth value of the selected reference marker.

In addition, the image registration success criterion is a criterion including at least one of whether the CT scan image and the oral scan image are of the same recipient, and whether at least one of the CT scan image and the oral scan image is inaccurate.

In addition, the registration image is a three-dimensional image in which information about the nerve and bone shape including the nerve of the mandibular alveolus, the shape of the maxillary sinus, the anterior incisor hole, and the bone density of the recipient is displayed.

In addition, the image registration method for image registration for artificial tooth treatment according to an embodiment of the present invention is an image registration method for artificial tooth treatment that generates a registration image for artificial tooth treatment from a CT scan image and an oral scan image. , comparing a data format of at least one of the CT photographed image and the oral scan image with a registered standard data format; The operation of converting the CT image and the oral scan image into a data format, the operation of confirming the possibility of success in image registration based on a preset image registration success criterion, and the operation of matching the CT photographed image and the oral scan image to obtain a registration image for the recipient and generating, wherein the CT scan image and the oral scan image are an image of a subject to which an attachable reference marker is applied inside the oral cavity or an image of the subject to which a generative reference marker is to be applied, and the confirmed image registration is successful Depending on the possibility, the operator device that has acquired the CT image and the oral scan image re-acquires at least one of the CT image or the oral scan image, thereby improving the speed and accuracy of generating the registered image.

As described above, the service apparatus for image registration for artificial tooth treatment and the image registration method therefor of the present invention, as soon as the service apparatus receives the CT image and the oral scan image obtained from the recipient, immediately convert the data format of the two images. By converting to generate a registered image, there is an effect of generating a registered image by minimizing the quality change between the two images.

In addition, the service apparatus for image registration for artificial tooth surgery and the image registration method for the same of the present invention correct the distortion of the oral scan image, which is distorted when generating the registration image, and then register the CT image and the oral scan image. By doing so, it is possible to minimize the error of the registered image.

1 is a diagram illustrating a system for providing an integrated solution service for artificial teeth treatment according to an embodiment of the present invention.
FIG. 2 is a diagram schematically illustrating a procedure for providing an artificial tooth treatment integrated solution service according to an embodiment of the present invention.
3 is a flowchart illustrating a method of providing an artificial tooth treatment integrated solution service according to an embodiment of the present invention.
4 is a flowchart illustrating a method of providing an artificial tooth treatment integrated solution service in a device to be operated on according to an embodiment of the present invention.
5 is a flowchart for explaining a method of providing an artificial tooth operation integrated solution service in an operator device according to an embodiment of the present invention.
6 is a detailed flowchart for explaining a method for receiving consultation information in the operator's device according to an embodiment of the present invention.
7 is a flowchart for explaining a method of providing an artificial tooth treatment integrated solution service in a service apparatus according to an embodiment of the present invention.
8 is a detailed flowchart illustrating a method of generating consultation information in a service apparatus according to an embodiment of the present invention.
9 is a detailed flowchart illustrating a method of generating a prediction image in a service device according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in more detail with reference to the accompanying drawings. At this time, it should be noted that in the accompanying drawings, the same components are denoted by the same reference numerals as much as possible. In addition, detailed descriptions of well-known functions and configurations that may obscure the gist of the present invention will be omitted.

1 is a diagram illustrating a system for providing an integrated solution service for artificial teeth treatment according to an embodiment of the present invention.

Referring to FIG. 1 , the service providing system 10 according to the present invention includes a subject device 100 , an operator device 150 , and a service device 200 .

The recipient device 100 may be a portable device used by a patient (hereinafter referred to as a recipient) visiting a hospital, particularly a dentist, or a device that is provided in a hospital lobby and can be manipulated by the recipient. The operator's device 100 communicates with the operator's device 150 . To this end, the recipient device 100 performs wireless communication such as long term evolution advanced (LTE-A), long term evolution (LTE), wireless fidelity (Wifi), Bluetooth (bluetooth), and BLE (bluetooth low energy). can

When the recipient device 100 is provided in a hospital lobby, etc., the recipient device 100 may be a device that the recipient device 100 can use, such as a computer, a laptop computer, or a tablet PC. The recipient may be authenticated by inputting the recipient's unique information, such as a resident registration number, into the recipient device 100 . When the recipient device 100 is a portable device, the portable device may be a device that the recipient can carry, such as a smart phone, a portable terminal, or a tablet PC. In addition, an application capable of communicating with the operator's apparatus 150 may be installed in the operator's device 100 . The recipient can log in to the application and receive authentication.

The recipient device 100 may display the recipient information obtained from the operator device 150 after authentication is completed. The operator's device 100 may display the operator's opinion input by the operator's device 150 after the operator examines the operator's information. The patient's device 100 may display consultation information that has been checked by the operator's device 150 . The operator device 100 may input a change request for consultation information received from the operator device 150 and transmit it to the operator device 150 . In this case, the change request may be selection of a type for the prosthesis, and the like.

The operator device 100 may display the operation schedule of the operator generated by the operator device 150 . The operator's device 100 may transmit a change signal for the procedure schedule to the operator's device 150 according to the operator's input. When the treatment time corresponding to the treatment schedule arrives, the device 100 may output a notification indicating this.

The operator's device 150 is a device used by a doctor (hereinafter, referred to as an operator) working in a hospital, particularly a dental office, and may be a device such as a computer, a laptop computer, or a tablet PC. The operator device 150 is a long term evolution advanced (LTE-A), long term evolution (LTE), wireless fidelity (Wifi), Bluetooth (bluetooth), BLE (bluetooth low energy), etc. of wireless communication can be performed. In addition, the operator device 150 for communication with the service device 200, LTE-A (long term evolution advanced), LTE (long term evolution), Wifi (wireless fidelity), WCDMA (wideband code division multiple access), such as Wireless communication can be performed.

The operator device 150 transmits the operator information including the CT scan image and the oral scan image of the operator to the service apparatus 200 through communication with the service apparatus 200 . The operator device 150 receives, from the service device 200 , a matched image of a CT scan image and an oral scan image of a person to be treated, a prediction image after artificial tooth treatment, and planning data for artificial tooth treatment. To this end, the operator device 150 includes an information acquisition unit 151 , a procedure consultation unit 153 , and a procedure management unit 155 .

The information acquisition unit 151 acquires the information of the operator by the operator's input. The recipient's information includes the recipient's name, the recipient's gender, the recipient's age, general medical history, tooth type, tooth number corresponding to the placement location requiring artificial tooth treatment, the recipient's facial image, and CT ( computed tomography) may include a photographed image and an oral scan image photographed inside the mouth of the recipient. In this case, the face image may include at least one of a plurality of 2D images and 3D images. The information acquisition unit 151 transmits the subject information to the service device 200 .

To this end, the operator device 150 may be connected to an imaging device including a face imaging device (not shown), a CT imaging device (not shown), and an oral scanning device (not shown), or may include an imaging device. The information acquisition unit 151 may acquire the opinion of the operator on the information of the operator input from the operator.

The information acquisition unit 151 generates an electronic chart by using the acquired information and opinions of the subject. The information acquisition unit 151 transmits the recipient's information or an electronic chart generated based on the recipient's information to the service device 200 .

The operation consultation unit 153 displays at least one of the consultation information received from the service device 200, that is, the matching image, the prediction image after the artificial tooth operation, and the planning data for the artificial tooth operation to the recipient for the artificial tooth operation. Provides consulting services. In this case, the planning data includes implantation information of a fixture to be operated in the mouth of the recipient for artificial tooth treatment. The implantation information of the fixture includes an implantation position at which the fixture is to be placed in the oral cavity, a standard including a diameter and length, an implantation direction, an implantation depth, a type of fixture, and the like. In this case, the fixture is one of the parts of the artificial tooth, and the part of the artificial tooth may be a prosthesis including a fixture, an abutment connectable to the fixture, and a crown connectable to the abutment.

The registration image is a 3D image generated by the service device 200 matching the CT image and the oral scan image immediately upon receiving the CT image and the oral scan image from the operator device 150 . The operator can check the nerve and bone shape information including the nerve of the mandibular alveolus, the shape of the maxillary sinus and anterior incisor hole, and the bone density through the registration image. The operation consultation unit 153 displays the registration image, and the operator may perform a consultation related to the artificial tooth operation, such as whether to place the artificial tooth in the oral cavity of the operator and the operator using the displayed matching image.

When a re-request signal for at least one image among a CT scan image and an oral scan image is received from the service device 200 , the procedure consultation unit 153 activates the information acquisition unit 151 to retake at least one image. After that, it can be transmitted to the service device 200 .

The prediction image is an image that predicts the facial change of the recipient after the artificial tooth operation. More specifically, the prediction image is an augmented reality in which at least one prosthesis image is virtually placed at at least one placement position to place an artificial tooth identified in the registration image, and the registered image in which the prosthesis image is placed is combined with the face image of the recipient. It may be an augmented reality (AR) image. The operation consultation unit 153 displays a predicted image, and the operator may perform a consultation on the facial change of the operator after the operation of the artificial tooth with the operator is completed by using the displayed predicted image.

In addition, the procedure consultation unit 153 may receive the facial images before and after artificial tooth treatment of another subject whose treatment conditions are similar to those of the subject by more than a threshold. The operator may use the facial images before and after the artificial tooth operation of the other operator to consult about the facial changes of another operator who has similar treatment conditions to the operator. In this case, the facial images before and after the artificial tooth surgery may be at least one of a 2D image and a 3D image.

The planning data is data necessary to operate artificial teeth on the recipient, and means placement information and drilling guide information of a fixture to be operated in the recipient's oral cavity, which is designed by the manager of the service device 200, for example, a planner. is created The implantation information of the fixture includes an implantation position at which the fixture is to be placed in the oral cavity, a standard including a diameter and length, an implantation direction, an implantation depth, a type of fixture, and the like. The drilling guide information includes information such as part numbers, types, images, names, etc. for a plurality of drilling devices used when forming a hole in which a fixture is to be placed, and insertion depth information indicating an insertion depth at a location where the fixture is to be placed. , and includes use order information for a plurality of drilling devices.

The placement information of the fixture among the planning data may be displayed by being applied to the registration image. In addition, the drilling guide information may be displayed as text data for an image and usage for a drill device for drilling. Based on the planning data, the operator may conduct a consultation on a fixture to be inserted into an implantation position requiring artificial tooth treatment, an abutment to be coupled with the fixture, and a crown to be coupled with the abutment.

The operation management unit 155 receives a consultation result from the operator after the operation consultation unit 153 provides a consultation service to the operator. The procedure management unit 155 may transmit a confirmation signal or correction data for the planning data to the service device 200 based on the inputted consultation result. When the correction data is generated, the procedure management unit 155 may correct and display the prediction image based on the correction data. Also, when the procedure management unit 155 transmits the correction data to the service device 200 , the procedure consultation unit 153 may receive and display the predicted image corrected by the service device 200 based on the correction data.

After transmitting the confirmation signal or correction data to the service device 200 , the procedure management unit 155 may receive schedule information from the service device 200 . The schedule information refers to schedule information generated by the service device 200 based on a production time and a delivery time of a prosthesis required for an artificial tooth operation of a recipient based on the planning data.

The procedure management unit 155 creates a procedure schedule for the recipient based on the received schedule information. The procedure schedule may be generated by the operator's input, and may be generated based on schedule information received from the service device 200, treatment and treatment time of other patients waiting for treatment, and the like. In this case, the procedure schedule is a schedule in which the information acquisition unit 151 acquires the information of the recipient and the procedure of the recipient can be performed in one-day.

The procedure management unit 155 transmits the generated procedure schedule to the recipient device 100, updates the procedure schedule in real time according to the delivery status of the prosthesis, the treatment of other recipients, and the procedure progress status, and transmits it to the recipient device 100. have. For example, the procedure management unit 155 may generate a procedure schedule by allocating the estimated time required for each operation, such as the delivery status of the prosthesis, the treatment of other recipients, and the progress of the procedure. At this time, if the time required for each operation is longer than the expected time, the procedure management unit 155 may reflect this and regenerate the procedure schedule. In addition, when the time required for each operation is shorter than the expected time, the procedure management unit 155 may reflect this and regenerate the procedure schedule.

When a schedule change request signal is received from the device 100 to be operated on, the procedure management unit 155 may change the generated procedure schedule. The procedure management unit 155 may output an alarm informing that it is the artificial tooth operation time for the recipient when the operation time of the recipient arrives based on the procedure schedule.

The service device 200 is a device used by a planner who designs planning data required for artificial tooth treatment for a recipient, and may be a device such as a computer, a laptop computer, or a tablet PC. The service device 200 performs wireless communication such as long term evolution advanced (LTE-A), long term evolution (LTE), wireless fidelity (Wifi), and wideband code division multiple access (WCDMA) for communication with the operator device 150 . can be performed.

The service device 200 communicates with the operator device 150 that acquires the operator information including a facial image, a CT scan image, and an oral scan image for the operator, and provides consultation and artificial tooth treatment planning for the operator. It provides an integrated solution service for artificial teeth surgery including To this end, the service device 200 largely includes a memory 210 and a control unit 220 , and the memory 210 includes a big data storage unit 210a and a digital library 210b. The control unit 220 includes a data management unit 220a, a matching work determination unit 220b, an image matching unit 220c, a diagnosis unit 220d, a virtual arrangement unit 220e, a planning unit 220f, and a schedule generation unit 220g. and a guide generating unit 220h. In addition, although not shown, the service device 200 may additionally include an input unit for receiving an input from a planner, a display unit capable of displaying a screen according to an operation, and the like.

The big data storage unit 210a stores the subject information received from the operator device 150 as big data. In addition, the big data storage unit 210a may store a registered image generated by matching a CT image and an oral scan image included in the subject information, a facial image generated based on the registered image, and planning data. In addition, the big data storage unit 210a may store a facial image of the recipient before and after the artificial tooth treatment.

The digital library 210b is an image of the prosthesis, for example, a fixture image of at least one fixture, an abutment image of a plurality of abutments that can be coupled to the fixture, and an image of a crown that can be coupled to the abutment. may include.

The data management unit 220a stores the subject information received from the operator device 150 in the big data storage unit 210a. In this case, the operator's opinion may be included in the operator's information. The recipient information includes the recipient's name, recipient's gender, recipient's age, general medical history, tooth type, tooth number corresponding to the placement location requiring artificial tooth treatment, the recipient's face image, and a CT scan image of the recipient's head and an oral scan image of the inside of the mouth of the recipient. In this case, the face image may include at least one of a plurality of 2D images and 3D images.

The data management unit 220a checks the data format of the CT scan image and the oral scan image among the subject information. The data management unit 220a compares the data format of at least one of the CT scan image and the oral scan image with the matching standard data format. The data management unit 220a converts a data format of an image having a data format different from the matching standard data format into a matching standard data format. In general, since the file extensions of the CT scan image and the oral scan image are different from each other, it is not easy to match them without data format conversion. Accordingly, the data management unit 220a converts the same data format as the matching standard data format so that the quality of the CT scan image and the oral scan image does not deteriorate. The data management unit 220a provides the CT scan image and the oral scan image in which the data format is converted, to the consistency work determination unit 220b.

The matching determination unit 220b checks whether the converted CT scan image and the oral scan image can be matched. For example, when the CT scan image and the oral scan image of the subject are acquired while at least one reference marker is attached to the inside of the subject's oral cavity, the conformity determination unit 220b is at least included in each of the CT scan image and the oral scan image. Identifies one reference marker. In this case, the reference marker is a marker that is attached to the inside of the oral cavity of the person who wants to treat the artificial tooth, and may be attached to various parts such as the operation position of the artificial tooth, the gum, and the like. The matching work determination unit 220b confirms the possibility of success in matching the two images by using at least one reference marker included in each of the CT scan image and the oral scan image. For example, the matching work determination unit 220b may check the matching success possibility based on the number of at least one reference image included in each image.

When the CT scan image and the oral scan image of the recipient are obtained in a state in which the reference marker is not attached to the inside of the oral cavity, the conformity determination unit 220b selects at least one identical position from the CT scan image and the oral scan image. The consistency determination unit 220b may apply a generative reference marker to at least one selected same location, and apply a depth map algorithm to the generative reference marker. The matching work determination unit 220b may check the possibility of matching success by using the depth value for the same location calculated by applying the depth map algorithm.

If the matching success probability for the two images is less than the threshold value, the matching work determination unit 220b determines that the matching is impossible, and requests the CT scan image and the oral scan image again from the operator's device 150 . Conversely, if the matching success probability for the two images exceeds the threshold, the matching completion determination unit 220b determines that matching is possible, and provides the two images to the image matching unit 220c. The matching work determination unit 220b confirms the image matching success possibility based on a preset image matching success criterion. In this case, the criteria for success in image registration are whether at least one reference marker included in each of the CT scan image and the oral scan image is the same, whether the CT scan image and the oral scan image are images of the same subject, and the CT scan image and the oral scan image. It may be at least one of whether at least one of the scan images is inaccurate, and whether the depth value calculated by applying the depth map algorithm to the same position of the CT scan image and the oral scan image is the same.

The image matching unit 220c matches the two images confirmed to be able to be matched by the matching completion determination unit 220b, that is, a CT scan image and an oral scan image. The image matching unit 220c may perform automatic registration of the CT image and the oral scan image by an automatic registration algorithm, and may perform registration by input from a planner.

The image matching unit 220c matches the two images by controlling the oral scan image so that at least one reference marker included in the CT scan image and at least one reference included in the oral scan image overlap at the same position. More specifically, the image matching unit 220c displays the CT scan image and the oral scan image overlaid on the display unit. The image matching unit 220c performs image analysis of the CT scan image and the oral scan image. The image matching unit 220c may check at least one of the number of reference markers included in the CT scan image, the angle between the reference markers, the orientation of each reference marker, and the relative position of the reference markers through image analysis. Also, the image matching unit 220c may check at least one of the number of reference markers included in the oral scan image, the angle between the reference markers, the orientation of each reference marker, and the relative position of the reference markers through image analysis. . In order to check the orientation of the reference marker, the reference marker may be formed in a spherical shape, a flat shape, a polygonal shape, a cylindrical shape, and other shapes, and the image matching unit 220c calculates the x, y, and z values based on the origin of the reference marker. You can check the direction by checking.

According to the confirmation result, the image matching unit 220c should be present at the same position among the reference markers included in each image after overlaying the CT scan image and the oral scan image, but a reference marker that does not exist at the same position to extract The image matching unit 220c controls the ratio, direction, and angle of the oral scan image in order to match the location of the extracted reference marker. The image matching unit 220c may match the reference marker included in the oral scan image, which should exist in the same position as the reference marker included in the CT scan image, with each other through the control of the oral scan image. When the reference marker included in the CT scan image and the reference marker included in the oral scan image match, the image matching unit 220c may generate one 3D registered image by matching the two images. After generating the registered image, the image matching unit 220c selects a reference marker that can be at least one feature point from among reference markers included in the registered image. The image matching unit 220c calculates a depth value of the selected reference marker. The image matching unit 220c may improve the accuracy of the registered image by adjusting the calculated depth value for the reference marker. The image matching unit 220c may check the dental information of the recipient from the matching image, and may store it in the big data storage unit 210a as the recipient information.

The image matching unit 220c matches the CT scan image and the oral scan image in which the success possibility of matching is confirmed by using the depth value for the same location calculated by applying the depth map algorithm. The image matching unit 220c calculates depth values for a plurality of positions in the CT scan image, and selects a plurality of positions identical to the plurality of positions selected in the CT scan image from the oral scan image. The image matching unit 220c controls the ratio, direction, and angle of the oral scan image so that the depth values for a plurality of positions in the selected oral scan image are the same as the depth values calculated from the CT scan image. The image matching unit 220c creates a registered image by matching the CT scan image and the oral scan image having the same depth value with the CT scan image.

When the image matching is successful, the image matching unit 220c provides the matched images to the diagnosis unit 220d and the virtual arrangement unit 220e, respectively. In this case, the registration image is a three-dimensional image, and information about the nerve and bone shape including the nerve of the mandibular alveolus of the recipient, the shape of the maxillary sinus and the anterior incisor hole, and the bone density may be displayed. Conversely, if it is confirmed that the image registration has failed, the image matching unit 220c re-requests at least one image in which an error has occurred among the CT scan image and the oral scan image to the operator device 150 .

The diagnosis unit 220d is the operator's device so that, when it is confirmed that there is a treatment to be preceded prior to the artificial tooth operation from at least one of a CT scan image, an oral scan image, and a registration image of the subject, the confirmed treatment can be preceded. (150) may provide information on this. In addition, if the CT scan image and the oral scan image of the subject are pre-stored in the big data storage unit 210a, the diagnosis unit 220d compares the acquired CT scan image and the oral scan image with the pre-stored images to make artificial You can check if there is any treatment that should be preceded before dental surgery. When it is confirmed that there is a treatment to be preceded prior to the artificial tooth operation, the diagnosis unit 220d may provide information about this to the operator device 150 so that the confirmed treatment may be preceded.

The virtual arrangement unit 220e includes a consultation arrangement unit 221 for generating a predictive image capable of confirming facial changes of the recipient after artificial tooth treatment, a planning arrangement unit 222 for performing treatment planning for the recipient, and The matching image may include a virtual treatment unit 223 that virtually operates the prosthesis.

Based on the big data storage unit 210a, the consultation arrangement unit 221 checks the existence of another subject whose treatment conditions are similar to that of the subject. As a result of the confirmation, if there is another subject with similar treatment conditions to the subject, the consultation arrangement unit 221 calls the facial images before and after the artificial tooth treatment of the other subject from the big data storage unit 210a to the operator device 150. send. Conversely, if there is no other subject having similar treatment conditions to the subject, the consultation arrangement unit 221 generates a prediction image for the subject and transmits it to the operator device 150 .

To this end, the consultation arrangement unit 221 calls the big data for other recipients stored in the big data storage unit 210a. Big data is operation information about other recipients, name, gender, age, tooth type, tooth number corresponding to the implantation location where artificial tooth treatment was performed, dental status, facial image, CT scan image, It may include oral scan images, registration images, planning data, and facial images before and after artificial tooth surgery.

The consultation arrangement unit 221 confirms the existence of another subject whose information and treatment conditions are similar to those of the subject. At this time, the consultation arrangement unit 221 partially compares and combines the treatment conditions including the sex, age, tooth type, implantation position, and dental state of the person to be treated among the big data stored in the big data storage unit 210a to determine the treatment conditions. It is possible to check whether there are other subjects similar to the threshold or more.

The consultation arrangement unit 221 extracts the facial images before and after artificial tooth treatment of the other subject when there is another subject whose information and treatment conditions are similar to the threshold or more of the subject, and transmits the extracted facial images to the operator device 150 . If the tooth number corresponding to the implantation position at which the recipient wants to proceed with the artificial tooth treatment is No. 23, the consultation placement unit 221 displays the facial image before and after the procedure of another recipient who has treated the artificial tooth at No. 23 by the operator device 150 can be sent to In addition, when the tooth number for which the recipient wants to undergo artificial tooth treatment is No. 41 and No. 23, the consultation placement unit 221 provides a facial image before and after the treatment of one other recipient who has treated all of the artificial teeth at No. 41 and No. 23 may be transmitted to the operator device 150 . In addition, when the tooth number for which the recipient wants to undergo artificial tooth treatment is No. 41 and No. 23, the consultation placement unit 221 provides the facial images before and after the treatment of two other recipients who have treated artificial teeth at No. 41 and No. 23, respectively. may be transmitted to the operator device 150 .

The consultation arrangement unit 221 may generate a predictive image for the recipient by using the planning data (eg, planning data in which the fixture implantation information is applied to the matching image) of another recipient whose treatment conditions are similar to or greater than a threshold. More specifically, the consultation arrangement unit 221 extracts a partial image corresponding to the placement position of the recipient from the planning data of the other recipient. The consultation arrangement unit 221 generates a predicted image of the recipient by using the extracted partial image. In this case, the prediction image may be an augmented reality (AR) image capable of predicting a change in the face of the recipient after the artificial tooth operation.

For example, if the tooth number corresponding to the placement position at which the recipient wants to proceed with the artificial tooth treatment is 23, the consultation placement unit 221 may correspond to the placement position in the planning data of another recipient who has treated the artificial tooth at No. 23. Extract a partial image. In addition, if the tooth number corresponding to the implantation position at which the recipient wants to proceed with the artificial tooth treatment is No. 41 and No. 23, the consultation placement unit 221 is the planning of another recipient who has treated the artificial tooth at No. 41 and No. 23 It is possible to extract a partial image corresponding to the implantation position from the data. Also, the consultation arrangement unit 221 may extract a partial image corresponding to an implantation position from the planning data of different recipients who have treated artificial teeth in Nos. 41 and 23, respectively. The consultation arrangement unit 221 combines the extracted partial image with the registered image of the recipient. The consultation arrangement unit 221 generates a predicted image by combining the registered image to which the partial image is combined and the face image of the recipient. The consultation arrangement unit 221 provides the planning data of another recipient used when generating the prediction image to the planning arrangement unit 222 .

As a result of the check, if there is no other recipient having similar operating conditions to the recipient, the consultation placement unit 221 virtually arranges the image of the part or the entire artificial tooth in the matched image of the recipient. The consultation arrangement unit 221 generates a predictive image by combining the matched image in which the image of the part or the whole of the artificial tooth is virtually arranged with the face image of the recipient.

In this case, when the facial image is a plurality of 2D images, the consultation arrangement unit 221 may generate a 3D image by combining the plurality of 2D images. To this end, the consultation arrangement unit 221 may generate a single 3D image by combining the plurality of 2D images by using respective feature points included in the plurality of 2D images. The consultation arrangement unit 221 may generate a prediction image by applying a registration image in which an image of a part or an entire artificial tooth is virtually arranged to the 3D image.

In addition, when the facial image is a 2D image obtained from the front of the recipient, the consultation arrangement unit 221 overlays the 2D image with a matching image in which the image of the part or the entire artificial tooth is virtually displayed. The consultation arrangement unit 221 generates a prediction image by matching the registration image in which the image of the part or the whole of the artificial tooth is virtually placed based on the feature point identified from the face image of the person to be treated in the overlaid displayed state. can In this case, the consultation arrangement unit 221 may calculate the depth in the 2D image using a depth map algorithm. The consultation placement unit 221 generates a virtual 3D image based on the calculated depth, and applies a registered image in which an image of a part or an entire artificial tooth is virtually placed to the generated 3D image to generate a predicted image. have.

In addition, when the face image is a 3D image, the consultation arrangement unit 221 may generate a prediction image by combining the 3D image with the registered image in which the image of the part or the whole of the artificial tooth is virtually arranged.

The placement unit 222 for planning confirms an implantation position requiring artificial tooth treatment in the registration image. The planning arrangement unit 222 selects a fixture image that can be arranged at the confirmed placement position from among a plurality of fixture images stored in the digital library 210b. The planning arrangement unit 222 virtually arranges the selected fixture image on the registration image. The planning arrangement unit 222 may select and adjust the fixture image to be customized to the recipient.

The planning arrangement unit 222 provides the registered image on which the fixture image is arranged to the virtual treatment unit 223 . The virtual operation unit 223 may virtually arrange an image of the abutment coupled to the fixture on the fixture image. Also, the virtual treatment unit 223 may virtually arrange an image of a crown coupled to the abutment on the abutment image.

The planning arrangement unit 222 provides information on the parts or the entire image of the artificial tooth arranged in the registration image, for example, information on placement of a fixture corresponding to the fixture image to the planning unit 220f. In this case, the implantation information of the fixture may be an implantation position at which the fixture is to be placed, a standard including a diameter and length, an implantation direction, an implantation depth, a type of fixture, and the like. When a confirmation signal for the planning data is received from the operator's device 150, or the revised data of the planning data is received from the operator's device 150, the planning arrangement unit 222 provides it to the planning unit 220f. can

The planning arrangement unit 222 arranges the part or the entire image of the artificial tooth corresponding to the planning data of another subject provided by the consultation arrangement unit 221 in the registered image of the subject. The planning arrangement unit 222 provides the planning unit 220f to generate planning data suitable for the recipient based on information about the parts or the entire image of the artificial tooth arranged in the registration image.

The planning unit 220f generates planning data based on the placement information of the fixture provided from the planning arrangement unit 222 . The planning data means placement information and drilling guide information of a fixture to be operated in the oral cavity of the recipient. The drilling guide information includes information such as part numbers, types, images, names, etc. for a plurality of drilling devices used when forming a hole in which a fixture is to be placed, and insertion depth information indicating an insertion depth at a location where the fixture is to be placed. , including information on the order of use for a plurality of drilling devices.

The planning unit 220f confirms or corrects the planning data when a confirmation signal for the planning data is received or the correction data is received from the planning arrangement unit 222, and generates the planning data by the schedule generating unit 220g. and the guide generating unit 220h. The planning unit 220f may store the generated or modified planning data in the big data storage unit 210a.

The schedule generator 220g generates schedule information. The schedule information is a schedule in which the production time of the prosthesis according to the planning data and the delivery time of the manufactured prosthesis are taken into consideration. The prosthesis includes an abutment coupled to a fixture corresponding to the fixture image and a crown coupled to the abutment. In addition, the schedule information may be considered together with the production time and delivery time for a surgical guide that provides a guide necessary for forming a perforation for placing a fixture. The schedule generator 220g transmits the generated schedule to the operator device 150 .

The guide generating unit 220h generates a guide for all or parts of an artificial tooth required for an artificial tooth operation based on the planning data. In particular, the guide generating unit 220h may generate an image of the crown among the parts of the artificial tooth. In addition, the guide generating unit 220h may generate an image for the surgical guide.

The guide generating unit 220h may transmit the generated image of the crown and the image of the surgical guide to an external device such as a 3D printer (not shown). Accordingly, the service device 200 may perform wireless or wired communication with an external device. The service device 200 is a wired using a USB cable or wireless communication such as long term evolution advanced (LTE-A), long term evolution (LTE), wireless fidelity (Wifi), Bluetooth (bluetooth), BLE (bluetooth low energy), etc. communication and the like. When the production of parts or all of the artificial tooth and the surgical guide by the external device is completed, the planner delivers it to the operator who is the user of the operator's device 150 by using a logistics system such as a delivery service.

In addition, in the exemplary embodiment of the present invention, it is described that the service device 200 generates the matched image, but the present invention is not limited thereto. When the specifications of the operator's device 150 are sufficiently supported, the registration image generation may be performed by the operator's device 150 .

2 is a diagram schematically illustrating a procedure for providing an integrated solution service for artificial teeth treatment according to an embodiment of the present invention.

Referring to FIG. 2 , in operation 201 , the operator device 150 acquires information about a person who wants to operate an artificial tooth. In operation 203, the service device 200 automatically registers the CT scan image and the oral scan image included in the subject information to generate a registered image. In operation 205 , the service device 200 generates an augmented reality image using the facial image of the recipient included in the recipient information to generate a predicted image representing a change in the recipient's face after the artificial procedure.

In operation 207 , the operator device 150 performs a consultation with the operator using the matched image and the predicted image generated by the service device 200 . In operation 209, the service device 200 generates planning data, and the operator device 150 checks the planning data.

In operation 211 , the service device 200 manufactures a prosthesis based on the planning data when the operator device 150 completes the inspection of the planning data. In operation 213 , the service device 200 stores the registered image, the predicted image, and the planning data. In operation 215 , the operator of the operator apparatus 150 performs an artificial tooth operation of the operator based on the planning data and the manufactured prosthesis. In this case, the prosthesis includes all or parts of an artificial tooth including an abutment coupled to a fixture corresponding to the fixture image and a crown coupled to the abutment. In addition, the operator may form a perforation in the mouth of the operator by using a surgical guide that provides a guide necessary for forming a perforation for placing the fixture. As described above, operations 201 to 215 may be performed within 24 hours from the time the recipient visits the hospital, so that the artificial tooth operation can be performed during one-day.

3 is a flowchart illustrating a method of providing an artificial tooth treatment integrated solution service according to an embodiment of the present invention.

Referring to FIG. 3 , in operation 301 , the operator device 150 acquires information about the operator, and in operation 303 , the operator uses an input unit (not shown) to input an opinion on the information about the operator. In operation 305 , the operator device 150 transmits information and opinions of the recipient to the service device 200 , and in operation 307 , the operator device 150 transmits information and opinions of the recipient to the device 100 . In operation 309, the subject device 100 displays an electronic chart in which the opinion is input based on a signal received from the subject.

In operation 311, the service device 200 generates consultation information for the recipient based on the recipient information. The consultation information is information necessary when the operator consults with the operator for artificial tooth treatment of the operator, and may include a registration image, a prediction image, and planning data. In operation 313 , the service device 200 transmits consultation information to the operator device 150 . In operation 315, the operator device 150 checks the consultation information. The operator device 150 may transmit a confirmation signal for the prediction image and the planning data to the service device 200 according to the inspection result. Also, the operator device 150 may transmit a position change signal for a fixture image disposed in the registration image or correction data for planning data to the service device 200 according to the inspection result. When the operator device 150 corrects the planning data, the registered image or the predicted image may be automatically corrected by the corrected correction data.

When the operator device 150 transmits the inspection result for the consultation information to the service device 200 in operation 317 , the service device 200 generates schedule information according to the inspection result in operation 323 . In operation 325 , the service device 200 transmits the generated schedule information to the operator device 150 . In operation 327, the service device 200 generates a guide based on the planning data. In operation 329, the service device 200 stores the consultation information as big data.

In operation 315 , the service device 200 performs operation 319 when the inspection of the consultation information is finished. In operation 319 , the service device 200 transmits the consultation information reflecting the inspection result to the device 100 . In operation 321 , the subject device 100 displays consultation information according to an input of the subject.

In operation 331 , the operator device 150 generates a procedure schedule for the operator based on the schedule information received from the service apparatus 200 in operation 325 . The procedure schedule is a schedule for performing artificial tooth treatment of a recipient, and may be generated based on schedule information, treatment and treatment time of other recipients waiting in line. In addition, the procedure schedule is a schedule capable of performing the procedure within a critical time, for example, 24 hours from the time the information of the recipient is obtained in operation 301 .

In operation 333 , the operator device 150 transmits the generated operation schedule to the operator device 100 . In operation 335, the recipient device 100 displays a procedure schedule based on a signal received from the recipient. In operation 337, the operator device 150 performs operation 339 when a change signal for changing the procedure schedule is input. In operation 339 , the operator device 150 transmits a change signal to the operator device 150 . In operation 341 , the operator device 150 updates the procedure schedule based on the change signal, and performs operation 349 . In operation 337, the operator device 150 performs operation 343 if the change signal is not input. In operation 343 , a signal indicating that the change signal is not input is transmitted to the operator device 150 , and operation 349 is performed.

In operation 349, the operator device 150 checks whether the operation time corresponding to the generated operation schedule or the updated operation schedule has arrived. In operation 349, the operator device 150 performs operation 351 when the operation time according to the operation schedule arrives. In operation 351, the operator device 150 outputs a notification indicating that the operation time has arrived. In operation 349, if the operation time does not arrive, the operator device 150 continuously checks whether the operation time has arrived.

As a result of checking operation 337, if no change signal is input, the subject device 100 performs operation 345 . In operation 345 , the device 100 to be operated performs operation 347 when the operation time corresponding to the operation schedule arrives. In operation 347, the subject device 100 outputs a notification informing that the treatment time has arrived. In operation 345 , if the operation time does not arrive, the device 100 continuously checks whether the operation time has arrived.

4 is a flowchart for explaining a method of providing an artificial tooth treatment integrated solution service in a device to be operated on according to an embodiment of the present invention.

Referring to FIG. 4 , in operation 401 , the recipient device 100 checks whether authentication for the recipient has been completed by input from the recipient. As a result of checking operation 401, if authentication of the recipient is not completed, the recipient device 100 may repeatedly perform authentication of the recipient until authentication of the recipient is completed. When the recipient device 100 is provided in a hospital lobby, etc., the recipient may be authenticated by inputting unique information such as a resident registration number. When the device 100 is a portable device, it is possible to log in to an application capable of communicating with the device 150 to receive authentication.

As a result of checking operation 401 , when authentication for the recipient is completed, the device 100 for the recipient performs operation 403 . In operation 403 , when it is confirmed that an observation confirmation signal for confirming the operator's opinion is received from the operator, the device 100 performs operation 405 . In operation 405 , the operator device 100 displays the operator's opinion input through the operator apparatus 150 on a display unit (not shown) and performs operation 407 .

In operation 403, the recipient device 100 performs operation 407 if the observation confirmation signal is not received. In operation 407, when it is confirmed that a consultation information confirmation signal for confirming consultation information is received from the recipient, the device 100 performs operation 409. Referring to FIG. In operation 409 , the operator device 100 displays the consultation information received from the operator apparatus 150 on the display unit and performs operation 411 . The consultation information is information necessary when the operator consults with the operator for artificial tooth treatment of the operator, and may include a registration image, a prediction image, and planning data.

In operation 407, if the receiving device 100 does not receive the consultation information confirmation signal, operation 411 is performed. In operation 411, when it is confirmed that the operation schedule confirmation signal for confirming the operation schedule is received from the operator, the device 100 performs operation 413, and if the operation schedule confirmation signal is not received, waits for the reception of the operation schedule confirmation signal . In operation 413 , the operator device 100 displays the operation schedule generated by the operator apparatus 150 on the display unit and performs operation 415 .

In operation 415 , when a change date selection signal for changing a date corresponding to the procedure schedule is received from the operation recipient, the device 100 performs operation 417 , and when the change date selection signal is not received, operation 421 is performed. In operation 417 , the operator device 100 transmits a change signal for the procedure schedule to the operator device 150 with a date corresponding to the change date selection signal. In operation 419, when a change completion signal is received from the operator apparatus 150 to indicate that the change to the procedure schedule is complete, operation 421 is performed. If the change completion signal is not received, operation 415 returns to the above redo the action.

In operation 421 , the device 100 checks whether a treatment time corresponding to the treatment schedule arrives. As a result of checking operation 421 , when the operation time arrives, in operation 423 , the subject device 100 outputs a notification indicating that the operation time has arrived. As a result of confirming operation 421 , if the operation time does not arrive, the device 100 continuously checks whether the operation time has arrived.

5 is a flowchart illustrating a method of providing an artificial tooth treatment integrated solution service in an operator device according to an embodiment of the present invention.

Referring to FIG. 5 , in operation 501 , the operator apparatus 150 checks whether an acquisition signal for acquiring information about the operator is received from the outside. In this case, the acquisition signal may be generated through an input unit (not shown) provided in the operator's device 150 . As a result of checking operation 501, if an acquisition signal is received, the operator device 150 performs operation 503, and if the acquisition signal is not received, waits for reception of the acquisition signal.

In operation 503, the operator's device 150 acquires information about the operator. The recipient's information includes the recipient's name, the recipient's gender, the recipient's age, general medical history, tooth type, tooth number for the placement location that requires artificial tooth treatment, the recipient's face image, and a CT scan image of the recipient's head and an oral scan image of the inside of the mouth of the recipient. In this case, the face image may include at least one of a plurality of 2D images and 3D images. To this end, the operator's device 150 may be connected to an imaging device including a face imaging device (not shown), a CT imaging device (not shown), and an oral scanning device (not shown), or may include an imaging device. In operation 505, the operator's device 150 receives an opinion on the information about the operator obtained from the operator. In this case, operation 505 may be omitted.

In operation 507 , the operator apparatus 150 transmits the obtained operator information and the input opinion to the service apparatus 200 . To this end, the operator device 150 may perform communication such as wireless communication with the service device 200 . In operation 509 , the operator device 150 receives, from the service device 200 , consultation information based on the recipient information transmitted to the service device 200 . The operation of receiving the consultation information will be described in detail with reference to FIG. 6 . 6 is a detailed flowchart for explaining a method for receiving consultation information in the operator's device according to an embodiment of the present invention.

Referring to FIG. 6 , in operation 601 , the operator device 150 receives a registered image from the service device 200 , and in operation 603 , the operator apparatus 150 displays the received registered image on a display unit (not shown). The operator can check the nerve and bone shape information including the nerve of the mandibular alveolus, the shape of the maxillary sinus and anterior incisor hole, and the bone density through the registration image. The operator may proceed with a consultation related to the artificial tooth operation, such as at which position among the operator and the inside of the mouth of the operator, by using the displayed matching image. Although not shown, when a re-request signal for at least one image among a CT scan image and an oral scan image is received before the matching image is received from the service device 200, the operator's device 150 reloads at least one image. It may be photographed and transmitted to the service device 200 .

In operation 605 , the operator apparatus 150 receives the prediction image from the service apparatus 200 , and in operation 607 , the operator apparatus 150 displays the received prediction image on the display unit. The prediction image is an image that predicts the facial change of the recipient after the artificial tooth operation. More specifically, the prediction image is a registration image in which parts or all of the artificial teeth are virtually placed at at least one placement position to place the artificial teeth confirmed in the registration image, and the parts or all of the artificial teeth are placed. It may be an augmented reality (AR) image combined with a facial image of the subject. The operator may perform a consultation on the facial change of the operator after the operation of the operator and the artificial tooth is completed by using the displayed prediction image. In addition, in operation 605 , the operator device 150 may receive facial images before and after artificial tooth treatment of another operator whose treatment conditions are similar to those of the operator by more than a threshold.

In operation 609, the operator apparatus 150 receives the planning data from the service apparatus 200, and in operation 611, the operator apparatus 150 displays the received planning data on the display unit. The planning data is data necessary to operate an artificial tooth on the recipient, and means information about the placement of a fixture to be operated in the mouth of the recipient and drilling guide information. The implantation information of the fixture includes an implantation position at which the fixture is to be placed in the oral cavity, a standard including a diameter and length, an implantation direction, an implantation depth, a type of fixture, and the like. The drilling guide information includes information such as part numbers, types, images, names, etc. for a plurality of drilling devices used when forming a hole in which a fixture is to be placed, and insertion depth information indicating an insertion depth at a location where the fixture is to be placed. , including information on the order of use for a plurality of drilling devices. Based on the planning data, the operator may conduct a consultation on a fixture to be inserted into an implantation position requiring artificial tooth treatment, an abutment to be coupled with the fixture, and a crown to be coupled with the abutment. In particular, fixture placement information among the planning data may be displayed by being applied to the registration image.

In addition, in the embodiment of the present invention, it is described as an example that the matching image reception and display, the prediction image reception and display, and the planning data reception and display are sequentially operated as an example, but the present invention is not limited thereto. For example, the registered image, the prediction image, and the planning data may be displayed sequentially or temporarily after being received.

In operation 613 , when it is confirmed that the confirmation signal for the planning data received from the outside is received, the operator device 150 performs operation 617 . In operation 617 , the operator device 150 transmits a confirmation signal indicating that the planning data received from the service device 200 has been confirmed to the service device 200 , and returns to operation 511 of FIG. 5 .

In operation 613 , the operator device 150 performs operation 615 if a confirmation signal for the planning data received from the outside is not received. In operation 615 , the operator device 150 modifies the planning data received from the service device 200 and performs operation 617 . In operation 617 , the operator device 150 transmits the revised data that is the revised planning data to the service device 200 and returns to operation 611 of FIG. 5 . In this case, if the operator's device 150 corrects the planning data, the operator's apparatus 150 may modify and display the prediction image.

In operation 511 , the operator device 150 receives schedule information from the service device 200 . The schedule information is schedule information reflecting the production time of the prosthesis and the delivery time of the prosthesis according to the planning data. In operation 513, the operator's device 150 creates the operator's operation schedule based on the schedule information. To this end, the operator's device 150 may receive a treatment schedule from the operator, and may automatically create a treatment schedule based on schedule information and the treatment and treatment times of other patients waiting for treatment.

In operation 515 , the operator apparatus 150 transmits the generated operation schedule to the operator apparatus 100 . In addition, after generating the procedure schedule, the operator device 150 may update the procedure schedule in real time according to the delivery status of the prosthesis, the treatment of other recipients, and the progress of the procedure, and transmit it to the operator device 100 . In operation 517 , the operator apparatus 150 checks whether a schedule change request signal is received from the operator apparatus 100 . As a result of checking operation 517 , when a schedule change request signal is received, the operator device 150 performs operation 519 . In operation 519 , the operator apparatus 150 changes the operation schedule of the operator based on the schedule change request signal received from the apparatus 100 to be operated on and performs operation 521 . As a result of checking operation 517 , if the schedule change request signal is not received, the operator device 150 performs operation 521 .

In operation 521 , the operator device 150 checks whether the operation date of the operator, for example, the operation time has arrived, based on the operation schedule. As a result of confirming operation 521 , when the operation date arrives, in operation 523 , the operator device 150 outputs an alarm notifying that the operation date is an artificial tooth operation for the operator. Although not shown, the operator device 150 may display the planning data received from the service device 200 when performing artificial tooth surgery. As a result of checking operation 521 , if the operation date does not arrive, the operator apparatus 150 may periodically check whether the operation date has arrived.

7 is a flowchart for explaining a method of providing an artificial tooth treatment integrated solution service in a service apparatus according to an embodiment of the present invention.

Referring to FIG. 7 , in operation 701 , the control unit 220 checks whether or not the operator information is received from the operator device 150 . As a result of checking operation 701 , if the subject information is received, the control unit 220 performs operation 703 , and if the subject information is not received, the control unit 220 waits for reception of the subject information. At this time, the recipient information includes the name of the recipient, the gender of the recipient, the age of the recipient, the general medical history, the tooth type, the tooth number for the implantation location requiring artificial teeth, the face image of the recipient, and a CT scan of the recipient’s head It may include an image and an oral scan image of the inside of the mouth of the recipient. In this case, the face image may include at least one of a plurality of 2D images and 3D images. In addition, the operator information may include the operator's opinion on the operator input by the operator device 150 . In this case, the opinion of the operator may include precautions for artificial tooth operation according to the condition of the patient's gums, etc.

In operation 703, the controller 220 generates counseling information for the recipient. The operation of generating the consultation information will be described in detail with reference to FIG. 8 . 8 is a detailed flowchart illustrating a method of generating consultation information in a service apparatus according to an embodiment of the present invention.

Referring to FIG. 8 , in operation 801 , the controller 220 checks the data format of the CT scan image and the oral scan image. The controller 220 compares the data format of at least one of the CT scan image and the oral scan image with the matching standard data format. In operation 803, the controller 220 converts the data format of the CT scan image and the oral scan image into the same data format. Converts the data format of an image having a data format different from the registration standard data format to the registration standard data format. In general, since the CT scan image and the oral scan image have different file extensions, it is not easy to match them without data format conversion. Therefore, the controller 220 converts the same data format as the matching standard data format so that the quality of the CT image and the oral scan image does not deteriorate. To this end, the service device 200 may include a decoder (not shown).

In operation 805, the controller 220 checks whether the converted CT scan image and the oral scan image can be matched. For example, when the CT scan image and the oral scan image of the subject are acquired with at least one reference marker attached to the inside of the subject's oral cavity, the controller 220 controls each of the CT scan image and the oral scan image. Check the reference marker. In this case, the reference marker is a marker that is attached to the inside of the oral cavity of the person who wants to treat the artificial tooth, and may be attached to various parts such as the operation position of the artificial tooth, the gum, and the like. The controller 220 checks whether matching of the two images is possible using at least one reference marker included in each of the CT scan image and the oral scan image. In addition, if the CT scan image and the oral scan image of the subject are acquired without the reference marker attached to the inside of the subject's oral cavity, the control unit 220 selects at least one identical position in the CT scan image and the oral scan image. . The controller 220 may apply the generative reference marker to at least one selected same location and apply a depth map algorithm to the generated reference marker. The controller 220 may check the possibility of matching success by using the depth value for the same location calculated by applying the depth map algorithm.

As a result of checking operation 805, if the two images can be matched, the control unit 220 performs operation 811, and if the matching is not possible, the control unit 220 performs operation 807. In operation 807 , the controller 220 re-requests the CT scan image and the oral scan image to the operator device 150 . In operation 809, the controller 220 returns to operation 801 when the CT scan image and the oral scan image are re-received. In operation 809 , if the CT scan image and the oral scan image are not received again, the controller 220 returns to operation 807 and continuously requests the image to the operator device 150 again.

In operation 811 , the controller 220 matches the converted CT scan image with the oral scan image. The control unit 220 controls the oral scan image so that at least one reference marker included in the CT scan image and at least one reference included in the oral scan image can be superimposed at the same position to match the two images to perform operation 813. carry out More specifically, the controller 220 overlays the CT scan image and the oral scan image and displays them on the display unit. The controller 220 performs image analysis of the CT scan image and the oral scan image. The controller 220 may check at least one of the number of reference markers included in the CT scan image, the angle between the reference markers, the orientation of each reference marker, and the relative position of the reference markers through image analysis. In addition, the controller 220 may check at least one of the number of reference markers included in the oral scan image, the angle between the reference markers, the orientation of each reference marker, and the relative position of the reference markers through image analysis. In order to confirm the orientation of the reference marker, the reference marker may be formed in a spherical shape, a flat shape, a polygonal shape, a cylindrical shape, and other shapes, and the controller 220 checks the x, y, and z values based on the origin of the reference marker. direction can be checked.

According to the confirmation result, the control unit 220 should be present at the same position among the reference markers included in each image after the CT scan image and the oral scan image are overlaid and displayed, but the reference marker that does not exist in the same position is extracted do. The controller 220 controls the ratio, direction, and angle of the oral scan image in order to match the location of the extracted reference marker. The controller 220 may match the reference marker included in the oral scan image, which should exist at the same position as the reference marker included in the CT scan image, with each other through the control of the oral scan image. When the reference marker included in the CT scan image matches the reference marker included in the oral scan image, the controller 220 may generate one 3D matched image by matching the two images. After generating the registered image, the controller 220 selects a reference marker that may be at least one feature point from among reference markers included in the registered image. The controller 220 calculates a depth value of the selected reference marker. The controller 220 may improve the accuracy of the registered image by adjusting the calculated depth value for the reference marker. The controller 220 may check the dental information of the recipient from the registration image, and store it in the memory 210 as information about the recipient. In addition, image registration according to an embodiment of the present invention may be manually performed by input from a planner, or may be automatically performed by the controller 220 .

The control unit 220 matches the CT scan image and the oral scan image for which the success possibility of matching is confirmed by using the depth value for the same location calculated by applying the depth map algorithm. The controller 220 calculates depth values for a plurality of positions in the CT image, and selects a plurality of positions identical to the selected positions in the CT image from the oral scan image. The controller 220 controls the ratio, direction, and angle of the oral scan image so that the depth values for a plurality of positions in the selected oral scan image are the same as the depth values calculated from the CT scan image. The control unit 220 generates a registered image by matching the CT scan image and the oral scan image having the same depth value with the CT scan image.

In operation 813 , the controller 220 checks whether image matching is successful. As a result of checking operation 813 , if it is determined that image matching has failed, the controller 220 performs operation 807 . In operation 807 , the controller 220 re-requests at least one image in which an error has occurred among the CT scan image and the oral scan image to the operator device 150 . In operation 809, the controller 220 returns to operation 801 when at least one of the CT scan image and the oral scan image is re-received. In operation 809 , if the image is not received again, the controller 220 returns to operation 807 and continuously requests the image to the operator device 150 .

As a result of checking operation 813 , if it is confirmed that image matching is successful, the controller 220 performs operation 815 . In this case, the registration image is a three-dimensional image, and information about the nerve and bone shape including the nerve of the mandibular alveolus of the recipient, the shape of the maxillary sinus and the anterior incisor hole, and the bone density may be displayed. In operation 815 , the controller 220 generates a predicted image based on the registered image. A method of generating the prediction image will be described in detail with reference to FIG. 9 . 9 is a detailed flowchart for explaining a method of generating a prediction image in a service apparatus according to an embodiment of the present invention.

Referring to FIG. 9 , in operation 901 , the controller 220 calls big data for other recipients stored in the memory 210 . Big data is operation information about other recipients, name, gender, age, tooth type, tooth number for the placement location where artificial tooth treatment was performed, dental status, facial image, CT scan image, oral It may include scan images, registration images, planning data, and facial images before and after artificial tooth surgery. In operation 903 , the control unit 220 checks whether there is another subject whose information about the subject received in step 701 of FIG. 7 and the treatment condition are similar to or greater than a threshold value. At this time, the controller 220 compares and combines the information including the gender, age, tooth type, tooth number corresponding to the implantation position, and dental state of the recipient received in operation 701 from among the big data stored in the memory 210, partially comparing and combining It is possible to check whether there is another subject whose treatment conditions are similar to or more than a threshold.

As a result of checking operation 903 , if there is another subject whose information and treatment conditions are similar to or more than a threshold, the controller 220 performs operation 905 . In operation 905 , the controller 220 extracts the facial images before and after the artificial teeth of another operator and transmits the extracted facial images to the operator's device 150 . The operator of the operator device 150 may perform artificial tooth treatment consultation for the operator by using the facial images before and after the artificial tooth operation of another operator who has similar treatment conditions to the operator. For example, if the tooth number corresponding to the placement position at which the operator wants to proceed with the artificial tooth treatment is No. 23, the controller 220 transmits the facial images before and after the operation of the other recipient who has treated the artificial tooth at No. 23 to the operator device 150. can be transmitted In addition, when the tooth number corresponding to the implantation position at which the recipient wants to proceed with the artificial tooth treatment is No. 41 and No. 23, the control unit 220 controls the face of two other recipients who have treated the artificial teeth at No. 41 and No. 23 before and after the procedure. The image may be transmitted to the operator device 150 .

In operation 907, the controller 220 calls the planning data used in the artificial tooth operation of another recipient and performs operation 911. In this case, when the operator intends to operate artificial teeth at a plurality of placement positions, the controller 220 may call planning data related to a tooth number corresponding to each placement position. In operation 911, the control unit 220 generates a predicted image after the artificial tooth of the recipient and returns to operation 817 of FIG. 8 . In this case, the prediction image may be an augmented reality (AR) image capable of predicting a change in the face of the recipient after the artificial tooth operation.

As a result of checking operation 903 , if there is no other recipient whose information and treatment conditions are similar to or greater than a threshold, the controller 220 performs operation 909 . In operation 909, the control unit 220 generates planning data based on the matched image of the subject, and performs operation 911. In operation 911, the controller 220 applies the planning data to the facial image of the recipient to generate a predicted image after the surgery of the recipient's artificial teeth, and returns to step 817 of FIG. 8 .

In operation 817 , the controller 220 stores the registered image generated in FIG. 8 , the prediction image generated in FIG. 9 , and the planning data in the memory 210 , and performs operation 819 . In operation 819 , the controller 220 transmits the registered image, the prediction image, and the planning data to the operator device 150 , and returns to operation 705 of FIG. 7 .

In operation 705 , when it is confirmed that a confirmation signal for the planning data is received from the operator device 150 , the controller 220 performs operation 709 , and in operation 705 , the controller 220 receives a confirmation signal from the operator device 150 . If not confirmed, operation 707 is performed. In operation 707 , the controller 220 receives the correction data in which the planning data is corrected from the operator device 150 and performs operation 709 . In this case, the controller 220 may store the correction data as big data in the memory 210 .

In operation 709, the controller 220 generates schedule information. In this case, the schedule information may mean schedule information that is delivered to the operator by generating a prosthesis according to the planning data. In operation 711 , the controller 220 transmits the generated schedule information to the operator device 150 , and in operation 713 , the controller 220 generates a guide according to the schedule information. Although not shown, when the production of the prosthesis is completed based on the generated guide, the planner who is the manager of the service device 200 delivers the prosthesis to the operator who is the user of the operator device 150 by using a logistics system such as courier.

On the other hand, the embodiments of the present invention disclosed in the present specification and drawings are merely presented as specific examples to easily explain the technical contents of the present invention and help the understanding of the present invention, and are not intended to limit the scope of the present invention. That is, it will be apparent to those of ordinary skill in the art to which the present invention pertains that other modified examples can be implemented based on the technical spirit of the present invention.

Claims (9)

In the image registration service device for artificial teeth treatment that generates a registration image for artificial tooth treatment from a CT scan image and an oral scan image,
a data management unit that compares a data format of at least one of the CT scan image and the oral scan image with a standard matched data format, and converts the data format into the standard matched data format when different from the standard matched data format;
a matching work determination unit for confirming the possibility of successful image registration of the CT scan image and the oral scan image based on a preset image matching success criterion; and
and an image matching unit that registers the CT scan image and the oral scan image to generate a matched image for a person to be treated;
The image matching unit
Selecting a feature reference marker from among a plurality of reference markers included in the registered image, calculating a depth value of the feature reference marker, and adjusting the depth value of the feature reference marker to improve accuracy of the registered image
Image registration service device for artificial tooth treatment. According to claim 1,
The image matching unit,
When it is additionally confirmed that the predetermined automatic registration criteria of the CT photographed image and the oral scan image are satisfied by the registration determination unit, the image registration for artificial tooth surgery that automatically matches the CT photographed image and the oral scanned image by an automatic registration algorithm service device. 3. The method of claim 1 or 2,
The image matching unit,
An image matching service apparatus for artificial tooth surgery that overlays the CT scan image and the oral scan image and displays it, and extracts a specific reference marker from among at least one reference marker included in each image. 4. The method of claim 3,
The reference marker is
An image matching service device for artificial tooth surgery including at least one of an attachable reference marker attached to the inside of the mouth of the recipient or a generation type reference marker applied to the CT image and the oral scan image. 5. The method of claim 4,
The image matching unit,
An image matching service device for artificial tooth surgery that controls the ratio, direction, and angle of the oral scan image based on the extracted reference marker to overlap the specific reference marker to match the CT scan image and the oral scan image. delete According to claim 1,
The image matching success criterion is,
An image matching service apparatus for artificial tooth surgery, which is a criterion including at least one of whether the CT scan image and the oral scan image are of the same recipient, and whether at least one of the CT scan image and the oral scan image is inaccurate. According to claim 1,
The registered image is,
An image matching service device for artificial tooth surgery, which is a three-dimensional image displaying nerve and bone shape information including the nerve, maxillary sinus and anterior incisor shape and bone density of the mandibular alveolar of the recipient. In the image registration method for artificial tooth treatment for generating a registration image for artificial tooth treatment from a CT scan image and an oral scan image,
comparing a data format of at least one of the CT scan image and the oral scan image with a matching standard data format;
when at least one of the CT scan image and the oral scan image is different from the registered standard data format, converting it into the registered standard data format;
confirming the success possibility of image registration of the CT scan image and the oral scan image based on a preset image registration success criterion;
generating a registered image for a person to be treated by matching the CT scan image with the oral scan image;
selecting a feature reference marker from among a plurality of reference markers included in the registration image; and
Calculating the depth value of the feature reference marker and adjusting the depth value of the feature reference marker to improve the accuracy of the registration image
An image registration method for artificial teeth including a.

Images