KR102419010B1 - System for Providing of Procedure Information of Dental Implant, Doctor Apparatus thereof, and Method for Providing of Procedure Information of Dental Implant of using thereof - Google Patents

Abstract

The present invention relates to a system for providing artificial tooth treatment information, an operator device therefor, and a method for providing artificial tooth treatment information using the same. One or more of a video image taken for the operator, a registration image derived from the video image, an artificial tooth placement position, and a predicted image after artificial tooth treatment are provided to the operator according to the operator's selection, and when the artificial tooth treatment planning is established, planning data In consideration of one or more of the prosthesis production time, the delivery time of the prosthesis, the estimated time of the artificial tooth operation, and the schedule of the artificial tooth operator, the artificial teeth for the recipient It includes a procedure management unit that establishes a procedure schedule and provides it to the recipient, but when the planning data or the artificial tooth procedure schedule changes, it is reflected in the procedure consultation unit and the procedure management unit, so that the recipient can understand the artificial tooth treatment information and the artificial tooth treatment schedule in real time and can be applied to other embodiments.

Description

TECHNICAL FIELD The present invention relates to a system for providing information on artificial teeth procedure, an operator device therefor, and a method for providing information on artificial teeth using the same.

The present invention relates to a system for providing information on artificial teeth treatment, an operator device therefor, and a method for providing information on artificial teeth using the same, and an artificial tooth treatment information providing system for providing schedule information related to an artificial tooth treatment, an operator device therefor, and the same It relates to a method for providing information on artificial teeth treatment using.

In general, implant means a substitute that can replace human tissue when the original human tissue is lost, and in particular, in dentistry, including a fixture, an abutment, and a crown. It refers to implanting artificially made teeth using prostheses at the actual positions of teeth.

That is, the implant procedure is performed in the form of forming a perforation in the alveolar bone, placing a fixture in the perforation, and coupling the abutment and the crown to the fixture when the fixture is fused to the alveolar bone. The operator forms the perforation through various processes such as gum removal, alveolar bone positioning, planarization, initial hole formation and expansion, and thread formation. To this end, the operator provides the dental condition of the operator to the planner, and then uses the planning data, abutments, and crowns provided from the planner to operate the artificial teeth to the operator.

In the above case, since the operator must directly receive the planning data, abutment, crown, etc. for the artificial tooth operation of the recipient from the planner, time is consumed. In addition, there is a problem in that the recipient cannot check the schedule information of the artificial tooth procedure, so he has to endure the inconvenience of visiting the dentist multiple times.
(Patent Document 1) Korean Patent Publication No. 10-2016-0142142 (2016.12.12.)

Various embodiments of the present invention for solving these conventional problems transmit information related to the artificial tooth operation and the procedure schedule to the recipient device so that the recipient can check the information and the procedure schedule related to the artificial tooth operation of the recipient, and the recipient An object of the present invention is to provide a system for providing information on artificial teeth that can be changed by a device, a device for an operator therefor, and a method for providing information on artificial teeth using the same.

The artificial tooth operation information providing system according to an embodiment of the present invention is an artificial tooth operation information providing system including an operator device that provides artificial tooth operation information to a person to be operated on, the image image taken for the person to be operated on, the image One or more of the matched image derived from the image, the artificial tooth placement position, and the predicted image after the artificial tooth operation is provided to the operator according to the operator's selection, and when the artificial tooth operation planning is established, the planning data is provided to the operator In consideration of one or more of a prosthesis production time, delivery time of the prosthesis, an artificial tooth operation expected time, and an artificial tooth operator schedule according to the part and the planning data, the artificial tooth operation schedule for the person to be operated on according to the planning data Including a procedure management unit established and provided to the recipient, when the planning data or the artificial tooth procedure schedule is changed, it is reflected in the procedure consultation unit and the procedure management unit, so that the recipient can use the artificial tooth treatment information and the artificial tooth treatment schedule enable real-time visibility.

The apparatus further includes a receiver device that is communicatively connected with the operator's device to receive and display at least one of the artificial tooth consultation result, the artificial tooth treatment planning, and the artificial tooth treatment schedule.

In addition, if it is confirmed based on the procedure schedule, the device to be operated on outputs an alarm when the treatment time arrives.

In addition, the operator device transmits the operator's opinion on at least one of the artificial tooth operation planning and the artificial tooth operation schedule to the operator device.

Also, when it is confirmed from the operator device that the artificial tooth operation schedule is changed according to the operator's opinion, the operator device outputs an alarm when an operation time corresponding to the artificial tooth operation schedule arrives.

In addition, the prosthesis includes a fixture to be placed in the oral cavity of the recipient for the artificial tooth treatment, an abutment coupled to the fixture, and a crown coupled to the abutment.

In addition, the planning data includes the standard of the fixture including the implantation position, diameter and length of the fixture to be implanted in the oral cavity, the implantation direction of the fixture, the implantation depth, and the type of the fixture. It is the placement information of the fixture.

In addition, the method for providing artificial tooth operation information according to an embodiment of the present invention includes at least one of an image image taken for the subject, a registration image derived from the image image, an artificial tooth placement position, and a prediction image after artificial tooth operation The operation of providing to the device for the recipient according to the operator’s selection, the operation of providing the planning data to the device for the recipient when the artificial tooth surgery planning is established, and the production of a prosthesis for the artificial tooth treatment of the recipient according to the planning data Time, the delivery time of the prosthesis, an operation of establishing an artificial tooth treatment schedule for the recipient in consideration of one or more of an artificial tooth treatment expected time and an artificial tooth operator schedule and transmitting the schedule data to the recipient device and the planning data or the artificial tooth and changing the artificial tooth operation information and the artificial tooth operation schedule in real time when the operation schedule is changed, and transmitting the information to the device to be operated on.

As described above, the artificial tooth operation information providing system, the operator device therefor, and the artificial tooth operation information providing method using the same according to the present invention allow the operator to check information related to the operator's artificial tooth operation and the operation schedule, so that the operator can It is possible to check the remaining waiting time and to eliminate the hassle of having to visit the dentist multiple times.

In addition, the system for providing artificial tooth treatment information according to the present invention, an operator device therefor, and a method for providing artificial tooth treatment information using the same, include a method in which a recipient checks a treatment schedule related to his or her artificial tooth treatment, and a treatment schedule according to his/her own schedule By changing the , there is an effect that can minimize the time consumed in the artificial tooth operation from the point of view of the recipient.

1 is a view showing a system for providing an integrated solution service for artificial teeth treatment according to an embodiment of the present invention.
FIG. 2 is a diagram schematically illustrating a procedure of providing an artificial tooth treatment integrated solution service according to an embodiment of the present invention.
3 is a flowchart illustrating a method of providing an artificial tooth treatment integrated solution service according to an embodiment of the present invention.
4 is a flowchart illustrating a method of providing an artificial tooth treatment integrated solution service in a device to be operated on according to an embodiment of the present invention.
5 is a flowchart for explaining a method of providing an artificial tooth treatment integrated solution service in an operator device according to an embodiment of the present invention.
6 is a detailed flowchart for explaining a method for receiving consultation information in the operator's device according to an embodiment of the present invention.
7 is a flowchart for explaining a method of providing an artificial tooth treatment integrated solution service in a service apparatus according to an embodiment of the present invention.
8 is a detailed flowchart illustrating a method of generating consultation information in a service apparatus according to an embodiment of the present invention.
9 is a detailed flowchart for explaining a method of generating a prediction image in a service apparatus according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in more detail with reference to the accompanying drawings. In this case, it should be noted that in the accompanying drawings, the same components are denoted by the same reference numerals as much as possible. In addition, detailed descriptions of well-known functions and configurations that may obscure the gist of the present invention will be omitted.

1 is a view showing a system for providing an integrated solution service for artificial teeth treatment according to an embodiment of the present invention.

Referring to FIG. 1 , the service providing system 10 according to the present invention includes a subject device 100 , an operator device 150 , and a service device 200 .

The recipient device 100 may be a portable device used by a patient (hereinafter, referred to as a recipient) visiting a hospital, particularly a dentist, or a device provided in a hospital lobby and operated by the recipient. The operator's device 100 communicates with the operator's device 150 . To this end, the recipient device 100 performs wireless communication such as long term evolution advanced (LTE-A), long term evolution (LTE), wireless fidelity (Wifi), Bluetooth, and BLE (bluetooth low energy). can

When the recipient device 100 is provided in a hospital lobby, etc., the recipient device 100 may be a device that the recipient can use, such as a computer, a laptop computer, or a tablet PC. The recipient may be authenticated by inputting the recipient's unique information, such as a resident registration number, into the recipient device 100 . When the recipient device 100 is a portable device, the portable device may be a device that the recipient can carry, such as a smart phone, a portable terminal, or a tablet PC. In addition, an application capable of communicating with the operator's apparatus 150 may be installed in the operator's device 100 . The recipient can log in to the application and receive authentication.

The recipient device 100 may display the recipient information obtained from the operator device 150 after authentication is completed. The operator's device 100 may display the operator's opinion input by the operator's device 150 after the operator examines the operator's information. The operator's device 100 may display consultation information that has been checked by the operator's device 150 . The operator device 100 may input a change request for consultation information received from the operator device 150 and transmit it to the operator device 150 . In this case, the change request may include selection of a type for the prosthesis.

The operator device 100 may display the operation schedule of the operator generated by the operator device 150 . The operator's device 100 may transmit a change signal for the procedure schedule to the operator's device 150 according to the operator's input. When the treatment time corresponding to the treatment schedule arrives, the device 100 may output a notification indicating this.

The operator's device 150 is a device used by a doctor (hereinafter, referred to as an operator) working in a hospital, particularly a dentist, and may be a device such as a computer, a laptop computer, or a tablet PC. The operator device 150 is a long term evolution advanced (LTE-A), long term evolution (LTE), wireless fidelity (Wifi), Bluetooth (bluetooth), BLE (bluetooth low energy), etc. of wireless communication can be performed. In addition, the operator device 150 for communication with the service device 200, LTE-A (long term evolution advanced), LTE (long term evolution), Wifi (wireless fidelity), WCDMA (wideband code division multiple access), such as Wireless communication can be performed.

The operator apparatus 150 transmits the operator information including the CT scan image and the oral scan image of the operator to the service apparatus 200 through communication with the service apparatus 200 . The operator device 150 receives, from the service device 200 , a matched image of a CT scan image and an oral scan image of a person to be treated, a prediction image after artificial tooth treatment, and planning data for artificial tooth treatment. To this end, the operator device 150 includes an information acquisition unit 151 , a procedure consultation unit 153 , and a procedure management unit 155 .

The information acquisition unit 151 acquires the information of the operator by the operator's input. The recipient’s information includes the recipient’s name, recipient’s gender, recipient’s age, general medical history, tooth type, tooth number corresponding to the placement location requiring artificial tooth treatment, facial image of the recipient, and CT ( computed tomography) may include a photographed image and an oral scan image photographed inside the mouth of the recipient. In this case, the face image may include at least one of a plurality of 2D images and 3D images. The information acquisition unit 151 transmits the subject information to the service device 200 .

To this end, the operator's device 150 may be connected to an imaging device including a face imaging device (not shown), a CT imaging device (not shown), and an oral scanning device (not shown), or may include an imaging device. The information acquisition unit 151 may acquire the opinion of the operator on the information of the operator input from the operator.

The information acquisition unit 151 generates an electronic chart by using the acquired information and opinions of the subject. The information acquisition unit 151 transmits the recipient's information or an electronic chart generated based on the recipient's information to the service device 200 .

The operation consultation unit 153 displays at least one of the consultation information received from the service device 200, that is, the matching image, the predicted image after the artificial tooth operation, and the planning data for the artificial tooth operation to the recipient for the artificial tooth operation. Provides consulting services. In this case, the planning data includes implantation information of a fixture to be operated in the mouth of the recipient for artificial tooth treatment. The implantation information of the fixture includes an implantation position at which the fixture will be placed in the oral cavity, a standard including a diameter and length, an implantation direction, an implantation depth, a type of fixture, and the like. In this case, the fixture is one of the parts of the artificial tooth, and the part of the artificial tooth may be a prosthesis including a fixture, an abutment that can be coupled to the fixture, and a crown that can be coupled with the abutment.

The registered image is a 3D image generated by the service device 200 matching the CT image and the oral scan image immediately upon receiving the CT image and the oral scan image from the operator device 150 . The operator can check the nerve and bone shape information including the nerve of the mandibular alveolus, the shape of the maxillary sinus and anterior incisor hole, and the bone density through the registration image. The operation consultation unit 153 displays the registration image, and the operator may perform a consultation related to the artificial tooth operation, such as whether the artificial tooth is to be implanted at any position in the mouth of the operator and the operator using the displayed matching image.

When a re-request signal for at least one image among a CT scan image and an oral scan image is received from the service device 200 , the procedure consultation unit 153 activates the information acquisition unit 151 to retake at least one image After that, it can be transmitted to the service device 200 .

The prediction image is an image that predicts the facial change of the recipient after the artificial tooth operation. More specifically, the prediction image is an augmented reality in which at least one prosthesis image is virtually placed at at least one placement position to place an artificial tooth identified in the registration image, and the registered image in which the prosthesis image is placed is combined with the face image of the recipient. It may be an augmented reality (AR) image. The operation consultation unit 153 displays a predicted image, and the operator may perform a consultation on the facial change of the operator after the operation of the artificial tooth with the operator is completed by using the displayed predicted image.

In addition, the procedure consultation unit 153 may receive the facial images before and after artificial tooth treatment of another subject whose treatment conditions are similar to those of the subject by more than a threshold. The operator may use the facial images before and after the artificial tooth operation of another operator to consult about the facial changes of another operator who has similar treatment conditions to the operator. In this case, the facial images before and after the artificial tooth surgery may be at least one of a 2D image and a 3D image.

The planning data is data necessary to operate artificial teeth on the recipient, and means placement information and drilling guide information of a fixture to be operated in the recipient's oral cavity, which is designed by an administrator of the service device 200, for example, a planner. is created The implantation information of the fixture includes an implantation position at which the fixture will be placed in the oral cavity, a standard including a diameter and length, an implantation direction, an implantation depth, a type of fixture, and the like. The drilling guide information includes information such as part numbers, types, images, names, etc. for a plurality of drilling devices used when forming a hole in which a fixture is to be placed, and insertion depth information indicating an insertion depth at a location where the fixture is to be placed. , and includes use order information for a plurality of drilling devices.

The fixture placement information among the planning data may be displayed by being applied to the registration image. In addition, the drilling guide information may be displayed as text data for an image and usage for a drill device for drilling. Based on the planning data, the operator may perform a consultation on a fixture to be inserted into an implantation position requiring artificial tooth treatment, an abutment to be coupled to the fixture, and a crown to be coupled to the abutment.

The operation management unit 155 receives a consultation result from the operator after the operation consultation unit 153 provides a consultation service to the operator. The procedure management unit 155 may transmit a confirmation signal or correction data for the planning data to the service device 200 based on the inputted consultation result. When the correction data is generated, the procedure management unit 155 may correct and display the prediction image based on the correction data. In addition, when the procedure management unit 155 transmits the correction data to the service device 200 , the procedure consultation unit 153 may receive and display the predicted image corrected by the service device 200 based on the correction data.

After transmitting the confirmation signal or correction data to the service device 200 , the procedure management unit 155 may receive schedule information from the service device 200 . The schedule information refers to schedule information generated by the service device 200 based on a production time and a delivery time of a prosthesis required for an artificial tooth operation of a recipient based on the planning data.

The procedure management unit 155 creates a procedure schedule for the recipient based on the received schedule information. The procedure schedule may be generated by the operator's input, and may be generated based on schedule information received from the service device 200, treatment and treatment times of other patients waiting for treatment, and the like. In this case, the procedure schedule is a schedule that can be performed in one-day from the time the information of the recipient is acquired by the information acquisition unit 151 to the procedure of the recipient.

The procedure management unit 155 transmits the generated procedure schedule to the recipient device 100, updates the procedure schedule in real time according to the delivery status of the prosthesis, the treatment of other recipients, and the progress of the procedure, and transmits it to the device 100. have. For example, the procedure management unit 155 may create a procedure schedule by allocating the estimated time required for each operation, such as the delivery status of the prosthesis, the treatment of other recipients, and the progress of the procedure. At this time, if the time required for each operation is longer than the expected time, the procedure management unit 155 may reflect this and regenerate the procedure schedule. Also, when the time required for each operation is shorter than the expected time, the procedure management unit 155 may reflect this and regenerate the procedure schedule.

When a schedule change request signal is received from the device 100 to be operated on, the procedure management unit 155 may change the generated procedure schedule. When the operation time of the recipient arrives based on the procedure schedule, the procedure management unit 155 may output an alarm informing that it is the time of the artificial tooth operation for the recipient.

The service device 200 is a device used by a planner to design planning data required for artificial tooth treatment for a recipient, and may be a device such as a computer, a laptop computer, or a tablet PC. The service device 200 performs wireless communication such as long term evolution advanced (LTE-A), long term evolution (LTE), wireless fidelity (Wifi), and wideband code division multiple access (WCDMA) for communication with the operator device 150 . can be performed.

The service device 200 communicates with the operator device 150 that acquires information about the operator including a facial image, a CT scan image, and an oral scan image for the operator, and provides consultation and artificial tooth treatment planning for the operator. We provide an integrated solution service for artificial teeth surgery that includes To this end, the service device 200 largely includes a memory 210 and a control unit 220 , and the memory 210 includes a big data storage unit 210a and a digital library 210b. The control unit 220 includes a data management unit 220a, a matching work determination unit 220b, an image matching unit 220c, a diagnosis unit 220d, a virtual arrangement unit 220e, a planning unit 220f, and a schedule generating unit 220g. and a guide generating unit 220h. In addition, although not shown, the service device 200 may additionally include an input unit for receiving an input from a planner, a display unit capable of displaying a screen according to an operation, and the like.

The big data storage unit 210a stores the operator information received from the operator device 150 as big data. In addition, the big data storage unit 210a may store a registered image generated by matching a CT scan image and an oral scan image included in the subject information, a facial image generated based on the registered image, and planning data. In addition, the big data storage unit 210a may store facial images of the recipient before and after artificial tooth surgery.

The digital library 210b is an image of the prosthesis, for example, a fixture image of at least one fixture, an abutment image of a plurality of abutments that can be coupled to the fixture, and an image of a crown that can be coupled to the abutment. may include

The data management unit 220a stores the subject information received from the operator device 150 in the big data storage unit 210a. In this case, the operator's opinion may be included in the operator's information. The recipient information includes the recipient’s name, the recipient’s gender, the recipient’s age, the general medical history, the tooth type, the tooth number corresponding to the placement location that requires artificial tooth treatment, the recipient’s face image, and a CT scan image of the recipient’s head and an oral scan image of the inside of the mouth of the recipient. In this case, the face image may include at least one of a plurality of 2D images and 3D images.

The data management unit 220a checks the data format of the CT scan image and the oral scan image among the subject information. The data management unit 220a compares the data format of at least one of the CT scan image and the oral scan image with the matching standard data format. The data management unit 220a converts the data format of an image having a data format different from the matching standard data format into the matching standard data format. In general, since the CT scan image and the oral scan image have different file extensions, it is not easy to match them without data format conversion. Accordingly, the data management unit 220a converts the same data format as the matching standard data format so that the quality of the CT scan image and the oral scan image does not deteriorate. The data management unit 220a provides the CT scan image and the oral scan image in which the data format has been converted, to the consistency work determination unit 220b.

The matching work determination unit 220b checks whether the converted CT scan image and the oral scan image can be matched. For example, when the CT scan image and the oral scan image of the subject are acquired with at least one reference marker attached to the inside of the subject's oral cavity, the conformity determination unit 220b is at least included in each of the CT scan image and the oral scan image. Identifies one reference marker. In this case, the reference marker is a marker that is attached to the inside of the mouth of the person who wants to treat the artificial tooth, and may be attached to various parts, such as the operation position of the artificial tooth, the gum, and the like. The matching work determination unit 220b confirms the possibility of success in matching the two images by using at least one reference marker included in each of the CT scan image and the oral scan image. For example, the matching work determination unit 220b may check the matching success possibility based on the number of at least one reference image included in each image.

When the CT scan image and the oral scan image of the recipient are obtained in a state in which the reference marker is not attached to the inside of the oral cavity, the conformity determination unit 220b selects at least one identical position from the CT scan image and the oral scan image. The consistency determination unit 220b may apply a generative reference marker to at least one selected same location, and apply a depth map algorithm to the generative reference marker. The matching work determination unit 220b may check the possibility of matching success by using the depth value for the same location calculated by applying the depth map algorithm.

If the matching success probability for the two images is less than a threshold value, the matching work determination unit 220b determines that matching is impossible, and requests the CT scan image and the oral scan image again to the operator device 150 . Conversely, if the matching success probability for the two images exceeds the threshold, the matching completion determination unit 220b determines that matching is possible, and provides the two images to the image matching unit 220c. The matching work determination unit 220b checks the image matching success possibility based on a preset image matching success criterion. In this case, the criteria for success in image registration are whether at least one reference marker included in each of the CT scan image and the oral scan image is the same, whether the CT scan image and the oral scan image are images of the same subject, and the CT scan image and oral scan image. It may be at least one of whether at least one of the scanned images is inaccurate, and whether the depth value calculated by applying the depth map algorithm to the same position of the CT image and the oral scan image is the same.

The image matching unit 220c matches the two images confirmed to be able to be matched by the matching completion judgment unit 220b, that is, a CT scan image and an oral scan image. The image matching unit 220c may perform automatic registration of the CT image and the oral scan image by an automatic registration algorithm, and may perform registration by input from a planner.

The image matching unit 220c matches the two images by controlling the oral scan image so that at least one reference marker included in the CT scan image and at least one reference included in the oral scan image overlap at the same position. More specifically, the image matching unit 220c displays the CT scan image and the oral scan image overlaid on the display unit. The image matching unit 220c performs image analysis of the CT scan image and the oral scan image. The image matching unit 220c may check at least one of the number of reference markers included in the CT scan image, the angle between the reference markers, the orientation of each reference marker, and the relative position of the reference markers through image analysis. In addition, the image matching unit 220c may check at least one of the number of reference markers included in the oral scan image, the angle between the reference markers, the orientation of each reference marker, and the relative position of the reference markers through image analysis. . In order to confirm the orientation of the reference marker, the reference marker may be formed in a spherical shape, a flat shape, a polygonal shape, a cylindrical shape, and other shapes. You can check the direction by checking.

According to the confirmation result, the image matching unit 220c should be present at the same position among the reference markers included in each image after overlaying the CT scan image and the oral scan image, but a reference marker that does not exist at the same position to extract The image matching unit 220c controls the ratio, direction, and angle of the oral scan image in order to match the location of the extracted reference marker. The image matching unit 220c may match the reference marker included in the oral scan image, which should exist in the same position as the reference marker included in the CT scan image, with each other through the control of the oral scan image. When the reference marker included in the CT scan image and the reference marker included in the oral scan image match, the image matching unit 220c may generate one 3D registered image by matching the two images. After generating the registered image, the image matching unit 220c selects a reference marker that can be at least one feature point from among reference markers included in the registered image. The image matching unit 220c calculates a depth value of the selected reference marker. The image matching unit 220c may improve the accuracy of the registered image by adjusting the calculated depth value for the reference marker. The image matching unit 220c may check the dental information of the recipient from the matching image, and may store it in the big data storage unit 210a as information about the recipient.

The image matching unit 220c matches the CT scan image and the oral scan image in which the success possibility of matching is confirmed by using the depth value for the same location calculated by applying the depth map algorithm. The image matching unit 220c calculates depth values for a plurality of positions in the CT scan image, and selects a plurality of positions identical to the plurality of positions selected in the CT scan image from the oral scan image. The image matching unit 220c controls the ratio, direction, and angle of the oral scan image so that the depth values for a plurality of positions in the selected oral scan image are the same as the depth values calculated from the CT scan image. The image matching unit 220c creates a registered image by matching the CT scan image and the oral scan image having the same depth value with the CT scan image.

When the image matching is successful, the image matching unit 220c provides the matched images to the diagnosis unit 220d and the virtual arrangement unit 220e, respectively. In this case, the registration image is a three-dimensional image, and information about the nerve and bone shape including the nerve of the mandibular alveolus, the shape of the maxillary sinus and the anterior incisor hole, and the bone density may be displayed. Conversely, if it is confirmed that the image registration has failed, the image matching unit 220c re-requests at least one image in which an error has occurred among the CT scan image and the oral scan image to the operator device 150 .

The diagnosis unit 220d is the operator's device so that, when it is confirmed that there is a treatment to be preceded prior to the artificial tooth operation from at least one of a CT scan image, an oral scan image, and a registration image of the subject, the confirmed treatment can be preceded. (150) may provide information on this. In addition, if the CT scan image and the oral scan image of the subject are pre-stored in the big data storage unit 210a, the diagnosis unit 220d compares the acquired CT scan image and the oral scan image with the pre-stored images to make artificial You can check if there is any treatment that must be preceded by dental surgery. When it is confirmed that there is a treatment to be preceded prior to the artificial tooth operation, the diagnosis unit 220d may provide information about this to the operator device 150 so that the confirmed treatment may be preceded.

The virtual arrangement unit 220e includes a consultation arrangement unit 221 for generating a predictive image capable of confirming facial changes of the recipient after artificial tooth treatment, a planning arrangement unit 222 for performing treatment planning for the recipient, and It may include a virtual treatment unit 223 that virtually operates the prosthesis on the matching image.

Based on the big data storage unit 210a, the consultation arrangement unit 221 confirms the existence of another subject whose treatment conditions are similar to that of the subject. As a result of the confirmation, if there is another subject with similar treatment conditions to the subject, the consultation arrangement unit 221 calls the facial images before and after artificial tooth treatment of the other subject from the big data storage unit 210a to the operator device 150. send. Conversely, if there is no other operator having similar treatment conditions to the operator, the consultation arrangement unit 221 generates a prediction image for the operator and transmits it to the operator apparatus 150 .

To this end, the consultation arrangement unit 221 calls the big data for other recipients stored in the big data storage unit 210a. Big data is operation information about other recipients, name, gender, age, tooth type, tooth number corresponding to the placement location where artificial tooth treatment was performed, dental status, facial image, CT scan image, It may include oral scan images, registration images, planning data, and facial images before and after artificial tooth surgery.

The consultation arrangement unit 221 confirms the existence of another subject whose information and treatment conditions are similar to those of the subject. At this time, the consultation arrangement unit 221 partially compares and combines the treatment conditions including the sex, age, tooth type, implantation position, and dental state of the person to be treated among the big data stored in the big data storage unit 210a to determine the treatment conditions. It is possible to check the existence of other subjects similar to the threshold or more.

The consultation arrangement unit 221 extracts facial images before and after artificial tooth treatment of another subject when there is another subject whose information and treatment conditions are similar to or more than a threshold, and transmits the extracted facial images to the operator device 150 . If the tooth number corresponding to the implantation position at which the operator wants to proceed with the artificial tooth treatment is No. 23, the consultation placement unit 221 displays the facial image before and after the treatment of the other recipient who has treated the artificial tooth at No. 23 by the operator device 150 can be sent to In addition, when the tooth number for which the recipient wants to undergo artificial tooth treatment is No. 41 and No. 23, the consultation placement unit 221 provides a facial image before and after the procedure of one other recipient who has treated all of the artificial teeth at No. 41 and No. 23 may be transmitted to the operator device 150 . In addition, when the tooth number for which the recipient wants to undergo artificial tooth treatment is No. 41 and No. 23, the consultation placement unit 221 provides facial images before and after the procedure of two other recipients who have treated artificial teeth at No. 41 and No. 23, respectively. may be transmitted to the operator device 150 .

The consultation arrangement unit 221 may generate a predictive image for the recipient by using the planning data (eg, planning data in which the fixture implantation information is applied to the matching image) of other recipients whose treatment conditions are similar to those of the recipient by more than a threshold. More specifically, the consultation arrangement unit 221 extracts a partial image corresponding to the placement position of the recipient from the planning data of the other recipient. The consultation arrangement unit 221 generates a predicted image of the recipient by using the extracted partial image. In this case, the prediction image may be an augmented reality (AR) image capable of predicting a change in the recipient's face after artificial tooth treatment.

For example, if the tooth number corresponding to the placement position at which the recipient wants to proceed with the artificial tooth treatment is 23, the consultation placement unit 221 may correspond to the placement position in the planning data of another recipient who has operated the artificial tooth at No. 23 Extract a partial image. In addition, if the tooth number corresponding to the implantation position at which the recipient wants to proceed with the artificial tooth treatment is No. 41 and No. 23, the consultation placement unit 221 is the planning of another recipient who has treated the artificial tooth at No. 41 and No. 23 It is possible to extract a partial image corresponding to the implantation position from the data. Also, the consultation arrangement unit 221 may extract a partial image corresponding to an implantation position from the planning data of different recipients who have treated artificial teeth in Nos. 41 and 23, respectively. The consultation arrangement unit 221 combines the extracted partial image with the registered image of the recipient. The consultation arrangement unit 221 generates a prediction image by combining the registered image to which the partial image is combined and the face image of the recipient. The consultation arrangement unit 221 provides the planning data of another recipient used when generating the prediction image to the planning arrangement unit 222 .

As a result of the check, if there is no other recipient with similar operating conditions to the recipient, the consultation placement unit 221 virtually arranges the image of the part or the entire artificial tooth in the matched image of the recipient. The consultation arrangement unit 221 generates a predictive image by combining a registered image in which an image of a part or an entire artificial tooth is virtually arranged with the face image of the recipient.

In this case, when the facial image is a plurality of 2D images, the consultation arrangement unit 221 may generate a 3D image by combining the plurality of 2D images. To this end, the consultation arrangement unit 221 may combine a plurality of 2D images by using respective feature points included in the plurality of 2D images to generate a single 3D image. The consultation arrangement unit 221 may generate a prediction image by applying a registration image in which an image of a part or an entire artificial tooth is virtually arranged to the 3D image.

In addition, when the facial image is a 2D image obtained from the front of the recipient, the consultation arrangement unit 221 overlays the 2D image with a matching image in which the image of the part or the entire artificial tooth is virtually displayed. The consultation arrangement unit 221 generates a prediction image by matching the registration image in which the image of parts or the whole of the artificial tooth is virtually placed on the basis of the feature point identified from the face image of the person to be treated in the overlaid displayed state. can In this case, the consultation arrangement unit 221 may calculate the depth in the 2D image using a depth map algorithm. The consultation placement unit 221 generates a virtual 3D image based on the calculated depth, and applies a registered image in which an image of a part or an entire artificial tooth is virtually placed to the generated 3D image to generate a predicted image. have.

In addition, when the facial image is a 3D image, the consultation arrangement unit 221 may generate a prediction image by combining the 3D image with the registration image in which the image of the part or the entire artificial tooth is virtually arranged.

The placement unit 222 for planning confirms an implantation position requiring artificial tooth treatment in the registration image. The planning arrangement unit 222 selects a fixture image that can be arranged at the confirmed placement position from among a plurality of fixture images stored in the digital library 210b. The planning arrangement unit 222 virtually arranges the selected fixture image on the registration image. The planning arrangement unit 222 may select and adjust the fixture image to be customized to the recipient.

The planning arrangement unit 222 provides the registered image on which the fixture image is arranged to the virtual treatment unit 223 . The virtual operation unit 223 may virtually arrange an image for an abutment coupled to the fixture on the fixture image. Also, the virtual treatment unit 223 may virtually arrange an image of a crown coupled to the abutment on the abutment image.

The planning arrangement unit 222 provides information on the parts or the entire image of the artificial tooth arranged in the registration image, for example, information on placement of a fixture corresponding to the fixture image to the planning unit 220f. In this case, the implantation information of the fixture may be an implantation position at which the fixture is to be placed, a standard including a diameter and length, an implantation direction, an implantation depth, a type of fixture, and the like. When a confirmation signal for the planning data is received from the operator's device 150 or the revised data of the planning data is received from the operator's device 150, the planning arrangement unit 222 provides it to the planning unit 220f. can

The planning arrangement unit 222 arranges the part or the entire image of the artificial tooth corresponding to the planning data of another subject provided by the consultation arrangement unit 221 in the matched image of the subject. The planning arrangement unit 222 provides the planning unit 220f to generate planning data suitable for the person to be operated on based on the information on the part or the entire image of the artificial tooth arranged in the registration image.

The planning unit 220f generates planning data based on the fixture placement information provided from the planning arrangement unit 222 . The planning data means placement information and drilling guide information of a fixture to be operated in the mouth of the recipient. The drilling guide information includes information such as part numbers, types, images, names, etc. for a plurality of drilling devices used when forming a hole in which a fixture is to be placed, and insertion depth information indicating an insertion depth at a location where the fixture is to be placed. , and includes use order information for a plurality of drilling devices.

The planning unit 220f confirms or corrects the planning data when a confirmation signal for the planning data is received or the correction data is received from the planning arrangement unit 222, and generates the planning data by the schedule generating unit 220g and the guide generating unit 220h. The planning unit 220f may store the generated or modified planning data in the big data storage unit 210a.

The schedule generator 220g generates schedule information. The schedule information is a schedule in which the production time of the prosthesis according to the planning data and the delivery time of the manufactured prosthesis are taken into consideration. The prosthesis includes an abutment coupled to a fixture corresponding to the fixture image and a crown coupled to the abutment. In addition, the schedule information may be considered together with a production time and delivery time for a surgical guide that provides a guide necessary for forming a perforation for placing a fixture. The schedule generator 220g transmits the generated schedule to the operator device 150 .

The guide generating unit 220h generates a guide for all or parts of an artificial tooth required for an artificial tooth operation based on the planning data. In particular, the guide generating unit 220h may generate an image of the crown among the artificial tooth parts. In addition, the guide generating unit 220h may generate an image for the surgical guide.

The guide generating unit 220h may transmit the generated image of the crown and the image of the surgical guide to an external device such as a 3D printer (not shown). Accordingly, the service device 200 may perform wireless or wired communication with an external device. The service device 200 is a wired using a USB cable or wireless communication such as LTE-A (long term evolution advanced), LTE (long term evolution), Wifi (wireless fidelity), Bluetooth (bluetooth), BLE (bluetooth low energy), etc. communication and the like. When the production of parts or all of the artificial tooth and the surgical guide by the external device is completed, the planner delivers it to the operator who is the user of the operator's device 150 by using a logistics system such as a delivery service.

In addition, in the exemplary embodiment of the present invention, it is described that the service device 200 generates the registered image, but the present invention is not limited thereto. When the specifications of the operator's device 150 are sufficiently supported, the registration image generation may be performed by the operator's device 150 .

FIG. 2 is a diagram schematically illustrating a procedure of providing an artificial tooth treatment integrated solution service according to an embodiment of the present invention.

Referring to FIG. 2 , in operation 201 , the operator device 150 acquires information about a person who wants to operate an artificial tooth. In operation 203, the service device 200 automatically registers the CT scan image and the oral scan image included in the subject information to generate a registered image. In operation 205 , the service device 200 generates an augmented reality image using the facial image of the recipient included in the recipient information to generate a predicted image representing a change in the recipient's face after the artificial procedure.

In operation 207 , the operator's device 150 performs a consultation with the operator by using the matched image and the predicted image generated by the service apparatus 200 . In operation 209, the service device 200 generates planning data, and the operator device 150 checks the planning data.

In operation 211 , the service device 200 manufactures a prosthesis based on the planning data when the operator device 150 completes the inspection of the planning data. In operation 213, the service device 200 stores the registered image, the predicted image, and the planning data. In operation 215 , the operator of the operator apparatus 150 performs an artificial tooth operation of the operator based on the planning data and the manufactured prosthesis. In this case, the prosthesis includes all or parts of an artificial tooth including an abutment coupled to a fixture corresponding to the fixture image and a crown coupled to the abutment. In addition, the operator may form a perforation in the oral cavity of the recipient by using a surgical guide that provides a guide necessary for forming a perforation for placing the fixture. As described above, steps 201 to 215 can be performed within 24 hours from the time when the recipient visits the hospital, so that the artificial tooth treatment can be performed during one-day.

3 is a flowchart illustrating a method of providing an artificial tooth treatment integrated solution service according to an embodiment of the present invention.

Referring to FIG. 3 , in operation 301 , the operator device 150 acquires information about the operator, and in operation 303 , the operator uses an input unit (not shown) to input an opinion on the information about the operator. In operation 305 , the operator device 150 transmits information and opinions of the recipient to the service device 200 , and in operation 307 , the operator device 150 transmits information and opinions of the recipient to the device 100 . In operation 309, the subject device 100 displays an electronic chart in which opinions are input based on a signal received from the subject.

In operation 311, the service device 200 generates consultation information for the recipient based on the recipient information. The consultation information is information necessary when the operator consults with the operator for artificial tooth treatment of the operator, and may include a registration image, a prediction image, and planning data. In operation 313 , the service device 200 transmits consultation information to the operator device 150 . In operation 315, the operator device 150 checks the consultation information. The operator device 150 may transmit a confirmation signal for the prediction image and the planning data to the service device 200 according to the inspection result. Also, the operator device 150 may transmit a position change signal for a fixture image disposed in the registration image or correction data for the planning data to the service device 200 according to the inspection result. When the operator device 150 corrects the planning data, the registered image or the predicted image may be automatically corrected by the modified correction data.

When the operator device 150 transmits the inspection result for the consultation information to the service device 200 in operation 317, the service device 200 generates schedule information according to the inspection result in operation 323. In operation 325 , the service device 200 transmits the generated schedule information to the operator device 150 . In operation 327, the service device 200 generates a guide based on the planning data. In operation 329, the service device 200 stores the consultation information as big data.

In operation 315, the service device 200 performs operation 319 when the inspection of the consultation information is finished. In operation 319 , the service device 200 transmits the consultation information reflecting the inspection result to the device 100 . In operation 321 , the subject device 100 displays consultation information according to an input of the subject.

In operation 331 , the operator device 150 generates a procedure schedule for the operator based on the schedule information received from the service device 200 in operation 325 . The procedure schedule is a schedule for performing artificial tooth treatment of a recipient, and may be generated based on schedule information, treatment and treatment time of other recipients waiting in line. In addition, the procedure schedule is a schedule capable of performing the procedure within a critical time, for example, 24 hours from the time the information of the recipient is obtained in operation 301 .

In operation 333 , the operator device 150 transmits the generated operation schedule to the operator device 100 . In operation 335, the recipient device 100 displays a procedure schedule based on a signal received from the recipient. In operation 337, the operator device 150 performs operation 339 when a change signal for changing the procedure schedule is input. In operation 339 , the operator device 150 transmits a change signal to the operator device 150 . In operation 341 , the operator device 150 updates the procedure schedule based on the change signal, and performs operation 349 . In operation 337, the operator device 150 performs operation 343 if the change signal is not input. In operation 343 , a signal indicating that the change signal is not input is transmitted to the operator device 150 , and operation 349 is performed.

In operation 349, the operator device 150 checks whether a treatment time corresponding to the generated treatment schedule or the updated treatment schedule has arrived. In operation 349, the operator device 150 performs operation 351 when the operation time according to the operation schedule arrives. In operation 351, the operator device 150 outputs a notification indicating that the operation time has arrived. In operation 349, if the operation time does not arrive, the operator device 150 continuously checks whether the operation time has arrived.

As a result of checking operation 337, if no change signal is input, the subject device 100 performs operation 345 . In operation 345 , when the operation time corresponding to the operation schedule arrives, the device 100 performs operation 347 . In operation 347, the subject device 100 outputs a notification informing that the treatment time has arrived. In operation 345 , if the operation time does not arrive, the device 100 continuously checks whether the operation time has arrived.

4 is a flowchart illustrating a method of providing an artificial tooth treatment integrated solution service in a device to be operated on according to an embodiment of the present invention.

Referring to FIG. 4 , in operation 401 , the recipient device 100 checks whether or not authentication of the recipient has been completed by the recipient's input. As a result of confirming operation 401, if authentication of the subject is not completed, the subject device 100 may repeatedly perform authentication of the subject until the authentication of the subject is completed. When the recipient device 100 is provided in a hospital lobby, etc., the recipient may be authenticated by inputting unique information such as a resident registration number. When the device 100 is a portable device, it is possible to log in to an application capable of communicating with the device 150 to receive authentication.

As a result of the confirmation of operation 401, when authentication of the subject is completed, the subject device 100 performs operation 403. In operation 403 , when it is confirmed that an observation confirmation signal for confirming the operator's opinion is received from the operator, the device 100 performs operation 405 . In operation 405 , the operator device 100 displays the operator's opinion input through the operator apparatus 150 on a display unit (not shown) and performs operation 407 .

In operation 403, the recipient device 100 performs operation 407 if the observation confirmation signal is not received. In operation 407, when it is confirmed that a consultation information confirmation signal for confirming consultation information is received from the recipient, the device 100 performs operation 409. In operation 409, the operator device 100 displays the consultation information received from the operator apparatus 150 on the display unit, and performs operation 411 . The consultation information is information necessary when the operator consults with the operator for artificial tooth treatment of the operator, and may include a registration image, a prediction image, and planning data.

In operation 407, if the receiving device 100 does not receive the consultation information confirmation signal, operation 411 is performed. In operation 411, when it is confirmed that the operation schedule confirmation signal for confirming the operation schedule is received from the operator, the device 100 performs operation 413, and if the operation schedule confirmation signal is not received, waits for the reception of the operation schedule confirmation signal . In operation 413 , the operator device 100 displays the operation schedule generated by the operator apparatus 150 on the display unit and performs operation 415 .

In operation 415, when a change date selection signal for changing a date corresponding to the procedure schedule is received from the operation recipient, the device 100 performs operation 417, and when the change date selection signal is not received, operation 421 is performed. In operation 417 , the operator device 100 transmits a change signal for the procedure schedule to the operator device 150 with a date corresponding to the change date selection signal. In operation 419, when a change completion signal is received from the operator apparatus 150 to indicate that the change to the procedure schedule is complete, operation 421 is performed. If the change completion signal is not received, operation 415 returns to the above Redo the action.

In operation 421 , the device 100 checks whether a treatment time corresponding to the treatment schedule arrives. As a result of checking operation 421 , when the operation time arrives, in operation 423 , the subject device 100 outputs a notification indicating that the operation time has arrived. As a result of confirming operation 421 , if the operation time does not arrive, the device 100 continuously checks whether the operation time has arrived.

5 is a flowchart illustrating a method of providing an artificial tooth treatment integrated solution service in an operator device according to an embodiment of the present invention.

Referring to FIG. 5 , in operation 501 , the operator device 150 checks whether an acquisition signal for acquiring information about the operator is received from the outside. In this case, the acquisition signal may be generated through an input unit (not shown) provided in the operator's device 150 . As a result of confirming operation 501, if an acquisition signal is received, the operator device 150 performs operation 503, and if the acquisition signal is not received, waits for reception of the acquisition signal.

In operation 503, the operator device 150 acquires information about the operator. The recipient’s information includes the recipient’s name, the recipient’s gender, the recipient’s age, general medical history, tooth type, tooth number for the placement location requiring artificial tooth treatment, the recipient’s face image, and a CT scan image of the recipient’s head and an oral scan image of the inside of the mouth of the recipient. In this case, the face image may include at least one of a plurality of 2D images and 3D images. To this end, the operator's device 150 may be connected to an imaging device including a face imaging device (not shown), a CT imaging device (not shown), and an oral scanning device (not shown), or may include an imaging device. In operation 505, the operator's device 150 receives an opinion on the operator information obtained from the operator. In this case, operation 505 may be omitted.

In operation 507 , the operator apparatus 150 transmits the obtained operator information and the input opinion to the service apparatus 200 . To this end, the operator device 150 may perform communication such as wireless communication with the service device 200 . In operation 509 , the operator device 150 receives, from the service device 200 , consultation information based on the recipient information transmitted to the service device 200 . The operation of receiving the consultation information will be described in detail with reference to FIG. 6 . 6 is a detailed flowchart for explaining a method for receiving consultation information in the operator's device according to an embodiment of the present invention.

Referring to FIG. 6 , in operation 601 , the operator device 150 receives a registered image from the service device 200 , and in operation 603 , the operator apparatus 150 displays the received registered image on a display unit (not shown). The operator can check the nerve and bone shape information including the nerve of the mandibular alveolus, the shape of the maxillary sinus and anterior incisor hole, and the bone density through the registration image. The operator may proceed with a consultation related to the artificial tooth operation, such as whether the artificial tooth is to be implanted at any position between the operator and the operator's oral cavity by using the displayed matching image. Although not shown, when a re-request signal for at least one image among a CT scan image and an oral scan image is received before the matching image is received from the service device 200, the operator's device 150 reloads at least one image. It may be photographed and transmitted to the service device 200 .

In operation 605 , the operator apparatus 150 receives the prediction image from the service apparatus 200 , and in operation 607 , the operator apparatus 150 displays the received prediction image on the display unit. The prediction image is an image that predicts the facial change of the recipient after the artificial tooth operation. More specifically, the prediction image is a registration image in which parts or all of the artificial teeth are virtually placed at at least one placement position to place the artificial teeth confirmed in the registration image, and parts or all of the artificial teeth are placed. It may be an augmented reality (AR) image combined with a facial image of the recipient. The operator may proceed with a consultation on the facial change of the operator after the operation of the operator and the artificial tooth is completed by using the displayed prediction image. In addition, in operation 605 , the operator device 150 may receive facial images before and after artificial tooth treatment of another operator whose treatment conditions are similar to those of the operator by more than a threshold.

In operation 609, the operator apparatus 150 receives the planning data from the service apparatus 200, and in operation 611, the operator apparatus 150 displays the received planning data on the display unit. The planning data is data necessary to operate artificial teeth on the recipient, and means information about the placement of a fixture to be operated in the mouth of the recipient and drilling guide information. The implantation information of the fixture includes an implantation position at which the fixture will be placed in the oral cavity, a standard including a diameter and length, an implantation direction, an implantation depth, a type of fixture, and the like. The drilling guide information includes information such as part numbers, types, images, names, etc. for a plurality of drilling devices used when forming a hole in which a fixture is to be placed, and insertion depth information indicating an insertion depth at a location where the fixture is to be placed. , and includes use order information for a plurality of drilling devices. Based on the planning data, the operator may perform a consultation on a fixture to be inserted into an implantation position requiring artificial tooth treatment, an abutment to be coupled to the fixture, and a crown to be coupled to the abutment. In particular, fixture placement information among the planning data may be displayed by being applied to the registration image.

In addition, in the embodiment of the present invention, it is described as an example that the matching image reception and display, the prediction image reception and display, and the planning data reception and display are sequentially operated as an example, but the present invention is not limited thereto. For example, the registered image, the prediction image, and the planning data may be displayed sequentially or temporarily after being received.

In operation 613 , when it is confirmed that the confirmation signal for the planning data received from the outside is received, the operator device 150 performs operation 617 . In operation 617 , the operator device 150 transmits a confirmation signal indicating that the planning data received from the service device 200 has been confirmed to the service device 200 , and returns to operation 511 of FIG. 5 .

In operation 613 , the operator device 150 performs operation 615 if a confirmation signal for the planning data received from the outside is not received. In operation 615 , the operator device 150 modifies the planning data received from the service device 200 and performs operation 617 . In operation 617 , the operator device 150 transmits the revised data that is the revised planning data to the service device 200 and returns to operation 611 of FIG. 5 . In this case, if the operator's device 150 corrects the planning data, the operator's apparatus 150 may modify and display the prediction image.

In operation 511 , the operator device 150 receives schedule information from the service device 200 . The schedule information is schedule information reflecting the production time of the prosthesis and the delivery time of the prosthesis according to the planning data. In operation 513 , the operator device 150 generates the operator's operation schedule based on the schedule information. To this end, the operator's device 150 may receive a treatment schedule from the operator, and may automatically create a treatment schedule based on schedule information and the treatment and treatment times of other patients waiting for treatment.

In operation 515 , the operator apparatus 150 transmits the generated operation schedule to the operator apparatus 100 . In addition, after generating the procedure schedule, the operator device 150 may update the treatment schedule in real time according to the delivery status of the prosthesis, the treatment of other recipients, and the progress of the procedure, and transmit it to the operator device 100 . In operation 517 , the operator apparatus 150 checks whether a schedule change request signal is received from the operator apparatus 100 . As a result of checking operation 517 , when a schedule change request signal is received, the operator device 150 performs operation 519 . In operation 519 , the operator apparatus 150 changes the operation schedule of the operator based on the schedule change request signal received from the apparatus 100 to be operated, and performs operation 521 . As a result of checking operation 517 , if the schedule change request signal is not received, the operator device 150 performs operation 521 .

In operation 521 , the operator device 150 checks whether the operation date of the operator, for example, the operation time has arrived, based on the operation schedule. As a result of confirming operation 521, when the operation date arrives, in operation 523, the operator device 150 outputs an alarm notifying that the operation date is an artificial tooth operation for the operator. Although not shown, the operator device 150 may display the planning data received from the service device 200 when performing artificial tooth surgery. As a result of checking operation 521, if the operation date does not arrive, the operator apparatus 150 may periodically check whether the operation date has arrived.

7 is a flowchart for explaining a method of providing an artificial tooth treatment integrated solution service in a service device according to an embodiment of the present invention.

Referring to FIG. 7 , in operation 701 , the control unit 220 checks whether information about the subject is received from the operator device 150 . As a result of checking operation 701 , if the subject information is received, the control unit 220 performs operation 703 , and if the subject information is not received, the controller 220 waits for reception of the subject information. At this time, the recipient information includes the name of the recipient, the gender of the recipient, the age of the recipient, the general medical history, the tooth type, the tooth number for the implantation location requiring artificial teeth, the face image of the recipient, and a CT scan of the recipient’s head It may include an image and an oral scan image of the inside of the mouth of the recipient. In this case, the face image may include at least one of a plurality of 2D images and 3D images. Also, the operator information may include the operator's opinion on the operator input by the operator device 150 . In this case, the opinion of the operator may include precautions for artificial tooth operation according to the condition of the patient's gums, etc.

In operation 703, the control unit 220 generates consultation information for the recipient. The operation of generating the consultation information will be described in detail with reference to FIG. 8 . 8 is a detailed flowchart illustrating a method of generating consultation information in a service apparatus according to an embodiment of the present invention.

Referring to FIG. 8 , in operation 801 , the controller 220 checks the data format of the CT scan image and the oral scan image. The controller 220 compares the data format of at least one of the CT scan image and the oral scan image with the matching standard data format. In operation 803, the controller 220 converts the data format of the CT scan image and the oral scan image into the same data format. Converts the data format of an image having a data format different from the registration standard data format to the registration standard data format. In general, since the CT scan image and the oral scan image have different file extensions, it is not easy to match them without data format conversion. Accordingly, the controller 220 converts the same data format as the matching standard data format so that the quality of the CT image and the oral scan image does not deteriorate. To this end, the service device 200 may include a decoder (not shown).

In operation 805, the controller 220 checks whether the converted CT scan image and the oral scan image can be matched. For example, when the CT scan image and the oral scan image of the subject are acquired with at least one reference marker attached to the inside of the subject's oral cavity, the controller 220 controls at least one of the CT scan image and the oral scan image, respectively. Check the reference marker. In this case, the reference marker is a marker that is attached to the inside of the mouth of the person who wants to treat the artificial tooth, and may be attached to various parts, such as the operation position of the artificial tooth, the gum, and the like. The controller 220 checks whether matching of the two images is possible using at least one reference marker included in each of the CT scan image and the oral scan image. In addition, when the CT scan image and the oral scan image of the subject are acquired without the reference marker attached to the inside of the subject's oral cavity, the control unit 220 selects at least one identical position in the CT scan image and the oral scan image. . The controller 220 may apply the generative reference marker to the selected at least one same location and apply the depth map algorithm to the generated reference marker. The controller 220 may check the possibility of successful matching by using the depth value for the same location calculated by applying the depth map algorithm.

As a result of checking operation 805, if the two images can be matched, the control unit 220 performs operation 811, and if the matching is not possible, the control unit 220 performs operation 807. In operation 807 , the controller 220 re-requests the CT scan image and the oral scan image to the operator device 150 . In operation 809, the controller 220 returns to operation 801 when the CT scan image and the oral scan image are re-received. In operation 809 , if the CT scan image and the oral scan image are not received again, the controller 220 returns to operation 807 and continuously requests the image to the operator's device 150 again.

In operation 811 , the controller 220 matches the converted CT scan image with the oral scan image. The control unit 220 controls the oral scan image so that at least one reference marker included in the CT scan image and at least one reference included in the oral scan image can be superimposed at the same position to match the two images to perform operation 813 carry out More specifically, the controller 220 overlays the CT scan image and the oral scan image and displays them on the display unit. The controller 220 performs image analysis of the CT scan image and the oral scan image. The controller 220 may confirm at least one of the number of reference markers included in the CT scan image, the angle between the reference markers, the orientation of each reference marker, and the relative position of the reference markers through image analysis. In addition, the controller 220 may check at least one of the number of reference markers included in the oral scan image, the angle between the reference markers, the orientation of each reference marker, and the relative position of the reference markers through image analysis. In order to confirm the orientation of the reference marker, the reference marker may be formed in a spherical shape, a flat shape, a polygonal shape, a cylindrical shape, and other shapes, and the controller 220 checks the x, y, and z values based on the origin of the reference marker. direction can be checked.

According to the confirmation result, the control unit 220 should be present at the same position among the reference markers included in each image after the CT scan image and the oral scan image are overlaid and displayed, but the reference marker that does not exist in the same position is extracted do. The controller 220 controls the ratio, direction, and angle of the oral scan image in order to match the location of the extracted reference marker. The controller 220 may match the reference marker included in the oral scan image, which should exist at the same position as the reference marker included in the CT scan image, with each other through the control of the oral scan image. When the reference marker included in the CT scan image matches the reference marker included in the oral scan image, the controller 220 may generate one three-dimensional matched image by matching the two images. After generating the registered image, the controller 220 selects a reference marker that may be at least one feature point from among reference markers included in the registered image. The controller 220 calculates a depth value of the selected reference marker. The controller 220 may improve the accuracy of the registered image by adjusting the calculated depth value for the reference marker. The controller 220 may check the dental information of the recipient from the registration image, and store it in the memory 210 as the recipient information. In addition, image registration according to an embodiment of the present invention may be manually performed by an input from a planner, or may be automatically performed by the controller 220 .

The control unit 220 matches the CT scan image and the oral scan image for which the success possibility of matching is confirmed by using the depth value for the same location calculated by applying the depth map algorithm. The controller 220 calculates depth values for a plurality of positions in the CT scan image, and selects a plurality of positions identical to the plurality of positions selected in the CT scan image from the oral scan image. The controller 220 controls the ratio, direction, and angle of the oral scan image so that the depth values for a plurality of positions in the selected oral scan image are the same as the depth values calculated from the CT scan image. The control unit 220 generates a registered image by matching the CT scan image and the oral scan image having the same depth value with the CT scan image.

In operation 813 , the controller 220 checks whether image matching is successful. As a result of checking operation 813 , if it is determined that image matching has failed, the controller 220 performs operation 807 . In operation 807 , the controller 220 re-requests at least one image in which an error has occurred among the CT scan image and the oral scan image to the operator device 150 . In operation 809, the controller 220 returns to operation 801 when at least one of the CT scan image and the oral scan image is re-received. In operation 809 , if the image is not received again, the controller 220 returns to operation 807 and continuously requests the image to the operator device 150 .

As a result of checking operation 813 , if it is confirmed that image matching is successful, the controller 220 performs operation 815 . In this case, the registration image is a three-dimensional image, and information about the nerve and bone shape including the nerve of the mandibular alveolus, the shape of the maxillary sinus and the anterior incisor hole, and the bone density may be displayed. In operation 815 , the controller 220 generates a predicted image based on the registered image. A method of generating the prediction image will be described in detail with reference to FIG. 9 . 9 is a detailed flowchart for explaining a method of generating a prediction image in a service apparatus according to an embodiment of the present invention.

Referring to FIG. 9 , in operation 901 , the controller 220 calls big data for other subjects stored in the memory 210 . Big data is operation information about other recipients, name, gender, age, tooth type, tooth number for the implantation location where artificial tooth treatment was performed, dental status, facial image, CT scan image, oral It may include scan images, registration images, planning data, and facial images before and after artificial tooth surgery. In operation 903 , the control unit 220 checks whether there is another patient whose treatment condition is similar to that of the information received in operation 701 of FIG. 7 by a threshold or more. At this time, the control unit 220 compares and combines the information including the sex, age, tooth type, tooth number corresponding to the implantation position, and dental state of the recipient received in operation 701 from among the big data stored in the memory 210 in part, It is possible to check whether there is another subject whose treatment conditions are similar to or more than a threshold.

As a result of checking operation 903 , if there is another subject whose information and treatment conditions are similar to or greater than a threshold, the controller 220 performs operation 905 . In operation 905 , the controller 220 extracts the facial images before and after the artificial teeth of another operator and transmits them to the operator's device 150 . The operator of the operator device 150 may perform artificial tooth treatment consultation for the operator by using the facial images before and after the artificial tooth treatment of another operator who has similar treatment conditions to the operator. For example, if the tooth number corresponding to the implantation position at which the operator wants to proceed with the artificial tooth treatment is No. 23, the controller 220 transmits the facial images before and after the treatment of the other recipient who treated the artificial tooth at No. 23 to the operator device 150. can be transmitted In addition, when the tooth number corresponding to the implantation position at which the recipient wants to proceed with the artificial tooth treatment is No. 41 and No. 23, the control unit 220 controls the face of two other recipients who have treated the artificial teeth at No. 41 and No. 23 before and after the procedure. The image may be transmitted to the operator device 150 .

In operation 907, the controller 220 calls the planning data used in the artificial tooth operation of another recipient and performs operation 911. In this case, when the operator intends to operate artificial teeth at a plurality of placement positions, the controller 220 may call planning data related to a tooth number corresponding to each placement position. In operation 911, the control unit 220 generates a predicted image after the artificial tooth of the person to be treated, and returns to operation 817 of FIG. 8 . In this case, the prediction image may be an augmented reality (AR) image capable of predicting a change in the recipient's face after artificial tooth treatment.

As a result of checking operation 903 , if there is no other recipient whose information and treatment conditions are similar to or greater than a threshold, the controller 220 performs operation 909 . In operation 909, the controller 220 generates planning data based on the matched image of the subject, and performs operation 911. In operation 911, the controller 220 applies the planning data to the facial image of the recipient to generate a predicted image after the surgery of the recipient's artificial teeth, and returns to operation 817 of FIG. 8 .

In operation 817 , the controller 220 stores the registered image generated in FIG. 8 , the prediction image generated in FIG. 9 , and the planning data in the memory 210 , and performs operation 819 . In operation 819 , the controller 220 transmits the registration image, the prediction image, and the planning data to the operator device 150 , and returns to operation 705 of FIG. 7 .

In operation 705, when it is confirmed that a confirmation signal for the planning data is received from the operator's device 150, the controller 220 performs operation 709, and in operation 705, the controller 220 receives a confirmation signal from the operator's device 150 If it is confirmed that not, operation 707 is performed. In operation 707 , the controller 220 receives the correction data in which the planning data is corrected from the operator device 150 and performs operation 709 . In this case, the controller 220 may store the correction data as big data in the memory 210 .

In operation 709, the controller 220 generates schedule information. In this case, the schedule information may mean schedule information that is delivered to the operator by generating a prosthesis according to the planning data. In operation 711 , the controller 220 transmits the generated schedule information to the operator device 150 , and in operation 713 , the controller 220 generates a guide according to the schedule information. Although not shown, when the production of the prosthesis is completed based on the generated guide, the planner who is the manager of the service device 200 delivers the prosthesis to the operator who is the user of the operator's device 150 using a logistics system such as courier.

On the other hand, the embodiments of the present invention disclosed in the present specification and drawings are merely presented as specific examples to easily explain the technical contents of the present invention and help the understanding of the present invention, and are not intended to limit the scope of the present invention. That is, it is apparent to those of ordinary skill in the art to which the present invention pertains that other modified examples can be implemented based on the technical spirit of the present invention.

Claims (8)

In the artificial tooth treatment information providing system comprising an operator device for providing artificial tooth treatment information to a recipient,
At least one of a video image taken for the operator, a registration image derived from the video image, an artificial tooth placement position, and a prediction image after artificial tooth treatment is provided to the operator according to the operator's selection, and artificial tooth treatment planning is established a procedure consultation unit that provides planning data to the recipient when the procedure is performed; and
In consideration of one or more of the prosthesis production time, the delivery time of the prosthesis, the expected artificial tooth operation time, and the artificial tooth operator's schedule according to the planning data, the artificial tooth operation schedule for the recipient is established. an operator device comprising a; an operation management unit provided to the operator; and
a recipient device that is communicatively connected to the operator device to receive and display at least one of a consultation result for the artificial tooth, the planning data, and the artificial tooth treatment schedule;
including,
The recipient device transmits at least one of a recipient opinion on the planning data including selection of a type for the prosthesis with respect to the consultation result or a recipient opinion on the artificial tooth procedure schedule to the operator device,
When the planning data or the artificial tooth treatment schedule is changed, it is reflected in the treatment consultation unit and the treatment management unit, so that the operator can grasp the artificial tooth treatment information and the artificial tooth treatment schedule in real time. delete According to claim 1,
The subject device is
If it is confirmed based on the treatment schedule, an artificial tooth treatment information providing system that outputs an alarm when the treatment time arrives. delete According to claim 1,
The subject device is
When it is confirmed that the artificial tooth treatment schedule is changed according to the opinion of the recipient, the artificial tooth treatment information providing system outputs an alarm when a treatment time corresponding to the artificial tooth treatment schedule arrives. According to claim 1,
The prosthesis is
An artificial tooth treatment information providing system including a fixture to be placed in the oral cavity of the recipient for the artificial tooth treatment, an abutment coupled to the fixture, and a crown coupled to the abutment. 7. The method of claim 6,
The planning data is
The standard of the fixture including the implantation position, diameter and length of the fixture to be implanted in the oral cavity, the implantation direction of the fixture, the implantation depth and the type of the fixture, including the implantation information of the fixture Artificial teeth treatment information provision system. In the method of providing artificial tooth treatment information to a recipient,
The operation consultation unit provides one or more of the image image taken for the operator, the matching image derived from the image image, the artificial tooth placement position, and the predicted image after the artificial tooth operation as the operator's device for the operator according to the operator's selection. movement;
an operation of providing the planning data to the device to be operated upon when the treatment consultation unit establishes an artificial tooth treatment plan;
The procedure management unit considers one or more of a prosthesis production time, delivery time of the prosthesis, an expected artificial tooth operation time, and an artificial tooth operator schedule for the artificial tooth operation of the person to be operated according to the planning data, and an artificial tooth operation schedule for the person to be operated on establishing and transmitting to the recipient device;
an operation of receiving and displaying at least one of a consultation result for the artificial tooth, the planning data, and the artificial tooth operation schedule, in which the operator device is communicatively connected with the operator device including the operation consultation unit and the operation management unit;
transmitting, by the recipient device, at least one of a recipient opinion on the planning data including selection of a type of the prosthesis with respect to the consultation result or a recipient opinion on the artificial tooth procedure schedule to the operator device; and
an operation of the operation consulting unit or the operation management unit changing the artificial tooth operation information and the artificial tooth operation schedule in real time when the planning data or the artificial tooth operation schedule is changed and transmitting the information to the device to be operated;
A method of providing information on artificial teeth including a.

Images