KR20180125790A - System for Providing of Integration Solution Service of Dental Implant, Service Apparatus thereof, and Method for Procedure Service of Dental Implant of using thereof - Google Patents

Abstract

The present invention relates to a system for providing an integrated solution service for an artificial tooth procedure, a service apparatus for the same, and an artificial tooth treatment service method using the same. The present invention relates to a service apparatus for providing an artificial tooth procedure integrated solution service including artificial tooth procedure consultation and artificial tooth procedure planning for a person to be treated by communicating with an artificial tooth operator device which obtains information of a person to be treated including a face image, a CT photograph image, and an oral scan image for the person to be treated. The system for providing an integrated solution service for an artificial tooth procedure comprises: an image matching unit for generating a matching image by matching a CT photographing image and an oral scanning image in real time when the CT photographing image and the oral scanning image are received; a virtual placement unit for generating an artificial tooth procedure prediction image by virtually arranging images of components or all of artificial teeth of a person to be treated in the matching image; a planning unit for establishing artificial tooth procedure planning including transplantation position determination for the person to be treated, or selection of components or all of artificial teeth; and a guide generation unit for generating the artificial tooth procedure guide for the person to be treated with respect to a transplantation position of artificial teeth and components or all of artificial teeth on the basis of artificial tooth procedure planning data. Two or more among matching image generation, image generation of an artificial tooth procedure prediction image, and an artificial tooth procedure planning establishment for a person to be treated may be continuously provided to an operator device. Other embodiments may be applied.

Description

TECHNICAL FIELD [0001] The present invention relates to a system for providing an integrated dental treatment service, a service apparatus for the same, and a dental implant service method using the dental implant service system }

The present invention relates to a system for providing an integrated dental treatment integrated solution service, a service apparatus for the same, and an artificial tooth dental service method using the same, and more particularly, to a method of generating a matched image using a CT image and an oral scan image acquired from a client, And provides a prosthetic treatment of an artificial tooth by generating a predictive image and planning data from a patient, and a service apparatus for the same and an artificial tooth procedure service method using the same.

In general, implants refer to replacements that can replace human tissue when the original human tissue is lost, and in particular, dental implants include fixtures, abutments, and crown Implies implanting the artificial tooth with the prosthesis to the actual tooth position.

That is, the implant procedure is performed by forming a perforation in the alveolar bone, placing the fixture in the perforation, and bonding the abutment and the crown to the fixture when the fixture is fused to the alveolar bone. The operator forms perforations through various processes such as removal of the gums, alveolar bone positioning, planarization, initial hole formation and expansion, and thread formation. To this end, the practitioner provides the condition of the dentist's teeth to the planner, and then uses the planning data, abutment, crown, etc., provided by the planner to perform the artificial teeth to the dentist.

In such a case, the practitioner needs to directly receive the planning data, abutment, crown, and the like for the artificial tooth preparation of the subject from the planner, thus causing time-consuming problems. In addition, the physician can not confirm the schedule information of the artificial tooth procedure, so that the user must take the trouble of visiting the dental clinic a plurality of times.

Various embodiments of the present invention for solving such conventional problems include a method in which a service apparatus generates a matching image with a CT shot image and an ORAL scan image obtained from a subject and generates a prediction image and planning data from the matching image, The present invention provides a system for providing an integrated dental treatment integrated solution service, a service apparatus for the same, and an artificial dental treatment service method using the same.

In addition, various embodiments of the present invention provide a system for providing an integrated dental treatment integrated solution service in which a service device generates artificial dental procedure schedule information for a person to be treated according to production time and delivery time of a prosthesis manufactured based on planning data, And a method of providing an artificial tooth treatment service using the same.

The service device for providing the integrated dental treatment integrated solution service according to an embodiment of the present invention communicates with an artificial tooth practitioner device for acquiring physician information including a facial image, a CT image, and an oral scan image for a physician A service device for providing an integrated dental treatment integrated solution service including an artificial dental treatment consultation and an artificial dental treatment plan for a physician, comprising the steps of: when receiving the CT shot image and the oral scan image, A virtual placement unit for generating an artificial tooth procedure prediction image by virtually disposing an image of a part or all of an artificial tooth with respect to the subject in the registered image, Positioning of the teeth, or artificial teeth A planning part for establishing an artificial tooth procedure plan including selection of a part or an entirety of the artificial teeth, and a placement part for artificial teeth necessary for the artificial tooth procedure based on the artificial tooth preparation planning data, Wherein at least two of the matching image generation, the artificial tooth preparation prediction image generation, and the artificial tooth procedure planning establishment for the subject are successively provided to the practitioner apparatus for generating an artificial tooth procedure guide for the subject .

In addition, the virtual placement section may be configured to virtually arrange the part or entire image of the artificial tooth corresponding to the placement position of the artificial tooth identified in the matched image, and to arrange the part of the artificial tooth or the whole image of the artificial tooth, Is combined with the facial image to generate the predictive image indicating the facial change of the subject after the artificial tooth procedure.

Further, the predicted image is an augmented reality image.

The image matching unit may further automatically match the CT scan image and the oral scan image by an automatic matching algorithm if the image matching unit further confirms that the CT scan image and the oral scan image meet a preset automatic matching standard.

The matching image is characterized by being a three-dimensional image in which nerve and bone shape information including a nerve, a maxillary sinus, an anterior incisor hole shape, a bone density and the like of the subject's mandibular crest is displayed.

In addition, it is also possible to apply artificial teeth to the physician by reflecting production time and delivery time of the artificial tooth including the abutment coupled to the fixture corresponding to the fixture image and the crown coupled to the abutment And a schedule generating unit for generating the dental procedure schedule information.

If at least one other physician information having the same or different threshold value as the physician's condition is present among the other physician information pre-stored in the big data storage unit, the virtual placement unit may perform the artificial dental procedure based on the at least one other physician information And generates a predicted image.

In addition, the practitioner apparatus providing the integrated dental treatment integrated solution service according to an embodiment of the present invention communicates with the artificial tooth dental integrated service apparatus, and the physician's information including the CT shot image and the oral scan image with respect to the client, And a CT image of the subject and an orthoscopic image of the subject, an artificial tooth preparation predictive image, and an artificial tooth planning plan data, the artificial tooth practitioner apparatus comprising: Providing an information acquisition unit for acquiring physician information including an image, physician information including a CT shot image and an oral scan image for the physician, and transmitting the CT shot image and the oral scan image Matching image, artificial tooth procedure prediction A dental consultation unit for receiving at least one of the registered image and the predictive image and providing the dental practitioner with an artificial dental treatment consultation service, And a procedure management unit for providing an artificial tooth procedure schedule for the subject who is created with the CT scan image and the oral scan image, wherein the artificial tooth procedure consultation and procedure schedule for the subject is obtained from acquisition of the subject information including the CT image and the oral scan image Or more is continuously performed.

Further, the procedure management section updates the procedure schedule in response to a change request for the procedure schedule received from the patient trainer device.

According to another aspect of the present invention, there is provided a method for providing an integrated dental treatment integrated solution service, the method comprising the steps of: providing an artificial dental treatment service by an artificial dental operator apparatus and an artificial dental treatment integrated service apparatus, An operation to transmit the CT image and the ORAL scan image to the service device when the CT image and the ORAL scan image are acquired, and the service device generates a matching image from the CT image and the ORAL scan image and transmits the same to the practitioner device, An operation of generating an artificial tooth procedure predictive image by virtually disposing an image of an artificial tooth part or an entire image of the artificial tooth with respect to the matched image on the matched image and transmitting the generated artificial tooth surgical prediction image to the practitioner apparatus; , And transmits the consultation result to the service device And the service device generates planning data for the artificial tooth procedure based on the consultation result and transmits the planning data to the practitioner device, and the operation device or the service device transmits the artificial tooth consultation result and the operation result And an operation of generating an artificial tooth procedure schedule for the subject based on the planning data, wherein the artificial tooth procedure consultation for the subject from the acquisition of the subject information including the CT shot image and the oral scan image for the subject, And the creation of the procedure schedule is continuously performed.

As described above, the system for providing the artificial dental integrated solution service of the present invention, the service apparatus for the same, and the artificial dental treatment service method using the same provide a method in which the service apparatus acquires the CT scan image acquired from the client, An image is generated, a predicted image and planning data are generated from the matched image, and transmitted to the practitioner apparatus, thereby minimizing the time consumed by the practitioner until the artificial teeth procedure of the client.

In addition, the system for providing the integrated dental treatment integrated solution service of the present invention, the service apparatus for the same, and the artificial tooth procedure service method using the same include the manufacturing time and the delivery time of the prosthesis manufactured based on the planning data By providing the schedule information to the practitioner, the physician can check his / her artificial tooth procedure schedule, and the procedure schedule can be changed according to his / her schedule.

FIG. 1 illustrates a system for providing an integrated dental treatment integrated solution service according to an embodiment of the present invention. Referring to FIG.
FIG. 2 is a schematic view for explaining a procedure for providing an integrated dental treatment integrated solution service according to an embodiment of the present invention.
3 is a flowchart illustrating a method of providing an integrated dental treatment integrated solution service according to an embodiment of the present invention.
4 is a flowchart illustrating a method for providing an integrated dental treatment integrated solution service in a patient's apparatus according to an embodiment of the present invention.
FIG. 5 is a flowchart illustrating a method for providing an integrated dental treatment integrated solution service in a practitioner apparatus according to an embodiment of the present invention.
6 is a detailed flowchart for explaining a method of receiving counseling information in a practitioner apparatus according to an embodiment of the present invention.
7 is a flowchart illustrating a method of providing an integrated dental treatment integrated solution service in a service apparatus according to an embodiment of the present invention.
8 is a detailed flowchart for explaining a method of generating consultation information in a service apparatus according to an embodiment of the present invention.
9 is a detailed flowchart for explaining a method of generating a prediction image in a service apparatus according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that, in the drawings, the same components are denoted by the same reference symbols as possible. Further, the detailed description of known functions and configurations that may obscure the gist of the present invention will be omitted.

FIG. 1 illustrates a system for providing an integrated dental treatment integrated solution service according to an embodiment of the present invention. Referring to FIG.

Referring to FIG. 1, a service providing system 10 according to the present invention includes a subject instructor apparatus 100, a practitioner apparatus 150, and a service apparatus 200.

The physician's apparatus 100 may be a device that can be operated by a physician, such as a portable device used by a patient visiting a dental clinic (hereinafter, referred to as a physician) or a hospital lobby. The physician's apparatus 100 performs communication with the practitioner apparatus 150. To do this, the assistant device 100 performs wireless communication such as long term evolution advanced (LTE-A), long term evolution (LTE), wireless fidelity (Wifi), bluetooth, and bluetooth low energy .

When the physician's apparatus 100 is provided in a hospital lobby or the like, the physician's apparatus 100 may be a device that can be used by a physician, such as a computer, a notebook computer, a tablet PC, or the like. The physician may be authenticated by inputting physician-specific information such as a resident registration number to the physician's apparatus 100. When the patient instructor apparatus 100 is a portable apparatus, the portable apparatus may be a device such as a smart phone, a portable terminal, and a tablet PC that can be carried by a client. In addition, an application capable of communicating with the operator apparatus 150 may be installed on the patient instructor apparatus 100. The physician can be authenticated by logging into the application.

The physician's apparatus 100 can display the information of the physician who is acquired in the practitioner apparatus 150 after the authentication is completed. The physician's apparatus 100 may display the operator's findings input by the operator apparatus 150 after the operator inspects the information of the employee. The physician's apparatus 100 can display the consultation information that has been checked by the practitioner apparatus 150. [ The physician's apparatus 100 may input a change request for the consultation information received from the practitioner apparatus 150 and transmit the change request to the practitioner apparatus 150. At this time, the change request may be a kind selection for the prosthesis.

The physician's apparatus 100 may display the procedure schedule of the physician created in the practitioner apparatus 150. [ The physician's apparatus 100 may transmit a change signal to the practitioner apparatus 150 according to the input of the physician. The physician's apparatus 100 can output a notification informing the patient when the procedure time corresponding to the procedure schedule comes.

The practitioner device 150 is a device used by a physician (hereinafter referred to as a practitioner) working in a hospital, particularly, a dentist, and may be a device such as a computer, a notebook, and a tablet PC. The practitioner apparatus 150 includes a long term evolution advanced (LTE-A), a long term evolution (LTE), a wireless fidelity (WFI), a bluetooth, a bluetooth low energy Can be performed. In addition, the operator apparatus 150 may further include a long term evolution advanced (LTE-A), a long term evolution (LTE), a wireless fidelity (Wifi), a wideband code division multiple access Wireless communication can be performed.

The practitioner apparatus 150 transmits the physician information including the CT shot image and the oral scan image to the service provider 200 through the communication with the service apparatus 200. [ The practitioner apparatus 150 receives a CT image of the subject and a matching image of the oral scan image, a predicted image after the artificial tooth procedure, and planning data for the artificial tooth procedure from the service device 200. For this purpose, the practitioner apparatus 150 includes an information obtaining unit 151, a procedure consultation unit 153, and a procedure management unit 155.

The information acquiring unit 151 acquires the information of the subject's person by the input of the practitioner. The information of the physician's person is the name of the physician, the sex of the physician, the age of the physician, the history of the whole body, the type of tooth, the tooth number corresponding to the position where the artificial tooth is required, the facial image of the physician, computed tomography) image and an oral scan image of the inside of the subject's mouth. At this time, the facial image may include at least one of a plurality of 2D images or 3D images. The information acquisition unit 151 transmits the physician information to the service device 200. [

To this end, the practitioner device 150 may be connected to an imaging device including a facial imaging device (not shown), a CT imaging device (not shown) and an oral scanning device (not shown), or may include a imaging device. The information acquisition unit 151 can acquire the operator's opinion on the information of the physician who is input from the practitioner.

The information obtaining unit 151 generates an electronic chart using information and findings of the acquired physician. The information acquiring unit 151 transmits the electronic chart generated based on the information of the physician or the information of the physician to the service device 200.

The procedure consultation unit 153 displays at least one of the consultation information received from the service apparatus 200, that is, the matching image, the predicted image after the artificial tooth procedure, and the planning data for the artificial tooth procedure, Provide counseling services. At this time, the planning data includes placement information of the fixture to be implanted inside the mouth of the client for an artificial tooth procedure. The placement information of the fixture includes a placement position, a diameter and a length including a position at which the fixture is to be placed in the oral cavity, a placement direction, a placement depth, a type of fixture, and the like. At this time, the fixture may be one of the components of the artificial tooth, and the component of the artificial tooth may be a prosthesis including a fixture, an abutment connectable to the fixture, and a crown connectable to the abutment.

The matching image is a three-dimensional image generated by matching the CT scan image and the oral scan image as soon as the CT apparatus image and the OR scan image are received from the operator apparatus 150 by the service apparatus 200. The practitioner can confirm the nerve and bone shape information including the nerve, maxillary sinus and anterior incisor hole shape and bone density of the mandibular alveolar bone of the recipient through the matching image. The operation consultation unit 153 displays a matched image and the practitioner can perform consultation related to the artificial tooth procedure such as the placement of the artificial tooth in the inside of the mouth of the patient and the patient using the matched image displayed.

When a re-request signal for at least one of the CT image and the oral scan image is received from the service apparatus 200, the procedure consultation unit 153 activates the information obtaining unit 151 to retake at least one image And then transmitted to the service apparatus 200.

The predicted image is an image that predicts the facial change of the subject after the artificial tooth procedure. More specifically, the predictive image includes at least one prosthetic image in a virtual placement position in at least one placement position for placement of an artificial tooth identified in a matching image, and a matching image in which a prosthetic image is placed, Or an augmented reality (AR) image. The procedure consultation unit 153 displays the predicted image and the practitioner can use the displayed predictive image to conduct consultation about the facial change of the patient after the operation of the patient and the artificial tooth is completed.

In addition, the procedure consultation unit 153 may receive a facial image of the subject who has undergone the artificial tooth procedure of another subject who has the same or similar condition as that of the subject. The practitioner can use the facial image of the other dental practitioner before and after the dental prosthesis to consult about the facial changes of the dental practitioner who is similar to the dental practitioner. At this time, the facial image before and after the artificial tooth procedure may be at least one of 2D and 3D images.

The planning data refers to data necessary for performing the artificial tooth on the client and is information about the fixture to be inserted into the oral cavity of the client and the drilling guide information and is designed by the administrator of the service apparatus 200, . The placement information of the fixture includes a placement position, a diameter and a length including a position at which the fixture is to be placed in the oral cavity, a placement direction, a placement depth, a type of fixture, and the like. The drilling guide information includes information such as a part number, a type, an image, and a name of a plurality of drilling apparatuses used when the fixture is to be placed, and insertion depth information indicating an insertion depth at a position where the fixture is to be placed , And usage order information for a plurality of drilling devices.

Among the planning data, the fixture information of the fixture can be displayed and applied to the matching image. Further, the drilling guide information can be displayed as text data on images and usage for the drilling apparatus for drilling. The practitioner can consult the fixture to be inserted at the position where the artificial tooth procedure is required based on the planning data, the abutment to be combined with the fixture, and the crown to be combined with the abutment.

The procedure management unit 155 receives the consultation result from the practitioner after the procedure consultation unit 153 provides the consultation service to the client. The operation management unit 155 may transmit the consulting signal or the correction data for the planning data to the service device 200 based on the inputted consultation result. When the correction data is generated, the procedure management unit 155 may correct the prediction image based on the correction data and display the corrected image. In addition, when the operation management unit 155 transmits the correction data to the service device 200, the procedure consultation unit 153 can receive and display the modified prediction image on the service device 200 based on the correction data.

The procedure management unit 155 may receive the schedule information from the service device 200 after transmitting the confirm signal or the correction data to the service device 200. [ The schedule information refers to schedule information generated based on the production time and delivery time of the prosthesis necessary for the operation of the artificial teeth of the client by the service apparatus 200 based on the planning data.

The procedure management unit 155 generates a procedure schedule for the subject based on the received schedule information. The procedure schedule can be generated based on the operator's input, and can be generated based on schedule information received from the service apparatus 200, treatment and procedure time of other waiting staffs waiting. At this time, the procedure schedule is a schedule in which the information acquisition unit 151 can proceed from the time when the information of the patient's information is obtained to the operation of the patient's doctor in one-day.

The procedure management unit 155 transmits the generated procedure schedule to the patient device 100, updates the procedure schedule in real time according to the delivery status of the prosthesis, the treatment of the other patients, and the progress of the procedure and transmits the updated procedure schedule to the patient device 100 have. For example, the procedure management unit 155 may generate a procedure schedule by allocating an estimated time required for each operation such as a delivery state of a prosthesis, a treatment of other personnel, and a procedure progress state. At this time, the operation management unit 155 can regenerate the procedure schedule reflecting the time taken for each operation to be longer than the expected time. In addition, when the time required for each operation is shorter than the expected time, the procedure management unit 155 can regenerate the procedure schedule reflecting the time.

When the schedule change request signal is received from the assistant device 100, the procedure management unit 155 can change the created procedure schedule. The procedure management unit 155 may output an alarm indicating that the artificial tooth is being implanted to the patient's instructor on the basis of the procedure schedule.

The service device 200 is an apparatus used by a planner for designing plan data necessary for a patient to perform artificial teeth, and may be a computer, a notebook computer, a tablet PC, or the like. The service device 200 may perform wireless communication such as long term evolution advanced (LTE-A), long term evolution (LTE), wireless fidelity (WFI), wideband code division multiple access Can be performed.

The service apparatus 200 communicates with the practitioner apparatus 150 that acquires the subject information including the facial image, the CT image, and the oral scan image for the subject, thereby performing the artificial tooth procedure consultation and the artificial tooth procedure planning To provide integrated dentistry integrated solution services. The service device 200 includes a memory 210 and a control unit 220. The memory 210 includes a big data storage unit 210a and a digital library 210b. The control unit 220 includes a data management unit 220a, a matching stencil end unit 220b, an image matching unit 220c, a diagnosis unit 220d, a virtual arrangement unit 220e, a planning unit 220f, a schedule generation unit 220g, And a guide generation unit 220h. In addition, although not shown, the service device 200 may further include an input unit for receiving input of the planner, a display unit for displaying a screen according to the operation, and the like.

The big data storage unit 210a stores the physician information received from the practitioner 150 as big data. In addition, the big data storage unit 210a may store a matching image, a facial image, and a planning data generated based on the matching image, which are generated by matching the CT shot image and the oral scan image included in the subject information. In addition, the big data storage unit 210a may store a facial image of the subject before and after the artificial tooth procedure.

The digital library 210b may include an image for the prosthesis, e.g., a fixture image for at least one fixture, an abutment image for a plurality of abutments coupleable to the fixture, and an image for a crown that is engageable to the abutment . ≪ / RTI >

The data management unit 220a stores the physician information received from the practitioner apparatus 150 in the big data storage unit 210a. At this time, the physician information may include the findings of the practitioner. The physician information includes the name of the physician, the sex of the physician, the age of the physician, the history of the whole body, the type of tooth, the tooth number corresponding to the position of the implant requiring the operation of the artificial tooth, the facial image of the physician, And an oral scan image of the inside of the subject's mouth. At this time, the facial image may include at least one of a plurality of 2D images or 3D images.

The data management unit 220a confirms the data format of the CT shot image and the oral scan image from the patient information. The data management unit 220a compares the data format of at least one of the CT shot image and the oral scan image with the matching standard data format. The data management unit 220a converts the data format of the image having the data format different from the match standard data format to the standard data format. Generally, the CT shot image and the oral scan image have different file extensions, so that it is not easy to match without conversion of the data format. Therefore, the data management unit 220a converts the data format that is the same as the standard standard data format so as not to cause deterioration of the CT shot image and the oral scan image. The data management unit 220a provides the CT scan image and the oral scan image in which the data format is converted to the matching sill plate end 220b.

The conformable stencil end 220b verifies whether the converted CT image and the scan image can be matched. For example, if at least one reference marker is acquired with the CT photograph image of the subject and the oral scan image attached to the inside of the subject's mouth, the conformable suture end portion 220b may include at least the CT images Identify one reference marker. At this time, the reference marker is a marker attached to the inside of the mouth of a patient who is to be implanted in an artificial tooth, and can be attached to various parts such as a treatment position of an artificial tooth, a gum, and the like. The matching suture end 220b verifies the matching success probability for the two images using at least one reference marker included in each of the CT shot image and the oral scan image. For example, the matching sul plate end 220b can check the matching success probability based on the number of at least one reference image included in each image and the like.

The matching sul plate end 220b selects at least one identical position in the CT shot image and the oral scan image when the CT photographing image and the oral scan image of the subject are acquired without the reference marker being attached to the oral cavity. The conformable stencil end 220b may apply the generated reference markers to at least one identical location selected and apply a depth map algorithm to the generated reference markers. The matching sill plate end 220b can confirm the matching success probability by using the depth value of the same position calculated by applying the depth map algorithm.

If the matching success probability of the two images is below the threshold value, the matching suture end 220b determines that matching is impossible and requests the operator device 150 to recall the CT image and the oral scan image. On the other hand, if the matching success probability of two images exceeds the threshold value, the matching stencil end 220b determines that matching is possible and provides two images to the image matching unit 220c. The matching sul plate end 220b confirms the image matching success probability based on a predetermined image matching success criterion. At this time, the image registration success criteria include at least one reference marker included in each of the CT shot image and the oral scan image, whether or not the CT shot image and the oral scan image are images for the same subject, Whether or not there is an inaccuracy of at least one of the scan images, and whether or not the depth values calculated by applying the depth map algorithm to the same positions of the CT shot image and the oral scan image are the same.

The image matching unit 220c performs matching of two images, that is, a CT shot image and an oral scan image, which are confirmed to be capable of matching at the matching sul plate end 220b. The image matching unit 220c can perform the automatic matching of the CT shot image and the oral scan image by the automatic matching algorithm, and can perform the matching by the input of the planner.

The image matching unit 220c controls the oral scan image so that at least one reference marker included in the CT image and at least one reference included in the original scan image are overlapped at the same position to match the two images. More specifically, the image matching unit 220c overlays the CT shot image and the oral scan image and displays them on the display unit. The image matching unit 220c performs image analysis of the CT shot image and the oral scan image. The image matching unit 220c can check at least one of the number of reference markers included in the CT image, the angle between the reference markers, the orientation of each reference marker, and the relative position of the reference marker through image analysis. The image matching unit 220c can check at least one of the number of reference markers included in the oral scan image, the angle between the reference markers, the orientation of each reference marker, and the relative position of the reference markers through image analysis . In order to confirm the orientation of the reference markers, the reference markers may be formed in a spherical shape, a planar shape, a polygonal shape, a cylindrical shape, and the like, and the image matching unit 220c may calculate x, y and z values with reference to the origin of the reference markers You can check and see your bearings.

According to the result of the check, the image matching unit 220c should exist at the same position among the reference markers included in each image after overlaying and displaying the CT shot image and the oral scan image, but the reference markers . The image matching unit 220c controls the ratio, direction, and angle of the original scan image so as to match the positions of the extracted reference markers. The image matching unit 220c may match the reference markers included in the original scan image, which should exist at the same position as the reference markers included in the CT image, through the control of the oral scan image. When the reference markers included in the CT image and the reference markers included in the oral scan image are matched, the image matching unit 220c can match the two images to generate one three-dimensional registered image. The image matching unit 220c selects a reference marker that can be at least one of the reference markers included in the matching image after the matching image is generated. The image matching unit 220c calculates the depth value of the selected reference marker. The image matching unit 220c can improve the accuracy of the matching image by adjusting the depth values of the reference markers calculated. The image matching unit 220c can check the dentist's dental information from the matching image and store it in the big data storage unit 210a as the patient information.

The image matching unit 220c matches the CT scan image and the oral scan image having the matching success probability confirmed by using the depth value for the same position calculated by applying the depth map algorithm. The image matching unit 220c calculates a depth value for a plurality of positions in the CT image and selects the same plurality of positions in the OR scan image at a plurality of positions selected from the CT image. The image matching unit 220c controls the ratio, direction, and angle of the original scan image so that the depth value for a plurality of positions in the selected original scan image is the same as the depth value calculated in the CT image. The image matching unit 220c generates a matching image by matching an oral scan image having the same depth value with the CT image, with the CT image.

When the image matching is successful, the image matching unit 220c provides the matching image to the diagnosis unit 220d and the virtual arrangement unit 220e, respectively. At this time, the matching image is a three-dimensional image, and nerve and bone shape information including the nerve of the mandibular alveolar bone, the maxillary sinus and anterior incisor hole shape, and the bone density can be displayed. On the contrary, if it is determined that the image registration is unsuccessful, the image matching unit 220c requests the operator apparatus 150 again for at least one image in which the error occurred in the CT image and the oral scan image.

When the diagnosis unit 220d determines that there is a treatment to be performed prior to the artificial tooth procedure from at least one of the CT photograph image, the oral scan image, and the registration image of the subject's surgeon, (150) may provide information about this. If the CT image and the oral scan image of the subject are stored in the big data storage unit 210a, the diagnosis unit 220d compares the acquired CT image and the oral scan image with previously stored images, You can see if there is any treatment that needs to be done before the tooth procedure. If the diagnosis unit 220d determines that there is a treatment to be performed before the artificial tooth procedure, the operator can provide information to the operator apparatus 150 so that the confirmed treatment can be performed.

The virtual placement unit 220e includes a consultation placement unit 221 for generating a predictive image that can confirm the face change of the subject after the artificial teeth procedure, a planning placement unit 222 for performing the treatment planning for the subject, And a virtual treatment unit 223 that virtually implements the prosthesis on the matching image.

The consultation placement unit 221 confirms whether there exists a subject who is similar in terms of procedure to the subject's subject based on the big data storage unit 210a. If it is determined that there is another subject who is similar in terms of procedure to the subject, the consultation placement unit 221 calls the facial image before and after the artificial tooth procedure of the other subject's physician in the big data storage unit 210a, send. On the other hand, if there is no other subject who has similar procedure conditions to the subject, the consultation placement unit 221 generates a predicted image for the subject and transmits it to the practitioner apparatus 150.

To this end, the consultant arranging unit 221 calls up big data for other faculty members stored in the big data storage unit 210a. The big data is surgical information for the other physicians, and includes the name, sex, age, tooth type, teeth number corresponding to the position where the artificial tooth was performed, face image, facial image, CT image, An orthal scan image, a matching image, a planning data, and a facial image before and after the artificial tooth procedure.

The consultation placement unit 221 confirms whether or not there exists a subject who is similar to the information of the subject and the procedure condition. At this time, the consultation placement unit 221 partially compares and combines the surgical conditions including the gender, age, tooth type, placement position, and dental state of the patient, among the big data stored in the big data storage unit 210a, The presence or absence of another physician who is equal to or more than the threshold value can be confirmed.

The consulting placement unit 221 extracts facial images before and after the artificial teeth procedure of the other personnel and transmits them to the practitioner apparatus 150 when there is another physician who has the information of the physician and the operation condition similar to or more than the threshold value. The consulting placement unit 221 may be configured such that if the subject has a tooth number 23 corresponding to the placement position at which the artificial tooth is to be advanced, the facial image of the other artificer who has performed the artificial tooth 23, Lt; / RTI > In the case where the subject's teeth number is 41 or 23, the consulting placement unit 221 may determine whether or not to perform the artificial tooth treatment by using the face image before and after the procedure of one other person who has performed all of the artificial teeth in steps 41 and 23. [ To the operator device (150). In the case where the dental technician has tooth numbers 41 and 23 to which the artificial teeth are to be applied, the consultation placement unit 221 sets the facial image before and after the procedure of the two other physicians who respectively performed the artificial teeth 41 and 23 To the operator device (150).

The consulting placement unit 221 may generate a predicted image for the subject using the planning data of the subject and the other subject's surgeons having a similar or equal threshold value (for example, the planning data in which the fixture placement information is applied to the matching image). More specifically, the consultation placement unit 221 extracts a partial image corresponding to the placement position of the subject's person in the planning data of the other subject. The consultation placement unit 221 generates the predicted image of the client by using the extracted partial image. At this time, the predicted image may be an augmented reality (AR) image capable of predicting the facial change of the subject after the artificial tooth procedure.

For example, in the consultation placement unit 221, if the subject's tooth number is 23 corresponding to the placement position at which the physician wishes to perform the artificial tooth procedure, Extract the partial image. In addition, if the tooth number is 41 or 23 corresponding to the placement position at which the physician intends to perform the artificial tooth procedure, the consultation placement unit 221 sets the artificial teeth to the planning of the other physician The partial image corresponding to the placement position can be extracted from the data. Also, the consultation placement unit 221 can extract the partial images corresponding to the placement positions from the planning data of the different staff members who have performed the artificial teeth at 41 and 23, respectively. The consultation placement unit 221 combines the extracted partial image with the matching image of the subject. The consultation placement unit 221 combines the matched image in which the partial image is combined with the facial image of the subject and generates a predicted image. The consultation placement unit 221 provides the planning data for the other personnel used in the generation of the predicted image to the planning arrangement unit 222. [

As a result of the confirmation, if there is no other subject who is similar in terms of procedure to the subject, the consultation placement unit 221 virtually arranges the part of the artificial tooth or the entire image in the registered image of the subject. The consultation placement unit 221 combines the matched image in which the image of the part of the artificial tooth or the whole image is virtually combined with the facial image of the subject to generate the predicted image.

At this time, when the facial image is a plurality of 2D images, the consultation placement unit 221 may combine the plurality of 2D images to generate a 3D image. For this purpose, the consultant placement unit 221 may combine a plurality of 2D images using each of the feature points included in the plurality of 2D images to generate a single 3D image. The consultation placement unit 221 can generate a predicted image by applying a matched image in which a part of the artificial tooth or the entire image is virtually arranged to the 3D image.

In addition, the consultation placement unit 221 overlays and displays a matched image in which a part of an artificial tooth or a whole image is virtually arranged, when the face image is a 2D image obtained from the front of the client. The consultation placement unit 221 generates a predicted image by matching the registered image in which the part of the artificial tooth or the entire image of the artificial tooth is virtually arranged on the basis of the feature point identified from the facial image of the client, . At this time, the consulting placement unit 221 may calculate the depth in the 2D image using a depth map algorithm. The consultation placement unit 221 can generate a virtual 3D image based on the calculated depth and generate a predicted image by applying a matched image in which the part of the artificial tooth or the entire image is virtually arranged on the generated 3D image have.

In addition, when the facial image is a 3D image, the consultation placement unit 221 can generate a predicted image by combining the 3D image with the matched image in which the part of the artificial tooth or the entire image is virtually arranged.

The placement unit for planning 222 identifies the position of the implant requiring placement of the artificial teeth in the matching image. The placement unit for planning 222 selects a fixture image that can be placed at an identified placement position among a plurality of fixture images stored in the digital library 210b. The placement unit for planning 222 virtually arranges the selected fixture image in the matching image. The placement section 222 for planning can select and adjust the fixture image custom-tailored to the client.

The placement unit for planning 222 provides a matching image in which a fixture image is arranged to the virtual procedure unit 223. [ The virtual procedure unit 223 can virtually arrange the image of the abutment coupled to the fixture in the fixture image. In addition, the virtual procedure section 223 can virtually arrange the image of the crown coupled to the abutment in the abutment image.

The placement unit for planning 222 provides the planning unit 220f with information on a part or an entire image of an artificial tooth placed in the matching image, for example, the placement information of the fixture corresponding to the fixture image. At this time, the placement information of the fixture may be a specification including a position, a diameter, and a length at which the fixture is to be placed, a placement direction, a depth of a fixture, a type of fixture, and the like. The planning arrangement unit 222 receives the correction data for the planning data from the operator apparatus 150 or the correction data for which the correction data for the planning data is received from the operator apparatus 150 and provides the correction data to the planning unit 220f .

The placement unit for planning 222 arranges the part of the artificial tooth or the entire image corresponding to the planning data of the other personnel provided by the consultation placement unit 221 in the matching image of the client. The placement unit for planning 222 provides the planning unit 220f with planning data suitable for the subject based on the information on the entire image or the part of the artificial tooth placed in the matching image.

The planning section 220f generates planning data based on the placement information of the fixture provided from the placement section 222 for planning. The planning data refers to placement information and drilling guide information of the fixture to be performed inside the oral cavity of the client. The drilling guide information includes information such as a part number, a type, an image, and a name of a plurality of drilling apparatuses used when the fixture is to be placed, and insertion depth information indicating an insertion depth at a position where the fixture is to be placed , And usage order information for a plurality of drilling devices.

The planning unit 220f performs conformance or correction on the planning data when the conform signal for the planning data is received from the planning unit 222 or receives the correction data and outputs the planning data to the schedule generating unit 220g. And guide generation unit 220h. The planning unit 220f may store the generated or modified planning data in the big data storage unit 210a.

The schedule generator 220g generates schedule information. The schedule information is a schedule in which the time for manufacturing the prosthesis according to the planning data and the delivery time for the manufactured prosthesis are considered. The prosthesis includes an abutment coupled to the fixture corresponding to the fixture image and a crown coupled to the abutment. In addition, the schedule information may be considered together with a production time and a delivery time of a surge guide providing a guide necessary for forming a hole for placing a fixture. The schedule generating unit 220g transmits the generated schedule to the practitioner apparatus 150. [

The guide generating unit 220h generates a guide for a part or an entire tooth of an artificial tooth necessary for an artificial tooth procedure based on the planning data. In particular, the guide generating unit 220h can generate an image of a crown of the components of the artificial tooth. In addition, the guide generation unit 220h may generate an image for the surge guide.

The guide generating unit 220h may transmit an image of the generated crown and an image of the surge guide to an external device such as a 3D printer (not shown). For this reason, the service apparatus 200 can perform wireless or wired communication with an external apparatus. The service device 200 may be a wireless communication device such as a wireless communication device such as long term evolution advanced (LTE-A), long term evolution (LTE), wireless fidelity (Wifi), bluetooth, Communication, and the like. The planner delivers a part of the artificial tooth or the whole of the artificial tooth by the external device and the surge guide to the practitioner who is the user of the operator device 150 by using the delivery system such as courier service.

In addition, in the embodiment of the present invention, the service apparatus 200 generates the matching image, but the present invention is not limited thereto. If the specifications of the practitioner device 150 are sufficiently supported, matching image generation may be performed in the practitioner device 150.

FIG. 2 is a schematic view for explaining a procedure for providing an integrated dental treatment integrated solution service according to an embodiment of the present invention.

Referring to FIG. 2, in operation 201, the practitioner apparatus 150 acquires physician information on a physician who intends to perform an artificial tooth. In operation 203, the service apparatus 200 automatically matches the CT shot image and the oral scan image included in the subject information to generate a matching image. In operation 205, the service device 200 generates a predicted image representing the facial pattern change after the artificial operation as an augmented reality image using the facial image of the subject who is included in the subject information.

In operation 207, the practitioner apparatus 150 conducts consultation of the client by using the matching image and the prediction image generated by the service apparatus 200. In operation 209, the service device 200 generates planning data, and the operator device 150 performs verification of the planning data.

In operation 211, the service device 200 manufactures the prosthesis based on the planning data when the verification of the planning data is completed in the operator device 150. In operation 213, the service device 200 stores the matching image, the prediction image, and the planning data. In operation 215, the practitioner of the practitioner's device 150 proceeds with the artificial tooth procedure of the recipient based on the planning data and the manufactured prosthesis. Here, the prosthesis includes a part or all of an artificial tooth including an abutment coupled to a fixture corresponding to the fixture image and a crown coupled to the abutment. In addition, the surgeon can form a perforation in the inside of the patient's mouth by using a surgeal guide that provides a guide necessary for forming a perforation for placing the fixture. As described above, the operations 201 to 215 are performed within 24 hours from the time when the client visits the hospital, and the artificial tooth procedure can be performed during one-day.

3 is a flowchart illustrating a method of providing an integrated dental treatment integrated solution service according to an embodiment of the present invention.

Referring to FIG. 3, in operation 301, the practitioner apparatus 150 acquires the information of the person to be trained. In operation 303, the practitioner inputs the information on the trainee information using an input unit (not shown). In operation 305, the operator apparatus 150 transmits the information and the findings of the employee to the service apparatus 200, and in operation 307, the operator apparatus 150 transmits the information and the findings of the employee to the patient apparatus 100. In operation 309, the physician's apparatus 100 displays an electronic chart in which the findings are inputted based on signals received from the subject's surgeon.

In operation 311, the service device 200 generates consultation information on the subject based on the subject information. The consultation information may include a matching image, a predictive image, and planning data, which is information necessary for the practitioner to consult a client with an assistant for an artificial tooth procedure of a client. In operation 313, the service apparatus 200 transmits the consultation information to the operator apparatus 150. In operation 315, the practitioner apparatus 150 performs examination for consultation information. The practitioner apparatus 150 may transmit a conform signal for the predicted image and the planning data to the service apparatus 200 according to the examination result. In addition, the operator apparatus 150 may transmit the position change signal for the fixture image disposed in the matched image or the correction data for the planning data to the service apparatus 200 according to the inspection result. If the operator device 150 modifies the planning data, the matching image or the predictive image may be automatically modified by the modified correction data.

In operation 317, when the operator apparatus 150 transmits the examination result of the consultation information to the service apparatus 200, the service apparatus 200 generates the schedule information according to the examination result in the operation 323. In operation 325, the service apparatus 200 transmits the generated schedule information to the operator apparatus 150. In operation 327, the service device 200 generates a guide based on the planning data. In operation 329, the service device 200 stores the consultation information as big data.

In operation 315, the service apparatus 200 performs 319 operation upon completion of verification of the consultation information. In operation 319, the service device 200 transmits the consultation information reflecting the examination result to the doctor's apparatus 100. In operation 321, the client device 100 displays counseling information by the input of the client.

In operation 331, the practitioner device 150 generates a procedure schedule for the physician based on the schedule information received from the service device 200 in the 325 operation. The procedure schedule is a schedule for proceeding with the artificial teeth procedure of the patient, and may be generated based on schedule information, medical care and treatment time of other waiting patients in the waiting room, and the like. In addition, the procedure schedule is a schedule in which the procedure can be performed within a critical period of time, for example, within 24 hours from the time when the information of the patient is acquired in the operation 301. [

 In operation 333, the practitioner device 150 transmits the generated procedure schedule to the subject device 100. In operation 335, the subject's apparatus 100 displays a procedure schedule based on the signal received from the subject's surgeon. In operation 337, the operator apparatus 150 performs an operation 339 when a change signal for changing the procedure schedule is input. In operation 339, practitioner device 150 sends a change signal to practitioner device 150. In operation 341, practitioner device 150 updates the procedure schedule based on the change signal and performs 349 operation. In operation 337, practitioner device 150 performs operation 343 if no change signal is input. In operation 343, a signal indicating that a change signal is not inputted is transmitted to the operator device 150, and the operation 349 is performed.

In operation 349, the operator apparatus 150 confirms whether the procedure time corresponding to the created procedure schedule or the updated procedure schedule has arrived. In operation 349, the operator apparatus 150 performs an operation 351 when a procedure time according to the procedure schedule arrives. In operation 351, the operator apparatus 150 outputs a notification informing that the operation time comes. In operation 349, the operator apparatus 150 continuously checks whether or not the operation time comes, unless the operation time comes.

If it is determined that the change signal is not input, the assistant device 100 performs the operation 345. In operation 345, the physician's apparatus 100 performs an operation 347 when a procedure time corresponding to the procedure schedule arrives. In operation 347, the physician's apparatus 100 outputs a notification informing that the operation time is coming. In operation 345, the subject's apparatus 100 continuously checks whether or not the operation time comes, unless the operation time comes.

4 is a flowchart illustrating a method for providing an integrated dental treatment integrated solution service in a patient's apparatus according to an embodiment of the present invention.

Referring to FIG. 4, in operation 401, the client device 100 confirms whether the client has been authenticated by inputting the client. If it is determined that the authentication of the subject is not completed as a result of the operation of the 401, the subject device 100 may repeatedly perform the authentication of the subject by the time the authentication of the subject is completed. When the client device 100 is provided in a hospital lobby or the like, the client can receive authentication by inputting client-specific information such as a resident registration number. When the patient instructor apparatus 100 is a portable apparatus, the user can log in and authenticate with an application capable of communicating with the operator apparatus 150.

As a result of the confirmation of the operation 401, when the authentication of the subject is completed, the subject's apparatus 100 performs the operation 403. In operation 403, the subject's apparatus 100 performs an operation 405 when it is confirmed that a confirmation signal for confirming the operator's findings is received from the subject. In operation 405, the physician's apparatus 100 displays the findings of a practitioner input through the operator apparatus 150 on a display unit (not shown) and performs an operation 407.

In operation 403, the subject's apparatus 100 performs an operation 407 if no confirmation signal is received. In operation 407, if the assistant device 100 confirms that the consultation information confirmation signal for confirming the consultation information is received from the client, it performs the operation 409. In operation 409, the physician's apparatus 100 displays the consultation information received from the practitioner 150 on the display unit and performs 411 operation. The consultation information may include a matching image, a predictive image, and planning data, which is information necessary for the practitioner to consult a client with an assistant for an artificial tooth procedure of a client.

In operation 407, the physician's device 100 performs 411 operation if no consultation information confirmation signal is received. In operation 411, the subject's apparatus 100 performs the operation 413 when it is confirmed that the procedure schedule confirmation signal for confirming the procedure schedule is received from the client, and waits for the reception of the procedure schedule confirmation signal if the procedure schedule confirmation signal is not received . In operation 413, the subject's apparatus 100 displays the procedure schedule generated in the operator's apparatus 150 on the display unit and performs an operation 415.

In operation 415, the subject's apparatus 100 performs an operation 417 when a change date selection signal for changing the date corresponding to the procedure schedule is received from the client, and performs an operation 421 if the change date selection signal is not received. In operation 417, the subject device 100 sends a change signal to the operator device 150 for the procedure schedule to a date corresponding to the change date selection signal. In operation 419, if the change completion signal indicating that the change of the procedure schedule has been completed is received from the operator apparatus 150 from the assistant apparatus 100, the operation returns to operation 415 if the change completion signal is not received. Run the operation again.

In operation 421, the physician's apparatus 100 confirms whether the procedure time corresponding to the procedure schedule comes. As a result of the confirmation of the operation 421, when the operation time comes, the assistant device 100 outputs a notification informing that the operation time comes. As a result of the confirmation of the operation 421, if the operation time does not arrive, the patient's apparatus 100 continuously checks whether or not the operation time comes.

FIG. 5 is a flowchart illustrating a method for providing an integrated dental treatment integrated solution service in a practitioner apparatus according to an embodiment of the present invention.

Referring to FIG. 5, in operation 501, the practitioner apparatus 150 confirms whether or not to receive an acquisition signal for acquiring information of the subject from the outside. At this time, the acquisition signal may be generated through an input unit (not shown) provided in the operator apparatus 150. As a result of the confirmation of the operation 501, the operator apparatus 150 performs the operation 503 when the acquisition signal is received, and waits for reception of the acquisition signal if the acquisition signal is not received.

In operation 503, the practitioner device 150 acquires the information of the physician. The information of the physician is the name of the physician, the sex of the physician, the age of the physician, the history of the whole body, the type of tooth, the tooth number for the position of the implant requiring the operation of the artificial tooth, the facial image of the physician, And an oral scan image of the inside of the subject's mouth. At this time, the facial image may include at least one of a plurality of 2D images or 3D images. To this end, the operator apparatus 150 may be connected to a video apparatus including a face photographing apparatus (not shown), a CT photographing apparatus (not shown) and an oral scan apparatus (not shown), or may be provided with a video apparatus. In operation 505, the practitioner apparatus 150 receives the findings of the physician information obtained from the practitioner. At this time, the operation 505 can be omitted.

In operation 507, the practitioner apparatus 150 transmits acquired acquired physician information and input findings to the service apparatus 200. For this purpose, the practitioner apparatus 150 can perform communication such as wireless communication with the service apparatus 200. In operation 509, the practitioner apparatus 150 receives, from the service apparatus 200, the consultation information based on the physician information transmitted to the service apparatus 200. [ The operation of receiving the consultation information will be described in detail with reference to FIG. 6 is a detailed flowchart for explaining a method of receiving counseling information in a practitioner apparatus according to an embodiment of the present invention.

Referring to FIG. 6, in operation 601, the practitioner apparatus 150 receives a matching image from the service apparatus 200, and in operation 603, the practitioner apparatus 150 displays the received matching image on a display unit (not shown). The practitioner can confirm the nerve and bone shape information including the nerve, maxillary sinus and anterior incisor hole shape and bone density of the mandibular alveolar bone of the recipient through the matching image. The practitioner can perform counseling related to the artificial tooth procedure such as the placement of the artificial tooth in the oral cavity of the patient and the recipient using the registered matching image. Although not shown, the operator apparatus 150 receives at least one image of at least one of the CT shot image and the oral scan image before the matching image is received from the service apparatus 200, And transmit it to the service apparatus 200.

In operation 605, the practitioner device 150 receives the prediction image from the service device 200, and in operation 607, the practitioner device 150 displays the received prediction image on the display. The predicted image is an image that predicts the facial change of the subject after the artificial tooth procedure. More specifically, the predicted image includes at least one artificial tooth part or all of the artificial teeth virtually arranged at at least one placing position at which the artificial tooth identified in the matching image is to be placed, and a matching image And may be an augmented reality (AR) image combined with the facial image of the subject. The practitioner can use the displayed predictive image to conduct consultation about the facial changes of the subject after completion of the operation of the subject and the artificial tooth. In addition, in operation 605, the operator apparatus 150 may receive a facial image before and after an artificial tooth procedure of a patient who is treated by a physician and another practitioner whose operation condition is equal to or more than a threshold value.

In operation 609, the practitioner device 150 receives the planning data from the service device 200, and in operation 611, the practitioner device 150 displays the received planning data on the display. The planning data is data necessary for performing an artificial tooth on the client, and means placement information and drilling guide information of a fixture to be inserted into the oral cavity of the client. The placement information of the fixture includes a placement position, a diameter and a length including a position at which the fixture is to be placed in the oral cavity, a placement direction, a placement depth, a type of fixture, and the like. The drilling guide information includes information such as a part number, a type, an image, and a name of a plurality of drilling apparatuses used when the fixture is to be placed, and insertion depth information indicating an insertion depth at a position where the fixture is to be placed , And usage order information for a plurality of drilling devices. The practitioner can consult the fixture to be inserted at the position where the artificial tooth procedure is required based on the planning data, the abutment to be combined with the fixture, and the crown to be combined with the abutment. In particular, among the planning data, the fixture placement information can be applied to the matched image and displayed.

In addition, in the embodiment of the present invention, it is described that the matching image reception and display, the prediction image reception and display, and the planning data reception and display are sequentially performed, but the present invention is not limited thereto. For example, the matching image, the predictive image, and the planning data may be displayed after being sequentially or temporarily received.

In operation 613, the operator apparatus 150 performs an operation 617 when it is confirmed that a consult signal for the planning data received from the outside is received. In operation 617, the practitioner apparatus 150 transmits a conform signal indicating that the planning data received from the service apparatus 200 has been confirmed to the service apparatus 200, and returns to operation 511 of FIG.

In operation 613, the operator apparatus 150 performs an operation 615 if a conform signal for the planning data received from the outside is not received. In operation 615, practitioner device 150 modifies the planning data received from service device 200 and performs 617 operations. In operation 617, the operator device 150 transmits the modified data, which is the modified planning data, to the service device 200 and returns to operation 611 of FIG. At this time, when the operator apparatus 150 modifies the planning data, the operator apparatus 150 may modify and display the predicted image.

In operation 511, the practitioner apparatus 150 receives schedule information from the service apparatus 200. The schedule information is schedule information reflecting the production time of the prosthesis according to the planning data and the delivery time of the prosthesis. In operation 513, the practitioner apparatus 150 generates a procedure schedule of the subject based on the schedule information. For this purpose, the practitioner apparatus 150 can receive the procedure schedule from the practitioner, and can automatically generate the procedure schedule based on the schedule information, the treatment and the procedure time of other waiting staffs waiting.

In operation 515, the practitioner apparatus 150 transmits the created procedure schedule to the subject apparatus 100. In addition, after creating the procedure schedule, the practitioner apparatus 150 can update the procedure schedule in real time according to the delivery state of the prosthesis, the treatment of the other patients, and the progress of the procedure, and transmit the updated procedure schedule to the patient device 100. In operation 517, the operator apparatus 150 confirms whether or not a schedule change request signal is received from the subject apparatus 100. As a result of the check of the operation 517, when the schedule change request signal is received, the operator apparatus 150 performs the operation 519. In operation 519, the practitioner apparatus 150 changes the procedure schedule of the subject based on the schedule change request signal received from the subject's apparatus 100, and performs the 521 operation. If the schedule change request signal is not received as a result of the 517 operation check, the operator device 150 performs the 521 operation.

In operation 521, the practitioner apparatus 150 confirms whether the procedure date of the subject, for example, the arrival time of the operation time, is based on the procedure schedule. As a result of the checking of the operation 521, when the operation date arrives, the operation device 150 outputs an alarm informing that the operation date of the artificial tooth is the operation date of the patient. Although not shown, the practitioner device 150 may display the planning data received from the service device 200 when performing the artificial tooth procedure. As a result of the checking of the operation 521, if the operation date does not arrive, the operator apparatus 150 can periodically check whether the operation date comes.

7 is a flowchart illustrating a method of providing an integrated dental treatment integrated solution service in a service apparatus according to an embodiment of the present invention.

Referring to FIG. 7, in operation 701, the control unit 220 confirms whether the patient information is received from the operator apparatus 150. As a result of the checking of the operation 701, when the service person information is received, the control unit 220 performs the operation 703, and if the service person information is not received, the control unit 220 waits for reception of the service person information. At this time, the physician information includes the name of the patient, the sex of the patient, the age of the physician, the history of the whole body, the tooth type, the tooth number for the position where the artificial tooth needs to be implanted, the facial image of the physician, An image and an oral scan image of the inside of the subject's mouth. At this time, the facial image may include at least one of a plurality of 2D images or 3D images. In addition, the physician information may include a physician's opinion on the physician who is input by the practitioner apparatus 150. At this time, the operator's findings may include instructions for the artificial tooth procedure according to the condition of the gum of the patient.

In operation 703, the control unit 220 generates consultation information on the physician. The operation of generating the consultation information will be described in detail with reference to FIG. 8 is a detailed flowchart for explaining a method of generating consultation information in a service apparatus according to an embodiment of the present invention.

Referring to FIG. 8, in operation 801, the control unit 220 confirms the data format of the CT shot image and the oral scan image. The control unit 220 compares the data format of at least one of the CT shot image and the oral scan image with the matching standard data format. In operation 803, the control unit 220 converts the data format of the CT shot image and the scan scan image into the same data format. Converts the data format of an image having a data format that is different from the conforming standard data format to a compatible standard data format. Generally, the CT shot image and the oral scan image have different file extensions, so that it is not easy to match without conversion of the data format. Therefore, the control unit 220 converts the data format that is the same as the standard standard data format so as not to cause deterioration of the CT shot image and the oral scan image. To this end, the service device 200 may include a decoder (not shown).

In operation 805, the control unit 220 checks whether the converted CT image and the oral scan image can be matched. For example, when the CT photographing image of the subject and the at least one reference marker are acquired with the at least one reference marker attached to the inside of the subject's mouth during the acquisition of the oral scan image, the control unit 220 displays at least one Check the reference markers. At this time, the reference marker is a marker attached to the inside of the mouth of a patient who is to be implanted in an artificial tooth, and can be attached to various parts such as a treatment position of an artificial tooth, a gum, and the like. The control unit 220 checks whether or not the two images can be matched using at least one reference marker included in each of the CT shot image and the oral scan image. In addition, when the CT photographing image and the ORAL scan image of the subject are acquired without attaching the reference marker to the inside of the subject's mouth, the control unit 220 selects at least one identical position in the CT shot image and the ORAL scan image . The control unit 220 may apply the generated reference marker to the selected at least one same position and apply the depth map algorithm to the generated reference marker. The control unit 220 can confirm the matching success probability by using the depth value of the same position calculated by applying the depth map algorithm.

If it is determined that two images can be matched as a result of the operation 805, the control unit 220 performs the operation 811. If the matching is not possible, the control unit 220 performs the operation 807. [ In operation 807, the control unit 220 requests the operator apparatus 150 again for the CT shot image and the oral scan image. In operation 809, the control unit 220 returns to the operation 801 when the CT image and the original scan image are received again. In operation 809, if the CT image and the original scan image are not received again, the control unit 220 returns to the operation 807 and continuously performs the image re-request to the operator apparatus 150.

In operation 811, the control unit 220 performs the matching of the converted CT image and the scan image. The control unit 220 controls the orthoscan image so that at least one reference marker included in the CT image and at least one reference included in the original scan image can be superimposed at the same position to match the two images, . More specifically, the control unit 220 overlays the CT shot image and the oral scan image and displays them on the display unit. The control unit 220 performs image analysis of the CT shot image and the oral scan image. The controller 220 can confirm at least one of the number of reference markers included in the CT image, the angle between the reference markers, the orientation of each reference marker, and the relative position of the reference marker through image analysis. In addition, the controller 220 can identify at least one of the number of reference markers included in the oral scan image, the angle between the reference markers, the orientation of each reference marker, and the relative position of the reference marker. In order to confirm the orientation of the reference markers, the reference markers may be formed in a spherical shape, a planar shape, a polygonal shape, a cylindrical shape, and the like, and the control unit 220 checks x, y, and z values with reference to the origin of the reference markers You can confirm your orientation.

According to the result of the check, the control unit 220 should be located at the same position among the reference markers included in each image after overlaying and displaying the CT shot image and the oral scan image, but extracting the reference marker that does not exist at the same position do. The control unit 220 controls the ratio, direction and angle of the original scan image so as to match the positions of the extracted reference markers. The control unit 220 can match the reference markers included in the oral scan image that should be located at the same position as the reference markers included in the CT shot image through the control of the oral scan image. If the reference markers included in the CT photographed image match with the reference markers included in the oral scan image, the control unit 220 can match the two images to generate one three-dimensional registered image. After generating the matching image, the control unit 220 selects a reference marker that can be at least one of the reference markers included in the matching image. The control unit 220 calculates the depth value of the selected reference marker. The control unit 220 can improve the accuracy of the matching image by adjusting the depth value of the reference marker. The control unit 220 can check the dentist's dentition information from the matched image and store it in the memory 210 as the dentist's information. In addition, the image registration according to the embodiment of the present invention may be manually performed by the input of the planner, and may be automatically performed by the control unit 220. [

The control unit 220 matches the CT scan image and the oral scan image having the matching success probability confirmed using the depth value for the same position calculated by applying the depth map algorithm. The control unit 220 calculates a depth value for a plurality of positions in the CT shot image, and selects the same plurality of positions in the OR scan image at the plurality of positions selected in the CT shot image. The control unit 220 controls the ratio, direction and angle of the original scan image so that the depth value for a plurality of positions in the selected original scan image is equal to the depth value calculated in the CT shot image. The control unit 220 matches the CT scan image with the OR scan image having the same depth value as the CT image to generate a matching image.

In operation 813, the control unit 220 confirms whether or not image matching is successful. If it is determined that the image registration is unsuccessful as a result of checking 813 operation, the control unit 220 performs 807 operation. In operation 807, the control unit 220 requests the operator apparatus 150 again for at least one image of the CT shot image and the ORAL scan image. In operation 809, the control unit 220 returns to the operation 801 when at least one of the CT shot image and the oral scan image is received again. In operation 809, if the image is not received again, the control unit 220 returns to the operation 807 and continuously performs the image re-request to the operator apparatus 150.

If it is determined that the image matching is successful as a result of checking 813 operation, the controller 220 performs an 815 operation. At this time, the matching image is a three-dimensional image, and nerve and bone shape information including the nerve of the mandibular alveolar bone, the maxillary sinus and anterior incisor hole shape, and the bone density can be displayed. In operation 815, the control unit 220 generates a predicted image based on the matched image. A method of generating a predictive image will be described in detail with reference to FIG. 9 is a detailed flowchart for explaining a method of generating a prediction image in a service apparatus according to an embodiment of the present invention.

Referring to FIG. 9, in operation 901, the control unit 220 calls up big data for the other physicians stored in the memory 210. The big data is the procedure information for the other physicians. It includes the name, sex, age, tooth type, tooth number for the position where the artificial tooth was performed, tooth position, facial image, CT image, A scan image, a registration image, a planning data, and a facial image before and after the artificial tooth procedure. In operation 903, the control unit 220 confirms whether the information of the recipient is received in operation 701 of FIG. 7 and whether there exists another recipient whose operation condition is equal to or greater than the threshold value. At this time, the controller 220 partially compares the information including the gender, the age, the tooth type, the tooth number corresponding to the placement position, and the dentition state received from the big data stored in the memory 210 in operation 701 It is possible to confirm whether or not there exists another patient who has a condition of which the procedure condition is equal to or more than the threshold value.

If it is determined as a result of the operation 903 that there is another physician who has the information of the physician and the operation condition that is equal to or greater than the threshold, the controller 220 performs 905 operation. In operation 905, the control unit 220 extracts facial images before and after the artificial teeth procedure of the other personnel and transmits them to the practitioner apparatus 150. The practitioner of the practitioner apparatus 150 can perform the artificial tooth procedure consultation for the subject using the facial image before and after the artificial tooth procedure of the subject who is similar to the condition of the subject. For example, if the subject has a tooth number 23 corresponding to the position where the artificial tooth is to be implanted, the controller 220 controls the operation of the physician using the facial image before and after the operation of the physician who performed the artificial tooth Lt; / RTI > In addition, when the subject's teeth number is 41 or 23 corresponding to the placement position where the physician intends to perform the artificial tooth procedure, the control unit 220 determines whether or not the two physicians who performed the artificial teeth, And transmit the image to the operator device 150.

In operation 907, the control unit 220 calls the planning data used in the artificial tooth procedure of the other physician and performs the operation 911. At this time, when the subject instructs to perform the artificial teeth at a plurality of placement positions, the control unit 220 can call the planning data related to the tooth numbers corresponding to the respective placement positions. In operation 911, the control unit 220 generates a predicted image after the artificial tooth procedure of the client and returns to operation 817 of FIG. At this time, the predicted image may be an augmented reality (AR) image capable of predicting the facial change of the subject after the artificial tooth procedure.

If it is determined as a result of the operation 903 that there is no other trainee who has the information of the trainee and the procedure condition that is equal to or greater than the threshold value, the control unit 220 performs the operation 909. In operation 909, the control unit 220 generates the planning data based on the matching image of the subject and performs the 911 operation. In operation 911, the control unit 220 applies the planning data to the facial image of the subject and generates a predicted image after the artificial tooth procedure of the subject, and returns to operation 817 of FIG.

In operation 817, the controller 220 stores the matching image generated in FIG. 8, the prediction image and the planning data generated in FIG. 9 in the memory 210, and performs an operation 819. In operation 819, the control unit 220 transmits the matching image, the predictive image, and the planning data to the operator device 150 and returns to operation 705 of FIG.

In operation 705, the control unit 220 performs an operation 709 when it is confirmed that a confirmation signal for the planning data is received from the operator apparatus 150. In operation 705, the controller 220 receives a confirmation signal from the operator apparatus 150 If it is not confirmed, the operation 707 is performed. In operation 707, the control unit 220 receives the modified data from the operator apparatus 150 for which the planning data has been modified, and performs the operation 709. At this time, the controller 220 may store the correction data in the memory 210 as the big data.

In operation 709, the control unit 220 generates schedule information. At this time, the schedule information may refer to schedule information generated by the prosthesis according to the planning data and delivered to the practitioner. In operation 711, the control unit 220 transmits the generated schedule information to the operator apparatus 150, and in operation 713, the controller 220 generates a guide according to the schedule information. Although not shown, the planner, which is the manager of the service apparatus 200, delivers the prosthesis to the practitioner who is the user of the operator apparatus 150 by using a logistics system such as courier service when the fabrication of the prosthesis is completed based on the generated guide.

It should be noted that the embodiments of the present invention disclosed in the present specification and drawings are only illustrative of the present invention in order to facilitate the understanding of the present invention and are not intended to limit the scope of the present invention. That is, it will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible.

Claims (10)

An artificial dental treatment integrated solution including an artificial dental treatment consultation and artificial dental treatment plan for a person who performs an artificial tooth by communicating with an artificial dental operator device that acquires information on a dental practitioner including a facial image, a CT shot image, A service device for providing a service,
An image registration unit for generating a registration image by matching the CT image and the oral scan image in real time upon receiving the CT image and the oral scan image;
A virtual placement unit for generating an artificial tooth procedure predicted image by virtually arranging an image of a part or all of an artificial tooth with respect to the subject on the matched image;
A planning unit for establishing an artificial tooth placement position for the physician, or an artificial tooth procedure planning including selection of an entire or part of an artificial tooth; And
A guide generating unit for generating an artificial tooth procedure guide for the subject to be artificially implanted, based on the artificial tooth procedure planning data, on a placement position of the artificial tooth necessary for the artificial tooth procedure, a part or all of the artificial tooth;
Wherein at least two of the matching image generation, the artificial dental procedure prediction image generation, and the artificial tooth procedure planning establishment for the subject are continuously provided to the practitioner apparatus. Device. The method according to claim 1,
The virtual arrangement unit
A part of the artificial tooth corresponding to the placement position of the artificial tooth identified in the matched image or an entire image of the artificial tooth is virtually arranged and the matched image in which the part of the artificial tooth or the entire image is virtually arranged is combined with the face image Wherein the prediction image generating unit generates the prediction image indicating the change in the facial surface of the subject after the artificial tooth procedure. 3. The method of claim 2,
The predictive image may include:
Wherein the image is an augmented reality image. The method according to claim 1,
Wherein the image matching unit comprises:
Wherein the automatic matching algorithm automatically aligns the CT scan image and the oral scan image by an automatic matching algorithm if it is further confirmed that the CT scan image and the oral scan image satisfy a preset automatic matching standard, . 5. The method of claim 4,
The matched image may include:
And a nerve and bone shape information including a nerve, a maxillary sinus and an anterior incisor hole shape and a bone density of a mandibular lower limb of the subject, and the like. 3. The method of claim 2,
The artificial tooth procedure for the subject is performed by reflecting the production time and the delivery time for the part or the whole of the artificial tooth including the abutment coupled to the fixture corresponding to the fixture image and the crown coupled to the abutment A schedule generation unit for generating schedule information;
Further comprising the step of providing an integrated dental treatment solution. The method of claim 3,
The virtual arrangement unit
If at least one other subject information having the same or different threshold value as the subject condition exists among the other subject information stored in the big data storage unit, the artificial tooth procedure predicted image is generated based on the at least one other subject information Features an integrated dental implant solution service device. The method of claim 1, further comprising the steps of: providing a physician with patient information including a CT shot image and an oral scan image for a physician; performing a CT imaging of the physician and a matching image of an oral scan image, 1. An artificial tooth practitioner apparatus provided with image and artificial tooth procedure planning data,
An information acquiring unit acquiring physician information including a CT shot image and an oral scan image for the subject;
Providing the service device with physician information including a CT shot image and an oral scan image for the subject,
Receiving at least one of the matched image of the CT shot image and the oral scan image, the artificial tooth procedure prediction image, and the artificial tooth preparation planning data from the service device, displaying at least one of the registered image and the predicted image, A procedure consultation unit for providing a service; And
A procedure management unit for providing a consultation result of the procedure consultation unit and an artificial tooth procedure schedule for the subject created based on the planning data;
, ≪ / RTI &
Wherein at least one of the acquisition of the physician information including the CT shot image and the oral scan image, and the provision of the artificial tooth procedure consultation and the procedure schedule for the physician are continuously performed. 9. The method of claim 8,
The operation management unit,
And updates the procedure schedule in response to a change request for the procedure schedule received from the subject applicator device. An artificial tooth procedure service method using an artificial tooth operator apparatus and an artificial tooth operation integrated service apparatus,
Wherein the operator apparatus transmits the CT scan image and the ORAL scan image to the service apparatus when the operator acquires the CT scan image and the ORAL scan image with respect to the subject;
The service device generating a matching image from the CT shot image and the oral scan image and transmitting the matching image to the practitioner device;
Wherein the service device generates an artificial tooth procedure prediction image by virtually disposing an image of a part of the artificial tooth or the whole image of the artificial tooth with respect to the matched image on the matching image and transmits the artificial tooth treatment prediction image to the practitioner apparatus;
Transmitting the consultation result to the service device when the counseling result about the artificial tooth procedure is stored;
The service device generating planning data for the artificial tooth procedure based on the consultation result and transmitting the generated planning data to the practitioner device; And
The practitioner apparatus or the service apparatus generating an artificial tooth procedure schedule for the subject based on the artificial tooth procedure consultation result and the planning data;
≪ / RTI >
Wherein at least one of artificial tooth consultation and creation of the procedure schedule is continuously performed from the acquisition of the subject information including the CT shot image and the oral scan image for the subject.

Images