WO2020204374A2

WO2020204374A2 - Method and device for providing user-specific template-based surgery report

Info

Publication number: WO2020204374A2
Application number: PCT/KR2020/003177
Authority: WO
Inventors: 김효정; 조상형
Original assignee: 오스템임플란트 주식회사
Priority date: 2019-04-05
Filing date: 2020-03-06
Publication date: 2020-10-08
Also published as: KR102322518B1; WO2020204374A3; KR20200118326A

Abstract

Disclosed are a method and device for providing a user-specific template-based surgery report. A method for providing a surgery report according to an embodiment comprises the steps of: providing a surgery report template edit screen; reconstructing in a template a template item selected by a user in the surgery report template edit screen; and generating a surgery report by means of applying contents to the reconstructed template.

Description

User-customized template-based surgical report provision method and device

The present invention relates to a medical image processing technology including a dental implant surgery guide design technology.

After establishing the implant placement plan using the dental implant surgery guide program, the user saves or prints the surgical report that can check the 3D shape format data and the surgery plan of the guide, and performs the surgery while checking it. The surgical report can be directly output by the user, and can be output in the process of producing the designed guide and delivered to the user along with the guide.

The surgical report of the implant surgery guide program can be printed out on paper using a 2D printer or loaded on a monitor in the operating room as data in pdf format to check the basic information of the surgery plan for each tooth number. However, since the surgical report uses a fixed template, additional work must be performed separately in order to add information desired by the user, and the same operation must be repeated for each case to be designed.

According to an embodiment, a user-customized template-based surgical report providing method and apparatus are proposed in which a user directly configures a template of a surgical report for an implant surgery guide design result and automatically generates a surgical report according to the configured template.

A method of providing a surgery report according to an embodiment includes the steps of providing a surgery report template editing screen, reconfiguring a template item selected by a user on the surgery report template editing screen into a template, and reflecting the contents in the reconstructed template. Generating a surgical report.

The step of providing the surgery report template editing screen includes providing a surgery report template editing screen including a template selection area, a template design result area, and a template item design area, and the template selection area selects a template or confirms the selected template, and This is a screen where a template is added to create a template, and the template design result area is a screen that enlarges and displays the template page selected in the template selection area, but displays the operation results of the user's own design of the template item of the surgery report. The report template editing screen may be a screen for a user to design a template item of a surgical report.

The template item design area consists of User Information, Surgery Information, Surgery Image, Other Items (Appendix), and User Additional Items (Customized). Items can be added or deleted.

In the template item design area, template items are classified into major categories, and each major category area may provide an entire item selection menu interface capable of adding all items included in the major category to the template.

At least one of a method of clicking a template item to add to the template at the stage of reconfiguration to the template, or a drag & drop method of selecting and dragging the item to be added to the template and dropping it in the template design result area. Template items can be added through. In the step of reconfiguring to the template, the position and size of the template item added by user manipulation can be adjusted.

The reconfiguration to the template includes the steps of manually adding a template item by the user, checking the path information on the screen of the template item to be added, and setting the path on the screen without user input according to the path information on the checked screen. At least one of the steps of automatically adding a template item to a path on a corresponding screen by calling a template item may be included.

The apparatus for providing a surgical report according to another embodiment comprises an output unit for displaying a surgical report template editing screen and a user operation interface for editing a surgical report template, outputting a surgical report, and a surgical report template editing screen including template editing items. And a control unit that reconfigures the template item selected by the user into the template, and reflects the contents in the reconfigured template to generate a surgical report.

The surgery report template editing screen includes a surgical report template editing screen including a template selection area, a template design result area, and a template item design area, and the template selection area selects a template or checks the selected template and creates a new template. The template design result area is a screen where the template page selected in the template selection area is enlarged and displayed, but the operation result of the user's own design of the template item of the surgery report is displayed, and the surgical report template editing screen May be a screen for a user to design a template item of a surgical report.

The control unit can perform at least one user manipulation of a method of clicking a template item to be added to the template or a drag & drop method of selecting and dragging the item to be added to the template and dropping it into the template design result area. Template items can be added. The control unit may adjust the position and size of the template item added by user manipulation. The control unit manually adds a template item by the user or checks the route information on the screen of the template item to be added, and according to the route information on the checked screen, the control unit loads the template item that has set the route on the screen without user input, and retrieves the corresponding screen. Template items can be automatically added to the path on the screen.

According to the method and apparatus for providing a surgical report based on a user-customized template according to an embodiment, a user directly configures a template of a surgical report for the design result of an implant surgery guide and automatically generates a surgical report according to the configured template. As a result, it can be effectively used in the preparation and procedure of surgery. For example, by allowing the user to directly configure patient and surgery plan information as a customized template, information that is deemed unnecessary by the user is removed, and a surgical report containing only information that can be referred to in preparation and progress of surgery is generated and Can be printed.

1 is a view showing the configuration of a surgical report providing apparatus according to an embodiment of the present invention,

2 is a diagram showing a screen of a surgery report provided through a program according to an embodiment of the present invention;

3 is a view showing a surgery report template editing screen according to an embodiment of the present invention;

4 is a program screen for adding a template item according to an embodiment of the present invention;

5 is a program screen for adding a template item according to another embodiment of the present invention;

6 is a program screen in which a user manually adds an image to a surgery report according to an embodiment of the present invention;

7 is a program screen for automatically adding an image to a surgical report through a method of automatically loading an image with a path set;

8 is a diagram illustrating a flow of a method for providing a surgical report based on a customized template according to an embodiment of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms, only the present embodiments are intended to complete the disclosure of the present invention, and the general knowledge in the technical field to which the present invention pertains. It is provided to completely inform the scope of the invention to those who have it, and the invention is only defined by the scope of the claims. The same reference numerals refer to the same components throughout the specification.

In describing embodiments of the present invention, if it is determined that a detailed description of a known function or configuration may unnecessarily obscure the subject matter of the present invention, a detailed description thereof will be omitted, and terms to be described later are in the embodiments of the present invention. These terms are defined in consideration of the function of the user and may vary according to the intention or custom of users or operators. Therefore, the definition should be made based on the contents throughout this specification.

Combinations of each block in the attached block diagram and each step in the flowchart may be executed by computer program instructions (execution engines), and these computer program instructions are provided on a processor of a general purpose computer, special purpose computer or other programmable data processing device. As it may be mounted, its instructions executed by the processor of a computer or other programmable data processing device generate means for performing the functions described in each block of the block diagram or each step of the flowchart.

These computer program instructions may also be stored in a computer usable or computer readable memory that can be directed to a computer or other programmable data processing device to implement a function in a particular way, so that the computer usable or computer readable memory It is also possible to produce an article of manufacture containing instruction means for performing the functions described in each block of the block diagram or each step of the flow chart.

In addition, since computer program instructions can be mounted on a computer or other programmable data processing device, a series of operation steps are performed on a computer or other programmable data processing device to create a computer-executable process. It is also possible for the instructions to perform the data processing apparatus to provide steps for executing the functions described in each block of the block diagram and each step of the flowchart.

In addition, each block or each step may represent a module, segment, or part of code containing one or more executable instructions for executing specified logical functions, and in some alternative embodiments mentioned in the blocks or steps. It should be noted that it is also possible for functions to occur out of order. For example, two blocks or steps shown in succession may in fact be performed substantially simultaneously, and the blocks or steps may be performed in the reverse order of a corresponding function as necessary.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the embodiments of the present invention exemplified below may be modified in various other forms, and the scope of the present invention is not limited to the embodiments described below. Embodiments of the present invention are provided to more completely describe the present invention to those of ordinary skill in the art to which this invention pertains.

1 is a view showing the configuration of a surgical report providing apparatus according to an embodiment of the present invention.

The surgical report providing device 1 is an electronic device capable of executing a medical image processing program such as a dental implant surgery guide design program. Electronic devices include computers, notebook computers, laptop computers, tablet PCs, smartphones, mobile phones, personal media players (PMPs), personal digital assistants (PDAs), and the like. Medical image processing programs include scan programs, CAD programs, etc. in addition to guide design programs. In addition, it can be applied to programs for general medical image processing other than for dental implant surgery. Hereinafter, for convenience of explanation, a dental implant surgery guide design program will be described as an example. However, if image processing is possible, the same can be applied to other programs.

The image processing process using the program includes registration of surgical patients, acquisition of CT data and oral model data of the registered patient, registration of CT data and oral model data, generation of arch lines from the matched image data, and panoramic images using arch lines ( It consists of a process including creation of panoramic image), determining the position and size of the crown model from the patient's oral model data, positioning the implant structure including the fixture from the patient's CT data, designing the guide shape, and outputting the final guide.

The present invention is configured to provide a user-customized surgical report including surgical plan information and guide design information in the process of outputting a final guide designed through implantation plan design.

Hereinafter, a configuration of a surgical report providing apparatus having the above-described features will be described with reference to the configuration of FIG. 1.

Referring to FIG. 1, a surgical report providing apparatus 1 according to an embodiment includes a data acquisition unit 10, a storage unit 12, a control unit 14, an input unit 16, and an output unit 18. .

The data acquisition unit 10 acquires basic image data of a patient. Basic image data includes X-ray data, CT data, MRI data, and oral model data. The data acquisition unit 10 may execute basic image data in a program or load data stored in a web page and a server. CT data, oral model data, etc. may be required as basic data for implant placement.

Oral model data can be obtained by scanning a plaster model created after the patient's mouth with a 3D scanner, or by scanning the inside of the patient's mouth using a 3D intra-oral scanner. have. CT data can be obtained by generating a patient's head tomography images using computed tomography (CT), segmenting the boundary of the tooth from each tomography image, and then combining them into one. The obtained oral model data and CT data may be stored in the storage unit 12.

The storage unit 12 stores information necessary for the operation of the surgical report providing device 1 and information generated according to the operation, and provides information upon request of the control unit 14. For example, the storage unit 12 stores implantation design data and surgery reports generated by the control unit 14. The implantation design data includes information on an implantation position and orientation for an implant structure including a fixture, and information on a guide shape. The implantation design data can be used as a surgical guide during the surgical procedure. The surgical report includes basic patient information, surgically planned tooth number, surgical drilling kit information, implant structure and surgical guide information for each tooth number, captured image centered on the planned fixture, and drilling sequence.

The controller 14 generates placement design data including the placement position and direction of the virtual implant structure from the image data, and designs and provides a guide shape. In this case, the controller 14 may perform a simulation of placing a virtual implant structure object in the image data. The image data includes multidimensional images such as 2D and 3D showing the patient's tooth arrangement created for implant placement planning design. For example, various types of images are used, such as basic image data acquired through the data acquisition unit 10, panoramic image data, image data generated through reconstruction, and matching data obtained by matching a plurality of images. Can be.

After the implant placement plan is designed by the control unit 14, the 3D shape format data of the guide and the surgical report that can confirm the surgery plan of the guide are generated. The surgical report may be replaced with a surgical report or may further include a surgical report. In order to generate a surgical report, the control unit 14 configures a surgical report template editing screen including a template editing item and reconstructs the template item selected by the user into the template. Then, the surgical report is generated by reflecting the contents in the reorganized template. Editing includes a series of processes such as adding, deleting, and changing template items. The surgery report template editing screen according to an embodiment includes a template selection area, a template design result area, and a template item design area. An embodiment of this will be described later with reference to FIG. 3.

The control unit 14 includes an input unit 16 such as a method of clicking a template item to be added to a template, a drag & drop method of selecting and dragging an item to be added to the template and dropping it into the template design result area. Template items can be added by user manipulation through ). In addition, the control unit 14 may adjust the position and size of the template item added by user manipulation through the input unit 16. The control unit 14 manually adds a template item by user manipulation through the input unit 16, or checks the route information on the screen of the template item to be added, and according to the checked route information, the route on the screen without user input. You can add a template item by calling the template item that has been set and automatically adding the template item to the path on the screen.

The output unit 18 displays a surgery report template editing screen and a user operation interface for editing the surgery report template. In addition, according to the template editing, the surgical report reflecting the contents of the template is output.

2 is a diagram showing a screen of a surgery report provided through a program according to an embodiment of the present invention.

Referring to FIG. 2, when the position of the implant structure including the fixture is determined using a program and the final surgical guide is generated by reflecting this information, the surgical plan information and the design information of the guide are included as shown in FIG. To generate a surgical report. The surgical report includes information on surgeons and hospitals who establish a surgical plan or perform surgery, patient information and image information of patients who have planned surgery, information on guides that have been designed, information on planned implant structures by tooth number, and implants. Images captured based on the location of the structure, drilling sequence for each fixture, surgery information (Surgery Info.), drill kit information (Drill Kit Info.), implant & guide hole information (Implant & Guide Hole Info.), and others. It includes comments and more. Information on implants and guide holes includes Tooth Number, Manufacturer, Code Name, System, Length, Diameter, Stent Hole Diameter, and stent. Information such as Stent Hole Type may be included.

The surgical report, which includes patient information to the entire surgical plan, is automatically entered without additional work except for comments in a way that the information entered by the user during the guide design process is called on the basic template provided by the program. .

3 is a diagram illustrating a surgery report template editing screen according to an embodiment of the present invention.

In addition to the basic template provided by the program, as shown in FIG. 3, a user-customized template of the surgical report can be directly designed and used as a basic template through the surgical report template editing screen.

Referring to FIG. 3, the surgical report template editing screen includes an area A 310, an area B 320, and an area C 330.

A area 310 is a template selection area in which a template can be selected or a template can be added to create a new template by checking the selected template. The template list, page information of the selected template, and the selected template This is the area where basic information is displayed.

Area B 320 is an enlarged template page selected in area A 310, and in the enlarged template page, a template design result area in which the result of the user's direct design of template items through area C 330 is displayed. to be. It can provide not only A4 size but also commonly used paper size, and design multiple pages simultaneously by dividing the screen.

The C area 330 is a template item design area for designing a template item of a surgical report, and is composed of items that can be added when a template is produced. For example, it consists of User Information, Surgery Information, Surgery Image, Other Items (Appendix), and User Additional Items (Customized). Surgery information may include patient information (Patient Info.), tooth number (Tooth No.), drill kit (Drill Kit), fixture information (Implant Info.), main image (Main Image). . The main image may be a CT image, an oral scan image, or the like. Surgery image information is an axial view image, a sagittal view image, a coronal 3D volume image, a panoramic image, and a parallel image. It may include a parallel image, a bone density image, and a capture image. The captured image may be an image manually captured by the user. Other items (Appendix) may include a drilling sequence (Drilling Sequence) and a comment (Comment). Drilling sequence is a screen where you can check the drilling sequence. Comments include text and pages. User additional items (Customized) may include a drilling image (Drill IMG). Meanwhile, the above-described items are some examples listing representative items to aid understanding of the present invention, and it is specified that similar items may be added or changed.

To add each item to the template, you can use a method such as clicking the mouse on the item. As another example, a drag & drop method in which an item to be added is clicked and selected, and then the selected item is clicked and dragged and dropped to a desired position in the area B 320 may be used. The position and size of the items added to the B area 320 may be adjusted. For example, you can click and select an item you want to adjust its position or size, then click and drag the selected item to drop it at a desired location. You can adjust the position using a drag & drop method. As an example of resizing, the size of the template item can be adjusted by clicking a template item to be resized and controlling a border with a mouse. The boundary line control of the mouse is a method of freely adjusting the size of design items by mouse movement by over & clicking the mouse on the boundary line.

Template editing allows not only adding templates, but also deleting items. For example, after a user selects an unnecessary template item from among the template items included in the area B 320, the user can delete it by clicking an activated delete icon in the selected template item. When the mouse is over the item to be deleted, the delete icon is activated, and if the delete icon is clicked, the corresponding template item can be deleted. As another example, after the user selects an item to be deleted, the corresponding item may be deleted using the Delete key on the keyboard.

4 is a program screen for adding a template item according to an embodiment of the present invention.

Referring to FIG. 4, when adding a template item to area B 320, an automatically selected item is placed in a preset position with a line, and the user can modify the position and size. First, the placement position is based on the basic position included in the major category of each item. For example, as shown in FIG. 4, when the user selects the'Sub-category: Tooth No. button' in the'Large Category: Surgery Information' in the C area 330, the tooth number correct �� is displayed. It is automatically arranged in a preset position of the area B 320, and the position and size can be arbitrarily modified by the user.

5 is a program screen for adding a template item according to another embodiment of the present invention.

Referring to FIG. 5, in order to add the entire large category to the template, all items included in the large category are simultaneously added by selecting an all item selection menu interface (eg, All button). For example, if the user clicks the All button 500 of Surgery Information, the Surgery Information is located at a designated location on the template page, and if another item is located at the designated location, it is already added. Configure the screen layout to be located at the bottom of the item.

In the case of'Additional User Items', the user can directly add the list of major categories and each item. When the additional item is'Video', it provides a method that the user can manually add to the surgery report, and a method that automatically loads the image with the path set. For example, the automatic loading method checks the path information on the screen of the image to be added to the screen, and according to the path information on the screen, loads the image that has set the path on the screen without user input, This is a method of automatically adding video. The path on the screen is path information that matches the actual screen of the program. A method of manually adding an image to a surgical report by a user will be described later with reference to FIG. 6 and an automatic call method with reference to FIG. 7.

When the contents of the surgical report are reflected in the generated template, a surgical report is generated. By using the basic function provided in the surgical report, the user can modify or print the generated surgical report.

6 is a program screen in which a user manually adds an image to a surgery report according to an embodiment of the present invention.

Referring to FIG. 6, information such as a template list and a template page selected from the template list is provided in the area A 310 of the surgical report template editing screen. When a template is changed in the template list, the contents of the surgery report are applied to the changed template and a surgery report is generated.

The C area 330 includes a list of basic tools used in a surgical report and a capture image captured by a user during the operation planning process. When a user wants to add a capture image to the surgery report, it can be added by clicking an area included in the capture image item in the template. If there is no capture image item, a method of sequentially adding to the last page of the surgical report can be used.

7 is a program screen for automatically adding an image to a surgery report through a method of automatically loading an image for which a path has been set.

Referring to FIG. 7, in the surgery plan image information (Surgery Image), an axial view image (700) other than a capture image (Axial view image) (700), a sagittal view image (Sagittal view image) (710), parallel The image on the screen by the user targeting images of a parallel image 720, a coronal 3D volume image 730, a panoramic image 740, and an item added by the user. When a path is set, as shown in FIG. 7, images are automatically input along a path on a set screen without user input.

1 and 8, the surgery report providing device 1 provides a surgery report template editing screen (S810). The surgery report template editing screen may include a template selection area, a template design result area, and a template item design area. The template selection area is a screen in which a template is added to select a template, check the selected template, and create a new template. The template design result area is a screen in which the template page selected in the template selection area is enlarged and displayed, and the operation result of the user designing the template item of the surgery report is displayed. The surgery report template editing screen is a screen in which the user designs the template items of the surgery report.

The template item design area according to an embodiment is composed of User Information, Surgery Information, Surgery Image Information, Other Items (Appendix), and User Additional Items (Customized). It is possible to add and delete items through user setting. In the template item design area, template items are classified into major categories, and each major category area may provide an entire item selection menu interface for adding all items included in the major category to the template.

Subsequently, the surgery report providing device 1 reconstructs the template item selected by the user on the surgery report template editing screen into the template (S820). For example, template items using a mouse-click method to add a template item to a template, a drag & drop method (Drag & Drop) in which the item to be added to the template is selected and dragged to move to the template design result area. Add At this time, the position and size of the template item added by user manipulation can be adjusted.

In the template reconfiguration step (S820) according to an embodiment, when the template item to be added is an image, the surgical report providing device 1 is a method of manually adding an image by a user, and a path on the screen of the image to be added. According to the path information on the screen after checking the information, a method of automatically adding an image to the path on the screen by calling the image that has set the path on the screen without user input is used.

Subsequently, the surgical report providing device 1 generates a surgical report by reflecting the contents on the reconstructed template (S830). Surgical reports can be saved and printed. For example, it may be saved in the form of a pdf file, and displayed on a screen or output to the outside through a printing device.

So far, the present invention has been looked at around the embodiments. Those of ordinary skill in the art to which the present invention pertains will be able to understand that the present invention may be implemented in a modified form without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments should be considered from an illustrative point of view rather than a limiting point of view. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope equivalent thereto should be construed as being included in the present invention.

Claims

Providing a surgical report template editing screen;

Reconfiguring the template item selected by the user into the template on the surgery report template editing screen; And

Generating a surgical report by reflecting the contents on the reconstructed template;

Surgical report providing method comprising a.
The method of claim 1, wherein providing the surgery report template editing screen comprises:

Provides a surgical report template editing screen including a template selection area, a template design result area, and a template item design area,

The template selection area is a screen for selecting a template, checking the selected template, and adding a template to create a new template.

In the template design result area, the template page selected in the template selection area is enlarged and displayed, but the result of the operation that the user designed the template item of the surgery report directly is displayed.

The surgery report template editing screen is a screen for designing template items of the surgery report by the user.
The method of claim 2, wherein the template item design area

It consists of User Information, Surgery Information, Surgery Image, Other Items (Appendix) and User Additional Items (Customized), and items can be added or deleted through user settings. Method of providing a surgical report, characterized in that possible.
The method of claim 2,

In the template item design area, template items are classified into major categories,

Each major category area provides a menu interface for selecting all items in which all items included in the major category can be added to the template.
The method of claim 1, wherein the step of reconfiguring into the template

Template items are added through at least one of a mouse-click method to add a template item to the template or a drag & drop method (Drag & Drop) of selecting and dragging the item to be added to the template and dropping it in the template design result area. Method of providing a surgical report, characterized in that.
The method of claim 1, wherein the step of reconfiguring into the template

A method of providing a surgical report, characterized in that adjusting the position and size of the template item added by user manipulation.
The method of claim 1, wherein the step of reconfiguring into the template

Manually adding a template item by a user; And

Checking the path information on the screen of the template item to be added, and automatically adding the template item to the path on the screen by calling the template item that has set the path on the screen without user input according to the path information on the screen;

Surgical report providing method comprising at least one of.
An output unit for displaying a surgical report template editing screen and a user operation interface for editing a surgical report template and outputting a surgical report; And

A control unit configured to configure a surgical report template editing screen including a template editing item, reconstruct the template item selected by the user into the template, and reflect the contents in the reconstructed template to generate a surgical report;

Surgical report providing device comprising a.
The method of claim 8, wherein the surgical report template editing screen

Includes a surgical report template editing screen including a template selection area, a template design result area, and a template item design area,

The template selection area is a screen for selecting a template, checking the selected template, and adding a template to create a new template.

In the template design result area, the template page selected in the template selection area is enlarged and displayed, but the result of the operation that the user designed the template item of the surgery report directly is displayed.

The surgical report template editing screen is a surgical report providing device, characterized in that the user designs a template item of the surgical report.
The method of claim 9, wherein the template item design area

It consists of User Information, Surgery Information, Surgery Image, Other Items (Appendix) and User Additional Items (Customized), and items can be added or deleted through user settings. Surgical report providing device, characterized in that possible.
The method of claim 9,

In the template item design area, template items are classified into major categories,

Each major category area provides a menu interface for selecting all items in which all items included in the major category can be added to the template.
The method of claim 8, wherein the control unit

Template items by user manipulation of at least one of the method of clicking the template item to be added to the template or the drag & drop method of selecting and dragging the item to be added to the template and dropping it in the template design result area Surgical report providing device, characterized in that to add.
The method of claim 8, wherein the control unit

Surgical report providing device, characterized in that adjusting the position and size of the template item added by user manipulation.
The method of claim 8, wherein the control unit

Manually add a template item by the user, or check the route information on the screen of the template item to be added, and according to the route information on the checked screen, the template item that has set the route on the screen without user input is called and the route on the screen Surgical report providing device, characterized in that automatically adding a template item to.