CN111128350B - Online editing method and device - Google Patents

Abstract

The invention discloses an online editing method and device. Wherein, the method includes: determining a first three-dimensional model file of the object to be processed; determining a second three-dimensional model of an initial implant that needs to be implanted in the object to be processed, wherein the initial implant is determined based on the characteristic information of the object to be processed. of; displaying in a predetermined browser a first frame for presenting the first three-dimensional model corresponding to the first three-dimensional model file; matching the first three-dimensional model and the second three-dimensional model to the first frame; presenting in the first frame The first three-dimensional model and the second three-dimensional model; select the third three-dimensional model, and use the third three-dimensional model to replace the second three-dimensional model presented in the first frame. The present invention solves the technical problem in the related art that the surgical plan cannot be edited when displayed through a browser.

Description

Online editing method and device

Technical field

The present invention relates to the field of data processing technology, and specifically to an online editing method and device.

Background technique

Surgical planning means obtaining images of the patient's lesions before surgery, and then combining the doctor's knowledge of anatomy and pathology to conduct surgical planning (including surgical methods, surgical procedures, surgical incisions and paths, etc.), and obtain a surgical plan. With the development of science and technology, doctors use computer technology to assist in pre-operative planning in order to design the optimal surgical plan.

In terms of presentation of surgical planning, users are usually required to install a client on a computer or mobile phone. Even when using a browser to display surgical planning, the user is required to download and install a plug-in in order to perform interactive three-dimensional display on the web page. This operation gives users caused inconvenience.

At the same time, when users browse the surgical plan, they need to edit and adjust the surgical plan, such as replacing the implant and prosthesis model pre-selected in the surgical plan. The conventional online presentation method of browsing the surgical plan cannot meet the needs of editing the surgical plan.

Regarding the above-mentioned related technology problem of being unable to edit when displaying the surgical plan through a browser, no effective solution has yet been proposed.

Contents of the invention

Embodiments of the present invention provide an online editing method and device to at least solve the technical problem in the related art that editing cannot be performed when displaying surgical plans through a browser.

According to one aspect of an embodiment of the present invention, an online editing method is provided, including: determining a first three-dimensional model file of an object to be processed; determining a second three-dimensional model of an initial implant that needs to be implanted in the object to be processed, Wherein, the initial implant is determined based on the characteristic information of the object to be processed; a first frame for presenting the first three-dimensional model corresponding to the first three-dimensional model file is displayed in a predetermined browser; Match the first three-dimensional model and the second three-dimensional model to the first frame; present the first three-dimensional model and the second three-dimensional model in the first frame; select a third three-dimensional model, and The second three-dimensional model presented in the first frame is replaced with the third three-dimensional model.

Optionally, before determining the first three-dimensional model file of the object to be processed, the online editing method further includes: obtaining image data of the object to be processed; performing reverse processing on the image data to obtain the first three-dimensional model file. Model.

Optionally, determining the first three-dimensional model file of the object to be processed includes: determining the first spatial position information of the first three-dimensional model and the first attribute information of the first three-dimensional model; according to the first space The position information and the first attribute information determine the first three-dimensional model file of the object to be processed, and the first three-dimensional model file is stored in a first predetermined storage location.

Optionally, determining that a second three-dimensional model of the initial implant that needs to be implanted in the object to be treated includes: storing the second three-dimensional model to a second predetermined storage location; wherein, storing the second three-dimensional model To the second predetermined storage location includes: determining the model information of the initial implant and the second spatial position information of the initial implant according to the object to be processed, and obtaining a second image of the second three-dimensional model. Model file; store the second model file in the second predetermined storage location.

Optionally, presenting the framework for presenting the first three-dimensional model in the predetermined browser includes: under the 3D drawing protocol, the predetermined browser converts the first model of the first three-dimensional model into the first three-dimensional model through a JavaScript script. The file is transferred to the display card of the predetermined computer; controlling the display card to build the first frame in the predetermined browser through a shader according to the first model file; rendering the first frame in the predetermined browser frame.

Optionally, matching the first three-dimensional model and the second three-dimensional model to the first frame includes: controlling the predetermined browser to convert the first model file and the second model file into the first frame through a JavaScript script. The file is transferred to the vertex shader and fragment shader of the display card; controlling the predetermined browser to call the vertex shader and fragment shader of the display card through the JavaScript script to process the first model file and the The information corresponding to the second model file.

Optionally, before selecting the third three-dimensional model, the online editing method further includes: building an implant product library; wherein building the implant product library includes: determining at least An implant; obtain the three-dimensional model file of the at least one implant to obtain the implant product library.

Optionally, selecting a third three-dimensional model and using the third three-dimensional model to replace the second three-dimensional model presented in the first frame includes: displaying in the predetermined browser for presenting the at least a second frame of a three-dimensional model file of an implant; transmitting the three-dimensional model file in the implant product library to the predetermined browser to present the at least one implant in the second frame a three-dimensional model file; select the third three-dimensional model from the second frame; move the third three-dimensional model to a predetermined position of the first frame to replace the one presented in the first frame of the second three-dimensional model.

According to another aspect of the embodiment of the present invention, an online editing device is also provided, including: a first determination unit used to determine the first three-dimensional model file of the object to be processed; a second determination unit used to determine the need for implantation The second three-dimensional model of the initial implant of the object to be treated, wherein the initial implant is determined based on the characteristic information of the object to be treated; a display unit configured to display the initial implant in a predetermined browser. Present the first frame of the first three-dimensional model corresponding to the first three-dimensional model file; a matching unit for matching the first three-dimensional model and the second three-dimensional model to the first frame; a presentation unit, for presenting the first three-dimensional model and the second three-dimensional model in the first frame; a replacement unit for selecting a third three-dimensional model and using the third three-dimensional model to replace the first three-dimensional model presented in the first frame; The second 3D model in the frame.

Optionally, the online editing device further includes: an acquisition unit, configured to acquire the image data of the object to be processed before determining the first three-dimensional model file of the object to be processed; and a reverse processing unit, configured to perform the processing on the object. The image data is reversely processed to obtain the first three-dimensional model.

Optionally, the first determination unit includes: a first determination module, used to determine the first spatial position information of the first three-dimensional model and the first attribute information of the first three-dimensional model; a second determination module, Determining a first three-dimensional model file of the object to be processed according to the first spatial position information and the first attribute information, and storing the first three-dimensional model file in a first predetermined storage location.

Optionally, the second determination unit includes: a storage module for storing the second three-dimensional model to a second predetermined storage location; wherein the storage module includes: a determination sub-module for determining according to the to-be-determined The processing object determines the model information of the initial implant and the second spatial position information of the initial implant, and obtains a second model file of the second three-dimensional model; a storage submodule is used to store the second The model file is stored in the second predetermined storage location.

Optionally, the presentation unit includes: a transmission module, configured for the predetermined browser to transmit the first model file of the first three-dimensional model to the display card of the predetermined computer through a JavaScript script under a 3D drawing protocol; A control module, used to control the display card to build the first frame in the predetermined browser through a shader according to the first model file; a presentation module, used to present the first frame in the predetermined browser First frame.

Optionally, the matching unit includes: a second control module for controlling the predetermined browser to transmit the first model file and the second model file to the vertex shader of the display card through a JavaScript script and a fragment shader; a third control module for controlling the predetermined browser to call the vertex shader and fragment shader of the display card through the JavaScript script to process the first model file and the second model Information corresponding to the file.

Optionally, the online editing device further includes: a building unit, used to build an implant product library before selecting the third three-dimensional model; wherein the building unit includes: a third determination module, used to determine according to the At least one implant determined by the first three-dimensional model file; an acquisition module configured to acquire the three-dimensional model file of the at least one implant to obtain the implant product library.

Optionally, the replacement unit includes: a presentation module, configured to present a second frame for presenting the three-dimensional model file of the at least one implant in the predetermined browser; a presentation module, configured to display the three-dimensional model file of the at least one implant. The three-dimensional model file in the implant product library is transmitted to the predetermined browser to present the three-dimensional model file of the at least one implant in the second frame; a selection module is used to select the three-dimensional model file from the second frame Select the third three-dimensional model in the first frame; a replacement module for moving the third three-dimensional model to a predetermined position of the first frame to replace the second three-dimensional model presented in the first frame Model.

According to another aspect of the embodiment of the present invention, a storage medium is also provided. The storage medium includes a stored program, wherein the program executes any one of the above online editing methods.

According to another aspect of the embodiment of the present invention, a processor is also provided, and the processor is configured to run a program, wherein when the program is running, it executes any one of the above online editing methods.

In the embodiment of the present invention, a first three-dimensional model file is used to determine the object to be treated; and a second three-dimensional model is used to determine the initial implant that needs to be implanted in the object to be treated, wherein the initial implant is based on the characteristics of the object to be treated. The information is determined; displaying in a predetermined browser a first frame for presenting the first three-dimensional model corresponding to the first three-dimensional model file; matching the first three-dimensional model and the second three-dimensional model to the first frame; in the first frame The first three-dimensional model and the second three-dimensional model are presented in the first frame; the third three-dimensional model is selected, and the third three-dimensional model is used to replace the second three-dimensional model presented in the first frame. Through the online editing method provided by the embodiment of the present invention, the A framework for displaying the three-dimensional model of the object to be processed and the implant can be built directly in the predetermined browser. When display or editing is needed, the purpose of display or editing can be directly performed in the browser, and the treatment is improved. The technical effect of flexibility in processing the object is solved, thereby solving the technical problem in related technologies that the surgical plan cannot be edited when displayed through a browser.

Description of the drawings

The drawings described here are used to provide a further understanding of the present invention and constitute a part of this application. The illustrative embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the attached picture:

Figure 1 is a flow chart of an online editing method according to an embodiment of the present invention;

Figure 2 is a flow chart of an optional online editing method according to an embodiment of the present invention;

Figure 3 is a schematic diagram of objects to be processed and implants displayed in a browser according to an embodiment of the present invention;

Figure 4 is a schematic diagram of optional objects to be processed and implants displayed in a browser according to an embodiment of the present invention;

Figure 5 is a schematic diagram of an online editing device according to an embodiment of the present invention.

Detailed ways

In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only These are some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts should fall within the scope of protection of the present invention.

It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances so that the embodiments of the invention described herein are capable of being practiced in sequences other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, e.g., a process, method, system, product, or apparatus that encompasses a series of steps or units and need not be limited to those explicitly listed. Those steps or elements may instead include other steps or elements not expressly listed or inherent to the process, method, product or apparatus.

Example 1

According to an embodiment of the present invention, a method embodiment of an online editing method is provided. It should be noted that the steps shown in the flow chart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and, Although a logical sequence is shown in the flowcharts, in some cases the steps shown or described may be performed in a sequence different from that herein.

Figure 1 is a flow chart of an online editing method according to an embodiment of the present invention. As shown in Figure 1, the online editing method includes the following steps:

Step S102: Determine the first three-dimensional model file of the object to be processed.

Optionally, before determining the first three-dimensional model file of the object to be processed, the online editing method further includes: obtaining image data of the object to be processed; and performing reverse processing on the image data to obtain the first three-dimensional model.

For example, the object to be processed may be a skeleton, and the image data may be computed tomography CT data of the skeleton, or magnetic resonance MRI data. Of course, it may also be other types of image data.

In addition, determining the first three-dimensional model file of the object to be processed includes: determining the first spatial position information of the first three-dimensional model and the first attribute information of the first three-dimensional model; determining the first three-dimensional position information and the first attribute information of the object to be processed. The first three-dimensional model file of the object is stored in the first predetermined storage location.

For example, after using the medical imaging data of the skeleton to reversely obtain the three-dimensional model of the skeleton (i.e., the first three-dimensional model), the first three-dimensional model can also be stored as a model file (the first three-dimensional model file) containing spatial position information. The model file can include material and other attribute information to optimize the rendering effect in the predetermined browser.

In one application scenario, medical imaging data such as CT or MRI of bones are obtained, and a three-dimensional model of the bones is reversely generated using the medical imaging data of the bones, and stored as a first three-dimensional model file containing spatial position information; the first three-dimensional model file can Contains material and other attribute information to optimize the rendering effect in the browser.

Step S104: Determine the second three-dimensional model of the initial implant that needs to be implanted into the object to be treated, where the initial implant is determined based on the characteristic information of the object to be treated.

Optionally, use the first three-dimensional model of the skeleton and use design software to perform surgical planning and design, that is, determine the model and spatial position information of the orthopedic implant needed for the operation, and store the orthopedic implant model as a file containing The three-dimensional model file of the spatial position information, that is, the second three-dimensional model file; the second three-dimensional model file may contain attribute information such as material to optimize the presentation effect in the browser.

In an optional embodiment, determining that the second three-dimensional model of the initial implant that needs to be implanted in the object to be treated may include: storing the second three-dimensional model to a second predetermined storage location; wherein, the second three-dimensional model Storing to the second predetermined storage location includes: determining the model information of the initial implant and the second spatial position information of the initial implant according to the object to be processed, and obtaining a second model file of the second three-dimensional model; storing the second model file at the second predetermined storage location.

For example, use a three-dimensional model of the skeleton and use design software for surgical planning and design, that is, determine the model and spatial position information of the orthopedic implant needed for the operation, and store the orthopedic implant model as a model containing the spatial position information. 3D model file. It should be noted that, in the embodiment of the present invention, the number of implants is one or more.

Step S106: Display the first frame for presenting the first three-dimensional model corresponding to the first three-dimensional model file in a predetermined browser.

Optionally, presenting the framework for presenting the first three-dimensional model in the predetermined browser may include: under the 3D drawing protocol, the predetermined browser transmits the first model file of the first three-dimensional model to the display of the predetermined computer through a JavaScript script. card; the control display card builds the first frame in the predetermined browser through the shader according to the first model file; and renders the first frame in the predetermined browser.

That is, the webGL technology is used to build a presentation framework for surgical planning online through a browser (ie, a scheduled browser). Among them, WebGL (Web Graphics Library) is a 3D drawing protocol. This drawing technology standard allows JavaScript and OpenGL ES 2.0 to be combined. By adding a JavaScript binding to OpenGL ES 2.0, WebGL can provide hardware 3D for HTML5 Canvas. Speed up rendering.

WebGL perfectly solves two problems of existing Web interactive three-dimensional animation: first, it realizes the production of Web interactive three-dimensional animation through HTML script itself, without any browser plug-in support; second, it uses the underlying graphics The hardware acceleration function performs graphics rendering through a unified, standard, cross-platform OpenGL interface. Through this technology, without using any browser plug-ins, just using HTML and JavaScript, you can create web interactive 3D animations with performance comparable to current Flash, Silverlight, etc., and it can be used in the same way on any platform. operation.

Step S108: Match the first three-dimensional model and the second three-dimensional model to the first frame.

Optionally, in the above embodiment, the three-dimensional model of bones and implants containing spatial position information is mainly stored in the surgical planning library, and transmitted to the browser (i.e., scheduled browser) through the Internet, and the browser is based on The spatial position information of the three-dimensional model of the bone and the implant is used to match the three-dimensional model of the bone and the implant in the first presentation frame.

In an optional embodiment, matching the first three-dimensional model and the second three-dimensional model to the first frame may include: controlling a predetermined browser to transmit the first model file and the second model file to the display card through a JavaScript script. The vertex shader and fragment shader; control the predetermined browser to call the vertex shader and fragment shader of the display card through a JavaScript script to process the information corresponding to the first model file and the second model file.

Step S110: Present the first three-dimensional model and the second three-dimensional model in the first frame.

For example, the three-dimensional model of bones and implants is matched in the first rendering frame, and the browser directly transfers the matrix and material information of the three-dimensional model of bones and implants to the vertex shader and fragment shader of the computer graphics card through JavaScript; The browser directly calls the vertex shader and fragment shader of the computer graphics card through JavaScript to process the matrix and material information of the 3D model of the bones and implants, and prepares for the drawing of the 3D model; the browser directly JavaScript calls the computer graphics card to draw the three-dimensional model of the bones and implants in the rendering frame.

Step S112: Select a third three-dimensional model and replace the second three-dimensional model presented in the first frame with the third three-dimensional model.

In addition, before selecting the third three-dimensional model, the online editing method also includes: building an implant product library; wherein building the implant product library includes: determining at least one implant determined according to the first three-dimensional model file; obtaining A three-dimensional model file of at least one implant to obtain an implant product library.

For example, a three-dimensional implant model containing spatial position information is stored in a product library (i.e., implant product library) and transmitted to a browser through the Internet. The browser, based on the spatial position information of the implant three-dimensional model, The implant three-dimensional model (ie, the three-dimensional model file of at least one implant) is matched into the presentation second frame.

It can be seen from the above that in the embodiment of the present invention, the first three-dimensional model file of the object to be treated is determined; the second three-dimensional model of the initial implant that needs to be implanted in the object to be treated is determined, and displayed in a predetermined browser for presenting the third A first frame of the first three-dimensional model corresponding to a three-dimensional model file; matching the first three-dimensional model and the second three-dimensional model to the first frame; presenting the first three-dimensional model and the second three-dimensional model in the first frame; selecting The third three-dimensional model is used to replace the second three-dimensional model presented in the first frame, thereby directly building a framework for displaying the three-dimensional model of the object to be processed and the implant in the predetermined browser. When display or editing is required, the display or editing can be performed directly in the browser.

It is easy to notice that in the embodiment of the present invention, the three-dimensional model of the object to be processed and the three-dimensional model of the implant are transmitted to the browser in advance, and the three-dimensional model of the object to be processed is pre-built in the browser. The framework of the implant allows you to build a framework for displaying the object to be processed and the three-dimensional model of the implant directly in a predetermined browser. When display or editing is needed, it can be displayed or edited directly in the browser. The purpose is to achieve the technical effect of improving the flexibility of processing objects to be processed. ,

Therefore, the online editing method provided by the embodiment of the present invention solves the technical problem in the related art that editing cannot be performed when the surgical plan is displayed through a browser.

According to the above embodiments of the present invention, in step S112, selecting the third three-dimensional model and using the third three-dimensional model to replace the second three-dimensional model presented in the first frame may include: displaying in a predetermined browser for presenting at least one a second frame of a three-dimensional model file of the implant; transmitting the three-dimensional model file in the implant product library to a predetermined browser to present at least one three-dimensional model file of the implant in the second frame; from the second frame Select the third three-dimensional model in the first frame; move the third three-dimensional model to a predetermined position in the first frame to replace the second three-dimensional model presented in the first frame.

Taking the object to be processed as a skeleton, the online editing method provided by the embodiment of the present invention will be described in detail below with reference to the accompanying drawings.

Figure 2 is a flow chart of an optional online editing method according to an embodiment of the present invention. As shown in Figure 2, it includes: Step (1): Acquisition of a three-dimensional skeleton model, specifically: acquisition of medical images such as CT or MRI of the skeleton. Data, use the medical imaging data of the bones to reversely generate a three-dimensional model of the bones, and store it as a model file containing spatial position information; that is, obtain medical imaging data such as CT or MRI of the bones, and use the medical imaging data of the bones to reversely generate a three-dimensional model of the bones. The model is stored as a model file containing spatial position information. The model file (ie, the first three-dimensional model file) may contain attribute information such as material to optimize the presentation effect in the browser.

Step (2) Obtain the three-dimensional model of the implant, specifically: use the three-dimensional model of the bone and use design software to plan and design the surgery, that is, determine the model and spatial position information of the implant needed during the surgery, and then The implanted object model is stored as a three-dimensional model file containing spatial position information. The model file (the second three-dimensional model file) can contain material and other attribute information to optimize the presentation effect in the browser; where, the number of implants is one or more.

Step (3) Construction of the presentation framework of the surgical planning library, specifically: using WebGL technology to build the presentation framework of the three-dimensional model of bones and implants online through the browser. In order to express the three-dimensional skeletal model vividly and vividly and access it online through a browser, in embodiments of the present invention, HTML5 and WebGL framework technologies are used to build a presentation framework for the three-dimensional skeletal model. Using the WebGL framework system in HTML5, this framework can make full use of the advantages in display bandwidth to draw and display three-dimensional graphics on the browser in a plug-in-free form. Under the WebGL framework, the browser passes the information about the presentation framework of the skeletal 3D model to be built to the computer's display card through JavaScript scripts. The display card uses the shader to render the skeletal 3D model on the browser based on the passed information. Construction of the framework.

Step (4) Building the product library presentation framework, specifically: using WebGL technology to build the presentation framework of the implant three-dimensional model online through the browser (i.e., the second frame).

Step (5) Match the three-dimensional model of bones and implants into the presentation framework, specifically: store the three-dimensional model of bones and implants containing spatial position information into the surgical planning library, and transmit it to the browser through the Internet, and the browser will The spatial position information of the three-dimensional model of the bone and implant is used to match the three-dimensional model of the bone and implant in the presentation frame. The 3D models of bones and implants are matched in the rendering framework. The browser directly transfers the matrix and material information of the 3D models of bones and implants to the vertex shader and fragment shader of the computer display card through JavaScript; the browser directly passes JavaScript calls the vertex shader and fragment shader of the computer graphics card to process the matrix and material information of the 3D model of bones and implants passed in, and prepares for the drawing of the 3D model; the browser directly calls the computer display through JavaScript Card, draw the 3D model of the bones and implants in the rendering frame.

Step (6) Match the three-dimensional models of implants of different types into the presentation frame (i.e., the second frame), specifically: store the three-dimensional implant models containing spatial position information into the product library, and transmit them to the browser through the Internet. The browser matches the three-dimensional implant model to the presentation frame based on the spatial position information of the implant three-dimensional model.

Step (7) Online presentation of surgical planning. Figure 3 is a schematic diagram of the object to be processed and the implant displayed in the browser according to the embodiment of the present invention. As shown in Figure 3, bone 1, implant 2 and other implants The 3D model of the object is displayed on the browser in a static or dynamic manner.

Step (8) Online presentation of the product library. Figure 4 is a schematic diagram of optional objects to be processed and implants displayed in a browser according to an embodiment of the present invention. As shown in Figure 4, implant 3 and other implants The 3D model of the object is displayed on the browser in a static or dynamic manner.

Step (9) Perform the editing operation, as shown in Figure 4. Select implant 3 in the product library presentation frame and drag it to the area near implant 2 in the surgical planning library presentation frame. The system can automatically recognize the model and execute it. In the replacement operation, the center of the replaced implant 3 coincides with the original implant 2, and the orientation of the characteristic surface remains unchanged. The user can adjust the new implant 3 to the appropriate position through the movement operation.

It should be noted that the dynamic online display of the three-dimensional model of bones and implants includes: rotation, movement, etc. of the model. For example, the three-dimensional model of bones and implants can be rotated and presented along a specified rotation center.

Through the online editing method provided by the embodiment of the present invention, the surgical plan can be presented and edited online in an environment where the browser does not run any plug-ins, which improves the functionality of online presentation of the surgical plan and is conducive to the user's evaluation of the surgical plan. More intuitive editing and observation; it also solves the problem of being unable to edit when using a browser to display surgical planning, and improves the functionality of online presentation of surgical planning.

Example 2

According to another aspect of the embodiment of the present invention, an online editing device is also provided. Figure 5 is a schematic diagram of the online editing device according to the embodiment of the present invention. As shown in Figure 5, the online editing device may include: a first determination unit 51, second determination unit 52, presentation unit 53, matching unit 54, presentation unit 55 and replacement unit 56. The online editing device will be described in detail below.

The first determining unit 51 is used to determine the first three-dimensional model file of the object to be processed.

The second determination unit 52 is used to determine the second three-dimensional model of the initial implant that needs to be implanted into the object to be treated, where the initial implant is determined based on the characteristic information of the object to be treated.

The presentation unit 53 is configured to present the first frame for presenting the first three-dimensional model corresponding to the first three-dimensional model file in a predetermined browser.

The matching unit 54 is used to match the first three-dimensional model and the second three-dimensional model into the first frame.

The presentation unit 55 is configured to present the first three-dimensional model and the second three-dimensional model in the first frame.

The replacement unit 56 is used to select a third three-dimensional model and replace the second three-dimensional model presented in the first frame with the third three-dimensional model.

It should be noted here that the above-mentioned first determination unit 51, second determination unit 52, presentation unit 53, matching unit 54, presentation unit 55 and replacement unit 56 correspond to steps S102 to S112 in Embodiment 1, and the above modules are The examples and application scenarios implemented by the corresponding steps are the same, but are not limited to the content disclosed in the above-mentioned Embodiment 1. It should be noted that the above-mentioned modules, as part of the device, can be executed in a computer system such as a set of computer-executable instructions.

It can be seen from the above that in the above embodiments of the present application, the first determination unit can be used to determine the first three-dimensional model file of the object to be treated; and then the second determination unit can be used to determine the second initial implant that needs to be implanted in the object to be treated. A three-dimensional model, wherein the initial implant is determined based on the characteristic information of the object to be processed; and then the display unit is used to display the first frame for presenting the first three-dimensional model corresponding to the first three-dimensional model file in a predetermined browser; and Utilize the matching unit to match the first three-dimensional model and the second three-dimensional model into the first frame; and utilize the presentation unit to present the first three-dimensional model and the second three-dimensional model in the first frame; and replace the unit for selecting the third three-dimensional model. , and replace the second three-dimensional model presented in the first frame with the third three-dimensional model. Through the online editing device provided by the embodiment of the present invention, a framework for displaying the three-dimensional model of the object to be processed and the implant can be built directly in a predetermined browser. When display or editing is required, the framework can be directly built in the browser. The purpose of display or editing is to achieve the technical effect of improving the flexibility of processing the object to be processed, thereby solving the technical problem in related technologies that editing cannot be performed when displaying surgical planning through a browser.

In an optional embodiment, the online editing device further includes: an acquisition unit, configured to acquire the image data of the object to be processed before determining the first three-dimensional model file of the object to be processed; and a reverse processing unit, configured to The image data is reversely processed to obtain the first three-dimensional model.

In an optional embodiment, the first determination unit includes: a first determination module, used to determine the first spatial position information of the first three-dimensional model and the first attribute information of the first three-dimensional model; a second determination module, Used to determine a first three-dimensional model file of the object to be processed according to the first spatial position information and the first attribute information, and store the first three-dimensional model file in a first predetermined storage location.

In an optional embodiment, the second determination unit includes: a storage module for storing the second three-dimensional model to a second predetermined storage location; wherein the storage module includes: a determination sub-module for determining based on the object to be processed Determine the model information of the initial implant and the second spatial position information of the initial implant to obtain a second model file of the second three-dimensional model; the storage submodule is used to store the second model file in a second predetermined storage location.

In an optional embodiment, the presentation unit includes: a transmission module, configured for the predetermined browser to transmit the first model file of the first three-dimensional model to the display card of the predetermined computer through a JavaScript script under the 3D drawing protocol; A control module, used to control the display card to build the first frame in the predetermined browser through the shader according to the first model file; a rendering module, used to present the first frame in the predetermined browser.

In an optional embodiment, the matching unit includes: a second control module, used to control the predetermined browser to transfer the first model file and the second model file to the vertex shader and fragment shader of the display card through a JavaScript script ; The third control module is used to control the predetermined browser to call the vertex shader and fragment shader of the display card through a JavaScript script to process the information corresponding to the first model file and the second model file.

In an optional embodiment, the online editing device further includes: a building unit, configured to build an implant product library before selecting the third three-dimensional model; wherein the building unit includes: a third determination module, configured to Determine at least one implant determined based on the first three-dimensional model file; and obtain a module for obtaining a three-dimensional model file of at least one implant to obtain an implant product library.

In an optional embodiment, the replacement unit includes: a presentation module, configured to present a second frame for presenting the three-dimensional model file of at least one implant in a predetermined browser; a presentation module, configured to display the implant The three-dimensional model file in the product library is transmitted to a predetermined browser to present the three-dimensional model file of at least one implant in the second frame; a selection module is used to select a third three-dimensional model from the second frame; a replacement module, Used to move the third three-dimensional model to a predetermined position in the first frame to replace the second three-dimensional model presented in the first frame.

Example 3

According to another aspect of the embodiment of the present invention, a storage medium is also provided. The storage medium includes a stored program, wherein the program executes any one of the above online editing methods.

Example 4

According to another aspect of the embodiment of the present invention, a processor is also provided, and the processor is used to run a program, wherein when the program is running, any one of the above online editing methods is executed.

The above serial numbers of the embodiments of the present invention are only for description and do not represent the advantages and disadvantages of the embodiments.

In the above-mentioned embodiments of the present invention, each embodiment is described with its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are only illustrative. For example, the division of the units may be a logical functional division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or may be Integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the units or modules may be in electrical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to cause a computer device (which can be a personal computer, a server or a network device, etc.) to execute all or part of the steps of the method described in various embodiments of the present invention. The aforementioned storage media include: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program code. .

The above are only preferred embodiments of the present invention. It should be noted that those skilled in the art can make several improvements and modifications without departing from the principles of the present invention. These improvements and modifications can also be made. should be regarded as the protection scope of the present invention.

Claims (8)

1. An online editing method, comprising:

determining a first three-dimensional model file of an object to be processed;

determining a second three-dimensional model of an initial implant to be implanted into the object to be processed, wherein the initial implant is determined according to the characteristic information of the object to be processed;

displaying a first frame for presenting a first three-dimensional model corresponding to the first three-dimensional model file in a preset browser;

matching the first three-dimensional model and the second three-dimensional model into the first frame;

presenting the first three-dimensional model and the second three-dimensional model in the first frame;

selecting a third three-dimensional model and replacing the second three-dimensional model presented in the first frame with the third three-dimensional model;

wherein prior to selecting the third three-dimensional model, further comprising: constructing an implant product library; wherein constructing the library of implant products comprises: determining at least one implant determined from the first three-dimensional model file; acquiring a three-dimensional model file of the at least one implant to obtain the implant product library;

wherein selecting a third three-dimensional model and replacing the second three-dimensional model presented in the first frame with the third three-dimensional model comprises: presenting a second frame in the predetermined browser for rendering a three-dimensional model file of the at least one implant; transmitting the three-dimensional model file in the implant product library to the predetermined browser to render the three-dimensional model file of the at least one implant in the second frame; selecting the third three-dimensional model from the second frame; the third three-dimensional model is moved to a predetermined position of the first frame to replace the second three-dimensional model presented in the first frame.

2. The method of claim 1, further comprising, prior to determining the first three-dimensional model file of the object to be processed:

acquiring image data of the object to be processed;

and carrying out reverse processing on the image data to obtain the first three-dimensional model.

3. The method of claim 2, wherein determining the first three-dimensional model file of the object to be processed comprises:

determining first spatial position information of the first three-dimensional model and first attribute information of the first three-dimensional model;

and determining a first three-dimensional model file of the object to be processed according to the first space position information and the first attribute information, and storing the first three-dimensional model file into a first preset storage position.

4. A method according to claim 3, wherein determining a second three-dimensional model of an initial implant to be implanted in the object to be treated comprises: storing the second three-dimensional model to a second predetermined storage location;

wherein storing the second three-dimensional model to the second predetermined storage location comprises:

determining model information of the initial implant and second spatial position information of the initial implant according to the object to be processed to obtain a second model file of the second three-dimensional model;

And storing the second model file in the second preset storage position.

5. The method of claim 4, wherein exposing a frame for rendering the first three-dimensional model in the predetermined browser comprises:

transmitting a first model file of the first three-dimensional model to a display card of a preset computer by the preset browser through a JavaScript script under a 3D drawing protocol;

controlling the display card to build the first frame in the preset browser through a shader according to the first model file;

the first frame is presented in the predetermined browser.

6. The method of claim 5, wherein matching the first three-dimensional model and the second three-dimensional model into the first frame comprises:

controlling the preset browser to transmit the first model file and the second model file to a vertex shader and a fragment shader of the display card through a JavaScript script;

and controlling the preset browser to call a vertex shader and a fragment shader of the display card through the JavaScript script, and processing information corresponding to the first model file and the second model file.

7. An on-line editing apparatus, comprising:

a first determining unit for determining a first three-dimensional model file of an object to be processed;

a second determining unit, configured to determine a second three-dimensional model of an initial implant to be implanted into the object to be processed, where the initial implant is determined according to feature information of the object to be processed;

the display unit is used for displaying a first frame for displaying a first three-dimensional model corresponding to the first three-dimensional model file in a preset browser;

a matching unit for matching the first three-dimensional model and the second three-dimensional model into the first frame;

a presentation unit configured to present the first three-dimensional model and the second three-dimensional model in the first frame;

a replacing unit configured to select a third three-dimensional model and replace the second three-dimensional model presented in the first frame with the third three-dimensional model;

wherein, this online editing device still includes: a building unit for building a library of implant products prior to selecting the third three-dimensional model; wherein the construction unit comprises: a third determination module for determining at least one implant determined from the first three-dimensional model file; the acquisition module is used for acquiring the three-dimensional model file of the at least one implant to obtain the implant product library;

Wherein the replacement unit includes: a presentation module for presenting a second frame of a three-dimensional model file for presenting the at least one implant in the predetermined browser; a rendering module for transmitting the three-dimensional model files in the library of implant products to the predetermined browser to render the three-dimensional model files of the at least one implant in the second frame; a selection module for selecting the third three-dimensional model from the second frame; a replacement module for moving the third three-dimensional model to a predetermined position of the first frame to replace the second three-dimensional model presented in the first frame.

8. The apparatus as recited in claim 7, further comprising:

the acquisition unit is used for acquiring image data of the object to be processed before determining the first three-dimensional model file of the object to be processed;

and the reverse processing unit is used for carrying out reverse processing on the image data to obtain the first three-dimensional model.