CN112820408A - Surgical operation risk determination method, related device and computer program product - Google Patents
Surgical operation risk determination method, related device and computer program product Download PDFInfo
- Publication number
- CN112820408A CN112820408A CN202110104055.7A CN202110104055A CN112820408A CN 112820408 A CN112820408 A CN 112820408A CN 202110104055 A CN202110104055 A CN 202110104055A CN 112820408 A CN112820408 A CN 112820408A
- Authority
- CN
- China
- Prior art keywords
- risk
- surgical
- virtual
- potential
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 76
- 238000004590 computer program Methods 0.000 title claims abstract description 17
- 238000012502 risk assessment Methods 0.000 claims abstract description 48
- 230000000007 visual effect Effects 0.000 claims abstract description 41
- 230000008569 process Effects 0.000 claims abstract description 24
- 238000012549 training Methods 0.000 claims abstract description 16
- 230000009471 action Effects 0.000 claims description 41
- 238000001356 surgical procedure Methods 0.000 claims description 31
- 238000012545 processing Methods 0.000 claims description 14
- 230000015654 memory Effects 0.000 claims description 9
- 230000008439 repair process Effects 0.000 claims description 6
- 230000004044 response Effects 0.000 claims description 5
- 238000004088 simulation Methods 0.000 claims description 5
- 238000012163 sequencing technique Methods 0.000 claims 1
- 239000000126 substance Substances 0.000 claims 1
- 238000013473 artificial intelligence Methods 0.000 abstract description 3
- 238000004891 communication Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 238000012800 visualization Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000007443 liposuction Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000000740 bleeding effect Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 230000007935 neutral effect Effects 0.000 description 2
- 230000008961 swelling Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001364 causal effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 238000013210 evaluation model Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007787 long-term memory Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000006403 short-term memory Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000007794 visualization technique Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/40—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/50—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
Landscapes
- Health & Medical Sciences (AREA)
- Public Health (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Primary Health Care (AREA)
- General Health & Medical Sciences (AREA)
- Epidemiology (AREA)
- Databases & Information Systems (AREA)
- Pathology (AREA)
- Data Mining & Analysis (AREA)
- Biomedical Technology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Surgery (AREA)
- Urology & Nephrology (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application discloses a surgical operation risk determining method and device, electronic equipment, a computer readable storage medium and a computer program product, relates to the technical field of artificial intelligence such as virtual reality, computer vision and cloud computing, and can be applied to intelligent medical scenes. One embodiment of the method comprises: acquiring a visual three-dimensional model of a target surgical site of a target user; simulating virtual operation performed on the visual three-dimensional model according to the target operation type selected by the target user; determining potential surgical risks corresponding to the operation process and the operation result of the virtual surgical operation by using a preset risk assessment model; the risk assessment model is obtained based on historical surgical operation information of various surgical types and corresponding real surgical risk training. The embodiment eliminates the fear caused by the unknown condition in a visual mode, and fully shows the risk possibly occurring in the whole operation process to the user so as to fully make psychological preparation.
Description
Technical Field
The present application relates to the field of computer and image processing technologies, and in particular, to the field of artificial intelligence technologies such as virtual reality, computer vision, and cloud computing, and in particular, to a method and an apparatus for determining a risk of an operation, an electronic device, a computer-readable storage medium, and a computer program product.
Background
Most of ordinary people are afraid of the operation requiring the moving knife, which is originated from the fear of unknown and uncontrolled operation, and the appeal of the operation is abstract only by doctors, so how to make the psychological fear of the necessary operation as large as possible by the users so as to receive the operation in a relatively mild state is an important condition for achieving a better operation effect.
Disclosure of Invention
The embodiment of the application provides a surgical operation risk determination method, a surgical operation risk determination device, an electronic device, a computer-readable storage medium and a computer program product.
In a first aspect, an embodiment of the present application provides a surgical operation risk determining method, including: acquiring a visual three-dimensional model of a target surgical site of a target user; simulating virtual operation performed on the visual three-dimensional model according to the target operation type selected by the target user; determining potential surgical risks corresponding to the operation process and the operation result of the virtual surgical operation by using a preset risk assessment model; the risk assessment model is obtained based on historical surgical operation information of various surgical types and corresponding real surgical risk training.
In a second aspect, an embodiment of the present application provides a surgical operation risk determining apparatus, including: a visualized three-dimensional model acquisition unit configured to acquire a visualized three-dimensional model of a target surgical site of a target user; a virtual surgery operation simulation unit configured to simulate a virtual surgery operation performed on the visual three-dimensional model according to a target surgery type selected by a target user; a potential operation risk determining unit configured to determine a potential operation risk corresponding to an operation process and an operation result of the virtual operation using a preset risk assessment model; the risk assessment model is obtained based on historical surgical operation information of various surgical types and corresponding real surgical risk training.
In a third aspect, an embodiment of the present application provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the method of determining risk of a surgical procedure as described in any one of the implementations of the first aspect when executed.
In a fourth aspect, embodiments of the present application provide a non-transitory computer-readable storage medium storing computer instructions for enabling a computer to implement the surgical operation risk determination method as described in any implementation manner of the first aspect.
In a fifth aspect, the present application provides a computer program product comprising a computer program, which when executed by a processor is capable of implementing the surgical procedure risk determination method as described in any implementation manner of the first aspect.
According to the method, the device, the electronic equipment, the computer readable storage medium and the computer program product for determining the operation risk, firstly, a visual three-dimensional model of a target operation part of a target user is obtained; then, according to the target operation type selected by the target user, simulating virtual operation performed on the visual three-dimensional model; and finally, determining potential operation risks corresponding to the operation process and the operation result of the virtual operation by using a preset risk assessment model, wherein the risk assessment model is obtained based on historical operation information of various operation types and corresponding real operation risk training.
This application is at first with the real operation of waiting to carry out convert virtual operation to visual three-dimensional model through visual technique into, with let the specific operation process of more abundant understanding of user through providing visual content, thereby eliminate the fear psychology that brings because of unknown, still utilize the risk assessment model of establishing in advance to come real-time output and the potential operation risk that virtual operation corresponds simultaneously, with the risk that probably appears of the whole operation process of fully showing to the user, also do benefit to going on of real operation under the condition of fully doing psychological preparation, also provide the basis for explaining the risk repair mode.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present application, nor do they limit the scope of the present application. Other features of the present application will become apparent from the following description.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
FIG. 1 is an exemplary system architecture to which the present application may be applied;
fig. 2 is a flowchart of a surgical procedure risk determination method according to an embodiment of the present application;
FIG. 3 is a flow chart of another method for determining risk of a surgical procedure provided in an embodiment of the present application;
FIG. 4 is a flow chart of yet another method for determining risk of a surgical procedure provided in an embodiment of the present application;
fig. 5 is a block diagram illustrating a structure of a surgical operation risk determining apparatus according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of an electronic device suitable for executing a surgical operation risk determination method according to an embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
Fig. 1 illustrates an exemplary system architecture 100 to which embodiments of the surgical procedure risk determination methods, apparatuses, electronic devices, and computer-readable storage media of the present application may be applied.
As shown in fig. 1, the system architecture 100 may include a scanner 101, a server 102, and a display terminal 103. The scanner is configured to scan a target surgical site to be operated by a user, so that the server 102 creates a visual three-dimensional model of the target surgical site according to the received site scanning data, the server 102 further simulates a virtual surgical operation on the visual three-dimensional model according to the selected surgical type, performs risk assessment on a virtual surgical action in the virtual surgical operation, and sends visual information and risk information to the display terminal 103 to be displayed to the user. Data exchange between the scanner 101, the server 102, and the display terminal 103 in the system architecture 100 may be performed in a wired or wireless manner.
Specifically, all devices capable of reconstructing the region scan data of the visualized three-dimensional model by the server 102 may be used as the scanner 101 in the system architecture 100, for example, when the visualized three-dimensional model can be reconstructed by directly using the planar image of the target surgical region, all devices provided with a camera may be used as the scanner 101; if a part structure frame acquired from another channel is needed as a model skeleton on the basis of a planar image, the scanner 101 is composed of a device or component for acquiring the part structure frame and a camera for acquiring the planar image. The server 102 is used for processing data in the present application, and therefore any physical device or virtual device that meets the data processing requirement in the actual application scenario can serve as the server 102. The display terminal 103 is mainly used as a display window of information processed by the server 102 in the present application, and the display terminal 103 may be integrated with the server 102 or may be independently arranged according to requirements, or a terminal provided with a display screen or an information display component and held by a user may be used as the display terminal 103.
The above effects can be achieved through cooperation among the components in the system architecture 100, and specifically can be achieved through application programs installed in the components respectively, for example, a scanning application is installed in the scanner 101, a surgical operation risk determination application is installed in the server 102, and an information display application is installed in the display terminal 103, and specifically, the scanning application installed in the scanner 101 and the information display application installed in the display terminal 103 can exist as an independent component of the surgical operation risk determination application, so as to better perform data exchange with the server 102. Of course, besides the above applications, other applications that implement other functions or ensure normal operation of the current function may also be installed in each of the above components, and are not specifically limited herein.
For the sake of understanding of the present application, taking the server 102 as an example, the server 102 may implement the following effects when running the surgical operation risk determination application: firstly, receiving part scanning data sent by a scanner 101 through a wireless network, and then reconstructing a corresponding visual three-dimensional model according to the part scanning data; simulating virtual operation performed on the visual three-dimensional model according to the selected target operation type, and determining potential operation risks corresponding to the operation process and the operation result of the virtual operation by using a preset risk assessment model; and meanwhile, the real-time virtual surgery operation and the corresponding potential surgery risk are sent to the display terminal 103 through a wireless network for displaying.
It should be noted that the scan data of the region for reconstructing the visualized three-dimensional model may be obtained from the scanner 101 in real time, or may be stored locally in the server 102 in advance in various ways. Thus, when the server 102 detects that such data is already stored locally (e.g., remaining to-be-processed region scan data prior to beginning processing), the data may be selected to be acquired directly from the local, in which case the exemplary system architecture 100 may not include a scanner.
Since reconstructing the visual three-dimensional model, generating the virtual surgery operation based on the visual three-dimensional model, and performing the evaluation on the virtual surgery action all need to occupy more computation resources and stronger computation capability, the method for determining the risk of the surgery operation provided in the following embodiments of the present application is generally executed by a workstation or a large server which is not personally owned by the user and has stronger computation capability and more computation resources, and accordingly, the device for determining the risk of the surgery operation is generally also arranged in the workstation or the large server which is not personally owned by the user. However, it should be noted that, when the smart mobile terminal or the fixed terminal owned by the user also has all or part of the computing capability and computing resource satisfying the above requirements, the executing agent of the above operation may also send all or part of the above operation to the smart mobile terminal or the fixed terminal of the user.
It should be understood that the number of scanners, servers, display terminals in fig. 1 is merely illustrative. There may be any number of scanners, servers, display terminals, as desired for implementation.
Referring to fig. 2, fig. 2 is a flowchart of a surgical procedure risk determining method according to an embodiment of the present application, wherein the process 200 includes the following steps:
step 201: acquiring a visual three-dimensional model of a target surgical site of a target user;
this step is intended to obtain a visualized three-dimensional model of the target surgical site of the target user by the executing entity of the surgical procedure risk determination method (e.g., server 102 shown in fig. 1).
The visualized three-dimensional model can be obtained by the execution body in various ways, for example, when the visualized three-dimensional model of the target operation site of the target user is formed before, the execution body can obtain the finished visualized three-dimensional model from the corresponding storage address; when the finished visualized three-dimensional model does not exist, the execution main body can automatically reconstruct the visualized three-dimensional model based on the acquired part scanning data of the target surgical part of the target user, and the part scanning data of the visualized three-dimensional model which can be directly reconstructed by the execution main body can be obtained by scanning the target surgical part by a professional instrument (for example, the scanner 101 shown in fig. 1).
Furthermore, in consideration of the fact that the scanner which can directly make the execution main body to reconstruct the part scanning information of the visualized three-dimensional model needs to include the three-dimensional part structure information and can scan the part structure information through the skin is high in cost, the execution main body can also reconstruct the visualized three-dimensional model by summarizing the surface details included in the plane images on the basis of the standard structure skeleton of the part recorded in advance by adopting the plane images according to the standard structure skeleton of the part recorded in advance. The above-mentioned solution is particularly suitable for making full use of the commonly-held planar image capturing device (for example, a mobile terminal having a camera and a capturing function) as far as possible when it is clear that the structural skeleton of the target surgical site of the user is not displaced.
Or the adaptive adjustment is carried out on the basis of the visual three-dimensional models of the same parts of other users, and the specific selection can be flexibly selected according to the requirements of the actual application scene, and the specific limitation is not made here.
In addition, the visualization of the visualized three-dimensional model may specifically be a visualization presented on a conventional display interface, and may also be a visualization presented in a specific Virtual Reality scene based on Virtual Reality technology (VR).
Step 202: simulating virtual operation performed on the visual three-dimensional model according to the target operation type selected by the target user;
based on step 201, this step is intended to simulate a virtual surgical operation performed on the visualized three-dimensional model by the execution subject according to a surgical operation corresponding to a target surgical type selected by a target user.
It should be understood that different types of surgery for the same site, i.e. different types of surgery usually mean different surgical objectives, whereas different surgical operations usually need to be performed for different surgical objectives, a surgical operation is defined in this application to be composed of at least one surgical action as a minimum action unit, and thus performing a surgical operation means performing a corresponding surgical objective.
The target operation type is selected by the target user according to the intention of the target user, the target operation type selection information transmitted by the target user can be directly received, all the optional items can be provided for the target user at first, and then the selection information of the target user on any optional item in the optional items is received.
When the target operation type is determined, the execution main body simulates virtual operation performed on the visual three-dimensional model according to the operation corresponding to the target operation type, the virtual operation is composed of at least one operation action corresponding to the operation, the virtual operation is also composed of at least one virtual operation action, therefore, the virtual operation simulated by the execution main body on the basis of the visual three-dimensional model is a continuous action set, and the visual result can be represented as a video with corresponding duration.
Step 203: and determining potential operation risks corresponding to the operation process and the operation result of the virtual operation by using a preset risk assessment model.
On the basis of step 202, this step is intended to determine potential surgical risks corresponding to the operation procedures and operation results of the virtual surgical operation by the execution subject using a preset risk assessment model.
The risk assessment model is obtained based on historical operation information of various operation types and corresponding real operation risk training, the training mode can be a training mode provided by a machine learning algorithm, and a training object can also be any deep learning network or any combination of deep learning networks capable of achieving the effects, such as a convolutional neural network, a long-term and short-term memory network, a generation countermeasure network and the like, so that the trained risk assessment model can represent the operation process of the operation and the corresponding relation between the operation result and the operation risk.
The operation risk determining method provided by the embodiment of the application comprises the steps of firstly converting real operation to be performed into virtual operation on a visual three-dimensional model through a visualization technology, enabling a user to know a specific operation process more fully through providing visual contents, eliminating the psychological fear caused by unknown reasons, meanwhile, outputting potential operation risks corresponding to the virtual operation in real time by utilizing a pre-constructed risk assessment model, fully displaying the risks possibly occurring in the whole operation process to the user, facilitating the real operation under the condition of fully making psychological preparation, and providing a basis for explaining a risk repairing mode.
Referring to fig. 3, fig. 3 is a flowchart of another method for determining risk of a surgical procedure according to an embodiment of the present application, wherein the process 300 includes the following steps:
step 301: acquiring a planar image of a target surgical site shot by a target user;
in the step, the executive body acquires a plane image which is obtained by shooting the target surgical site by the target user, and the plane image can be obtained by shooting by the target user through a camera shooting function of an intelligent mobile terminal held by the target user.
Step 302: determining a corresponding three-dimensional structure according to the corresponding physiological structure of the target operation position;
the step aims to determine a corresponding three-dimensional structure according to the physiological structure corresponding to the target operation position by the executing body. Since accurate internal structural information cannot be represented in the planar image, the executing body uses the standard physiological structure corresponding to the target operation position as an internal structural skeleton of a visual three-dimensional model for reconstructing the position.
Step 303: generating a visual three-dimensional model according to the plane image and the three-dimensional structure;
on the basis of steps 301 and 302, this step is intended to generate this visualized three-dimensional model by the executing body described above in a manner that fills the surface details on the basis of the internal structural skeleton, by recording a planar image of the surface details of the target surgical site and a three-dimensional structure serving as the internal structural skeleton, respectively.
For step 201 shown in the flow 200 in the previous embodiment, the present embodiment provides a specific implementation manner through the above steps 301 to 303, and because a manner of fusion recording of surface details and internal structural skeleton of the target surgical site is adopted, the requirement of the reconstructed visualized three-dimensional model on the basic data is greatly reduced, and the ubiquitous camera device is fully utilized.
Step 304: simulating virtual operation performed on the visual three-dimensional model according to the target operation type selected by the target user;
this step is the same as step 202 of the previous embodiment, and the explanation of step 202 in the previous embodiment is referred to, without repeating the explanation of the same technical features.
Step 305: acquiring a screenshot in the execution of any virtual operation action in the virtual operation;
step 306: acquiring a screenshot after the execution of any virtual operation action in the virtual operation is finished;
the executing body obtains the executing condition and the executing completion condition of each virtual surgical action presented in the screenshot form through step 305 and step 306 respectively. Furthermore, in order to reflect the execution situation as accurately and completely as possible, the number of screenshots may not be limited, and a motion picture may be generated based on a plurality of continuous screenshots in time.
Step 307: inputting the screenshot in execution and the screenshot after execution are finished into a preset risk assessment model;
on the basis of the steps 305 and 306, the step is intended to input the screenshot in execution and the screenshot after execution are completed into a preset risk assessment model by the execution subject so as to output a risk assessment result by means of the trained risk assessment model. In this embodiment, the risk assessment model should also be obtained based on the historical surgical operation information embodied in the screenshot and the corresponding real surgical risk training. Correspondingly, if the situation during execution is embodied in a motion picture form, the training samples should be synchronously adjusted, so that the result output by the trained risk assessment model is more accurate.
Step 308: and acquiring the potential operation risks output by the risk assessment model and corresponding to the virtual operation actions.
For step 203 in the process 200 shown in the previous embodiment, the present embodiment provides a specific implementation manner through the above steps 305 to 308, and uses a risk assessment model trained by embodying the execution neutral and execution completion conditions of the surgical operation in the screenshot, so as to accurately output the possible risks of the execution neutral and execution completion conditions, which are embodied in the screenshot manner as the input.
It should be understood that there is no causal or dependency relationship between the specific reconstruction scheme provided in steps 301 to 303 and the specific scheme provided in steps 305 to 308 for outputting the potential risk by using the risk assessment model, and it is entirely possible to combine any lower level, preferred embodiment and the previous embodiment separately generated in steps 201 and 203 in the previous embodiment, thereby obtaining two embodiments in which the preferred embodiment exists only in one location. This example exists only as a preferred example where two preferred embodiments exist simultaneously.
Referring to fig. 4, fig. 4 is a flowchart of another method for determining risk of a surgical operation according to an embodiment of the present application, wherein the flowchart 400 includes the following steps:
step 401: acquiring a visual three-dimensional model of a target surgical site of a target user;
step 402: simulating virtual operation performed on the visual three-dimensional model according to the target operation type selected by the target user;
step 403: determining potential surgical risks corresponding to the operation process and the operation result of the virtual surgical operation by using a preset risk assessment model;
the above steps 401 to 403 are consistent with the steps 201 to 203 in the flow 200, and appear in this embodiment only as technical contents for embodying the completeness of the solution, and for the explanation of this part of the solution, please refer to the explanation of this part of the technical solution in the previous embodiment.
Step 404: in response to the fact that the potential risk level of the virtual operation action currently performed in the virtual operation exceeds a preset level, sending a high operation risk prompt and providing a standby operation scheme;
aiming at the condition that the potential risk determined by the risk assessment model exceeds the preset level, the execution main body makes a processing scheme including sending a high surgical risk prompt and providing a standby surgical scheme so as to inform a user of the real condition and adjust the surgical scheme as early as possible.
Step 405: and responding to the determined potential surgical risk belonging to the preset common risk, adjusting the risk repairing operation preset for the common risk on the basis of the current virtual surgical action, and displaying the adjusted risk repairing operation.
Aiming at the condition that the potential risk determined by the risk assessment model belongs to the preset common risk, the execution main body adjusts the risk repair operation preset for the common risk on the basis of the current virtual operation action, and displays the adjusted risk repair operation. Namely, the repair operation is continuously shown to the user through the virtual action, so that the doubt of the user on the actual harm of the common risks is eliminated as much as possible.
On the basis of any of the above embodiments, for the case that a plurality of potential operation risks are determined, the risk occurrence probability of each potential operation risk can be determined respectively, the risk occurrence probabilities are sorted according to the magnitude of the risk occurrence probability, and the sorted potential operation risk list is displayed to the target user so that the target user can obtain the most effective information more intuitively.
On the basis of any embodiment, in order to meet the curiosity of the user or a third-party user or the feasibility of the operation suggestion, the method can also receive an introduced self-defined operation scheme, and adjust the virtual operation action contained in the virtual operation according to the self-defined operation action contained in the self-defined operation scheme, so that the risk evaluation of the self-defined operation is output through a risk evaluation model, and the user can visually see whether the operation scheme which seems feasible is really feasible or not.
In order to deepen understanding, the application also provides a specific implementation scheme by combining a specific application scene:
user A wants to liposuction on his face through operation, for this user A fully knows the process and risk of liposuction on the face, provides the following scheme:
1) the operation scheme provider B controls a face scanner to scan the face of the user A to obtain face scanning data;
2) a surgical plan provider B (a control server) reconstructs a visual face three-dimensional model X according to the face scanning data;
3) the user A informs the (server of the) operation scheme provider B of the selection of the operation type N with the shortest recovery time;
4) a surgical plan provider B (a control server) simulates a virtual surgical operation M corresponding to the surgical type N on the basis of the three-dimensional face model X;
5) the operation scheme provider B (a control server) performs risk assessment on the whole process of the virtual operation M by using a preset risk assessment model, and further obtains the potential risks of red swelling and intermittent bleeding of the face liposuction position which may occur;
6) the operation scheme provider B shows the whole process of the virtual operation M and the potential risks of intermittent bleeding of 40% and redness and swelling of 30% of the corresponding face liposuction position to the user A, and also provides a repairing mode of the conventional risks, such as smearing corresponding medicaments and the like.
With further reference to fig. 5, as an implementation of the method shown in the above figures, the present application provides an embodiment of a surgical operation risk determining apparatus, which corresponds to the embodiment of the method shown in fig. 2, and which is particularly applicable to various electronic devices.
As shown in fig. 5, the surgical operation risk determining apparatus 500 of the present embodiment may include: a visual three-dimensional model obtaining unit 501, a virtual operation simulation unit 502 and a potential operation risk determination unit 503. Wherein, the visualized three-dimensional model obtaining unit 501 is configured to obtain a visualized three-dimensional model of a target surgical site of a target user; a virtual surgery operation simulation unit 502 configured to simulate a virtual surgery operation performed on the visualized three-dimensional model according to a target surgery type selected by a target user; a potential surgical risk determining unit 503 configured to determine a potential surgical risk corresponding to an operation procedure and an operation result of the virtual surgical operation using a preset risk assessment model; the risk assessment model is obtained based on historical surgical operation information of various surgical types and corresponding real surgical risk training.
In the present embodiment, in the surgical operation risk determination apparatus 500: the detailed processing and the technical effects of the visualized three-dimensional model obtaining unit 501, the virtual surgery operation simulation unit 502 and the potential surgery risk determination unit 503 can refer to the related descriptions of step 201 and step 203 in the corresponding embodiment of fig. 2, which are not described herein again.
In some optional implementations of the present embodiment, the visualized three-dimensional model obtaining unit 501 may be further configured to:
acquiring a planar image of a target surgical site shot by a target user;
determining a corresponding three-dimensional structure according to the corresponding physiological structure of the target operation position;
and generating a visual three-dimensional model according to the plane image and the three-dimensional structure.
In some optional implementations of this embodiment, the potential surgical risk determination unit 503 may be further configured to:
acquiring a screenshot in the execution of any virtual operation action in the virtual operation;
acquiring a screenshot after the execution of any virtual operation action in the virtual operation is finished;
inputting the screenshot in execution and the screenshot after execution are finished into a preset risk assessment model; the risk assessment model is obtained based on historical operation information reflected by the screenshot and corresponding real operation risk training;
and acquiring the potential operation risks output by the risk assessment model and corresponding to the virtual operation actions.
In some optional implementations of the present embodiment, the surgical operation risk determination apparatus 500 may further include:
a high risk level processing unit configured to send a high surgical risk reminder and provide a backup surgical plan in response to a potential risk level of a currently performed virtual surgical action in the virtual surgical operation exceeding a preset level.
In some optional implementations of the present embodiment, the surgical operation risk determination apparatus 500 may further include:
and the multi-risk display unit is configured to respond to the determination of the plurality of potential operation risks, respectively determine the risk occurrence probability of each potential operation risk, sort the risk occurrence probabilities according to the magnitude of the risk occurrence probabilities, and display the sorted potential operation risk lists.
In some optional implementations of the present embodiment, the surgical operation risk determination apparatus 500 may further include:
and the common risk repairing operation display unit is configured to respond to the determined potential operation risk belonging to the preset common risk, adjust the risk repairing operation preset for the common risk on the basis of the current virtual operation action, and display the adjusted risk repairing operation.
In some optional implementations of the present embodiment, the surgical operation risk determination apparatus 500 may further include:
a custom protocol receiving unit configured to receive an incoming custom surgical protocol;
and the operation action adjusting unit is configured to adjust the virtual operation action contained in the virtual operation according to the user-defined operation action contained in the user-defined operation scheme.
The present embodiment exists as an apparatus embodiment corresponding to the above method embodiment, and the surgical operation risk determining apparatus provided in the embodiment of the present application converts a real surgical operation to be performed into a virtual surgical operation on a visual three-dimensional model through a visualization technique, so as to allow a user to more fully understand a specific surgical procedure by providing visual contents, thereby eliminating a fear psychology brought by an unknown condition, and simultaneously, a pre-constructed risk assessment model is used to output a potential surgical risk corresponding to the virtual surgical operation in real time, so as to fully display a risk that may occur in the entire surgical procedure for the user, thereby facilitating the performance of the real surgical operation under the condition of fully preparing a psychological measure, and also providing a basis for explaining a risk repairing manner.
There is also provided, in accordance with an embodiment of the present application, an electronic device, a readable storage medium, and a computer program product.
FIG. 6 illustrates a schematic block diagram of an example electronic device 600 that can be used to implement embodiments of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 6, the apparatus 600 includes a computing unit 601, which can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM)602 or a computer program loaded from a storage unit 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the device 600 can also be stored. The calculation unit 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
A number of components in the device 600 are connected to the I/O interface 605, including: an input unit 606 such as a keyboard, a mouse, or the like; an output unit 607 such as various types of displays, speakers, and the like; a storage unit 608, such as a magnetic disk, optical disk, or the like; and a communication unit 609 such as a network card, modem, wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
The computing unit 601 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The calculation unit 601 performs the various methods and processes described above, such as the surgical procedure risk determination method. For example, in some embodiments, the surgical procedure risk determination method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 608. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 600 via the ROM 602 and/or the communication unit 609. When the computer program is loaded into RAM 603 and executed by the computing unit 601, one or more steps of the surgical procedure risk determination method described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured by any other suitable means (e.g., by means of firmware) to perform the surgical procedure risk determination method.
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present application may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this application, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The Server may be a cloud Server, which is also called a cloud computing Server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of high management difficulty and weak service extensibility in the conventional physical host and Virtual Private Server (VPS) service.
The embodiment of the application firstly converts the real operation to be performed into the virtual operation of the visual three-dimensional model through the visualization technology, so as to enable a user to know the specific operation process more fully through providing visual contents, thereby eliminating the fear psychology brought by unknown reasons, and meanwhile, the risk assessment model constructed in advance is utilized to output the potential operation risk corresponding to the virtual operation in real time, so as to fully show the risk possibly occurring in the whole operation process to the user, thereby being beneficial to the performance of the real operation under the condition of fully making psychological preparation, and providing a basis for explaining a risk repairing mode.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (17)
1. A surgical procedure risk determination method, comprising:
acquiring a visual three-dimensional model of a target surgical site of a target user;
simulating a virtual operation performed on the visual three-dimensional model according to the target operation type selected by the target user;
determining potential surgical risks corresponding to the operation process and the operation result of the virtual surgical operation by using a preset risk assessment model; the risk assessment model is obtained based on historical surgical operation information of various surgical types and corresponding real surgical risk training.
2. The method of claim 1, wherein the obtaining a visualized three-dimensional model of a target surgical site of a target user comprises:
acquiring a planar image of the target surgical site shot by the target user;
determining a corresponding three-dimensional structure according to the physiological structure corresponding to the target operation position;
generating the visualized three-dimensional model from the planar image and the three-dimensional structure.
3. The method of claim 1, wherein the determining potential surgical risks corresponding to the procedure and procedure results of the virtual surgical procedure using a preset risk assessment model comprises:
acquiring a screenshot in the execution of any virtual surgical action in the virtual surgical operation;
acquiring a screenshot after the execution of any virtual operation action in the virtual operation is finished;
inputting the screenshot in execution and the screenshot after execution are finished into a preset risk assessment model; the risk assessment model is obtained based on historical operation information reflected by screenshots and corresponding real operation risk training;
and acquiring the potential operation risks output by the risk assessment model and corresponding virtual operation actions.
4. The method of claim 1, further comprising:
and sending a high surgical risk prompt and providing a standby surgical scheme in response to the potential risk level of the virtual surgical action currently performed in the virtual surgical operation exceeding a preset level.
5. The method of claim 4, further comprising:
and in response to the determination of the plurality of potential operation risks, determining the risk occurrence probability of each potential operation risk respectively, sequencing according to the risk occurrence probability, and displaying a sequenced potential operation risk list.
6. The method of any of claims 1-5, further comprising:
and responding to the determined potential surgical risk belonging to the preset common risk, adjusting the risk repair operation preset for the common risk on the basis of the current virtual surgical action, and displaying the adjusted risk repair operation.
7. The method of claims 1-5, further comprising:
receiving an incoming custom surgical procedure;
and adjusting the virtual operation action contained in the virtual operation according to the custom operation action contained in the custom operation scheme.
8. A surgical procedure risk determination device, comprising:
a visualized three-dimensional model acquisition unit configured to acquire a visualized three-dimensional model of a target surgical site of a target user;
a virtual surgery operation simulation unit configured to simulate a virtual surgery operation performed on the visualized three-dimensional model according to a target surgery type selected by the target user;
a potential operation risk determining unit configured to determine a potential operation risk corresponding to an operation process and an operation result of the virtual operation using a preset risk assessment model; the risk assessment model is obtained based on historical surgical operation information of various surgical types and corresponding real surgical risk training.
9. The apparatus of claim 8, wherein the visualized three-dimensional model acquisition unit is further configured to:
acquiring a planar image of the target surgical site shot by the target user;
determining a corresponding three-dimensional structure according to the physiological structure corresponding to the target operation position;
generating the visualized three-dimensional model from the planar image and the three-dimensional structure.
10. The apparatus of claim 8, wherein the potential surgical procedure risk determination unit is further configured to:
acquiring a screenshot in the execution of any virtual surgical action in the virtual surgical operation;
acquiring a screenshot after the execution of any virtual operation action in the virtual operation is finished;
inputting the screenshot in execution and the screenshot after execution are finished into a preset risk assessment model; the risk assessment model is obtained based on historical operation information reflected by screenshots and corresponding real operation risk training;
and acquiring the potential operation risks output by the risk assessment model and corresponding virtual operation actions.
11. The apparatus of claim 8, further comprising:
a high risk level processing unit configured to send a high surgical risk reminder and provide a backup surgical plan in response to a potential risk level of a currently performed virtual surgical action in the virtual surgical operation exceeding a preset level.
12. The apparatus of claim 8, further comprising:
and the multi-risk display unit is configured to respond to the determination of a plurality of potential operation risks, respectively determine the risk occurrence probability of each potential operation risk, sort the risk occurrence probabilities according to the magnitude of the risk occurrence probabilities, and display a sorted potential operation risk list.
13. The apparatus of any of claims 8-12, further comprising:
and the common risk repairing operation display unit is configured to respond to the determined potential surgical risk belonging to the preset common risk, adjust the risk repairing operation preset for the common risk on the basis of the current virtual surgical action, and display the adjusted risk repairing operation.
14. The method of claims 8-12, further comprising:
a custom protocol receiving unit configured to receive an incoming custom surgical protocol;
and the operation action adjusting unit is configured to adjust the virtual operation action contained in the virtual operation according to the user-defined operation action contained in the user-defined operation scheme.
15. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the surgical procedure risk determination method of any one of claims 1-7.
16. A non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the surgical procedure risk determination method of any one of claims 1-7.
17. A computer program product comprising a computer program which, when executed by a processor, implements a surgical procedure risk determination method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110104055.7A CN112820408B (en) | 2021-01-26 | 2021-01-26 | Surgical risk determination method, related device and computer program product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110104055.7A CN112820408B (en) | 2021-01-26 | 2021-01-26 | Surgical risk determination method, related device and computer program product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112820408A true CN112820408A (en) | 2021-05-18 |
| CN112820408B CN112820408B (en) | 2024-05-10 |
Family
ID=75859352
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110104055.7A Active CN112820408B (en) | 2021-01-26 | 2021-01-26 | Surgical risk determination method, related device and computer program product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112820408B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114927229A (en) * | 2022-04-21 | 2022-08-19 | 新瑞鹏宠物医疗集团有限公司 | Operation simulation method and device, electronic equipment and storage medium |
| EP4174869A1 (en) * | 2021-10-26 | 2023-05-03 | Koninklijke Philips N.V. | Case-based mixed reality preparation and guidance for medical procedures |
| WO2023072685A1 (en) * | 2021-10-26 | 2023-05-04 | Koninklijke Philips N.V. | Case-based mixed reality preparation and guidance for medical procedures |
| CN116187448A (en) * | 2023-04-25 | 2023-05-30 | 之江实验室 | Information display method and device, storage medium and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130090548A1 (en) * | 2011-10-10 | 2013-04-11 | Wake Forest University Health Sciences | Automated renal evaluation systems and methods using mri image data |
| CN109509555A (en) * | 2018-11-26 | 2019-03-22 | 刘伟民 | A kind of surgical operation preview appraisal procedure and system based on 3-dimensional image |
| CN110163462A (en) * | 2018-09-07 | 2019-08-23 | 中国国际海运集装箱(集团)股份有限公司 | Appraisal procedure, device, system, medium and the electronic equipment of equipment operation |
-
2021
- 2021-01-26 CN CN202110104055.7A patent/CN112820408B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130090548A1 (en) * | 2011-10-10 | 2013-04-11 | Wake Forest University Health Sciences | Automated renal evaluation systems and methods using mri image data |
| CN110163462A (en) * | 2018-09-07 | 2019-08-23 | 中国国际海运集装箱(集团)股份有限公司 | Appraisal procedure, device, system, medium and the electronic equipment of equipment operation |
| CN109509555A (en) * | 2018-11-26 | 2019-03-22 | 刘伟民 | A kind of surgical operation preview appraisal procedure and system based on 3-dimensional image |
Non-Patent Citations (3)
| Title |
|---|
| T LOESCHER: "An augmented reality approach to surgical telementoring", IEEE, 31 December 2014 (2014-12-31) * |
| 方驰华;刘宇斌;黄燕鹏;潘家辉;彭丰平;鲁朝敏;: "64排螺旋CT三维重建和胰腺可视化仿真手术的应用研究", 中国实用外科杂志, no. 09, 1 September 2008 (2008-09-01) * |
| 谢文;张强;孔维佳;宋恩民;: "基于分布式虚拟现实技术的耳显微手术仿真系统", 中国医疗器械杂志, no. 03, 30 May 2010 (2010-05-30) * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4174869A1 (en) * | 2021-10-26 | 2023-05-03 | Koninklijke Philips N.V. | Case-based mixed reality preparation and guidance for medical procedures |
| WO2023072685A1 (en) * | 2021-10-26 | 2023-05-04 | Koninklijke Philips N.V. | Case-based mixed reality preparation and guidance for medical procedures |
| CN114927229A (en) * | 2022-04-21 | 2022-08-19 | 新瑞鹏宠物医疗集团有限公司 | Operation simulation method and device, electronic equipment and storage medium |
| CN116187448A (en) * | 2023-04-25 | 2023-05-30 | 之江实验室 | Information display method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112820408B (en) | 2024-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112820408A (en) | Surgical operation risk determination method, related device and computer program product | |
| CN111860167B (en) | Face fusion model acquisition method, face fusion model acquisition device and storage medium | |
| CN110349232B (en) | Image generation method and device, storage medium and electronic equipment | |
| CN113240778B (en) | Method, device, electronic equipment and storage medium for generating virtual image | |
| CN112527115B (en) | User image generation method, related device and computer program product | |
| CN113658309B (en) | Three-dimensional reconstruction method, device, equipment and storage medium | |
| US11455765B2 (en) | Method and apparatus for generating virtual avatar | |
| CN110136054B (en) | Image processing method and device | |
| US20210117484A1 (en) | Webpage template generation | |
| US20220076476A1 (en) | Method for generating user avatar, related apparatus and computer program product | |
| CN113365146B (en) | Method, apparatus, device, medium and article of manufacture for processing video | |
| CN112580666A (en) | Image feature extraction method, training method, device, electronic equipment and medium | |
| CN112884889B (en) | Model training method, model training device, human head reconstruction method, human head reconstruction device, human head reconstruction equipment and storage medium | |
| CN114792355A (en) | Virtual image generation method and device, electronic equipment and storage medium | |
| CN113052962B (en) | Model training method, information output method, device, equipment and storage medium | |
| CN113380269B (en) | Video image generation method, apparatus, device, medium, and computer program product | |
| CN114187392A (en) | Virtual even image generation method and device and electronic equipment | |
| CN112529161A (en) | Training method for generating countermeasure network, and method and device for translating human face image | |
| CN112562043A (en) | Image processing method and device and electronic equipment | |
| CN112714337A (en) | Video processing method and device, electronic equipment and storage medium | |
| CN114299598A (en) | Method for determining fixation position and related device | |
| CN113784217A (en) | Video playing method, device, equipment and storage medium | |
| CN114820908B (en) | Virtual image generation method and device, electronic equipment and storage medium | |
| CN114071111B (en) | Video playing method and device | |
| CN116824014B (en) | Data generation method and device for avatar, electronic equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |