CN109859833B - Evaluation method and device for ablation treatment effect - Google Patents

Evaluation method and device for ablation treatment effect Download PDF

Info

Publication number
CN109859833B
CN109859833B CN201811622007.1A CN201811622007A CN109859833B CN 109859833 B CN109859833 B CN 109859833B CN 201811622007 A CN201811622007 A CN 201811622007A CN 109859833 B CN109859833 B CN 109859833B
Authority
CN
China
Prior art keywords
image
tumor
preprocessed
ablation
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811622007.1A
Other languages
Chinese (zh)
Other versions
CN109859833A (en
Inventor
艾丹妮
刘定坤
杨健
王涌天
梁萍
付天宇
武潺
宋红
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Technology BIT
Original Assignee
Beijing Institute of Technology BIT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Technology BIT filed Critical Beijing Institute of Technology BIT
Priority to CN201811622007.1A priority Critical patent/CN109859833B/en
Publication of CN109859833A publication Critical patent/CN109859833A/en
Application granted granted Critical
Publication of CN109859833B publication Critical patent/CN109859833B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Processing (AREA)

Abstract

The embodiment of the invention provides an evaluation method and device for the treatment effect of an ablation operation. The evaluation method of the ablation surgery treatment effect comprises the following steps: preprocessing a tumor region in a preoperative image and an ablation region in a postoperative image respectively; image registration is carried out on a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image, an elastic deformation field is obtained, vector field analysis is carried out on the elastic deformation field, and a tumor contraction center point is determined; and according to the tumor contraction center point, mapping a tumor region in the preprocessed preoperative image onto the preprocessed postoperative image after image registration, and obtaining an evaluation result of the ablation treatment effect. The method and the device for evaluating the therapeutic effect of the ablation surgery provided by the embodiment of the invention can accurately reflect the shrinkage of the tumor in the surgery, thereby obtaining a more accurate evaluation result of the therapeutic effect of the ablation surgery.

Description

Evaluation method and device for ablation treatment effect
Technical Field
The embodiment of the invention relates to the technical field of image processing, in particular to an evaluation method and device of an ablation treatment effect.
Background
Microwave ablation is a low invasive liver cancer treatment means, and the tumor is heated at high temperature, so that an ablation area completely wraps the tumor, and the inactivation of the tumor is realized. After ablation surgery, postoperative assessment of the therapeutic effect of the surgery is required. The postoperative evaluation of the microwave ablation operation evaluates the curative effect of the operation by comparing the wrapping relation between the tumor area and the ablation area, and provides feedback for doctors. Because the tumor area and the ablation area exist in the preoperative image and the postoperative image respectively, the preoperative image and the postoperative image are required to be aligned through a registration method, the tumor area is mapped to the postoperative image, the position and the size relation of the tumor area and the ablation area are compared, the wrapping condition of the tumor area and the ablation area is obtained, and the evaluation of the treatment effect of the ablation operation is realized.
The existing method for evaluating the treatment effect of the ablation operation based on registration is many, such as eliminating mismatching of tumors and ablation areas, eliminating respiratory motion influence, maintaining special mechanical properties of the liver and the like. The method aims at realizing the postoperative evaluation of the ablation by highly aligning the preoperative tumor and the postoperative ablation region in space position through a registration method and analyzing the position and the size relationship of the preoperative tumor and the postoperative ablation region on the basis. However, clinical studies have found that in microwave ablation procedures, tumors shrink irreversibly under the influence of heat. The method does not consider the characteristic of thermal shrinkage of the tumor, but can not restore the actual change of thermal shrinkage of the tumor only by registration, so that when the wrapping condition of the ablation region on the tumor region is calculated, the volume of the tumor region is larger than the actual volume, the obtained wrapping condition is inaccurate, and the accuracy of the evaluation result of the ablation treatment effect is low.
Clinically, on the basis of grasping the position information of the ablation needle in the operation, a tumor shrinkage model simulating the thermal shrinkage motion of the tumor in the operation is sequentially proposed, and the shrinkage condition of the tumor can be accurately predicted. However, when evaluating the effect of ablation treatment, only pre-and post-operative image information is usually available, without intraoperative ablation needle position information, resulting in an inability to predict tumor shrinkage from the tumor shrinkage model described above.
Disclosure of Invention
In view of the problems of the prior art, embodiments of the present invention provide a method and apparatus for evaluating the therapeutic effect of an ablation procedure that overcomes or at least partially solves the above-mentioned problems.
In a first aspect, an embodiment of the present invention provides a method for evaluating an effect of ablation procedure treatment, including:
respectively preprocessing a tumor region in the preoperative image and an ablation region in the postoperative image, so that the gray scale distribution of the tumor region in the preprocessed preoperative image is the same as the gray scale distribution of the organ tissue region around the tumor region, and the gray scale distribution of the ablation region in the preprocessed postoperative image is the same as the gray scale distribution of the organ tissue region around the ablation region;
Image registration is carried out on a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image, an elastic deformation field is obtained, vector field analysis is carried out on the elastic deformation field, and a tumor contraction center point is determined;
according to the tumor contraction center point, mapping a tumor area in the preprocessed preoperative image onto the preprocessed postoperative image after image registration, and according to the tumor area mapped onto the preprocessed postoperative image after image registration and an ablation area in the preprocessed postoperative image after image registration, acquiring an evaluation result of the ablation operation treatment effect;
wherein the elastic deformation field is used for describing the shrinkage of the tumor.
In a second aspect, an embodiment of the present invention provides an apparatus for evaluating an effect of ablation procedure treatment, including:
the pretreatment module is used for respectively carrying out pretreatment on a tumor area in the preoperative image and an ablation area in the postoperative image, so that the gray level distribution of the tumor area in the preoperative image after pretreatment is the same as the gray level distribution of the organ tissue area around the tumor area, and the gray level distribution of the ablation area in the postoperative image after pretreatment is the same as the gray level distribution of the organ tissue area around the ablation area;
The image registration module is used for carrying out image registration on a tumor area in the preprocessed preoperative image and an ablation area in the preprocessed postoperative image, obtaining an elastic deformation field, carrying out vector field analysis on the elastic deformation field, and determining a tumor contraction center point;
the effect evaluation module is used for mapping the tumor area in the preprocessed preoperative image to the preprocessed postoperative image after image registration according to the tumor contraction center point, and acquiring an evaluation result of the ablation operation treatment effect according to the tumor area mapped to the preprocessed postoperative image after image registration and the ablation area in the preprocessed postoperative image after image registration;
wherein the elastic deformation field is used for describing the shrinkage of the tumor.
In a third aspect, an embodiment of the present invention provides an electronic device, including:
at least one processor; and
at least one memory communicatively coupled to the processor, wherein:
the memory stores program instructions executable by the processor to invoke the method of assessing the effectiveness of an ablative surgical treatment provided by any of the various possible implementations of the first aspect.
In a fourth aspect, embodiments of the present invention provide a non-transitory computer-readable storage medium storing computer instructions that cause a computer to perform a method of assessing the effectiveness of an ablative surgical treatment provided by any of the various possible implementations of the first aspect.
According to the method and the device for evaluating the ablation treatment effect, the pre-operation image and the post-operation image are preprocessed, the preprocessed pre-operation image and the preprocessed post-operation image are subjected to image registration, the elastic deformation field is obtained, the vector field analysis is carried out on the elastic deformation field, the tumor shrinkage center point is determined, the tumor area is mapped onto the post-operation image according to the tumor shrinkage center point, the evaluation result of the ablation treatment effect is obtained, shrinkage of the tumor in operation can be accurately reflected, and accordingly the more accurate evaluation result of the ablation treatment effect can be obtained.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flow chart of a method for evaluating the effect of ablation therapy according to an embodiment of the present invention;
FIG. 2 is a functional block diagram of an evaluation device for the effectiveness of ablation therapy provided in accordance with an embodiment of the present invention;
fig. 3 is a block diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. Embodiments of the present invention are intended to be within the scope of the present invention as defined by the appended claims.
In order to overcome the problems in the prior art, the embodiment of the invention provides an evaluation method of the treatment effect of an ablation operation, which has the advantages that the shrinkage center point of the tumor is predicted by analyzing the shrinkage condition of the tumor actually occurring in the operation, the tumor area in a preoperative image is mapped onto a postoperative image according to the shrinkage center point of the tumor, and the actual change of the heated shrinkage of the tumor is considered in the mapping process, so that the wrapping condition of the ablation area on the tumor area can be reflected more accurately, and the evaluation result of the treatment effect of the ablation operation is obtained more accurately.
Fig. 1 is a flow chart of a method for evaluating the therapeutic effect of an ablation procedure according to an embodiment of the present invention. As shown in fig. 1, a method for evaluating the effect of ablation therapy includes: step S101, respectively preprocessing a tumor region in a preoperative image and an ablation region in a postoperative image, so that the gray distribution of the tumor region in the preprocessed preoperative image is the same as the gray distribution of the organ tissue region around the tumor region, and the gray distribution of the ablation region in the preprocessed postoperative image is the same as the gray distribution of the organ tissue region around the ablation region.
It should be noted that, the method for evaluating the therapeutic effect of the ablation procedure provided by the embodiment of the invention is suitable for evaluating the postoperative therapeutic effect of the ablation procedure on tumors of various pathological organs such as liver, stomach, lung, pancreas, thyroid, breast, intestinal tract and the like, and is not used for implementing the ablation procedure and diagnosing and treating patients after the ablation procedure.
It will be appreciated that pre-operative and post-operative images of the patient are acquired prior to evaluation of the effectiveness of the ablation procedure. The preoperative image includes a tumor region; the post-operative image includes an ablation region. The tumor region is present only in the pre-operative image and not in the post-operative image, while the ablation region is present only in the post-operative image and not in the pre-operative image.
The tumor region refers to the region occupied by the tumor in the image.
After the ablation operation, three layers are formed in sequence from inside to outside: carbonized regions, coagulated regions, and non-ablated regions. The carbonization zone and the coagulation zone are both contracted, and thus the ablation zone includes the carbonization zone and the coagulation zone.
It should be noted that, because the gray level distribution of the tumor area and the ablation area is similar and is obviously different from that of the normal organ tissue area, the edges of the tumor area and the ablation area tend to be aligned in the subsequent image registration process, and mismatching is generated, so that the elastic deformation field around the tumor is influenced, and the finally predicted shrinkage condition of the tumor is inaccurate.
Therefore, in order to avoid mismatching of the tumor region and the ablation region in registration, the pre-operation image and the post-operation image can be preprocessed by using an image restoration technology, specifically, the tumor region in the pre-operation image and the ablation region in the post-operation image are preprocessed respectively, so that the gray distribution of the tumor region in the pre-operation image after preprocessing is the same as the gray distribution of the organ tissue region around the tumor region, the gray distribution of the ablation region in the post-operation image after preprocessing is the same as the gray distribution of the organ tissue region around the ablation region, and therefore, the edge alignment of the tumor region and the ablation region in the subsequent image registration process and the inaccuracy of the predicted tumor shrinkage condition are avoided.
The gray distribution of the tumor area in the pre-processed preoperative image is the same as the gray distribution of the organ tissue area around the tumor area, which means that the gray distribution of the tumor area in the pre-processed preoperative image and the gray distribution of the organ tissue area around the tumor area have the same probability distribution function, but the parameters of the probability distribution function are different.
The gray distribution of the ablation region in the preprocessed postoperative image is the same as the gray distribution of the organ tissue region around the ablation region, which means that the gray distribution of the ablation region in the preprocessed postoperative image has the probability distribution function with the same form as the gray distribution of the organ tissue region around the ablation region, but the parameters of the probability distribution function are different.
Step S102, performing image registration on a tumor region in a preprocessed preoperative image and an ablation region in a preprocessed postoperative image to obtain an elastic deformation field, and performing vector field analysis on the elastic deformation field to determine a tumor contraction center point; wherein the elastic deformation field is used to describe the shrinkage of the tumor.
It should be noted that, when the microblog ablation operation is performed, the tumor drives the surrounding organ tissues, such as blood vessels, to shrink inwards in the process of thermal shrinkage, so that the actual shrinkage process of the tumor can be deduced according to the elastic deformation of the surrounding organ tissues, and the elastic deformation can be represented by the elastic deformation field of the surrounding organ tissues. The elastic deformation field of the organ tissue surrounding the tumor can be considered to be the same as the elastic deformation field of the tumor.
Specifically, after preprocessing the preoperative image and the postoperative image, the tumor region in the preprocessed preoperative image and the ablation region in the preprocessed postoperative image are registered according to an image registration method, so that estimation of the internal motion of a lesion organ can be realized, and an elastic deformation field for describing the shrinkage of tumors is obtained.
The elastic deformation field reflects the elastic deformation of the organ tissue around the tumor containing the internal motion information of the diseased organ. Since the surrounding organ tissue is located around the tumor, the elastic deformation of the surrounding organ tissue can also reflect the shrinkage of the tumor.
The elastic deformation field reflects the elastic movement of the inside of the lesion organ, and can be used for analyzing the shrinkage condition of the tumor because the elastic deformation field contains movement information of the tissue of the organ around the tumor. Because the tumor can drive surrounding tissues to shrink when being heated, the elastic deformation field can point to one or more points in the tumor together, and the points which point together are the shrinkage center point of the tumor. Therefore, by searching the center point of tumor contraction, the contraction movement of the tumor can be analyzed, and the contraction condition of the tumor can be further expressed.
Since the elastic deformation field is a vector field, a vector field analysis can be performed on the elastic deformation field to determine the tumor contraction center point. The elastic deformation field is subjected to a vector field analysis, and a suitable method can be selected from the existing vector field analysis methods.
Step S103, according to the tumor contraction center point, mapping the tumor area in the preprocessed preoperative image onto the preprocessed postoperative image after image registration, and according to the tumor area mapped onto the preprocessed postoperative image after image registration and the ablation area in the preprocessed postoperative image after image registration, obtaining an evaluation result of the ablation operation treatment effect.
The microwave ablation operation is performed by inserting an ablation needle into a tumor, generating microwaves through the ablation needle, and generating heat through the intense movement friction of water molecules in a microwave oscillation electric field to cause coagulation necrosis of tumor cells. Thus, the center point of contraction of the tumor can be considered to be the location of the intraoperative ablation needle. Depending on the actual situation, the ablation needle may be one or more, as the center point of contraction of the tumor obtained is one or more.
After obtaining the tumor shrinkage center point through step S102, taking the tumor shrinkage center point obtained through step S102 as the position of the ablation needle, so that the shrinkage condition of the tumor can be predicted according to the position of the ablation needle and any existing tumor shrinkage model, the tumor area in the pre-operation image after pretreatment is combined with the shrinkage condition of the tumor obtained by prediction and mapped onto the post-operation image after pretreatment, thereby obtaining the ablation area in the post-operation image after pretreatment after image registration, the wrapping condition of the tumor area mapped onto the post-operation image after pretreatment after image registration, and evaluating the treatment effect of the ablation operation according to the wrapping condition, thereby obtaining the evaluation result of the treatment effect of the ablation operation.
According to the embodiment of the invention, after the pre-operation image and the post-operation image are preprocessed, the preprocessed pre-operation image and the preprocessed post-operation image are subjected to image registration, an elastic deformation field is obtained, vector field analysis is carried out on the elastic deformation field, a tumor contraction center point is determined, a tumor area is mapped onto the post-operation image according to the tumor contraction center point, an evaluation result of the ablation treatment effect is obtained, the contraction of the tumor in operation can be accurately reflected, and thus a more accurate evaluation result of the ablation treatment effect can be obtained.
Based on the above embodiments, the specific steps of preprocessing the tumor region in the preoperative image include: for each pixel in the tumor region in the pre-operative image, the gray scale of the pixel is replaced with a weighted sum of the gray scales of the pixels in the neighborhood of the pixel.
Specifically, the gray scale of each pixel in the tumor area in the preoperative image is replaced by the weighted sum of the gray scales of each pixel in the neighborhood of the pixel, so as to realize the pretreatment of the tumor area in the preoperative image.
The neighborhood of each pixel may be, but not limited to, 4 neighborhood or 8 neighborhood.
The specific formula for preprocessing the tumor area in the preoperative image is as follows:
Wherein Ω 1 Representing a tumor region; x is tumor region Ω 1 Pixels in (a); i (x) represents the gray scale of the pixel x after pretreatment; neighborhood omega 0 Representing a neighborhood of pixel x; y represents the neighborhood Ω of pixel x 0 Pixels in (a); i (y) represents the gradation of the pixel y; w represents a weight; alpha 0 And the preset normal number is used for representing the adjustment coefficient.
For alpha 0 Lower values can reduce noise and higher values can preserve image detail.
According to the embodiment of the invention, the gray scale of each pixel in the tumor area is replaced by the weighted sum of the gray scales of each pixel in the neighborhood of the pixel, and the error matching of the tumor area and the ablation area in the registration can be avoided, so that more accurate tumor shrinkage conditions can be obtained, and more accurate evaluation results of the treatment effect of the ablation operation can be obtained.
Based on the above embodiments, the specific steps of preprocessing the ablation region in the post-operation image include: for each pixel in the ablation region in the post-operative image, the gray scale of the pixel is replaced with a weighted sum of the gray scales of the pixels in the neighborhood of the pixel.
Specifically, the gray scale of each pixel in the ablation region in the postoperative image is replaced by the weighted sum of the gray scales of each pixel in the neighborhood of the pixel, so that the pretreatment of the tumor region in the postoperative image is realized.
The neighborhood of each pixel may be, but not limited to, 4 neighborhood or 8 neighborhood.
The method of preprocessing the tumor region in the preoperative image can be adopted to preprocess the ablation region in the postoperative image. The specific formula for preprocessing the ablation area in the postoperative image is as follows:
wherein Ω 2 Representing an ablation zone; x is the ablation zone Ω 2 Pixels in (a); i (x) represents the gray scale of the pixel x after pretreatment; neighborhood omega 0 Representing a neighborhood of pixel x; y represents the neighborhood Ω of pixel x 0 Pixels in (a); i (y) represents the gradation of the pixel y; w represents a weight; alpha 0 And the preset normal number is used for representing the adjustment coefficient.
For alpha 0 Lower values can reduce noise and higher values can preserve image detail. Alpha in specific formulas for pre-and post-operative image preprocessing 0 The same applies.
It will be appreciated that the neighborhood used in pre-processing the tumor region in the pre-operative image may be the same as or different from the neighborhood used in pre-processing the ablation region in the post-operative image. For example, the 8 neighbors may be used, or the 4 neighbors and the 8 neighbors may be used, respectively.
According to the embodiment of the invention, the gray scale of each pixel in the ablation area is replaced by the weighted sum of the gray scales of each pixel in the neighborhood of the pixel, so that the false matching of the tumor area and the ablation area in the registration can be avoided, the more accurate tumor shrinkage condition can be obtained, and the more accurate evaluation result of the ablation operation treatment effect can be obtained.
Based on the above embodiments, the specific steps of performing image registration on a tumor region in a pre-processed preoperative image and an ablation region in a post-processed image to obtain an elastic deformation field include: performing rigid registration on a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image so as to maximize mutual information between the preprocessed preoperative image and the preprocessed postoperative image after rigid registration; and according to the differential stratospheric deformation model, elastically registering a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image after rigid registration to obtain an elastic deformation field.
Specifically, image registration is performed on a tumor region in a preprocessed preoperative image and an ablation region in a preprocessed postoperative image, and the method comprises the following two steps: rigid registration and elastic registration.
Since the preoperative image and the postoperative image for evaluating the effect of ablation surgery are acquired from different times and places, there is a large-scale pose difference between the images, which cannot be processed only by elastic registration. It is therefore necessary to predict first the rigid deformation between the two images, correcting the large-scale pose difference by rigid registration.
Pose, refers to position and posture.
The gray information of the entire image may be used to direct rigid registration and mutual information (Mutual Information, MI for short) may be used to measure the degree of similarity between the two images. The goal of rigid registration is to find an ideal rigid transformation matrixSo that the pre-processed post-operative image I after rigid transformation R-post And pre-processed preoperative image I pre The mutual information between them reaches a maximum. The post-operative image after pretreatment can be used as I post And (3) representing.
The mutual information may be standardized mutual information (Normalized Mutual Information, abbreviated as NMI), but is not limited thereto.
The method is suitable for the situation that the preoperative image and the postoperative image are obtained through different medical image acquisition methods. For example, when the preoperative image is a CT image and the postoperative image is an MRI image, rigid registration is performed based on mutual information, so that the method is not affected by different image acquisition methods, and a better registration effect is obtained.
Rigid transformation matrixIs an Euler Transform (Euler Transform) matrix. Rigid transformation, consisting of two parts, rotation and translation. Rigid transformation matrix->The expression can be represented by the following formula:
wherein α, β, γ represent rotation angles about x, y, z axes, respectively; t is t x ,t y ,t z The amount of translation along the x, y, z axes are shown, respectively.
After rigid registration, the pre-operative image and the post-operative image are spatially aligned as a whole. However, since the non-rigid motion inside the lesion is required to be analyzed, the elastic registration is further required to obtain corresponding motion information, namely an elastic deformation field
When elastic registration is performed, registration can be performed according to a differential stratoshaped deformation (diffeomorphic demons) model, and an elastic deformation field is obtained. The elastic deformation field obtained by prediction according to the differential stratospheric deformation model has the characteristic of differential stratosphere. The characteristics enable the elastic deformation field to be tiny everywhere, namely the change of the elastic deformation field is continuously led, so that the position of the tumor contraction center point can be deduced on the basis of grasping the movement information of organs and tissues around the tumor.
For example, but not limited to, elastic registration may be performed using a log-domain differential homoembryo deformation (log-domain diffeomorphic demons) model.
Post-operative image I after pretreatment post Through final deformation fieldAfter deformation, with pre-processed preoperative image I pre HeightAlignment.
Wherein the rigid transformation matrixReflecting the rigid deformation of the preoperative and postoperative pose of the patient, and the elastic deformation field +.>Reflecting the elastic deformation of organ tissue containing information of the internal motion of the diseased organ.
According to the embodiment of the invention, through rigid registration based on mutual information and elastic registration based on differential and homoembryo deformation models, the elastic deformation field is obtained, the pose difference of the postoperative image relative to the preoperative image and the elastic deformation of the organ tissues around the tumor can be more accurately separated, and the more accurate elastic deformation field for describing the shrinkage of the tumor can be obtained, so that the more accurate shrinkage condition of the tumor can be obtained, and the more accurate evaluation result of the ablation treatment effect can be obtained. Furthermore, the rigid registration based on mutual information can be suitable for the situation that the preoperative image and the postoperative image are obtained through different medical image acquisition methods, and the application range is wider.
Based on the above embodiments, the specific steps of vector field analysis of the elastic deformation field to determine the tumor contraction center point include: decomposing the elastic deformation field to obtain a non-rotating field and a potential function of the non-rotating field in the elastic deformation field; determining a central point of the reduced propagation in the non-rotating field according to a potential function of the non-rotating field; and acquiring the contraction degree of the central points of the contraction propagation in the non-rotating field, clustering the central points of the contraction propagation in the non-rotating field according to the contraction degree, and determining the central point of the type of contraction propagation with the largest contraction degree as the tumor contraction central point.
Specifically, the elastic deformation field may be subjected to vector field analysis by the following steps to determine the tumor shrinkage center point.
After the elastic deformation field is obtained, the elastic deformation field is decomposed, and the elastic deformation field is decomposed into a non-rotating field, a non-scattering field and a harmonic field.
At the position ofThere are many key points such as source (center point of propagation enlarged, center of an expanding propagation), sink (center point of propagation contracted), rotational center (center point of rotation), etc. Shrinkage of a tumor is reflected in the propagation of shrinkage in the deformation field, so sink can represent the center point of shrinkage of the tumor.
Wherein,representing an elastic deformation field; />Indicating a non-rotating field; />Indicating no stray field; />Representing the reconciliation field.
A non-rotating field comprising only divergence and/or contraction; no stray field, only rotation; and (3) reconciling the fields, and approximating translation.
Since the center point of contraction is required to be obtained, the center point of contraction is obviously only present in the non-rotating field.
In decomposing the elastic deformation field, the potential function D of the non-rotating field can also be obtained.
Wherein G is Representing free-space green's function; let denote the divergence operator; Ω denotes a pre-processed preoperative image I pre Space.
From the potential function of the non-rotating field, the sink (center point of the narrowing propagation) in the non-rotating field can be determined.
Due toIs complex, resulting in the generation of many sink. sink includes two classes: noise sink and correct sink. Noise sink is caused by noise, and its degree of contraction is small; correct sink is caused by tumor shrinkage, which is to a large extent.
In order to eliminate the influence of noise and obtain a correct tumor contraction center point, after determining the center points of contraction propagation in the non-rotating field, the contraction degree of each center point of contraction propagation is obtained.
The degree of contraction of each sink point can be reflected by the jacobian determinant. The specific expression of the jacobian determinant is:
wherein,respectively indicate->Components in three directions of x, y and z axes.
JAC is 1 indicating that the volume remains unchanged; the smaller the value of JAC, the greater the degree of volume shrinkage.
Substituting the coordinates of each sink point into the specific expression of the Jacobian determinant to obtain the contraction degree of each sink point.
After the contraction degree of each sink point is obtained, clustering is carried out on the contraction degree (JAC value) of the sink point by adopting a clustering algorithm, and the center point of the type of contraction propagation with the largest contraction degree is determined to be the correct sink, namely the tumor contraction center point. And the center point of the propagation is the noise sink in one or more types of shrinkage smaller in shrinkage degree.
The embodiment of the invention does not limit the adopted clustering algorithm in particular.
For example, clustering can be performed using the K-means algorithm, aggregating the center points of the contracted propagation into two classes: the type with larger contraction degree and the type with smaller contraction degree are correct sink, and the type with smaller contraction degree is noise sink.
According to the embodiment of the invention, the central point of the shrinkage propagation in the non-rotating field is determined by decomposing the elastic deformation field, the central points of the shrinkage propagation in the non-rotating field are clustered according to the shrinkage degree, and the central point of the type of shrinkage propagation with the maximum shrinkage degree is determined as the tumor shrinkage central point, so that the interference of noise can be eliminated, the more accurate tumor shrinkage central point can be obtained, and the more accurate evaluation result of the ablation operation treatment effect can be obtained.
Based on the foregoing embodiment, the specific step of determining the center point of the reduced propagation in the non-rotating field according to the potential function of the non-rotating field includes: and acquiring a maximum point of a potential function of the non-rotating field, and determining a point in the non-rotating field corresponding to the maximum point as a central point of the reduced propagation in the non-rotating field.
Specifically, sink is a point in the spin-free field corresponding to the maximum point of the potential function of the spin-free field.
The maximum point of the potential function of the non-rotating field can be determined according to the potential function of the non-rotating field, so that the central point of the narrowing propagation in the non-rotating field can be determined according to the maximum point of the potential function of the non-rotating field.
According to the embodiment of the invention, the point in the non-rotating field corresponding to the maximum value point of the potential function of the non-rotating field is determined as the central point of the reduced propagation in the non-rotating field, and the accurate central point of the reduced propagation can be obtained, so that the more accurate central point of tumor shrinkage and the more accurate evaluation result of the ablation treatment effect can be obtained.
Based on the above embodiments, the specific steps of decomposing the elastic deformation field to obtain the non-rotating field and the potential function of the non-rotating field in the elastic deformation field include: and decomposing the elastic deformation field according to a Huo Jihai MoHotz decomposition algorithm to obtain a non-rotating field and a potential function of the non-rotating field in the elastic deformation field.
Specifically, an elastic deformation field may be decomposed using a Huo Jihai mholtz decomposition (Hodge Helmholtz decomposition, HHD for short) algorithm.
For example, the elastic deformation field may be decomposed using a Natural HHD (Natural Huo Jihai MHotz decomposition) algorithm or an efficiency HHD (efficiency Huo Jihai MHotz decomposition).
According to the embodiment of the invention, the elastic deformation field is decomposed according to the Huo Jihai Muholtz decomposition algorithm, so that more accurate non-rotating field and potential function of the non-rotating field can be obtained, and further, more accurate evaluation result of the ablation treatment effect can be obtained.
Fig. 2 is a functional block diagram of an evaluation device for the therapeutic effect of an ablation procedure according to an embodiment of the present invention. Based on the content of the above embodiment, as shown in fig. 2, an apparatus for evaluating the effect of ablation surgery treatment includes a preprocessing module 201, an image registration module 202, and an effect evaluation module 203, wherein:
the preprocessing module 201 is configured to respectively preprocess a tumor area in the preoperative image and an ablation area in the postoperative image, so that the gray distribution of the tumor area in the preprocessed preoperative image is the same as the gray distribution of the organ tissue area around the tumor area, and the gray distribution of the ablation area in the preprocessed postoperative image is the same as the gray distribution of the organ tissue area around the ablation area;
the image registration module 202 is configured to perform image registration on a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image, obtain an elastic deformation field, perform vector field analysis on the elastic deformation field, and determine a tumor contraction center point;
The effect evaluation module 203 is configured to map a tumor region in the preprocessed preoperative image to a preprocessed postoperative image after image registration according to a tumor contraction center point, and obtain an evaluation result of an ablation treatment effect according to the tumor region mapped to the preprocessed postoperative image and an ablation region in the preprocessed postoperative image after image registration;
wherein the elastic deformation field is used to describe the shrinkage of the tumor.
Specifically, after the preoperative image and the postoperative image of the patient are acquired, the preprocessing module 201 respectively preprocesses the tumor area in the preoperative image and the ablation area in the postoperative image, so that the gray distribution of the tumor area in the preoperative image after preprocessing is the same as the gray distribution of the organ tissue area around the tumor area, the gray distribution of the ablation area in the postoperative image after preprocessing is the same as the gray distribution of the organ tissue area around the ablation area, the edge alignment of the tumor area and the ablation area in the subsequent image registration process is avoided, and the false matching of the tumor area and the ablation area occurs in the registration.
The image registration module 202 performs image registration on a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image to obtain an elastic deformation field for describing shrinkage of the tumor; after the elastic deformation field is obtained, vector field analysis is carried out on the elastic deformation field, and the tumor shrinkage center point is determined.
The effect evaluation module 203 maps the tumor area in the preprocessed preoperative image to the preprocessed postoperative image after image registration according to the tumor contraction center point, and obtains an evaluation result of the ablation treatment effect.
The specific method and flow of each module included in the evaluation device for the ablation treatment effect to realize the corresponding function are detailed in the embodiment of the evaluation method for the ablation treatment effect, and are not repeated here.
The evaluation device of the ablation treatment effect is used for the evaluation method of the ablation treatment effect of the foregoing embodiments. Therefore, the description and definition in the evaluation method of the ablation procedure treatment effect in the foregoing embodiments can be used for understanding the respective execution modules in the embodiments of the present invention.
According to the embodiment of the invention, after the pre-operation image and the post-operation image are preprocessed, the preprocessed pre-operation image and the preprocessed post-operation image are subjected to image registration, an elastic deformation field is obtained, vector field analysis is carried out on the elastic deformation field, a tumor contraction center point is determined, a tumor area is mapped onto the post-operation image according to the tumor contraction center point, an evaluation result of the ablation treatment effect is obtained, the contraction of the tumor in operation can be accurately reflected, and thus a more accurate evaluation result of the ablation treatment effect can be obtained.
Fig. 3 is a block diagram of an electronic device according to an embodiment of the present invention. Based on the content of the above embodiment, as shown in fig. 3, the electronic device may include: a processor (processor) 301, a memory (memory) 302, and a bus 303; wherein the processor 301 and the memory 302 perform communication with each other through the bus 303; the processor 301 is configured to invoke computer program instructions stored in the memory 302 and executable on the processor 301 to perform the methods provided by the method embodiments described above, including, for example: respectively preprocessing a tumor region in the preoperative image and an ablation region in the postoperative image, so that the gray scale distribution of the tumor region in the preprocessed preoperative image is the same as the gray scale distribution of the organ tissue region around the tumor region, and the gray scale distribution of the ablation region in the preprocessed postoperative image is the same as the gray scale distribution of the organ tissue region around the ablation region; image registration is carried out on a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image, an elastic deformation field is obtained, vector field analysis is carried out on the elastic deformation field, and a tumor contraction center point is determined; according to the tumor shrinkage center point, mapping a tumor region in the preprocessed preoperative image onto the preprocessed postoperative image after image registration, and according to the tumor region mapped onto the preprocessed postoperative image after image registration and the ablation region in the preprocessed postoperative image after image registration, obtaining an evaluation result of the ablation treatment effect.
Another embodiment of the present invention discloses a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, are capable of performing the methods provided by the above-described method embodiments, for example comprising: respectively preprocessing a tumor region in the preoperative image and an ablation region in the postoperative image, so that the gray scale distribution of the tumor region in the preprocessed preoperative image is the same as the gray scale distribution of the organ tissue region around the tumor region, and the gray scale distribution of the ablation region in the preprocessed postoperative image is the same as the gray scale distribution of the organ tissue region around the ablation region; image registration is carried out on a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image, an elastic deformation field is obtained, vector field analysis is carried out on the elastic deformation field, and a tumor contraction center point is determined; according to the tumor shrinkage center point, mapping a tumor region in the preprocessed preoperative image onto the preprocessed postoperative image after image registration, and according to the tumor region mapped onto the preprocessed postoperative image after image registration and the ablation region in the preprocessed postoperative image after image registration, obtaining an evaluation result of the ablation treatment effect.
Further, the logic instructions in memory 302 described above may be implemented in the form of software functional units and stored in a computer readable storage medium when sold or used as a stand alone product. Based on such understanding, the technical solution of the embodiments of the present invention may be embodied in essence or a part contributing to the prior art or a part of the technical solution, in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Another embodiment of the present invention provides a non-transitory computer readable storage medium storing computer instructions that cause a computer to perform the methods provided by the above-described method embodiments, for example, including: respectively preprocessing a tumor region in the preoperative image and an ablation region in the postoperative image, so that the gray scale distribution of the tumor region in the preprocessed preoperative image is the same as the gray scale distribution of the organ tissue region around the tumor region, and the gray scale distribution of the ablation region in the preprocessed postoperative image is the same as the gray scale distribution of the organ tissue region around the ablation region; image registration is carried out on a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image, an elastic deformation field is obtained, vector field analysis is carried out on the elastic deformation field, and a tumor contraction center point is determined; according to the tumor shrinkage center point, mapping a tumor region in the preprocessed preoperative image onto the preprocessed postoperative image after image registration, and according to the tumor region mapped onto the preprocessed postoperative image after image registration and the ablation region in the preprocessed postoperative image after image registration, obtaining an evaluation result of the ablation treatment effect.
The apparatus embodiments described above are merely illustrative, wherein elements illustrated as separate elements may or may not be physically separate, and elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. It is to be understood that the foregoing aspects, in essence, or portions thereof, may be embodied in the form of a software product that may be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., including instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the various embodiments, or methods of portions of the embodiments, described above.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (7)

1. A method of assessing the effectiveness of an ablative surgical treatment, comprising:
respectively preprocessing a tumor region in the preoperative image and an ablation region in the postoperative image, so that the gray scale distribution of the tumor region in the preprocessed preoperative image is the same as the gray scale distribution of the organ tissue region around the tumor region, and the gray scale distribution of the ablation region in the preprocessed postoperative image is the same as the gray scale distribution of the organ tissue region around the ablation region;
image registration is carried out on a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image, an elastic deformation field is obtained, vector field analysis is carried out on the elastic deformation field, and a tumor contraction center point is determined;
According to the tumor contraction center point, mapping a tumor area in the preprocessed preoperative image onto the preprocessed postoperative image after image registration, and according to the tumor area mapped onto the preprocessed postoperative image after image registration and an ablation area in the preprocessed postoperative image after image registration, acquiring an evaluation result of the ablation operation treatment effect;
wherein the elastic deformation field is used for describing the shrinkage of the tumor;
the specific steps of performing image registration on the tumor area in the preprocessed preoperative image and the ablation area in the preprocessed postoperative image to obtain the elastic deformation field include:
performing rigid registration on a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image so as to maximize mutual information between the preprocessed preoperative image and the preprocessed postoperative image after rigid registration;
according to the differential stratospheric deformation model, elastically registering a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image after rigid registration to obtain the elastic deformation field;
The specific steps of carrying out vector field analysis on the elastic deformation field and determining the tumor shrinkage center point comprise the following steps:
decomposing the elastic deformation field to obtain a non-rotating field in the elastic deformation field and a potential function of the non-rotating field;
determining a central point of the reduced propagation in the non-rotating field according to the potential function of the non-rotating field;
acquiring the contraction degree of each contraction propagation center point in the non-rotating field, clustering the contraction propagation center points in the non-rotating field according to the contraction degree, and determining the center point of the contraction propagation with the largest contraction degree as the tumor contraction center point;
the specific steps of determining the central point of the diminished propagation in the non-rotating field according to the potential function of the non-rotating field include:
and acquiring a maximum point of a potential function of the non-rotating field, and determining a point in the non-rotating field corresponding to the maximum point as a central point of the reduced propagation in the non-rotating field.
2. The method of assessing the effectiveness of an ablative surgical treatment according to claim 1, wherein the specific step of pre-treating the tumor region in the preoperative image comprises:
for each pixel in the tumor region in the pre-operative image, replacing the gray scale of the pixel with a weighted sum of the gray scales of the pixels in the neighborhood of the pixel.
3. The method of assessing the effectiveness of an ablative surgical procedure of claim 1 wherein the specific step of pre-processing the ablated region in the post-operative image comprises:
for each pixel in the ablation region in the post-operative image, replacing the gray scale of the pixel with a weighted sum of the gray scales of the pixels in the neighborhood of the pixel.
4. The method of assessing the effectiveness of an ablative surgical procedure of claim 1, wherein decomposing the elastic deformation field to obtain a non-rotating field of the elastic deformation field and a potential function of the non-rotating field comprises:
and decomposing the elastic deformation field according to a Huo Jihai Muholtz decomposition algorithm to obtain a non-rotating field in the elastic deformation field and a potential function of the non-rotating field.
5. An evaluation device for the effect of ablation surgery treatment, comprising:
the pretreatment module is used for respectively carrying out pretreatment on a tumor area in the preoperative image and an ablation area in the postoperative image, so that the gray level distribution of the tumor area in the preoperative image after pretreatment is the same as the gray level distribution of the organ tissue area around the tumor area, and the gray level distribution of the ablation area in the postoperative image after pretreatment is the same as the gray level distribution of the organ tissue area around the ablation area;
The image registration module is used for carrying out image registration on a tumor area in the preprocessed preoperative image and an ablation area in the preprocessed postoperative image, obtaining an elastic deformation field, carrying out vector field analysis on the elastic deformation field, and determining a tumor contraction center point;
the effect evaluation module is used for mapping the tumor area in the preprocessed preoperative image to the preprocessed postoperative image after image registration according to the tumor contraction center point, and acquiring an evaluation result of the ablation operation treatment effect according to the tumor area mapped to the preprocessed postoperative image after image registration and the ablation area in the preprocessed postoperative image after image registration;
wherein the elastic deformation field is used for describing the shrinkage of the tumor;
the image registration module is specifically configured to perform rigid registration on a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image, so that mutual information between the preprocessed preoperative image and the preprocessed postoperative image after rigid registration is maximized;
according to the differential stratospheric deformation model, elastically registering a tumor region in the preprocessed preoperative image and an ablation region in the preprocessed postoperative image after rigid registration to obtain the elastic deformation field;
The image registration module is specifically configured to decompose the elastic deformation field, and obtain a non-rotation field in the elastic deformation field and a potential function of the non-rotation field;
determining a central point of the reduced propagation in the non-rotating field according to the potential function of the non-rotating field;
acquiring the contraction degree of each contraction propagation center point in the non-rotating field, clustering the contraction propagation center points in the non-rotating field according to the contraction degree, and determining the center point of the contraction propagation with the largest contraction degree as the tumor contraction center point;
the image registration module is specifically configured to obtain a maximum point of a potential function of the non-rotation field, and determine a point in the non-rotation field corresponding to the maximum point as a central point of the reduced propagation in the non-rotation field.
6. An electronic device, comprising:
at least one processor; and
at least one memory communicatively coupled to the processor, wherein:
the memory stores program instructions executable by the processor, the processor invoking the program instructions to perform the method of any of claims 1-4.
7. A non-transitory computer readable storage medium storing computer instructions that cause the computer to perform the method of any one of claims 1 to 4.
CN201811622007.1A 2018-12-28 2018-12-28 Evaluation method and device for ablation treatment effect Active CN109859833B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811622007.1A CN109859833B (en) 2018-12-28 2018-12-28 Evaluation method and device for ablation treatment effect

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811622007.1A CN109859833B (en) 2018-12-28 2018-12-28 Evaluation method and device for ablation treatment effect

Publications (2)

Publication Number Publication Date
CN109859833A CN109859833A (en) 2019-06-07
CN109859833B true CN109859833B (en) 2023-12-22

Family

ID=66892839

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811622007.1A Active CN109859833B (en) 2018-12-28 2018-12-28 Evaluation method and device for ablation treatment effect

Country Status (1)

Country Link
CN (1) CN109859833B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110310313B (en) * 2019-07-09 2021-10-01 中国电子科技集团公司第十三研究所 Image registration method, image registration device and terminal
CN110782474B (en) * 2019-11-04 2022-11-15 中国人民解放军总医院 Deep learning-based method for predicting morphological change of liver tumor after ablation
CN110910406B (en) * 2019-11-20 2022-08-26 中国人民解放军总医院 Method and system for evaluating three-dimensional space curative effect after liver tumor ablation
CN111012480A (en) * 2020-01-06 2020-04-17 南京康友医疗科技有限公司 Ablation needle system of ablation instrument
CN112257912A (en) * 2020-10-15 2021-01-22 北京爱康宜诚医疗器材有限公司 Method and device for predicting operation evaluation information, processor and electronic device
CN112967797A (en) * 2021-02-02 2021-06-15 上海全景医学影像诊断中心有限公司 Method for evaluating efficacy of smog surgery
CN113506331A (en) * 2021-06-29 2021-10-15 武汉联影智融医疗科技有限公司 Method, apparatus, computer device and storage medium for registering tissue and organ
CN113299370B (en) * 2021-07-05 2022-03-01 数坤(北京)网络科技股份有限公司 Medical image display method and device, computer equipment and storage medium
CN113838556A (en) * 2021-09-24 2021-12-24 北京三春晖医疗器械有限公司 Composite pulse electric field tumor ablation planning system
CN114757982A (en) * 2022-04-11 2022-07-15 北京理工大学 Registration method and device applied to liver ablation postoperative evaluation

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102609621A (en) * 2012-02-10 2012-07-25 中国人民解放军总医院 Ablation image guiding equipment with image registration device
CN104392452A (en) * 2014-11-28 2015-03-04 成都影泰科技有限公司 Application based DICOM medical image processing method
CN104881568A (en) * 2015-04-27 2015-09-02 苏州敏宇医疗科技有限公司 Cloud computation based early oncotherapy efficacy evaluation system and method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10402535B2 (en) * 2014-02-26 2019-09-03 Siemens Healthcare Gmbh System and method for personalized computation of tissue ablation extent based on medical images

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102609621A (en) * 2012-02-10 2012-07-25 中国人民解放军总医院 Ablation image guiding equipment with image registration device
CN104392452A (en) * 2014-11-28 2015-03-04 成都影泰科技有限公司 Application based DICOM medical image processing method
CN104881568A (en) * 2015-04-27 2015-09-02 苏州敏宇医疗科技有限公司 Cloud computation based early oncotherapy efficacy evaluation system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"Local incompressible registration for liver ablation surgery assessment";Tianyu Fu等;《Medical Physics》;20171008;第5874页第2栏最后1段至第5879页第2栏第2段 *

Also Published As

Publication number Publication date
CN109859833A (en) 2019-06-07

Similar Documents

Publication Publication Date Title
CN109859833B (en) Evaluation method and device for ablation treatment effect
US11862348B2 (en) Systems and methods for using generic anatomy models in surgical planning
US10417762B2 (en) Matching patient images and images of an anatomical atlas
US10854339B2 (en) Systems and methods for associating medical images with a patient
US10026016B2 (en) Tracking and representation of multi-dimensional organs
Deng et al. A novel skull registration based on global and local deformations for craniofacial reconstruction
US11475570B2 (en) Computational simulations of anatomical structures and body surface electrode positioning
Kuiper et al. Efficient cascaded V‐net optimization for lower extremity CT segmentation validated using bone morphology assessment
CN115049596A (en) Template image library generation method, target positioning device and storage medium
CN111127636A (en) Intelligent desktop-level three-dimensional diagnosis system for complex intra-articular fracture
Loew et al. Technical issues in multimodality medical image registration
Criscuolo et al. A comprehensive lung CT landmark pair dataset for evaluating deformable image registration algorithms
CN115578456A (en) Simulated pneumoperitoneum image generation method and device and computer equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information

Inventor after: Ai Danni

Inventor after: Liu Dingkun

Inventor after: Yang Jian

Inventor after: Wang Yongtian

Inventor after: Liang Ping

Inventor after: Fu Tianyu

Inventor after: Wu Chan

Inventor after: Song Hong

Inventor before: Ai Danni

Inventor before: Liu Dingkun

Inventor before: Yang Jian

Inventor before: Wang Yongtian

Inventor before: Fu Tianyu

Inventor before: Wu Chan

Inventor before: Song Hong

CB03 Change of inventor or designer information
GR01 Patent grant
GR01 Patent grant