CN109767432A - Data fusion method, device, computer equipment and readable storage medium storing program for executing - Google Patents
Data fusion method, device, computer equipment and readable storage medium storing program for executing Download PDFInfo
- Publication number
- CN109767432A CN109767432A CN201811640984.4A CN201811640984A CN109767432A CN 109767432 A CN109767432 A CN 109767432A CN 201811640984 A CN201811640984 A CN 201811640984A CN 109767432 A CN109767432 A CN 109767432A
- Authority
- CN
- China
- Prior art keywords
- image
- functional
- data
- outer contour
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000007500 overflow downdraw method Methods 0.000 title abstract description 13
- 210000000056 organ Anatomy 0.000 claims abstract description 123
- 238000013507 mapping Methods 0.000 claims abstract description 94
- 210000004204 blood vessel Anatomy 0.000 claims abstract description 35
- 238000000034 method Methods 0.000 claims abstract description 29
- 238000004088 simulation Methods 0.000 claims description 72
- 230000004927 fusion Effects 0.000 claims description 20
- 230000006870 function Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 13
- 230000000694 effects Effects 0.000 claims description 13
- 239000012530 fluid Substances 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 7
- 238000012512 characterization method Methods 0.000 abstract 1
- 230000003902 lesion Effects 0.000 description 10
- 230000017531 blood circulation Effects 0.000 description 5
- 238000002591 computed tomography Methods 0.000 description 5
- 230000000877 morphologic effect Effects 0.000 description 5
- 230000004089 microcirculation Effects 0.000 description 4
- 238000002600 positron emission tomography Methods 0.000 description 4
- 230000010412 perfusion Effects 0.000 description 3
- 239000008280 blood Substances 0.000 description 2
- 210000004369 blood Anatomy 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 230000000004 hemodynamic effect Effects 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 208000031481 Pathologic Constriction Diseases 0.000 description 1
- 210000003484 anatomy Anatomy 0.000 description 1
- 210000001557 animal structure Anatomy 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 210000005242 cardiac chamber Anatomy 0.000 description 1
- 210000004351 coronary vessel Anatomy 0.000 description 1
- 238000013506 data mapping Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 210000004185 liver Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000036262 stenosis Effects 0.000 description 1
- 208000037804 stenosis Diseases 0.000 description 1
- 238000003325 tomography Methods 0.000 description 1
Landscapes
- Apparatus For Radiation Diagnosis (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Image Analysis (AREA)
Abstract
This application involves a kind of data fusion method, device, computer equipment and readable storage medium storing program for executing.The data fusion method includes: the anatomic image of the function image and the target object that are registrated target object, obtains registration result；According to the anatomic image, first object image and the second target image are obtained, wherein include blood vessel in second target image, include remaining organ in the first object image；Determine mapping data of the functional parameter on the outer profile for the remaining organ that the first object image includes；According to the mapping data, the outer profile image of the remaining organ is obtained；According to second target image, analogue data is obtained, wherein distribution situation of the analogue data characterization parameter preset in the blood vessel；Merge the outer profile image and the analogue data.The method provided by the present application can be realized merging for function image and analogue data.
Description
Technical Field
The present invention relates to the field of medical technology, and in particular, to a data fusion method, apparatus, computer device, and readable storage medium.
Background
At present, with the continuous development of medical science, functional images and anatomical images have become common ways for assisting medical technicians in diagnosis. Wherein, the functional image can reflect the functional lesion of the tissue or the organ from the microcirculation level; the anatomical image can reflect a morphological lesion of a tissue or organ.
In order to visually reflect morphological lesions and functional lesions of tissues or organs, the functional images are fused with anatomical images to form three-dimensional display images. For example, fused electron Computed Tomography (CT) with Positron Emission Tomography (PET); for another example, Magnetic Resonance (MR) is fused with PET. Among them, CT and MR are used to reflect the functional condition of a tissue or an organ, and PET is used to reflect the anatomical morphology of a tissue or an organ. In addition, by reconstructing a model of an anatomical structure of a large blood vessel of a tissue or an organ and then simulating a flow of blood in the blood vessel by a computational fluid dynamics method, it is possible to obtain simulation data such as hemodynamic parameters. The simulated data can reflect the blood flow condition of the tissue or organ from the large vessel level.
However, the microcirculation level and the macrovascular level are not isolated, and the stenosis of the macrovascular must lead to a decrease in the perfusion of the microcirculation blood, which in turn affects the function of the organ or tissue. In the fusion mode, the functional image and the anatomical image are fused, so that morphological lesions and functional lesions of tissues or organs can be visually reflected. However, the relationship between the functional image and the simulated data obtained based on the anatomical image is not clear.
Disclosure of Invention
In view of the above, it is necessary to provide a data fusion method, apparatus, computer device and readable storage medium for solving the above problems.
A method of data fusion, comprising:
registering the functional image of the target object and the anatomical image of the target object to obtain a registration result;
acquiring a first target image and a second target image according to the anatomical image, wherein the second target image comprises blood vessels, and the first target image comprises residual organs;
determining mapping data of functional parameters on the outer contour of the remaining organ contained in the first target image; wherein the functional parameters are used for characterizing the activity condition of the residual organs in the registration result;
acquiring an outer contour image of the residual organ according to the mapping data;
acquiring simulation data according to the second target image, wherein the simulation data represent the distribution condition of preset parameters in the blood vessel;
and fusing the outer contour image and the simulation data.
In one embodiment, the acquiring simulation data according to the second target image includes:
constructing a second target simulation model according to the second target image;
and carrying out computational fluid dynamics simulation according to the second target simulation model to obtain the simulation data.
In one embodiment, the determining the mapping data of the functional parameter on the outer contour of the remaining organ contained in the first target image comprises:
determining a center point of the remaining organ;
acquiring rays from the central point to the outer contour of the residual organ;
determining a functional parameter set according to the functional image and the ray included in the registration result, wherein the parameters included in the functional parameter set are parameters corresponding to the part of the ray passing through the residual organ;
and determining the mapping data according to the function parameter set.
In one embodiment, the obtaining an outer contour image of the remaining organ according to the mapping data includes:
determining an intersection point of the ray and the outer contour;
mapping the mapping data to the intersection point;
and acquiring the outer contour image of the residual organ according to the intersection point.
In one embodiment, the determining the mapping data of the functional parameter on the outer contour of the remaining organ contained in the first target image comprises:
determining a central axis of the remaining organ;
determining a second point closest to the first point on the central axis according to the first point on the outer contour, wherein the first point is any point on the outer contour;
acquiring a target line segment connecting the first point and the second point;
determining a functional parameter set according to the functional image and the target line segment contained in the registration result, wherein the parameters contained in the functional parameter set are parameters corresponding to the part of the target line segment passing through the residual organ;
and determining the mapping data according to the function parameter set.
In one embodiment, the obtaining an outer contour image of the remaining organ according to the mapping data includes:
mapping the mapping data to the first point;
and acquiring the outer contour image of the residual organ according to the first point.
In one embodiment, the determining the mapping data according to the set of functional parameters includes:
determining a maximum value from the functional parameters contained in the functional parameter set, and taking the maximum value as the mapping data;
or,
determining an average value of the functional parameters contained in the functional parameter set, and taking the average value as the mapping data;
or,
and determining an integral value of the functional parameter contained in the functional parameter set, and using the integral value as the mapping data.
A data fusion apparatus comprising:
the registration module is used for registering the functional image of the target object and the anatomical image of the target object to obtain a registration result;
the processing module is used for acquiring a first target image and a second target image according to the anatomical image, wherein the second target image comprises blood vessels, and the first target image comprises residual organs;
a determining module, configured to determine mapping data of the functional parameter on an outer contour of a remaining organ included in the first target image; wherein the functional parameters are used for characterizing the activity condition of the residual organs in the registration result;
the outer contour image acquisition module is used for acquiring outer contour images of the residual organs according to the mapping data;
the simulation data acquisition module is used for acquiring simulation data according to the second target image, wherein the simulation data represents the distribution condition of preset parameters in the blood vessel;
and the fusion module is used for fusing the outer contour image and the simulation data.
A computer device comprising a memory storing a computer program and a processor implementing the steps of the method as described above when executing the computer program.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method as set forth above.
According to the data fusion method, the data fusion device, the computer equipment and the readable storage medium, a registration result is obtained by registering the functional image of the target object and the anatomical image of the target object, and the first target image and the second target image are obtained according to the anatomical image. Then, determining mapping data of functional parameters on the outer contour of the residual organ contained in the first target image, and acquiring an outer contour image of the residual organ according to the mapping data. And simultaneously, acquiring simulation data according to the second target image. And finally fusing the outer contour image and the simulation data. The data fusion method, the data fusion device, the computer equipment and the readable storage medium provided by the embodiment of the application can take the functional image and the anatomical image of the target object as input, obtain the outer contour image and the simulation data containing functional parameters, and fuse the outer contour image and the simulation data, so that the obtained image not only contains the functional parameters, but also contains the simulation data, a user can visually obtain the corresponding relation between a diseased blood vessel and the remaining organs dominated by the diseased blood vessel, the severity of a lesion can be evaluated from multiple angles, and the evaluation efficiency and effect are improved.
Drawings
FIG. 1 is a schematic diagram of an internal structure of a computer device according to an embodiment of the present application;
FIG. 2 is a schematic flow chart of a data fusion method according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating steps for acquiring simulation data according to the second target image according to an embodiment of the present application;
FIG. 4 is a flowchart illustrating steps of determining mapping data of functional parameters on the outer contour of the remaining organ included in the first target image according to an embodiment of the present application;
FIG. 5 is a flowchart illustrating the steps of obtaining an outer contour image of the remaining organ according to the mapping data according to an embodiment of the present application;
FIG. 6 is a flowchart illustrating steps of determining mapping data of functional parameters on the outer contour of the remaining organ included in the first target image according to an embodiment of the present application;
FIG. 7 is a flowchart illustrating the steps of obtaining an outer contour image of the remaining organ according to the mapping data according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a data fusion apparatus according to an embodiment of the present application.
Detailed Description
The data fusion method provided by the application can be applied to the computer device shown in fig. 1, and the computer device comprises a processor, a memory, a network interface and a database which are connected through a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing video files and the like in the embodiment of the application. The network interface of the computer device is used for communicating with an external terminal through a network connection. Optionally, the computer device may be a server, may be a PC, a personal digital assistant, other terminal devices such as a PAD, a mobile phone, and the like, or a cloud or a remote server, and the specific form of the computer device is not limited in the embodiment of the present application.
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions in the embodiments of the present application are further described in detail by the following embodiments in combination with the accompanying drawings. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not limiting of the application.
The data fusion method provided by the embodiment of the application can be applied to processing of image data in the medical field. The medical image fusion and processing of human or animal organs or tissues are mainly used for further reflecting the function condition of the organs or tissues, so that doctors are assisted to make more reasonable diagnosis.
Referring to fig. 2, an embodiment of the present application provides a data fusion method, including:
s10, registering the functional image of the target object and the anatomical image of the target object to obtain a registration result. Wherein the target object is included in the functional image and the anatomical image.
The target object refers to an organ or tissue whose function needs to be evaluated and understood. For example, the target object may be a heart, a brain, a liver, or the like.
The functional image is an image capable of reflecting the functional parameters of the target object from the microcirculation level. The acquisition of the functional images includes, but is not limited to, PET, SPET (single photon emission tomography), CT perfusion, MR perfusion, and the like. The functional image may be a 3D image. The number of the functional images may be 1, or may be multiple, that is, the functional image may be an image sequence representing a certain functional parameter of the target object.
The anatomical image is an image that can reflect the anatomical form of the target object from a morphological level. The acquisition of the anatomical image includes, but is not limited to, CT, MR, etc. The anatomical image may be a 3D image.
And registering the functional image containing the target object and the target object, wherein the registering method is not specifically limited in the application and can be selected according to actual requirements. The registration result obtained by registration comprises the functional parameters in the functional image and also comprises the anatomical morphology in the anatomical image, so that the morphological lesion and the functional lesion of the target object can be visually reflected.
S20, acquiring a first target image and a second target image according to the anatomical image. Wherein the second target image includes a blood vessel. The first target image includes a remaining organ therein. The vessels in the second target image are used to serve the remaining organs in the first target.
Specifically, the anatomical image is processed, and the target object in the anatomical image is segmented into the blood vessel and the remaining organ, so as to obtain the first target image and the second target image. The remaining organ refers to a portion of the target subject from which the blood vessel is removed. For example, the target object is a heart. And processing the anatomical image of the heart to obtain a heart chamber image and a coronary artery image, namely the first target image and the second target image.
S30, determining the mapping data of the functional parameters on the outer contour of the residual organ contained in the first target image. Wherein the functional parameters are used for characterizing the activity condition of the remaining organs in the registration result.
And taking the registration result and the first target image as input, and corresponding the functional parameters in the registration result to the outer contour of the residual organ in the first target image. The mapping data characterizes the correspondence of the functional parameters to the outer contours of the remaining organs. The registration result includes the functional parameter, and therefore the mapping data is obtained according to the registration result and the first target image.
And S40, acquiring the outer contour image of the residual organ according to the mapping data.
That is, the functional parameter is mapped to the outer contour image of the remaining organ according to the corresponding relationship between the functional parameter and the outer contour of the remaining organ, so that the outer contour of the remaining organ includes the functional parameter. The functional parameters can be intuitively obtained through the outer contour image.
And S50, acquiring simulated data according to the second target image, wherein the simulated data represent the distribution condition of preset parameters in the blood vessel.
And constructing a three-dimensional model of the blood vessel based on the anatomical image of the blood vessel, and simulating to obtain the distribution condition of preset parameters in the blood vessel. The preset parameter may be one or more of hemodynamic parameters. The simulated data can represent the condition of the blood vessel. The mode of obtaining the simulation data is not limited in the present application and can be selected according to actual requirements.
And S60, fusing the outline image and the simulation data.
Specifically, the outline image and the simulation data may be superimposed to form a fusion map. The method for fusion and superposition is not limited in the present application. The fusion graph comprises the functional parameters of the target object and also comprises the simulation data of the target object.
In this embodiment, a registration result is obtained by registering a functional image of a target object and an anatomical image of the target object, and a first target image and a second target image are obtained according to the anatomical image. Then, determining mapping data of functional parameters on the outer contour of the residual organ contained in the first target image, and acquiring an outer contour image of the residual organ according to the mapping data. And simultaneously, acquiring simulation data according to the second target image. And finally fusing the outer contour image and the simulation data. According to the method provided by the embodiment of the application, the functional image and the anatomical image of the target object are used as input, the outer contour image and the simulation data containing functional parameters are obtained, and the outer contour image and the simulation data are fused, so that the obtained image not only contains the functional parameters, but also contains the simulation data, a user can visually obtain the corresponding relation between a diseased blood vessel and the remaining organs dominated by the diseased blood vessel, the severity of a lesion can be evaluated from multiple angles, and the evaluation efficiency and effect are improved.
Referring to fig. 3, in one embodiment, S50 includes:
s510, constructing a second target simulation model according to the second target image;
s520, according to the second target simulation model, carrying out computational fluid dynamics simulation, and obtaining the simulation data.
And constructing a 3D solving model based on the second target image obtained by the vessel segmentation, namely the second target simulation model. And performing Computational Fluid Dynamics (CFD) simulation according to the second simulation model. And acquiring the distribution condition of the preset parameters in the blood vessel according to the simulation result. The preset parameters may include, but are not limited to, FFR (Fractional coronary Flow Reserve), wall shear stress (WWS), blood Flow pressure, blood Flow velocity, etc. Segmenting the anatomical image (such as a magnetic resonance contrast image) and acquiring a blood vessel result (such as a blood vessel mask), then constructing a mesh of the blood vessel according to the segmentation result to acquire the second target simulation model, determining the boundary conditions of the blood flow inlet and outlet according to the second target simulation model, and performing simulation on the blood flow of the blood vessel by calculating hydrodynamics to acquire a simulation result.
In this embodiment, a second target simulation model is constructed according to the second target image, and computational fluid dynamics simulation is performed according to the second target simulation model to obtain the simulation data. The method for acquiring the simulation data is simple and effective, and the speed and the accuracy of acquiring the simulation data are guaranteed.
Referring to fig. 4, in one embodiment, S30 includes:
S310A, determining a center point of the remaining organ;
S320A, obtaining the ray from the central point to the outer contour of the residual organ;
S330A, determining a functional parameter set according to the functional image and the ray included in the registration result, wherein the parameters included in the functional parameter set are parameters corresponding to the part of the ray passing through the residual organ;
S340A, determining the mapping data according to the function parameter set.
In the second target image, rays are emitted from a center point of the remaining organ to an outer contour of the remaining organ. And acquiring data points of functional parameters in the functional image, through which the ray passes, based on the corresponding relation between the residual organ in the second target image and the organ in the registration result image. The data points of the functional parameters are multiple, and the data points of the functional parameters are the functional parameter set. And calculating the functional parameter set to obtain the corresponding relation between the functional parameter data points and the residual organ outline, namely the mapping data.
By the method, rays are emitted to the directions of all points on the outer contour of the residual organ from the central point of the residual organ, and the mapping data of all functional parameters can be obtained. That is, the innumerable plurality of rays emitted from the center of the remaining organ to all directions cover all points of the outer contour of the remaining organ. Thus, all functional parameters in the functional image may be mapped.
Referring to fig. 5, in one embodiment, S40 includes:
S410A, determining the intersection point of the ray and the outer contour;
S420A, mapping the mapping data to the intersection;
S430A, acquiring the outline image of the residual organ according to the intersection point.
And according to the mapping data, mapping the data on the functional parameter data points to the intersection points of the rays and the outer contour, and completing the mapping of all the functional parameter data points by the method to obtain the outer contour image of the residual organ.
Referring to fig. 6, in an embodiment, S30 can also be implemented by the following steps, S30 includes:
s310, determining a central axis of the residual organ;
S320B, according to a first point on the outer contour, determining a second point closest to the first point on the central axis, wherein the first point is any point on the outer contour;
S330B, acquiring a target line segment connecting the first point and the second point;
S340B, determining a functional parameter set according to the functional image and the target line segment included in the registration result, where the parameters included in the functional parameter set are parameters corresponding to a portion of the target line segment passing through the remaining organ;
S340A, determining the mapping data according to the function parameter set.
And determining a central axis of the residual organ, and for a first point in the outer contour of the residual organ, finding a point on the central axis, which is closest to the first point, and determining the point as the second point. The first point and the second point form the target line segment. Functional parameter data points in the functional image through which the target line segment passes. The functional parameter data points in the functional image through which the target line segment passes are multiple, and a set of the multiple functional parameter data points is the functional parameter set. And calculating the functional parameter set to obtain the corresponding relation between the functional parameter data points and the residual organ outline, namely the mapping data.
And finding out the functional parameter data points corresponding to each point in the outer contour of the residual organ by the method, and obtaining the mapping data of each point. And mapping each point on the outer contour of the residual organ, so as to complete the mapping of all the functional parameters.
Referring to fig. 7, in one embodiment, S40 includes:
S410B, mapping the mapping data to the first point;
S420B, acquiring the outer contour image of the residual organ according to the first point.
According to the mapping data, mapping the data on the functional parameter data points to the outer contour points of the remaining organ corresponding thereto, i.e. to the first point. The first point is any point on the outer contour of the residual organ. Therefore, by the method, functional parameter data points corresponding to all the points can be mapped, and the outer contour image of the residual organ can be obtained.
The mapping data of the functional parameters on the outer contour of the residual organ contained in the first target image is determined through the embodiment, the outer contour image of the residual organ is obtained according to the mapping data, the functional parameters in the target object are also mapped to the outer contour of the target object, and therefore the internal functional parameters can be visually displayed through the outer contour of the target object. The method provided by the embodiment improves the intuitiveness of data display and improves the display effect.
In one embodiment, S340A includes:
s341, determining a maximum value from the functional parameters included in the functional parameter set, and using the maximum value as the mapping data; or,
s342, determining an average value of the functional parameters contained in the functional parameter set, and taking the average value as the mapping data; or,
s343, determining an integrated value of the function parameter included in the set of function parameters, and using the integrated value as the mapping data.
That is to say, in the functional parameter set, a plurality of functional parameter data points can be obtained through the functional image by a line between each ray and the intersection point of the outer contour of the remaining organ, and then, a maximum value, an average value or an integral value is calculated for the plurality of functional parameter data points, so as to obtain one data, and the data corresponds to the intersection points on the outer contour of the remaining organ one by one, so as to obtain the mapping data.
Similarly, the target line segment can also obtain \35764Begfunctional parameter data points through the functional image, and the data is obtained by performing maximum value or averaging or integral value calculation on the functional parameter data points, and is in one-to-one correspondence with the first points on the outer contours of the remaining organs, so that the mapping data is obtained.
In this embodiment, the maximum value, the average value, or the integral value is determined from the functional parameters included in the functional parameter set, and the maximum value, the average value, or the integral value is determined as the mapping data, so that the accuracy of data mapping is improved.
Referring to fig. 8, an embodiment of the present application provides a data fusion apparatus 10, where the data fusion apparatus 10 includes: a registration module 100, a processing module 200, a determination module 300, an outer contour image acquisition module 400, a simulation data acquisition module 500, and a fusion module 600. Wherein,
the registration module 100 is configured to register a functional image of a target object and an anatomical image of the target object to obtain a registration result;
the processing module 200 is configured to obtain a first target image and a second target image according to the anatomical image, where the second target image includes a blood vessel, and the first target image includes a remaining organ;
the determining module 300 is configured to determine mapping data of the functional parameter on the outer contour of the remaining organ included in the first target image; wherein the functional parameters are used for characterizing the activity condition of the residual organs in the registration result;
the outer contour image obtaining module 400 is configured to obtain an outer contour image of the remaining organ according to the mapping data;
the simulated data obtaining module 500 is configured to obtain simulated data according to the second target image, where the simulated data represents a distribution condition of a preset parameter in the blood vessel;
the fusion module 600 is configured to fuse the outer contour image and the simulation data.
In one embodiment, the simulation data acquisition module 500 includes a model building unit and a simulation unit. The model building unit is used for building a second target simulation model according to the second target image. And the simulation unit is used for carrying out computational fluid dynamics simulation according to the second target simulation model to obtain the simulation data.
In one embodiment, the determining module 300 includes: the device comprises a central point determining unit, a ray acquiring unit, a first function parameter determining unit and a mapping data determining unit. Wherein the central point determination unit is configured to determine a central point of the remaining organ. The ray acquisition unit is used for acquiring rays from the central point to the outer contour of the residual organ. The first functional parameter determining unit is configured to determine a functional parameter set according to the functional image and the ray included in the registration result, where the parameters included in the functional parameter set are parameters corresponding to a portion of the ray passing through the remaining organ. The mapping data determining unit is used for determining the mapping data according to the function parameter set.
In one embodiment, the outer contour image acquisition module 400 comprises an intersection point determination unit, a mapping unit and an image acquisition unit. Wherein the intersection point determining unit is configured to determine an intersection point of the ray and the outer contour. The mapping unit is configured to map the mapping data to the intersection point. The image acquisition unit is used for acquiring the outer contour image of the residual organ according to the intersection point.
In one embodiment, the determining module 300 further comprises: the device comprises a central axis determining unit, a second point determining unit, a target line segment acquiring unit and a second function parameter set determining unit. The central axis determining unit is used for determining the central axis of the residual organ. The second point determining unit is configured to determine a second point closest to the first point on the central axis according to the first point on the outer contour, where the first point is any point on the outer contour. The target line segment acquisition unit is used for acquiring a target line segment connecting the first point and the second point. The second functional parameter set determining unit is configured to determine a functional parameter set according to the functional image and the target line segment included in the registration result, where parameters included in the functional parameter set are parameters corresponding to a portion of the target line segment passing through the remaining organ.
In one embodiment, the outer contour image obtaining module 400 further comprises a first point mapping unit. The first point mapping unit is configured to map the mapping data to the first point. The image acquisition unit is further used for acquiring the outer contour image of the residual organ according to the first point.
In one embodiment, the mapping data determining unit is further configured to determine a maximum value from the functional parameters included in the set of functional parameters, and use the maximum value as the mapping data; or determining an average value of the functional parameters contained in the functional parameter set, and taking the average value as the mapping data; alternatively, an integrated value of the functional parameter included in the set of functional parameters is determined, and the integrated value is used as the mapping data.
For specific limitations of the data fusion device, reference may be made to the above limitations of the data fusion method, which are not described herein again. The various modules in the data fusion device may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
One embodiment of the present application provides a computer apparatus comprising a memory and a processor, the memory storing a computer program. The processor, when executing the computer program, implements the steps of:
registering the functional image of the target object and the anatomical image of the target object to obtain a registration result;
acquiring a first target image and a second target image according to the anatomical image, wherein the second target image comprises blood vessels, and the first target image comprises residual organs;
determining mapping data of functional parameters on the outer contour of the remaining organ contained in the first target image; wherein the functional parameters are used for characterizing the activity condition of the residual organs in the registration result;
acquiring an outer contour image of the residual organ according to the mapping data;
acquiring simulation data according to the second target image, wherein the simulation data represent the distribution condition of preset parameters in the blood vessel;
and fusing the outer contour image and the simulation data.
The implementation principle and technical effect of the computer device provided by the above embodiment are similar to those of the above method embodiment, and are not described herein again.
One embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. The computer program when executed by a processor implementing the steps of:
registering the functional image of the target object and the anatomical image of the target object to obtain a registration result;
acquiring a first target image and a second target image according to the anatomical image, wherein the second target image comprises blood vessels, and the first target image comprises residual organs;
determining mapping data of functional parameters on the outer contour of the remaining organ contained in the first target image; wherein the functional parameters are used for characterizing the activity condition of the residual organs in the registration result;
acquiring an outer contour image of the residual organ according to the mapping data;
acquiring simulation data according to the second target image, wherein the simulation data represent the distribution condition of preset parameters in the blood vessel;
and fusing the outer contour image and the simulation data.
The implementation principle and technical effect of the computer-readable storage medium provided by the above embodiments are similar to those of the above method embodiments, and are not described herein again.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A method of data fusion, comprising:
registering the functional image of the target object and the anatomical image of the target object to obtain a registration result;
acquiring a first target image and a second target image according to the anatomical image, wherein the second target image comprises blood vessels, and the first target image comprises residual organs;
determining mapping data of functional parameters on the outer contour of the remaining organ contained in the first target image; wherein the functional parameters are used for characterizing the activity condition of the residual organs in the registration result;
acquiring an outer contour image of the residual organ according to the mapping data;
acquiring simulation data according to the second target image, wherein the simulation data represent the distribution condition of preset parameters in the blood vessel;
and fusing the outer contour image and the simulation data.
2. The method of claim 1, wherein said acquiring simulated data from said second target image comprises:
constructing a second target simulation model according to the second target image;
and carrying out computational fluid dynamics simulation according to the second target simulation model to obtain the simulation data.
3. The method according to claim 1, wherein said determining mapping data of functional parameters on outer contours of remaining organs contained in said first target image comprises:
determining a center point of the remaining organ;
acquiring rays from the central point to the outer contour of the residual organ;
determining a functional parameter set according to the functional image and the ray included in the registration result, wherein the parameters included in the functional parameter set are parameters corresponding to the part of the ray passing through the residual organ;
and determining the mapping data according to the function parameter set.
4. The method of claim 3, wherein said obtaining an outer contour image of the remaining organ from the mapping data comprises:
determining an intersection point of the ray and the outer contour;
mapping the mapping data to the intersection point;
and acquiring the outer contour image of the residual organ according to the intersection point.
5. The method according to claim 1, wherein said determining mapping data of functional parameters on outer contours of remaining organs contained in said first target image comprises:
determining a central axis of the remaining organ;
determining a second point closest to the first point on the central axis according to the first point on the outer contour, wherein the first point is any point on the outer contour;
acquiring a target line segment connecting the first point and the second point;
determining a functional parameter set according to the functional image and the target line segment contained in the registration result, wherein the parameters contained in the functional parameter set are parameters corresponding to the part of the target line segment passing through the residual organ;
and determining the mapping data according to the function parameter set.
6. The method of claim 5, wherein said obtaining an outer contour image of the remaining organ from the mapping data comprises:
mapping the mapping data to the first point;
and acquiring the outer contour image of the residual organ according to the first point.
7. The method according to any one of claims 3 to 6, wherein determining the mapping data according to the set of functional parameters comprises:
determining a maximum value from the functional parameters contained in the functional parameter set, and taking the maximum value as the mapping data;
or,
determining an average value of the functional parameters contained in the functional parameter set, and taking the average value as the mapping data;
or,
and determining an integral value of the functional parameter contained in the functional parameter set, and using the integral value as the mapping data.
8. A data fusion apparatus, comprising:
the registration module is used for registering the functional image of the target object and the anatomical image of the target object to obtain a registration result;
the processing module is used for acquiring a first target image and a second target image according to the anatomical image, wherein the second target image comprises blood vessels, and the first target image comprises residual organs;
a determining module, configured to determine mapping data of the functional parameter on an outer contour of a remaining organ included in the first target image; wherein the functional parameters are used for characterizing the activity condition of the residual organs in the registration result;
the outer contour image acquisition module is used for acquiring outer contour images of the residual organs according to the mapping data;
the simulation data acquisition module is used for acquiring simulation data according to the second target image, wherein the simulation data represents the distribution condition of preset parameters in the blood vessel;
and the fusion module is used for fusing the outer contour image and the simulation data.
9. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor when executing the computer program implements the steps of the method of any of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811640984.4A CN109767432B (en) | 2018-12-29 | 2018-12-29 | Data fusion method and device, computer equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811640984.4A CN109767432B (en) | 2018-12-29 | 2018-12-29 | Data fusion method and device, computer equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109767432A true CN109767432A (en) | 2019-05-17 |
| CN109767432B CN109767432B (en) | 2021-03-16 |
Family
ID=66453114
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811640984.4A Active CN109767432B (en) | 2018-12-29 | 2018-12-29 | Data fusion method and device, computer equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109767432B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1973297A (en) * | 2004-05-14 | 2007-05-30 | 皇家飞利浦电子股份有限公司 | Information enhanced image guided interventions |
| CN101011617A (en) * | 2006-12-29 | 2007-08-08 | 成都川大奇林科技有限责任公司 | Method for determining radiating field output dose accurately in conformalradiotherapy |
| WO2008144539A1 (en) * | 2007-05-17 | 2008-11-27 | Yeda Research & Development Co. Ltd. | Method and apparatus for computer-aided diagnosis of cancer and product |
| DE102007052123A1 (en) * | 2007-10-31 | 2009-05-14 | Siemens Ag | Fusion image producing method, involves making registration of two-dimensional and three-dimensional image acquisition together in dependence of center line determined for acquisitions in context of production of fusion image |
| CN103298406A (en) * | 2011-01-06 | 2013-09-11 | 美国医软科技公司 | System and method for treatment planning of organ disease at the functional and anatomical levels |
| CN104978725A (en) * | 2014-04-03 | 2015-10-14 | 上海联影医疗科技有限公司 | Method and device for dividing coronary artery |
| CN107665497A (en) * | 2016-07-29 | 2018-02-06 | 上海联影医疗科技有限公司 | In a kind of medical image calculate ambition than method |
| CN108053428A (en) * | 2017-12-28 | 2018-05-18 | 上海联影医疗科技有限公司 | A kind of method for registering of medical image, device and equipment |
| CN108765277A (en) * | 2018-06-04 | 2018-11-06 | 上海联影医疗科技有限公司 | Image split-joint method, device, computer equipment and storage medium |
-
2018
- 2018-12-29 CN CN201811640984.4A patent/CN109767432B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1973297A (en) * | 2004-05-14 | 2007-05-30 | 皇家飞利浦电子股份有限公司 | Information enhanced image guided interventions |
| CN101011617A (en) * | 2006-12-29 | 2007-08-08 | 成都川大奇林科技有限责任公司 | Method for determining radiating field output dose accurately in conformalradiotherapy |
| WO2008144539A1 (en) * | 2007-05-17 | 2008-11-27 | Yeda Research & Development Co. Ltd. | Method and apparatus for computer-aided diagnosis of cancer and product |
| DE102007052123A1 (en) * | 2007-10-31 | 2009-05-14 | Siemens Ag | Fusion image producing method, involves making registration of two-dimensional and three-dimensional image acquisition together in dependence of center line determined for acquisitions in context of production of fusion image |
| CN103298406A (en) * | 2011-01-06 | 2013-09-11 | 美国医软科技公司 | System and method for treatment planning of organ disease at the functional and anatomical levels |
| CN104978725A (en) * | 2014-04-03 | 2015-10-14 | 上海联影医疗科技有限公司 | Method and device for dividing coronary artery |
| CN107665497A (en) * | 2016-07-29 | 2018-02-06 | 上海联影医疗科技有限公司 | In a kind of medical image calculate ambition than method |
| CN108053428A (en) * | 2017-12-28 | 2018-05-18 | 上海联影医疗科技有限公司 | A kind of method for registering of medical image, device and equipment |
| CN108765277A (en) * | 2018-06-04 | 2018-11-06 | 上海联影医疗科技有限公司 | Image split-joint method, device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109767432B (en) | 2021-03-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230233261A1 (en) | Systems and methods for an interactive tool for determining and visualizing a functional relationship between a vascular network and perfused tissue | |
| US9323887B2 (en) | Device and computed tomography scanner for determining and visualizing the perfusion of the myocardial muscle | |
| US10147190B2 (en) | Generation of a patient-specific anatomical atlas | |
| CN104346821B (en) | Automatic planning for medical imaging | |
| JP2022167972A (en) | Medical image processing method, medical image processing device, medical image processing system, and medical image processing program | |
| CN106164981B (en) | It is the method and system of surgical instrument insertion display timing signal in surgical operation | |
| WO2018133098A1 (en) | Vascular wall stress-strain state acquisition method and system | |
| CN111652849B (en) | Blood flow parameter calculation result obtaining method, device, equipment and system | |
| CN106510893B (en) | Data driven framework for optimizing artificial organ printing and stent selection for regenerative medicine | |
| CN111353524B (en) | System and method for locating patient features | |
| JP2008538970A (en) | Multi-surface modeling | |
| RU2719951C2 (en) | Anatomical structure modeling by finite element method | |
| JP2020508709A (en) | Stress prediction and stress evaluation for device insertion into deformable objects | |
| CN105225257A (en) | For the method for visualizing of the human skeleton from medical scanning | |
| CN111340934A (en) | Method and computer system for generating a combined tissue-vessel representation | |
| CN109767432B (en) | Data fusion method and device, computer equipment and readable storage medium | |
| CN114066802A (en) | Method, device and system for determining abnormalities in myocardial region | |
| CN107392976A (en) | Data processing method, device and equipment | |
| US20220108525A1 (en) | Patient-specific cortical surface tessellation into dipole patches | |
| JP3836487B2 (en) | MODELING APPARATUS, PROGRAM, COMPUTER-READABLE RECORDING MEDIUM, ASSEMBLY METHOD, AND MODELING METHOD | |
| KR20140120236A (en) | Integrated analysis method of matching myocardial and cardiovascular anatomy informations | |
| US11166689B1 (en) | Providing a dynamic mask image | |
| CN116649995B (en) | Method and device for acquiring hemodynamic parameters based on intracranial medical image | |
| CN109859182B (en) | Medical image mismatch detection method and device, computer equipment and storage medium | |
| RU2684760C1 (en) | Method and system for pre-operative modeling of medical procedure |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 201807 Shanghai City, north of the city of Jiading District Road No. 2258 Applicant after: Shanghai Lianying Medical Technology Co., Ltd Address before: 201807 Shanghai City, north of the city of Jiading District Road No. 2258 Applicant before: SHANGHAI UNITED IMAGING HEALTHCARE Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| CB03 | Change of inventor or designer information |
Inventor after: Ren Yuan Inventor after: Lu Guangming Inventor after: Zhang Longjiang Inventor after: Wang Hongjian Inventor after: Zhao Xi Inventor before: Ren Yuan Inventor before: Wang Hongjian Inventor before: Zhao Xi |
|
| CB03 | Change of inventor or designer information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |