CN108926359B - Space compound imaging method, device and equipment - Google Patents
Space compound imaging method, device and equipment Download PDFInfo
- Publication number
- CN108926359B CN108926359B CN201810505905.2A CN201810505905A CN108926359B CN 108926359 B CN108926359 B CN 108926359B CN 201810505905 A CN201810505905 A CN 201810505905A CN 108926359 B CN108926359 B CN 108926359B
- Authority
- CN
- China
- Prior art keywords
- frame
- image
- weight
- determining
- component
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10132—Ultrasound image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Abstract
The invention discloses a space compound imaging method, a device and equipment, wherein the method comprises the following steps: acquiring multi-frame component images of a detected body, wherein each frame of component image corresponds to one frame of ultrasonic image with a preset scanning deflection angle; determining a first included angle between the integral gradient direction of the initial scanning image and the axial direction of the ultrasonic transmitting probe when the preset deflection angle is 0 degrees; determining the interframe weight of each frame of the component image according to the approximation degree of the preset scanning deflection angle of the multi-frame component image and the first included angle; and performing spatial composite imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial composite image. The invention can set the composite ratio of each frame of image in a targeted manner, improves the rationality of setting the inter-frame weight, further can meet the use habits of diversified application scenes and operators, and improves the reference value of the obtained space composite image.
Description
Technical Field
The invention relates to the technical field of medical image processing, in particular to a space compound imaging method, a device and equipment.
Background
The spatial compounding technology is an imaging method for scanning a scanning object from different scanning deflection angles to obtain component images of different scanning deflection angles, and then superposing the component images according to corresponding inter-frame weights to form a frame image. In the existing technical solution of spatial compound imaging, the same inter-frame weight is usually applied to two frames of images with the scanning angle deflected to the left or right by the same angle (e.g., +15 ° and-15 °), that is, the compound image has symmetry.
However, medical ultrasound imaging images generally do not have bilateral symmetry, and component images at different scanning deflection angles are spatially compounded by using interframe weights with symmetry, so that the compounding ratio of each frame of component image cannot be set in a targeted manner, and the final compound imaging effect can be affected.
Disclosure of Invention
In view of the above, the present invention provides a spatial compound imaging method, apparatus and device to solve the above technical problems.
In order to achieve the purpose, the technical scheme adopted by the invention is as follows:
according to a first aspect of the embodiments of the present invention, there is provided a spatial compound imaging method, including:
acquiring multi-frame component images of a detected body, wherein each frame of component image corresponds to one frame of ultrasonic image with a preset scanning deflection angle;
determining a first included angle between the integral gradient direction of the initial scanning image and the axial direction of the ultrasonic transmitting probe when the preset deflection angle is 0 degrees;
determining the interframe weight of each frame of the component image according to the approximation degree of the preset scanning deflection angle of the multi-frame component image and the first included angle;
and performing spatial composite imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial composite image.
In an embodiment, the approximating the first included angle according to the preset scanning deflection angle of the multi-frame component image comprises:
calculating the absolute value of the difference value between the preset scanning deflection angle of each frame of the component image and the first included angle;
and determining the approximation degree of the scanning deflection angle of the component image and the first included angle according to the absolute value of the difference value between the scanning deflection angle of each frame of the component image and the first included angle.
In an embodiment, the determining the inter-frame weight of each frame of the component image according to the approximation degree of the preset scanning deflection angle of the multiple frames of the component images and the first included angle includes:
determining the distribution weight size proportion of the component images of each frame according to the approximation degree;
determining an inter-frame weight for each frame of the component image based on the assigned weight size ratio.
In an embodiment, the determining the distribution weight size ratio of the component images of each frame according to the approximation degree comprises:
determining the distribution weight score of the component image of each frame according to the approximation degree;
and determining the distribution weight size proportion of the component images of each frame according to the ratio of the distribution weight score of the component images of each frame to the sum of the distribution weight scores of the component images of the plurality of frames.
In one embodiment, the determining inter-frame weights for each frame of the component image based on the assigned weight size ratio comprises:
determining an allocation weight lowest share and an allocation weight total share of the component image for each frame, the allocation weight lowest share and the allocation weight total share satisfying a relationship shown in the following formula (1):
Psum+Pmin×NF＝1 (1)；
wherein, PsumTo assign a total share of weight, PminTo assign the weight lowest share, NFThe number of component images;
determining the distribution weight share of the component image of each frame according to the distribution weight size proportion and the total distribution weight share;
and determining the inter-frame weight of each frame of the component image according to the sum of the distribution weight share of each frame of the component image and the lowest share of the distribution weight.
In one embodiment, the spatially compound imaging the multiple frames of component images based on the inter-frame weights of the component images of the frames includes:
dividing a composite imaging area formed by the multi-frame component images based on the image edge lines of the multi-frame component images to obtain a plurality of composite imaging sub-areas;
determining a component image corresponding to each composite imaging subregion;
and determining the pixel value of the corresponding pixel point position in each composite imaging subregion according to the inter-frame weight of the assembly image corresponding to the composite imaging subregion and the pixel value of each pixel point position in the assembly image.
In an embodiment, after obtaining the spatial composite image, the method further includes:
determining a second included angle between the overall gradient direction of the space composite image and the overall gradient direction of the initial scanning image;
and if the second included angle is larger than or equal to a preset threshold value, acquiring the multi-frame assembly image of the detected body again.
In one embodiment, the method further comprises determining the overall gradient direction of a target image, the target image being the initial scan image or the spatially compounded image, according to the following steps:
determining a gradient direction vector of each pixel point in the target image;
and summing the gradient direction vectors of all the pixel points to obtain the overall gradient direction of the target image.
In an embodiment, the subject includes a carotid artery.
According to a second aspect of the embodiments of the present invention, there is provided a spatial composite imaging apparatus including:
the device comprises an assembly image acquisition module, a deflection angle detection module and a deflection angle detection module, wherein the assembly image acquisition module is used for acquiring a plurality of frames of assembly images of a detected body, and each frame of assembly image corresponds to one frame of ultrasonic image with a preset scanning deflection angle;
the first included angle determining module is used for determining a first included angle between the overall gradient direction of the initial scanning image and the axial direction of the ultrasonic transmitting probe when the preset deflection angle is 0 degree;
the inter-frame weight determining module is used for determining the inter-frame weight of each frame of the component images according to the approximation degree of the preset scanning deflection angle of the multi-frame component images and the first included angle;
and the spatial composite imaging module is used for carrying out spatial composite imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial composite image.
In one embodiment, the apparatus further comprises: an approximation degree determination module;
the approximation degree determining module comprises:
the angle difference value calculating unit is used for calculating the absolute value of the difference value between the preset scanning deflection angle of each frame of the component image and the first included angle;
and the approximation degree determining unit is used for determining the approximation degree of the scanning deflection angle of the component image and the first included angle according to the absolute value of the difference value between the scanning deflection angle of each frame of the component image and the first included angle.
In one embodiment, the inter-frame weight determination module includes:
a weight proportion determining unit, configured to determine, according to the approximation degree, a distribution weight size proportion of the component images of each frame;
and the inter-frame weight determining unit is used for determining the inter-frame weight of the component images of each frame based on the distribution weight size proportion.
In an embodiment, the weight ratio determination unit is further configured to:
determining the distribution weight score of the component image of each frame according to the approximation degree;
and determining the distribution weight size proportion of the component images of each frame according to the ratio of the distribution weight score of the component images of each frame to the sum of the distribution weight scores of the component images of the plurality of frames.
In an embodiment, the inter-frame weight determination unit is further configured to:
determining an allocation weight lowest share and an allocation weight total share of the component image for each frame, the allocation weight lowest share and the allocation weight total share satisfying a relationship shown in the following formula (1):
Psum+Pmin×NF＝1 (1)；
wherein, PsumTo assign a total share of weight, PminTo assign the weight lowest share, NFThe number of component images;
determining the distribution weight share of the component image of each frame according to the distribution weight size proportion and the total distribution weight share;
and determining the inter-frame weight of each frame of the component image according to the sum of the distribution weight share of each frame of the component image and the lowest share of the distribution weight.
In one embodiment, the spatial compound imaging module includes:
the imaging area dividing unit is used for dividing a composite imaging area formed by the multi-frame component images based on the image edge lines of the multi-frame component images to obtain a plurality of composite imaging sub-areas;
the component image determining unit is used for determining component images corresponding to the composite imaging sub-regions;
and the pixel value determining unit is used for determining the pixel value of the corresponding pixel point position in each composite imaging subregion according to the inter-frame weight of the assembly image corresponding to the composite imaging subregion and the pixel value of each pixel point position in the assembly image.
In one embodiment, the apparatus further comprises: the second included angle determining module is used for determining a second included angle between the overall gradient direction of the space composite image and the overall gradient direction of the initial scanning image;
the component image acquisition module is further configured to reacquire the multi-frame component images of the subject when the second included angle is greater than or equal to a preset threshold.
In an embodiment, the subject includes a carotid artery.
According to a third aspect of embodiments of the present invention, there is provided a spatial composite imaging apparatus including:
a processor;
a memory configured to store processor-executable instructions;
wherein the processor is configured to:
acquiring multi-frame component images of a detected body, wherein each frame of component image corresponds to one frame of ultrasonic image with a preset scanning deflection angle;
determining a first included angle between the integral gradient direction of the initial scanning image and the axial direction of the ultrasonic transmitting probe when the preset deflection angle is 0 degrees;
determining the interframe weight of each frame of the component image according to the approximation degree of the preset scanning deflection angle of the multi-frame component image and the first included angle;
and performing spatial composite imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial composite image.
According to a fourth aspect of the embodiments of the present invention, a machine-readable storage medium is provided, on which computer instructions are stored, and when executed, the computer instructions perform the following processes:
acquiring multi-frame component images of a detected body, wherein each frame of component image corresponds to one frame of ultrasonic image with a preset scanning deflection angle;
determining a first included angle between the integral gradient direction of the initial scanning image and the axial direction of the ultrasonic transmitting probe when the preset deflection angle is 0 degrees;
determining the interframe weight of each frame of the component image according to the approximation degree of the preset scanning deflection angle of the multi-frame component image and the first included angle;
and performing spatial composite imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial composite image.
From the above description, the spatial compound imaging method, apparatus and device disclosed by the present invention can obtain the multi-frame component image of the object, determining a first included angle between the integral gradient direction of an initial scanning image and the axial direction of the ultrasonic transmitting probe when the preset deflection angle is 0 degree, determining the interframe weight of each frame of the component image according to the approximate degree of the preset scanning deflection angle of the multi-frame component image and the first included angle, and then the multi-frame component images are subjected to space compound imaging based on the inter-frame weight of each frame of the component images to obtain a space compound image, the composite ratio of each frame of image can be set in a targeted manner, the rationality of setting the inter-frame weight is improved, and further, the use habits of diversified application scenes and operators can be met, and the reference value of the obtained space composite image is improved.
Drawings
FIG. 1A shows a flow diagram of a method of spatial compound imaging according to an exemplary embodiment of the present invention;
FIG. 1B shows a schematic diagram of a spatially compounded component image in accordance with an exemplary embodiment of the present invention;
FIG. 2 shows a flow chart of a method of spatial compound imaging according to a further exemplary embodiment of the present invention;
FIG. 3 illustrates a flow chart of how inter-frame weights for frame component images are determined according to an exemplary embodiment of the present invention;
FIG. 4 shows a flowchart of how to determine the assigned weight size ratio of the component images for each frame based on the degree of approximation, according to an example embodiment of the present invention;
FIG. 5 illustrates a flow diagram of how inter-frame weights for frame component images are determined based on assigning weight size ratios according to an exemplary embodiment of the present invention;
FIG. 6A shows a flow diagram of how multiple frame component images are spatially compounded based on inter-frame weights of the frame component images according to an example embodiment of the present invention;
FIG. 6B shows a schematic diagram of the division of a composite imaging subregion in accordance with an exemplary embodiment of the present invention;
FIG. 6C is a schematic diagram illustrating region division of a pixel according to an exemplary embodiment of the present invention;
FIG. 7 shows a flow chart of a method of spatial compound imaging according to a further exemplary embodiment of the present invention;
fig. 8 is a block diagram illustrating a structure of a spatial complex imaging apparatus according to an exemplary embodiment of the present invention;
fig. 9 is a block diagram illustrating a structure of a spatial complex imaging apparatus according to still another exemplary embodiment of the present invention;
fig. 10 shows a block diagram of a spatial complex imaging apparatus according to an exemplary embodiment of the present invention.
Detailed Description
The present invention will be described in detail below with reference to specific embodiments shown in the drawings. These embodiments do not limit the present invention, and structural, methodological, or functional changes made by those skilled in the art according to these embodiments are included in the scope of the present invention.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It will be understood that, although the terms first, second, etc. may be used herein to describe various structures, these structures should not be limited by these terms. These terms are only used to distinguish one type of structure from another.
FIG. 1A shows a flow diagram of a method of spatial compound imaging according to an exemplary embodiment of the present invention; FIG. 1B shows a schematic diagram of a spatially compounded component image in accordance with an exemplary embodiment of the present invention. As shown in fig. 1A, the method comprises the following steps S101-S104:
s101: acquiring a plurality of frames of component images of the detected body, wherein each frame of component image corresponds to one frame of ultrasonic image with a preset scanning deflection angle.
In one embodiment, the subject includes a carotid artery, which is the main blood vessel from the heart to the brain and other parts of the head, behind the sternoclavicular joint and up the organs and around the larynx. The carotid artery blood vessel is inspected by ultrasonic, such as the items of running of the blood vessel, whether the lumen is expanded or narrowed, intima thickness, echo, hemodynamics and the like, and the method is favorable for providing a basis for subsequent detection of diseases such as carotid atherosclerosis, vertebral artery stenosis occlusion, arteritis, carotid embolism, thrombus and the like.
As shown in fig. 1B, the multi-frame assembly image of the subject may be an ultrasound image obtained after the ultrasound transmission probe 100 performs ultrasound scanning on the subject at a plurality of different scanning deflection angles, wherein the plurality of different scanning deflection angles may be 0 °, 7.5 °, -7.5 °, 15 °, and-15 °, respectively. After the ultrasonic images of the plurality of different scanning deflection angles are obtained, the ultrasonic image of each scanning deflection angle can be determined as a Frame of component image for spatial compounding, and a component image Frame0 of 0 degree, a component image Frame1 of 7.5 degrees, a component image Frame2 of-7.5 degrees, a component image Frame3 of 15 degrees and a component image Frame4 of-15 degrees are obtained.
It should be noted that in fig. 1B, the size of the image and the angle may be exaggerated for clarity of illustration.
S102: determining a first included angle between the integral gradient direction of the initial scanning image and the axial direction of the ultrasonic transmitting probe when the preset deflection angle is 0 degrees;
in one embodiment, before the spatial multiplexing function is turned on, the deflection angle of the ultrasonic transmission probe is 0 °, and the initial scan image of the subject can be acquired.
In one embodiment, after an initial scan image of the subject is obtained, the overall gradient direction of the image may be calculated. For example, the method for calculating the overall gradient direction of the image may include: and determining the gradient direction vector of each pixel point in the image, and then summing the gradient direction vectors of each pixel point to obtain the overall gradient direction of the image, such as a vector a.
In one embodiment, the axial direction of the ultrasound transmission probe, such as the vector b, at the preset deflection angle of 0 ° may be detected by the direction sensor.
In one embodiment, after determining the overall gradient direction of the initial scan image and the axial direction of the ultrasound transmission probe when the preset deflection angle is 0 °, a first included angle between the overall gradient direction of the initial scan image and the axial direction of the ultrasound transmission probe can be calculated. For example, the first angle between vector a and vector b is Anglecurrent, which is cos Anglecurrent ═ a b/| a | | | b |, and Anglecurrent | | arccos (a |/b/| a | | | b |).
S103: and determining the interframe weight of each frame of the component image according to the approximation degree of the preset scanning deflection angle of the multi-frame component image and the first included angle.
In an embodiment, after the first included angle is obtained, the approximation degree of the preset scanning deflection angle of the multiple frames of component images and the first included angle may be respectively calculated, and the inter-frame weight of each frame of the component images is determined according to the calculation result of the approximation degree.
For example, if the approximation degrees of the preset scan deflection angle and the first included angle of the multi-Frame component images are sorted from high to low to obtain Frame0> Frame1> Frame3> Frame2> Frame4, a greater weight may be set for a component image with a higher approximation degree of the preset scan deflection angle and the first included angle in an aggregate clinical practical application scenario (for example, it is desirable to reduce an ultrasound dropout phenomenon of the image), for example, the inter-Frame weights are respectively set for Frame0, Frame1, Frame3, Frame2, and Frame 4: 35%, 30%, 20%, 10%, 5%.
In an embodiment, the manner of calculating the approximation degree of the preset scan deflection angle of the multi-frame module image to the first included angle can also be referred to the following embodiment shown in fig. 3, which will not be described in detail herein.
S104: and performing spatial composite imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial composite image.
In an embodiment, after determining the inter-frame weight of each frame of the component image, the multi-frame component image may be subjected to spatial compound imaging based on the inter-frame weight of each frame of the component image, so as to obtain a spatial compound image.
In an embodiment, the above-mentioned manner of performing spatial compound imaging on the multi-frame component images can also be referred to the following embodiment shown in fig. 6A, and will not be described in detail herein.
As can be seen from the above description, in this embodiment, by obtaining a multi-frame component image of a subject, determining a first included angle between the overall gradient direction of an initial scan image and the axial direction of an ultrasound emission probe when a preset deflection angle is 0 °, then determining inter-frame weight of each frame of the component image according to the approximation degree between the preset scan deflection angle of the multi-frame component image and the first included angle, and further performing spatial composite imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial composite image, because the inter-frame weight of each frame of the component image is calculated based on the approximation degree between the scan deflection angle of each frame of the component image and the first included angle, the composite ratio of each frame of the image can be set in a targeted manner, the rationality for setting inter-frame weight is improved, and further the use habits of diversified application scenes and operators can be satisfied, and the reference value of the obtained space composite image is improved.
Fig. 2 shows a flow chart of a method of spatial compound imaging according to a further exemplary embodiment of the present invention. As shown in fig. 2, the method comprises the following steps S201-S206:
s201: acquiring multi-frame component images of a detected body, wherein each frame of component image corresponds to one frame of ultrasonic image with a preset scanning deflection angle;
s202: determining a first included angle between the integral gradient direction of the initial scanning image and the axial direction of the ultrasonic transmitting probe when the preset deflection angle is 0 degrees;
s203: calculating the absolute value of the difference value between the preset scanning deflection angle of each frame of the component image and the first included angle;
s204: determining the approximation degree of the scanning deflection angle of each frame of component image and the first included angle according to the absolute value of the difference value between the scanning deflection angle of each frame of component image and the first included angle;
s205: determining the interframe weight of each frame of the component image according to the approximation degree of the preset scanning deflection angle of the multi-frame component image and the first included angle;
s206: performing spatial compound imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial compound image
For the explanation and description of steps S201 to S202 and S205 to S206, reference may be made to the above embodiments, which are not repeated herein.
In step S203, if the calculated included Angle between the overall gradient direction of the image and the axial direction of the ultrasound emission under the non-deflection condition is obtainedcurrentThe deflection angles SCIAngle0, SCIAngle1, SCIAngle2, SCIAngle3, and Angle of the component images Frame0, Frame1, Frame2, and Frame3 can be determined at 6 °, respectivelycurrentOf the absolute value of the difference of, wherein SCIAngle0＝0°，SCIAngle1＝7.5°，SCIAngle2＝-7.5°，SCIAngle315 °, the magnitude relation of the absolute value of the difference is:
|SCIAngle1-Anglecurrent|＜|SCIAngle0-Anglecurrent|＜|SCIAngle3-Anglecurrent|＜|SCIAngle2-Anglecurrent|。
in step S204, after determining an absolute value of a difference between the scan deflection angle of each frame of the component image and the first included angle, the absolute value of the difference may be determined as an approximation degree of the scan deflection angle of the corresponding component image and the first included angle.
It should be noted that, the smaller the absolute value of the difference between the scanning deflection angle of each frame of component image and the first included angle is, the greater the approximation degree between the scanning deflection angle of the component image and the first included angle is, and thus the magnitude relation between the scanning deflection angle of each frame of component image and the approximation degree of the first included angle can be determined as follows: frame1> Frame0> Frame3> Frame 2.
As can be seen from the above description, in this embodiment, by calculating an absolute value of a difference between a preset scanning deflection angle of each frame of the component image and the first included angle, and determining an approximation degree of the scanning deflection angle of the component image and the first included angle according to the absolute value of the difference between the scanning deflection angle of each frame of the component image and the first included angle, the approximation degree of the scanning deflection angle of each component image and the first included angle can be accurately determined, and then, an inter-frame weight of each frame of the component image can be determined according to the approximation degree, so as to provide a basis for performing spatial composite imaging on a plurality of frame component images according to the inter-frame weight of each component image in the following process.
FIG. 3 illustrates a flow chart of how inter-frame weights for frame component images are determined according to an exemplary embodiment of the present invention; the present embodiment is exemplified by how to determine the inter-frame weight of each frame component image on the basis of the above-described embodiments. As shown in fig. 3, the determining the inter-frame weight of each frame of the component image according to the approximation degree of the preset scan deflection angle of the multiple frames of the component images and the first included angle in step S103 may include the following steps S301 to S302:
s301: determining the distribution weight size proportion of the component images of each frame according to the approximation degree;
s302: determining an inter-frame weight for each frame of the component image based on the assigned weight size ratio.
In an embodiment, after determining the degree of approximation between the preset deflection angle and the first included angle of each frame of component image, the distribution weight size ratio may be determined according to the degree of approximation corresponding to each component image.
For example, if the magnitude relationship between the scanning deflection angle of each frame of component image and the approximation degree of the first included angle is: frame1> Frame0> Frame3> Frame 2;
the assigned weight size ratios may be determined according to the magnitude of the degree of approximation corresponding to each component image, for example, the assigned weight size ratios of the component images Frame1, Frame0, Frame3, and Frame2 are determined to be 39.78%, 25.87%, 22.39%, and 11.96%, respectively.
In one embodiment, the assigned weight size ratio of each Frame component image may be determined as the inter-Frame weight of the component image of each Frame, i.e., the inter-Frame weights of the component images Frame1, Frame0, Frame3 and Frame2 are 39.78%, 25.87%, 22.39% and 11.96%, respectively.
As can be seen from the above description, in this embodiment, the distribution weight size ratio of the component images of each frame is determined according to the approximation degree, and the inter-frame weight of the component images of each frame is determined based on the distribution weight size ratio, so that the inter-frame weight of the component images of each frame can be accurately determined, and a basis is provided for performing spatial compound imaging on multiple frame component images according to the inter-frame weight of each component image.
FIG. 4 shows a flowchart of how to determine the assigned weight size ratio of the component images for each frame based on the degree of approximation, according to an example embodiment of the present invention; the present embodiment is exemplified by how to determine the distribution weight size ratio of the component images of each frame according to the degree of approximation on the basis of the above-described embodiments. As shown in fig. 4, the determining the distribution weight size ratio of the component images of each frame according to the approximation degree in step S301 may include the following steps S401 to S403:
s401: determining the distribution weight score of the component image of each frame according to the approximation degree;
s402: and determining the distribution weight size proportion of the component images of each frame according to the ratio of the distribution weight score of the component images of each frame to the sum of the distribution weight scores of the component images of the plurality of frames.
In an embodiment, after determining the approximation degree of the preset deflection angle and the first included angle of each frame of component image, the inter-frame weight score of each frame of component image may be determined according to the approximation degree, for example, if the magnitude relation between the scanning deflection angle and the approximation degree of the first included angle of each frame of component image is: frame1>Frame0>Frame3>Frame 2; then sorting is carried out according to the magnitude of the inter-Frame weight of each component image, and a sequence is determined for each Frame image, namely, the Frame1 is the first sequence, the Frame0 is the second sequence, the Frame3 is the third sequence, and the Frame4Frame2 is the fourth sequence. On the basis, the inter-Frame weight score S of the first-order component image Frame1 can be assigned110, the inter-Frame weight score S of the second-order component image Frame02Let the interframe weight score S of the third-order component image Frame3 be 63Let the fourth-order component image Frame2 have an inter-Frame weight score S of 54＝2。
It should be noted that the specific value of the inter-frame weight score only needs to satisfy the magnitude relationship, and the specific value may be freely set by a developer as needed, which is not limited in this embodiment.
In one embodiment, after determining the distribution weight score of each frame of component image, the distribution weight size ratio of each frame of component image may be determined according to the ratio of the distribution weight score of each frame of component image to the sum of the distribution weight scores of the plurality of frames of component images.
For example, if the inter-Frame weight score S of the first-order component image Frame1 is assigned110, the inter-Frame weight score S of the second-order component image Frame02Let the interframe weight score S of the third-order component image Frame3 be 63Let the fourth-order component image Frame2 have an inter-Frame weight score S of 54Then, the assigned weight size ratio of each frame component image may be determined according to the following equation (1):
wherein, PiAssigning a weight size ratio, S, to the ith component imageiAssigning a weight score, N, to the ith-ordered component imageFIs the number of component images.
That is, it can be determined that the assigned weight size ratios of the Frame1, the Frame0, the Frame3, and the Frame2 are: 10/(10+6+5+2) 43.48%, 6/(10+6+5+2) 26.08%, 5/(10+6+5+2) 21.74%, and 2/(10+6+5+2) 8.60%.
As can be seen from the above description, in this embodiment, the distribution weight score of the component image of each frame is determined according to the approximation degree, and the distribution weight size ratio of the component image of each frame is determined according to the ratio of the distribution weight score of the component image of each frame to the total distribution weight score of the component images of multiple frames, so that the distribution weight size ratio of the component image of each frame can be accurately determined, and further, the interframe weight improvement basis of the component image of each frame is accurately determined in the following, the rationality of setting interframe weight is improved, and the reference value of the obtained spatial composite image is improved.
FIG. 5 illustrates a flow diagram of how inter-frame weights for frame component images are determined based on assigning weight size ratios according to an exemplary embodiment of the present invention; the present embodiment is exemplified by how to determine the inter-frame weight of each frame component image based on the assigned weight size ratio on the basis of the above-described embodiments. As shown in fig. 5, the determining the inter-frame weight of the component image for each frame based on the assigned weight size ratio in step S302 may include the following steps S501 to S503:
s501: and determining the lowest share of the distribution weight and the total share of the distribution weight of the component images of each frame.
S502: determining the distribution weight share of the component image of each frame according to the distribution weight size proportion and the total distribution weight share;
s503: and determining the inter-frame weight of each frame of the component image according to the sum of the distribution weight share of each frame of the component image and the lowest share of the distribution weight.
In an embodiment, in order to enable the allocation of the inter-frame weights to be both differential and uniform, the minimum share of the allocation weights and the total share of the allocation weights of the component images of each frame may be determined by a developer according to actual needs. Wherein, the weight lowest share is assigned as a weight share that will be assigned even if the weight score of a certain frame component image is 0; and assigning a total share of the weight, i.e., a share obtained by subtracting the lowest share of each frame component image from the unit 1, to be assigned according to the weight score. In one embodiment, the allocation weight lowest share and the allocation weight total satisfy a relationship shown in the following equation (2):
Psum+Pmin×NF＝1 (2)；
wherein, PsumTo assign a total share of weight, PminTo assign the weight lowest share, NFThe number of component images;
in one embodiment, after determining the distribution weight size ratio of each frame of component image and the total distribution weight share of each frame of component image, the distribution weight shares of the component images of each frame can be calculated respectively.
For example, if the weight is assigned to the lowest share Pmin0.05, number of component images NF4, and the assigned weight size ratios of the component images Frame1, Frame0, Frame3, and Frame2 are: p43.48%, 26.08%, 21.74%, 8.60%, the inter-frame weight of the component image of each frame can be obtained according to the following formula (3):
FPi＝Pi×Psum+Pmin (3)。
wherein FPiInter-frame weight, P, for ith-ordered component imageiAssigning a weight size ratio, P, to the ith component imagesumTo assign a total share of weight, PminThe weight lowest share is assigned.
The inter-Frame weights of the component images Frame1, Frame0, Frame3, and Frame2 were determined to be 39.78%, 25.87%, 22.39%, and 11.96%, respectively, by calculation.
As can be seen from the above description, in this embodiment, by determining the lowest share and the total share of the distribution weight of the component images of each frame, determining the share of the distribution weight of the component images of each frame according to the distribution weight size ratio and the total share of the distribution weight, and then determining the inter-frame weight of the component images of each frame according to the sum of the share of the distribution weight of the component images of each frame and the lowest share of the distribution weight, the inter-frame weight of the component images of each frame can be accurately determined, so that the distribution of the inter-frame weight not only represents the difference, but also considers the uniformity, the rationality for setting the inter-frame weight is improved, and the reference value of the obtained spatial composite image can be further improved.
FIG. 6A shows a flow diagram of how multiple frame component images are spatially compounded based on inter-frame weights of the frame component images according to an example embodiment of the present invention; FIG. 6B shows a schematic diagram of the division of a composite imaging subregion in accordance with an exemplary embodiment of the present invention; fig. 6C is a schematic diagram illustrating region division of a pixel according to an exemplary embodiment of the present invention.
The present embodiment is exemplified by how to spatially compound-image a plurality of frame component images based on the inter-frame weight of each frame component image, based on the above-described embodiments.
As shown in fig. 6A, the spatially compound imaging the multi-frame component image based on the inter-frame weight of each frame of the component image in step S104 may include the following steps S601-S603:
s601: dividing a composite imaging area formed by the multi-frame component images based on the image edge lines of the multi-frame component images to obtain a plurality of composite imaging sub-areas;
s602: determining a component image corresponding to each composite imaging subregion;
s603: and determining the pixel value of the corresponding pixel point position in each composite imaging subregion according to the inter-frame weight of the assembly image corresponding to the composite imaging subregion and the pixel value of each pixel point position in the assembly image.
In step S601, as shown in fig. 6B, the image edge of the multi-Frame component image divides the composite imaging area (dotted line portion) into a plurality of composite imaging sub-areas, where the component image applied for spatial compounding in each composite imaging sub-area is different, and the imaging areas of the component images Frame0, Frame1, Frame2, Frame3 and Frame4 all contain the composite imaging sub-area a, so the component images applied for spatial compounding in the composite imaging sub-area a are Frame0, Frame1, Frame2, Frame3 and Frame 35 4; similarly, the component images applied for spatial compounding in the composite imaging subregion C are Frame0, Frame1, Frame2, and Frame 3. By analogy, the whole composite imaging area can be divided into a fixed plurality of composite imaging sub-areas, and the number N of the composite imaging sub-areasAConforms to the following formula (4):
wherein N isAFor the number of composite imaging sub-regions, NFTThe number of component images (equal to the number of preset scan deflection angles) that are spatially compounded.
In one embodiment, if the number of spatially compounded component images is 5, the compound imaging region is divided into 9 compound imaging sub-regions by calculation.
As shown in fig. 6B, the composite imaging sub-region in the figure can be represented by english letters a to I.
In step S602, after the composite imaging region formed by the multiple frames of component images is divided to obtain multiple composite imaging sub-regions, the component images corresponding to the composite imaging sub-regions may be determined.
In one embodiment, for the area division of the points at the boundary of each composite imaging sub-area, the principle of containing fewer component images and having higher priority can be adopted.
For example, for the point (CDFH) shown in fig. 6B, the adjacent regions are the composite imaging subregion C, the composite imaging subregion D, the composite imaging subregion F, and the composite imaging subregion H, respectively, wherein the composite imaging subregion H has the least component images (only Frame0 and Frame1), so the point (CDFH) can be divided into the composite imaging subregion H.
In an embodiment, for the area division of the point not at the boundary of the composite imaging sub-area, the schematic diagram of the area division of the pixel point shown in fig. 6C may be referred to. As shown in fig. 6C, defining ≥ DAP as ≥ α and ≤ CBP as ≤ β, the region where point P is located satisfies the following formula (5):
wherein A isPIs the composite imaging subregion, SCIAngle, in which point P is locatedi(i＝1,2,…,4)Is the preset scan deflection angle (0 °, 7.5 °, -7.5 °, 15 °, -15 °, respectively, in this embodiment) for the corresponding component image. For example, when ≈ alpha<15 DEG and 7.5 DEG<∠β<At 15 deg. APThe point P is located in the region C shown in fig. 6B, and the component images applied to the region C for spatial compounding are Frame0, Frame1, Frame2, and Frame 3.
Similarly, the component image applied to spatially compound each compound sub-region may be determined, that is, the component image corresponding to each compound imaging sub-region may be determined.
In step S603, after determining the inter-frame weight of the component image corresponding to each composite imaging sub-region, the pixel value of the corresponding pixel point position in each composite imaging sub-region may be determined according to the inter-frame weight of the component image corresponding to each composite imaging sub-region and the pixel value of each pixel point position in the component image.
In an embodiment, the pixel value of each pixel point in the composite imaging sub-region C where the point P is located is equal to the weighted sum of the pixel values of each pixel point position in each component image applied to the region C (where the applied weight coefficient is the inter-frame weight), that is, the following formula (6) is satisfied:
wherein the content of the first and second substances,
and (3) a pixel value of a certain point in the composite imaging is represented, a superscript C represents a composite imaging subarea where the pixel value is located, and i is the order of the component image. For example
I.e., pixel values representing the x-th row, y-th column pixel point locations in the corresponding imaged area in the second in-order component image. And at this moment, the pixel values of the pixel point positions in the composite sub-regions are determined, and the spatial composite image can be obtained through the integration result of the composite sub-regions.
As can be seen from the above description, in this embodiment, a composite imaging region formed by the multi-frame component images is divided based on image edges of the multi-frame component images to obtain a plurality of composite imaging sub-regions, and component images corresponding to the composite imaging sub-regions are determined, and then pixel values of corresponding pixel positions in the composite imaging sub-regions are determined according to inter-frame weights of the component images corresponding to the composite imaging sub-regions and pixel values of the pixel positions in the component images, so that spatial compounding of each composite imaging sub-region according to the determined inter-frame weights of the component images can be achieved, and a complete spatial composite image is obtained, which can meet usage habits of diversified application scenes and operators, and improve a reference value of the obtained spatial composite image.
FIG. 7 shows a flow chart of a method of spatial compound imaging according to a further exemplary embodiment of the present invention; as shown in fig. 7, the method includes the following steps S701 to S706:
s701: acquiring multi-frame component images of a detected body, wherein each frame of component image corresponds to one frame of ultrasonic image with a preset scanning deflection angle;
s702: determining a first included angle between the integral gradient direction of the initial scanning image and the axial direction of the ultrasonic transmitting probe when the preset deflection angle is 0 degrees;
s703: determining the interframe weight of each frame of the component image according to the approximation degree of the preset scanning deflection angle of the multi-frame component image and the first included angle;
s704: performing spatial composite imaging on the multi-frame component images based on the inter-frame weight of each frame of the component images to obtain a spatial composite image;
s705: determining a second included angle between the overall gradient direction of the space composite image and the overall gradient direction of the initial scanning image;
s706: and if the second included angle is larger than or equal to a preset threshold value, acquiring the multi-frame assembly image of the detected body again.
For the explanation and explanation of the steps S701 to S704, reference may be made to the above embodiments, which are not described herein again.
In step S705, after obtaining the spatially compounded image, the overall gradient of the current spatially compounded image may be calculated (see the above-mentioned method for calculating the overall gradient of the initial scanned image in the embodiment shown in fig. 1, which is not described in detail herein), so as to determine a second angle between the overall gradient of the current spatially compounded image and the overall gradient direction of the initial scanned image.
In an embodiment, after the second included angle is obtained, the second included angle may be compared with a preset threshold, and if the second included angle is smaller than the preset threshold, it indicates that the overall gradient of the current spatial composite image is not changed too much compared with the initial scanned image, and meets the requirement; otherwise, if the second included angle is greater than or equal to the preset threshold, it indicates that the overall gradient of the current spatial composite image is changed too much compared with the initial scan image, and the multi-frame component image of the object may be re-acquired, so as to re-perform spatial composite imaging based on the re-acquired component image.
As can be seen from the above description, in this embodiment, by determining a second included angle between the overall gradient direction of the obtained spatial composite image and the overall gradient direction of the initial scan image, and when the second included angle is greater than or equal to a preset threshold, re-acquiring the multi-frame component image of the object to be detected, a feedback mechanism may be constructed based on the overall gradient of the image, so as to effectively check whether the obtained spatial composite image meets the requirement, improve the quality of spatial composite imaging, and further improve the reference value of the obtained spatial composite image.
Fig. 8 is a block diagram illustrating a structure of a spatial complex imaging apparatus according to an exemplary embodiment of the present invention; as shown in fig. 8, the apparatus includes: a component image acquisition module 110, a first angle determination module 120, an inter-frame weight determination module 130, and a spatial compound imaging module 140, wherein:
an assembly image obtaining module 110, configured to obtain multiple frames of assembly images of a subject, where each frame of the assembly image corresponds to one frame of ultrasound image with a preset scanning deflection angle;
a first included angle determining module 120, configured to determine a first included angle between the overall gradient direction of the initial scan image and the axial direction of the ultrasound transmitting probe when the preset deflection angle is 0 °;
an inter-frame weight determining module 130, configured to determine an inter-frame weight of each frame of the component image according to an approximation degree between a preset scanning deflection angle of the multi-frame component image and the first included angle;
and the spatial composite imaging module 140 is configured to perform spatial composite imaging on the multiple frames of component images based on the inter-frame weight of each frame of the component image, so as to obtain a spatial composite image.
As can be seen from the above description, in this embodiment, by obtaining a multi-frame component image of a subject, determining a first included angle between the overall gradient direction of an initial scan image and the axial direction of an ultrasound emission probe when a preset deflection angle is 0 °, then determining inter-frame weight of each frame of the component image according to the approximation degree between the preset scan deflection angle of the multi-frame component image and the first included angle, and further performing spatial composite imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial composite image, because the inter-frame weight of each frame of the component image is calculated based on the approximation degree between the scan deflection angle of each frame of the component image and the first included angle, the composite ratio of each frame of the image can be set in a targeted manner, the rationality for setting inter-frame weight is improved, and further the use habits of diversified application scenes and operators can be satisfied, and the reference value of the obtained space composite image is improved.
Fig. 9 is a block diagram illustrating a structure of a spatial complex imaging apparatus according to still another exemplary embodiment of the present invention; the component image obtaining module 210, the first included angle determining module 220, the inter-frame weight determining module 240, and the spatial composite imaging module 250 have the same functions as the component image obtaining module 110, the first included angle determining module 120, the inter-frame weight determining module 130, and the spatial composite imaging module 140 in the embodiment shown in fig. 8, and are not described herein again. As shown in fig. 9, the apparatus may further include: an approximation degree determining module 230;
the approximation degree determining module 230 may include:
an angle difference calculation unit 231, configured to calculate an absolute value of a difference between a preset scanning deflection angle of each frame of the component image and the first included angle;
an approximation degree determining unit 232, configured to determine an approximation degree between the scanning deflection angle of each frame of the component image and the first included angle according to an absolute value of a difference between the scanning deflection angle of each frame of the component image and the first included angle.
In an embodiment, the inter-frame weight determining module 240 may include:
a weight ratio determining unit 241, configured to determine a distribution weight size ratio of the component images of each frame according to the approximation degree;
an inter-frame weight determining unit 242, configured to determine an inter-frame weight of the component image for each frame based on the assigned weight size ratio.
In an embodiment, the weight ratio determining unit 241 may be further configured to:
determining the distribution weight score of the component image of each frame according to the approximation degree;
and determining the distribution weight size proportion of the component images of each frame according to the ratio of the distribution weight score of the component images of each frame to the sum of the distribution weight scores of the component images of the plurality of frames.
In an embodiment, the inter-frame weight determining unit 242 may be further configured to:
determining an allocation weight lowest share and an allocation weight total share of the component image for each frame, the allocation weight lowest share and the allocation weight total share satisfying a relationship shown in the following formula (1):
Psum+Pmin×NF＝1 (1)；
wherein, PsumTo assign a total share of weight, PminTo assign the weight lowest share, NFThe number of component images;
determining the distribution weight share of the component image of each frame according to the distribution weight size proportion and the total distribution weight share;
and determining the inter-frame weight of each frame of the component image according to the sum of the distribution weight share of each frame of the component image and the lowest share of the distribution weight.
In an embodiment, the spatial compound imager module 250 may include:
an imaging region dividing unit 251, configured to divide a composite imaging region formed by the multi-frame component images based on image edge lines of the multi-frame component images to obtain a plurality of composite imaging sub-regions;
a component image determining unit 252, configured to determine component images corresponding to the composite imaging sub-regions;
the pixel value determining unit 253 is configured to determine a pixel value of a corresponding pixel point position in each composite imaging sub-region according to the inter-frame weight of the component image corresponding to the composite imaging sub-region and the pixel value of each pixel point position in the component image.
In an embodiment, the apparatus may further comprise: a second included angle determining module 260, configured to determine a second included angle between the overall gradient direction of the spatial composite image and the overall gradient direction of the initial scanning image;
on this basis, the component image acquiring module 210 is further configured to acquire the multi-frame component image of the subject again when the second included angle is greater than or equal to a preset threshold.
In an embodiment, the subject may include a carotid artery.
It should be noted that, all the above-mentioned optional technical solutions may be combined arbitrarily to form the optional embodiments of the present disclosure, and are not described in detail herein.
The embodiment of the medical image generation device can be applied to network equipment. The device embodiments may be implemented by software, or by hardware, or by a combination of hardware and software. The software implementation is taken as an example, and is formed by reading corresponding computer program instructions in the nonvolatile memory into the memory for operation through the processor of the device where the software implementation is located as a logical means. From a hardware level, as shown in fig. 10, it is a hardware structure diagram of an electronic device in which the medical image generation apparatus of the present invention is located, and besides the processor, the network interface, the memory and the nonvolatile memory shown in fig. 10, the device in which the apparatus is located in the embodiment may also include other hardware, such as a forwarding chip responsible for processing a message, and the like; the device may also be a distributed device in terms of hardware structure, and may include multiple interface cards to facilitate expansion of message processing at the hardware level.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program implements the following task processing method when being processed by a processor:
acquiring multi-frame component images of a detected body, wherein each frame of component image corresponds to one frame of ultrasonic image with a preset scanning deflection angle;
determining a first included angle between the integral gradient direction of the initial scanning image and the axial direction of the ultrasonic transmitting probe when the preset deflection angle is 0 degrees;
determining the interframe weight of each frame of the component image according to the approximation degree of the preset scanning deflection angle of the multi-frame component image and the first included angle;
and performing spatial composite imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial composite image.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
Claims (19)
1. A method of spatially compounded imaging, comprising:
acquiring multi-frame component images of a detected body, wherein each frame of component image corresponds to one frame of ultrasonic image with a preset scanning deflection angle;
determining a first included angle between the overall gradient direction of an initial scanning image and the axial direction of an ultrasonic emission probe when a preset deflection angle is 0 degree, wherein the overall gradient direction is determined based on the sum of gradient direction vectors of all pixel points in the initial scanning image;
determining the interframe weight of each frame of the component image according to the approximation degree of the preset scanning deflection angle of the multi-frame component image and the first included angle;
and performing spatial composite imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial composite image.
2. The method according to claim 1, wherein said approximating the first included angle from the preset scan deflection angle of the multiframe assembly image comprises:
calculating the absolute value of the difference value between the preset scanning deflection angle of each frame of the component image and the first included angle;
and determining the approximation degree of the scanning deflection angle of the component image and the first included angle according to the absolute value of the difference value between the scanning deflection angle of each frame of the component image and the first included angle.
3. The method according to claim 1, wherein determining the inter-frame weight of each frame of the component image according to the approximation degree of the preset scan deflection angle of the multi-frame component image and the first included angle comprises:
determining the distribution weight size proportion of the component images of each frame according to the approximation degree;
determining an inter-frame weight for each frame of the component image based on the assigned weight size ratio.
4. The method of claim 3, wherein said determining the assigned weight size ratio of each frame of said component image based on said degree of approximation comprises:
determining the distribution weight score of the component image of each frame according to the approximation degree;
and determining the distribution weight size proportion of the component images of each frame according to the ratio of the distribution weight score of the component images of each frame to the sum of the distribution weight scores of the component images of the plurality of frames.
5. The method of claim 3, wherein said determining inter-frame weights for each frame of the component image based on the assigned weight size ratio comprises:
determining an allocation weight lowest share and an allocation weight total share of the component image for each frame, the allocation weight lowest share and the allocation weight total share satisfying a relationship shown in the following formula (1):
Psum+Pmin×NF＝1 (1)；
wherein, PsumTo assign a total share of weight, PminTo assign the weight lowest share, NFThe number of component images;
determining the distribution weight share of the component image of each frame according to the distribution weight size proportion and the total distribution weight share;
and determining the inter-frame weight of each frame of the component image according to the sum of the distribution weight share of each frame of the component image and the lowest share of the distribution weight.
6. The method of claim 1, wherein spatially compounding the multiple frames of component images based on the inter-frame weights of the component images comprises:
dividing a composite imaging area formed by the multi-frame component images based on the image edge lines of the multi-frame component images to obtain a plurality of composite imaging sub-areas;
determining a component image corresponding to each composite imaging subregion;
and determining the pixel value of the corresponding pixel point position in each composite imaging subregion according to the inter-frame weight of the assembly image corresponding to the composite imaging subregion and the pixel value of each pixel point position in the assembly image.
7. The method of claim 1, wherein after obtaining the spatially compounded image, the method further comprises:
determining a second included angle between the overall gradient direction of the space composite image and the overall gradient direction of the initial scanning image;
and if the second included angle is larger than or equal to a preset threshold value, acquiring the multi-frame assembly image of the detected body again.
8. The method of claim 7, further comprising determining an overall gradient direction of a target image, the target image being the initial scan image or the spatially compounded image, according to the following steps:
determining a gradient direction vector of each pixel point in the target image;
and summing the gradient direction vectors of all the pixel points to obtain the overall gradient direction of the target image.
9. The method according to any one of claims 1-8, wherein the subject comprises a carotid artery.
10. A spatial compound imaging apparatus, comprising:
the device comprises an assembly image acquisition module, a deflection angle detection module and a deflection angle detection module, wherein the assembly image acquisition module is used for acquiring a plurality of frames of assembly images of a detected body, and each frame of assembly image corresponds to one frame of ultrasonic image with a preset scanning deflection angle;
the first included angle determining module is used for determining a first included angle between the overall gradient direction of an initial scanning image and the axial direction of the ultrasonic transmitting probe when the preset deflection angle is 0 degree, wherein the overall gradient direction is determined based on the sum of gradient direction vectors of all pixel points in the initial scanning image;
the inter-frame weight determining module is used for determining the inter-frame weight of each frame of the component images according to the approximation degree of the preset scanning deflection angle of the multi-frame component images and the first included angle;
and the spatial composite imaging module is used for carrying out spatial composite imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial composite image.
11. The apparatus of claim 10, further comprising: an approximation degree determination module;
the approximation degree determining module comprises:
the angle difference value calculating unit is used for calculating the absolute value of the difference value between the preset scanning deflection angle of each frame of the component image and the first included angle;
and the approximation degree determining unit is used for determining the approximation degree of the scanning deflection angle of the component image and the first included angle according to the absolute value of the difference value between the scanning deflection angle of each frame of the component image and the first included angle.
12. The apparatus of claim 10, wherein the inter-frame weight determination module comprises:
a weight proportion determining unit, configured to determine, according to the approximation degree, a distribution weight size proportion of the component images of each frame;
and the inter-frame weight determining unit is used for determining the inter-frame weight of the component images of each frame based on the distribution weight size proportion.
13. The apparatus of claim 12, wherein the weight proportion determining unit is further configured to:
determining the distribution weight score of the component image of each frame according to the approximation degree;
and determining the distribution weight size proportion of the component images of each frame according to the ratio of the distribution weight score of the component images of each frame to the sum of the distribution weight scores of the component images of the plurality of frames.
14. The apparatus of claim 12, wherein the inter-frame weight determination unit is further configured to:
determining an allocation weight lowest share and an allocation weight total share of the component image for each frame, the allocation weight lowest share and the allocation weight total share satisfying a relationship shown in the following formula (1):
Psum+Pmin×NF＝1 (1)；
wherein, PsumTo assign a total share of weight, PminTo assign the weight lowest share, NFThe number of component images;
determining the distribution weight share of the component image of each frame according to the distribution weight size proportion and the total distribution weight share;
and determining the inter-frame weight of each frame of the component image according to the sum of the distribution weight share of each frame of the component image and the lowest share of the distribution weight.
15. The apparatus of claim 10, wherein the spatial compounding imaging module comprises:
the imaging area dividing unit is used for dividing a composite imaging area formed by the multi-frame component images based on the image edge lines of the multi-frame component images to obtain a plurality of composite imaging sub-areas;
the component image determining unit is used for determining component images corresponding to the composite imaging sub-regions;
and the pixel value determining unit is used for determining the pixel value of the corresponding pixel point position in each composite imaging subregion according to the inter-frame weight of the assembly image corresponding to the composite imaging subregion and the pixel value of each pixel point position in the assembly image.
16. The apparatus of claim 10, further comprising: the second included angle determining module is used for determining a second included angle between the overall gradient direction of the space composite image and the overall gradient direction of the initial scanning image;
the component image acquisition module is further configured to reacquire the multi-frame component images of the subject when the second included angle is greater than or equal to a preset threshold.
17. The apparatus according to any one of claims 10-16, wherein the subject comprises a carotid artery.
18. A spatial compound imaging apparatus, comprising:
a processor;
a memory configured to store processor-executable instructions;
wherein the processor is configured to:
acquiring multi-frame component images of a detected body, wherein each frame of component image corresponds to one frame of ultrasonic image with a preset scanning deflection angle;
determining a first included angle between the overall gradient direction of an initial scanning image and the axial direction of an ultrasonic emission probe when a preset deflection angle is 0 degree, wherein the overall gradient direction is determined based on the sum of gradient direction vectors of all pixel points in the initial scanning image;
determining the interframe weight of each frame of the component image according to the approximation degree of the preset scanning deflection angle of the multi-frame component image and the first included angle;
and performing spatial composite imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial composite image.
19. A machine-readable storage medium having stored thereon computer instructions that, when executed, perform the following:
acquiring multi-frame component images of a detected body, wherein each frame of component image corresponds to one frame of ultrasonic image with a preset scanning deflection angle;
determining a first included angle between the overall gradient direction of an initial scanning image and the axial direction of an ultrasonic emission probe when a preset deflection angle is 0 degree, wherein the overall gradient direction is determined based on the sum of gradient direction vectors of all pixel points in the initial scanning image;
determining the interframe weight of each frame of the component image according to the approximation degree of the preset scanning deflection angle of the multi-frame component image and the first included angle;
and performing spatial composite imaging on the multi-frame component image based on the inter-frame weight of each frame of the component image to obtain a spatial composite image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810505905.2A CN108926359B (en) | 2018-05-24 | 2018-05-24 | Space compound imaging method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810505905.2A CN108926359B (en) | 2018-05-24 | 2018-05-24 | Space compound imaging method, device and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108926359A CN108926359A (en) | 2018-12-04 |
| CN108926359B true CN108926359B (en) | 2021-03-30 |
Family
ID=64449517
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810505905.2A Active CN108926359B (en) | 2018-05-24 | 2018-05-24 | Space compound imaging method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108926359B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114190983A (en) * | 2021-11-19 | 2022-03-18 | 中国科学院深圳先进技术研究院 | Ultrasonic imaging method and device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001276077A (en) * | 2000-03-28 | 2001-10-09 | Aloka Co Ltd | Ultrasonic diagnostic device |
| CN1675565A (en) * | 2002-08-21 | 2005-09-28 | 皇家飞利浦电子股份有限公司 | Ultrasonic imaging apparatus with adaptable spatial image combination |
| US9125589B2 (en) * | 2007-05-09 | 2015-09-08 | General Electric Company | System and method for tissue characterization using ultrasound imaging |
| CN105530870A (en) * | 2014-05-28 | 2016-04-27 | 深圳迈瑞生物医疗电子股份有限公司 | Ultrasonic imaging method and system |
| CN106419959A (en) * | 2016-10-14 | 2017-02-22 | 汕头市超声仪器研究所有限公司 | Double-planar-probe deflection-overlaying imaging system |
| CN108022209A (en) * | 2016-10-31 | 2018-05-11 | 北京东软医疗设备有限公司 | Acquisition methods and device, the method and apparatus of spatial compound imaging of color value |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10083372B2 (en) * | 2015-11-03 | 2018-09-25 | Toshiba Medical Systems Corporation | Ultrasound diagnosis apparatus, image processing apparatus and image processing method |
-
2018
- 2018-05-24 CN CN201810505905.2A patent/CN108926359B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001276077A (en) * | 2000-03-28 | 2001-10-09 | Aloka Co Ltd | Ultrasonic diagnostic device |
| CN1675565A (en) * | 2002-08-21 | 2005-09-28 | 皇家飞利浦电子股份有限公司 | Ultrasonic imaging apparatus with adaptable spatial image combination |
| US9125589B2 (en) * | 2007-05-09 | 2015-09-08 | General Electric Company | System and method for tissue characterization using ultrasound imaging |
| CN105530870A (en) * | 2014-05-28 | 2016-04-27 | 深圳迈瑞生物医疗电子股份有限公司 | Ultrasonic imaging method and system |
| CN106419959A (en) * | 2016-10-14 | 2017-02-22 | 汕头市超声仪器研究所有限公司 | Double-planar-probe deflection-overlaying imaging system |
| CN108022209A (en) * | 2016-10-31 | 2018-05-11 | 北京东软医疗设备有限公司 | Acquisition methods and device, the method and apparatus of spatial compound imaging of color value |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108926359A (en) | 2018-12-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6670963B2 (en) | Visual attention model | |
| US10762649B2 (en) | Methods and systems for providing selective disparity refinement | |
| CN110493488B (en) | Video image stabilization method, video image stabilization device and computer readable storage medium | |
| US10672108B2 (en) | Image processing apparatus, image processing method, and image processing program | |
| JP2007181674A (en) | Method of forming image using block matching and motion compensated interpolation | |
| US8494239B2 (en) | Image processing device, method and program | |
| CN108926359B (en) | Space compound imaging method, device and equipment | |
| WO2013035457A1 (en) | Stereoscopic image processing apparatus, stereoscopic image processing method, and program | |
| WO2015085922A1 (en) | Method and apparatus for frame rate up-conversion | |
| JP7032913B2 (en) | Image processing device, image processing method, computer program | |
| JP2018036898A (en) | Image processing device and control method of the same | |
| CN108898582B (en) | Heart image reconstruction method and device and computer equipment | |
| JP4708740B2 (en) | Image processing apparatus and image processing method | |
| CN115836872A (en) | Scanning cabin offset determination method, device and system, computer equipment and medium | |
| KR20100097858A (en) | Super-resolution using example-based neural networks | |
| CN109389577B (en) | X-ray image processing method and system, and computer storage medium | |
| CN110020656A (en) | Bearing calibration, device and the equipment of image | |
| US11948328B2 (en) | Image-processing device, image-processing method, and image-processing program | |
| JP2016201037A (en) | Image processing device, image processing method, and program | |
| JP4982343B2 (en) | Image processing apparatus, image evaluation method, program, and information storage medium | |
| CN112766338A (en) | Method, system and computer readable storage medium for calculating distance image | |
| Jian et al. | Cloud image processing and analysis based flatfoot classification method | |
| JP6378496B2 (en) | Image processing apparatus, control method, and recording medium | |
| JP2020112928A (en) | Background model generation device, background model generation method, and background model generation program | |
| JP2003310586A (en) | Image processing apparatus and image processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 110167 No. 177-1 Innovation Road, Hunnan District, Shenyang City, Liaoning Province Applicant after: DongSoft Medical System Co., Ltd. Address before: 110167 No. 177-1 Innovation Road, Hunnan District, Shenyang City, Liaoning Province Applicant before: Dongruan Medical Systems Co., Ltd., Shenyang |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |