JP4796174B2 - Ultrasonic imaging apparatus, image processing apparatus, and program - Google Patents

Description

  The present invention relates to an ultrasonic imaging apparatus, an image processing apparatus, and a program for generating tomographic image data that changes with time, in particular, tomographic image data of a contrast medium injected into a subject.

  In recent years, a contrast agent is injected into a subject, and the subject is imaged using an ultrasonic imaging apparatus. Here, the contrast agent is made of a liquid containing a large number of micro bubbles. The liquid injected into the subject circulates in the body with time. At this time, the ultrasonic wave emitted from the ultrasonic imaging apparatus is observed as an ultrasonic echo (echo) having a harmonic component from the portion where the contrast medium circulates, resulting in non-linearization due to microbubbles.

  Here, when a contrast agent is injected into a subject and image data is generated using an ultrasound imaging apparatus, the portion having the harmonic component of the displayed image data indicates a region infiltrated with the contrast agent. Yes. The temporal change in this region indicates how the contrast medium infiltrates into the subject and circulates, and is important information for identifying various diseases.

  In addition, even in image data such as CFM (Color Flow Mapping) that does not use a contrast agent, the color-displayed region shows how the blood flow circulates in time or space. This is important information for identification.

Fuminori Moriyasu and two others, “Ultrasound Contrast Guidebook”, Kanehara Publishing, February 28, 2003, p. 54-55

  However, according to the above background art, the positional relationship between the part of the subject where the contrast medium exists at the time of imaging and the other part where the contrast medium will infiltrate is not clear. That is, on the image of the ultrasonic imaging apparatus, only the region where the contrast agent is present at the time of imaging is displayed, and the signal intensity of other parts is low and cannot be viewed.

  In particular, the entire infiltrated area from when the contrast medium infiltrates into the subject and begins to appear on the image over time and disappears is visualized when the operator interprets the image even though the entire area cannot be seen at the same time. This is important image data for identifying the infiltrated region of the contrast agent to be detected and recognizing the temporal change of this region.

  Further, even in blood flow image data using CFM or the like, the color-displayed region partially shows how the blood flow circulates in time or space, and these blood flows circulate. It is important for the operator to recognize the entire temporal or spatial domain.

  From these facts, how to realize an ultrasonic imaging apparatus, an image processing apparatus and a program that allow the operator to recognize the entire infiltrated area where the contrast medium infiltrates into the subject simultaneously with the imaging part of the subject where the contrast medium exists. Is important.

  The present invention has been made to solve the above-described problems caused by the background art, and at the same time as the imaging portion of the subject in which the contrast medium is present, the operator is provided with the entire infiltration region where the contrast medium infiltrates in the subject. An object is to provide an ultrasonic imaging apparatus, an image processing apparatus, and a program for recognition.

  In order to solve the above-described problems and achieve the object, an ultrasonic imaging apparatus according to a first aspect of the invention receives an ultrasonic wave from an object by ultrasonically scanning the object, and at a scan time. From the image data generating means for generating image data of a plurality of frames in a continuous subject, a display means for displaying an image based on the image data, a storage means for storing the image data, and the scan time from the image data. Continuous time domain image data generating means for generating continuous time domain image data obtained by adding image data of a plurality of consecutive frames, and a plurality of frames indicating a process in which pixel values change from the image data as the scan time elapses. Time change process image data generating means for generating time change process image data; and the continuous time domain image data. And superimposed on the image synthesizing an image of the time change process image data, and a synthesizing output means for outputting to said display means sequentially changing the time change process image data with the passage of the scan time.

  The ultrasonic imaging apparatus according to the invention of the second aspect receives image data from a subject and generates image data of a plurality of continuous frames in which imaging parts differ in the thickness direction of the imaging cross section. Projection image data obtained by adding image data of a plurality of frames continuously present in the thickness direction from the image data, display means for displaying an image based on the image data, storage means for storing the image data, and Projection image data generating means for generating a part change process image data generating means for generating a part change process image data of a plurality of frames indicating a process of changing a pixel value according to a change of an imaging part in the thickness direction from the image data And superimposing the image of the part change process image data on the image of the projection image data, and following the change of the imaging part. Successively changing the site process image data Te and a composite output means for outputting to said display means.

  An ultrasonic imaging apparatus according to a third aspect of the invention includes an image data generating unit that generates a plurality of image data indicating temporal changes in the same imaging region after a contrast agent is injected into a subject, and the image Display means for displaying data, storage means for storing the image data, and infiltration area image data for generating infiltration area image data indicating all areas in the image in which the contrast agent infiltrates the site from the image data Generation means, infiltration process image data generation means for generating a plurality of frames of infiltration process image data indicating a process in which the contrast medium infiltrates into the region, and the image data is superimposed on the image of the infiltration area image data. A synthesis output unit configured to synthesize an image of infiltration process image data, sequentially change the infiltration process image data according to the process, and output the data to the display unit; .

  The ultrasonic imaging apparatus according to the invention of the fourth aspect is characterized in that, in the invention of the third aspect, the infiltration region image data generation means includes addition means for adding the plurality of image data. .

  The ultrasonic imaging apparatus according to the fifth aspect of the invention is the ultrasonic imaging apparatus according to the third or fourth aspect, wherein the infiltration region image data generation means and the infiltration process image data generation means do not include information on the contrast agent. Subtracting means for subtracting image data from the image data is provided.

  In the fifth aspect of the invention, the infiltration region image data generation means and the infiltration process image data generation means subtract the reference image data not including the contrast agent information from the image data by the subtraction means, and obtain the background image data. Remove.

  The ultrasonic imaging apparatus according to the sixth aspect of the invention is the ultrasonic imaging apparatus according to any one of the third to fifth aspects, wherein the infiltration process image data includes a pixel value of the image data reflecting the amount of the contrast agent. And as pixel information.

  The ultrasonic imaging apparatus according to the seventh aspect of the invention is the ultrasonic imaging apparatus according to any one of the third to fifth aspects, wherein the infiltration process image data indicates a time at which a pixel value of the image data is maximum. It is characterized by having as.

  The ultrasonic imaging apparatus according to the eighth aspect of the present invention is the ultrasonic imaging apparatus according to any one of the third to fifth aspects, wherein the infiltration process image data includes a time when the pixel value of the image data starts to increase. It is characterized by having as information.

  The ultrasonic imaging apparatus according to the ninth aspect of the invention is the ultrasonic imaging apparatus according to any one of the third to eighth aspects, wherein the infiltrated region image data generating means, The infiltration process image data generation unit and the composite output unit include an input unit for inputting a position of a cross section for performing the output.

In the ninth aspect of the invention, the ultrasonic imaging apparatus inputs the position of the cross section to be output by the input unit, and sets the cross section at an arbitrary position and direction.
The ultrasonic imaging apparatus according to the invention of the tenth aspect is characterized in that, in the ninth aspect, the synthetic output means sequentially changes the position of the cross section where the output is performed according to the process.

In the tenth aspect of the invention, the combined output means sequentially changes the position of the cross section to be output according to the process, and outputs the cross section at the optimum position with time.
The ultrasonic imaging apparatus according to the invention of the eleventh aspect is characterized in that, in the tenth aspect, the sequential change is rotation of the cross section.

  The ultrasonic imaging apparatus according to a twelfth aspect of the present invention is the ultrasonic imaging apparatus according to any one of the ninth to eleventh aspects, wherein the combined output means converts the cross-sectional two-dimensional image data, the infiltration region image data, and the A creation means for creating from the projection information of the infiltration process image data is provided.

  In the ultrasonic imaging apparatus according to the thirteenth aspect of the invention, in the twelfth aspect, the projection information includes projection values of the infiltration region image data and the infiltration process image data from a direction orthogonal to the cross section. It is the sum total.

In the thirteenth aspect of the invention, the projection information forms projection data of three-dimensional image data.
The ultrasonic imaging apparatus according to the fourteenth aspect of the invention is the ultrasonic imaging apparatus according to the twelfth aspect, wherein the projection information includes projection values of the infiltration region image data and the infiltration process image data from a direction orthogonal to the cross section. It is the largest among them.

In the fourteenth aspect of the invention, the projection information forms the maximum intensity projection data (MIPData) of the three-dimensional image data.
The ultrasonic imaging apparatus according to the invention of a fifteenth aspect is the ultrasonic imaging apparatus according to any one of the third to fourteenth aspects, wherein the combined output means displays the infiltration region image data and the infiltration process image data displayed in an overlapping manner. Are displayed in different colors.

  The ultrasonic imaging apparatus according to the sixteenth aspect of the invention is the ultrasonic imaging apparatus according to any one of the third to fifteenth aspects, wherein the combined output means displays the infiltration process image superimposed on the infiltration region image. It comprises a selection means for selecting whether or not.

  According to a seventeenth aspect of the present invention, an image processing apparatus includes an interface for receiving tomographic image data of a plurality of frames in a subject that is continuous during a scan time of scanning the subject, and a display for displaying an image based on the tomographic image data. Means, storage means for storing the tomographic image data, and continuous time domain image data generating means for generating, from the tomographic image data, continuous time domain image data in which image data of a plurality of consecutive frames in the scan time are added. A time change process image data generating means for generating time change process image data of a plurality of frames indicating a process of changing a pixel value with the passage of the scan time from the image data, and an image of the continuous time domain image data. Overlay the image of the time-varying process image data, and scan And successively changing the time change process image data with the passage between and a synthetic output means for outputting to said display means.

  According to an eighteenth aspect of the invention, an image processing apparatus includes an interface for receiving tomographic image data of a plurality of consecutive frames whose imaging parts are different in the thickness direction of the imaging cross section, and display means for displaying an image based on the tomographic image data. Storage means for storing the tomographic image data; projection image data generating means for generating, from the tomographic image data, projected image data obtained by adding tomographic image data of a plurality of frames continuously existing in the thickness direction; From the tomographic image data, a part change process image data generating unit that generates a part change process image data of a plurality of frames indicating a process of changing a pixel value according to a change in the imaging part in the thickness direction, and an image of the projection image data The image of the part change process image data is superimposed and the part process according to the change of the imaging part It is sequentially changed image data and a composite output means for outputting to said display means.

  According to a nineteenth aspect of the present invention, an image processing apparatus includes: an interface that receives a plurality of tomographic image data indicating temporal changes in the same imaging region after a contrast agent is injected into a subject; and the tomographic image data Display means for displaying, storage means for storing the tomographic image data, and infiltration region image data for generating infiltration region image data indicating all regions in the tomographic image in which the contrast agent infiltrates the site from the tomographic image data A data generation unit, an infiltration process image data generation unit for generating a plurality of frames of infiltration process image data indicating a process in which the contrast medium infiltrates into the region from the tomographic image data, and an image of the infiltration region image data. The image of the infiltration process image data is synthesized, and the infiltration process image data is sequentially changed according to the process and output to the display means. And means.

  An image processing apparatus according to a twentieth aspect of the invention is characterized in that, in the nineteenth aspect, the tomographic image data is image data generated by an ultrasonic imaging apparatus.

  The image processing apparatus according to a twenty-first aspect of the invention is characterized in that, in the nineteenth or twentieth aspect, the infiltration region image data generating means includes an adding means for adding the plurality of tomographic image data. .

  An image processing apparatus according to a twenty-second aspect of the invention is the image processing device according to any one of the nineteenth to twenty-first aspects, wherein the infiltration process image data includes a pixel value of the image data that reflects the amount of the contrast agent. It is characterized by having as pixel information.

  An image processing apparatus according to a twenty-third aspect of the invention is the image processing device according to any one of the nineteenth to twenty-second aspects, wherein the combined output means displays the infiltration region image data and the infiltration process image data displayed in an overlapping manner. It is characterized by displaying in different colors.

  According to a twenty-fourth aspect of the present invention, there is provided a program that causes a computer of an image processing device to receive a plurality of frames of tomographic image data in a subject that is continuous during a scan time of scanning the subject, and an image based on the tomographic image data. Display means for displaying the tomographic image data, storage means for storing the tomographic image data, and continuous-time domain image data for generating continuous-time domain image data obtained by adding image data of a plurality of frames consecutive in the scan time from the tomographic image data Generation means, time change process image data generation means for generating time change process image data of a plurality of frames indicating a process of changing a pixel value as the scan time elapses, and an image of the continuous time domain image data Overlay the images of the time-varying process image data And, combining output means for outputting to said display means sequentially changing the time change process image data with the passage of the scan time, to function as a.

  According to a twenty-fifth aspect of the present invention, there is provided a program for an image processing apparatus, an interface for receiving tomographic image data of a plurality of consecutive frames in which an imaging part is different in a thickness direction of an imaging section, Display means for displaying, storage means for storing the tomographic image data, and projection image data generating means for generating, from the tomographic image data, projection image data obtained by adding tomographic image data of a plurality of frames continuously existing in the thickness direction. A part change process image data generating means for generating a part change process image data of a plurality of frames indicating a process in which a pixel value changes according to a change of an imaging part in the thickness direction from the tomographic image data, and an image of the projection image data Overlay the image of the part change process image data, and change the imaging part The composite output means sites process image data by sequentially changing the output to the display means, to function as a I.

  According to a twenty-sixth aspect of the present invention, there is provided a program that causes a computer of an image processing apparatus to receive a plurality of tomographic image data indicating temporal changes in the same imaging region after a contrast agent is injected into a subject. Display means for displaying tomographic image data, storage means for storing the tomographic image data, and infiltrating area image data indicating all areas in the tomographic image in which the contrast medium infiltrates into the site is generated from the tomographic image data. Infiltration region image data generation means, from the tomographic image data, infiltration process image data generation means for generating a plurality of frames of infiltration process image data indicating a process in which the contrast medium infiltrates into the site, The image of the infiltration process image data is superimposed and the display is performed by sequentially changing the infiltration process image data according to the process. Combining output means for outputting the stage, to function as a.

  As described above, in the present invention, after the contrast agent is injected into the subject by the image data generation means, a plurality of image data indicating the time change of the same imaging region is generated, and the image data is obtained by the display means. The image data is displayed and stored by the storage means, and from this image data, the infiltration area image data generation means generates the infiltration area image data indicating the entire area on the image in which the contrast medium infiltrates the site. From the data, the infiltration process image data generation means generates a plurality of infiltration process image data indicating the process in which the contrast medium infiltrates the site, and the composite output means superimposes the infiltration process image data on the image of the infiltration area image data. Since the image is displayed and the infiltration process image data is sequentially changed according to the infiltration process, the process in which the contrast agent infiltrates the imaging region Can be recognized by comparison, in particular how the time variation of infiltrated area is enlarged over time, by comparing the entire infiltrated area, it can be recognized with a specific sense.

FIG. 1 is a block diagram showing the overall configuration of the ultrasound imaging apparatus. FIG. 2 is a functional block diagram illustrating a functional configuration of the control unit according to the first embodiment. FIG. 3 is a flowchart showing the operation of the ultrasonic imaging apparatus according to the first embodiment. FIG. 4 is a flowchart showing the operation of the infiltration process image display process according to the first embodiment. FIG. 5 is an explanatory diagram illustrating an example of an image according to the first embodiment. FIG. 6 is an explanatory diagram illustrating an example of an infiltration region image according to the first embodiment. FIG. 7 is an explanatory diagram illustrating an example of an infiltration process image in which the infiltration region images of Embodiment 1 are superimposed. FIG. 8 is an explanatory diagram illustrating an example of a captured image of the ultrasonic imaging apparatus. FIG. 9 is a functional block diagram illustrating a functional configuration of the control unit according to the second embodiment. FIG. 10 is a flowchart illustrating the operation of the ultrasonic imaging apparatus according to the second embodiment. FIG. 11 is a flowchart showing the operation of the part change process image display process of the second embodiment. FIG. 12 is an explanatory diagram illustrating the sweep operation of the probe unit according to the second embodiment. FIG. 13 is an explanatory diagram illustrating an example of an image according to the second embodiment. FIG. 14 is an explanatory diagram illustrating generation of a projection image according to the second embodiment. FIG. 15 is an explanatory diagram illustrating an example of a projection image according to the second embodiment. FIG. 16 is an explanatory diagram illustrating an example of a region change process image on which the projection images of the second embodiment are superimposed. FIG. 17 is a functional block diagram illustrating a functional configuration of the control unit according to the third embodiment.

The best mode for carrying out an ultrasonic imaging apparatus according to the present invention will be described below with reference to the accompanying drawings. Note that the present invention is not limited thereby.
<Embodiment 1>
FIG. 1 is a block diagram showing the overall configuration of the ultrasound imaging apparatus according to the first embodiment. The ultrasound imaging apparatus includes a probe unit 101, a transmission / reception unit 102, an image processing unit 103, a cine memory unit 104, an image display control unit 105, a display unit 106, an input unit 107, and a control unit 108. The probe unit 101, the transmission / reception unit 102, the image processing unit 103, and the control unit 108 constitute an image data generation unit for image data, which will be described later, and the image display control unit 105 and the display unit 106 constitute a display unit 109. . Further, in the connection for connecting each constituent element, a thick line represents a transmission line through which analog or digital image data is transmitted, and a thin line represents a transmission line through which control information is transmitted.

  The probe unit 101 repeatedly irradiates ultrasonic waves in a specific direction of an imaging cross section of a living body, that is, a part for transmitting and receiving ultrasonic waves, and uses ultrasonic signals repeatedly reflected from the living body as time-series sound rays. While receiving, electronic scanning is performed while sequentially switching the direction of ultrasonic irradiation. Although not shown in the figure, piezoelectric elements are arranged in the probe unit 101 in an array.

  The transmission / reception unit 102 is connected to the probe unit 101 by a coaxial cable, and generates an electrical signal for driving the piezoelectric element of the probe unit 101. Further, the transmission / reception unit 102 performs first-stage amplification of the received ultrasonic signal.

  The image processing unit 103 performs image processing for generating image data in real time from the ultrasonic signal amplified by the transmission / reception unit 102. Specific processing contents include, for example, delay addition processing of the received ultrasonic signal, A / D (analog / digital) conversion processing, and processing of writing the converted digital information as image data in a cine memory unit 104 described later. Etc. The image data generated here uses a harmonic harmonic image, a Doppler image, or the like in order to depict a contrast agent.

  This Doppler image is formed by Doppler processing of the image processing unit 103. In the Doppler processing, phase change information is extracted from the ultrasonic signal amplified by the transmission / reception unit 102, and flow information associated with each point of the imaging section such as velocity, power value, and dispersion is calculated in real time.

  The image processing unit 103 also forms a CFM image by CFM processing. In the CFM processing, blood flow information included in the ultrasound signal is generated as image data that colors a flow approaching the probe unit 101 in red and a flow moving away from the probe unit 101 in blue.

  The cine memory unit 104 is a storage unit for accumulating and storing image data generated by image processing. In particular, temporally changing image data is stored with a time-series index, and is used as basic data for later analysis of temporal changes in image data.

  The image display control unit 105 performs display frame rate conversion of the image data generated by the image processing unit 103 and controls the shape and position of a display image such as image data.

  The display unit 106 uses the CRT (Cathode Ray Tube) or LCD (Liquid Crystal Display) or the like to display the display frame rate conversion and the image display shape and position controlled information to the operator by the image display control unit 105. Visible display.

  The input unit 107 includes a keyboard, a pointing device, and the like, and an operation setting of the ultrasonic imaging apparatus, selection of display image data, and the like are performed by an operator. Further, there is also a selection means for selecting whether or not the infiltration region image data and the infiltration process image data described later are to be superimposed.

  The control unit 108 controls the operation of each unit of the above-described ultrasonic imaging apparatus based on the setting and selection information given from the input unit 107 and a program (program) or data (data) stored in advance, and the display unit 106 Display image data.

  FIG. 2 is a functional block diagram showing functional components of the control unit 108 according to the present invention. The control unit 108 includes image data 200, infiltration region image data generation means 210, infiltration process image data generation means 220, and composite output means 230. The image data 200 includes a plurality of images that are input from the cine memory unit 104 and are generated in time series at the same imaging region of the subject. Note that the image data 200 is image data that forms a time series from the time when the contrast medium is injected into the subject until the contrast agent has completely infiltrated into the subject.

  The infiltration region image data generation unit 210 includes an addition unit 211 that adds pixel values corresponding to the same position of a plurality of image data to generate one piece of image data. Then, the infiltration region image data generation unit 210 generates a single infiltration region image data 212 from the image data 200 by the addition unit 211.

  The infiltration process image data generation unit 220 includes a time phase image generation unit 221, a maximum pixel value time image generation unit 222, a pixel value increase start time image generation unit 223, and the like. The infiltration process image data generation means 220 uses these image generation means to generate infiltration process image data 224 indicating the process in which the contrast agent infiltrates into the subject from the image data 200. Note that the time phase image generation unit 221, the maximum pixel value time image generation unit 222, and the pixel value increase start time image generation unit 223 select an image generation unit desired by the operator from the input unit 107 as appropriate. The used image is generated.

  The time phase image generation unit 221 generates a time phase image that reflects the amount of contrast agent in the imaging region in each time phase. Since the data of the image data 200 is proportional to the amount of contrast agent in each time phase, the images arranged in the time series of the image data 200 are used as time phase images as they are, and this time phase image data is used as infiltration process image data. 224.

  The maximum pixel value time image generation unit 222 obtains the time from the start of measurement at which the pixel value becomes maximum for each pixel indicating the same imaging region, from a plurality of images arranged in time series of the image data 200. Then, infiltration process image data 224 in which the pixels of the image data corresponding to this time are colored is generated. This maximum pixel value temporal image data indicates the temporal change of the image area where the maximum amount of contrast agent is present.

  The pixel value increase start time image generation unit 223 obtains the time from the start of measurement at which the pixel value starts increasing for each pixel indicating the same imaging region, from a plurality of images arranged in time series of the image data 200. Then, infiltration process image data 224 in which the pixels of the image data corresponding to this time are colored is generated. This pixel value increase start time image data indicates a time change of an image region where the contrast medium has started infiltration.

  The composite output means 230 superimposes the infiltrated region image data 212 on the infiltrating process image data 224 as a background image, and displays the superimposed image along the time axis indicated by the infiltrating process image data 224 along the display unit 106. Are displayed sequentially. At this time, the overlapped infiltration region image data 212 and infiltration process image data 224 are color-coded into visually distinct colors. For example, the infiltration region image data 212 is displayed as a black and white image, and the infiltration process image data 224 is displayed as a color image such as red or blue.

  Here, this superposition is expressed by the following equation.

Here, i is a frame number indicating one piece of image data arranged on the time axis serving as an index in the infiltration process image data 224, and Disp is a pixel of an image displayed as a result of superposition F is a pixel value of the image of the infiltration process image data 224. Therefore, ΣF _i indicates the infiltration region image data 212 forming the background image. Further, a and b are weighting coefficients when performing superimposition, and are also indices indicating the display form, for example, color.

  Note that this superimposition can be performed by using the image display control unit 105 so that the display position of the display unit 106 is the same, or the superimposed image data is separately generated and displayed. It can also be displayed on the part 106.

  Next, the operation of the ultrasonic imaging apparatus according to the first embodiment will be described with reference to FIG. FIG. 3 is a flowchart showing the operation of the ultrasound imaging apparatus. First, the operator injects a contrast medium into the subject (step S301). Then, the operator brings the probe unit 101 into contact with the target portion of the subject, and generates a state in which the contrast medium infiltrates in the subject as the image data 200 (step S302). FIG. 5 is a diagram illustrating an example of the image data 200 generated here. The image data 200 includes a plurality of time-series images, and each image displays a portion of the subject infiltrated with the contrast agent. Note that each image is a fragmentary image display of only the part infiltrated with the contrast agent, and it is difficult to accurately grasp the part infiltrated with the contrast agent compared to other parts.

  Thereafter, the ultrasound imaging apparatus performs infiltration process image display processing (step S303), and displays an infiltration process image indicating a process in which the contrast agent infiltrates. Then, the operator grasps the infiltration process of the contrast medium from the infiltration process image (step S304), and ends the present process.

  Next, the infiltration process image display processing in step S303 will be described with reference to FIG. FIG. 4 is a flowchart showing the operation of the infiltration process image display process. First, the control unit 108 generates the infiltration region image data 212 from the image data 200 generated in step S302 by the infiltration region image data generation unit 210 (step S401). FIG. 6 is an example of the infiltration region image data 212 generated from the image data 200 shown in FIG. The image regions for each time when the contrast agent is present, shown in a fragmentary manner in each image in FIG. 5, are combined into one piece of image data. In the infiltration region image data 212, the entire image region where the contrast agent exists is displayed from the time when the contrast agent is injected into the subject until the infiltration of the contrast agent into the subject.

  Thereafter, the control unit 108 generates the infiltration process image data 224 by the infiltration process image data generation unit 220 (step S402). Here, the control unit 108 is one of the time phase image generation unit 221, the maximum pixel value time image generation unit 222, and the pixel value increase start time image generation unit 223 based on the instruction input information from the input unit 107. Is used to generate infiltration process image data 224. When the time phase image generation means 221 is selected, the image data 200 in FIG. 5 is a time phase image in which the amount of contrast agent changes with time, so that the image data 200 is directly used as the infiltration process image data 224. Is done.

  Thereafter, the control unit 108 determines whether to perform overlay display of the infiltration process image data 224 with the infiltration region image data 212 as a background image based on the instruction input information from the input unit 107 (step S403). When the superimposed display is not performed (No at Step S403), only the infiltration process image data 224 is sequentially displayed on the display unit 106 by the composite output unit 230 (Step S404).

  In addition, when performing overlay display (Yes at Step S403), the control unit 108 displays the infiltration process image data 224 with the infiltration region image data 212 in the background in time series by the composite output unit 230. (Step S405). FIG. 7 is a diagram showing temporal changes of the infiltration process image data 224 displayed on the display unit 106 with the infiltration region image data 212 as a background image along the horizontal axis forming the time axis. In addition, the infiltration process image data 224 has illustrated the case where it produced | generated using the time phase image production | generation means 221 as shown in FIG.

  In FIG. 7, the infiltration region image data 212 shown in FIG. 6 is included in all time phase images as a background image. In addition, the infiltration process image data 224 of each time phase shown in FIG. 5 is displayed as an image area indicated by diagonal lines so as to overlap the background image. In FIG. 7, the infiltration process image data 224 is indicated by diagonal lines, but the infiltration process image data 224 can also be indicated by a different color such as red on the display unit 106.

  As described above, in the first embodiment, the entire infiltrating image area is inspected by the infiltrating area image data generating unit 210 from the image data 200 showing the temporally changing process in which the contrast medium infiltrates in the subject. The infiltration area image data 212 to be shown is generated, and the infiltration process image data generation means 220 generates infiltration process image data 224 that shows the infiltration process in time series. The composite output means 230 outputs the two pieces of image data. Since the contrast medium is sequentially output to the display unit 109, the process in which the contrast agent infiltrates the imaging region can be recognized by comparison with the entire infiltrated region, and in particular, the time change in which the infiltrated region expands with time Can be recognized with a specific sensation by comparison with the entire infiltration region.

  In the first embodiment, the control unit 108 of the ultrasonic imaging apparatus performs infiltration process image display processing using the infiltration region image data generation unit 210, the infiltration process image data generation unit 220, and the composite output unit 230. However, an image processing apparatus that is separately connected to the ultrasonic imaging apparatus via an interface can also perform exactly the same processing. In this case, the burden on the hardware and software of the ultrasonic imaging apparatus main body is reduced. In addition, when performing infiltration process image display processing using an image processing apparatus, the image data used is not limited to image data, but tomographic image data generated using an X-ray CT apparatus or a magnetic resonance imaging apparatus. Can also be used.

  In the first embodiment, the infiltration region image data 212 is generated by the addition unit 211 included in the infiltration region image data generation unit 210. However, a so-called capture unit that is an addition unit is used. Infiltration area image data 212 can also be generated. The capture means sequentially adds the time-varying portions of the tomographic image data and displays them as a single image including the changing process. The image data that has been completely captured is the same as the infiltration region image data 212. FIG. 8 shows an example of a captured image obtained by capturing the image data 200 shown in FIG. 5 using this capture means. In FIG. 8, unlike FIG. 7, the infiltration region image data 212 is gradually generated with the passage of time. When the capture means is used, it is difficult to grasp the entire image of the infiltration region at the beginning of the capture.

  In the first embodiment, the image data 200 includes only the image data of the site where the contrast medium exists. However, the image data 200 may include background image data where the contrast medium does not exist. it can. In this case, the infiltration region image data generation means 210 and the infiltration process image data generation means 220 are provided with a subtraction means (not shown), and the reference image in the case where there is no contrast agent forming the background image data is subtracted from the image data 200. However, the background image data may not be included.

  In the first embodiment, the image data 200 is an image having planar two-dimensional tomographic image data, but may be an image having three-dimensional three-dimensional tomographic image data. Similarly, the infiltration region image data 212 and the infiltration process image data 224 generated from the image data 200 can be set as three-dimensional image data. In this case, when outputting these image data using the composite output unit 230, a cross section for creating 2D image data from the 3D image data is set at an arbitrary position and direction by the input unit 107. Then, based on the cross-sectional information, the creating means (not shown) of the composite output means 230.

  Further, the creating means generates 2D image data from the 3D image data onto which the cross section is projected. At this time, the projection data (projection data) in which the sum of the projected three-dimensional image data is the pixel value of the new image, or the MIP in which the maximum value of the projected three-dimensional image data is the pixel value of the new image (Maximum Intensity Projection) or the like can be used.

Further, the composite output unit 230 can change the position of the cross section forming the two-dimensional image data by rotation or the like when sequentially outputting the two-dimensional image data generated from the three-dimensional image data. Thereby, the time change of a contrast agent can be followed at an optimal cross-sectional position.
<Embodiment 2>
By the way, in Embodiment 1 described above, the process in which the contrast medium injected into the subject infiltrates the same imaging site in the subject over time is clearly shown with the infiltrated region image showing the entire infiltrated region as a background. However, the probe unit 101 is manually swept in the thickness direction orthogonal to the imaging cross section, and image data of a plurality of parts indicating blood flow such as CFM generated at this time is used. In addition, it is possible to clearly grasp the projected image of the entire imaging section for each part of the imaging section of the subject. Therefore, in the second embodiment, a case where the image for each part of the imaging section is clearly grasped using the projection image will be shown.

  The invention according to the second embodiment omits the control unit 108 and has the same hardware configuration as that in FIG. 1, and thus detailed description of parts other than the control unit 108 is omitted. FIG. 9 is a functional block diagram showing functional components of the control unit 908 according to the second embodiment. Here, the control unit 908 corresponds to the control unit 108 of FIG.

  The control unit 908 includes image data 900, projection image data generation means 910, part change process image data generation means 920, and composite output means 230. The image data 900 is input from the cine-memory unit 104, and when the probe unit 101 is manually swept in the thickness direction perpendicular to the imaging section, a plurality of time-series images are generated in synchronization with the sweep. It is data.

  The projection image data generation unit 910 includes an addition unit 911 that adds pixel values corresponding to the same pixel position of a plurality of image data to generate one piece of image data. Here, a projection image in which images are added in the thickness direction is formed by the adding means 911, and is formed as a single projection image data 912.

  The part change process image data generation unit 920 includes a time phase image generation unit 921, a maximum pixel value time image generation unit 922, a pixel value increase start time image generation unit 923, and the like. The part change process image data generation unit 920 generates the part change process image data 924 indicating the process of changing the imaging part in the subject in synchronization with the sweep from the image data 900 using these image generation units. To do. Note that the time phase image generation unit 921, the maximum pixel value time image generation unit 922, and the pixel value increase start time image generation unit 923 are appropriately selected from the input unit 107 as the image generation unit desired by the operator.

  The time phase image generation unit 921 generates a time phase image that reflects the pixel value of the imaging region in each time phase synchronized with the sweep. Since the data of the image data 900 represents pixel values in each time phase, the images arranged in the time series of the image data 900 are directly used as the time phase image, and this time phase image data is used as the part change process image data 924. .

  The maximum pixel value time image generation unit 922 obtains the time from the start of measurement at which the pixel value is maximized for each pixel indicating the same pixel position from a plurality of images arranged in time series of the image data 900. Then, the region change process image data 924 is generated by coloring the pixels of the image data corresponding to this time. This maximum pixel value time image data indicates a time change of an image region where the maximum pixel value exists.

  The pixel value increase start time image generation unit 923 obtains the time from the start of measurement at which the pixel value starts increasing for each pixel indicating the same pixel position from a plurality of images arranged in time series of the image data 900. Then, the region change process image data 924 is generated by coloring the pixels of the image data corresponding to this time. This pixel value increase start time image data indicates a time change of the image region where the pixel value starts increasing.

  The composite output means 230 superimposes the projected image data 912 on the part change process image data 924 as a background image, and displays the superimposed image along the time axis indicated by the part change process image data 924 along the display unit. The information is sequentially displayed on 106. At this time, the projection image data 912 and the part change process image data 924 to be superimposed are color-coded into visually distinguishable colors. For example, the projection image data 912 is displayed as a black and white image, and the part change process image data 924 is displayed as a color image such as red or blue. Note that this superimposition can be performed by using the image display control unit 105 so that the display position of the display unit 106 is the same, or the superimposed image data is separately generated and displayed. It can also be displayed on the part 106. Note that what this superposition represents is the same as the formula (1).

  Subsequently, the operation of the ultrasound imaging apparatus according to the second embodiment will be described with reference to FIG. FIG. 10 is a flowchart showing the operation of the ultrasound imaging apparatus. First, the operator manually sweeps the probe unit 101, and generates a plurality of image data in synchronization with the sweep (step S1001). FIG. 12A is a diagram illustrating an example in which the sector-type probe unit 101 is swept in the thickness direction substantially orthogonal to the imaging section. The operator places the probe unit 101 on a target site on the subject, and manually sweeps the probe unit 101 in the thickness direction orthogonal to the imaging section where electronic scanning is performed. In the example shown in FIG. 12A, the portion where the probe unit 101 is placed is generally fixed, and the irradiation direction of the opening through which ultrasonic waves are transmitted and received is swept. It is also possible to fix the irradiation direction of the probe unit 101 and sweep the portion where the probe unit 101 is placed in the thickness direction. FIG. 12B shows an example in which a linear probe unit is used and the ultrasonic wave irradiation direction is fixed and swept in the thickness direction. In this example, a plurality of pieces of image data that are continuously arranged in the thickness direction orthogonal to the imaging section are generated. Then, the operator generates stereoscopic image data of the target part of the subject as the image data 900.

  FIG. 13 is a diagram showing an example of image data 900 formed using the CFM processing or Doppler processing generated here. The image data 900 is composed of a plurality of image data in time series synchronized with the sweep, and images of different imaging parts in the thickness direction are displayed. In addition, since each image is a piecewise image display of only a site with a flow such as a blood flow at the time of imaging, it is difficult to accurately grasp all the sites with a flow.

  Thereafter, the ultrasound imaging apparatus performs a part change process image display process (step S1002), and displays a part change process image showing a process of changing the imaging part where the flow has occurred. Then, the operator grasps the change process of the imaging part from the part change process image (step S1003), and ends this process.

  Next, the part change process image display processing in step S1002 will be described with reference to FIG. FIG. 11 is a flowchart showing the operation of the part change process image display process. First, the control unit 908 generates projection image data 912 from the image data 900 generated in step S1001 by the projection image data generation unit 910 (step S1101). FIG. 14 is an explanatory diagram schematically illustrating a simple example of generating the projection image data 912. Here, the image data 912 is a plurality of image data generated when the ultrasound irradiation direction of the probe unit 101 is fixed and swept in the thickness direction. Then, the pixel values at the same pixel position of each image data are added to obtain the pixel value of the projection image data at the same pixel position.

  FIG. 15 is an example of the projection image data 912 generated from the image data 900 shown in FIG. An image area where a flow exists, shown in a fragmentary manner in each image in FIG. 13, is combined into one piece of image data. In the projection image data 912, the entire image area where the flow existed before the flow of blood flow or the like flows into the stereoscopic imaging region and flows out of the stereoscopic imaging region is displayed.

  Thereafter, the control unit 908 generates the part change process image data 924 by the part change process image data generation unit 920 (step S1102). Here, based on the instruction input information from the input unit 107, the control unit 908 is one of the time phase image generation unit 921, the maximum pixel value time image generation unit 922, and the pixel value increase start time image generation unit 923. Is used to generate the region change process image data 924. When the time phase image generation unit 921 is selected, the image data 900 in FIG. 13 is a time phase image whose flow changes with time, and thus the image data 900 is directly used as the part change process image data 924. .

  Thereafter, the control unit 908 determines, based on the instruction input information from the input unit 107, whether to superimpose the region change process image data 924 with the projection image data 912 as a background image (step S1103). When the superimposed display is not performed (No in step S1103), only the part change process image data 924 is sequentially displayed on the display unit 106 by the composite output unit 230 (step S1104).

  In addition, when performing overlay display (Yes in step S1103), the control unit 908 displays the part change process image data 924 with the projection image data 912 as a background in time series by the composite output unit 230. (Step S1105). FIG. 16 shows the time change of the part change process image data 924 displayed on the display unit 106 with the projection image data 912 as the background image, that is, the change in the imaging part in the thickness direction, along the horizontal axis forming the time axis. FIG. Note that the part change process image data 924 exemplifies a case where the part change process image data 924 is generated using the time phase image generation unit 921 as shown in FIG.

  In FIG. 16, the projection image data 912 shown in FIG. 15 is included in all time phase images as a background image. Then, the region change process image data 924 of each time phase shown in FIG. 13 is displayed as an image region indicated by oblique lines, superimposed on the background image. In FIG. 16, the part change process image data 924 is indicated by diagonal lines, but the part change process image data 924 may be indicated by a different color, for example, red, on the display unit 106.

  As described above, in the second embodiment, the entire image area where the flow exists is projected by the projection image data generation unit 910 from the image data 900 indicating the portion where the flow such as blood flow occurs in the subject. The projection image data 912 is generated, and the part change process image data generation unit 920 generates the part change process image data 924 indicating the process in which the flow changes depending on the imaging part according to the imaging part. Since the image data is superimposed and sequentially output to the display unit 109, the process of changing the part where the flow occurs can be recognized by comparison with the entire region where the flow exists.

  In the second embodiment, the probe unit 101 is manually swept. However, the probe unit 101 can be automatically swept using a machine, and further, the matrix is a matrix in which piezoelectric elements form a two-dimensional array. It is also possible to perform an electrical sweep using the probe units arranged in the.

In the second embodiment, an example using a CFM image is shown, but a Doppler image, a B-mode image, a B-flow image, or the like can also be used.
<Embodiment 3>
By the way, in Embodiments 1 and 2 described above, image data indicating the process in which the contrast medium injected into the subject infiltrates the same imaging region in the subject as time elapses and the probe unit 101 are imaged. Sweep manually in the thickness direction that is generally perpendicular to the cross section, and use the image data of continuous imaging parts such as CFM generated by this sweep, and use the image data of all image data as a background to add the image of each image data. Although it was decided to grasp clearly, as a similar function including these, continuous time domain image data obtained by adding these image data to a plurality of image data continuously generated in time is generated. Individual image data can also be displayed against a continuous time domain image. Therefore, the third embodiment shows a case where individual image data is clearly grasped with a continuous time region image as a background.

  In the invention according to the third embodiment, the control unit 108 is omitted, and the hardware configuration is exactly the same as that in FIG. FIG. 17 is a functional block diagram showing functional components of the control unit 1608 according to the third embodiment. Here, the control unit 1608 corresponds to the control unit 108 of FIG.

  The control unit 1608 includes image data 1600, continuous time domain image data generation means 1610, time change process image data generation means 1620, and composite output means 230. The image data 1600 is a plurality of time-series image data generated from the probe unit 101 and input from the cine memory unit 104.

  The continuous time region image data generation unit 1610 includes an addition unit 1611 that adds pixel values corresponding to the same pixel position of a plurality of image data to generate one piece of image data. Then, the continuous time region image data generating unit 1610 uses the adding unit 1611 to generate one continuous time region image data 1612 in which all the image data 1600 are added.

  The time change process image data generation means 1620 includes a time phase image generation means 1621, a maximum pixel value time image generation means 1622, a pixel value increase start time image generation means 1623, and the like. The time-varying process image data generating unit 1620 generates time-varying process image data 1624 indicating a process of time-varying the image from the image data 1600 using these image generating units. Note that the time phase image generation unit 1621, the maximum pixel value time image generation unit 1622, and the pixel value increase start time image generation unit 1623 are the time phase image generation unit 221, the maximum pixel value time image generation unit 222, and the pixel shown in FIG. 2. Since it is exactly the same as the value increase start time image generation means 223, detailed description is omitted.

  The composite output unit 230 superimposes the continuous time domain image data 1612 on the time change process image data 1624 as a background image, and the superposed image along the time axis indicated by the time change process image data 1624. The information is sequentially displayed on the display unit 106. At this time, the continuous time domain image data 1612 and the time-varying process image data 1624 to be superimposed are color-coded into visually distinct colors. For example, the continuous time domain image data 1612 is displayed as a black and white image, and the time change process image data 1624 is displayed as a color image such as red or blue. This superimposition can be performed by using the image display control unit 105 so that the display position of the display unit 106 is the same, or the superimposed image data is separately generated and the image data is displayed. It can also be displayed on the part 106. Note that what this superposition represents is the same as the formula (1).

Here, since the operation of the control unit 1608 is the same as that of the control units 108 and 908 shown in the first and second embodiments, detailed description thereof will be omitted.
As described above, in the third embodiment, image data 1600 including image data of a plurality of frames continuous in the scan time is used to generate image data of a plurality of frames continuous in the scan time by the continuous time region image data generation unit 1610. Is generated, and the time change process image data generation means 1620 generates time change process image data 1624 consisting of a plurality of frames according to the time change. The composite output means 230 outputs the two images. Since the data is superimposed and sequentially output to the display unit 109, the process in which the image data changes with time can be recognized by comparison with an image over the entire continuous scan time.

DESCRIPTION OF SYMBOLS 101 Probe part 102 Transmission / reception part 103 Image processing part 104 Cine memory part 105 Image display control part 106 Display part 107 Input part 108,908,1608 Control part 109 Display means 200, 900, 1600 Image data 210 Infiltration area image data generation means 211, 911, 1611 Addition means 212 Infiltration area image data 220 Infiltration process image data generation means 221, 921, 1621 Time phase image generation means 222, 922, 1622 Maximum pixel value time image generation means 223, 923, 1623 Start of pixel value increase Time image generation means 224 Infiltration process image data 230 Composite output means 910 Projection image data generation means 912 Projection image data 920 Part change process image data generation means 924 Part change process image data 1610 Continuous time region image data generation means 1612 Duration time region image data 1620 Time change process image data generating means 1624 Time change process image data

Claims (9)

Image data generating means for receiving ultrasonic waves from the subject and generating image data of a plurality of consecutive frames in which the imaging site is different in the thickness direction of the imaging cross section;
Display means for displaying an image based on the image data;
Storage means for storing the image data;
Projection image data generating means for generating projection image data obtained by adding image data including blood flow of a plurality of frames continuously existing in the thickness direction from the image data;
A plurality of frames of blood that are included in the plurality of continuously existing frames that are the basis of the projection image data from the image data and indicate a process in which pixel values change according to changes in the imaging region in the thickness direction. A part change process image data generating means for generating part change process image data including a flow;
A composite output means for superimposing the image of the part change process image data on the image of the projection image data, sequentially changing the part process image data according to the change of the imaging part, and outputting to the display means;
An ultrasound imaging apparatus comprising: An image data generating means for ultrasonically scanning the subject, receiving ultrasonic waves from the subject, and generating image data of a plurality of frames in the subject continuous in a scan time;
Display means for displaying an image based on the image data;
Storage means for storing the image data;
From the image data, continuous time region image data generating means for generating continuous time region image data obtained by adding image data including blood flow of a plurality of frames continuous in the scan time;
A time including a plurality of frames of blood flow indicating a process in which a pixel value changes as the scan time elapses, and is included in the continuous frames based on the continuous time domain image data from the image data. Time-varying process image data generating means for generating change-process image data;
A composite output means for superimposing the image of the time change process image data on the image of the continuous time domain image data, sequentially changing the time change process image data as the scan time elapses, and outputting to the display means; ,
An ultrasound imaging apparatus comprising: The ultrasonic imaging apparatus according to claim 1 or 2,
The ultrasonic imaging apparatus, wherein the image data including blood flow is image data using a contrast agent, image data using CFM (Color Flow Mapping), or image data using a B mode. An interface for receiving tomographic image data of a plurality of consecutive frames in which the imaging site is different in the thickness direction of the imaging cross section;
Display means for displaying an image based on the tomographic image data;
Storage means for storing the tomographic image data;
Projection image data generating means for generating, from the tomographic image data, projection image data obtained by adding tomographic image data including a plurality of frames of blood flow continuously present in the thickness direction;
From the tomographic image data, a plurality of frames that are included in the plurality of continuously existing frames that are the basis of the projection image data and that indicate a process in which pixel values change according to a change in the imaging region in the thickness direction. A part change process image data generating means for generating part change process image data including blood flow;
A composite output means for superimposing the image of the part change process image data on the image of the projection image data, sequentially changing the part process image data according to the change of the imaging part, and outputting to the display means;
An image processing apparatus comprising: An interface for receiving tomographic image data of a plurality of frames in a subject continuous in a scan time of scanning the subject;
Display means for displaying an image based on the tomographic image data;
Storage means for storing the tomographic image data;
From the tomographic image data, continuous time region image data generating means for generating continuous time region image data obtained by adding image data including blood flow of a plurality of frames continuous in the scan time;
A time including a plurality of frames of blood flow indicating a process in which a pixel value changes as the scan time elapses, and is included in the continuous frames based on the continuous time domain image data from the image data. Time-varying process image data generating means for generating change-process image data;
A composite output means for superimposing the image of the time change process image data on the image of the continuous time domain image data, sequentially changing the time change process image data as the scan time elapses, and outputting to the display means; ,
An image processing apparatus comprising: The image processing apparatus according to claim 4 or 5,
The image data including blood flow is ultrasonic image data using a contrast agent, ultrasonic image data using CFM (Color Flow Mapping), or ultrasonic image data using a B mode. Processing equipment. The computer of the image processing device
An interface for receiving tomographic image data of a plurality of consecutive frames in which the imaging part is different in the thickness direction of the imaging cross section;
Display means for displaying an image based on the tomographic image data;
Storage means for storing the tomographic image data;
Projection image data generating means for generating, from the tomographic image data, projection image data obtained by adding tomographic image data including a plurality of frames of blood flow continuously existing in the thickness direction;
From the tomographic image data, a plurality of frames that are included in the plurality of continuously existing frames that are the basis of the projection image data and that indicate a process in which pixel values change according to a change in the imaging region in the thickness direction. A part change process image data generating means for generating part change process image data including blood flow;
A composite output means for superimposing the image of the part change process image data on the image of the projection image data, sequentially changing the part process image data according to the change of the imaging part, and outputting to the display means;
Program to function as. The computer of the image processing device
An interface for receiving tomographic image data of a plurality of frames in a subject that is continuous during a scan time of scanning the subject;
Display means for displaying an image based on the tomographic image data;
Storage means for storing the tomographic image data;
Continuous time region image data generating means for generating, from the tomographic image data, continuous time region image data obtained by adding image data including blood flow of a plurality of frames continuous in the scan time;
A time including a plurality of frames of blood flow indicating a process in which a pixel value changes as the scan time elapses, and is included in the continuous frames based on the continuous time domain image data from the image data. Time-change process image data generation means for generating change process image data,
A composite output means for superimposing the image of the time-change process image data on the image of the continuous-time region image data, and sequentially changing the time-change process image data according to the passage of the scan time and outputting it to the display means;
Program to function as. In the program according to claim 7 or 8,
The image data including blood flow is ultrasound image data using a contrast agent, ultrasound image data using CFM (Color Flow Mapping), or ultrasound image data using a B mode. .

Images