JPH07265303A - Image receiving method and apparatus - Google Patents

Abstract

PURPOSE:To clearly show the structure of a noticeable region by performing display wherein a plurality of projection processing results are organically connected. CONSTITUTION:An image processing apparatus is equipped with a projection processing means 92 executing projection processing taking out predetermined values preset with respect to the respective corresponding pixels of a plurality of image data with respect to a plurality of different predetermined values to form a plurality of IP images, an image forming means 93 forming different color images corresponding to a plurality of the IP images subjected to projection processing by the projection processing means 92 and a display means 8 simultaneously displaying the respective color images formed by the image forming means 93.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing method and an image processing apparatus in an image diagnostic apparatus, and more particularly to an image processing method and an image processing apparatus suitable for clearly displaying the structure of a region of interest.

[0002]

2. Description of the Related Art An ultrasonic diagnostic apparatus is designed such that an ultrasonic probe (probe) is brought into contact with a diseased part of a subject and the frequency is from 1 MHz to a dozen MHz.
The same ultrasonic probe receives the reflected echo signals reflected from the regions of different acoustic impedance in the subject, performs phase adjustment, etc., and then performs image processing and displays on the display device. It is a device for displaying an image of a sample as A mode, B mode, or M mode display.

FIG. 9 is a block diagram showing a configuration example of a conventional system, showing a receiving system and an image processing system in the case of an ultrasonic diagnostic apparatus as an example. An RF (Radio Frequency) echo signal received by an ultrasonic probe (not shown) enters the receiving beamformer 1. In the receiving beam former 1, the phases of the received signals corresponding to the respective oscillating elements are adjusted and then added. The RF echo signal subjected to phasing addition by the reception beam former 1 is logarithmically compressed by a logarithmic amplifier 2 and then enters a wave detector 3.

The detector 3 detects an RF echo signal to remove a high frequency component of 1 MHz to tens of MHz and generate an echo video signal. This echo video signal enters the subsequent A / D converter 4 and is converted into digital data. This digital data is temporarily stored in the memory 5. Here, the digital data stored in the memory 5 is image data in a state in which the scanning direction is not converted.

The image data stored in the memory 5 is read out in order, the scanning direction is converted by the scanning conversion unit 6, and then stored in the B-mode image memory 7. The B-mode image data stored in the B-mode image memory 7 is sent to the display unit 8 and displayed as a B-mode image.

[0006]

However, the B-mode image obtained in this manner is a blurred image, whether on the display of the display unit 8 or on a photograph as a hard copy. In many cases, it is difficult to distinguish the contents.

Further, even when observing a plurality of B-mode images obtained moment by moment in real time, or observing in a cine mode in which a plurality of B-mode images are sequentially updated and displayed, the image is still messy. There is no difference. As a result, it was difficult to clearly understand the entire structure of the subject from the B-mode image.

In such a case, it is conceivable to subject the obtained B-mode image to projection processing. By performing such a projection process, it is expected that the above-mentioned unsettled state will be alleviated and the structure will be easily understood. Here, projection (IP (IntensityProjection)) processing is the maximum value (or minimum value, specific value) for each corresponding pixel for all original images to be processed.
Is a process for obtaining a projection image (IP image) obtained by extracting and projecting.

However, in the projection process, an image is obtained by focusing on the data of any one of the maximum value, the minimum value and the specific value. Although it can be shown, it is difficult to show the entire structure other than the projection processed attention value. For example, when projection processing is performed with the maximum value, no consideration is given to pixels having data other than the maximum value. The same problem occurs when the projection process is executed with other values.

The present invention has been made in view of the above points, and an object thereof is to clearly display the structure of a region of interest by performing a display in which a plurality of projection processing results are organically linked when projection processing is performed. It is to realize an image processing method and an image processing apparatus capable of performing the above.

[0011]

A first means for solving the above problems is a projection process for extracting a predetermined value set in advance for each corresponding pixel of a plurality of image data, for a plurality of different predetermined values. By running multiple
An image processing method is characterized in that an IP image is generated, images of different colors are generated corresponding to the plurality of IP images, and a plurality of images of different colors are displayed at the same time.

The IP image is an image obtained by extracting and projecting the maximum value (or minimum value, specific value) for each pixel corresponding to all original images to be processed. is there.

A second means for solving the above-mentioned problem is to execute a projection process for extracting a predetermined value preset for each corresponding pixel of a plurality of image data for a plurality of different predetermined values. An image characterized by generating a plurality of IP images, generating images of different colors corresponding to each of the plurality of IP images, and alternately displaying the plurality of images of different colors at predetermined time intervals It is a processing method.

A third means for solving the above problem is to execute a projection process for extracting a predetermined value set in advance for each corresponding pixel of a plurality of image data for a plurality of different predetermined values. Projection processing means for generating an IP image, image generation means for generating images of different colors corresponding to the plurality of IP images projected by the projection processing means, and images of each color generated by the image generation means And an image display device for displaying simultaneously.

A fourth means for solving the above problem is to perform a projection process for extracting a predetermined value set in advance for each corresponding pixel of a plurality of image data for a plurality of different predetermined values. Projection processing means for generating an IP image, image generation means for generating images of different colors corresponding to the plurality of IP images projected by the projection processing means, and images of each color generated by the image generation means The image processing apparatus is characterized by further comprising: a display unit that alternately displays at a predetermined time interval.

[0016]

In the image processing method which is the first means for solving the problems, MIP image data,
Multiple IP images such as Min IP image data are generated. Then, different colors are given according to each IP image, and the display according to these colors is simultaneously performed.

Incidentally, the MIP image is an image obtained by extracting and projecting the maximum value for each pixel corresponding to all original images to be processed, and the Min IP image is This is an image obtained by extracting and projecting the minimum value for each pixel corresponding to all original images to be processed, and these images are collectively called an IP image.

In the image processing method as the second means for solving the problem, a plurality of IP images such as MIP image data and Min IP image data are generated by a plurality of projection processes. Then, different colors are provided according to the respective IP images, and the respective IP images provided with these different colors are alternately displayed at a predetermined time interval.

In the image processing apparatus which is the third means for solving the problem, a plurality of IP images such as MIP image data and Min IP image data are generated by a plurality of projection processes. Then, different colors are given according to each IP image, and the display according to these colors is simultaneously performed.

In the image processing apparatus which is the fourth means for solving the problems, a plurality of IP images such as MIP image data and Min IP image data are generated by a plurality of projection processes. Then, different colors are provided according to the respective IP images, and the respective IP images provided with these different colors are alternately displayed at a predetermined time interval.

[0021]

Embodiments of the present invention will now be described in detail with reference to the drawings. FIG. 1 is a configuration diagram showing a schematic configuration of an image processing apparatus according to an embodiment of the present invention, and FIG. 2 is a configuration diagram showing an overall configuration of a receiving system of an ultrasonic diagnostic apparatus using the image processing apparatus of FIG. .

First, the schematic configuration of the receiving system will be described with reference to FIG. Here, a case where a general ultrasonic diagnostic apparatus is taken as an example is shown. The RF echo signal received by the ultrasonic probe (not shown) enters the receiving beamformer 1. In the receiving beam former 1, the phases of the received signals corresponding to the respective oscillating elements are adjusted and then added. The RF echo signal subjected to phasing addition by the reception beam former 1 is logarithmically compressed by a logarithmic amplifier 2 and then enters a wave detector 3. The detector 3 detects the RF echo signal and removes high frequency components to generate an echo video signal. This echo video signal enters the subsequent A / D converter 4 and is converted into digital data. This digital data is temporarily stored in the memory 5. The image data stored in the memory 5 is read out in order, the scanning direction is converted by the scanning conversion unit 6, and then stored in the B-mode image memory 7.

The B-mode image data stored in the B-mode image memory 7 is processed by the image processing unit 9 described below and sent to the display unit 8 to be displayed as a clear B-mode image.

Next, FIG. 1 shows a concrete example of the image processing section 9 which is a characteristic part of the present invention. This image processing unit 9
The image data read from the B-mode image memory 7 is stored for a predetermined number of frames necessary for the projection process, and then MIP processing and Min IP processing are performed on the same pixel data of many image data. The image generation is performed by assigning different colors to the projection processing and the projection processing results, and finally one image (B mode image) is generated.

Here, the projection (IP (Intensity Projectio
n)) processing means, for all original images to be processed,
This is a process of obtaining a projection image (IP image) obtained by extracting and projecting the maximum value (or minimum value, specific value) for each corresponding pixel. That is,
In the case shown in FIG. 3, the same pixels (for example, the black dots of FIG. 3 (1) ... (N)) are compared with the first to Nth original images obtained differently in terms of time or position. The process of extracting the maximum value (or minimum value, specific value) in () is performed for all pixels to obtain one projection image (IP image).

In FIG. 1, the same parts as those in FIG. 2 are designated by the same reference numerals. In FIG. 1, an image buffer 91 stores a plurality of B-mode image data read from the B-mode image memory 7 that are temporally or positionally different for a plurality of frames required for projection processing. The image buffer 91 is composed of a normal frame memory, cine memory, or the like. The projection processing unit 92 simultaneously performs a plurality of projection processes to obtain an IP image obtained by extracting a predetermined value set for each pixel for all the plurality of original images to be processed, and the image generation unit 93 Is to generate images of different colors corresponding to plural kinds of IP images.

First, the basic operation of the image processing method and the image processing apparatus according to an embodiment of the present invention will be described with reference to FIGS. 1 and 4. The B-mode image generated by the well-known method (step in FIG. 4) is stored in the memory 7, and this image data is stored in the image buffer 91 by a required number of sheets. Here, the number of B-mode images required for the subsequent projection processing is stored and stored.

Next, using the B-mode image data stored in the image buffer 91, the projection processing unit 92 simultaneously performs a plurality of types of projection processing (for example, MIP processing, Min IP processing, IP processing of a specific value). Perform (step in FIG. 4).
Multiple types of IP images are generated by these projection processes.

The image generation unit 93 generates an image for each color from the plurality of types of IP images thus generated (step in FIG. 4). Then, an image for display is generated from the image for each color and displayed on the display unit 11 (FIG. 4).
Step).

In this way, the B-mode image is projected before being displayed, and the images are colored and displayed according to the respective projection processes, so that a clear display different from the conventional general B-mode image is displayed. Will be possible.

That is, the display color is different due to the subtle difference in the acoustic impedance in the subject, and a clear display can be obtained as compared with the conventional smoky display. In addition, by combining the primary colors, the complementary colors, the primary colors and their complementary colors, etc., the colors displayed depending on the difference in the projection processing can be distinguished even in the state in which the images obtained by the respective projection processing are overlapped. Also, the overlapping portion can be discriminated from the mixed color.
As a result, the projection processing results are organically linked and displayed, and it becomes possible to distinguish between the original color alone and the overlapping colors, and the structure of the part of interest (overlapping projection processing results) It is possible to clearly indicate the condition.

Next, an example (specific example) of the image processing apparatus and the image processing method of one embodiment of the present invention will be described with reference to the block diagram of the specific configuration shown in FIG. 5 and the flowchart of FIG. 5, the same parts as those in FIG. 2 are designated by the same reference numerals. In the image processing apparatus shown in FIG. 5, the image buffer 91 stores a plurality of B-mode image data read from the B-mode image memory 7 that differ in terms of time or position, for a plurality of frames required for projection processing. . The projection processing unit 92 simultaneously performs a plurality of projection processes to obtain an IP image obtained by extracting a predetermined value set for each pixel for all the plurality of original images to be processed, and the image generation unit 93 Is to generate images of different colors corresponding to plural kinds of IP images. Further, in FIG. 5, the projection processing unit 9
Reference numeral 2 indicates that three types of processing, that is, MIP processing, Min IP processing, and average (Ave) processing are executed, and the image generation unit 93 generates an image of RBG three primary colors corresponding to the three types of projection processing. What is displayed on the display unit 11 is shown as an example. Here, the averaging process is a process for obtaining an image by performing an averaging process on each corresponding pixel for all original images to be processed.

The operation of this embodiment will be described below with reference to the flow chart of FIG. First, the B-mode image generated by the well-known method (step in FIG. 6) is stored in the memory 7, and this image data is stored in the image buffer 91 by the required number of sheets. Here, the number of B-mode images required for the subsequent projection processing is stored and stored.

Next, using the B-mode image data stored in the image buffer 91, the projection processing unit 92 simultaneously performs a plurality of types of projection processing (for example, MIP processing, Min IP processing, IP processing with a specific value). Do (5 steps,
', ”).

Here, the projection processing unit 92 uses the maximum value M
It is composed of a MIP processing unit 92a that executes IP processing, a Min IP processing unit 92b that executes Min IP processing with a minimum value, and an averaging processing unit 92c that executes averaging processing.

Then, the image generator 93 receives a plurality of types of projection processing results and generates images of different colors corresponding to those IP images (steps "," in FIG. 6). The R generation unit 93a, the G generation unit 93b, and the B generation unit 93c according to the three types of projection processing.
Generates an image of three primary colors of R (red) / G (green) / B (blue). In this case, if the display unit 11 receives R / G / B input signals, the output of each generation unit is displayed by the display unit 1.
1 (step in FIG. 6). As a result, the IP image processed by MIP is displayed in R, and Min IP
The processed IP image is displayed in G and averaged
The IP image is displayed as B. And these three types
The overlapping parts of the IP image follow the rule of additive color mixing,
The overlap between R and G is Y (yellow), and the overlap between R and B is Mg
(Magenta), the overlap between G and B is displayed as Cy (cyan). Further, the overlapping portion of all RGB is displayed as white. If the brightness is low for all colors, it is displayed as black. This allows you to clearly see how the IP images overlap. It should be noted that there is a portion that is reproduced as a more subtle halftone color due to the difference in the luminance of each color.

Incidentally, here, as the projection processing, MIP processing,
Although Min IP processing and averaging processing are taken as examples, combinations using other processing (distributed processing, etc.) and combinations other than 3 types (2 types, 4 types or more) are also possible.

In the image generation section, R / G / B is taken as an example, but other colors are possible. For example, a combination of complementary colors, a combination of primary colors and complementary colors, and the like. That is, as a combination of colors when generating the above-described image for each color, it is possible to distinguish each color when they are displayed at the same time, and the mixed color in the overlapped portion is used. It is desirable that the combination is such that it is possible to determine how many colors are mixed. As an example, colors that meet the conditions of such a combination are primary colors (red (R)
/ Green (G) / Blue (B)) combination, complementary color (yellow (
Yl) / magenta (Mg) / cyan (Cy)), primary color and complementary color (Yl / B, R /
Cy, Mg / G), etc. are considered. For example, the primary color (R
/ G / B) combination, in addition to the original primary colors,
By superimposing these, yellow (Yl) / magenta (M
g) / cyan (Cy) / white (Wt) is generated,
Colors mixed by overlapping (yellow (Yl) / magenta (
It is possible to estimate the ratio of colors (R / G / B) before combining from (Mg) / cyan (Cy) / white (Wt)).
It should be noted that the above color combinations may be any combination as long as the allocation of the original colors can be understood from the final display color, and the order of the combination does not matter. For example, MIP
For each image of processing, Min IP processing, averaging processing,
R, G, B may be assigned or G, B, R may be assigned. Further, as the color in the above case, it is possible to assign an achromatic color (monochrome) in addition to the chromatic color, and it is also possible to combine the chromatic color and the achromatic color.

Further, as shown in FIG. 7, there are two types of projection processing in the projection processing unit 92 (arbitrary combination of MIP and Min P, etc.), and image generation in the image generation unit 93 is performed with primary colors and complementary colors. It is also possible to combine them. In such a case, by combining the images of the two types of projection processing results with the primary colors and their complementary colors (R and Cy, G and Mg, and B and Y), overlapping is achieved as in the case of the above-described three primary color display. The part is displayed as white, and the overlap becomes clear.
In this case, the video output unit 93e generates the RBG output for display and the composite output from the two types of images of the primary color and the complementary color.

FIG. 8 is a block diagram showing the configuration of another embodiment of the present invention. Here, as in FIG. 7, the projection processing unit 92 performs two types of projection processing, and the R generation unit 93a and the Cy generation unit 93d in the image generation unit 93 generate two types of R and Cy images. There is. When the display unit 11 alternately displays the even field / odd field images in an interlaced manner, the alternate display processing unit 93f receives the two types of R and Cy images and receives the image from the R generation unit 93a. To the memory area of the odd field, and the image from the Cy generation unit 93d is taken into the memory area of the even field. Then, the two types of images captured by the alternate display processing unit 93f are alternately displayed for each field in the display unit 11.
Output to. In such a case, since the two types of images appear to overlap due to the afterglow time of the display unit 11 and the afterimage of the observer's eyes, each image (R, Cy) and its overlapping state (white) as in the above embodiment. ) Becomes clear.

In this embodiment, when the display unit 11 is a non-interlaced display in which the image is updated frame by frame, the alternate display processing unit 93f is provided with a frame memory for two screens and the captured image is acquired. Are output alternately. Further, even when the number of types of projection processing is three or more, the memory area of the alternate display processing unit 93f is increased,
Similar operations can be realized by sequentially displaying each.

In the above embodiment, the case of combining IP images by ultrasonic waves has been described.
(Magnetic Resonance Imaging) It is also possible to use it for an IP image by a device or an IP image by a CT scanner. Further, the case where the projection processing and the averaging processing of the maximum value and the minimum value are combined has been described as an example, but it is also possible to use an IP image projected with a specific value other than the maximum value and the minimum value. In addition, parallel processing, time-division processing, and the like are conceivable as the plurality of projection processings, and various processing methods capable of processing substantially simultaneously can be used.

As described above, a plurality of IP images are generated by executing a projection process for extracting a predetermined value set in advance for each corresponding pixel of a plurality of image data for a plurality of different predetermined values, According to the image processing method, which is characterized by generating images of different colors corresponding to each of the plurality of IP images and displaying the plurality of images of different colors at the same time, the MIP image data is processed by the plurality of projection processes. , Multiple IP images such as Min IP image data are generated, different colors are given to each IP image, and the display according to these colors is performed simultaneously. As a result, the projection processing results are organically linked to each other, and it becomes possible to distinguish between the original color alone and the overlapping areas of the colors. It becomes possible to easily identify the structure of the site.

A plurality of IP images are generated by executing a projection process for extracting a predetermined value set in advance for each corresponding pixel of a plurality of image data for a plurality of different predetermined values. According to the image processing method, which is characterized in that images of different colors are generated corresponding to the respective images, and the plurality of images of these different colors are alternately displayed at a predetermined time interval, the MIP is performed by a plurality of projection processes. Image data, Min IP
A plurality of IP images such as image data are generated, different colors are given according to the respective IP images, and the respective IP images provided with these different colors are alternately displayed at a predetermined time interval. As a result, the projection processing results are organically linked to each other, and it becomes possible to distinguish between the original color alone and the overlapping areas of the colors. It becomes possible to easily identify the structure of the site.

Projection processing means for generating a plurality of IP images by executing a projection processing for extracting a predetermined value set in advance for each corresponding pixel of a plurality of image data, for a plurality of different predetermined values, The image processing means includes image generation means for generating images of different colors corresponding to the plurality of IP images projected by the projection processing means, and display means for simultaneously displaying the images of the respective colors generated by the image generation means. According to the image processing device characterized by the above, the MIP image data, Mi
n Multiple IP images such as IP image data are generated and
Different colors are given according to the IP image, and the display according to these colors is simultaneously performed.

As a result, the projection processing results are organically linked to each other, and it is possible to distinguish the original color alone portion and the color overlapping portion, and the projection processing results are overlapped. It becomes possible to easily identify the structure of the site of interest from the condition.

Projection processing means for generating a plurality of IP images by executing a projection processing for extracting a predetermined value set in advance for each corresponding pixel of a plurality of image data, for a plurality of different predetermined values, Image generation means for generating images of different colors corresponding to a plurality of IP images projected by the projection processing means, and images of each color generated by the image generation means are alternately displayed at predetermined time intervals. According to the image processing apparatus characterized by including the display means, a plurality of projection processings such as MIP image data and Min IP image data are performed.
An IP image is generated, a different color is given to each IP image, and the IP images given the different colors are alternately displayed at a predetermined time interval. As a result, a display in which the projection processing results are organically linked is performed,
It becomes possible to distinguish the original color alone part and the part where the colors are overlapped, and it is possible to easily identify the structure of the site of interest from the degree of overlap of the projection processing results.

[0048]

As described above in detail, according to the present invention, a plurality of different types of projection processing are performed on image data, coloring is performed according to each projection processing, and the plurality of projection processing results are classified by color. By combining the display of
The projection processing results are organically linked and displayed, and it becomes possible to distinguish the original color alone and the area where the colors are overlapped, and the structure of the part of interest from the overlap of the projection processing results. It is possible to realize an image processing method and an image processing apparatus capable of easily identifying the.

[Brief description of drawings]

FIG. 1 is a configuration diagram showing a configuration of an image processing unit according to an embodiment of the present invention.

FIG. 2 is a configuration diagram of an ultrasonic diagnostic apparatus using an image processing unit according to an embodiment of the present invention.

FIG. 3 is an explanatory diagram illustrating an example of a processing example of IP processing.

FIG. 4 is a flowchart of an operation of an image processing unit and an image processing method.

FIG. 5 is a configuration diagram showing a configuration of an image processing unit according to an embodiment of the present invention.

FIG. 6 is an operation of an image processing unit and an image processing method (specific example).
It is a flowchart of.

FIG. 7 is a configuration diagram showing a configuration of an image processing unit according to an embodiment of the present invention.

FIG. 8 is a configuration diagram showing a configuration of an image processing unit according to an embodiment of the present invention.

FIG. 9 is a configuration diagram of a conventional ultrasonic diagnostic apparatus.

[Explanation of symbols]

 9 image processing unit 91 image buffer 92 projection processing unit 92a MIP processing unit 92b Min IP processing unit 92c average processing unit 93 image generation unit 93a R generation unit 93b G generation unit 93c B generation unit 93d Cy generation unit 93e video output unit 93f alternating Display processing unit

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Yasuto Takeuchi 127 GE Yokogawa Medical Systems Co., Ltd., 4-7 Asahigaoka, Hino City, Tokyo

Claims (4)

[Claims] 1. A plurality of IP images are generated by executing a projection process for extracting a predetermined value set in advance for each corresponding pixel of a plurality of image data for a plurality of different predetermined values. An image processing method characterized by generating images of different colors corresponding to respective images and displaying a plurality of images of these different colors at the same time. 2. A plurality of IP images are generated by executing a projection process for extracting a predetermined value set in advance for each corresponding pixel of a plurality of image data for a plurality of different predetermined values. An image processing method characterized in that images of different colors are generated corresponding to respective images, and a plurality of images of these different colors are displayed alternately at predetermined time intervals. 3. A projection processing unit for generating a plurality of IP images by executing a projection process for extracting a predetermined value set in advance for each corresponding pixel of a plurality of image data, for a plurality of different predetermined values. The image processing means includes image generation means for generating images of different colors corresponding to the plurality of IP images projected by the projection processing means, and display means for simultaneously displaying the images of the respective colors generated by the image generation means. An image processing device characterized by the above. 4. A projection processing unit for generating a plurality of IP images by executing a projection process for extracting a predetermined value set in advance for each corresponding pixel of a plurality of image data, for a plurality of different predetermined values. Image generation means for generating images of different colors corresponding to the plurality of IP images projected by the projection processing means, and images of each color generated by the image generation means are alternately displayed at predetermined time intervals. An image processing apparatus comprising a display means.