JPH09179963A - Picture processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To execute interpolating processing for an insufficient picture obtained by ultrasonic diagnosis or the like by mutually comparing the feature values of respective straight line elements of plural directions and outputting a maximum value and its direction as the processing result of a pixel point. SOLUTION: Three-dimensional pixel data 50A are inputted and the points of near-by pixels around the point of a pixel to be processed are sent to a feature value integrating means 52. The means 52 executes filter processing for finding out a mean value of four kinds of straight lines in the vicinity around the sent center pixel and sends the processed results of the four straight lines to a comparing means 54. The means 54 mutually compares the results of the four straight lines, determines a maximum value and its direction out of the results and sends the determined result to a processing result storing means 56. The means 56 stores the sent result as new three-dimensional picture processing data.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to image processing technology, and more particularly to image processing for medical images using ultrasonic waves and the like.

[0002]

2. Description of the Related Art Currently, images used for ultrasonic medical image processing are mainly two-dimensional. But,
Three-dimensional image processing is becoming mainstream in order to obtain more accurate information.

FIG. 12 is a diagram for explaining line segments conventionally used in two-dimensional image processing. In the two-dimensional image, with respect to the pixel that the line segment 300 crosses, the brightness of the pixel is set to be large by the cross-cutting division, and the line segment is displayed. Such an image corresponds to a boundary line in an image obtained by two-dimensional ultrasonic diagnosis. Also, such an image is three-dimensional,
Corresponds to the plane.

[0004]

However, in such an image of ultrasonic diagnosis, due to the nature of ultrasonic waves, even if a straight line corresponding to a boundary exists, a line segment that is partially cut off as shown in FIG. There are cases where measurement is performed as indicated by 302 and a line segment 304, and for this, it is necessary to perform interpolation work. In addition, such an image corresponds to a plane having a hole as shown in FIG. 3 in three dimensions.

[0005]

In order to solve the above-mentioned problems, the image processing apparatus of the present invention inputs three-dimensional pixel data representing a stereoscopic image to a plane, and inputs the input pixel data. For each point, a plurality of straight lines consisting of a plurality of pixel points centered on each point of this pixel data are assumed for some directions, and means for accumulating the image feature amount on each straight line pixel; The image processing apparatus is characterized by having a comparison means for comparing the feature amounts of the respective linear elements in the respective directions and selecting the maximum value and its direction, and outputting the maximum value and its direction as the processing result for the pixel point. Is.

Further, for a curved surface, three-dimensional pixel data representing a stereoscopic image is input, and for each point of the input pixel data, a plurality of pixel points centering on each point of this pixel data are selected. By assuming a plurality of curves having a certain curvature for several directions and comparing the feature amount of each curve element in each of the plurality of directions with the means for integrating the image feature amount on each curve pixel, the maximum value The image processing apparatus is characterized in that it has a comparing means for selecting the direction and its direction, and outputs the maximum value and the direction as a processing result for the pixel point.

With the above arrangement, the present invention makes it possible to perform an interpolation process for an insufficient image obtained by ultrasonic diagnosis or the like.

[0008]

BEST MODE FOR CARRYING OUT THE INVENTION

(Embodiment 1) FIG. 1 shows an image processing apparatus according to a first embodiment of the present invention.

The operation of this device will be described below. In this image processing device, the three-dimensional pixel data 50 is input,
The points of 5 × 5 neighboring pixels centering on the point of the pixel to be processed are sent to the feature amount integrating means 52.

In the feature quantity accumulating means 52, the neighborhood 5 around the central pixel 102 sent as shown in FIG.
At x5, filter processing for obtaining an average value is performed on the four types of straight lines as shown in FIG. 2B, and the results for the four types of straight lines are sent to the comparison means 54.

The comparison means 54 compares the sent results of the four types of straight lines, determines the maximum value and the direction thereof, and sends the result to the processing result storage means 56.

The processing result storage means 56 stores the sent result as new three-dimensional image processing data.

In the image processing apparatus described above, since the input amount corresponds to the three-dimensional data in the feature amount integrating means in two dimensions, only one axial direction corresponds to one process. Can not. Therefore, the actual operation is as follows.

First, with respect to the input three-dimensional pixel data 50, all the pixel data in the z-axis direction (pixel data in the vicinity of 5 × 5 in the xy plane) are processed and processed. The result is stored in the result storage means 58.

Next, the pixel data stored in the processing result accumulating means 56 is used as a new input for the three-dimensional pixel data 5
0 is set, all pixel data in the y-axis direction (processing is performed on pixel data in the vicinity of the zx plane) are processed, and the results are stored in the processing result storage means 58.

Finally, the pixel data stored in the processing result accumulating means 56 is used as a new input to form three-dimensional pixel data 50, and the pixel data in the vicinity of the yz plane is processed in the x-axis direction. All the pixel data of (1) are processed, and the results are stored in the processing result storage means 58.

That is, assuming that the input image is the plane 104 in FIG. 3, if processing is performed in the z-axis, y-axis, x-axis, etc., 110, 112, 114 in FIG.
All the pixels on the plane are processed sequentially in the arrow direction.

The following is a description of the processed image. When performed along the z axis, the portion 122 in FIG. 4A is generated by the interpolation processing.

However, in FIG. 4A, a pixel shifted by one pixel in the xy plane with respect to the input plane is omitted for clarity. For example, the process in FIG. 4B is equivalent to the process for the plane including 130 in FIG. 4A, and the process in FIG. 4C is equivalent to the process for the plane including 132 in FIG. 4A. As it is, FIG.
Only the portion 250 in FIGS. 4B and 4C is displayed.

Next, when the processing is performed along the y-axis, the condition in the vicinity of the z-axis direction is taken into consideration, so that the pixel of the portion 124 in FIG. 5 is generated by the interpolation processing.

Further, similar processing is performed for the x-axis, and the processing ends. In this description, the process for the x axis is omitted. Therefore, in this way, interpolation can be performed more as shown in FIG.

For the sake of simplification of the description, the pixels themselves are used for the filter this time, and the average is taken.
As shown in FIG. 6, the distance 14 from the center 140 of the pixel is
It is likely that the same can be done by accurately considering 2, 144 and then the subdivided pixels (subpixelation) 146. The straight line 150 in FIG. 6 corresponds to the processing of the filter 3 in FIG.
42, 144 and the intersections 152, 15 of the straight line 150
4x4 sub-pixel 16 including 4, 156, 158
0, 162, 166, 168 represent pixels f51, f42, f
Subpixel 4x4 corresponding to 24 and f15 and including the center of the pixel corresponds to f33.

By doing this, it is possible to finely set the direction in consideration of the degree of calculation processing as shown in FIG.

(Second Embodiment) FIG. 1 shows an image processing apparatus according to a second embodiment of the present invention. The operation of this device will be described below.

In this image processing apparatus, the three-dimensional pixel data 50 is input, and points in the neighborhood of 5 × 5 pixels centered on the point of the pixel to be processed are sent to the feature amount integrating means 52.

The feature amount accumulating means 52 takes the average of pixels arranged in a curved line in the neighboring 5 × 5 pixels similar to that shown in FIG. 2A, and averages the eight types of curves as shown in FIG. 8A. Filter processing for obtaining a value is performed, and the eight types of results are sent to the comparison means 54.

At this time, the eight types of filters are shown in FIG.
As shown in (b), it is almost the same as the curvature of a circle having a radius of 10 pixels.

The comparing means 54 compares the eight kinds sent to it, determines the maximum value and the direction thereof, and sends the result to the processing result accumulating means 56.

The processing result storage means 56 stores the sent results as new three-dimensional image processing data.

In the image processing apparatus described above, since the input image corresponds to three-dimensional data and the feature amount accumulating means corresponds to two-dimensional, only one axial direction corresponds to one processing. Can not. Therefore, the actual operation is as follows.

First, with respect to the input three-dimensional pixel data 50, all the pixel data in the z-axis direction (pixel data in the vicinity of 5 × 5 in the xy plane) are processed, and the processing result is obtained. The result is stored in the storage means 58.

Next, the pixel data stored in the processing result storage means 56 is used as a new input for the three-dimensional pixel data 5
0 is set, and all pixel data in the y-axis direction (processing is performed on pixel data in the vicinity of the zx plane) is performed, and the result is stored in the processing result storage means 58.

Finally, the pixel data stored in the processing result accumulating means 56 is used as a new input to form the three-dimensional pixel data 50, and the pixel data in the vicinity of the yz plane is processed. All the pixel data of are processed and stored in the processing result storage means 58.

That is, assuming that the input image is the plane 104 in FIG. 9, if processing is performed in the z-axis, y-axis, x-axis, etc., 210, 212, 214 in FIG.
All the pixels on the plane are processed sequentially in the arrow direction.

The processed image will be described below. First, when the movement is performed along the z-axis, as shown in FIG.
The portion 22 is generated by the interpolation process.

However, in the present description, the case where one pixel is shifted in the xy plane with respect to the input plane is omitted.

Next, when the processing is performed along the y-axis, the condition in the vicinity of the z-axis direction is taken into consideration, so that the pixel of the portion 224 in FIG. 11 is generated by the interpolation processing.

As described above, the curved shape of the filter in the feature amount integrating means 52 makes it possible to interpolate even a curved shape.

For the sake of simplification of explanation, the pixels themselves arranged in line are used for the filter this time, and the average is taken, but by considering the subdivided pixels (subpixels) in the calculation of the pixel, The same operation as in the first embodiment can be performed, and it becomes possible to set the degree of processing for a finer angle in consideration of the setting.

Also, some kinds of curvatures are prepared in advance, and some of the prepared curvatures are performed, so that it is possible to interpolate pixels with a more fitted curvature.

[0041]

Industrial Applicability As described above, the present invention applies a filtering process to pixels that are three-dimensionally close to a pixel that is partially missing a necessary image obtained by ultrasonic diagnosis or the like. , Interpolation processing can be performed, and a more realistic image can be reproduced.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram of an image processing apparatus according to an embodiment of the present invention.

FIG. 2 is an explanatory diagram of a filter according to the first embodiment of the present invention.

FIG. 3 is an explanatory diagram of an input image according to the same embodiment.

FIG. 4 is an explanatory diagram of interpolation processing in the same embodiment.

FIG. 5 is an explanatory diagram of interpolation processing in the same embodiment.

FIG. 6 is an explanatory diagram of an expanded filter according to the same embodiment.

FIG. 7 is an explanatory diagram of a rotation angle of the filter according to the same embodiment.

FIG. 8 is an explanatory diagram of a filter according to a second embodiment of the present invention.

FIG. 9 is an explanatory diagram of an input image according to the same embodiment.

FIG. 10 is an explanatory diagram of interpolation processing according to the same embodiment.

FIG. 11 is an explanatory diagram of interpolation processing according to the same embodiment.

FIG. 12 is an explanatory diagram of straight lines in the image.

FIG. 13 is an explanatory diagram of line segments in the image.

[Explanation of symbols]

50 three-dimensional pixel data to be input 52 feature amount integrating means 54 comparing means 56 processing result accumulating means 102 central pixel 104 the input image plane 110 to be processed in the first embodiment 110 x in the case of processing in the z-axis direction -Y processing plane 112 zx processing plane when processing in the y-axis direction 114 yz processing plane when processing in the x-axis direction 122 Processing was performed in the z-axis direction in the first embodiment. Pixels interpolated in the case 124 Pixels interpolated when processing is performed in the y-axis direction in the first embodiment 130 When line segments are connected as straight lines in the conventional example and the first embodiment (plane) 132 In the conventional example and the first embodiment, when the line segment is not connected as a straight line (plane) 140 The center of the pixel 142 The distance of the pixel is 1 Concentric circles that indicate and 144 Concentric circles that indicate that the distance between pixels is 2 146 Pixels (subpixels) obtained by subdividing one pixel into 16 divisions (4x4) 150 Straight line for interpolation 152 Intersection at distance of 2 pixels 154 pixels At an intersection distance of 1 156 pixels at an intersection point of 1 pixel 160 at a distance of 2 sub-pixels (4x
4) 160 subpixels at a distance of 2 (4x
4) 162 subpixels at a distance of 1 (4x
4) Sub-pixel (4x) when the distance of 164 pixels is 0
4) Sub-pixel (4x) when the distance of 166 pixels is 1
4) Sub-pixel (4x) when the distance of 168 pixels is 1
4) 180 A straight line showing the angle of rotating the straight line 1 182 A straight line showing the angle of rotating the straight line 2 184 A straight line showing the angle of rotating the straight line 3 186 A straight line showing the angle of rotating the straight line 4 188 A straight line indicating the angle by which the straight line is rotated 5 190 A straight line indicating the angle by which the straight line is rotated 6 202 A central pixel 204 An input image plane to be processed in the first embodiment 210 A process in the z-axis direction X-y processing plane when performing 212 212 z-processing plane when performing processing in the y-axis direction 214 y-z processing plane when performing processing in the x-axis direction 222 In the z-axis direction in the first embodiment Pixels interpolated when processing is performed 224 Pixels interpolated when processing is performed in the y-axis direction in the first embodiment 250 Interpolation by conventional processing Part 300 Straight line 302 Line segment 304 Line segment 306 Line segment 308 Line segment

Claims (2)

[Claims] 1. Three-dimensional pixel data representing a three-dimensional image is input, and for each point of the input pixel data, a straight line consisting of a plurality of pixel points centered on each point of this pixel data is provided. A plurality of directions are assumed, and means for integrating the image feature amount on each straight line pixel and a comparison means for comparing the feature amount of each straight line element in each of the plurality of directions and selecting the maximum value and its direction are provided. An image processing apparatus, wherein the maximum value and its direction are output as a processing result for the pixel point. 2. A three-dimensional pixel data representing a three-dimensional image is input, and a curve having a constant curvature composed of a plurality of pixel points with respect to each point of the input pixel data as a center. A plurality of values for several directions, the means for integrating the image feature amount on each curve pixel is compared with the feature amount of each curve element in each of the plurality of directions, and the maximum value and its direction are selected. And outputting the maximum value and its direction as a processing result for the pixel point.