US20060098892A1 - Image processing device - Google Patents
Image processing device Download PDFInfo
- Publication number
- US20060098892A1 US20060098892A1 US10/522,027 US52202705A US2006098892A1 US 20060098892 A1 US20060098892 A1 US 20060098892A1 US 52202705 A US52202705 A US 52202705A US 2006098892 A1 US2006098892 A1 US 2006098892A1
- Authority
- US
- United States
- Prior art keywords
- image
- input image
- edge
- processing device
- recursive filtering
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 title claims abstract description 57
- 230000006835 compression Effects 0.000 claims abstract description 16
- 238000007906 compression Methods 0.000 claims abstract description 16
- 238000001914 filtration Methods 0.000 claims description 32
- 230000015654 memory Effects 0.000 claims description 18
- 238000009499 grossing Methods 0.000 claims description 14
- 238000012935 Averaging Methods 0.000 claims description 7
- 230000003111 delayed effect Effects 0.000 claims description 2
- 238000004321 preservation Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 9
- 210000004204 blood vessel Anatomy 0.000 description 4
- 238000003745 diagnosis Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005259 measurement Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 230000002685 pulmonary effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/40—Image enhancement or restoration using histogram techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/92—Dynamic range modification of images or parts thereof based on global image properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/20—Circuitry for controlling amplitude response
- H04N5/205—Circuitry for controlling amplitude response for correcting amplitude versus frequency characteristic
- H04N5/208—Circuitry for controlling amplitude response for correcting amplitude versus frequency characteristic for compensating for attenuation of high frequency components, e.g. crispening, aperture distortion correction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20016—Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
Definitions
- the present invention relates to an image processing device and, more particularly, to an image processing device which enhances contrast for medium-to-fine details (a catheter, blood vessels, etc.) of an image by compressing low-frequency components of the image collected by a measurement section of an image diagnosis apparatus or the like.
- medium-to-fine details a catheter, blood vessels, etc.
- DRC processing is processing for compressing low-frequency components of an input image.
- the recursive filter is a feedback-type filter which performs present smoothing processing by using the results of preceding smoothing processing, and which is capable of efficiently extracting low-frequency components by a smaller amount of computation in comparison with FIR filters.
- a top-bottom/left-right recursive filter performs recursive filtering processing by reciprocating along top-bottom and left-right directions with respect to the direction of scanning on an input image, i.e., four cycles of recursive filtering processing in total, to obtain an unsharpened image free from phase distortion (Japanese Patent Application Laid-open No. 9-182093).
- the conventional recursive filter performing recursive filtering on an input image by reciprocating along top-bottom and left-right directions, i.e., four cycles of recursive filtering processing in total, requires at least a time for input of one frame of image data in obtaining an output value for a particular one of pixels.
- DRC processing using a top-bottom/left-right recursive filter is not suitable for real-time processing because of a large delay due to image processing.
- An object of the present invention is to provide an image processing device having only a short delay due to image processing and a small amount of computation, free from an artifact such as black region in a processed image, and capable of largely improving contrast for a medium-to-fine detail of an image such as a catheter.
- the present invention provides an image processing device comprising recursive filtering means of smoothing an input image and arithmetic means of subtracting an input image smoothed by the recursive filtering means from the original of the input image, wherein the recursive filtering means includes edge setting means of setting at least one edge having a predetermined angle from a scanning line direction of the input image, and control means of smoothing the image to be smoothed in correspondence with the edge set by the edge setting means.
- control means controls the recursive filter so that the recursive filter outputs a smoothed image (unsharpened image, i.e., low-frequency components) smoothed in an edge direction set as the direction of an edge of the input image (e.g., a direction perpendicular to the line of scanning on the image).
- the low-frequency components are compressed into a suitable amount by low-frequency component compression amount setting means and thereafter output.
- Low-frequency component compression means compresses the low-frequency components of the input image by subtracting from the input image the output value from the low-frequency component compression amount setting means.
- the recursive filter can extract the low-frequency components of the input image with an input time delay corresponding to one line of the input image. Therefore, DRC processing has only a short delay due to image processing and is capable of real-time processing by a small amount of computation.
- the feedback rate is changed according to the magnitude of the value of the difference between the input image and the output image one-line before. For example, if the absolute value of the difference value is smaller, the degree of smoothing is increased. If the absolute value of the difference value is larger, the degree of smoothing is reduced. In this way, the influence of phase distortion (an artifact such as a black region due to DRC processing on a falling low-luminance portion of the input image in particular) is prevented and contrast at a medium-to-fine detail of the image such as a catheter is improved.
- phase distortion an artifact such as a black region due to DRC processing on a falling low-luminance portion of the input image in particular
- Phase distortion can be further reduced by providing a plurality of recursive filters which output unsharpened images smoothed on the basis of edges in a plurality of directions, and by combining outputs from the recursive filters.
- FIG. 1 is an essential-portion block diagram showing an embodiment of an image processing device in accordance with the present invention
- FIG. 2 is a block diagram showing an example of a configuration of the recursive filter shown in FIG. 1 ;
- FIG. 3 is a graph showing input-output characteristic of the LUT shown in FIG. 1 ;
- FIG. 4 is an essential-portion block diagram showing another embodiment of the image processing device in accordance with the present invention.
- FIG. 5 is a block diagram showing an example of a configuration of the recursive filter shown in FIG. 4 ;
- FIG. 6 is a diagram used for explanation of the effect of the present invention (limitation of black region in an edge neighborhood region).
- FIG. 7 is a diagram used for explanation of the effect of the present invention (an improvement in contrast at a catheter).
- FIG. 1 is an essential-portion block diagram showing an embodiment of an image processing device in accordance with the present invention.
- an image processing device 10 is constituted by an edge preservation type of recursive filter 12 , a lookup table (LUT) 14 , a delay circuit 16 , and an arithmetic unit 18 .
- Edge referred to herein denotes a portion of an image at which the difference between the values of adjacent pixels in data on one line of the image is large.
- An input image in the image processing device 10 is, in the case of a medical image diagnosis apparatus such as an X-ray imaging apparatus for example, a digital image measured in an X-ray image measurement section including an image intensifier and a CCD camera or an X-ray flat panel detector or the like.
- the digital image is a fluoroscopic image continuously collected as a moving image of 1024 ⁇ 1024 pixels, 4096-step gradation, and 30 frames/second.
- the digital image may alternatively be an image collected in real time by an ultrasonic diagnosis apparatus.
- the above-described input image is input to the edge-preservation-type recursive filter 12 and the delay circuit 16 of the image processing device 10 .
- the edge-preservation-type recursive filter 12 will next be described.
- the edge-preservation-type recursive filter 12 represents recursive filtering processing performed in a direction in which its edge is set or preserved.
- FIG. 2 is a block diagram showing an example of a configuration of the above-described edge-preservation-type recursive filter 12 .
- the edge-preservation-type recursive filter 12 is constituted by line memories 120 and 128 , an arithmetic unit 122 , a LUT (LookUp Table) 124 and an adder 126 .
- a value 0 is set in all addresses in the line memory 128 .
- line data on the first line (uppermost portion) of an input image is stored in the line memory 120 .
- the arithmetic device 122 subtracts, from image data f(t) stored in the line memory 120 , image data g(t ⁇ 1) stored in the line memory 128 at the corresponding address one-line before, thereby obtains a difference value d and outputs the difference value d to the LUT 124 .
- the LUT 124 reads out the table value (k ⁇ d) corresponding to the input difference value d and outputs the table value to the adder 126 .
- Another input to the adder 126 is image data g(t ⁇ 1) output from the line memory 128 .
- the adder 126 adds together these two inputs and outputs the sum value as image data g(t) representing an unsharpened image.
- This image data g(t) is also stored in the line memory 128 and is output from the line memory 128 as one-line delayed image data g(t ⁇ 1).
- FIG. 3 shows an example of the LUT 124 .
- the output from the above-described edge-preservation-type recursive filter 12 is input to the LUT 14 shown in FIG. 1 .
- a low-frequency component compression characteristic according to low-frequency components of the input image can be set.
- input means such as a mouse and keyboard known as input means for computer systems
- the input image on a display unit and a compression characteristic input menu are displayed on a display unit to enable input of a region of interest and various values such as numeric values.
- bit-shift arithmetic device for example may be used as well as the above-described LUT 14 .
- the output from the LUT 14 is input to the arithmetic unit 18 .
- Another input to the arithmetic unit 18 is the input image supplied via the delay circuit 16 .
- the delay circuit 16 is a circuit for coincidence with respect to time between a particular one of the pixels of the input image and the corresponding one of the pixels of the unsharpened image.
- the delay circuit 16 delays the input image by the length of time corresponding to the delay caused by the line memory 120 and so on of the edge-preservation-type recursive filter 12 .
- the arithmetic unit 18 subtracts the output image (unsharpened image) of the LUT 14 from the input image and outputs an image in which the low-frequency components of the input image are compressed.
- the output image output from the arithmetic unit 18 in the form of a digital signal is converted into an analog signal by a D/A converter not shown in the figures, and the resulting image is displayed on a monitor such as a CRT or a liquid crystal monitor.
- low-frequency components are largely compressed in a pulmonary region in an X-ray fluoroscopic image where halation can easily occur. Consequently, halation is reduced and contrast for travel of a catheter, blood vessels, etc. is improved.
- FIG. 4 is an essential-portion block diagram showing another embodiment of the image processing device in accordance with the present invention. Portions in this embodiment identical to those in the image processing device 10 shown in FIG. 1 are indicated by the same reference characters and detailed description for them will be omitted.
- the image processing device 100 shown in FIG. 4 is constituted by three edge-preservation-type recursive filters 12 - 1 , 12 - 2 , and 12 - 3 , an averaging unit 13 , a LUT 14 , a delay circuit 16 and an arithmetic unit 18 .
- Three edge-preservation-type recursive filters 12 - 1 , 12 - 2 , and 12 - 3 output smoothed unsharpened images while respectively preserving edges in a 45° direction (left-downward direction), a 90° direction (downward direction) and a 135° direction (right-downward direction) with respect to the input image.
- FIG. 5 shows an example of a configuration of the edge-preservation-type recursive filters 12 - 1 , 12 - 2 , and 12 - 3 .
- the example of the configuration shown in FIG. 5 differs from the example of the configuration shown in FIG. 2 in that a line-data-shift arithmetic unit 127 is provided. In other respects, the configuration is the same as that shown in FIG. 2 . Detailed description for the same points will be omitted.
- the line-data-shift arithmetic unit 127 shifts line data according to a shift amount ⁇ .
- the line-data-shift arithmetic unit 127 of the 45°-direction edge-preservation-type recursive filter 12 - 1 stores in the line memory 128 line data obtained by one-pixel shifting leftward the line data (unsharpened image) output from the adder 126 , and exceptionally stores 0 for the rightmost pixel in one line.
- the line data output from the 45°-direction edge-preservation-type recursive filter 12 - 1 is obtained as an output of smoothing in the 45° direction.
- the line-data-shift arithmetic unit 127 of the edge-preservation-type recursive filter 12 - 2 stores the output from the adder 126 in the line memory 128 without shifting.
- the line data output from the 90°-direction edge-preservation-type recursive filter 12 - 2 is obtained as an output of smoothing in the 90° direction.
- the edge-preservation-type recursive filter 12 - 2 may be formed without the line-data-shift arithmetic unit 127 , as shown in FIG. 2 .
- the line-data-shift arithmetic unit 127 of the 135°-direction edge-preservation-type recursive filter 12 - 3 stores in the line memory 128 line data obtained by one-pixel shifting rightward the line data (unsharpened image) output from the adder 126 , and exceptionally stores 0 for the leftmost pixel in one line.
- the line data output from the 135°-direction edge-preservation-type recursive filter 12 - 3 is obtained as an output of smoothing in the 135° direction.
- the output images in the respective directions from the above-described edge-preservation-type recursive filters 12 - 1 , 12 - 2 , and 12 - 3 for filtering in three directions are output to the averaging unit 13 , and average values are computed in the averaging unit 13 .
- the averaging unit 13 may perform weighting averaging by weighting the output values from the edge-preservation-type recursive filters 12 - 1 , 12 - 2 , and 12 - 3 for filtering in three directions and thereafter performing averaging for obtaining arithmetic means.
- the output images from the edge-preservation-type recursive filters 12 - 1 , 12 - 2 , and 12 - 3 for filtering in three directions may be combined by setting the weight for the edge-preservation-type recursive filter 12 - 2 to 2 and each of the weights for the edge-preservation-type recursive filters 12 - 1 and 12 - 3 to 3 and obtaining a combination of the addition of the output values therefrom and bit shift (three-bit shift).
- FIG. 6 is a graph showing profiles of an input image, an image DRC processed by using the edge-preservation-type recursive filters for filtering in three directions, and an image DRC processed by using a recursive filters for filtering in three directions (not of the edge preservation type).
- contrast C 2 of the image DRC processed by using the edge-preservation-type recursive filters for filtering in three directions is substantially the same as contrast C 3 of the image DRC processed by using the non-edge-preservation-type recursive filters for filtering in three directions, and contrast C 1 of a catheter in the input image can be improved.
- contrast at medium-to-fine details of an image such as a catheter and blood vessels as well as a guide wire in the case of the conventional art can be improved by DRC processing using edge-preservation-type recursive filters for filtering in a plurality of directions, while limiting black region.
- the delay due to image processing is short; the amount of computation is small; an artifact such as black region is not caused in a processed image; contact for a medium-to-fine detail of an image such as a catheter can be largely improved.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Facsimile Image Signal Circuits (AREA)
Abstract
Description
- The present invention relates to an image processing device and, more particularly, to an image processing device which enhances contrast for medium-to-fine details (a catheter, blood vessels, etc.) of an image by compressing low-frequency components of the image collected by a measurement section of an image diagnosis apparatus or the like.
- On medical images obtained by conventional X-ray image diagnosis apparatuses or the like, dynamic range compression processing (DRC processing) is performed to enhance contrast at a guide wire, a catheter, a blood vessel, etc. DRC processing is processing for compressing low-frequency components of an input image.
- For extraction of low-frequency components in DRC processing, a method (Japanese Patent Application Laid-open No. 9-182093) which uses an infinite impulse response (IIR) filter (also called a recursive filter) is known.
- The recursive filter is a feedback-type filter which performs present smoothing processing by using the results of preceding smoothing processing, and which is capable of efficiently extracting low-frequency components by a smaller amount of computation in comparison with FIR filters.
- A top-bottom/left-right recursive filter performs recursive filtering processing by reciprocating along top-bottom and left-right directions with respect to the direction of scanning on an input image, i.e., four cycles of recursive filtering processing in total, to obtain an unsharpened image free from phase distortion (Japanese Patent Application Laid-open No. 9-182093).
- The conventional recursive filter performing recursive filtering on an input image by reciprocating along top-bottom and left-right directions, i.e., four cycles of recursive filtering processing in total, requires at least a time for input of one frame of image data in obtaining an output value for a particular one of pixels. Thus, DRC processing using a top-bottom/left-right recursive filter is not suitable for real-time processing because of a large delay due to image processing.
- An object of the present invention is to provide an image processing device having only a short delay due to image processing and a small amount of computation, free from an artifact such as black region in a processed image, and capable of largely improving contrast for a medium-to-fine detail of an image such as a catheter.
- To achieve the above-described object, the present invention provides an image processing device comprising recursive filtering means of smoothing an input image and arithmetic means of subtracting an input image smoothed by the recursive filtering means from the original of the input image, wherein the recursive filtering means includes edge setting means of setting at least one edge having a predetermined angle from a scanning line direction of the input image, and control means of smoothing the image to be smoothed in correspondence with the edge set by the edge setting means.
- That is, the control means controls the recursive filter so that the recursive filter outputs a smoothed image (unsharpened image, i.e., low-frequency components) smoothed in an edge direction set as the direction of an edge of the input image (e.g., a direction perpendicular to the line of scanning on the image). The low-frequency components are compressed into a suitable amount by low-frequency component compression amount setting means and thereafter output. Low-frequency component compression means compresses the low-frequency components of the input image by subtracting from the input image the output value from the low-frequency component compression amount setting means. The recursive filter can extract the low-frequency components of the input image with an input time delay corresponding to one line of the input image. Therefore, DRC processing has only a short delay due to image processing and is capable of real-time processing by a small amount of computation.
- Also, in the recursive filter, the feedback rate is changed according to the magnitude of the value of the difference between the input image and the output image one-line before. For example, if the absolute value of the difference value is smaller, the degree of smoothing is increased. If the absolute value of the difference value is larger, the degree of smoothing is reduced. In this way, the influence of phase distortion (an artifact such as a black region due to DRC processing on a falling low-luminance portion of the input image in particular) is prevented and contrast at a medium-to-fine detail of the image such as a catheter is improved.
- Phase distortion can be further reduced by providing a plurality of recursive filters which output unsharpened images smoothed on the basis of edges in a plurality of directions, and by combining outputs from the recursive filters.
-
FIG. 1 is an essential-portion block diagram showing an embodiment of an image processing device in accordance with the present invention; -
FIG. 2 is a block diagram showing an example of a configuration of the recursive filter shown inFIG. 1 ; -
FIG. 3 is a graph showing input-output characteristic of the LUT shown inFIG. 1 ; -
FIG. 4 is an essential-portion block diagram showing another embodiment of the image processing device in accordance with the present invention; -
FIG. 5 is a block diagram showing an example of a configuration of the recursive filter shown inFIG. 4 ; -
FIG. 6 is a diagram used for explanation of the effect of the present invention (limitation of black region in an edge neighborhood region); and -
FIG. 7 is a diagram used for explanation of the effect of the present invention (an improvement in contrast at a catheter). - Preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
-
FIG. 1 is an essential-portion block diagram showing an embodiment of an image processing device in accordance with the present invention. - As shown in
FIG. 1 , animage processing device 10 is constituted by an edge preservation type ofrecursive filter 12, a lookup table (LUT) 14, adelay circuit 16, and anarithmetic unit 18. “Edge” referred to herein denotes a portion of an image at which the difference between the values of adjacent pixels in data on one line of the image is large. - An input image in the
image processing device 10 is, in the case of a medical image diagnosis apparatus such as an X-ray imaging apparatus for example, a digital image measured in an X-ray image measurement section including an image intensifier and a CCD camera or an X-ray flat panel detector or the like. For example, the digital image is a fluoroscopic image continuously collected as a moving image of 1024×1024 pixels, 4096-step gradation, and 30 frames/second. The digital image may alternatively be an image collected in real time by an ultrasonic diagnosis apparatus. - The above-described input image is input to the edge-preservation-type
recursive filter 12 and thedelay circuit 16 of theimage processing device 10. - The edge-preservation-type
recursive filter 12 will next be described. The edge-preservation-typerecursive filter 12 represents recursive filtering processing performed in a direction in which its edge is set or preserved. -
FIG. 2 is a block diagram showing an example of a configuration of the above-described edge-preservation-typerecursive filter 12. The edge-preservation-typerecursive filter 12 is constituted byline memories arithmetic unit 122, a LUT (LookUp Table) 124 and anadder 126. - Before input of frame-by-frame input images, a
value 0 is set in all addresses in theline memory 128. Subsequently, line data on the first line (uppermost portion) of an input image is stored in theline memory 120. Thearithmetic device 122 subtracts, from image data f(t) stored in theline memory 120, image data g(t−1) stored in theline memory 128 at the corresponding address one-line before, thereby obtains a difference value d and outputs the difference value d to theLUT 124. - In the
LUT 124, values (k×d) obtained by multiplying all difference values d (e.g., d=−4095, . . . , 4095) by a filter coefficient k dependent on the input value in the edge-preservation-typerecursive filter 12 are stored in advance. TheLUT 124 reads out the table value (k×d) corresponding to the input difference value d and outputs the table value to theadder 126. Another input to theadder 126 is image data g(t−1) output from theline memory 128. Theadder 126 adds together these two inputs and outputs the sum value as image data g(t) representing an unsharpened image. This image data g(t) is also stored in theline memory 128 and is output from theline memory 128 as one-line delayed image data g(t−1). - The function of the above-described edge-preservation-type
recursive filter 12 is expressed by the following equation: - In the above equation (1), (1−k) represents a feedback rate. If the feedback rate is higher (k is closer to 0), the degree of smoothing is increased. If the feedback rate is lower (k is closer to 1), the degree of smoothing is decreased. When k=1, the edge-preservation-type
recursive filter 12 immediately outputs the input value without performing smoothing. -
FIG. 3 shows an example of theLUT 124. When the difference value d is small (in the case of a non-edge portion), the gradient from the origin (=filter coefficient) k is set to a small value (e.g., k= 1/64). When the difference value d is large (in the case of an edge), the gradient k is set to a large value (e.g., k=1). - The output from the above-described edge-preservation-type
recursive filter 12 is input to theLUT 14 shown inFIG. 1 . In theLUT 14, a low-frequency component compression characteristic according to low-frequency components of the input image can be set. TheLUT 14 may have, for example, an input-output characteristic of y=αx (x: input; y: output; low-frequency component compression rate α=0.2). By various setting means comprising input means such as a mouse and keyboard known as input means for computer systems, the input image on a display unit and a compression characteristic input menu are displayed on a display unit to enable input of a region of interest and various values such as numeric values. - As low-frequency component compression amount setting means, a bit-shift arithmetic device for example may be used as well as the above-described
LUT 14. The extent of bit shift in such a case may be set to about two bits (α=¼). - The output from the
LUT 14 is input to thearithmetic unit 18. Another input to thearithmetic unit 18 is the input image supplied via thedelay circuit 16. Thedelay circuit 16 is a circuit for coincidence with respect to time between a particular one of the pixels of the input image and the corresponding one of the pixels of the unsharpened image. Thedelay circuit 16 delays the input image by the length of time corresponding to the delay caused by theline memory 120 and so on of the edge-preservation-typerecursive filter 12. - The
arithmetic unit 18 subtracts the output image (unsharpened image) of theLUT 14 from the input image and outputs an image in which the low-frequency components of the input image are compressed. The output image output from thearithmetic unit 18 in the form of a digital signal is converted into an analog signal by a D/A converter not shown in the figures, and the resulting image is displayed on a monitor such as a CRT or a liquid crystal monitor. - As a result of the above-described dynamic range compression processing, if the input image has, for example, 4096 levels of gray, the output image has about 3277 levels of gray (=4095 (1−0.2)+1). Thus, low-frequency components are largely compressed in a pulmonary region in an X-ray fluoroscopic image where halation can easily occur. Consequently, halation is reduced and contrast for travel of a catheter, blood vessels, etc. is improved.
-
FIG. 4 is an essential-portion block diagram showing another embodiment of the image processing device in accordance with the present invention. Portions in this embodiment identical to those in theimage processing device 10 shown inFIG. 1 are indicated by the same reference characters and detailed description for them will be omitted. - The image processing device 100 shown in
FIG. 4 is constituted by three edge-preservation-type recursive filters 12-1, 12-2, and 12-3, an averagingunit 13, aLUT 14, adelay circuit 16 and anarithmetic unit 18. - Three edge-preservation-type recursive filters 12-1, 12-2, and 12-3 output smoothed unsharpened images while respectively preserving edges in a 45° direction (left-downward direction), a 90° direction (downward direction) and a 135° direction (right-downward direction) with respect to the input image.
FIG. 5 shows an example of a configuration of the edge-preservation-type recursive filters 12-1, 12-2, and 12-3. - The example of the configuration shown in
FIG. 5 differs from the example of the configuration shown inFIG. 2 in that a line-data-shift arithmetic unit 127 is provided. In other respects, the configuration is the same as that shown inFIG. 2 . Detailed description for the same points will be omitted. - Referring to
FIG. 5 , the line-data-shift arithmetic unit 127 shifts line data according to a shift amount β. A shift amount β=−1 is fixedly set in the line-data-shift arithmetic unit 127 of the 45°-direction edge-preservation-type recursive filter 12-1. - The line-data-
shift arithmetic unit 127 of the 45°-direction edge-preservation-type recursive filter 12-1 stores in theline memory 128 line data obtained by one-pixel shifting leftward the line data (unsharpened image) output from theadder 126, and exceptionallystores 0 for the rightmost pixel in one line. Thus, the line data output from the 45°-direction edge-preservation-type recursive filter 12-1 is obtained as an output of smoothing in the 45° direction. - A shift amount β=0 is fixedly set in the line-data-
shift arithmetic unit 127 of the 90°-direction edge-preservation-type recursive filter 12-2. In this case, the line-data-shift arithmetic unit 127 of the edge-preservation-type recursive filter 12-2 stores the output from theadder 126 in theline memory 128 without shifting. Thus, the line data output from the 90°-direction edge-preservation-type recursive filter 12-2 is obtained as an output of smoothing in the 90° direction. The edge-preservation-type recursive filter 12-2 may be formed without the line-data-shift arithmetic unit 127, as shown inFIG. 2 . - A shift amount β=1 is fixedly set in the line-data-
shift arithmetic unit 127 of the 135°-direction edge-preservation-type recursive filter 12-3. The line-data-shift arithmetic unit 127 of the 135°-direction edge-preservation-type recursive filter 12-3 stores in theline memory 128 line data obtained by one-pixel shifting rightward the line data (unsharpened image) output from theadder 126, and exceptionallystores 0 for the leftmost pixel in one line. Thus, the line data output from the 135°-direction edge-preservation-type recursive filter 12-3 is obtained as an output of smoothing in the 135° direction. - The output images in the respective directions from the above-described edge-preservation-type recursive filters 12-1, 12-2, and 12-3 for filtering in three directions are output to the averaging
unit 13, and average values are computed in the averagingunit 13. The averagingunit 13 may perform weighting averaging by weighting the output values from the edge-preservation-type recursive filters 12-1, 12-2, and 12-3 for filtering in three directions and thereafter performing averaging for obtaining arithmetic means. For example, the output images from the edge-preservation-type recursive filters 12-1, 12-2, and 12-3 for filtering in three directions may be combined by setting the weight for the edge-preservation-type recursive filter 12-2 to 2 and each of the weights for the edge-preservation-type recursive filters 12-1 and 12-3 to 3 and obtaining a combination of the addition of the output values therefrom and bit shift (three-bit shift). - The effects of the image processing device according to the present invention will next be described with reference to
FIGS. 6 and 7 . -
FIG. 6 is a graph showing profiles of an input image, an image DRC processed by using the edge-preservation-type recursive filters for filtering in three directions, and an image DRC processed by using a recursive filters for filtering in three directions (not of the edge preservation type). - In the case of DRC processing using the non-edge-preservation-type recursive filters, low-frequency components are excessively subtracted in an edge neighborhood region with respect to the recursive filter processing directions due to phase distortion on the input image, resulting in occurrence of a black region in the DRC processed image (pixel value P=0). In contrast, DRC processing using the edge-preservation-type recursive filters for filtering in three directions according to the present invention ensures a reduction in black region in an edge neighborhood region.
- Also, as shown in
FIG. 7 , contrast C2 of the image DRC processed by using the edge-preservation-type recursive filters for filtering in three directions is substantially the same as contrast C3 of the image DRC processed by using the non-edge-preservation-type recursive filters for filtering in three directions, and contrast C1 of a catheter in the input image can be improved. - That is, contrast at medium-to-fine details of an image such as a catheter and blood vessels as well as a guide wire in the case of the conventional art can be improved by DRC processing using edge-preservation-type recursive filters for filtering in a plurality of directions, while limiting black region.
- According to the present invention, as described above, the delay due to image processing is short; the amount of computation is small; an artifact such as black region is not caused in a processed image; contact for a medium-to-fine detail of an image such as a catheter can be largely improved.
Claims (11)
g(t)=k·f(t)+(1−k)·g(t−1)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2002-213297 | 2002-07-23 | ||
JP2002213297A JP4045422B2 (en) | 2002-07-23 | 2002-07-23 | Image processing device |
PCT/JP2003/009326 WO2004010379A1 (en) | 2002-07-23 | 2003-07-23 | Image processing device |
Publications (2)
Publication Number | Publication Date |
---|---|
US20060098892A1 true US20060098892A1 (en) | 2006-05-11 |
US7593588B2 US7593588B2 (en) | 2009-09-22 |
Family
ID=30767835
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/522,027 Expired - Fee Related US7593588B2 (en) | 2002-07-23 | 2003-07-23 | Edge preservation type image processing device |
Country Status (4)
Country | Link |
---|---|
US (1) | US7593588B2 (en) |
JP (1) | JP4045422B2 (en) |
CN (1) | CN1672175B (en) |
WO (1) | WO2004010379A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080181528A1 (en) * | 2007-01-25 | 2008-07-31 | Sony Corporation | Faster serial method for continuously varying Gaussian filters |
US20080298707A1 (en) * | 2007-05-30 | 2008-12-04 | Mitsubishi Electric Corporation | Image processing apparatus and method and image display apparatus |
US20090141998A1 (en) * | 2007-11-12 | 2009-06-04 | Matsubishi Electric Corporation | Image processing device, image display device, and image processing method therefor |
JP2018108413A (en) * | 2008-10-27 | 2018-07-12 | キヤノンメディカルシステムズ株式会社 | X-ray diagnostic apparatus |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4045422B2 (en) | 2002-07-23 | 2008-02-13 | 株式会社日立メディコ | Image processing device |
TR201810171T4 (en) * | 2006-10-03 | 2018-08-27 | Vestel Elektronik Sanayi Ve Ticaret Anonim Sirketi | A method and apparatus for minimizing annular artifacts in an input image. |
JP4992438B2 (en) * | 2007-01-26 | 2012-08-08 | 株式会社ニコン | Image processing apparatus and image processing program |
CN101540055B (en) * | 2009-04-13 | 2011-05-04 | 浙江大学 | Cartoon stylization method facing online real-time application |
US9478014B2 (en) * | 2012-06-29 | 2016-10-25 | Shimadzu Corporation | Image processing method for extracting linear patterns |
JP2014228926A (en) * | 2013-05-20 | 2014-12-08 | 株式会社朋栄 | Cyclic digital filter and image processing method |
US8831354B1 (en) * | 2014-01-08 | 2014-09-09 | Faroudja Enterprises, Inc. | System and method for edge-adaptive and recursive non-linear filtering of ringing effect |
JP6983801B2 (en) * | 2016-03-23 | 2021-12-17 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Improved image quality by reducing 2-pass temporal noise |
JP6893278B1 (en) * | 2020-12-18 | 2021-06-23 | 株式会社Retail AI | Information processing equipment, methods and computer programs |
Citations (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5757362A (en) * | 1995-01-05 | 1998-05-26 | International Business Machines Corporation | Recursive digital filter using fixed point arithmetic |
US5768405A (en) * | 1993-07-22 | 1998-06-16 | U.S Philips Corporation | Digital image processing method for local determination of the center and the width of objects in the form of contrasting bands on a background |
US5911012A (en) * | 1995-06-30 | 1999-06-08 | U.S. Philips Corporation | Method for the temporal filtering of the noise in an image of a sequence of digital images, and device for carrying out the method |
US6151417A (en) * | 1997-04-08 | 2000-11-21 | U.S. Philips Corporation | System for the processing of a sequence of noisy images and medical examination apparatus including such a system |
US20010038716A1 (en) * | 2000-02-07 | 2001-11-08 | Takashi Tsuchiya | Device and method for image processing |
US20010038718A1 (en) * | 1997-05-09 | 2001-11-08 | Rakesh Kumar | Method and apparatus for performing geo-spatial registration of imagery |
US20020035407A1 (en) * | 1997-04-11 | 2002-03-21 | Matsushita Electric Industrial Co., Ltd. | Audio decoding apparatus, signal processing device, sound image localization device, sound image control method, audio signal processing device, and audio signal high-rate reproduction method used for audio visual equipment |
US20020047911A1 (en) * | 2000-03-23 | 2002-04-25 | Takashi Tsuchiya | Image processing circuit and method for processing image |
US20020094114A1 (en) * | 2000-12-05 | 2002-07-18 | Tetsuo Ogino | Image processing method and apparatus, recording medium and imaging apparatus |
US6445830B1 (en) * | 1998-10-14 | 2002-09-03 | General Electric Company | Method and apparatus for correction of a discrete pixel image |
US6466700B1 (en) * | 1997-12-31 | 2002-10-15 | Koninklijke Philips Electronics N.V. | Method of processing a noisy multidimensional image and medical imaging apparatus for carrying out this method |
US20020159649A1 (en) * | 2001-02-22 | 2002-10-31 | Varian Medical Systems, Inc. | Method and system for reducing correlated noise in image data |
US20020181797A1 (en) * | 2001-04-02 | 2002-12-05 | Eastman Kodak Company | Method for improving breast cancer diagnosis using mountain-view and contrast-enhancement presentation of mammography |
US6511426B1 (en) * | 1998-06-02 | 2003-01-28 | Acuson Corporation | Medical diagnostic ultrasound system and method for versatile processing |
US20030169239A1 (en) * | 2002-03-06 | 2003-09-11 | International Business Machines Corporation | Touch panel, control method, program, and storage medium |
US20030227558A1 (en) * | 2002-05-10 | 2003-12-11 | Jaspers Cornelis Antonie Maria | Digital image enhancing system |
US6823090B2 (en) * | 2000-11-09 | 2004-11-23 | Canon Kabushiki Kaisha | Image processing apparatus and its method, program, and storage medium |
US20040252907A1 (en) * | 2001-10-26 | 2004-12-16 | Tsukasa Ito | Image processing method, apparatus, and program |
US20040264752A1 (en) * | 2003-06-26 | 2004-12-30 | Cline Harvey E. | System and method for segmenting tissue types in dual-echo magnetic resonance images |
US6999634B2 (en) * | 2000-07-18 | 2006-02-14 | Lg Electronics Inc. | Spatio-temporal joint filter for noise reduction |
US7095902B2 (en) * | 2001-03-19 | 2006-08-22 | Minolta Co., Ltd. | Image processing apparatus, image processing method, and program product |
US7127122B2 (en) * | 2001-06-20 | 2006-10-24 | Sony Corporation | Image processing method and image processing apparatus |
US7170635B2 (en) * | 2001-05-29 | 2007-01-30 | Minolta Co., Ltd. | Image processing apparatus, image processing method, and computer program product therefor |
US7177481B2 (en) * | 2000-12-19 | 2007-02-13 | Konica Corporation | Multiresolution unsharp image processing apparatus |
US7265785B2 (en) * | 2002-07-25 | 2007-09-04 | Matsushita Electric Industrial Co., Ltd. | Imaging apparatus and method that provide high resolution under low illumination without substantial S/N degradation |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3706185B2 (en) | 1995-12-25 | 2005-10-12 | 富士写真フイルム株式会社 | Image reproduction method and apparatus |
JPH1049669A (en) | 1996-08-02 | 1998-02-20 | Hitachi Ltd | Method for processing picture |
JPH1153535A (en) | 1997-08-01 | 1999-02-26 | Fuji Photo Film Co Ltd | Method and device for image reproduction |
JP4415236B2 (en) * | 2000-02-07 | 2010-02-17 | ソニー株式会社 | Image processing apparatus and image processing method |
JP4045422B2 (en) | 2002-07-23 | 2008-02-13 | 株式会社日立メディコ | Image processing device |
-
2002
- 2002-07-23 JP JP2002213297A patent/JP4045422B2/en not_active Expired - Fee Related
-
2003
- 2003-07-23 WO PCT/JP2003/009326 patent/WO2004010379A1/en active Application Filing
- 2003-07-23 US US10/522,027 patent/US7593588B2/en not_active Expired - Fee Related
- 2003-07-23 CN CN038173948A patent/CN1672175B/en not_active Expired - Fee Related
Patent Citations (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5768405A (en) * | 1993-07-22 | 1998-06-16 | U.S Philips Corporation | Digital image processing method for local determination of the center and the width of objects in the form of contrasting bands on a background |
US5757362A (en) * | 1995-01-05 | 1998-05-26 | International Business Machines Corporation | Recursive digital filter using fixed point arithmetic |
US5911012A (en) * | 1995-06-30 | 1999-06-08 | U.S. Philips Corporation | Method for the temporal filtering of the noise in an image of a sequence of digital images, and device for carrying out the method |
US6151417A (en) * | 1997-04-08 | 2000-11-21 | U.S. Philips Corporation | System for the processing of a sequence of noisy images and medical examination apparatus including such a system |
US20020035407A1 (en) * | 1997-04-11 | 2002-03-21 | Matsushita Electric Industrial Co., Ltd. | Audio decoding apparatus, signal processing device, sound image localization device, sound image control method, audio signal processing device, and audio signal high-rate reproduction method used for audio visual equipment |
US20010038718A1 (en) * | 1997-05-09 | 2001-11-08 | Rakesh Kumar | Method and apparatus for performing geo-spatial registration of imagery |
US6466700B1 (en) * | 1997-12-31 | 2002-10-15 | Koninklijke Philips Electronics N.V. | Method of processing a noisy multidimensional image and medical imaging apparatus for carrying out this method |
US6511426B1 (en) * | 1998-06-02 | 2003-01-28 | Acuson Corporation | Medical diagnostic ultrasound system and method for versatile processing |
US6445830B1 (en) * | 1998-10-14 | 2002-09-03 | General Electric Company | Method and apparatus for correction of a discrete pixel image |
US20010038716A1 (en) * | 2000-02-07 | 2001-11-08 | Takashi Tsuchiya | Device and method for image processing |
US6724943B2 (en) * | 2000-02-07 | 2004-04-20 | Sony Corporation | Device and method for image processing |
US20020047911A1 (en) * | 2000-03-23 | 2002-04-25 | Takashi Tsuchiya | Image processing circuit and method for processing image |
US6965416B2 (en) * | 2000-03-23 | 2005-11-15 | Sony Corporation | Image processing circuit and method for processing image |
US6999634B2 (en) * | 2000-07-18 | 2006-02-14 | Lg Electronics Inc. | Spatio-temporal joint filter for noise reduction |
US6823090B2 (en) * | 2000-11-09 | 2004-11-23 | Canon Kabushiki Kaisha | Image processing apparatus and its method, program, and storage medium |
US20020094114A1 (en) * | 2000-12-05 | 2002-07-18 | Tetsuo Ogino | Image processing method and apparatus, recording medium and imaging apparatus |
US7177481B2 (en) * | 2000-12-19 | 2007-02-13 | Konica Corporation | Multiresolution unsharp image processing apparatus |
US20020159649A1 (en) * | 2001-02-22 | 2002-10-31 | Varian Medical Systems, Inc. | Method and system for reducing correlated noise in image data |
US7095902B2 (en) * | 2001-03-19 | 2006-08-22 | Minolta Co., Ltd. | Image processing apparatus, image processing method, and program product |
US20020181797A1 (en) * | 2001-04-02 | 2002-12-05 | Eastman Kodak Company | Method for improving breast cancer diagnosis using mountain-view and contrast-enhancement presentation of mammography |
US7170635B2 (en) * | 2001-05-29 | 2007-01-30 | Minolta Co., Ltd. | Image processing apparatus, image processing method, and computer program product therefor |
US7127122B2 (en) * | 2001-06-20 | 2006-10-24 | Sony Corporation | Image processing method and image processing apparatus |
US20040252907A1 (en) * | 2001-10-26 | 2004-12-16 | Tsukasa Ito | Image processing method, apparatus, and program |
US20030169239A1 (en) * | 2002-03-06 | 2003-09-11 | International Business Machines Corporation | Touch panel, control method, program, and storage medium |
US20030227558A1 (en) * | 2002-05-10 | 2003-12-11 | Jaspers Cornelis Antonie Maria | Digital image enhancing system |
US7265785B2 (en) * | 2002-07-25 | 2007-09-04 | Matsushita Electric Industrial Co., Ltd. | Imaging apparatus and method that provide high resolution under low illumination without substantial S/N degradation |
US20040264752A1 (en) * | 2003-06-26 | 2004-12-30 | Cline Harvey E. | System and method for segmenting tissue types in dual-echo magnetic resonance images |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080181528A1 (en) * | 2007-01-25 | 2008-07-31 | Sony Corporation | Faster serial method for continuously varying Gaussian filters |
US20080298707A1 (en) * | 2007-05-30 | 2008-12-04 | Mitsubishi Electric Corporation | Image processing apparatus and method and image display apparatus |
US8150198B2 (en) * | 2007-05-30 | 2012-04-03 | Mitsubishi Electric Corporation | Image processing apparatus and method and image display apparatus |
US20090141998A1 (en) * | 2007-11-12 | 2009-06-04 | Matsubishi Electric Corporation | Image processing device, image display device, and image processing method therefor |
US8300974B2 (en) * | 2007-11-12 | 2012-10-30 | Mitsubishi Electric Corporation | Image processing device, image display device, and image processing method therefor |
JP2018108413A (en) * | 2008-10-27 | 2018-07-12 | キヤノンメディカルシステムズ株式会社 | X-ray diagnostic apparatus |
Also Published As
Publication number | Publication date |
---|---|
CN1672175B (en) | 2010-04-28 |
WO2004010379A1 (en) | 2004-01-29 |
JP2004054726A (en) | 2004-02-19 |
US7593588B2 (en) | 2009-09-22 |
JP4045422B2 (en) | 2008-02-13 |
CN1672175A (en) | 2005-09-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7593588B2 (en) | Edge preservation type image processing device | |
US7317841B2 (en) | System and method for image noise reduction using a minimal error spatiotemporal recursive filter | |
KR100694090B1 (en) | Methods and apparatus of preventing noise boost in image contrast enhancement systems | |
JP4772721B2 (en) | Image processing apparatus and method | |
US8391598B2 (en) | Methods for performing local tone mapping | |
Kim et al. | An image interpolator with image improvement for LCD controller | |
US7483081B2 (en) | Edge compensated feature detector and method thereof | |
US7386183B2 (en) | Method and apparatus for image processing | |
US6760401B2 (en) | Apparatus and method for processing of digital images | |
US20090002562A1 (en) | Image Processing Device, Image Processing Method, Program for Image Processing Method, and Recording Medium Having Program for Image Processing Method Recorded Thereon | |
JP3159465B2 (en) | Image display device | |
JPH10171983A (en) | Method and device for processing picture | |
US8514332B2 (en) | Method and system for non-linear blending in motion-based video processing | |
KR20040106584A (en) | Unit for and method of calculating a sharpened edge | |
US20020027618A1 (en) | Video-apparatus with peaking filter | |
JP2006523409A (en) | Spatial image conversion apparatus and method | |
US20060115152A1 (en) | Image processing apparatus and method | |
JP3326819B2 (en) | Image processing device | |
JPH0647035A (en) | Image processing system | |
JP3206217B2 (en) | Image processing device | |
JPH03198836A (en) | X-ray image processor | |
JP4595294B2 (en) | Image processing device | |
KR100349593B1 (en) | Converted auto regressive filter and filtering method thereof | |
JP2006157453A (en) | Image processing apparatus, image processing method, and imaging apparatus | |
JPH0613271U (en) | TV image quality improvement method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: HITACHI MEDICAL CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SUGENO, SHUJI;IKEDA, SHIGEYUKI;NAKAMURA, TADASHI;REEL/FRAME:017329/0828 Effective date: 20041228 |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
AS | Assignment |
Owner name: HITACHI, LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HITACHI MEDICAL CORPORATION;REEL/FRAME:040545/0254 Effective date: 20160401 |
|
REMI | Maintenance fee reminder mailed | ||
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.) |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20170922 |