US6782137B1 - Digital image display improvement system and method - Google Patents
Digital image display improvement system and method Download PDFInfo
- Publication number
- US6782137B1 US6782137B1 US09/448,706 US44870699A US6782137B1 US 6782137 B1 US6782137 B1 US 6782137B1 US 44870699 A US44870699 A US 44870699A US 6782137 B1 US6782137 B1 US 6782137B1
- Authority
- US
- United States
- Prior art keywords
- image
- mid
- intensity values
- values
- dynamic range
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
- 238000000034 method Methods 0.000 title claims abstract description 68
- 238000013507 mapping Methods 0.000 claims abstract description 36
- 230000003044 adaptive effect Effects 0.000 claims abstract description 34
- 230000002708 enhancing effect Effects 0.000 claims abstract description 10
- 230000006870 function Effects 0.000 claims description 53
- 238000012545 processing Methods 0.000 claims description 19
- 238000009499 grossing Methods 0.000 claims description 7
- 238000007781 pre-processing Methods 0.000 claims description 5
- 230000000873 masking effect Effects 0.000 claims description 4
- 238000012805 post-processing Methods 0.000 claims description 4
- 238000004590 computer program Methods 0.000 claims 3
- 239000011159 matrix material Substances 0.000 description 65
- 230000008569 process Effects 0.000 description 17
- 238000003384 imaging method Methods 0.000 description 7
- 238000012935 Averaging Methods 0.000 description 6
- 238000002059 diagnostic imaging Methods 0.000 description 5
- 238000012937 correction Methods 0.000 description 4
- 238000013500 data storage Methods 0.000 description 4
- 238000002591 computed tomography Methods 0.000 description 3
- 238000001914 filtration Methods 0.000 description 3
- 230000014509 gene expression Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000002595 magnetic resonance imaging Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000005312 nonlinear dynamic Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000000844 transformation Methods 0.000 description 2
- 238000002604 ultrasonography Methods 0.000 description 2
- 230000001154 acute effect Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 210000003484 anatomy Anatomy 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 210000003141 lower extremity Anatomy 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000002601 radiography Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 229920006395 saturated elastomer Polymers 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 210000001364 upper extremity Anatomy 0.000 description 1
- 230000005428 wave function Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/94—Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
- G06T5/75—Unsharp masking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10116—X-ray image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20216—Image averaging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
Definitions
- the present invention relates generally to the field of digital image processing, and more particularly to a technique for enhancing the appearance of digital images, such as medical diagnostic images, to more clearly render certain image features while maintaining overall image intensity levels.
- the invention also provided a system and method for enhancing medical diagnostic images, particularly computed radiology and digital x-ray images.
- Digital imaging systems have become increasingly useful in a variety of fields, particularly in medical diagnostic imaging.
- image data is generated that defines characteristics of discrete picture elements or pixels of an image matrix.
- the matrix of pixels when viewed by the observer, forms an overall reconstructed image in which features of interest are visible to the observer.
- the characteristics of the pixels that form the image may be intensity (i.e. gray level), color and the like.
- discrete pixel images are acquired, processed, and displayed typically by varying the intensity of the pixels making up the image matrix to simulate conventional photographic images, or to render images which would have been difficult or impossible to obtain through conventional means.
- Digital imaging systems have been configured to process image data in various manners, depending upon the source of the data, the type of data, and the display technique to be employed.
- image data may be acquired through various modality systems, including magnetic resonance imaging (MRI) systems, computed tomography (CT) systems, x-ray systems, ultrasound systems, and so forth.
- MRI magnetic resonance imaging
- CT computed tomography
- x-ray systems x-ray systems
- ultrasound systems and so forth.
- the image data may be further processed, filtered, enhanced, scaled, and so forth to reduce noise and to render more visible particular features of interest.
- the resulting image may be viewed by a user, such as on a computer monitor or similar display, often referred to as softcopy, or may be output as hard copy, such as on a paper or similar support, or photographic film.
- x-ray images obtained from computed radiography (CR) or digital detectors a high dynamic range is often present in the image due to the inhomogeneity in the attenuation of various materials in the path of radiation used to generate the image data.
- the image dynamic range is typically larger than the dynamic range of a softcopy display device.
- This mismatch in dynamic ranges is further exacerbated by the inherent contrast lost due to multiple wavelengths of the x-ray source.
- some x-ray photons will traverse the subject directly, while other photons will be diverted from their path by intervening material. This phenomenon, often referred to as scatter, can result in additional loss of contrast, particularly when the images are viewed on softcopy displays.
- the present invention provides an image enhancement technique designed to respond to these needs.
- the invention may be applied in a variety of environments, but is particularly well suited to medical diagnostic imaging, wherein image data is displayed on a softcopy displays such as computer or workstation monitors.
- the technique offers the advantage of being applicable both to new image viewing systems or stations, as well as to existing systems by loading of image enhancement software for carrying out the functions envisaged.
- the technique first performs an adaptive equalization operation, in which pixel values are equalized from original values, while maintaining overall appearance of lighter and darker regions corresponding to higher and lower intensity values.
- Adaptive local contrast enhancement is then performed based upon the equalized values to render detailed structures more discernable.
- the contrast enhancement preferably generates a mid-range boosted image, then performs non-linear mapping of the mid-range boosted image onto the dynamic range of the softcopy display device.
- Several different candidate mapping functions may be available for this purpose, the appropriate function being selected based upon the dynamic range of the display device.
- FIG. 1 is a diagrammatical representation of an imaging system for implementing the image enhancement techniques of the present invention
- FIG. 2 is a diagram illustrating an exemplary image acquired through the system of FIG. 1 for enhancement in accordance with the present techniques
- FIG. 3 is a graphical representation of analogous steps in the image enhancement technique of the present invention for performing equalization of overall image features in an adaptive manner to accommodate an effective dynamic range of a softcopy display or similar output, while performing adaptive contrast boosting to enhance feature recognition;
- FIG. 4 is a diagram illustrating exemplary control logic for carrying out the present image enhancement technique
- FIG. 5 is a flow chart representing in greater detail exemplary steps in control logic for performing adaptive equalization in the process of FIG. 4;
- FIG. 6 is a diagrammatical representation of matrix transformations performed in the adaptive equalization steps of FIG. 5;
- FIG. 7 is a flow chart illustrating exemplary control logic for performing adaptive contrast boosting in the process of FIG. 4;
- FIG. 8 is a diagrammatical representation of matrix transformation operations performed in the adaptive contrast boosting steps of FIG. 7;
- FIG. 9 is a graphical representation of non-linear dynamic range mapping transformations implemented in the control logic of FIG. 7 .
- FIG. 1 represents an imaging system 10 which includes an image processing system 12 for carrying out image management operations, such as the present image enhancement technique on image data generated by one or more image acquisition systems 14 .
- the image acquisition systems may be of any suitable type, and in a medical diagnostic imaging environment, may include various modality acquisition systems, such as MRI systems, CT systems, x-ray systems, ultrasound systems, and so forth. It should be noted, that image acquisition systems 14 may also include digitizing systems, such as equipment designed to convert conventional film-based x-ray images to digital data for processing and storage.
- processing circuitry 16 may perform such operations as filtering, dynamic range adjustment, image enhancement, and so forth.
- the processing circuitry may be included in the image acquisition system, or may be part of a post-processing system downstream from the acquisition system.
- Digital image data acquired by the systems 14 and processed by circuitry 16 is applied to a data storage and interface module 18 , which similarly may include one or a plurality of components either local to or remote from the image acquisition systems and processing circuitry.
- the data storage and interface system may include local data storage, short term storage systems, archive systems, picture archiving and communications systems (PACS), and so forth.
- the image data is retrievable from the data storage and interface module 18 for processing and image enhancement in the system 12 .
- system 12 generally includes an image data processing circuit 20 , coupled to a memory circuit 22 .
- the image data processing circuit 20 will typically comprise an appropriate programming code executed by a digital computer based upon the image enhancement technique or routine described below.
- the programming code may be stored within memory circuit 22 , as may certain configuration parameters, image data, and so forth.
- An operator station 24 is coupled to image data processing circuit 20 for access to parameter configurations, image data, reconstructed images, and the like. Operator station 24 also permits an operator to input parameter configurations for performing the enhancement functions described below.
- An archive or long term storage memory device 26 is provided for storage of both raw and processed image data.
- a viewing station 28 coupled to image data processing circuit 20 is provided for viewing reconstructed images based upon the enhanced image data.
- Viewing station 28 includes a softcopy display, such as a conventional or high intensity computer monitor or a plurality of such monitors.
- the viewing station may be further coupled to output devices, such as printers, as well as to input devices, such as standard computer keyboards, digitizers, dictation components, and so forth.
- image data processing circuit 20 is coupled to an interface circuit 30 which permits processed image data, configuration data, and so forth to be transmitted to a remote location, such as one or more client stations 32 served by the image processing system 12 via network links 34 .
- a plurality of viewing stations may be supported by the system, enabling radiologists and clinicians to access and view reconstructed images. Because dynamic ranges of softcopy display devices in the viewing stations may vary, the present technique enables adaptation of the image enhancement process described below to accommodate such different dynamic ranges.
- Imaging system 10 is designed to acquire data defining individual pixels of an image matrix which, when reconstructed renders a meaningful and useful image as illustrated in FIG. 2 .
- features of interest such as internal anatomy of a patient, are visible in the reconstructed image by virtue of contrast between the pixels resulting from varying pixel intensities.
- a chest region is visible in a reconstructed image 36 and includes various features, designated generally by reference numeral 38 in FIG. 2 which are of interest for diagnostic and other purposes.
- certain of these features may be less distinct or distinguishable than would be desired and would be available from more conventional methods, such as photographic film.
- the present technique provides a mechanism for enhancement of such features, while preserving overall image appearance, as defined by more gradual variations in pixel intensities.
- the reconstructed image has a width 40 and a height 42 resulting from juxtaposition of the pixels 44 comprising the matrix.
- the individual pixels are aligned in rows 46 and columns 48 to form the image matrix.
- Varying intensity of the pixels within the matrix then produce generally darker regions as indicated at reference numeral 50 , and generally lighter regions as indicated at reference numeral 52 .
- the generally darker and lighter regions of the image may be considered to correspond to more gradual or lower frequency changes in the pixel intensity, while more sharp or distinct boundaries, edges, and other local features and details, as indicated at reference numeral 54 , are defined by higher frequency or more rapidly changing pixel intensities.
- the features of the reconstructed image may be blurred or less distinguishable from surrounding features and regions due to the limited dynamic range of the softcopy display in rendering the image.
- the present technique is designed to provide for both adaptive equalization of the lighter and darker regions of the image, while enhancing local contrast so as to enable features to be more readily identified and distinguished from the environment.
- FIG. 3 represents a graphical analogy of the processing steps in the present technique as described more fully below.
- the technique may be thought of as processing the raw or pre-processed image data from an initial condition as represented in a first envelope 56 .
- the image data represented analogously as a wave function 58 in envelope 56 of FIG. 3, may be thought of as including a carrier wave 60 representing the gradually changing lighter and darker regions of the reconstructed image, and a higher frequency or detailed wave 62 superimposed on the carrier wave and providing local contrasting detail in the reconstructed image.
- the resulting image data may exceed both upper and lower limits 64 and 66 of the effective dynamic range.
- brighter regions indicated analogously reference numeral 68
- information within darker regions may be indistinguishable, as represented analogously at reference numeral 70 .
- adaptive equalization is first performed on the image data to draw the carrier wave 60 , as represented individually in envelope 72 of FIG. 3, within the bounds of the dynamic range of the output device.
- the carrier wave will fall within the bounds of the dynamic range, while maintaining the relative light and dark appearances of the corresponding regions of the image.
- the mid-region of the resulting image data as represented at reference numeral 76 in FIG. 3, may be preserved, while additional image details available from local contrast or analogously higher frequency image data may be subsequently expanded as indicated at envelope 76 in FIG. 3 .
- This expansion is performed through adaptive contrast boosting to enhance local contrast within brighter and darker regions as indicated at reference numeral 80 in FIG. 3 .
- the resulting image has the appearance of the former image insomuch as the relative brightness and darkness of the more gradually changing pixel intensities is maintained, but includes substantially more contrast for more rapidly changing details to permit these to be distinguished from the surrounding environment.
- control logic 100 begins with access of the image file, as represented at reference numeral 102 .
- the image data may be preprocessed, such as by shrinking the image matrix by a predetermined factor, such as a factor of 2 through neighborhood averaging.
- a predetermined factor such as a factor of 2
- neighborhood averaging consists of averaging the intensities of non-overlapping pixels. For reduction of the image by a factor of 2, then, 2 ⁇ 2 pixel neighborhoods are averaged and the resulting values are inserted into a matrix which will serve as the starting point for the subsequent image enhancement steps.
- the neighborhood averaging preprocessing operation is performed only if particularly fine structures viewable within the reconstructed image are not of particular interest.
- the shrinking operation of the preprocessing step where appropriate facilitates and speeds the image enhancement steps described below.
- a parameter value for the preprocess shrinking may be set to a level of unity.
- the preprocessing step is followed by adaptive equalization of the image data.
- the adaptive equalization process includes shrinking of the image data matrix, smoothing of the image data, equalization of the resulting data, expansion of the data matrix, and construction of an equalized image based upon both the processed image data, and the beginning image data.
- the adaptive equalization process serves to equalize, but low frequency variations in the image data to correspondingly preserve the appearance of lighter and darker regions in the reconstructed image.
- the adaptive equalization process of step 106 is followed by adaptive contrast boosting, as indicated at step 107 in FIG. 4 .
- This process serves to avoid unnecessarily high contrast boost at very strong edges and very low contrast areas in a computationally efficient fashion.
- contrast is boosted.
- the contrast boosting process in the present embodiment, entails shrinking the data matrix, smoothing the image data, generating a gain function, performing spatially independent scaling based upon the gain function, expansion of the data matrix by bilinear interpolation, and unsharp masking of the resulting image data.
- the unsharp masking step provides a mid-frequency boosted image.
- a non-linear mapping operation is then performed on the image data to preserve the mid-frequency boosted image data, while translating image data near the upper and lower extremities of the dynamic range to the useful dynamic range of the softcopy display.
- the adaptive contrast boosting operations may include a final scaling step to produce the final processed image data.
- the image data may be post-processed as indicated at step 250 .
- post-processing may include steps such as window leveling, inversion (such as for emulation of conventional x-ray images), bicubic interpolation and so forth.
- the processed image data is called upon to reconstruct the display image, or is stored for later access and image reconstruction, such as for display on a softcopy display of a viewing station.
- FIG. 5 Exemplary steps in control logic for carrying out the adaptive equalization step 106 of FIG. 4 are summarized in FIG. 5 .
- the adaptive equalization procedure is further illustrated through the diagrammatical representation of FIG. 6 .
- the input data for a beginning matrix g and parameters referred to through the following logical steps are first read by the image data processing circuit.
- the input data defining the matrix g will be determined by the preprocessing step 104 illustrated in FIG. 4, or may be the data directly read from a memory circuit such as memory circuit 22 illustrated in FIG. 1 .
- the parameter values may similarly be stored in the memory circuit, or may be selected by an operator, such as through an operator station 24 or viewing station 28 shown in FIG. 1 .
- values of g avg and a threshold value T are computed.
- the value g avg is the average value of the intensities of pixels comprising the matrix g.
- the threshold value T is set equal to the average value g avg multiplied by a coefficient t, set by the program, or by an operator to a value typically greater than 0, and in the present embodiment to a value of 0.1.
- a reduced image is computed, denoted gshr, by converting the matrix g to the matrix gshr through the application of shrink parameters S 1 and S 2 . Referring to FIG. 6, the original value matrix g, designated by reference numeral 128 in FIG.
- step 112 is converted to the matrix gshr, having dimensions m′ ⁇ n′, as designated by reference numeral 130 .
- this operation is performed by averaging non-overlapping pixel neighborhoods of dimensions S 1 ⁇ S 2 , as indicated at reference numeral 132 , to form single pixels 134 in the matrix gshr.
- the matrix gshr is expanded for later performance of the smoothing operation at step 118 .
- the expansion of matrix gshr is performed by expanding each dimension of the matrix gshr by an input parameter L, which is the dimension of a separable box-car filter.
- the pixel values adjacent to boundaries of the matrix gshr are mirrored into adjacent regions of the expanded matrix gshr-exp as indicated at reference numerals 136 and 138 .
- reference numerals 140 pixels adjacent to the edge of the matrix gshr are inserted into locations along the corresponding dimension L of the additional regions 136 and 138 .
- values of input parameter L may be assigned between 3 and 41, although other values may be employed.
- a threshold mask image gshr-exp-thr is formed.
- This threshold matrix is formed by application of the following rules:
- C 1 is a fixed constant set by either the program or by the operator. In a presently preferred embodiment, C 1 has a value of 0.01.
- the matrices gshr-exp and gshr-exp-thr are next smoothed by use of a box-car filter having a length L.
- these matrices 138 and 134 are therefore converted to matrices 144 and 146 , respectively, by progressive movement of the box-car filter 148 through the expanded matrices.
- the box-car filter will smooth the image by the neighborhood average first along the rows of the image followed by another neighborhood average along the columns of the image. Computationally, this process is performed by the use of two addition operations and two subtraction operations per pixel, irrespective of the magnitude of the dimension L.
- a correction function hshr is computed by dividing the low pass filtered matrices 144 and 146 created by the smoothing operation of step 118 by one another. Specifically, the matrix 144 which is the low pass filtered matrix of the gshr-exp matrix is divided, within the unexpanded bounds, by the corresponding values of matrix 146 , which is the low pass filtered matrix formed from gshr-exp-thr. In this operation, the following rule is applied within the unexpanded coordinates of the pixels:
- hshr max (lpf (gshr-exp), N 1 )/
- N 1 is a constant internal parameter such that 0 is less than N 1 is less than 1.
- N 1 is set to a value of 0.0001. As illustrated in FIG. 6, this operation renders a matrix of dimensions m′ ⁇ n′, as designated by reference numeral 150 .
- a correction function image h of dimensions m ⁇ n, as indicated at reference numeral 152 , is next computed by bilinear interpolation of the matrix hshr.
- this bilinear interpolation provides for expansion of each pixel 154 of the equalization function into a series of adjacent pixels in a neighborhood 156 .
- a corrected image feq is computed as indicated at step 124 of FIG. 5 .
- a corrected image is first computed in accordance with the relation:
- N 2 is a parameter entered by the user, typically between 100 and 5,000. It should be noted that the resulting image is a function both of the correction function and of the original matrix g. From the resulting values, the equalized matrix, represented by reference numeral 158 in FIG. 6, is computed in accordance with the relation:
- a final equalized image f is selected as indicated at step 126 .
- a series of logical rules or expressions are applied for selection of individual pixel values either from the matrix feq or from the original matrix g, depending upon relationships therebetween.
- the presently preferred rules are intended to avoid suppression of higher intensity values from the matrix g, while avoiding equalization of low intensity values.
- Exemplary expressions employed in the presently preferred embodiment may be summarized as follows:
- C 2 is a predetermined parameter, set to a value of 0.01 in the presently preferred embodiment.
- the matrix f designed by the reference numeral 160 is formed by selection in accordance with these criteria from the matrix feq and the original data matrix g.
- FIG. 7 summarizes exemplary control logic for carrying out the adaptive contrast boosting step 107 of FIG. 4 .
- a first step 162 data of a matrix r is read, as well as parameters referred to below through the adaptive contrast boosting steps.
- the data of the matrix r designated by reference numeral 186 in FIG. 8, is identical to the final equalized image data for matrix f illustrated diagrammatically in FIG. 6 . From this image, an average value r avg is computed, along with a threshold value TR, as indicated at step 164 .
- the average value r avg is the average of all of the values of the matrix r, while the value TR is the product of this average value and a fraction tr which is input by the operator or may be set by the program, typically greater than 0, and in the present embodiment is set to a value of 0.1.
- a reduced image matrix rshr is computed as indicated by reference numeral 188 in FIG. 8 .
- the matrix rshr has dimensions m′′ ⁇ n′′ as determined by averaging of pixels in non-overlapping neighborhoods of dimensions SR 1 ⁇ SR 2 , indicated by reference numeral 190 in FIG. 8 . These non-overlapping neighborhood pixels are then converted to single pixels 192 in the rshr matrix.
- the reduced image is expanded to form a matrix rshr-exp, as designated by reference numeral 194 in FIG. 8 .
- this step is performed by expanding the dimensions of the matrix rshr by portions of dimension LR, indicated by reference numeral 196 in FIG. 8 .
- the parameter LR is set to a value of between 3 and 41.
- the expansion process provides pixel values in the expanded regions which are mirrored from the original matrix, as indicated at reference numeral 198 in FIG. 8 .
- a masked image rshr-exp-thr is created by application of the following relations:
- CR 1 is a fixed constant, set to a value of 0.01 in the preferred embodiment.
- the resulting matrices 194 and 200 are next smoothed by a low pass filtering operation. As illustrated in FIG. 8, this operation proceeds by application of a separable box-car filter on the matrices rshr-exp and rshr-exp-thr to produce resulting matrices 202 and 204 , respectively.
- the box-car filter has dimensions LR, and proceeds through the rows and columns as described above in the adaptive equalization process.
- a gain function sshr is computed based upon both of the low pass filtered matrices.
- the matrix sshr designated 208 in FIG. 8, is generated in accordance with the expression:
- sshr max(lpf-rshr-exp, NR 1 )/ max(lpf-rshr-exp-thr, NR 1 ),
- NR 1 is a constant internal parameter set between 0 and 1.
- the value of NR 1 is set to a value of 0.0001.
- the gain function is next scaled to form a matrix ssca, designated 210 in FIG. 8 .
- This scaling function is preferably performed in accordance with the relation:
- ssca ssch*avg(lpf-rshr-exp)/avg(sshr),
- a contrast enhanced image s is next computed by linear interpolation of the scaled gain function.
- the matrix s which has dimensions m ⁇ n, and is designated by reference numeral 212 in FIG. 8, is populated with pixels in neighborhoods 216 derived from each pixel to 14 of the matrix ssca.
- a mid-frequency boosted image p is created by unsharp masking of the matrix s. This step is preferably performed in accordance with the relation:
- NR 2 is a user supplied parameter such that NR 2 >1.
- a non-linear dynamic range mapping function is applied to map the dynamic range of matrix p on to a desired dynamic range of a softcopy display device, as indicated at reference numeral 182 in FIG. 7 .
- the non-linear mapping function expands local contrast within upper and lower regions of the dynamic range as summarized above with reference to FIG. 3 .
- the function is applied, in the form of a lookup table 222 (see FIG. 8) to form a mapped matrix pnlut, designated by reference numeral 220 in FIG. 8 .
- the non-linear mapping function applied at step 182 serves to appropriately map upper and lower regions of the dynamic range of the softcopy display device, while providing different mapping for a mid region.
- An exemplary mapping relation is illustrated in FIG. 9 .
- the non-linear mapping function 224 may be expressed graphically as a relationship between input values along axis 226 , and output values along axis 228 .
- values of the input i.e. of the matrix p
- mapping relationship 238 is applied below the lower boundary of the mid region to bring the lower intensity pixels within this region into the effective dynamic range of the softcopy display device.
- mapping function 240 is applied in the upper region to the right of upper boundary 234 of the mid region.
- the use of the non-linear mapping function of the type illustrated in FIG. 9 permits the dynamic range of the image pixels to be conformed to the dynamic range of the softcopy display device.
- the imaging systems described above may support a wide variety of display devices, typically computer monitors, having different output dynamic ranges.
- the mapping function applied at step 182 is preferably adapted for the dynamic range of each supported display device.
- the dynamic range of the display device may be access, input, or otherwise recognized, and the mapping performed at step 182 adjusted to conform to the display device.
- Other display devices will receive different mapping functions adapted for their specific dynamic ranges.
- a final contrast boosted image pboost is generated from matrix pnlut by scaling in accordance with the following relation:
- pboost( x, y ) pnlut( x, y )* r avg /pnlunt avg ,
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
Abstract
A technique is disclosed for enhancing discrete pixel images in accordance with a desired dynamic range, such as the dynamic range of a softcopy display. Adaptive equalization is first performed on the image data to reduce overall differences between high and low intensity values, while maintaining the overall appearance of light and dark regions of the reconstructed image. Adaptive contrast boosting or enhancement is then performed on the equalized values to bring out details visible by virtue of the enhanced local contrast. The contrast enhancement may include non-linear mapping of a mid-frequency boosted image onto the dynamic range of the softcopy display.
Description
The present invention relates generally to the field of digital image processing, and more particularly to a technique for enhancing the appearance of digital images, such as medical diagnostic images, to more clearly render certain image features while maintaining overall image intensity levels. The invention also provided a system and method for enhancing medical diagnostic images, particularly computed radiology and digital x-ray images.
Digital imaging systems have become increasingly useful in a variety of fields, particularly in medical diagnostic imaging. In systems of this type, image data is generated that defines characteristics of discrete picture elements or pixels of an image matrix. The matrix of pixels, when viewed by the observer, forms an overall reconstructed image in which features of interest are visible to the observer. In general, the characteristics of the pixels that form the image may be intensity (i.e. gray level), color and the like. In medical diagnostic imaging, for example, discrete pixel images are acquired, processed, and displayed typically by varying the intensity of the pixels making up the image matrix to simulate conventional photographic images, or to render images which would have been difficult or impossible to obtain through conventional means.
Digital imaging systems have been configured to process image data in various manners, depending upon the source of the data, the type of data, and the display technique to be employed. For example, in the medical diagnostics field, image data may be acquired through various modality systems, including magnetic resonance imaging (MRI) systems, computed tomography (CT) systems, x-ray systems, ultrasound systems, and so forth. Depending upon the imaging modality, the image data may be further processed, filtered, enhanced, scaled, and so forth to reduce noise and to render more visible particular features of interest. The resulting image may be viewed by a user, such as on a computer monitor or similar display, often referred to as softcopy, or may be output as hard copy, such as on a paper or similar support, or photographic film.
With the advent of softcopy displays, problems have presented themselves which did not occur, or were less pronounced with conventional technologies. For example, in x-ray images rendered on photographic film, a light box was typically used by radiologists to read the resulting images, with excellent contrast and detail being provided by the photographic film. Where softcopy is desired, however, the same features may be less visible due to the limited dynamic range of the display device, or to the inherent limitations in rendering the detail in a manner that enables features of interest to be distinguished comparably to photographic film. This problem is particularly acute in view of the fact that softcopy displays are increasingly popular due to the archiving of large volumes of images in institutions, and to the facility of accessing the images for display at workstations where the radiologist will page through a large number of examinations during a reading session.
In the case of x-ray images obtained from computed radiography (CR) or digital detectors, a high dynamic range is often present in the image due to the inhomogeneity in the attenuation of various materials in the path of radiation used to generate the image data. The image dynamic range is typically larger than the dynamic range of a softcopy display device. This mismatch in dynamic ranges is further exacerbated by the inherent contrast lost due to multiple wavelengths of the x-ray source. Moreover, some x-ray photons will traverse the subject directly, while other photons will be diverted from their path by intervening material. This phenomenon, often referred to as scatter, can result in additional loss of contrast, particularly when the images are viewed on softcopy displays.
Methods have been proposed for controlling or adjusting dynamic range and contrast enhancement, particularly in CR images. These include multi-resolution algorithms, adaptive histogram equalization methods, multi-channel filtering techniques, local range modification techniques, contrast-limited adaptive histogram equalization techniques, “just noticeable difference” adaptive contrast enhancement techniques, and so forth. While adequate for certain applications and situations, these techniques have not, however, provided a satisfactory overall process for generalized image enhancement, but tend to be extremely specific in nature to a body part or image type.
There is a need, therefore, for an improved image enhancement technique which can be applied to digital image data to improve contrast and feature discernability in images, particularly in the medical diagnostics field. There is a particular need, at present, for a technique which may be applied in a straightforward manner to image data for reconstructed images to be viewed on softcopy displays by compressing a dynamic range, while improving the contrast-to-noise ratio without enhancing image artifacts.
The present invention provides an image enhancement technique designed to respond to these needs. The invention may be applied in a variety of environments, but is particularly well suited to medical diagnostic imaging, wherein image data is displayed on a softcopy displays such as computer or workstation monitors. The technique offers the advantage of being applicable both to new image viewing systems or stations, as well as to existing systems by loading of image enhancement software for carrying out the functions envisaged.
In a presently preferred embodiment, the technique first performs an adaptive equalization operation, in which pixel values are equalized from original values, while maintaining overall appearance of lighter and darker regions corresponding to higher and lower intensity values. Adaptive local contrast enhancement is then performed based upon the equalized values to render detailed structures more discernable. The contrast enhancement preferably generates a mid-range boosted image, then performs non-linear mapping of the mid-range boosted image onto the dynamic range of the softcopy display device. Several different candidate mapping functions may be available for this purpose, the appropriate function being selected based upon the dynamic range of the display device.
FIG. 1 is a diagrammatical representation of an imaging system for implementing the image enhancement techniques of the present invention;
FIG. 2 is a diagram illustrating an exemplary image acquired through the system of FIG. 1 for enhancement in accordance with the present techniques;
FIG. 3 is a graphical representation of analogous steps in the image enhancement technique of the present invention for performing equalization of overall image features in an adaptive manner to accommodate an effective dynamic range of a softcopy display or similar output, while performing adaptive contrast boosting to enhance feature recognition;
FIG. 4 is a diagram illustrating exemplary control logic for carrying out the present image enhancement technique;
FIG. 5 is a flow chart representing in greater detail exemplary steps in control logic for performing adaptive equalization in the process of FIG. 4;
FIG. 6 is a diagrammatical representation of matrix transformations performed in the adaptive equalization steps of FIG. 5;
FIG. 7 is a flow chart illustrating exemplary control logic for performing adaptive contrast boosting in the process of FIG. 4;
FIG. 8 is a diagrammatical representation of matrix transformation operations performed in the adaptive contrast boosting steps of FIG. 7; and
FIG. 9 is a graphical representation of non-linear dynamic range mapping transformations implemented in the control logic of FIG. 7.
Referring to the drawings, FIG. 1 represents an imaging system 10 which includes an image processing system 12 for carrying out image management operations, such as the present image enhancement technique on image data generated by one or more image acquisition systems 14. The image acquisition systems may be of any suitable type, and in a medical diagnostic imaging environment, may include various modality acquisition systems, such as MRI systems, CT systems, x-ray systems, ultrasound systems, and so forth. It should be noted, that image acquisition systems 14 may also include digitizing systems, such as equipment designed to convert conventional film-based x-ray images to digital data for processing and storage. Each image acquisition system 14 is coupled to processing circuitry 16 which may perform such operations as filtering, dynamic range adjustment, image enhancement, and so forth. The processing circuitry may be included in the image acquisition system, or may be part of a post-processing system downstream from the acquisition system. Digital image data acquired by the systems 14 and processed by circuitry 16 is applied to a data storage and interface module 18, which similarly may include one or a plurality of components either local to or remote from the image acquisition systems and processing circuitry. In a typical medical diagnostic imaging environment, the data storage and interface system may include local data storage, short term storage systems, archive systems, picture archiving and communications systems (PACS), and so forth. The image data is retrievable from the data storage and interface module 18 for processing and image enhancement in the system 12.
In the diagrammatical representation of FIG. 1, system 12 generally includes an image data processing circuit 20, coupled to a memory circuit 22. The image data processing circuit 20 will typically comprise an appropriate programming code executed by a digital computer based upon the image enhancement technique or routine described below. The programming code may be stored within memory circuit 22, as may certain configuration parameters, image data, and so forth. An operator station 24 is coupled to image data processing circuit 20 for access to parameter configurations, image data, reconstructed images, and the like. Operator station 24 also permits an operator to input parameter configurations for performing the enhancement functions described below. An archive or long term storage memory device 26 is provided for storage of both raw and processed image data. A viewing station 28 coupled to image data processing circuit 20 is provided for viewing reconstructed images based upon the enhanced image data. Viewing station 28 includes a softcopy display, such as a conventional or high intensity computer monitor or a plurality of such monitors. The viewing station may be further coupled to output devices, such as printers, as well as to input devices, such as standard computer keyboards, digitizers, dictation components, and so forth. Finally, image data processing circuit 20 is coupled to an interface circuit 30 which permits processed image data, configuration data, and so forth to be transmitted to a remote location, such as one or more client stations 32 served by the image processing system 12 via network links 34. It should be noted that a plurality of viewing stations may be supported by the system, enabling radiologists and clinicians to access and view reconstructed images. Because dynamic ranges of softcopy display devices in the viewing stations may vary, the present technique enables adaptation of the image enhancement process described below to accommodate such different dynamic ranges.
The reconstructed image, as shown in FIG. 2, has a width 40 and a height 42 resulting from juxtaposition of the pixels 44 comprising the matrix. The individual pixels are aligned in rows 46 and columns 48 to form the image matrix. Varying intensity of the pixels within the matrix then produce generally darker regions as indicated at reference numeral 50, and generally lighter regions as indicated at reference numeral 52. The generally darker and lighter regions of the image may be considered to correspond to more gradual or lower frequency changes in the pixel intensity, while more sharp or distinct boundaries, edges, and other local features and details, as indicated at reference numeral 54, are defined by higher frequency or more rapidly changing pixel intensities.
When viewed on a softcopy display, the features of the reconstructed image may be blurred or less distinguishable from surrounding features and regions due to the limited dynamic range of the softcopy display in rendering the image. The present technique is designed to provide for both adaptive equalization of the lighter and darker regions of the image, while enhancing local contrast so as to enable features to be more readily identified and distinguished from the environment.
FIG. 3 represents a graphical analogy of the processing steps in the present technique as described more fully below. As shown in FIG. 3, the technique may be thought of as processing the raw or pre-processed image data from an initial condition as represented in a first envelope 56. The image data, represented analogously as a wave function 58 in envelope 56 of FIG. 3, may be thought of as including a carrier wave 60 representing the gradually changing lighter and darker regions of the reconstructed image, and a higher frequency or detailed wave 62 superimposed on the carrier wave and providing local contrasting detail in the reconstructed image. When compared to the effective dynamic range of the output device, the resulting image data may exceed both upper and lower limits 64 and 66 of the effective dynamic range. As a result, brighter regions, indicated analogously reference numeral 68, may be saturated at an upper limit of the dynamic range, while information within darker regions may be indistinguishable, as represented analogously at reference numeral 70.
Through the present process, adaptive equalization is first performed on the image data to draw the carrier wave 60, as represented individually in envelope 72 of FIG. 3, within the bounds of the dynamic range of the output device. Following such adaptive equalization, as represented at envelope 74 of FIG. 3, the carrier wave will fall within the bounds of the dynamic range, while maintaining the relative light and dark appearances of the corresponding regions of the image. The mid-region of the resulting image data, as represented at reference numeral 76 in FIG. 3, may be preserved, while additional image details available from local contrast or analogously higher frequency image data may be subsequently expanded as indicated at envelope 76 in FIG. 3. This expansion is performed through adaptive contrast boosting to enhance local contrast within brighter and darker regions as indicated at reference numeral 80 in FIG. 3. The resulting image has the appearance of the former image insomuch as the relative brightness and darkness of the more gradually changing pixel intensities is maintained, but includes substantially more contrast for more rapidly changing details to permit these to be distinguished from the surrounding environment.
Exemplary control logic for performing the image enhancement functions of the present technique are summarized in FIG. 4. This control logic, designated generally by reference numeral 100, begins with access of the image file, as represented at reference numeral 102. At step 104, the image data may be preprocessed, such as by shrinking the image matrix by a predetermined factor, such as a factor of 2 through neighborhood averaging. As will be appreciated by those skilled in the art, the process of neighborhood averaging consists of averaging the intensities of non-overlapping pixels. For reduction of the image by a factor of 2, then, 2×2 pixel neighborhoods are averaged and the resulting values are inserted into a matrix which will serve as the starting point for the subsequent image enhancement steps. In the presently preferred embodiment, the neighborhood averaging preprocessing operation is performed only if particularly fine structures viewable within the reconstructed image are not of particular interest. The shrinking operation of the preprocessing step, however, where appropriate facilitates and speeds the image enhancement steps described below. When no preprocess shrinking is desired, a parameter value for the preprocess shrinking may be set to a level of unity.
As indicated at reference numeral 106 in FIG. 4, the preprocessing step is followed by adaptive equalization of the image data. As described more fully below, the adaptive equalization process includes shrinking of the image data matrix, smoothing of the image data, equalization of the resulting data, expansion of the data matrix, and construction of an equalized image based upon both the processed image data, and the beginning image data. In general, the adaptive equalization process serves to equalize, but low frequency variations in the image data to correspondingly preserve the appearance of lighter and darker regions in the reconstructed image.
The adaptive equalization process of step 106 is followed by adaptive contrast boosting, as indicated at step 107 in FIG. 4. This process, as described more fully below, serves to avoid unnecessarily high contrast boost at very strong edges and very low contrast areas in a computationally efficient fashion. At the intermediate frequencies contrast is boosted. The contrast boosting process, in the present embodiment, entails shrinking the data matrix, smoothing the image data, generating a gain function, performing spatially independent scaling based upon the gain function, expansion of the data matrix by bilinear interpolation, and unsharp masking of the resulting image data. The unsharp masking step provides a mid-frequency boosted image. A non-linear mapping operation is then performed on the image data to preserve the mid-frequency boosted image data, while translating image data near the upper and lower extremities of the dynamic range to the useful dynamic range of the softcopy display. Finally, the adaptive contrast boosting operations may include a final scaling step to produce the final processed image data.
Following the adaptive contrast boosting, the image data may be post-processed as indicated at step 250. In a present embodiment, such post-processing may include steps such as window leveling, inversion (such as for emulation of conventional x-ray images), bicubic interpolation and so forth. At step 252 the processed image data is called upon to reconstruct the display image, or is stored for later access and image reconstruction, such as for display on a softcopy display of a viewing station.
Exemplary steps in control logic for carrying out the adaptive equalization step 106 of FIG. 4 are summarized in FIG. 5. The adaptive equalization procedure is further illustrated through the diagrammatical representation of FIG. 6. At step 108, the input data for a beginning matrix g and parameters referred to through the following logical steps are first read by the image data processing circuit. The input data defining the matrix g will be determined by the preprocessing step 104 illustrated in FIG. 4, or may be the data directly read from a memory circuit such as memory circuit 22 illustrated in FIG. 1. The parameter values may similarly be stored in the memory circuit, or may be selected by an operator, such as through an operator station 24 or viewing station 28 shown in FIG. 1.
At step 110, values of gavg and a threshold value T are computed. The value gavg is the average value of the intensities of pixels comprising the matrix g. The threshold value T is set equal to the average value gavg multiplied by a coefficient t, set by the program, or by an operator to a value typically greater than 0, and in the present embodiment to a value of 0.1. At step 112, a reduced image is computed, denoted gshr, by converting the matrix g to the matrix gshr through the application of shrink parameters S1 and S2. Referring to FIG. 6, the original value matrix g, designated by reference numeral 128 in FIG. 6, has dimensions m ×n, and that step 112 is converted to the matrix gshr, having dimensions m′×n′, as designated by reference numeral 130. As will be appreciated by those skilled in the art, this operation is performed by averaging non-overlapping pixel neighborhoods of dimensions S1×S2, as indicated at reference numeral 132, to form single pixels 134 in the matrix gshr.
At step 114, the matrix gshr is expanded for later performance of the smoothing operation at step 118. As illustrated diagramatically in FIG. 6, the expansion of matrix gshr is performed by expanding each dimension of the matrix gshr by an input parameter L, which is the dimension of a separable box-car filter. As shown in FIG. 6, the pixel values adjacent to boundaries of the matrix gshr are mirrored into adjacent regions of the expanded matrix gshr-exp as indicated at reference numerals 136 and 138. Thus, as shown at reference numerals 140, pixels adjacent to the edge of the matrix gshr are inserted into locations along the corresponding dimension L of the additional regions 136 and 138. In the presently preferred embodiment, values of input parameter L may be assigned between 3 and 41, although other values may be employed.
At step 116 a threshold mask image gshr-exp-thr is formed. This threshold matrix is formed by application of the following rules:
gshr-exp-thr=C1*gavg,
if gshr-exp is>T; and
gshr-exp-thr=0,
if gshr-exp is≦T;
where C1 is a fixed constant set by either the program or by the operator. In a presently preferred embodiment, C1 has a value of 0.01.
Returning to FIG. 5, as indicated at step 118, the matrices gshr-exp and gshr-exp-thr are next smoothed by use of a box-car filter having a length L. As illustrated diagrammatically in FIG. 6, these matrices 138 and 134 are therefore converted to matrices 144 and 146, respectively, by progressive movement of the box-car filter 148 through the expanded matrices. It should be noted that the box-car filter will smooth the image by the neighborhood average first along the rows of the image followed by another neighborhood average along the columns of the image. Computationally, this process is performed by the use of two addition operations and two subtraction operations per pixel, irrespective of the magnitude of the dimension L.
Returning to FIG. 5, at step 120, a correction function hshr is computed by dividing the low pass filtered matrices 144 and 146 created by the smoothing operation of step 118 by one another. Specifically, the matrix 144 which is the low pass filtered matrix of the gshr-exp matrix is divided, within the unexpanded bounds, by the corresponding values of matrix 146, which is the low pass filtered matrix formed from gshr-exp-thr. In this operation, the following rule is applied within the unexpanded coordinates of the pixels:
hshr=max (lpf (gshr-exp), N1)/
max (lpf (gshr-exp-thr), N1);
where max(a, b) is a function which returns the maximum of the values a and b, and N1 is a constant internal parameter such that 0 is less than N1 is less than 1. In a presently preferred embodiment, N1 is set to a value of 0.0001. As illustrated in FIG. 6, this operation renders a matrix of dimensions m′×n′, as designated by reference numeral 150.
As noted at step 122 in FIG. 5, a correction function image h, of dimensions m×n, as indicated at reference numeral 152, is next computed by bilinear interpolation of the matrix hshr. As will be appreciated by those skilled in the art, this bilinear interpolation provides for expansion of each pixel 154 of the equalization function into a series of adjacent pixels in a neighborhood 156.
From the correction function image, a corrected image feq is computed as indicated at step 124 of FIG. 5. In this operation, a corrected image is first computed in accordance with the relation:
f(x, y)=(g(x, y)*h(x, y))/(h(x, y)*h(x, y)+N 2),
where N2 is a parameter entered by the user, typically between 100 and 5,000. It should be noted that the resulting image is a function both of the correction function and of the original matrix g. From the resulting values, the equalized matrix, represented by reference numeral 158 in FIG. 6, is computed in accordance with the relation:
where the value favg is the average of the values of f(x, y) computed in the previous step.
To complete the adaptive equalization operation, a final equalized image f is selected as indicated at step 126. In the presently preferred embodiment, a series of logical rules or expressions are applied for selection of individual pixel values either from the matrix feq or from the original matrix g, depending upon relationships therebetween. Specifically, the presently preferred rules are intended to avoid suppression of higher intensity values from the matrix g, while avoiding equalization of low intensity values. Exemplary expressions employed in the presently preferred embodiment may be summarized as follows:
f(x, y)=g(x, y)
if feq(x, y)<g(x, y); OR
f(x, y)=g(x, y)
if feq(x, y)<1; OR
f(x, y)=g(x, y)
if feq(x, y)>g(x, y) AND g(x, y)<T; OR
f(x, y)=g(x, y)
if (maximum pixel intensity in g)*C2>g(x, y); OR
f(x, y)=feq(x, y),
where C2 is a predetermined parameter, set to a value of 0.01 in the presently preferred embodiment. As will be noted from the foregoing, and from the diagrammatical representation of FIG. 6, the matrix f designed by the reference numeral 160, is formed by selection in accordance with these criteria from the matrix feq and the original data matrix g.
FIG. 7 summarizes exemplary control logic for carrying out the adaptive contrast boosting step 107 of FIG. 4. Referring to FIG. 7, and to the diagrammatical representation of these steps in FIG. 8, as a first step 162, data of a matrix r is read, as well as parameters referred to below through the adaptive contrast boosting steps. In the presently preferred embodiment, the data of the matrix r, designated by reference numeral 186 in FIG. 8, is identical to the final equalized image data for matrix f illustrated diagrammatically in FIG. 6. From this image, an average value ravg is computed, along with a threshold value TR, as indicated at step 164. As in the adaptive equalization steps, the average value ravg is the average of all of the values of the matrix r, while the value TR is the product of this average value and a fraction tr which is input by the operator or may be set by the program, typically greater than 0, and in the present embodiment is set to a value of 0.1.
At step 166 of FIG. 7, a reduced image matrix rshr is computed as indicated by reference numeral 188 in FIG. 8. The matrix rshr has dimensions m″×n″ as determined by averaging of pixels in non-overlapping neighborhoods of dimensions SR1×SR2, indicated by reference numeral 190 in FIG. 8. These non-overlapping neighborhood pixels are then converted to single pixels 192 in the rshr matrix.
At step 168, the reduced image is expanded to form a matrix rshr-exp, as designated by reference numeral 194 in FIG. 8. As described above with respect to the adaptive equalization process, this step is performed by expanding the dimensions of the matrix rshr by portions of dimension LR, indicated by reference numeral 196 in FIG. 8. In a presently preferred embodiment, the parameter LR is set to a value of between 3 and 41. As explained above, the expansion process provides pixel values in the expanded regions which are mirrored from the original matrix, as indicated at reference numeral 198 in FIG. 8.
At step 170 of FIG. 7, a masked image rshr-exp-thr is created by application of the following relations:
rshr-exp-thr=CR1*ravg,
if rshr-exp>TR; AND
rshr-exp-thr=0
if rshr-exp≦TR
where CR1 is a fixed constant, set to a value of 0.01 in the preferred embodiment.
Returning to FIG. 7, as indicated at step 172, the resulting matrices 194 and 200 are next smoothed by a low pass filtering operation. As illustrated in FIG. 8, this operation proceeds by application of a separable box-car filter on the matrices rshr-exp and rshr-exp-thr to produce resulting matrices 202 and 204, respectively. The box-car filter has dimensions LR, and proceeds through the rows and columns as described above in the adaptive equalization process.
At step 174, a gain function sshr is computed based upon both of the low pass filtered matrices. In particular, in the presently preferred embodiment, the matrix sshr, designated 208 in FIG. 8, is generated in accordance with the expression:
where max(a, b) returns the maximum values of a and b, and NR1 is a constant internal parameter set between 0 and 1. In a presently preferred embodiment, the value of NR1 is set to a value of 0.0001.
Returning to FIG. 7, as indicated at step 176, the gain function is next scaled to form a matrix ssca, designated 210 in FIG. 8. This scaling function is preferably performed in accordance with the relation:
where the values avg are the average values of the indicated matrices.
At step 178 illustrated in FIG. 7, a contrast enhanced image s is next computed by linear interpolation of the scaled gain function. As illustrated in FIG. 8, the matrix s, which has dimensions m×n, and is designated by reference numeral 212 in FIG. 8, is populated with pixels in neighborhoods 216 derived from each pixel to 14 of the matrix ssca.
At step 180, a mid-frequency boosted image p is created by unsharp masking of the matrix s. This step is preferably performed in accordance with the relation:
where the value NR2 is a user supplied parameter such that NR2>1.
From the mid-frequency boosted image p, designated by reference numeral 218 in FIG. 8, a non-linear dynamic range mapping function is applied to map the dynamic range of matrix p on to a desired dynamic range of a softcopy display device, as indicated at reference numeral 182 in FIG. 7. The non-linear mapping function expands local contrast within upper and lower regions of the dynamic range as summarized above with reference to FIG. 3. Based upon the values of matrix p, then, the function is applied, in the form of a lookup table 222 (see FIG. 8) to form a mapped matrix pnlut, designated by reference numeral 220 in FIG. 8.
In the presently preferred embodiment, the non-linear mapping function applied at step 182 serves to appropriately map upper and lower regions of the dynamic range of the softcopy display device, while providing different mapping for a mid region. An exemplary mapping relation is illustrated in FIG. 9. As shown in FIG. 9, the non-linear mapping function 224 may be expressed graphically as a relationship between input values along axis 226, and output values along axis 228. In a central region 230, between lower and upper bounds 232 and 234 of the central region, values of the input (i.e. of the matrix p) are mapped in accordance with the relationship identified by the segment of the function 236. Below the lower boundary of the mid region, a different mapping relationship 238 is applied to bring the lower intensity pixels within this region into the effective dynamic range of the softcopy display device. Similarly, in the upper region to the right of upper boundary 234 of the mid region, a different mapping function 240 is applied.
As will be appreciated by those skilled in the art, the use of the non-linear mapping function of the type illustrated in FIG. 9 permits the dynamic range of the image pixels to be conformed to the dynamic range of the softcopy display device. In specific applications, the imaging systems described above may support a wide variety of display devices, typically computer monitors, having different output dynamic ranges. In such cases, the mapping function applied at step 182 is preferably adapted for the dynamic range of each supported display device. In the image enhancement process described above, then, the dynamic range of the display device may be access, input, or otherwise recognized, and the mapping performed at step 182 adjusted to conform to the display device. Other display devices, of course, will receive different mapping functions adapted for their specific dynamic ranges.
To complete the adaptive contrast boosting operation, a final contrast boosted image pboost, designated by reference numeral 242 in FIG. 8, is generated from matrix pnlut by scaling in accordance with the following relation:
where the “avg” values are the average values of the respective matrices.
While the invention may be susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and have been described in detail herein. However, it should be understood that the invention is not intended to be limited to the particular forms disclosed. Rather, the invention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the following appended claims.
Claims (26)
1. A method for enhancing a discrete pixel image, the method comprising the steps of:
(a) adaptively equalizing original intensity values for pixels comprising the image to reduce overall variations between high and low intensity regions; and
(b) boosting local contrast between the intensity values by forming a mid-frequency boosted image and applying a non-linear mapping function to the mid-frequency boosted image to map low and high intensity pixel values to a desired dynamic range.
2. The method of claim 1 , wherein step (a) includes steps of smoothing the intensity values for the pixels, generating a candidate equalized image based upon the smoothed values, and generating a final equalized image based upon pixel values of the candidate equalized image and the original intensity values.
3. The method of claim 2 , wherein the step of generating the candidate equalized image includes steps of generating an equalization function, and generating the candidate equalized image based upon the equalization function and the original intensity values.
4. The method of claim 3 , wherein for generation of the equalized image, values for individual pixels are selected from the candidate equalized image or from the original image values based upon a set of selection criteria.
5. The method of claim 4 , wherein the original image values for individual pixels are selected for the equalized image when the candidate equalized image value for a pixel of interest is less than the original image value for the pixel.
6. The method of claim 1 , wherein step (a) includes steps of shrinking the image, smoothing the image, generating an equalization function based upon the smoothed image, and expanding the equalization function by bilinear interpolation.
7. The method of claim 1 , wherein step (b) includes steps of smoothing the image generated in step (a), generating a gain function based upon the smoothed image, and generating the mid-frequency boosted image based upon the gain function.
8. The method of claim 7 , comprising the steps of scaling the gain function, expanding the scaled gain function, and unsharp masking the scaled gain function to generated the mid-frequency boosted image.
9. The method of claim 1 , wherein the non-linear mapping function maps upper and lower range intensity values of the mid-frequency boosted image to upper and lower ranges of the desired dynamic range, and maps intermediate intensity values of the mid-frequency image substantially unchanged.
10. The method of claim 9 , wherein the non-linear mapping function maps the upper and lower range intensity values linearly within the respective upper and lower ranges.
11. The method of claim 1 , wherein the non-linear mapping function is selected from a plurality of candidate mapping functions based upon a dynamic range of a display device.
12. A method for enhancing a discrete pixel image for softcopy display, the method comprising the steps of:
(a) adaptively equalizing original intensity values for pixels comprising the image to reduce overall variations between high and low intensity regions;
(b) boosting local contrast between the intensity values by forming a mid-frequency boosted image; and
(c) applying a non-linear mapping function for a softcopy display device to the mid-frequency boosted image to map the intensity values to a dynamic range of the softcopy display device.
13. The method of claim 12 , wherein the non-linear mapping function maps upper and lower range intensity values of the mid-frequency boosted image to upper and lower ranges of the softcopy device dynamic range, and maps intermediate intensity values of the mid-frequency image substantially unchanged.
14. The method of claim 13 , wherein the non-linear mapping function maps the upper and lower range intensity values linearly within the respective upper and lower ranges.
15. The method of claim 12 , wherein the non-linear mapping function is selected from a plurality of candidate mapping functions based upon the dynamic range of the softcopy display device.
16. A method for enhancing a discrete pixel image, the method comprising the steps of:
(a) preprocessing image data to shrink an original image by a desired factor;
(b) adaptively equalizing original intensity values for pixels comprising the image to reduce overall variations between high and low intensity regions;
(c) boosting local contrast between the intensity values by forming a mid-frequency boosted image and applying a non-linear mapping function to the mid-frequency boosted image to map low and high intensity pixel values to a desired dynamic range; and
(d) postprocessing the mapped intensity values from step (c) for a softcopy display.
17. The method of claim 16 , wherein the desired factor applied at step (a) is 1.
18. The method of claim 16 , wherein the postprocessing step includes window leveling the mapped intensity values.
19. A system for enhancing and viewing discrete pixel images, the system comprising:
a memory device for storing image data representative of discrete pixel values of a reconstructed image;
a softcopy display station for displaying an enhanced image based upon the image data, the display station having a predetermined dynamic range; and
a data processing circuit configured to perform adaptive equalization of the discrete pixel values of the image data, and to enhance local contrast of the equalized values to adapt the image data to the dynamic range of the display station.
20. The system of claim 19 , wherein the data processing circuit is configured to generate a mid-frequency boosted image based upon the equalized values, and to non-linearly map the mid-frequency boosted image to the dynamic range of the display station.
21. The system of claim 20 , wherein the non-linear mapping performed by the data processing circuit maps upper and lower range intensity values of the mid-frequency boosted image to upper and lower ranges of the dynamic range, and maps intermediate intensity values of the mid-frequency image substantially unchanged.
22. The system of claim 21 , wherein the non-linear mapping maps the upper and lower range intensity values linearly within the respective upper and lower ranges.
23. The system of claim 20 , wherein the non-linear mapping is based upon a mapping function selected from a plurality of candidate mapping functions based upon the dynamic range of the softcopy display station.
24. A computer program for enhancing a discrete pixel image, the program comprising:
a machine readable medium for storing machine readable configuration code; and
configuration code stored on the machine readable medium, the code comprising instructions for adaptively equalizing original intensity values for pixels comprising an image to reduce overall variations between high and low intensity regions, boosting local contrast between the intensity values by forming a mid-frequency boosted image, and applying a non-linear mapping function for a softcopy display device to the mid-frequency boosted image to map the intensity values to a dynamic range of the softcopy display device.
25. The computer program of claim 24 , wherein the code includes instructions for determining the dynamic range of the softcopy display device.
26. The computer program of claim 25 , wherein the non-linear mapping function is selected from a plurality of candidate mapping functions based upon the dynamic range of the softcopy display device.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/448,706 US6782137B1 (en) | 1999-11-24 | 1999-11-24 | Digital image display improvement system and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/448,706 US6782137B1 (en) | 1999-11-24 | 1999-11-24 | Digital image display improvement system and method |
Publications (1)
Publication Number | Publication Date |
---|---|
US6782137B1 true US6782137B1 (en) | 2004-08-24 |
Family
ID=32869658
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/448,706 Expired - Lifetime US6782137B1 (en) | 1999-11-24 | 1999-11-24 | Digital image display improvement system and method |
Country Status (1)
Country | Link |
---|---|
US (1) | US6782137B1 (en) |
Cited By (68)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020076121A1 (en) * | 2000-06-13 | 2002-06-20 | International Business Machines Corporation | Image transform method for obtaining expanded image data, image processing apparatus and image display device therefor |
US20020158975A1 (en) * | 2000-07-06 | 2002-10-31 | Seiko Epson Corporation | Image processing method, recording medium, and image processing apparatus |
US20030160834A1 (en) * | 2002-02-26 | 2003-08-28 | Konica Corporation | Medical image recording system |
US20040042676A1 (en) * | 2002-08-27 | 2004-03-04 | Hrl Laboratories, Llc | Method and apparatus for illumination compensation of digital images |
US20050046872A1 (en) * | 2003-08-28 | 2005-03-03 | General Electric Company | Method and system for image processing for structured light profiling of a part |
US20050100208A1 (en) * | 2003-11-10 | 2005-05-12 | University Of Chicago | Image modification and detection using massive training artificial neural networks (MTANN) |
US20050111718A1 (en) * | 2003-11-26 | 2005-05-26 | University Of Chicago | Automated method and system for the evaluation of disease and registration accuracy in the subtraction of temporally sequential medical images |
US20060119612A1 (en) * | 2004-12-02 | 2006-06-08 | Kerofsky Louis J | Methods and systems for image-specific tone scale adjustment and light-source control |
US20060182363A1 (en) * | 2004-12-21 | 2006-08-17 | Vladimir Jellus | Method for correcting inhomogeneities in an image, and an imaging apparatus therefor |
US20060239395A1 (en) * | 2005-04-08 | 2006-10-26 | Canon Kabushiki Kaisha | Image management system, image management method, and program |
US20060262147A1 (en) * | 2005-05-17 | 2006-11-23 | Tom Kimpe | Methods, apparatus, and devices for noise reduction |
US20060274026A1 (en) * | 2004-12-02 | 2006-12-07 | Kerofsky Louis J | Systems and Methods for Selecting a Display Source Light Illumination Level |
US20060284822A1 (en) * | 2004-12-02 | 2006-12-21 | Sharp Laboratories Of America, Inc. | Methods and systems for enhancing display characteristics |
US20070014480A1 (en) * | 2005-07-13 | 2007-01-18 | General Electric Company | Method and apparatus for creating a multi-resolution framework for improving medical imaging workflow |
US20070022442A1 (en) * | 2005-07-21 | 2007-01-25 | Elad Gil | Dispatch system to remote devices |
US20070092139A1 (en) * | 2004-12-02 | 2007-04-26 | Daly Scott J | Methods and Systems for Image Tonescale Adjustment to Compensate for a Reduced Source Light Power Level |
US20070211049A1 (en) * | 2006-03-08 | 2007-09-13 | Sharp Laboratories Of America, Inc. | Methods and systems for enhancing display characteristics with ambient illumination input |
US20080024517A1 (en) * | 2006-07-28 | 2008-01-31 | Louis Joseph Kerofsky | Systems and methods for color preservation with image tone scale corrections |
US20080025622A1 (en) * | 2006-07-28 | 2008-01-31 | Canon Kabushiki Kaisha | Image processing apparatus and control method thereof |
US20080137935A1 (en) * | 2006-12-06 | 2008-06-12 | Siemens Medical Solutions Usa, Inc. | Locally Adaptive Image Enhancement For Digital Subtraction X-Ray Imaging |
US20080285853A1 (en) * | 2007-05-15 | 2008-11-20 | Xerox Corporation | Contrast enhancement methods and apparatuses |
US20090109232A1 (en) * | 2007-10-30 | 2009-04-30 | Kerofsky Louis J | Methods and Systems for Backlight Modulation and Brightness Preservation |
US20090167789A1 (en) * | 2007-12-26 | 2009-07-02 | Kerofsky Louis J | Methods and Systems for Backlight Modulation with Image Characteristic Mapping |
US20090267876A1 (en) * | 2008-04-28 | 2009-10-29 | Kerofsky Louis J | Methods and Systems for Image Compensation for Ambient Conditions |
US20100007599A1 (en) * | 2008-07-10 | 2010-01-14 | Louis Joseph Kerofsky | Methods and Systems for Color Preservation with a Color-Modulated Backlight |
CN101859432A (en) * | 2010-05-17 | 2010-10-13 | 重庆师范大学 | Construction method of document image enhancement |
US7826681B2 (en) | 2007-02-28 | 2010-11-02 | Sharp Laboratories Of America, Inc. | Methods and systems for surround-specific display modeling |
US20110074803A1 (en) * | 2009-09-29 | 2011-03-31 | Louis Joseph Kerofsky | Methods and Systems for Ambient-Illumination-Selective Display Backlight Modification and Image Enhancement |
US7924261B2 (en) | 2004-12-02 | 2011-04-12 | Sharp Laboratories Of America, Inc. | Methods and systems for determining a display light source adjustment |
US7982707B2 (en) | 2004-12-02 | 2011-07-19 | Sharp Laboratories Of America, Inc. | Methods and systems for generating and applying image tone scale adjustments |
US20110181787A1 (en) * | 2010-01-28 | 2011-07-28 | Stmicroelectronics Asia Pacific Pte Ltd | Image details preservation and enhancement |
US8004511B2 (en) | 2004-12-02 | 2011-08-23 | Sharp Laboratories Of America, Inc. | Systems and methods for distortion-related source light management |
EP2372638A1 (en) | 2010-03-04 | 2011-10-05 | Vestel Elektronik Sanayi ve Ticaret A.S. | A black and white stretch method for dynamic range extension |
US8111265B2 (en) | 2004-12-02 | 2012-02-07 | Sharp Laboratories Of America, Inc. | Systems and methods for brightness preservation using a smoothed gain image |
US8120570B2 (en) | 2004-12-02 | 2012-02-21 | Sharp Laboratories Of America, Inc. | Systems and methods for tone curve generation, selection and application |
US8155434B2 (en) | 2007-10-30 | 2012-04-10 | Sharp Laboratories Of America, Inc. | Methods and systems for image enhancement |
US8165724B2 (en) | 2009-06-17 | 2012-04-24 | Sharp Laboratories Of America, Inc. | Methods and systems for power-controlling display devices |
US8169431B2 (en) | 2007-12-26 | 2012-05-01 | Sharp Laboratories Of America, Inc. | Methods and systems for image tonescale design |
US8179363B2 (en) | 2007-12-26 | 2012-05-15 | Sharp Laboratories Of America, Inc. | Methods and systems for display source light management with histogram manipulation |
US8207932B2 (en) | 2007-12-26 | 2012-06-26 | Sharp Laboratories Of America, Inc. | Methods and systems for display source light illumination level selection |
US8223113B2 (en) | 2007-12-26 | 2012-07-17 | Sharp Laboratories Of America, Inc. | Methods and systems for display source light management with variable delay |
US8243882B2 (en) | 2010-05-07 | 2012-08-14 | General Electric Company | System and method for indicating association between autonomous detector and imaging subsystem |
US20120263366A1 (en) * | 2011-04-14 | 2012-10-18 | Zhimin Huo | Enhanced visualization for medical images |
US8378956B2 (en) | 2007-11-30 | 2013-02-19 | Sharp Laboratories Of America, Inc. | Methods and systems for weighted-error-vector-based source light selection |
US20130257869A1 (en) * | 2012-03-27 | 2013-10-03 | Zhiqiang LAO | Method for enhancing reconstructed 3-d tomosynthesis volume image |
WO2014053942A1 (en) * | 2012-10-05 | 2014-04-10 | Koninklijke Philips N.V. | Real-time image processing for optimizing sub-images views |
US8750582B2 (en) | 2010-05-06 | 2014-06-10 | Siemens Aktiengesellschaft | Method for recording and reconstructing a three-dimensional image dataset and X-ray apparatus |
US8786873B2 (en) | 2009-07-20 | 2014-07-22 | General Electric Company | Application server for use with a modular imaging system |
US8913089B2 (en) | 2005-06-15 | 2014-12-16 | Sharp Laboratories Of America, Inc. | Methods and systems for enhancing display characteristics with frequency-specific gain |
US8922594B2 (en) | 2005-06-15 | 2014-12-30 | Sharp Laboratories Of America, Inc. | Methods and systems for enhancing display characteristics with high frequency contrast enhancement |
US8947465B2 (en) | 2004-12-02 | 2015-02-03 | Sharp Laboratories Of America, Inc. | Methods and systems for display-mode-dependent brightness preservation |
US8996098B2 (en) | 2012-03-19 | 2015-03-31 | Donald Spector | System and method for diagnosing and treating disease |
US9070316B2 (en) | 2004-10-25 | 2015-06-30 | Barco Nv | Optical correction for high uniformity panel lights |
US9083969B2 (en) | 2005-08-12 | 2015-07-14 | Sharp Laboratories Of America, Inc. | Methods and systems for independent view adjustment in multiple-view displays |
US9177509B2 (en) | 2007-11-30 | 2015-11-03 | Sharp Laboratories Of America, Inc. | Methods and systems for backlight modulation with scene-cut detection |
US20150371387A1 (en) * | 2014-06-19 | 2015-12-24 | Qualcomm Incorporated | Local adaptive histogram equalization |
US9330630B2 (en) | 2008-08-30 | 2016-05-03 | Sharp Laboratories Of America, Inc. | Methods and systems for display source light management with rate change control |
US9733458B2 (en) | 2014-06-20 | 2017-08-15 | Qualcomm Incorporated | Multi-camera system using folded optics free from parallax artifacts |
US9819863B2 (en) | 2014-06-20 | 2017-11-14 | Qualcomm Incorporated | Wide field of view array camera for hemispheric and spherical imaging |
US9832381B2 (en) | 2014-10-31 | 2017-11-28 | Qualcomm Incorporated | Optical image stabilization for thin cameras |
US9838601B2 (en) | 2012-10-19 | 2017-12-05 | Qualcomm Incorporated | Multi-camera system using folded optics |
US9854182B2 (en) | 2014-06-20 | 2017-12-26 | Qualcomm Incorporated | Folded optic array camera using refractive prisms |
US9860434B2 (en) | 2014-04-04 | 2018-01-02 | Qualcomm Incorporated | Auto-focus in low-profile folded optics multi-camera system |
US9973680B2 (en) | 2014-04-04 | 2018-05-15 | Qualcomm Incorporated | Auto-focus in low-profile folded optics multi-camera system |
US10084958B2 (en) | 2014-06-20 | 2018-09-25 | Qualcomm Incorporated | Multi-camera system using folded optics free from parallax and tilt artifacts |
US10178373B2 (en) | 2013-08-16 | 2019-01-08 | Qualcomm Incorporated | Stereo yaw correction using autofocus feedback |
CN115546075A (en) * | 2022-12-02 | 2022-12-30 | 成都智元汇信息技术股份有限公司 | Method and device for dynamically enhancing display based on column data labeling area |
US11737644B2 (en) | 2012-03-19 | 2023-08-29 | Donald Spector | System and method for diagnosing and treating disease |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3979555A (en) * | 1975-05-27 | 1976-09-07 | Hughes Aircraft Company | Histogram equalization system for display improvement |
US4947416A (en) * | 1988-10-21 | 1990-08-07 | General Electric Company | Scanning equalization radiography with stationary equalization detector |
US5063607A (en) * | 1988-10-24 | 1991-11-05 | Hughes Aircraft Company | Image contrast enhancement technique |
US5357549A (en) * | 1990-10-24 | 1994-10-18 | U.S. Philips Corporation | Method of dynamic range compression of an X-ray image and apparatus effectuating the method |
US5467404A (en) * | 1991-08-14 | 1995-11-14 | Agfa-Gevaert | Method and apparatus for contrast enhancement |
US5640469A (en) * | 1989-09-28 | 1997-06-17 | Hughes Electronics | Systems and methods for producing high-contrast, intensity equalized visible images |
US5835618A (en) * | 1996-09-27 | 1998-11-10 | Siemens Corporate Research, Inc. | Uniform and non-uniform dynamic range remapping for optimum image display |
US5943433A (en) | 1996-12-30 | 1999-08-24 | General Electric Company | Method for correcting inhomogeneity of spatial intensity in an aquired MR image |
US5949918A (en) * | 1997-05-21 | 1999-09-07 | Sarnoff Corporation | Method and apparatus for performing image enhancement |
US5963676A (en) * | 1997-02-07 | 1999-10-05 | Siemens Corporate Research, Inc. | Multiscale adaptive system for enhancement of an image in X-ray angiography |
US6424730B1 (en) * | 1998-11-03 | 2002-07-23 | Eastman Kodak Company | Medical image enhancement method for hardcopy prints |
-
1999
- 1999-11-24 US US09/448,706 patent/US6782137B1/en not_active Expired - Lifetime
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3979555A (en) * | 1975-05-27 | 1976-09-07 | Hughes Aircraft Company | Histogram equalization system for display improvement |
US4947416A (en) * | 1988-10-21 | 1990-08-07 | General Electric Company | Scanning equalization radiography with stationary equalization detector |
US5063607A (en) * | 1988-10-24 | 1991-11-05 | Hughes Aircraft Company | Image contrast enhancement technique |
US5640469A (en) * | 1989-09-28 | 1997-06-17 | Hughes Electronics | Systems and methods for producing high-contrast, intensity equalized visible images |
US5357549A (en) * | 1990-10-24 | 1994-10-18 | U.S. Philips Corporation | Method of dynamic range compression of an X-ray image and apparatus effectuating the method |
US5467404A (en) * | 1991-08-14 | 1995-11-14 | Agfa-Gevaert | Method and apparatus for contrast enhancement |
US5835618A (en) * | 1996-09-27 | 1998-11-10 | Siemens Corporate Research, Inc. | Uniform and non-uniform dynamic range remapping for optimum image display |
US5943433A (en) | 1996-12-30 | 1999-08-24 | General Electric Company | Method for correcting inhomogeneity of spatial intensity in an aquired MR image |
US5963676A (en) * | 1997-02-07 | 1999-10-05 | Siemens Corporate Research, Inc. | Multiscale adaptive system for enhancement of an image in X-ray angiography |
US5949918A (en) * | 1997-05-21 | 1999-09-07 | Sarnoff Corporation | Method and apparatus for performing image enhancement |
US6424730B1 (en) * | 1998-11-03 | 2002-07-23 | Eastman Kodak Company | Medical image enhancement method for hardcopy prints |
Non-Patent Citations (1)
Title |
---|
"Adaptive Image Contrast enhancement based on Human Visual Properties"; T.-L. Ji, M.K. Sundareshan, and H. Roehrig; EEE Transactions on Medical Imaging, vol. 13, No. 4., Dec. 1994. |
Cited By (108)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020076121A1 (en) * | 2000-06-13 | 2002-06-20 | International Business Machines Corporation | Image transform method for obtaining expanded image data, image processing apparatus and image display device therefor |
US7397972B2 (en) * | 2000-06-13 | 2008-07-08 | International Business Machines Corporation | Image transform method for obtaining expanded image data, image processing apparatus and image display device therefor |
US20020158975A1 (en) * | 2000-07-06 | 2002-10-31 | Seiko Epson Corporation | Image processing method, recording medium, and image processing apparatus |
US7199902B2 (en) * | 2000-07-06 | 2007-04-03 | Seiko Epson Corporation | Image processing method, recording medium, and image processing apparatus |
US20030160834A1 (en) * | 2002-02-26 | 2003-08-28 | Konica Corporation | Medical image recording system |
US7301670B2 (en) * | 2002-02-26 | 2007-11-27 | Konica Corporation | Medical image recording system |
US20040042676A1 (en) * | 2002-08-27 | 2004-03-04 | Hrl Laboratories, Llc | Method and apparatus for illumination compensation of digital images |
US20070025633A1 (en) * | 2002-08-27 | 2007-02-01 | Hrl Laboratories, Llc | Method and apparatus for illumination compensation of digital images |
US7164808B2 (en) * | 2002-08-27 | 2007-01-16 | Hrl Laboratories, Llc | Method and apparatus for illumination compensation of digital images |
US7787709B2 (en) | 2002-08-27 | 2010-08-31 | Hrl Laboratories, Llc | Method and apparatus for illumination compensation of digital images |
US7302109B2 (en) * | 2003-08-28 | 2007-11-27 | General Electric Company | Method and system for image processing for structured light profiling of a part |
US20050046872A1 (en) * | 2003-08-28 | 2005-03-03 | General Electric Company | Method and system for image processing for structured light profiling of a part |
US7545965B2 (en) * | 2003-11-10 | 2009-06-09 | The University Of Chicago | Image modification and detection using massive training artificial neural networks (MTANN) |
US20050100208A1 (en) * | 2003-11-10 | 2005-05-12 | University Of Chicago | Image modification and detection using massive training artificial neural networks (MTANN) |
US8265728B2 (en) | 2003-11-26 | 2012-09-11 | University Of Chicago | Automated method and system for the evaluation of disease and registration accuracy in the subtraction of temporally sequential medical images |
WO2005057335A3 (en) * | 2003-11-26 | 2006-07-13 | Univ Chicago | Subtraction of temporally sequential medical images |
WO2005057335A2 (en) * | 2003-11-26 | 2005-06-23 | The University Of Chicago | Subtraction of temporally sequential medical images |
US20050111718A1 (en) * | 2003-11-26 | 2005-05-26 | University Of Chicago | Automated method and system for the evaluation of disease and registration accuracy in the subtraction of temporally sequential medical images |
US9070316B2 (en) | 2004-10-25 | 2015-06-30 | Barco Nv | Optical correction for high uniformity panel lights |
US8004511B2 (en) | 2004-12-02 | 2011-08-23 | Sharp Laboratories Of America, Inc. | Systems and methods for distortion-related source light management |
US20060119612A1 (en) * | 2004-12-02 | 2006-06-08 | Kerofsky Louis J | Methods and systems for image-specific tone scale adjustment and light-source control |
US8947465B2 (en) | 2004-12-02 | 2015-02-03 | Sharp Laboratories Of America, Inc. | Methods and systems for display-mode-dependent brightness preservation |
US20060284822A1 (en) * | 2004-12-02 | 2006-12-21 | Sharp Laboratories Of America, Inc. | Methods and systems for enhancing display characteristics |
US20060274026A1 (en) * | 2004-12-02 | 2006-12-07 | Kerofsky Louis J | Systems and Methods for Selecting a Display Source Light Illumination Level |
US7800577B2 (en) | 2004-12-02 | 2010-09-21 | Sharp Laboratories Of America, Inc. | Methods and systems for enhancing display characteristics |
US20070092139A1 (en) * | 2004-12-02 | 2007-04-26 | Daly Scott J | Methods and Systems for Image Tonescale Adjustment to Compensate for a Reduced Source Light Power Level |
US7782405B2 (en) | 2004-12-02 | 2010-08-24 | Sharp Laboratories Of America, Inc. | Systems and methods for selecting a display source light illumination level |
US7768496B2 (en) | 2004-12-02 | 2010-08-03 | Sharp Laboratories Of America, Inc. | Methods and systems for image tonescale adjustment to compensate for a reduced source light power level |
US8120570B2 (en) | 2004-12-02 | 2012-02-21 | Sharp Laboratories Of America, Inc. | Systems and methods for tone curve generation, selection and application |
US8111265B2 (en) | 2004-12-02 | 2012-02-07 | Sharp Laboratories Of America, Inc. | Systems and methods for brightness preservation using a smoothed gain image |
US7924261B2 (en) | 2004-12-02 | 2011-04-12 | Sharp Laboratories Of America, Inc. | Methods and systems for determining a display light source adjustment |
US7982707B2 (en) | 2004-12-02 | 2011-07-19 | Sharp Laboratories Of America, Inc. | Methods and systems for generating and applying image tone scale adjustments |
US7961199B2 (en) | 2004-12-02 | 2011-06-14 | Sharp Laboratories Of America, Inc. | Methods and systems for image-specific tone scale adjustment and light-source control |
US7672498B2 (en) * | 2004-12-21 | 2010-03-02 | Siemens Aktiengesellschaft | Method for correcting inhomogeneities in an image, and an imaging apparatus therefor |
US20060182363A1 (en) * | 2004-12-21 | 2006-08-17 | Vladimir Jellus | Method for correcting inhomogeneities in an image, and an imaging apparatus therefor |
US20060239395A1 (en) * | 2005-04-08 | 2006-10-26 | Canon Kabushiki Kaisha | Image management system, image management method, and program |
US8849068B2 (en) * | 2005-04-08 | 2014-09-30 | Canon Kabushiki Kaisha | Image management system, image management method, and program |
USRE43707E1 (en) | 2005-05-17 | 2012-10-02 | Barco N.V. | Methods, apparatus, and devices for noise reduction |
US7639849B2 (en) * | 2005-05-17 | 2009-12-29 | Barco N.V. | Methods, apparatus, and devices for noise reduction |
US20060262147A1 (en) * | 2005-05-17 | 2006-11-23 | Tom Kimpe | Methods, apparatus, and devices for noise reduction |
US8922594B2 (en) | 2005-06-15 | 2014-12-30 | Sharp Laboratories Of America, Inc. | Methods and systems for enhancing display characteristics with high frequency contrast enhancement |
US8913089B2 (en) | 2005-06-15 | 2014-12-16 | Sharp Laboratories Of America, Inc. | Methods and systems for enhancing display characteristics with frequency-specific gain |
US7489825B2 (en) | 2005-07-13 | 2009-02-10 | Ge Medical Systems | Method and apparatus for creating a multi-resolution framework for improving medical imaging workflow |
US20070014480A1 (en) * | 2005-07-13 | 2007-01-18 | General Electric Company | Method and apparatus for creating a multi-resolution framework for improving medical imaging workflow |
US9792628B2 (en) | 2005-07-21 | 2017-10-17 | Google Inc. | Dispatch system to remote devices |
US9118774B2 (en) | 2005-07-21 | 2015-08-25 | Google Inc. | Dispatch system to remote devices |
US20070022442A1 (en) * | 2005-07-21 | 2007-01-25 | Elad Gil | Dispatch system to remote devices |
US9083969B2 (en) | 2005-08-12 | 2015-07-14 | Sharp Laboratories Of America, Inc. | Methods and systems for independent view adjustment in multiple-view displays |
US7839406B2 (en) | 2006-03-08 | 2010-11-23 | Sharp Laboratories Of America, Inc. | Methods and systems for enhancing display characteristics with ambient illumination input |
US20070211049A1 (en) * | 2006-03-08 | 2007-09-13 | Sharp Laboratories Of America, Inc. | Methods and systems for enhancing display characteristics with ambient illumination input |
US20080025622A1 (en) * | 2006-07-28 | 2008-01-31 | Canon Kabushiki Kaisha | Image processing apparatus and control method thereof |
US7515160B2 (en) | 2006-07-28 | 2009-04-07 | Sharp Laboratories Of America, Inc. | Systems and methods for color preservation with image tone scale corrections |
US20080024517A1 (en) * | 2006-07-28 | 2008-01-31 | Louis Joseph Kerofsky | Systems and methods for color preservation with image tone scale corrections |
US7945118B2 (en) * | 2006-07-28 | 2011-05-17 | Canon Kabushiki Kaisha | Image processing apparatus and control method thereof |
US8111895B2 (en) | 2006-12-06 | 2012-02-07 | Siemens Medical Solutions Usa, Inc. | Locally adaptive image enhancement for digital subtraction X-ray imaging |
US20080137935A1 (en) * | 2006-12-06 | 2008-06-12 | Siemens Medical Solutions Usa, Inc. | Locally Adaptive Image Enhancement For Digital Subtraction X-Ray Imaging |
US7826681B2 (en) | 2007-02-28 | 2010-11-02 | Sharp Laboratories Of America, Inc. | Methods and systems for surround-specific display modeling |
US20080285853A1 (en) * | 2007-05-15 | 2008-11-20 | Xerox Corporation | Contrast enhancement methods and apparatuses |
US8355595B2 (en) | 2007-05-15 | 2013-01-15 | Xerox Corporation | Contrast enhancement methods and apparatuses |
US8155434B2 (en) | 2007-10-30 | 2012-04-10 | Sharp Laboratories Of America, Inc. | Methods and systems for image enhancement |
US20090109232A1 (en) * | 2007-10-30 | 2009-04-30 | Kerofsky Louis J | Methods and Systems for Backlight Modulation and Brightness Preservation |
US8345038B2 (en) | 2007-10-30 | 2013-01-01 | Sharp Laboratories Of America, Inc. | Methods and systems for backlight modulation and brightness preservation |
US9177509B2 (en) | 2007-11-30 | 2015-11-03 | Sharp Laboratories Of America, Inc. | Methods and systems for backlight modulation with scene-cut detection |
US8378956B2 (en) | 2007-11-30 | 2013-02-19 | Sharp Laboratories Of America, Inc. | Methods and systems for weighted-error-vector-based source light selection |
US8203579B2 (en) | 2007-12-26 | 2012-06-19 | Sharp Laboratories Of America, Inc. | Methods and systems for backlight modulation with image characteristic mapping |
US8179363B2 (en) | 2007-12-26 | 2012-05-15 | Sharp Laboratories Of America, Inc. | Methods and systems for display source light management with histogram manipulation |
US20090167789A1 (en) * | 2007-12-26 | 2009-07-02 | Kerofsky Louis J | Methods and Systems for Backlight Modulation with Image Characteristic Mapping |
US8169431B2 (en) | 2007-12-26 | 2012-05-01 | Sharp Laboratories Of America, Inc. | Methods and systems for image tonescale design |
US8223113B2 (en) | 2007-12-26 | 2012-07-17 | Sharp Laboratories Of America, Inc. | Methods and systems for display source light management with variable delay |
US8207932B2 (en) | 2007-12-26 | 2012-06-26 | Sharp Laboratories Of America, Inc. | Methods and systems for display source light illumination level selection |
US8531379B2 (en) | 2008-04-28 | 2013-09-10 | Sharp Laboratories Of America, Inc. | Methods and systems for image compensation for ambient conditions |
US20090267876A1 (en) * | 2008-04-28 | 2009-10-29 | Kerofsky Louis J | Methods and Systems for Image Compensation for Ambient Conditions |
US20100007599A1 (en) * | 2008-07-10 | 2010-01-14 | Louis Joseph Kerofsky | Methods and Systems for Color Preservation with a Color-Modulated Backlight |
US8416179B2 (en) | 2008-07-10 | 2013-04-09 | Sharp Laboratories Of America, Inc. | Methods and systems for color preservation with a color-modulated backlight |
US9330630B2 (en) | 2008-08-30 | 2016-05-03 | Sharp Laboratories Of America, Inc. | Methods and systems for display source light management with rate change control |
US8165724B2 (en) | 2009-06-17 | 2012-04-24 | Sharp Laboratories Of America, Inc. | Methods and systems for power-controlling display devices |
US8786873B2 (en) | 2009-07-20 | 2014-07-22 | General Electric Company | Application server for use with a modular imaging system |
US20110074803A1 (en) * | 2009-09-29 | 2011-03-31 | Louis Joseph Kerofsky | Methods and Systems for Ambient-Illumination-Selective Display Backlight Modification and Image Enhancement |
US8781248B2 (en) | 2010-01-28 | 2014-07-15 | Stmicroelectronics Asia Pacific Pte. Ltd. | Image details preservation and enhancement |
US20110181787A1 (en) * | 2010-01-28 | 2011-07-28 | Stmicroelectronics Asia Pacific Pte Ltd | Image details preservation and enhancement |
EP2372638A1 (en) | 2010-03-04 | 2011-10-05 | Vestel Elektronik Sanayi ve Ticaret A.S. | A black and white stretch method for dynamic range extension |
US8750582B2 (en) | 2010-05-06 | 2014-06-10 | Siemens Aktiengesellschaft | Method for recording and reconstructing a three-dimensional image dataset and X-ray apparatus |
US8243882B2 (en) | 2010-05-07 | 2012-08-14 | General Electric Company | System and method for indicating association between autonomous detector and imaging subsystem |
CN101859432A (en) * | 2010-05-17 | 2010-10-13 | 重庆师范大学 | Construction method of document image enhancement |
US20120263366A1 (en) * | 2011-04-14 | 2012-10-18 | Zhimin Huo | Enhanced visualization for medical images |
US8861886B2 (en) * | 2011-04-14 | 2014-10-14 | Carestream Health, Inc. | Enhanced visualization for medical images |
US8996098B2 (en) | 2012-03-19 | 2015-03-31 | Donald Spector | System and method for diagnosing and treating disease |
US11737644B2 (en) | 2012-03-19 | 2023-08-29 | Donald Spector | System and method for diagnosing and treating disease |
US9649013B2 (en) | 2012-03-19 | 2017-05-16 | Donald Spector | System and method for diagnosing and treating disease |
US20130257869A1 (en) * | 2012-03-27 | 2013-10-03 | Zhiqiang LAO | Method for enhancing reconstructed 3-d tomosynthesis volume image |
US9311740B2 (en) * | 2012-03-27 | 2016-04-12 | Carestream Health, Inc. | Method for enhancing reconstructed 3-D tomosynthesis volume image |
US9530186B2 (en) * | 2012-10-05 | 2016-12-27 | Koninklijke Philips N.V. | Real-time image processing for optimizing sub-images views |
WO2014053942A1 (en) * | 2012-10-05 | 2014-04-10 | Koninklijke Philips N.V. | Real-time image processing for optimizing sub-images views |
US20150254808A1 (en) * | 2012-10-05 | 2015-09-10 | Koninklijke Philips N.V. | Real-time image processing for optimizing sub-images views |
US10165183B2 (en) | 2012-10-19 | 2018-12-25 | Qualcomm Incorporated | Multi-camera system using folded optics |
US9838601B2 (en) | 2012-10-19 | 2017-12-05 | Qualcomm Incorporated | Multi-camera system using folded optics |
US10178373B2 (en) | 2013-08-16 | 2019-01-08 | Qualcomm Incorporated | Stereo yaw correction using autofocus feedback |
US9860434B2 (en) | 2014-04-04 | 2018-01-02 | Qualcomm Incorporated | Auto-focus in low-profile folded optics multi-camera system |
US9973680B2 (en) | 2014-04-04 | 2018-05-15 | Qualcomm Incorporated | Auto-focus in low-profile folded optics multi-camera system |
US10013764B2 (en) * | 2014-06-19 | 2018-07-03 | Qualcomm Incorporated | Local adaptive histogram equalization |
US20150371387A1 (en) * | 2014-06-19 | 2015-12-24 | Qualcomm Incorporated | Local adaptive histogram equalization |
US9854182B2 (en) | 2014-06-20 | 2017-12-26 | Qualcomm Incorporated | Folded optic array camera using refractive prisms |
US9843723B2 (en) | 2014-06-20 | 2017-12-12 | Qualcomm Incorporated | Parallax free multi-camera system capable of capturing full spherical images |
US10084958B2 (en) | 2014-06-20 | 2018-09-25 | Qualcomm Incorporated | Multi-camera system using folded optics free from parallax and tilt artifacts |
US9819863B2 (en) | 2014-06-20 | 2017-11-14 | Qualcomm Incorporated | Wide field of view array camera for hemispheric and spherical imaging |
US9733458B2 (en) | 2014-06-20 | 2017-08-15 | Qualcomm Incorporated | Multi-camera system using folded optics free from parallax artifacts |
US9832381B2 (en) | 2014-10-31 | 2017-11-28 | Qualcomm Incorporated | Optical image stabilization for thin cameras |
CN115546075A (en) * | 2022-12-02 | 2022-12-30 | 成都智元汇信息技术股份有限公司 | Method and device for dynamically enhancing display based on column data labeling area |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6782137B1 (en) | Digital image display improvement system and method | |
US6757442B1 (en) | Image enhancement method with simultaneous noise reduction, non-uniformity equalization, and contrast enhancement | |
Ji et al. | Adaptive image contrast enhancement based on human visual properties | |
US5805721A (en) | Method and apparatus for contrast enhancement | |
US7146059B1 (en) | Method of performing fast bilateral filtering and using the same for the display of high-dynamic-range images | |
US6424730B1 (en) | Medical image enhancement method for hardcopy prints | |
EP0527525B1 (en) | Method and apparatus for contrast enhancement | |
US7496224B2 (en) | Method for rendering digital radiographic images for display based on independent control of fundamental image quality parameters | |
US6766064B1 (en) | Method and apparatus for performing a contrast based dynamic range management algorithm | |
US20030189579A1 (en) | Adaptive enlarging and/or sharpening of a digital image | |
US7706626B2 (en) | Digital image reconstruction using inverse spatial filtering | |
US20100142790A1 (en) | Image processing method capable of enhancing contrast and reducing noise of digital image and image processing device using same | |
Prokop et al. | Principles of image processing in digital chest radiography | |
US7149358B2 (en) | Method and system for improving contrast using multi-resolution contrast based dynamic range management | |
US6175658B1 (en) | Spatially-selective edge enhancement for discrete pixel images | |
JPH10171983A (en) | Method and device for processing picture | |
JP2007507809A (en) | How to speed up Retinex-type algorithms | |
Seeram et al. | Image postprocessing in digital radiology—a primer for technologists | |
US8098950B2 (en) | Method and apparatus for segmentation-based image operations | |
CN108961179B (en) | Medical image post-processing system and using method thereof | |
US20040252132A1 (en) | Method and user interface for modifying at least one of contrast and density of pixels of a processed image | |
US20020168109A1 (en) | Image processing apparatus, image processing method, storage medium, and program | |
US7298373B2 (en) | Method and user interface for modifying at least one of contrast and density of pixels of a processed image | |
JP2003283927A (en) | Method for enhancing contrast of image | |
Barnes et al. | Image processing in digital radiography: basic concepts and applications |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: GENERAL ELECTRIC COMPANY, NEW YORK Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AVINASH, GOPAL B.;REEL/FRAME:010413/0551 Effective date: 19991122 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
FPAY | Fee payment |
Year of fee payment: 12 |