WO1991001613A1 - A compression method and apparatus for single-sensor color imaging systems - Google Patents

A compression method and apparatus for single-sensor color imaging systems Download PDF

Info

Publication number
WO1991001613A1
WO1991001613A1 PCT/US1990/004091 US9004091W WO9101613A1 WO 1991001613 A1 WO1991001613 A1 WO 1991001613A1 US 9004091 W US9004091 W US 9004091W WO 9101613 A1 WO9101613 A1 WO 9101613A1
Authority
WO
WIPO (PCT)
Prior art keywords
color
red
green
image
blue
Prior art date
Application number
PCT/US1990/004091
Other languages
French (fr)
Inventor
Yusheng Timothy Tsai
Kenneth A. Parulski
Majid Rabbani
Original Assignee
Eastman Kodak Company
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eastman Kodak Company filed Critical Eastman Kodak Company
Publication of WO1991001613A1 publication Critical patent/WO1991001613A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4015Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4007Scaling of whole images or parts thereof, e.g. expanding or contracting based on interpolation, e.g. bilinear interpolation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N11/00Colour television systems
    • H04N11/04Colour television systems using pulse code modulation
    • H04N11/042Codec means
    • H04N11/044Codec means involving transform coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/84Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/843Demosaicing, e.g. interpolating colour pixel values
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements

Definitions

  • the present invention is directed to a method and an apparatus for processing image data from a single chip color image sensor to facilitate visually lossless data compression prior to storage or transmission.
  • an electronic camera may use a color beamsplitter and three image sensors, one each for red, green, and blue.
  • a single sensor overlaid with a color filter pattern, can be used to obtain color images, provided that the sensor output signal is processed in an appropriate manner in order to demultiplex and interpolate the three color signals.
  • SUBSTITUTESHEET stored can be increased, and the recording time per picture can be reduced, if digital data compression is used to reduce the amount of data required to represent the images.
  • Conventional data compression methods for images from color cameras use the demultiplexed and interpolated three-color data instead of the directly digitized sensor output signal.
  • One example of such an approach is shown in U.S. Patent No. 4,797,729 entitled "Systems for Incorporating an Error-Tolerant Picture Compression Algorithm" by Y. T.Tsai, which patent is also assigned to Eastman Kodak Co.
  • the color interpolation process will triple the single "plane" of data from the digitized sensor output to three planes of data, one each for the red, green, and blue color information. Each color plane has the same number of pixels as the sensor. Image compression can be done directly on these three planes, or more efficiently, on the YI color space which is derived from the RGB data. After compression, the total amount of data must be much smaller than the "original" digitized sensor output data, or the compression will have served no purpose. Inverse compression will reconstruct the color image in the corresponding color space which can then be further processed, displayed, or printed.
  • the present invention provides a method and a real-time system architecture for compressing color images that are obtained from a single-chip CCD imager of the type which uses a color filter array (CFA).
  • the first step of the method is to separate the digitized color sensor output into three records, one (green) for luminance and two (red and blue) for color.
  • the second step is to convert the red and blue records to color ratios which are a function of both the red or blue pixel values and the interpolated luminance (green) signal value at the spatial locations corresponding to the red or blue pixels.
  • the third step is to transform the luminance (green) record from a linear space metric to a "lightness" space perceptually uniform metric (L*).
  • the Television and Engineering Handbook by K. B. Benson Editor, published by McGraw Hill, pages 2.38—2.40 sets forth definitions for uniform color spaces and, more particularly, the L* space.
  • the fourth step is to individually compress the luminance (green) and the two color ratio records (R/G, B/G) to reduce the average bit rate.
  • the compressed image data may then be recorded or transmitted.
  • an inverse compression is applied.
  • the decompressed red, green, and blue records are interpolated to obtain the three full color planes of digital image data.
  • This method has the advantage of processing less data than conventional methods, in less time using less storage, and of providing more efficient compression.
  • Figure 1 is a schematic block diagram of an electronic camera incorporating the present invention.
  • Figure 2 is a schematic block diagram of a playback device that may be used to view images from the electronic camera of Figure 1.
  • Figure 3 illustrates a matrix of color image pixels formed with a color filter pattern of the type used in the electronic camera of Figure 1.
  • Figure 4 is a prior art block flow diagram illustrating one conventional method for compressing a color image.
  • Figure 5 is a block flow diagram illustrating a color filter interpolation method.
  • Figure 6 is a block flow diagram illustrating the preferred embodiment of the camera processing and compression portion of the present invention.
  • Figure 7 is a block flow diagram illustrating the preferred embodiment of the playback decompression and processing method portion of the present invention.
  • Figure 8 is a block flow diagram of the preferred compression method portion of the present invention.
  • Figure 9 is a block flow diagram of the preferred decompression method portion of the present invention.
  • Figure 1 illustrates a block diagram of a digital electronic camera.
  • the image of a scene (not shown) is focused onto an image sensor 20 by a camera lens 10.
  • the image sensor 20 is composed of a number of discrete sensor elements 20A or pixels arranged in a two—dimensional array to form individual photosites (see Figure 3).
  • the individual photosites are covered with a regular array of color filters 18.
  • the image sensing elements 20A respond to the appropriately colored incident illumination to provide an analog electronic signal corresponding to the intensity of the illumination incident on the sensor elements.
  • This invention is described in relation to a charge coupled device (CCD) sensor having 1280 horizontal columns and 1024 vertical rows of pixels although other types of image sensors and sensors with other dimensionalities may be used.
  • a lens aperture 12 and shutter 14 are interposed between the lens and image sensor 20 in order to provide the proper sensor illumination level for a variety of scene light levels.
  • a birefringent blur filter 16 is placed in front of the image sensor 20 in order to reduce color aliasing.
  • the analog output signal from the image sensor 20 is processed by an analog signal processor 30 incorporating, for example, a pre—amplifier and a correlated double sampling circuit which provides a low noise video signal and which uses circuits which are well known in the art.
  • the output of the analog signal processor 30 is converted from analog form to digital form in an A/D converter 32.
  • the A/D converter 32 provides an 8 bit data signal for each sample.
  • the digitized color image is processed and compressed in block 40.
  • the compressed digital image data ID from block 40 is recorded in the digital recorder block 50 and is available at its output as stored image data SID.
  • the digital recorder can use any of the various digital recording techniques which are well known in the art, for example digital magnetic tape, digital magnetic disk, optical disk, or solid-state memory cards.
  • a timing and control circuit 60 controls the various camera components in order to capture and store an image in response to the pressing of a camera exposure button (not shown). Referring now to Figure 2, there is shown a schematic block diagram of a device used to display or print images recorded in the electronic camera of Figure 1.
  • a digital playback device 70 allows the stored digital image data SID recorded in the digital recording block 50 of Figure 1 to be played back or to play the image data ID directly from the digital and compression block 40.
  • a digital decompression and processing device 75 performs the inverse image compression and the signal processing in order to provide full resolution RGB data.
  • a video display processing device 80 provides the specific signal processing needed for a particular video display 90, for example line rate conversion, video camera correction and NTSC encoding.
  • a hardcopy print processing device 82 provides the specific signal processing needed for a particular hardcopy printer 92.
  • the color filter pattern 18 incorporated in Figure 1 overlaying the image sensor 20 and the discrete sensing elements 20A.
  • the 3G (green) CFA (color filter array) is a 1280 x 1024 pixel pattern of G(green), R(red), and B(blue) pixels with three quarter G pixels, one eighth R pixels and one eighth B pixels.
  • the CFA pattern shown in Figure 3 and the blur filter 16 shown in Figure 1 are designed according to the teachings of U.S. Patent No. 4,663,661 by J. Weldy et al, entitled "Single Sensor Color Video Camera With Blurring Filter” which patent is also assigned to Eastman Kodak Co. A higher proportion of G pixels relative to R and B is used to improve the luminance resolution of the image.
  • the G pixels are arranged in horizontal stripes to reduce rise-time artifacts, according to the teachings of U.S. Patent Application Serial No. 208,302 entitled, "Color Imaging Apparatus Employing a Horizontal Stripe Color Filter to Reduce Rise-Time Artifacts" filed June 17, 1988 by Kenneth A. Parulski, which application is assigned to Eastman Kodak Co.
  • Block 9 represents the CFA image data from the A/D converter 32 of Figure 1, which consists of 1024 x 1280 or about 1.3 megabytes of data per image.
  • a 3G CFA interpolation block 11 forms three full 1024 x 1280 planes of image data for RGB, or approximately 3.9 megabytes of data per image.
  • three planes Y, I and Q may be formed by directing the RGB image data of block 13 to block 15.
  • Each of the formed YIQ planes is 1024 x 1280 pixels, the same size as the RGB image planes of block 13.
  • Image compression is done directly on the three planes from either block 13 or block 15 in block 17.
  • a system which incorporates an appropriate form of compression is shown in U.S. Patent No.
  • the compressed data may then be stored in the digital recording block 50 of Figure 1 (or alternately may be transmitted).
  • an inverse compression When played back (or received) an inverse compression
  • SUBSTITUTESHEET operation is performed as reflected by block 75 of Figure 2.
  • the inverse compression reconstructs the color image which can then be used either for further processing, video display, or printing.
  • a key question is how the compression can be implemented on the "raw” sensor data so that the amount of data processed is not increased. Since the CFA introduces a color pattern into the image data, the correlation among the adjacent pixel values varies depending on the color they represent. If the image compression algorithm treats the "raw" sensor data as luminance data, then it is a very “busy” image which needs a high bit rate to represent it with visually lossless quality following color interpolation. Therefore, unless the "raw" sensor data is sorted out by color the CFA image compression will not be efficient. Furthermore, a single error in the uninterpolated image may cause a large error for more than a single pixel in the final interpolated image.
  • SUBSTITUTESHEET block 11 of Figure 4 is shown in Figure 5.
  • Color edge artifacts color aliasing
  • luminance edges are minimized by interpolating the color signal (red and blue) to luminance (green) signal ratios instead 5 of linearly interpolating the red and blue signals.
  • the filter coefficients are selected so that the effective PSF (point spread function) of the interpolated green pixels is equal to the PSF of the actual green pixels. For simple implementations, these filter coefficients can be approximated.
  • a linear—to-log conversion is performed in block 22 and the red channel horizontal chroma interpolation is performed by block 24 using:
  • red channel vertical chroma interpolation equations are processed in block 26 as follows:
  • a log-to-linear process is applied to the signals from block 26 by the action of block 28. 25
  • the blue channel processing uses the same method steps as the red channel which are represented by the block flow of Figure 5.
  • the chroma interpolation typically uses a linear interpolation of the 30 (log R - log G miss ) and (log B - log G miss ) values, which is equivalent to linearly interpolating the log /G mi ⁇ s and log B/G migs values.
  • FIG. 6 illustrates the digital processing and compres- '.on block 40 of 35 Figure 1 incorporating the preferred embodiment of the camera processing and compression portion of the invention.
  • the input to block 41 is the digitized
  • Plane 42 is a 1280 x 768 x 8 bit green array
  • plane 44 is a 640 x 256 x 8 bit red array
  • plane 46 is a 640 x 256 x 8 bit blue array
  • the lookup tables may be implemented in software in the digital processing portion of block 40.
  • Block 52 represents the three processed planes 54, 56 and 58 corresponding to the planes 42, 44 and 46.
  • a compression operation 61 using, for example, an adaptive discrete cosine transform algorithm is performed on the three processed places from block 52. Once compressed the resulting signals may be stored (or transmitted) as reflected by block 62. At playback or upon receiving the transmitted, compressed image, the compressed signals are processed with the block steps as shown in Figure 7.
  • Figure 7 represents the functions performed by block 75 of Figure 2.
  • Inverse compression is performed in block 68.
  • the missing green, red and blue pixels are interpolated in block 71 which forms the color image data for the three
  • SUBSTITUTESHEET planes as shown in block 72.
  • the three planes from block 72 use approximately 3.9 Megabytes of data to represent an image.
  • missing green pixels are first interpolated so that log B/Gmi. s_s_ and log R/Gm. responsibles concernss can be computed and the original uninterpolated green pixels are converted to L* space such that the noise sensitivity is distributed uniformly. Since chroma interpolation uses log R/G and log B/G, the compression on the chrominance information is preferrably done on this hue ratio so that the subsequent interpolation after playback does not introduce color artifacts .
  • Tl;e compression works on three separate files: the uninterpolated green pixels and two smaller size log R G • and log B/G , files.
  • the inverse compression is done first. Then the green pixels are converted from L* to linear space, interpolated, and converted to log space such that the missing red and blue pixel interpolation operation can be performed.
  • the hardware implementation for the compression function 61 is illustrated in Figure 8.
  • the compressor 61' receives the three digital image input records "I" from block 52 of Figure 6 at a block formatter 116 and formats the image into block I(x,y).
  • the preferred block sizes are either 16 x 16 or 8 x 8 pixels.
  • a two-dimensional discrete cosine transform is performed by the DCT 118 on each block to generate the corresponding block T(i,j) of transform (2 - D DCT) coefficients. Since the
  • D DCT is a well known procedure, (see for example U.S. Patent No. 4,302,775) no further description
  • SUBSTITUTESHEET will be given herein of the (2 — D DCT) operation.
  • the transform coefficients T(i,j) for each block are ordered into a one-dimensional array T(k) by an order coefficients device 120 in order of increasing spatial frequency, for example by employing a zig-zag scan along diagonals of the block of coefficients.
  • the coefficients are adaptively quantized using an adaptive quantizer 122 in accordance with the visibility of quantization noise in the presence of image detail within a block.
  • the adaptive quantization 122 is comprised of a normalize coefficients section 124, the output of which is directed to a quantize coefficients section 126 for accomplishing a variable normalization 124 prior to a fixed quantization 126.
  • a variable quantization could be employed.
  • the transform coefficients T(k) are normalized by dividing each transform coefficient by a normalization factor N(k) as follows:
  • TN(k) - T(k)/N(k)
  • TN(k) is the normalized transform coefficient value.
  • the normalization factor N(k) is provided by a normalization array generator 33 receiving as an input display parameters. This is based on the visibility of quantization noise in the presence of image detail in the block.
  • the normalized coefficients TN(k) are quantized in block 126 to form quantized coefficients TN(k).
  • the quantized coefficients from 126 are encoded in a Huffman and run-length coding section 128 using a minimum redundancy coding scheme to produce code values CV(k).
  • the presently preferred coding scheme is a Huffman code with run-length coding for strings of zero magnitude coefficients. Since Huffman and run—length coding are well known in the art, no
  • the coded coefficients are directed to and recorded by the digital recording block 50 of the electronic camera of Figure 1.
  • the inverse compressor 68' performs the inverse of the compression function performed by the compressor 61• in Figure 8 to recover the digital image data.
  • the code values CV(k) are directed to the input of a decode coefficients block 130 to produce normalized coefficients TN(k) .
  • TN(k) are denormalized in block 132 by dividing by the denormalization values N ⁇ (k) that are the inverse of the normalization array N(k) employed in the transmitter to produce the denormalized coefficients T(k) .
  • the transform coefficients are denormalized by multiploying by the normalization coefficients N(k) .
  • An inverse normalization array generator 34 provides the signal N _1 (k).
  • the one-dimensional string of reconstructed coefficient values T(k) are re-formated in block 136 into two-dimensional signal block T(i,j) and the blocks of coefficients are inversely transformed in block DCT 138 into image values I(x,y). Finally, the block of image values are re-formated in block 140 into the digital image I.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Color Television Systems (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)

Abstract

The method of the present invention operates upon the imaging signals from a color filter array image sensor to compress the image signals prior to color interpolation by separating the signals into three color planes. Missing green pixels are recovered through interpolation methods, either by bilinear or other techniques, in order to form color ratio signals log B/Gmissing and log R/Gmissing which allows for proper interpolation after decompression without color artifacts. Upon playback or reception, an inverse compression is applied and missing green, red and blue pixels are interpolated to provide three full planes of color image data.

Description

A COMPRESSION METHOD AND APPARATUS FOR SINGLE-SENSOR COLOR IMAGI G SYSTEMS Technical Field
The present invention is directed to a method and an apparatus for processing image data from a single chip color image sensor to facilitate visually lossless data compression prior to storage or transmission. Description of the Prior Art To provide color images, an electronic camera may use a color beamsplitter and three image sensors, one each for red, green, and blue. To reduce the size and cost of the camera, a single sensor, overlaid with a color filter pattern, can be used to obtain color images, provided that the sensor output signal is processed in an appropriate manner in order to demultiplex and interpolate the three color signals.
Many color filter patterns are possible. Some options are described in the paper entitled "Color Filters and Processing Alternatives for One-Chip Cameras" by K. A. Paruls i published in the IEEE Transactions on Electronic Devices, Volume ED-32, Number 8, August 1985, Pages 1381-1389. Single chip color sensors may be used in electronic still cameras as well as video cameras and camcorders. In order to store high quality, low noise color images, an electronic camera should preferrably use digital storage or recording rather than analog storage. U.S. Patent No. 4,131,919, "Electronic Still Camera" by Gareth A. Lloyd and Steven J. Sasson, assigned to Eastman Kodak Co. the assignee of the present invention, describes an electronic still camera which uses digital magnetic tape recording. The digital storage may also be accomplished by using a solid-state memory card. In all cases, the number of digital images which can be
SUBSTITUTESHEET stored can be increased, and the recording time per picture can be reduced, if digital data compression is used to reduce the amount of data required to represent the images. Conventional data compression methods for images from color cameras use the demultiplexed and interpolated three-color data instead of the directly digitized sensor output signal. One example of such an approach is shown in U.S. Patent No. 4,797,729 entitled "Systems for Incorporating an Error-Tolerant Picture Compression Algorithm" by Y. T.Tsai, which patent is also assigned to Eastman Kodak Co.
The color interpolation process will triple the single "plane" of data from the digitized sensor output to three planes of data, one each for the red, green, and blue color information. Each color plane has the same number of pixels as the sensor. Image compression can be done directly on these three planes, or more efficiently, on the YI color space which is derived from the RGB data. After compression, the total amount of data must be much smaller than the "original" digitized sensor output data, or the compression will have served no purpose. Inverse compression will reconstruct the color image in the corresponding color space which can then be further processed, displayed, or printed.
Since the color interpolation itself does not increase the information entropy of the original image, but instead increases the amount of redundant data, conventional compression methods may be less efficient than directly compressing the digitized sensor output signal. Considering the implementation cost, system complexity, and computation time needed, the approach of compressing the demultiplexed and interpolated data is a poor choice.
Attention is thus directed to how the compression might be efficiently accomplished
SUBSTITUTESHEET directly on the sensor output data. Since the CFA introduces a color patterning onto the sensor output data, the data correlation has many discontinuities of its distribution which may reduce the compression efficiency. Treating the sensor output data as a single luminance image record makes uniform saturated colors appear as a very busy image which requires a high bit rate to prevent a visual loss in quality when decompressed. Furthermore, color image data which has been sparsely sampled through a color filter array is very sensitive to errors. A single error in the data may cause a complex error pattern, depending on the location of the error, the pattern of the color filter array, and the color interpolation process. Therefore, straight-forward data compression applied to the color sensor output will not be efficient.
A new method for compressing one-chip color images, which uses the sensor output data more judiciously, and introduces the least complexity in a system implementation, is thus desirable. SUMMARY OF THE INVENTION The present invention provides a method and a real-time system architecture for compressing color images that are obtained from a single-chip CCD imager of the type which uses a color filter array (CFA). The first step of the method is to separate the digitized color sensor output into three records, one (green) for luminance and two (red and blue) for color. The second step is to convert the red and blue records to color ratios which are a function of both the red or blue pixel values and the interpolated luminance (green) signal value at the spatial locations corresponding to the red or blue pixels. The third step is to transform the luminance (green) record from a linear space metric to a "lightness" space perceptually uniform metric (L*). The Television and Engineering Handbook by K. B. Benson Editor, published by McGraw Hill, pages 2.38—2.40 sets forth definitions for uniform color spaces and, more particularly, the L* space. The fourth step is to individually compress the luminance (green) and the two color ratio records (R/G, B/G) to reduce the average bit rate. The compressed image data may then be recorded or transmitted. In the playback stage or at the receiving station, an inverse compression is applied. The decompressed red, green, and blue records are interpolated to obtain the three full color planes of digital image data.
This method has the advantage of processing less data than conventional methods, in less time using less storage, and of providing more efficient compression.
From the foregoing it can be seen that it is a primary object of the present invention to perform image compression on color sensor output data by first rearranging the data into a plurality of records in such a way as to reduce the discontinuities in the data stream.
It is another object of the present invention to process color image data prior to compression by rearranging and processing the sensor output data in such a way that compression on the chrominance information is done on color ratio signals, and compression on the luminance is done in a lightness space metric.
It is yet a further object of the present invention to provide a method for compressing an image from a one-chip color sensor by interpolating the luminance record in order to convert the color data into a form of luminance to color ratios such that errors generated by compression are not amplified by subsequent interpolation processes.
SUBSTITUTESHEET These and other objects of the present invention will become more apparent when taken in conjunction with the following description and drawings wherein like characters indicate like parts and which drawings form a part of the present disclosure.
BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a schematic block diagram of an electronic camera incorporating the present invention. Figure 2 is a schematic block diagram of a playback device that may be used to view images from the electronic camera of Figure 1.
Figure 3 illustrates a matrix of color image pixels formed with a color filter pattern of the type used in the electronic camera of Figure 1.
Figure 4 is a prior art block flow diagram illustrating one conventional method for compressing a color image.
Figure 5 is a block flow diagram illustrating a color filter interpolation method. Figure 6 is a block flow diagram illustrating the preferred embodiment of the camera processing and compression portion of the present invention. Figure 7 is a block flow diagram illustrating the preferred embodiment of the playback decompression and processing method portion of the present invention.
Figure 8 is a block flow diagram of the preferred compression method portion of the present invention.
Figure 9 is a block flow diagram of the preferred decompression method portion of the present invention. DESCRIPTION OF THE PREFERRED EMBODIMENTS OF THE INVENTION Figure 1 illustrates a block diagram of a digital electronic camera. The image of a scene (not shown) is focused onto an image sensor 20 by a camera lens 10. The image sensor 20 is composed of a number of discrete sensor elements 20A or pixels arranged in a two—dimensional array to form individual photosites (see Figure 3). The individual photosites are covered with a regular array of color filters 18. The image sensing elements 20A respond to the appropriately colored incident illumination to provide an analog electronic signal corresponding to the intensity of the illumination incident on the sensor elements. This invention is described in relation to a charge coupled device (CCD) sensor having 1280 horizontal columns and 1024 vertical rows of pixels although other types of image sensors and sensors with other dimensionalities may be used. A lens aperture 12 and shutter 14 are interposed between the lens and image sensor 20 in order to provide the proper sensor illumination level for a variety of scene light levels. A birefringent blur filter 16 is placed in front of the image sensor 20 in order to reduce color aliasing. The analog output signal from the image sensor 20 is processed by an analog signal processor 30 incorporating, for example, a pre—amplifier and a correlated double sampling circuit which provides a low noise video signal and which uses circuits which are well known in the art. The output of the analog signal processor 30 is converted from analog form to digital form in an A/D converter 32. The A/D converter 32 provides an 8 bit data signal for each sample. The digitized color image is processed and compressed in block 40. The compressed digital image data ID from block 40 is recorded in the digital recorder block 50 and is available at its output as stored image data SID. The digital recorder can use any of the various digital recording techniques which are well known in the art, for example digital magnetic tape, digital magnetic disk, optical disk, or solid-state memory cards. A timing and control circuit 60 controls the various camera components in order to capture and store an image in response to the pressing of a camera exposure button (not shown). Referring now to Figure 2, there is shown a schematic block diagram of a device used to display or print images recorded in the electronic camera of Figure 1. A digital playback device 70 allows the stored digital image data SID recorded in the digital recording block 50 of Figure 1 to be played back or to play the image data ID directly from the digital and compression block 40. A digital decompression and processing device 75 performs the inverse image compression and the signal processing in order to provide full resolution RGB data. A video display processing device 80 provides the specific signal processing needed for a particular video display 90, for example line rate conversion, video camera correction and NTSC encoding. A hardcopy print processing device 82 provides the specific signal processing needed for a particular hardcopy printer 92.
Referring to Figure 3, there is shown the color filter pattern 18 incorporated in Figure 1 overlaying the image sensor 20 and the discrete sensing elements 20A. The 3G (green) CFA (color filter array) is a 1280 x 1024 pixel pattern of G(green), R(red), and B(blue) pixels with three quarter G pixels, one eighth R pixels and one eighth B pixels. The CFA pattern shown in Figure 3 and the blur filter 16 shown in Figure 1 are designed according to the teachings of U.S. Patent No. 4,663,661 by J. Weldy et al, entitled "Single Sensor Color Video Camera With Blurring Filter" which patent is also assigned to Eastman Kodak Co. A higher proportion of G pixels relative to R and B is used to improve the luminance resolution of the image.
The G pixels are arranged in horizontal stripes to reduce rise-time artifacts, according to the teachings of U.S. Patent Application Serial No. 208,302 entitled, "Color Imaging Apparatus Employing a Horizontal Stripe Color Filter to Reduce Rise-Time Artifacts" filed June 17, 1988 by Kenneth A. Parulski, which application is assigned to Eastman Kodak Co.
Referring to Figure 4, a prior art block diagram of the digital processing and compression block 40 of Figure 1 is shown implemented with a prior art compression method. Block 9 represents the CFA image data from the A/D converter 32 of Figure 1, which consists of 1024 x 1280 or about 1.3 megabytes of data per image. A 3G CFA interpolation block 11 forms three full 1024 x 1280 planes of image data for RGB, or approximately 3.9 megabytes of data per image. Alternately, three planes Y, I and Q may be formed by directing the RGB image data of block 13 to block 15. Each of the formed YIQ planes is 1024 x 1280 pixels, the same size as the RGB image planes of block 13. Image compression is done directly on the three planes from either block 13 or block 15 in block 17. A system which incorporates an appropriate form of compression is shown in U.S. Patent No.
4,797,729 entitled "Systems Incorporating An Error Tolerant Picture Compression Algorithm" by Y. T. Tsai.
After compression the total amount of data is substantially reduced. The compressed data may then be stored in the digital recording block 50 of Figure 1 (or alternately may be transmitted). When played back (or received) an inverse compression
SUBSTITUTESHEET operation is performed as reflected by block 75 of Figure 2.
The inverse compression reconstructs the color image which can then be used either for further processing, video display, or printing.
When using the block flow of Figure 4 .three times the "raw" sensor data, or 3.9 megabytes, is processed by the image compression block 17. Consequently, the required buffer storage space is increased and the processing time is lengthened.
These two drawbacks are especially significant when the system is implemented in a real-time application.
A key question is how the compression can be implemented on the "raw" sensor data so that the amount of data processed is not increased. Since the CFA introduces a color pattern into the image data, the correlation among the adjacent pixel values varies depending on the color they represent. If the image compression algorithm treats the "raw" sensor data as luminance data, then it is a very "busy" image which needs a high bit rate to represent it with visually lossless quality following color interpolation. Therefore, unless the "raw" sensor data is sorted out by color the CFA image compression will not be efficient. Furthermore, a single error in the uninterpolated image may cause a large error for more than a single pixel in the final interpolated image. Thus, it has been concluded that compression algorithm with good performance on conventional color interpolated images cannot retain its performance when it is applied directly to uninterpolated image data from a single chip color sensor. in order to fully appreciate the data rearrangements used in the compression methods to be discussed, a flow chart of the 3G CFA interpolation
SUBSTITUTESHEET block 11 of Figure 4 is shown in Figure 5. Color edge artifacts (color aliasing) at luminance edges are minimized by interpolating the color signal (red and blue) to luminance (green) signal ratios instead 5 of linearly interpolating the red and blue signals.
The missing green pixels are interpolated through the following equation in block 21: CFA: G1
Figure imgf000012_0001
GMMi--,s„s„ = Missing Green Pixel
G4
G5 G,
15
Where, GMigs = 0.218 (Gχ + G&) -
0.563 (G2 + G5) + 0.844 (G3 + G )
20 The filter coefficients are selected so that the effective PSF (point spread function) of the interpolated green pixels is equal to the PSF of the actual green pixels. For simple implementations, these filter coefficients can be approximated.
25 A linear—to-log conversion is performed in block 22 and the red channel horizontal chroma interpolation is performed by block 24 using:
CFA: Rl Rmiss R2
30 where, Rmi•ss„ — Missing horizontal red p cixels
1°S Rmiss) = lo5(GR miss +
Figure imgf000012_0002
The red channel vertical chroma interpolation equations are processed in block 26 as follows:
SUBSTITUTESHEET
Figure imgf000013_0003
10 loδ Rmiss2 = l0S <GRmiss2> +
Figure imgf000013_0001
15 loδ Rmiss3 = lo* GRmiss3) +
0.25 log (R1/G1) +
0 .75 log (R2/G2)
Where
Figure imgf000013_0002
's are the actual green pixel 20 values at the missing red pixels, and G, and G2 are the interpolated missing green values at the red and blue photosites.
A log-to-linear process is applied to the signals from block 26 by the action of block 28. 25 The blue channel processing uses the same method steps as the red channel which are represented by the block flow of Figure 5.
The chroma interpolation (blocks 24 and 26) typically uses a linear interpolation of the 30 (log R - log Gmiss) and (log B - log Gmiss) values, which is equivalent to linearly interpolating the log /Gmiεs and log B/Gmigs values.
Refer now to Figure 6 which illustrates the digital processing and compres- '.on block 40 of 35 Figure 1 incorporating the preferred embodiment of the camera processing and compression portion of the invention. The input to block 41 is the digitized
SUBSTITUTESHEET CFA image data 9 from the A/D converter 32 in
Figure 1. The image data representing the image pixel pattern is separated into three color planes
42, 44 and 46. Plane 42 is a 1280 x 768 x 8 bit green array, plane 44 is a 640 x 256 x 8 bit red array and plane 46 is a 640 x 256 x 8 bit blue array
(where 8 is the number of bits per pixel).
Each plane of pixels from block 41 is directed to block 48 wherein the missing green pixels are interpolated. Additionally, the log R/G_^sg and log ■B/G_iss values are computed. This is accomplished using lookup tables to perform the logarithmic conversion and a subtraction operation using the well-known equation, log R/Gmi._ss_ = log R — log Gmi . The original (uninterpolated) green pixels are then converted to an L* space or another uniform intensity space, using the relationship L* = 116 (Y/Yn) (1/3) - 16 where: Yn is the value of Y for a reference white. The lookup tables may be implemented in software in the digital processing portion of block 40.
Block 52 represents the three processed planes 54, 56 and 58 corresponding to the planes 42, 44 and 46. A compression operation 61 using, for example, an adaptive discrete cosine transform algorithm is performed on the three processed places from block 52. Once compressed the resulting signals may be stored (or transmitted) as reflected by block 62. At playback or upon receiving the transmitted, compressed image, the compressed signals are processed with the block steps as shown in Figure 7. Figure 7 represents the functions performed by block 75 of Figure 2. Inverse compression is performed in block 68. The missing green, red and blue pixels are interpolated in block 71 which forms the color image data for the three
SUBSTITUTESHEET planes as shown in block 72. The three planes from block 72 use approximately 3.9 Megabytes of data to represent an image.
In summary, missing green pixels are first interpolated so that log B/Gmi. s_s_ and log R/Gm. „s„s can be computed and the original uninterpolated green pixels are converted to L* space such that the noise sensitivity is distributed uniformly. Since chroma interpolation uses log R/G and log B/G, the compression on the chrominance information is preferrably done on this hue ratio so that the subsequent interpolation after playback does not introduce color artifacts . The implementation of the conversion to L* space can be done using a 256 x 8 = 2 K bit lookup table. The log R/Gffii or log
B/G • may be implemented using a 256 x 8 K bits lookup table and one subtraction process (log A/B = log A - log B). Tl;e compression works on three separate files: the uninterpolated green pixels and two smaller size log R G • and log B/G , files. In the playback process, the inverse compression is done first. Then the green pixels are converted from L* to linear space, interpolated, and converted to log space such that the missing red and blue pixel interpolation operation can be performed. The hardware implementation for the compression function 61 is illustrated in Figure 8.
The compressor 61' receives the three digital image input records "I" from block 52 of Figure 6 at a block formatter 116 and formats the image into block I(x,y). The preferred block sizes are either 16 x 16 or 8 x 8 pixels. A two-dimensional discrete cosine transform is performed by the DCT 118 on each block to generate the corresponding block T(i,j) of transform (2 - D DCT) coefficients. Since the
2 — D DCT is a well known procedure, (see for example U.S. Patent No. 4,302,775) no further description
SUBSTITUTESHEET will be given herein of the (2 — D DCT) operation. The transform coefficients T(i,j) for each block are ordered into a one-dimensional array T(k) by an order coefficients device 120 in order of increasing spatial frequency, for example by employing a zig-zag scan along diagonals of the block of coefficients.
Next, the coefficients are adaptively quantized using an adaptive quantizer 122 in accordance with the visibility of quantization noise in the presence of image detail within a block. According to the preferred mode of practicing the invention, the adaptive quantization 122 is comprised of a normalize coefficients section 124, the output of which is directed to a quantize coefficients section 126 for accomplishing a variable normalization 124 prior to a fixed quantization 126. Alternatively, a variable quantization could be employed. The transform coefficients T(k) are normalized by dividing each transform coefficient by a normalization factor N(k) as follows:
TN(k) - T(k)/N(k) where TN(k) is the normalized transform coefficient value. The normalization factor N(k) is provided by a normalization array generator 33 receiving as an input display parameters. This is based on the visibility of quantization noise in the presence of image detail in the block. The normalized coefficients TN(k) are quantized in block 126 to form quantized coefficients TN(k). The quantized coefficients from 126 are encoded in a Huffman and run-length coding section 128 using a minimum redundancy coding scheme to produce code values CV(k). The presently preferred coding scheme is a Huffman code with run-length coding for strings of zero magnitude coefficients. Since Huffman and run—length coding are well known in the art, no
SUBSTITUTESHEET further description of the coding process will be given herein. The coded coefficients are directed to and recorded by the digital recording block 50 of the electronic camera of Figure 1. Referring to Figure 9, the inverse compressor 68', performs the inverse of the compression function performed by the compressor 61• in Figure 8 to recover the digital image data. The code values CV(k) are directed to the input of a decode coefficients block 130 to produce normalized coefficients TN(k) . The normalized coefficients
TN(k) are denormalized in block 132 by dividing by the denormalization values N~ (k) that are the inverse of the normalization array N(k) employed in the transmitter to produce the denormalized coefficients T(k) . Alternatively, the transform coefficients are denormalized by multiploying by the normalization coefficients N(k) . An inverse normalization array generator 34 provides the signal N_1(k).
The one-dimensional string of reconstructed coefficient values T(k) are re-formated in block 136 into two-dimensional signal block T(i,j) and the blocks of coefficients are inversely transformed in block DCT 138 into image values I(x,y). Finally, the block of image values are re-formated in block 140 into the digital image I.
While there has been shown what are considered to be the preferred embodiments of the invention, it will be manifest that many changes and modifications may be made therein without departing from the essential spirit of the invention. It is intended, therefore, in the annexed claims, to cover all such changes and modifications as may fall within the true scope of the invention.
SUBSTITUTESHEET

Claims

Claims :
1. A color image compression apparatus for compressing a color pixel pattern comprising: forming means for forming said color pixel pattern into three color planes of red (R), green (G), and blue (B) pixels; interpolating means coupled to said forming means for interpolating missing green pixels from the color plane of green pixels; processing means for computing the Log
R/G and Log B/G using the interpolated green pixels from said interpolation means; converting means for converting the uninterpolated green pixels from said forming means to an intensity uniform space; and compressing means for compressing the signals from said converting means and said processing means to provide a compressed color image.
2. The color image compression system according to claim 1 wherein said converting means is an L* space converter.
3. The color image compression system according to claim 1 wherein said processing means is comprised of a lookup table of Log B and Log G pixel values coupled to a subtractor such that the values of Log R/G and Log B/G are computed by subtracting the log value of G from the log value of R and G.
4. The color image compression system according to claim 1 wherein said compressing means uses a discrete cosine transform based algorithm.
5. A color imaging apparatus, comprising: an electronic camera, said electronic camera comprised of; image sensing means having a discrete array of image sensing elements each representing a pixel of image data, said image sensing elements each providing an analog output signal indicative of the intensity of incident light sensed thereby;
SUBSTITUTESHEET a color filter pattern means for separating an incident light beam into at least three different colors; means for converting the sensor analog output signals into digital signals; means for separating and forming the digital signals into a plurality of records according to the color of the pixels represented by the digital signals; means for processing and compressing the separate color records; means for digitally recording or transmitting the compressed color records; a playback device, said playback device comprised of: means for recovering the recorded or transmitted digital data; means for decompressing the compressed color records; means for interpolating the missing colored pixels from said image sensing means; and means for interfacing the interpolated color image to a device for displaying or printing the image.
6. The color imaging apparatus according to claim 5 where the said means for processing and compressing uses a discrete cosine transform based algorithm.
7. The color imaging apparatus according to claim 5 where said color filter pattern means is comprised of red, green and blue segments to form red, green and blue pixel image segments.
8. The color imaging apparatus according to claim 7 and further comprising means for receiving the green pixel image segments as a luminance image and for converting the luminance image to a perceptually uniform space before compression.
SUBSTITUTESHEET
9. The color imaging apparatus according to claim 7 and further comprising means for converting said red and blue pixel image segments to the form of R/Gmi•sβs_ and B/Gmi•s_s„ ratios before compression.
10. The color imaging apparatus according to claim 9 wherein said means for converting said
R/Gmi•„ss„ and B/Gmi-,s,s„ ratios comprutes the ratios by J subtracting the log values of G from the log values of R and B.
11. The color imaging apparatus according to claim 9 where said color filter pattern means is comprised of three—quarters luminance pixels arranged in horizontal lines.
12. A color imaging apparatus comprising: a color image sensor for providing an output signal; means for digitizing the sensor output signal; means for separating the digitized sensor output signal into at least three records according to color; means for preprocessing at least two of said records prior to data compression; data compression means for independently compressing each record; and means for storing or transmitting the compressed records.
13. The color imaging apparatus according to claim 12 wherein one record is a highly sampled luminance and the remainder are sparsely sampled color.
14. The color imaging apparatus according to claim 13 wherein the sparsely sampled color signals are formed as the ratio of a color pixel to an interpolated luminance pixel.
SUBSTITUTESHEET
15. A color image compression method comprising the steps of: a. separating a multicolor image into at least three single color records; b. interpolating luminance signal values at each spatial location corresponding to the red and green pixel locations; c. transforming at least one record to a space perceptually uniform metric; d. converting two of the remaining records into two color ratios which are a function the interpolated luminance signal value at the spatial locations corresponding to the red and blue pixels; e. compressing individually the transformed record and said two color ratios; f. transmitting said compressed record and said two color ratios; g. receiving the compressed record and said two color ratios; h. interpolating the received compressed record and said two color ratios to form three color planes of image data; and i. combining and displaying said three color planes of image data to form a multicolor image.
16. The color image compression method according to claim 15 wherein said multicolor image is separated into green, red, and blue records.
17. The color image compression method according to claim 16 wherein said green record is transformed to a space perceptually uniform metric.
18. The color image compression method according to claim 17 wherein said two color ratios are Loε 6 R/'Bmi•ss and L062 B/Gmi•ss
19. The color image compression method according to claim 15 wherein the step of transmitting is deleted and a step of storing said compressed records substituted therefor.
SUBSTITUTESHEET
20. A color image compression method comprising the steps of: a. converting a multicolor image into red, green and blue planes of pixel values; b. forming a set of luminance values for the green plane of pixel values; c. interpolating the missing green pixel values at each associated red and blue pixel value; d. forming a red color ratio for each red pixel value at a spatial location as a function of an associated interpolated missing green pixel value; e. forming a blue color ratio for each blue pixel value at a spatial location as a function of an associated interpolated missing green pixel value; f. compressing said formed set of luminance values and said formed red and blue color ratios; and g. storing said compressed luminance values and said formed red and blue color ratios for future use.
21. The color image compression method according to claim 20 and further comprising the steps of: decompressing the compressed luminance values and said formed red and blue color ratios; interpolating the missing red, green and blue pixel values from said decompressed luminance values and said formed red and blue color ratios to form red, green and blue planes of pixel values; and displaying the combined red, green and blue planes of pixel values to reconstruct said multicolor image.
SUBSTITUTESHEET
22. A color image compression method comprising the steps of: a. converting a multicolor image into planes of green, red and blue pixel values, each associated with a spatial location of said multicolor image; b. interpolating the missing green pixel values at each spatial location corresponding to a red and a blue pixel; c. forming a color ratio for each red pixel value to its associated missing green pixel value; d. forming a color ratio for each blue pixel value to its associated missing green pixel value; e. converting the uninterpolated green pixel values to a lightness space metric; f. compressing said formed lightness space metric and said formed color ratios; and g. storing said compressed formed lightness space metric and said formed color ratios for future use.
23. The color image compression method according to claim 22 wherein said lightness space metric is an L* space.
24. The color image compression method according to claim 22 wherein step g is deleted and the following steps added: h. transmitted said compressed formed lightness space metric and said formed color ratios; i. receiving said compressed formed lightness space metric and said formed color ratios; j. decompressing said compressed formed lightness space metric and said color ratios; k. forming planes of red, green and blue pixel values from said decompressed lightness space metric and said color ratios;
SUBSTITUTESHEET 1. combining said planes of red, green and blue pixel values to form a plane of red, green and blue pixel values; and m. displaying said formed plane as a reconstructed multicolor image.
25. The color image compression method according to claim 22 wherein said color ratios are formed as the Log R Gm _g value, and Log B/G . value,
SUBSTITUTESHEET
PCT/US1990/004091 1989-07-24 1990-07-24 A compression method and apparatus for single-sensor color imaging systems WO1991001613A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US384,353 1989-07-24
US07/384,353 US5053861A (en) 1989-07-24 1989-07-24 Compression method and apparatus for single-sensor color imaging systems

Publications (1)

Publication Number Publication Date
WO1991001613A1 true WO1991001613A1 (en) 1991-02-07

Family

ID=23516996

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1990/004091 WO1991001613A1 (en) 1989-07-24 1990-07-24 A compression method and apparatus for single-sensor color imaging systems

Country Status (4)

Country Link
US (1) US5053861A (en)
EP (1) EP0436012A1 (en)
JP (1) JPH04502996A (en)
WO (1) WO1991001613A1 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1992010911A1 (en) * 1990-12-10 1992-06-25 Eastman Kodak Company Image compression with color interpolation for a single sensor image system
EP0508607A2 (en) * 1991-03-13 1992-10-14 Canon Kabushiki Kaisha Electronic still camera
EP0510921A2 (en) * 1991-04-23 1992-10-28 Canon Kabushiki Kaisha Image processing apparatus
EP0514304A1 (en) * 1991-05-17 1992-11-19 France Telecom Method for coding and decoding colour images with a high compression rate without filtering
US5260808A (en) * 1991-04-23 1993-11-09 Canon Kabushiki Kaisha Image processing apparatus
EP0651562A1 (en) * 1993-10-29 1995-05-03 Eastman Kodak Company An electronic camera utilizing image compression feedback for improved color processing
EP0713629A1 (en) * 1993-07-27 1996-05-29 Sri International Method and apparatus for compression and decompression of digital color images
EP0510933B1 (en) * 1991-04-23 1998-12-02 Canon Kabushiki Kaisha Image processing apparatus and method
KR100580369B1 (en) 2004-06-01 2006-05-15 학교법인연세대학교 Methods and apparatus for encoding/decoding color images
CN101689357A (en) * 2007-04-11 2010-03-31 Red.Com公司 video camera
US8237830B2 (en) 2007-04-11 2012-08-07 Red.Com, Inc. Video camera
US9521384B2 (en) 2013-02-14 2016-12-13 Red.Com, Inc. Green average subtraction in image data
US11503294B2 (en) 2017-07-05 2022-11-15 Red.Com, Llc Video image data processing in electronic devices

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5309183A (en) * 1989-09-28 1994-05-03 Canon Kabushiki Kaisha Image pickup apparatus having difference encoding and non-linear processing of image signals
JP2942903B2 (en) * 1990-11-05 1999-08-30 キヤノン株式会社 Digital camera signal processor
EP0485149B1 (en) * 1990-11-07 1997-07-30 Canon Kabushiki Kaisha Recording apparatus
US5442718A (en) * 1992-09-07 1995-08-15 Sony Corporation Apparatus and method for storing and reproducing digital image data yielding high resolution and high quality video image data
US5452002A (en) * 1993-07-27 1995-09-19 Mu; Guo-Guang Color data image encoding method and apparatus with spectral zonal filter
US5621819A (en) * 1994-04-22 1997-04-15 Victor Company Of Japan, Ltd. Multidimensional multi-valued color image compression and decompression method
US5974174A (en) * 1996-09-26 1999-10-26 Victor Company Of Japan, Ltd. Picture-information processing apparatus
US6360022B1 (en) 1997-04-04 2002-03-19 Sarnoff Corporation Method and apparatus for assessing the visibility of differences between two signal sequences
JPH11122626A (en) 1997-10-17 1999-04-30 Nikon Corp Image processing method, system and record medium recording image processing program
US6130960A (en) * 1997-11-03 2000-10-10 Intel Corporation Block-matching algorithm for color interpolation
US6597394B1 (en) 1997-11-16 2003-07-22 Pictos Technologies, Inc. Programmable image transform processor for digital image processing
US6580456B1 (en) 1997-11-16 2003-06-17 Pictos Technologies, Inc. Programmable timing generator
US6750876B1 (en) 1997-11-16 2004-06-15 Ess Technology, Inc. Programmable display controller
JPH11168745A (en) * 1997-12-03 1999-06-22 Minolta Co Ltd Digital camera
US6366318B1 (en) * 1998-03-27 2002-04-02 Eastman Kodak Company CFA correction for CFA images captured at partial resolution
US6236433B1 (en) * 1998-09-29 2001-05-22 Intel Corporation Scaling algorithm for efficient color representation/recovery in video
US6211897B1 (en) * 1998-11-05 2001-04-03 Eastman Kodak Company Printing system and method for improving print quality of laser thermal printers
JP4450516B2 (en) * 1999-02-25 2010-04-14 サーノフ コーポレーション Method and apparatus for evaluating visibility differences between two signal arrays
US7372485B1 (en) * 1999-06-08 2008-05-13 Lightsurf Technologies, Inc. Digital camera device and methodology for distributed processing and wireless transmission of digital images
US8212893B2 (en) 1999-06-08 2012-07-03 Verisign, Inc. Digital camera device and methodology for distributed processing and wireless transmission of digital images
US6650795B1 (en) 1999-08-10 2003-11-18 Hewlett-Packard Development Company, L.P. Color image capturing system with antialiazing
US6809765B1 (en) * 1999-10-05 2004-10-26 Sony Corporation Demosaicing for digital imaging device using perceptually uniform color space
US6765611B1 (en) 2000-11-21 2004-07-20 Eastman Kodak Company Method for compressing an image from a sparsely sampled extended dynamic range image sensing device
US7694224B2 (en) * 2001-05-31 2010-04-06 International Business Machines Corporation Location predicative restoration of compressed images stored on a hard disk drive with soft and hard errors
US7724281B2 (en) * 2002-02-04 2010-05-25 Syniverse Icx Corporation Device facilitating efficient transfer of digital content from media capture device
JP4460447B2 (en) * 2002-06-28 2010-05-12 ノキア コーポレイション Information terminal
US20070198725A1 (en) * 2004-10-06 2007-08-23 Morris Robert P System and method for utilizing contact information, presence information and device activity
EP1750457A1 (en) * 2005-08-02 2007-02-07 Thomson Licensing Method and circuit arrangement for processing a video signal, and respective camera
FI20095175A (en) * 2009-02-23 2010-08-24 Anygraaf Oy A method for utilizing raster image segmentation in image compression
JP6105950B2 (en) * 2012-02-27 2017-03-29 キヤノン株式会社 Image processing apparatus and method
JP6259188B2 (en) * 2013-01-31 2018-01-10 キヤノン株式会社 Image processing apparatus and method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1986001965A2 (en) * 1984-09-10 1986-03-27 Eastman Kodak Company Signal rpocessing method and apparatus for sampled color image signal
DE3505368A1 (en) * 1985-02-14 1986-08-14 Heinrich-Hertz-Institut für Nachrichtentechnik Berlin GmbH, 1000 Berlin Colour-signal coding
US4774562A (en) * 1987-06-02 1988-09-27 Eastman Kodak Company Image transmission system with preview mode

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5970091A (en) * 1982-10-13 1984-04-20 Nippon Kogaku Kk <Nikon> Electronic still camera
US4663661A (en) * 1985-05-23 1987-05-05 Eastman Kodak Company Single sensor color video camera with blurring filter
US4843573A (en) * 1987-10-26 1989-06-27 Tektronix, Inc. Display-based color system
US4954879A (en) * 1988-12-20 1990-09-04 The Boeing Company Apparatus and method for compressing a video signal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1986001965A2 (en) * 1984-09-10 1986-03-27 Eastman Kodak Company Signal rpocessing method and apparatus for sampled color image signal
DE3505368A1 (en) * 1985-02-14 1986-08-14 Heinrich-Hertz-Institut für Nachrichtentechnik Berlin GmbH, 1000 Berlin Colour-signal coding
US4774562A (en) * 1987-06-02 1988-09-27 Eastman Kodak Company Image transmission system with preview mode

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
IEEE 1989 International Conference on Consumer Electronics, 6-9 June 1989, Rosemont, Illinois, US, ICCE Digest of Technical Papers, IEEE, K.A. PARULSKI et al.: "A Digital Color CCD Imaging System using Custom VLSI Circuits", pages 182-183 see the whole article *

Cited By (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1992010911A1 (en) * 1990-12-10 1992-06-25 Eastman Kodak Company Image compression with color interpolation for a single sensor image system
US5528292A (en) * 1991-03-13 1996-06-18 Canon Kabushiki Kaisha Electric still camera having a plurality of image pickup elements with color filters
EP0508607A2 (en) * 1991-03-13 1992-10-14 Canon Kabushiki Kaisha Electronic still camera
EP0508607A3 (en) * 1991-03-13 1993-05-05 Canon Kabushiki Kaisha Electronic still camera
EP0510921A2 (en) * 1991-04-23 1992-10-28 Canon Kabushiki Kaisha Image processing apparatus
SG80540A1 (en) * 1991-04-23 2001-05-22 Canon Kk Image processing apparatus
EP0510921A3 (en) * 1991-04-23 1993-06-09 Canon Kabushiki Kaisha Image processing apparatus
EP0566219A2 (en) * 1991-04-23 1993-10-20 Canon Kabushiki Kaisha Image processing apparatus
US5260808A (en) * 1991-04-23 1993-11-09 Canon Kabushiki Kaisha Image processing apparatus
EP0566219A3 (en) * 1991-04-23 1994-02-16 Canon Kk
US5930386A (en) * 1991-04-23 1999-07-27 Canon Kabushiki Kaisha Image processing apparatus and method
EP0510933B1 (en) * 1991-04-23 1998-12-02 Canon Kabushiki Kaisha Image processing apparatus and method
FR2676608A1 (en) * 1991-05-17 1992-11-20 France Telecom METHOD FOR ENCODING COLOR IMAGES WITH HIGH PRESSURE RATES WITHOUT FILTERING, DECODING METHOD, ENCODER, DECODER, AND CORRESPONDING APPLICATION.
US5293228A (en) * 1991-05-17 1994-03-08 France Telecom Method for the coding of color images at high compression rate without filtering, corresponding decoding method, coder, decoder and applications
EP0514304A1 (en) * 1991-05-17 1992-11-19 France Telecom Method for coding and decoding colour images with a high compression rate without filtering
EP0713629A1 (en) * 1993-07-27 1996-05-29 Sri International Method and apparatus for compression and decompression of digital color images
EP0713629A4 (en) * 1993-07-27 1997-03-12 Stanford Res Inst Int Method and apparatus for compression and decompression of digital color images
EP0651562A1 (en) * 1993-10-29 1995-05-03 Eastman Kodak Company An electronic camera utilizing image compression feedback for improved color processing
KR100580369B1 (en) 2004-06-01 2006-05-15 학교법인연세대학교 Methods and apparatus for encoding/decoding color images
US9436976B2 (en) 2007-04-11 2016-09-06 Red.Com, Inc. Video camera
CN104702926B (en) * 2007-04-11 2017-05-17 Red.Com 公司 Video camera
US8237830B2 (en) 2007-04-11 2012-08-07 Red.Com, Inc. Video camera
EP2793219A1 (en) * 2007-04-11 2014-10-22 Red.Com, Inc. Video camera
US8872933B2 (en) 2007-04-11 2014-10-28 Red.Com, Inc. Video camera
US8878952B2 (en) 2007-04-11 2014-11-04 Red.Com, Inc. Video camera
US9019393B2 (en) 2007-04-11 2015-04-28 Red.Com, Inc. Video processing system and method
CN101689357A (en) * 2007-04-11 2010-03-31 Red.Com公司 video camera
US9230299B2 (en) 2007-04-11 2016-01-05 Red.Com, Inc. Video camera
US9245314B2 (en) 2007-04-11 2016-01-26 Red.Com, Inc. Video camera
CN104702926A (en) * 2007-04-11 2015-06-10 Red.Com公司 Video camera
US9792672B2 (en) 2007-04-11 2017-10-17 Red.Com, Llc Video capture devices and methods
US9596385B2 (en) 2007-04-11 2017-03-14 Red.Com, Inc. Electronic apparatus
EP2145330A4 (en) * 2007-04-11 2011-09-07 Red Com Inc Video camera
US9787878B2 (en) 2007-04-11 2017-10-10 Red.Com, Llc Video camera
US9716866B2 (en) 2013-02-14 2017-07-25 Red.Com, Inc. Green image data processing
US9521384B2 (en) 2013-02-14 2016-12-13 Red.Com, Inc. Green average subtraction in image data
US10582168B2 (en) 2013-02-14 2020-03-03 Red.Com, Llc Green image data processing
US11503294B2 (en) 2017-07-05 2022-11-15 Red.Com, Llc Video image data processing in electronic devices
US11818351B2 (en) 2017-07-05 2023-11-14 Red.Com, Llc Video image data processing in electronic devices

Also Published As

Publication number Publication date
US5053861A (en) 1991-10-01
EP0436012A1 (en) 1991-07-10
JPH04502996A (en) 1992-05-28

Similar Documents

Publication Publication Date Title
US5053861A (en) Compression method and apparatus for single-sensor color imaging systems
US5065229A (en) Compression method and apparatus for single-sensor color imaging systems
US5172227A (en) Image compression with color interpolation for a single sensor image system
US5412427A (en) Electronic camera utilizing image compression feedback for improved color processing
US5541653A (en) Method and appartus for increasing resolution of digital color images using correlated decoding
US4974078A (en) Digital compression method and system with improved coding efficiency
JP4559622B2 (en) Color image compression based on two-dimensional discrete wavelet transform yielding perceptually lossless images
US6366318B1 (en) CFA correction for CFA images captured at partial resolution
EP0472699B1 (en) Electronic still camera providing multi-format storage of full and reduced resolution images
US5237402A (en) Digital image processing circuitry
US20050276496A1 (en) Image compression for rapid high-quality imaging
EP0909516A1 (en) Method and apparatus for decoding spatiochromatically multiplexed color images using predetermined coefficients
US6515698B1 (en) Image recording apparatus
JP3864748B2 (en) Image processing apparatus, electronic camera, and image processing program
WO2001026358A1 (en) Demosaicing for digital imaging device using perceptually uniform color space
EP1271928A2 (en) System and method for processing demosaiced images to reduce color aliasing artifacts
JP4683678B2 (en) Image signal processing method, image signal processing system, storage medium, and imaging apparatus
EP1769459A1 (en) Image compression for rapid high-quality imaging
JP3532963B2 (en) Image compression device
WO1999013429A1 (en) A method for directly compressing a color image and tailoring the compression based on the color filter array, optics, and sensor characteristics
JP2891246B2 (en) Digital camera
US6208754B1 (en) Image compression and expansion device using pixel offset
JP2908796B2 (en) Image signal orthogonal transform coding device
JP2766528B2 (en) Electronic camera image data processing device
JP2824255B2 (en) Image signal orthogonal transform coding device

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): JP

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB IT LU NL SE

WWE Wipo information: entry into national phase

Ref document number: 1990912003

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1990912003

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 1990912003

Country of ref document: EP