US20040062437A1 - Method and system for generating digital image files for a limited display - Google Patents

Method and system for generating digital image files for a limited display Download PDF

Info

Publication number
US20040062437A1
US20040062437A1 US10/259,538 US25953802A US2004062437A1 US 20040062437 A1 US20040062437 A1 US 20040062437A1 US 25953802 A US25953802 A US 25953802A US 2004062437 A1 US2004062437 A1 US 2004062437A1
Authority
US
United States
Prior art keywords
image
file size
display
maximum
error diffusion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US10/259,538
Other versions
US7130474B2 (en
Inventor
Jiebo Luo
Gustav Braum
Christophe Papin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Monument Peak Ventures LLC
Original Assignee
Eastman Kodak Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eastman Kodak Co filed Critical Eastman Kodak Co
Priority to US10/259,538 priority Critical patent/US7130474B2/en
Assigned to EASTMAN KODAK COMPANY reassignment EASTMAN KODAK COMPANY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BRAUN, GUSTAV, LUO, JIEBO, PAPIN, CHRISTOPHE
Priority to JP2003207569A priority patent/JP4347625B2/en
Priority to DE60302311T priority patent/DE60302311T2/en
Priority to EP03077885A priority patent/EP1403823B1/en
Publication of US20040062437A1 publication Critical patent/US20040062437A1/en
Application granted granted Critical
Publication of US7130474B2 publication Critical patent/US7130474B2/en
Assigned to CITICORP NORTH AMERICA, INC., AS AGENT reassignment CITICORP NORTH AMERICA, INC., AS AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: EASTMAN KODAK COMPANY, PAKON, INC.
Assigned to LASER-PACIFIC MEDIA CORPORATION, EASTMAN KODAK COMPANY, QUALEX INC., KODAK (NEAR EAST), INC., EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC., NPEC INC., KODAK IMAGING NETWORK, INC., FAR EAST DEVELOPMENT LTD., CREO MANUFACTURING AMERICA LLC, KODAK PORTUGUESA LIMITED, PAKON, INC., KODAK AVIATION LEASING LLC, KODAK REALTY, INC., KODAK AMERICAS, LTD., KODAK PHILIPPINES, LTD., FPC INC. reassignment LASER-PACIFIC MEDIA CORPORATION PATENT RELEASE Assignors: CITICORP NORTH AMERICA, INC., WILMINGTON TRUST, NATIONAL ASSOCIATION
Assigned to INTELLECTUAL VENTURES FUND 83 LLC reassignment INTELLECTUAL VENTURES FUND 83 LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: EASTMAN KODAK COMPANY
Assigned to MONUMENT PEAK VENTURES, LLC reassignment MONUMENT PEAK VENTURES, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: INTELLECTUAL VENTURES FUND 83 LLC
Assigned to MONUMENT PEAK VENTURES, LLC reassignment MONUMENT PEAK VENTURES, LLC RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: INTELLECTUAL VENTURES FUND 83 LLC
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformation in the plane of the image
    • G06T3/40Scaling the whole image or part thereof

Definitions

  • This invention relates to the field of digital imaging, and more particularly to a method for generating a digital file for representing a digital color image using a limited palette of color values.
  • the input digital image can be converted to the 8-bit representation simply by taking the highest 2- or 3-bits of each of the corresponding RGB channels. The result is an image that has quantization errors that can produce visible contours in the image in many circumstances.
  • This color palette is referred to as the 3-3-2 palette and is used in a number of wireless devices such as the Ericsson T68 cell phone.
  • One method for minimizing the visibility of the quantization errors in the reduced bit-depth image is to use a multi-level halftoning algorithm to preserve the local mean of the color value.
  • R. S. Gentile, E. Walowit and J. P. Allebach, “Quantization and multilevel halftoning of color images for near original image quality,” J. Opt. Soc. Am. A 7, 1019-1026 (1990) described various methods for quantization and multilevel halftoning of color images.
  • One commonly used multi-level halftoning method is called error diffusion. The detail of error diffusion will be discussed later.
  • the indices are usually compressed using a lossless file format such as CompuServe GIF, or Portable Network Graphics (PNG) (see http://www.w3.org/Graphics/PNG), or the upcoming Joint Photographic Network Group recommended format referred to as JPEG 2000 (see http://wwwjpeg.org), by taking advantage of the data redundancy because of correlation in the image structures.
  • a dithering process such as error diffusion (see P. G. Roetling and R. P. Loce, “Digital halftoning,” in Digital Image Processing Methods, E. Dougherty, Ed. New York: Marcel Dekker, 1994.
  • the original attachments are simply removed from the messages and saved in a network media-sharing repository, which can be subsequently accessed via a link (e.g., URL) referencing that storage address.
  • Recipients can specify their wireless handheld device type, and opt to receive transformations of this type of attachment.
  • Kirani and Whittington apply a transformation to the current attachment that corresponds to the least capable in the set of those multiple devices. Clearly, this process is cumbersome and the least capable device determines the image quality for all devices.
  • the present invention is directed to overcoming one or more of the problems set forth above.
  • the invention resides in a method for rendering and compressing a digital image for display on a display device, where the display device has a display resolution less than the resolution of the digital image, uses a display palette for rendering the digital image, and connects with a transmission channel that imposes a limit on a maximum file size.
  • the method includes the steps of (a) resizing the digital image to the display resolution to produce a display-sized image; (b) quantizing the display-sized image to the display palette with an error diffusion process that produces an error diffused display-sized image, where the error diffusion process has an initial error diffusion rate; (c) losslessly compressing the error diffused display-sized image to produce a compressed display-sized image having a particular file size; (d) comparing the particular file size to the maximum file size and, if the file size is less than the maximum file size, transmitting the display-sized image to the display; (e) if the particular file size is greater than the maximum file size, but less than another predetermined file size that is greater than the maximum file size, reducing the error diffusion rate by a predetermined amount in order to reduce the file size and then repeating steps subsequent to step (a) on the resized image at the reduced error diffusion rate; and (f) if the particular file size is greater than both the maximum file size and the predetermined file size, simplifying the resized image by reducing
  • the present invention has the advantage that the visual quality of the image represented by a digital image file of a size closest to the maximum file size is the highest possible, in the sense that the visual distortion due the quantization by a fixed device palette will be minimized and the prominent image structures are preserved.
  • FIG. 1 is a flow diagram illustrating the method of the present invention for generating digital image files for limited displays.
  • FIG. 2 is a pictorial example that is helpful in illustrating the process and effect of the present invention.
  • FIG. 3 is a diagram showing a known multi-level vector error diffusion process.
  • FIG. 4 shows an example set of error weights that can be used for the multi-level vector error diffusion process shown in FIG. 3.
  • FIG. 5 shows an example of an open space (OS) mask.
  • FIG. 6 shows an example of a region of interest (ROI) mask, particularly for a face.
  • ROI region of interest
  • FIG. 7 shows the inputs and output of an image simplification process used in the method illustrated in FIG. 1.
  • FIG. 8 shows the inputs and outputs of the quantization and error diffusion process used in the method illustrated in FIG. 1.
  • the program may be stored in conventional computer readable storage medium, which may comprise, for example; magnetic storage media such as a magnetic disk (such as a floppy disk or a hard drive) or magnetic tape; optical storage media such as an optical disc, optical tape, or machine readable bar code; solid state electronic storage devices such as random access memory (RAM), or read only memory (ROM); or any other physical device or medium employed to store a computer program.
  • magnetic storage media such as a magnetic disk (such as a floppy disk or a hard drive) or magnetic tape
  • optical storage media such as an optical disc, optical tape, or machine readable bar code
  • solid state electronic storage devices such as random access memory (RAM), or read only memory (ROM); or any other physical device or medium employed to store a computer program.
  • Multi-level halftoning One of the known techniques for generating digital files for use with a display device is multi-level halftoning.
  • Multi-level halftoning algorithms can be used to create the appearance of color values intermediate to the palette colors by varying the palette values assigned to the pixels of the output digital color image such that a local average color value is preserved.
  • An example of a known multi-level halftoning method that could be used is multi-level vector error diffusion.
  • a flow diagram illustrating a typical multi-level vector error diffusion algorithm is shown in FIG. 3.
  • an input pixel color value I i,j of from the i th column and j th row of the input digital color image 15 is processed by assigning a palette color to each image pixel (step 17 ) to form a corresponding output pixel color value O i,j of the output digital color image 18 .
  • Assigning a palette color to each image pixel in step 17 introduces a quantization error. This error is due to the fact that the output pixel value is selected from one of the palette colors in the predetermined set of palette colors 16 .
  • a difference operation 30 is used to compute a color error E i,j representing the vector difference between the input pixel color value I i,j and the output pixel color value O i,j .
  • a weight errors step 32 is used to apply a series of error weights W i,j to the resulting color error E i,j .
  • a sum operation 34 is then used to add the weighted color errors to nearby input pixels that have yet to be processed.
  • FIG. 4 An example set of error weights W i,j is shown in FIG. 4.
  • the color error E i,j for the current pixel 40 with column and row address (i, j) is weighted by a factor of ⁇ fraction (1/4) ⁇ and distributed to the next pixel to the right 42 in the current row of the image having the column and row address (i+1, j).
  • the color error E i,j is also weighted by factors of ⁇ fraction (1/4) ⁇ and distributed to three pixels in the next row of the image 44 having column and row addresses (i ⁇ 1, j+1), (i, j+1) and (i+1, j+1).
  • the quantization errors introduced when processing the current pixel 40 are distributed to nearby input pixels that have not yet been processed. The result is that the local average color value is approximately preserved.
  • the quantization artifacts are alleviated because of the re-distribution of quantization error to the neighboring pixels.
  • the image looks the best if close to 100% of the quantization error is re-distributed. If the rate of error diffusion is defined as the sum of all weights multiplied by 100, then the preferred goal is to use a high error diffusion rate that is as close to 100% as possible, e.g., 90%.
  • error diffusion introduces high frequency components to the image and therefore reduces the amount of data correlation in the image, making it more difficult to compress the resulting image (i.e., to satisfy the maximum file size requirement).
  • the error diffusion weights W i,j at a given error diffusion rate R can be readily determined by multiplying the weights at the 100% rate by the current error diffusion rate.
  • a rule of thumb is that if less than 50% of the quantization error is distributed, the effect of error diffusion is diminished to merely adding noise to the quantized image. Therefore, some alternative way of increasing the data correlation is needed if the error diffusion rate is reduced to 50% and the corresponding file size is still above the limit on maximum file size.
  • a nonlinear filter such as the Sigma filter has the advantage of better preserving image details when removing noise than linear filters.
  • a local average of neighboring pixel values that are within a difference of ⁇ of the current pixel value is used to replace the current pixel value.
  • edges of large magnitude are preserved this way while noise of low magnitude is removed.
  • the Sigma filter Due to its edge-preserving ability, the Sigma filter is a good choice for removing less important image details, but it is not the only edge-preserving filter that could be useful.
  • Other edge-preserving spatial smoothing filters include without limitation the Huber Markov Random Field filter described in J. Luo, C. W. Chen, K. J. Parker, and T. S. Huang, “Artifacts removal in low bit rate compressed images”, IEEE Trans. Image Processing, Vol. 5, 1996, pp. 1363-1368.
  • an input digital image 15 is processed to create an output digital image that is transmitted ( 190 ).
  • the processing consists of loading ( 100 ) the input digital image 15 into a computer program.
  • the image is then preprocessed ( 110 ) according to some desired processing scheme to create a preprocessed image.
  • This preprocessing ( 110 ) scheme might include, but is not limited to, scene balance, contrast enhancement, sharpening and rotation.
  • copies of the preprocessed image are sent to a resizing process ( 120 ), a region of interest (ROI) identifier ( 260 ), and an open-space identifier ( 270 ).
  • the preprocessed images sent to the ROI identifier ( 260 ) and the open space (OS) identifier ( 270 ) are processed according to a process to be described later. These two identifiers are used to apply additional protection of the ROI and extreme simplification of the smooth regions in the image.
  • digital image understanding technology which is understood to mean technology that digitally processes a digital image to recognize and thereby assign useful meaning to human understandable objects, attributes or conditions and then to utilize the results obtained in the further processing of the digital image.
  • the resizing operator ( 120 ) resizes the preprocessed image to create a resized image (according both to the original image aspect ratio and the device pixel ratio).
  • the resizing operator reduces the size of the image because the display resolution is often significantly lower than the resolution of the input image.
  • Good choices for the resizing operator include bi-linear and bi-cubic interpolators, which are well known in the art.
  • the error-diffusion (ED) weight (R) is set to a pre-determined initial value corresponding to diffusing close to 100% of the color quantization error.
  • the resized image (from the step 120 ), the error-diffusion weight (R), and a display palette (P) (provided by stage 150 ) are input into a quantization and error diffusion process ( 140 ).
  • the resized image is quantized to the display palette (P), and the quantization error is diffused according to the diffusion weight (R) and the process referred to in FIG. 3, to produce a quantized image in step 140 .
  • the quantized image is compressed ( 160 ) using a compression process to create a compressed image. This compression process is based on a lossless compressor such as that found in the PNG specification.
  • the compressed file size (F) is then calculated ( 170 ).
  • the compressed file size (F) is compared to a first threshold size (S1) in comparison 180 , e.g., to a threshold size of 3 kilo bytes. If the compressed file size (F) is less than the first threshold size (S1), the compressed image is transmitted ( 190 ) to the display device. If the compressed file size (F) is greater than (S1), the compressed file size (F) is compared to a second threshold size (S2) in a second comparison 200 , e.g., 3.5 kilo bytes. If the compressed file size (F) is less than the second threshold size (S2), the error-diffusion rate (R) is reduced ( 210 ) by a fixed percentage, e.g., 10%.
  • T e.g., a threshold of 50%.
  • the image simplification process ( 230 ) requires as its input the resized image ( 120 ) and certain optional inputs as indicated by broken line, including the region of interest (ROI) mask ( 240 ) and/or the open space (OS) mask ( 250 ).
  • the image simplification process ( 230 ) returns a simplified image ( 280 ) based on application of an image filter, such as the aforementioned sigma filter, to the resized image, which removes, or smoothes, low-magnitude spatial variations, regardless of their frequency content, which appear in more or less flat regions and are perceptually less important than edges of large magnitude.
  • an image filter such as the aforementioned sigma filter
  • the ROI ( 240 ) and OS ( 250 ) masks are used in the image simplification process in the following manner.
  • the ROI mask ( 240 ) is used to shield certain image regions identified in the ROI mask from the image filtering, such as the sigma filtering; more specifically, those regions in the mask having values equal to one are shielded from the image filtering.
  • the OS mask is used to convert those image regions identified in the OS mask with mask values equal to one to a single color value, such as the mean color value of the region.
  • the error-diffusion rate (R) is reset to a starting value (R0) and the process of quantizing the resized and simplified image to the display palette ( 140 ) is started again.
  • the process of reducing the error-diffusion rate (R) ( 210 ) and simplifying the image ( 230 ) are repeated until F is less than S1 and the quantized image is transmitted to the display device ( 190 ).
  • FIG. 2 The process and effect of the present invention is illustrated in FIG. 2.
  • An input image 20 is shown which includes a person standing in the foreground along with a tree, while sky, cloud, and grass lawn form the background of the scene.
  • quantization would lead to visually objectionable quantization artifacts such as unrecognizable facial features and heavy contouring in the sky region.
  • the regions corresponding to cloud, foliage, and lawn are treated as less important regions 22 and receive the most simplification, and the details in these regions are simplified to enable high quality rendering of the more prominent image structures such as the person, horizon, outline of the tree, etc.
  • an important image structure such as a human face 24
  • has relatively subtle features especially when an image is reduced to a small size.
  • a face detector is utilized to identify ( 260 ) a region of interest (ROI) to be protected from image simplification ( 230 ).
  • This region of the image is quantized to the display palette using an error-diffusion rate (R) equal to some maximal value deemed appropriate.
  • the ROI defined using the face detector is isolated from the remainder of the image regions by creating a ROI mask ( 240 ).
  • FIG. 6 for an illustration of a ROI mask created from the example image shown in FIG. 2. This mask has the same dimensions as the input image with pixel values equal to one (denoted by the white regions) in the ROI defined by the face detection process and zeros elsewhere (denoted by the black regions).
  • this mask ( 240 ) is used by the image simplification process ( 230 ) to identify the regions of the image that are not to be simplified, and by the error diffusion process ( 140 ) to apply 100% error diffusion, or a rate approaching 100%, to the regions of interest.
  • the image quantization process ( 140 ) has three required inputs: an error diffusion rate (R), the display palette ( 150 ), and either the resized image ( 120 ) or the simplified image ( 280 ).
  • the OS mask ( 240 ) and the ROI mask ( 250 ) are optional to the image quantization process and are only used if they are created in the normal flow of the algorithm. If the ROI mask ( 240 ) is present, in the quantize and diffuse image process ( 140 ), regions in the resized image ( 120 ) or in the simplified image ( 280 ) corresponding to ones in the ROI mask are quantized to the display palette ( 150 ) using an error diffusion process with a diffusion rate (R) set to a maximal value deemed appropriate.
  • the regions of the simplified image ( 280 ) are quantized to the display palette using an error diffusion rate (R) set to a minimal value, such as zero.
  • the remaining regions in the image are quantized to the display palette using the error diffusion rate (R) that is currently being used in the process.
  • an open space detector is used to identify ( 270 ) smooth regions in an image. Each of these regions is then converted (or quantized) to a single unique color value that is within the display palette. This process has the effect of reproducing these areas without quantization artifacts such as contour bands or dithering noise associated with error diffusion. As a result, for a given open-space feature, the region is rendered smoothly with a common color that best represents the color within the region.
  • a mask ( 250 ) is generated that distinguishes open-space regions 300 from the remaining regions in the image.
  • the sky regions ( 26 ) shown in FIG. 2 were identified as OS regions 300 .
  • the mask shown in FIG. 5 has ones everywhere there was a sky region and zeros everywhere else.
  • This mask is used to guide special treatment of the open-space regions in both the image simplification ( 230 ) and the error-diffusion process ( 140 ).
  • pixels in an open-space region receive the most extreme simplification, i.e., set to a single color, and are then quantized to a single palette color with 0% of error diffusion applied to the entire open-space region.
  • the face region 24 is detected and excluded from image simplification to ensure the best rendering of face features.
  • the sky region is identified as an open space region 26 and subsequently quantized to a single blue color and excluded from the error diffusion process.
  • the rendered image may be cropped at the image borders to the extent that the file size of the cropped image is smaller than S1.

Abstract

A method for processing a digital color image for display and transmission includes the steps of (a) resizing the image to a lower display resolution to produce a display-sized image, (b) quantizing the display-sized image to a display palette with an error diffusion process to produce an error diffused image, (c) losslessly compressing the error diffused image to produce a compressed image having a particular file size, (d) comparing the file size to a maximum file size and if less than the maximum file size, transmitting the digital image to the display; (e) if the file size is greater than the maximum file size but less than a another predetermined file size, reducing the error diffusion rate by a predetermined amount in order to reduce the file size; and (f) if the file size is greater than the maximum file size and the predetermined file size, simplifying the resized image by reducing image detail to produce a simplified image and repeating the preceding steps on the simplified image.

Description

    FIELD OF THE INVENTION
  • This invention relates to the field of digital imaging, and more particularly to a method for generating a digital file for representing a digital color image using a limited palette of color values. [0001]
  • BACKGROUND OF THE INVENTION
  • Many color image output devices are not capable of displaying all of the colors in an input digital image due to the fact that they must be stored in a memory buffer with a reduced bit-depth. Likewise, it may also be desirable to represent an image using a reduced bit-depth in order to reduce the amount of bandwidth needed for the transmission of an image, or the amount of memory needed to store an image. For example, many computers may use an 8-bit or a 16 bit color representation to store an image that is to be displayed on a soft-copy display such as a CRT or an LCD screen. Such representations allow only 256 and 65,536 unique color values, respectively. This is significantly less than the 16,777,216 possible color values associated with a typical 24-bit color image that is conventionally used in many digital imaging applications. [0002]
  • In applications where it is necessary to represent an input image using a reduced number of colors, it is necessary to determine the set of colors to be included in the reduced set of colors. In some cases, a reduced set of colors may be determined ahead of time independent of the particular image being encoded. For example, 3-bits of color information ([0003] 8 different levels) may be used for the red and green channels of an image, and 2-bits of color information (4 different levels) may be used for the blue channel of an image. This produces a lattice of 8×8×4=256 different color values that can be used to represent the input image using an 8-bit representation. The input digital image can be converted to the 8-bit representation simply by taking the highest 2- or 3-bits of each of the corresponding RGB channels. The result is an image that has quantization errors that can produce visible contours in the image in many circumstances. This color palette is referred to as the 3-3-2 palette and is used in a number of wireless devices such as the Ericsson T68 cell phone.
  • One method for minimizing the visibility of the quantization errors in the reduced bit-depth image is to use a multi-level halftoning algorithm to preserve the local mean of the color value. R. S. Gentile, E. Walowit and J. P. Allebach, “Quantization and multilevel halftoning of color images for near original image quality,” [0004] J. Opt. Soc. Am. A 7, 1019-1026 (1990) described various methods for quantization and multilevel halftoning of color images. One commonly used multi-level halftoning method is called error diffusion. The detail of error diffusion will be discussed later.
  • In wireless communication, there is usually a limit on the size of the file to be transmitted through the air and received by a targeted wireless device. For example, the current wireless communication standard requires that the file size should not exceed 3 kilo bytes. In the case of the EricssonT68 cell phone, let us assume that one would like to display an image of the size of 96×64 pixels on its color screen. Even after a digital color image is rendered by the 3-3-2 color palette and reduced to 1 byte per pixel, it takes 96×64 =6144 bytes to simply store the indices to the color palette. In general, it is undesirable to compress the indices in a lossy fashion because any error in the index value could result in significant color distortion due to indexing error. Therefore, the indices are usually compressed using a lossless file format such as CompuServe GIF, or Portable Network Graphics (PNG) (see http://www.w3.org/Graphics/PNG), or the upcoming Joint Photographic Network Group recommended format referred to as JPEG 2000 (see http://wwwjpeg.org), by taking advantage of the data redundancy because of correlation in the image structures. In addition, a dithering process such as error diffusion (see P. G. Roetling and R. P. Loce, “Digital halftoning,” in [0005] Digital Image Processing Methods, E. Dougherty, Ed. New York: Marcel Dekker, 1994. ) is frequently employed to alleviate color quantization effect, due to the use of a display palette, in order to produce a visually more pleasing image. Because the image has been reduced to a small size, and more importantly, the amount of correlation is significantly reduced by the error diffusion process, which is of high-pass nature in terms of frequency response, it becomes extremely challenging to achieve the needed compression in order to get the file size below the required 3 kilo bytes. On one hand, compression is required to satisfy the bandwidth limitation. On the other hand, compression (including quantization, and resizing) inevitably reduces the image quality. In short, the requirements for small file size and good image quality are competing constraints.
  • Conventional systems are generally unable to provide a good solution given similar competing constraints. In U.S. patent application Publication No. 2002/0016818 A1, which is entitled “System and Methodology for Optimizing Delivery of Email Attachments for Disparate Devices” and was published on Feb. 7, 2002, Kirani and Whittington disclose system and methodology for optimizing delivery of email attachments for disparate devices. Kirani and Whittington compare the size of attached images to the capabilities of the types of the recipient client device, and pre-empt the delivery of the original format of those attachments if they are determined to be burdensome or overwhelming for the particular recipient device in use. In cases wherein these attachments would strain the capabilities of the recipient device's wireless bandwidth and/or display features, the original attachments are simply removed from the messages and saved in a network media-sharing repository, which can be subsequently accessed via a link (e.g., URL) referencing that storage address. Recipients can specify their wireless handheld device type, and opt to receive transformations of this type of attachment. In cases wherein the recipient has previously used and specified multiple types of client devices, Kirani and Whittington apply a transformation to the current attachment that corresponds to the least capable in the set of those multiple devices. Clearly, this process is cumbersome and the least capable device determines the image quality for all devices. [0006]
  • There is therefore a need to provide a method for rendering and compressing a digital image for display on a display device using a display palette and having a display resolution less than the original image resolution, where the transmission channel also imposes a limit on the maximum file size. [0007]
  • SUMMARY OF THE INVENTION
  • The present invention is directed to overcoming one or more of the problems set forth above. Briefly summarized, according to one aspect of the present invention, the invention resides in a method for rendering and compressing a digital image for display on a display device, where the display device has a display resolution less than the resolution of the digital image, uses a display palette for rendering the digital image, and connects with a transmission channel that imposes a limit on a maximum file size. The method includes the steps of (a) resizing the digital image to the display resolution to produce a display-sized image; (b) quantizing the display-sized image to the display palette with an error diffusion process that produces an error diffused display-sized image, where the error diffusion process has an initial error diffusion rate; (c) losslessly compressing the error diffused display-sized image to produce a compressed display-sized image having a particular file size; (d) comparing the particular file size to the maximum file size and, if the file size is less than the maximum file size, transmitting the display-sized image to the display; (e) if the particular file size is greater than the maximum file size, but less than another predetermined file size that is greater than the maximum file size, reducing the error diffusion rate by a predetermined amount in order to reduce the file size and then repeating steps subsequent to step (a) on the resized image at the reduced error diffusion rate; and (f) if the particular file size is greater than both the maximum file size and the predetermined file size, simplifying the resized image by reducing image detail to produce a simplified image and then repeating steps subsequent to step (a) on the simplified image until the particular file size is less than the maximum file size. [0008]
  • The present invention has the advantage that the visual quality of the image represented by a digital image file of a size closest to the maximum file size is the highest possible, in the sense that the visual distortion due the quantization by a fixed device palette will be minimized and the prominent image structures are preserved. [0009]
  • These and other aspects, objects, features and advantages of the present invention will be more clearly understood and appreciated from a review of the following detailed description of the preferred embodiments and appended claims, and by reference to the accompanying drawings.[0010]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a flow diagram illustrating the method of the present invention for generating digital image files for limited displays. [0011]
  • FIG. 2 is a pictorial example that is helpful in illustrating the process and effect of the present invention. [0012]
  • FIG. 3 is a diagram showing a known multi-level vector error diffusion process. [0013]
  • FIG. 4 shows an example set of error weights that can be used for the multi-level vector error diffusion process shown in FIG. 3. [0014]
  • FIG. 5 shows an example of an open space (OS) mask. [0015]
  • FIG. 6 shows an example of a region of interest (ROI) mask, particularly for a face. [0016]
  • FIG. 7 shows the inputs and output of an image simplification process used in the method illustrated in FIG. 1. [0017]
  • FIG. 8 shows the inputs and outputs of the quantization and error diffusion process used in the method illustrated in FIG. 1.[0018]
  • DETAILED DESCRIPTION OF THE INVENTION
  • Because image processing systems employing algorithms for generating digital files for use with a display device are well known, the present description will be directed in particular to attributes forming part of, or cooperating more directly with, the method and system in accordance with the present invention. Attributes not specifically shown or described herein may be selected from those known in the art. In the following description, a preferred embodiment of the present invention would ordinarily be implemented as a software program, although those skilled in the art will readily recognize that the equivalent of such software may also be constructed in hardware. Given the method and system as described according to the invention in the following materials, software not specifically shown, suggested or described herein that is useful for implementation of the invention is conventional and within the ordinary skill in such arts. [0019]
  • If the invention is implemented as a computer program, the program may be stored in conventional computer readable storage medium, which may comprise, for example; magnetic storage media such as a magnetic disk (such as a floppy disk or a hard drive) or magnetic tape; optical storage media such as an optical disc, optical tape, or machine readable bar code; solid state electronic storage devices such as random access memory (RAM), or read only memory (ROM); or any other physical device or medium employed to store a computer program. [0020]
  • One of the known techniques for generating digital files for use with a display device is multi-level halftoning. Multi-level halftoning algorithms can be used to create the appearance of color values intermediate to the palette colors by varying the palette values assigned to the pixels of the output digital color image such that a local average color value is preserved. An example of a known multi-level halftoning method that could be used is multi-level vector error diffusion. A flow diagram illustrating a typical multi-level vector error diffusion algorithm is shown in FIG. 3. In this figure, an input pixel color value I[0021] i,j of from the ith column and jth row of the input digital color image 15 is processed by assigning a palette color to each image pixel (step 17) to form a corresponding output pixel color value Oi,j of the output digital color image 18. Assigning a palette color to each image pixel in step 17 introduces a quantization error. This error is due to the fact that the output pixel value is selected from one of the palette colors in the predetermined set of palette colors 16. A difference operation 30 is used to compute a color error Ei,j representing the vector difference between the input pixel color value Ii,j and the output pixel color value Oi,j. A weight errors step 32 is used to apply a series of error weights Wi,j to the resulting color error Ei,j. A sum operation 34 is then used to add the weighted color errors to nearby input pixels that have yet to be processed.
  • An example set of error weights W[0022] i,j is shown in FIG. 4. In this example, the color error Ei,j for the current pixel 40 with column and row address (i, j) is weighted by a factor of {fraction (1/4)} and distributed to the next pixel to the right 42 in the current row of the image having the column and row address (i+1, j). Likewise the color error Ei,j is also weighted by factors of {fraction (1/4)} and distributed to three pixels in the next row of the image 44 having column and row addresses (i−1, j+1), (i, j+1) and (i+1, j+1). In this way, the quantization errors introduced when processing the current pixel 40 are distributed to nearby input pixels that have not yet been processed. The result is that the local average color value is approximately preserved.
  • As explained above, when error diffusion is applied in conjunction with the quantization effect, the quantization artifacts are alleviated because of the re-distribution of quantization error to the neighboring pixels. In general, the image looks the best if close to 100% of the quantization error is re-distributed. If the rate of error diffusion is defined as the sum of all weights multiplied by 100, then the preferred goal is to use a high error diffusion rate that is as close to 100% as possible, e.g., 90%. On the other hand, error diffusion introduces high frequency components to the image and therefore reduces the amount of data correlation in the image, making it more difficult to compress the resulting image (i.e., to satisfy the maximum file size requirement). One trade-off is to reduce the percentage of error diffused to the neighboring pixels and thereby to reduce the amount of high frequency component introduced, in turn increasing the amount of data correlation to make it possible to meet the file size requirement. The error diffusion weights W[0023] i,j at a given error diffusion rate R can be readily determined by multiplying the weights at the 100% rate by the current error diffusion rate. However, a rule of thumb is that if less than 50% of the quantization error is distributed, the effect of error diffusion is diminished to merely adding noise to the quantized image. Therefore, some alternative way of increasing the data correlation is needed if the error diffusion rate is reduced to 50% and the corresponding file size is still above the limit on maximum file size.
  • Data correlation can be increased if the less significant details in the image are sacrificed while prominent image structures are preserved. The present invention utilizes a procedure called image simplification to achieve this objective. In particular, it is assumed that low-magnitude spatial variations, regardless of their frequency content, in more or less flat regions, are perceptually less important. Therefore, an edge-preserving spatial smoothing filter, such as the Sigma filter, is suitable for image simplification. For details of the Sigma filter, see J. Lee in “Digital image smoothing and the σ6-filter,” [0024] Computer Vision, Graphics, Image Processing, vol. 24, pp. 189-198. April 1983. Conventionally, the Sigma filter is used to remove noise in an image. A nonlinear filter such as the Sigma filter has the advantage of better preserving image details when removing noise than linear filters. A local average of neighboring pixel values that are within a difference of σ of the current pixel value is used to replace the current pixel value. Clearly, edges of large magnitude are preserved this way while noise of low magnitude is removed. Due to its edge-preserving ability, the Sigma filter is a good choice for removing less important image details, but it is not the only edge-preserving filter that could be useful. Other edge-preserving spatial smoothing filters include without limitation the Huber Markov Random Field filter described in J. Luo, C. W. Chen, K. J. Parker, and T. S. Huang, “Artifacts removal in low bit rate compressed images”, IEEE Trans. Image Processing, Vol. 5, 1996, pp. 1363-1368.
  • Referring to the method of the present invention shown in FIG. 1, an input [0025] digital image 15 is processed to create an output digital image that is transmitted (190). The processing consists of loading (100) the input digital image 15 into a computer program. The image is then preprocessed (110) according to some desired processing scheme to create a preprocessed image. This preprocessing (110) scheme might include, but is not limited to, scene balance, contrast enhancement, sharpening and rotation.
  • At this point in the method, copies of the preprocessed image are sent to a resizing process ([0026] 120), a region of interest (ROI) identifier (260), and an open-space identifier (270). The preprocessed images sent to the ROI identifier (260) and the open space (OS) identifier (270) are processed according to a process to be described later. These two identifiers are used to apply additional protection of the ROI and extreme simplification of the smooth regions in the image. These two identifiers, and therefore the current invention, relate to digital image understanding technology, which is understood to mean technology that digitally processes a digital image to recognize and thereby assign useful meaning to human understandable objects, attributes or conditions and then to utilize the results obtained in the further processing of the digital image.
  • The resizing operator ([0027] 120) resizes the preprocessed image to create a resized image (according both to the original image aspect ratio and the device pixel ratio). In general, the resizing operator reduces the size of the image because the display resolution is often significantly lower than the resolution of the input image. Good choices for the resizing operator include bi-linear and bi-cubic interpolators, which are well known in the art. Referring to step 130, the error-diffusion (ED) weight (R) is set to a pre-determined initial value corresponding to diffusing close to 100% of the color quantization error. The resized image (from the step 120), the error-diffusion weight (R), and a display palette (P) (provided by stage 150) are input into a quantization and error diffusion process (140). The resized image is quantized to the display palette (P), and the quantization error is diffused according to the diffusion weight (R) and the process referred to in FIG. 3, to produce a quantized image in step 140. The quantized image is compressed (160) using a compression process to create a compressed image. This compression process is based on a lossless compressor such as that found in the PNG specification. The compressed file size (F) is then calculated (170). The compressed file size (F) is compared to a first threshold size (S1) in comparison 180, e.g., to a threshold size of 3 kilo bytes. If the compressed file size (F) is less than the first threshold size (S1), the compressed image is transmitted (190) to the display device. If the compressed file size (F) is greater than (S1), the compressed file size (F) is compared to a second threshold size (S2) in a second comparison 200, e.g., 3.5 kilo bytes. If the compressed file size (F) is less than the second threshold size (S2), the error-diffusion rate (R) is reduced (210) by a fixed percentage, e.g., 10%.
  • The error-diffusion rate is then compared ([0028] 220) to a minimum error-diffusion rate threshold T, e.g., a threshold of 50%. If the error-diffusion rate (R) is less than T, an image simplification process (230) is initiated. If the error-diffusion rate (R) is greater than T, the process of quantizing the resized image with error diffusion, using the current value of the error-diffusion weights Wi,j, computed by multiplying the weight values when R0=100% by the current rate R, is initiated (140) and the method steps 160-200 are repeated.
  • Referring to FIG. 7, the image simplification process ([0029] 230) requires as its input the resized image (120) and certain optional inputs as indicated by broken line, including the region of interest (ROI) mask (240) and/or the open space (OS) mask (250). The image simplification process (230) returns a simplified image (280) based on application of an image filter, such as the aforementioned sigma filter, to the resized image, which removes, or smoothes, low-magnitude spatial variations, regardless of their frequency content, which appear in more or less flat regions and are perceptually less important than edges of large magnitude. The ROI (240) and OS (250) masks are used in the image simplification process in the following manner. The ROI mask (240) is used to shield certain image regions identified in the ROI mask from the image filtering, such as the sigma filtering; more specifically, those regions in the mask having values equal to one are shielded from the image filtering. The OS mask is used to convert those image regions identified in the OS mask with mask values equal to one to a single color value, such as the mean color value of the region.
  • The process of iteratively comparing the compressed image file size F to a set of thresholds (S1 and S2) in the [0030] comparisons 180 and 200 and selectively lowering the error-diffusion-rate (R) in the reduction step 210, is repeated until either F is less than S1 and the quantized image is transmitted to the display (190), or R is still just greater than T while F is less than S2.
  • Still referring to FIG. 1, once the resized image is sent to the image simplification process ([0031] 230) the error-diffusion rate (R) is reset to a starting value (R0) and the process of quantizing the resized and simplified image to the display palette (140) is started again. The process of reducing the error-diffusion rate (R) (210) and simplifying the image (230) are repeated until F is less than S1 and the quantized image is transmitted to the display device (190).
  • The process and effect of the present invention is illustrated in FIG. 2. An [0032] input image 20 is shown which includes a person standing in the foreground along with a tree, while sky, cloud, and grass lawn form the background of the scene. With a fixed device palette, quantization would lead to visually objectionable quantization artifacts such as unrecognizable facial features and heavy contouring in the sky region. Using the present invention, the regions corresponding to cloud, foliage, and lawn are treated as less important regions 22 and receive the most simplification, and the details in these regions are simplified to enable high quality rendering of the more prominent image structures such as the person, horizon, outline of the tree, etc.
  • In addition, more effective preservation of important image structures can be achieved by object detection. In some cases, an important image structure, such as a [0033] human face 24, has relatively subtle features, especially when an image is reduced to a small size.
  • Referring back to FIG. 1, in a preferred embodiment of the present invention, a face detector is utilized to identify ([0034] 260) a region of interest (ROI) to be protected from image simplification (230). This region of the image is quantized to the display palette using an error-diffusion rate (R) equal to some maximal value deemed appropriate. The ROI defined using the face detector is isolated from the remainder of the image regions by creating a ROI mask (240). Refer to FIG. 6 for an illustration of a ROI mask created from the example image shown in FIG. 2. This mask has the same dimensions as the input image with pixel values equal to one (denoted by the white regions) in the ROI defined by the face detection process and zeros elsewhere (denoted by the black regions). Thus, this mask (240) is used by the image simplification process (230) to identify the regions of the image that are not to be simplified, and by the error diffusion process (140) to apply 100% error diffusion, or a rate approaching 100%, to the regions of interest.
  • Referring to FIG. 8, the image quantization process ([0035] 140) has three required inputs: an error diffusion rate (R), the display palette (150), and either the resized image (120) or the simplified image (280). The OS mask (240) and the ROI mask (250) are optional to the image quantization process and are only used if they are created in the normal flow of the algorithm. If the ROI mask (240) is present, in the quantize and diffuse image process (140), regions in the resized image (120) or in the simplified image (280) corresponding to ones in the ROI mask are quantized to the display palette (150) using an error diffusion process with a diffusion rate (R) set to a maximal value deemed appropriate. If the OS mask (250) is present, the regions of the simplified image (280) are quantized to the display palette using an error diffusion rate (R) set to a minimal value, such as zero. The remaining regions in the image are quantized to the display palette using the error diffusion rate (R) that is currently being used in the process.
  • Human face detection is well known in prior art: For example, see B. Heisele, T. Poggio, M. Pontil, “Face Detection in Still Gray Images,” [0036] MIT Artificial Intelligence Lab, Memo 1687, May 2000, or alternatively, U.S. Pat. No. 5,710,833 by Moghaddam and Pentland (“Detection, recognition and coding of complex objects using probabilistic eigenspace analysis”), which are incorporated herein by reference.
  • In addition, more effective simplification of unimportant image structures can be achieved by object detection. For example, it would be extremely efficient for image compression if flat regions, or open space regions, such as sky or floor, are set and later quantized to a single color without applying any error diffusion. Details of open space detection is described in commonly-assigned U.S. Pat. No. 5,901,245 issued May 4, 1999 to Warnick et al., which is incorporated herein by reference. [0037]
  • Referring back to FIG. 1, in a preferred embodiment of the present invention, an open space detector is used to identify ([0038] 270) smooth regions in an image. Each of these regions is then converted (or quantized) to a single unique color value that is within the display palette. This process has the effect of reproducing these areas without quantization artifacts such as contour bands or dithering noise associated with error diffusion. As a result, for a given open-space feature, the region is rendered smoothly with a common color that best represents the color within the region. In a similar manner as described for the facial detection and protection process previously described, referring to FIG. 5, a mask (250) is generated that distinguishes open-space regions 300 from the remaining regions in the image. In this example the sky regions (26) shown in FIG. 2 were identified as OS regions 300. Thus, the mask shown in FIG. 5 has ones everywhere there was a sky region and zeros everywhere else. This mask is used to guide special treatment of the open-space regions in both the image simplification (230) and the error-diffusion process (140). In other words, pixels in an open-space region receive the most extreme simplification, i.e., set to a single color, and are then quantized to a single palette color with 0% of error diffusion applied to the entire open-space region.
  • Referring back to FIG. 2 for a pictorial example of the process and effect of the method according to the invention, the [0039] face region 24 is detected and excluded from image simplification to ensure the best rendering of face features. In addition, the sky region is identified as an open space region 26 and subsequently quantized to a single blue color and excluded from the error diffusion process.
  • In the case when the above-described procedure fails to produce an image file smaller than S1, the rendered image may be cropped at the image borders to the extent that the file size of the cropped image is smaller than S1. [0040]
  • The invention has been described in detail with particular reference to certain preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention. [0041]
  • Parts List
  • [0042] 15 input digital color image
  • [0043] 16 set of palette colors
  • [0044] 17 palette color assign next step
  • [0045] 18 output digital color image
  • [0046] 20 an input image
  • [0047] 22 image regions to receive most simplification
  • [0048] 24 human face region
  • [0049] 26 open space region (sky)
  • [0050] 30 difference operation
  • [0051] 32 weight errors step
  • [0052] 34 sum operation
  • [0053] 40 current pixel
  • [0054] 42 next pixel to the right
  • [0055] 44 pixels in next row of image
  • [0056] 100 input digital image loading step
  • [0057] 110 preprocessing step
  • [0058] 120 resizing process
  • [0059] 130 error-diffusion weight setting step
  • [0060] 140 quantization and error diffusion step
  • [0061] 150 display palette
  • [0062] 160 compress image step
  • [0063] 170 compressed file size calculation step
  • [0064] 180 first threshold size comparison
  • [0065] 190 transmit image step
  • [0066] 200 second threshold size comparison
  • [0067] 210 error diffusion rate reduction step
  • [0068] 220 minimum error diffusion rate comparison
  • [0069] 230 image simplification process
  • [0070] 240 region of interest mask
  • [0071] 250 open space mask
  • [0072] 260 region of interest identifier
  • [0073] 270 open space identifier
  • [0074] 280 simplified image
  • [0075] 300 open space regions

Claims (15)

What is claimed is:
1. A method for rendering and compressing a digital image for display on a display device; said display device having a display resolution less than that of the digital image, using a display palette for rendering the digital image, and connecting with a transmission channel imposing a limit on a maximum file size; said method comprising the steps of:
(a) resizing the digital image to the display resolution to produce a display-sized image;
(b) quantizing the display-sized image to the display palette with an error diffusion process that produces an error diffused display-sized image according to a predetermined error diffusion rate;
(c) losslessly compressing the error diffused display-sized image to produce a compressed display-sized image having a file size;
(d) comparing the file size to the maximum file size and, if the file size is less than the maximum file size, transmitting the display-sized image to the display;
(e) if the file size is greater than the maximum file size, but less than another predetermined file size that is greater than the maximum file size, reducing the error diffusion rate by a predetermined amount in order to reduce the file size and then repeating steps subsequent to step (a) on the resized image at the reduced error diffusion rate; and
(f) if the file size is greater than both the maximum file size and the predetermined file size, simplifying the resized image by reducing image detail to produce a simplified image and then repeating steps subsequent to step (a) on the simplified image until the file size is less than the maximum file size.
2. The method claimed in claim 1, further comprising the step of detecting a region of interest in the digital image and in step (f) preventing the simplifying of significant features in the region of interest.
3. The method claimed in claim 2, wherein the region of interest corresponds to a human face and the step of detecting a region of interest employs a face detection algorithm.
4. The method claimed in claim 1, wherein the step (e) of reducing the error diffusion rate comprises the steps of:
(i) quantizing the display-sized image to the display palette with a reduced error diffusion rate up to a maximum reduction to produce an error diffused display-sized image, whereby the maximum reduction corresponds to minimum error diffusion rate threshold; and
(ii) if the maximum reduction does not produce a file size less than the maximum file size, then simplifying the image according to step (f).
5. The method claimed in claim 1, wherein the step (f) of simplifying the resized image comprises applying a sigma filter to the resized image.
6. The method claimed in claim 1, further comprising the step of detecting one or more open space regions in the digital image and quantizing each of the open space regions to the same color value in the display palette without applying error diffusion.
7. The method claimed in claim 1, where pre-processing is applied to the digital image prior to the step (a) of resizing.
8. The method claimed in claim 7, where the pre-processing includes brightness, contrast, and/or gamma adjustment.
9. The method claimed in claim 1, where the error diffused display-sized image is further reduced in its size by cropping out pixels from the image borders to generate a cropped display-sized image, wherein the file size of the cropped display-sized image is below the maximum file size.
10. A computer storage medium having instructions stored therein for causing a computer to perform the method of claim 1.
11. A system for rendering and compressing a digital image for display on a display device and transmission on a transmission channel, said display device having a display resolution less than the resolution of the digital image and a display palette for rendering the digital image, the transmission channel further imposing a limit on a maximum file size suitable for transmission, said system comprising:
a resizing stage for resizing the digital image to the display resolution to produce a display-sized image;
a quantizer for quantizing the display-sized image to the display palette with an error diffusion process that produces an error diffused display-sized image according to a predetermined initial error diffusion rate;
a compressor for losslessly compressing the error diffused display-sized image to produce a compressed display-sized image having a particular file size; and
a processing stage for comparing the particular file size to the maximum file size and (a) if the particular file size is less than the maximum file size, transmitting the display-sized image to the display; (b) if the particular file size is greater than the maximum file size, but less than another predetermined file size that is greater than the maximum file size, reducing the error diffusion rate by a predetermined amount in order to reduce the file size and then quantizing and compressing the resized image at the reduced error diffusion rate until the particular file size is less than the maximum file size; and (c) if the particular file size is greater than both the maximum file size and the predetermined file size, simplifying the resized image by reducing image detail to produce a simplified image and then quantizing and compressing the simplified image until the particular file size is less than the maximum file size.
12. The system claimed in claim 11, wherein the processing stage further detects a region of interest in the digital image and prevents the simplifying of significant features in the region of interest.
13. The system claimed in claim 12, wherein the region of interest corresponds to a human face and the processing stage employs a face detection algorithm.
14. The system claimed in claim 11, wherein the processing stage applies a sigma filter to simplify the resized image.
15. The system claimed in claim 11, wherein the processing stage further detects one or more open space regions in the digital image and quantizes each of the open space regions to the same color value in the display palette without applying error diffusion.
US10/259,538 2002-09-27 2002-09-27 Method and system for generating digital image files for a limited display Active 2025-01-08 US7130474B2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US10/259,538 US7130474B2 (en) 2002-09-27 2002-09-27 Method and system for generating digital image files for a limited display
JP2003207569A JP4347625B2 (en) 2002-09-27 2003-08-14 Method and system for generating digital image files for limited displays
DE60302311T DE60302311T2 (en) 2002-09-27 2003-09-15 Method and system for generating digital image files for a limited display
EP03077885A EP1403823B1 (en) 2002-09-27 2003-09-15 Method and system for generating digital image files for a limited display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US10/259,538 US7130474B2 (en) 2002-09-27 2002-09-27 Method and system for generating digital image files for a limited display

Publications (2)

Publication Number Publication Date
US20040062437A1 true US20040062437A1 (en) 2004-04-01
US7130474B2 US7130474B2 (en) 2006-10-31

Family

ID=31977902

Family Applications (1)

Application Number Title Priority Date Filing Date
US10/259,538 Active 2025-01-08 US7130474B2 (en) 2002-09-27 2002-09-27 Method and system for generating digital image files for a limited display

Country Status (4)

Country Link
US (1) US7130474B2 (en)
EP (1) EP1403823B1 (en)
JP (1) JP4347625B2 (en)
DE (1) DE60302311T2 (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020141005A1 (en) * 2001-03-30 2002-10-03 Minolta Co., Ltd. Image processing program and image processing apparatus
US20030179393A1 (en) * 2002-03-21 2003-09-25 Nokia Corporation Fast digital image dithering method that maintains a substantially constant value of luminance
US20050093981A1 (en) * 2003-10-29 2005-05-05 Fuji Photo Film Co., Ltd. Moving image conversion device, method and program, moving image distribution device, and e-mail relay device
US20050275858A1 (en) * 2004-06-14 2005-12-15 Canon Kabushiki Kaisha Image processing apparatus and image processing method
US20060023951A1 (en) * 2004-07-27 2006-02-02 Tan Lian C S Method and system for processing an input image and generating an output image having low noise
US20060206908A1 (en) * 2005-03-10 2006-09-14 Matsushita Electric Industrial Co., Ltd. Optical pickup device and optical disk device
US20070058203A1 (en) * 2005-09-12 2007-03-15 Kabushiki Kaisha Toshiba System and method for generating low visibility multi-bit halftone
US20070180482A1 (en) * 2006-01-31 2007-08-02 M2M Research, Inc. Remote imaging system
US20100111406A1 (en) * 2006-05-05 2010-05-06 Google Inc. Selective image editing in a browser
US20100110092A1 (en) * 2006-05-05 2010-05-06 Google Inc. Distributed processing when editing an image in a browser
US20120002896A1 (en) * 2010-06-30 2012-01-05 Samsung Electronics Co., Ltd. System and method for reducing noise in an image
US8988418B1 (en) 2007-01-05 2015-03-24 Florelle, Inc. System and method for parametric display of modular aesthetic designs
US20180089228A1 (en) * 2008-10-03 2018-03-29 Monument Peak Ventures, Llc Interactive image selection method
US20190043253A1 (en) * 2018-09-07 2019-02-07 Intel Corporation View dependent 3d reconstruction mechanism

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7391929B2 (en) 2000-02-11 2008-06-24 Sony Corporation Masking tool
JP4064196B2 (en) * 2002-10-03 2008-03-19 株式会社リコー Client computer, server computer, program, storage medium, image data processing system, and image data processing method
US8612628B1 (en) * 2003-01-07 2013-12-17 Novell, Inc. Method and system for transferring repetitive images over computer networks
US7895513B1 (en) * 2003-05-28 2011-02-22 Adobe Systems Incorporated Color reduction in complex figures containing text for space/time constrained platforms
US7706448B2 (en) * 2003-07-30 2010-04-27 Microsoft Corporation Reversible diffusion-based compression
JP2006065834A (en) * 2004-07-26 2006-03-09 Murata Mach Ltd Image processing device and image processing method
US7609898B2 (en) * 2004-10-01 2009-10-27 Microsoft Corporation Method and system for progressive image transmission
US7698152B2 (en) * 2005-01-07 2010-04-13 Siemens Medical Solutions Health Services Corporation Medical image viewing management and status system
US7949113B2 (en) 2006-07-14 2011-05-24 Research In Motion Limited Contact image selection and association method and system for mobile device
CN101595734A (en) * 2007-01-16 2009-12-02 汤姆逊许可证公司 Be used for alleviating the system and method for the pseudo-shadow of image
US7983486B2 (en) * 2007-08-29 2011-07-19 Seiko Epson Corporation Method and apparatus for automatic image categorization using image texture
US20090244633A1 (en) * 2008-03-31 2009-10-01 Konica Minolta Systems Laboratory, Inc. Systems and Methods for Color Data Compression
US8155436B2 (en) * 2008-03-31 2012-04-10 Konica Minolta Laboratory U.S.A., Inc. Systems and methods for color data compression
US8121435B2 (en) * 2008-03-31 2012-02-21 Konica Minolta Laboratory U.S.A., Inc. Systems and methods for resolution switching
US20090244601A1 (en) * 2008-03-31 2009-10-01 Konica Minolta Systems Laboratory, Inc. Systems and Methods for Color Data Compression
US8599214B1 (en) 2009-03-20 2013-12-03 Teradici Corporation Image compression method using dynamic color index
JP5355190B2 (en) * 2009-04-08 2013-11-27 キヤノン株式会社 Image display apparatus and method, and program
US20110137947A1 (en) 2009-12-03 2011-06-09 International Business Machines Corporation Dynamic access control for documents in electronic communications within a cloud computing environment
US9100588B1 (en) 2012-02-28 2015-08-04 Bruce A. Seymour Composite image formatting for real-time image processing
JP5204327B1 (en) 2012-03-29 2013-06-05 株式会社東芝 Image processing apparatus and image processing method
JP2013242527A (en) * 2012-04-27 2013-12-05 Mitsubishi Electric Corp Image processing device, image processing method, and image display device

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5208871A (en) * 1990-10-19 1993-05-04 Xerox Corporation Pixel quantization with adaptive error diffusion
US5486826A (en) * 1994-05-19 1996-01-23 Ps Venture 1 Llc Method and apparatus for iterative compression of digital data
US5649083A (en) * 1994-04-15 1997-07-15 Hewlett-Packard Company System and method for dithering and quantizing image data to optimize visual quality of a color recovered image
US5710833A (en) * 1995-04-20 1998-01-20 Massachusetts Institute Of Technology Detection, recognition and coding of complex objects using probabilistic eigenspace analysis
US5790131A (en) * 1996-05-15 1998-08-04 Iterated Systems, Inc. System and method for lossy compression of data with output file size control
US5901245A (en) * 1997-01-23 1999-05-04 Eastman Kodak Company Method and system for detection and characterization of open space in digital images
US5901276A (en) * 1994-12-22 1999-05-04 Konica Corporation Image forming apparatus having an interface to connect with other image forming apparatus
US5930398A (en) * 1991-04-18 1999-07-27 Ampex Corporation Method and apparatus for determining a quantizing factor for multi-generation data compression/decompression processes
US6094510A (en) * 1996-04-15 2000-07-25 Canon Kabushiki Kaisha Image processing apparatus and method for predicting a compression rate of image data processed to modify an image
US6195462B1 (en) * 1998-03-30 2001-02-27 Eastman Kodak Company Image compression
US20020016818A1 (en) * 2000-05-11 2002-02-07 Shekhar Kirani System and methodology for optimizing delivery of email attachments for disparate devices
US20020031276A1 (en) * 1995-06-02 2002-03-14 Takahiro Yagishita Image encoding method and apparatus, image decoding method and apparatus, image processing apparatus, image formation apparatus, and computer-executable programs

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10336647A (en) 1997-06-04 1998-12-18 Nikon Corp Image compression device and computer readable recording medium recording image compression processing program
JP2000244751A (en) * 1999-02-22 2000-09-08 Matsushita Electric Ind Co Ltd Binary coding method for multilevel image and binary encoder for multilevel image

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5208871A (en) * 1990-10-19 1993-05-04 Xerox Corporation Pixel quantization with adaptive error diffusion
US5930398A (en) * 1991-04-18 1999-07-27 Ampex Corporation Method and apparatus for determining a quantizing factor for multi-generation data compression/decompression processes
US5649083A (en) * 1994-04-15 1997-07-15 Hewlett-Packard Company System and method for dithering and quantizing image data to optimize visual quality of a color recovered image
US5486826A (en) * 1994-05-19 1996-01-23 Ps Venture 1 Llc Method and apparatus for iterative compression of digital data
US5901276A (en) * 1994-12-22 1999-05-04 Konica Corporation Image forming apparatus having an interface to connect with other image forming apparatus
US5710833A (en) * 1995-04-20 1998-01-20 Massachusetts Institute Of Technology Detection, recognition and coding of complex objects using probabilistic eigenspace analysis
US20020031276A1 (en) * 1995-06-02 2002-03-14 Takahiro Yagishita Image encoding method and apparatus, image decoding method and apparatus, image processing apparatus, image formation apparatus, and computer-executable programs
US6094510A (en) * 1996-04-15 2000-07-25 Canon Kabushiki Kaisha Image processing apparatus and method for predicting a compression rate of image data processed to modify an image
US5790131A (en) * 1996-05-15 1998-08-04 Iterated Systems, Inc. System and method for lossy compression of data with output file size control
US5901245A (en) * 1997-01-23 1999-05-04 Eastman Kodak Company Method and system for detection and characterization of open space in digital images
US6195462B1 (en) * 1998-03-30 2001-02-27 Eastman Kodak Company Image compression
US20020016818A1 (en) * 2000-05-11 2002-02-07 Shekhar Kirani System and methodology for optimizing delivery of email attachments for disparate devices

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020141005A1 (en) * 2001-03-30 2002-10-03 Minolta Co., Ltd. Image processing program and image processing apparatus
US20030179393A1 (en) * 2002-03-21 2003-09-25 Nokia Corporation Fast digital image dithering method that maintains a substantially constant value of luminance
US7038814B2 (en) * 2002-03-21 2006-05-02 Nokia Corporation Fast digital image dithering method that maintains a substantially constant value of luminance
US7676083B2 (en) * 2003-10-29 2010-03-09 Fujifilm Corporation Moving image conversion device, method and program, moving image distribution device, and e-mail relay device
US20050093981A1 (en) * 2003-10-29 2005-05-05 Fuji Photo Film Co., Ltd. Moving image conversion device, method and program, moving image distribution device, and e-mail relay device
US20050275858A1 (en) * 2004-06-14 2005-12-15 Canon Kabushiki Kaisha Image processing apparatus and image processing method
US7852511B2 (en) * 2004-06-14 2010-12-14 Canon Kabushiki Kaisha Image processing apparatus and method, for producing a color separation table
US20060023951A1 (en) * 2004-07-27 2006-02-02 Tan Lian C S Method and system for processing an input image and generating an output image having low noise
US20060206908A1 (en) * 2005-03-10 2006-09-14 Matsushita Electric Industrial Co., Ltd. Optical pickup device and optical disk device
US7555759B2 (en) 2005-03-10 2009-06-30 Panasonic Corporation Optical pickup device and optical disk device
US20070058203A1 (en) * 2005-09-12 2007-03-15 Kabushiki Kaisha Toshiba System and method for generating low visibility multi-bit halftone
US7768673B2 (en) * 2005-09-12 2010-08-03 Kabushiki Kaisha Toshiba Generating multi-bit halftone dither patterns with distinct foreground and background gray scale levels
US20070180482A1 (en) * 2006-01-31 2007-08-02 M2M Research, Inc. Remote imaging system
US20100110092A1 (en) * 2006-05-05 2010-05-06 Google Inc. Distributed processing when editing an image in a browser
US8245123B2 (en) 2006-05-05 2012-08-14 Google Inc. Effects applied to images in a browser
US20100111406A1 (en) * 2006-05-05 2010-05-06 Google Inc. Selective image editing in a browser
US20110142361A1 (en) * 2006-05-05 2011-06-16 Google Inc. Rollback in a browser
US20100110104A1 (en) * 2006-05-05 2010-05-06 Google Inc. Effects applied to images in a browser
US8161368B2 (en) 2006-05-05 2012-04-17 Google Inc. Distributed processing when editing an image in a browser
US8230318B2 (en) * 2006-05-05 2012-07-24 Google Inc. Selective image editing in a browser
US8233009B2 (en) 2006-05-05 2012-07-31 Google Inc. Rollback in a browser
US8988418B1 (en) 2007-01-05 2015-03-24 Florelle, Inc. System and method for parametric display of modular aesthetic designs
US20180089228A1 (en) * 2008-10-03 2018-03-29 Monument Peak Ventures, Llc Interactive image selection method
US8472724B2 (en) * 2010-06-30 2013-06-25 Samsung Electronics Co., Ltd. System and method for reducing noise in an image
US20120002896A1 (en) * 2010-06-30 2012-01-05 Samsung Electronics Co., Ltd. System and method for reducing noise in an image
US20190043253A1 (en) * 2018-09-07 2019-02-07 Intel Corporation View dependent 3d reconstruction mechanism
US11315321B2 (en) * 2018-09-07 2022-04-26 Intel Corporation View dependent 3D reconstruction mechanism

Also Published As

Publication number Publication date
JP4347625B2 (en) 2009-10-21
EP1403823A1 (en) 2004-03-31
JP2004140792A (en) 2004-05-13
DE60302311T2 (en) 2006-09-28
EP1403823B1 (en) 2005-11-16
US7130474B2 (en) 2006-10-31
DE60302311D1 (en) 2005-12-22

Similar Documents

Publication Publication Date Title
US7130474B2 (en) Method and system for generating digital image files for a limited display
US9501818B2 (en) Local multiscale tone-mapping operator
US7130471B2 (en) Determining optimal image compression methods for reducing file size
US5377018A (en) Video compression and decompression using block selection and subdivision
US6859210B2 (en) Method for representing a digital color image using a set of palette colors based on detected important colors
US8351694B2 (en) Adaptive compression of multi-level images
JP4083587B2 (en) Image quality improving method and apparatus therefor
US5172237A (en) High quality color image compression system
US20070110303A1 (en) Low-Bandwidth Image Streaming
EP1929445A1 (en) Compression of images for computer graphics
WO1991018479A1 (en) Block adaptive linear predictive coding with adaptive gain and bias
US20060182364A1 (en) System and method for sharpening vector-valued digital images
CN111292269B (en) Image tone mapping method, computer device, and computer-readable storage medium
US5543820A (en) Method and apparatus for linear color processing
US6731822B1 (en) Method and apparatus for filtering images having insufficient tonal precision
US7643182B2 (en) System and method for processing image data
JP3494595B2 (en) Image transmission method and image transmission device
AU2003100910A4 (en) Improving Visual Quality when Compressing Images with an Unknown Dimension
JPH01151372A (en) Method and device for coding image data
GB2240448A (en) "High quality color image compression system"

Legal Events

Date Code Title Description
AS Assignment

Owner name: EASTMAN KODAK COMPANY, NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LUO, JIEBO;BRAUN, GUSTAV;PAPIN, CHRISTOPHE;REEL/FRAME:013351/0001;SIGNING DATES FROM 20020926 TO 20020927

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

AS Assignment

Owner name: CITICORP NORTH AMERICA, INC., AS AGENT, NEW YORK

Free format text: SECURITY INTEREST;ASSIGNORS:EASTMAN KODAK COMPANY;PAKON, INC.;REEL/FRAME:028201/0420

Effective date: 20120215

FEPP Fee payment procedure

Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: KODAK (NEAR EAST), INC., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK IMAGING NETWORK, INC., CALIFORNIA

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK PHILIPPINES, LTD., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: FAR EAST DEVELOPMENT LTD., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC.,

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: LASER-PACIFIC MEDIA CORPORATION, NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: QUALEX INC., NORTH CAROLINA

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: FPC INC., CALIFORNIA

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: NPEC INC., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: EASTMAN KODAK COMPANY, NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: CREO MANUFACTURING AMERICA LLC, WYOMING

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK AVIATION LEASING LLC, NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK PORTUGUESA LIMITED, NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK REALTY, INC., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: PAKON, INC., INDIANA

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

Owner name: KODAK AMERICAS, LTD., NEW YORK

Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001

Effective date: 20130201

AS Assignment

Owner name: INTELLECTUAL VENTURES FUND 83 LLC, NEVADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:EASTMAN KODAK COMPANY;REEL/FRAME:030203/0507

Effective date: 20130201

FPAY Fee payment

Year of fee payment: 8

AS Assignment

Owner name: MONUMENT PEAK VENTURES, LLC, TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INTELLECTUAL VENTURES FUND 83 LLC;REEL/FRAME:041941/0079

Effective date: 20170215

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.)

FEPP Fee payment procedure

Free format text: 11.5 YR SURCHARGE- LATE PMT W/IN 6 MO, LARGE ENTITY (ORIGINAL EVENT CODE: M1556); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12

AS Assignment

Owner name: MONUMENT PEAK VENTURES, LLC, TEXAS

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:INTELLECTUAL VENTURES FUND 83 LLC;REEL/FRAME:064599/0304

Effective date: 20230728