EP2097872A1 - Localized signal data preservation within signal bandwidth - Google Patents
Localized signal data preservation within signal bandwidthInfo
- Publication number
- EP2097872A1 EP2097872A1 EP06817542A EP06817542A EP2097872A1 EP 2097872 A1 EP2097872 A1 EP 2097872A1 EP 06817542 A EP06817542 A EP 06817542A EP 06817542 A EP06817542 A EP 06817542A EP 2097872 A1 EP2097872 A1 EP 2097872A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- data
- image
- signal
- bandwidth
- predetermined level
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000004321 preservation Methods 0.000 title description 2
- 239000000872 buffer Substances 0.000 claims abstract description 44
- 238000000034 method Methods 0.000 claims abstract description 35
- 230000006835 compression Effects 0.000 claims abstract description 30
- 238000007906 compression Methods 0.000 claims abstract description 30
- 239000011159 matrix material Substances 0.000 claims description 11
- 230000006837 decompression Effects 0.000 claims description 5
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 210000003414 extremity Anatomy 0.000 claims description 2
- 210000003141 lower extremity Anatomy 0.000 claims description 2
- 210000001364 upper extremity Anatomy 0.000 claims description 2
- 230000005540 biological transmission Effects 0.000 abstract description 8
- 230000001939 inductive effect Effects 0.000 abstract 1
- 239000003086 colorant Substances 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 230000008054 signal transmission Effects 0.000 description 2
- 241000255925 Diptera Species 0.000 description 1
- 230000000593 degrading effect Effects 0.000 description 1
- 230000001627 detrimental effect Effects 0.000 description 1
- 239000011888 foil Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012886 linear function Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
Definitions
- the present invention relates to electronic signal processing and in particular, reducing the level of noise in localized parts of a signal's bandwidth.
- Lossy signal compression techniques make transmission quicker and more efficient but introduce noise when the transmitted signal is compressed. This level of noise can be controlled and restricted to an acceptable level for the vast majority of the transmission. However, there are instances where the signal data at one or more particulars levels within the bandwidth are more important than others. Alternatively, noise at particular levels of the bandwidth has a more detrimental effect than it would at other levels of the bandwidth. The aggressiveness of the compression technique can be set so that the noise in these critical sections is acceptable, but then majority of the bandwidth is only lightly compressed and the data size remains large. Keeping the data size large tends to defeat the purpose of compressing the signal in the first place.
- JPEG Joint Photographic Experts Group
- the noise induced by JPEG compression in particular sections of the bandwidth can cause particularly visible artifacts in the decompressed image.
- the detailed description is directed to localized noise reduction in the compression and decompression of an image file.
- this is purely illustrative and the invention encompasses other types of signal transmission.
- JPEG compression of image data uses one of a suite of standard algorithms to reduce data size for faster transmission and more efficient storage.
- the quality of the resultant image is determined by the level of compression.
- An aggressive compression greatly reduces the file size but introduces high levels of noise.
- Light compression reduces the noise but the data size remains relatively large. Therefore, the optimum level of compression is a trade off between image quality and data size, having regard to the characteristics of the output device (printer or monitor), processing capabilities and resolution requirements.
- the image is analyzed in blocks of 8 X 8 pixels. Depending on the level of compression selected, the detail in each of the blocks is reduced. In more aggressive compressions, the 8 X 8 blocks can become visible in the final image. The compression should be at a level where the noise in the resulting image is imperceptible. Unfortunately, there are often certain components of an image that are far more prone to decompression artifacts than the rest of the image. In these cases, the noise is imperceptible for the majority of the image, but produces artifacts in certain parts.
- Figure 1 is an image of a black shape 10 on a white background 12 without any noise.
- Figure 2 shows the associated grayscale histogram for the image. The histogram has 256 levels, with level 0 being white and level 255 being black. A black shape on a white background (without any noise) has pixels in levels 0 or 255 only. All other levels are shades of grey and therefore empty.
- Figure 3 shows the image of Figure 1 after it has been JPEG compressed and decompressed.
- the detail lost during compression manifests as random grey scale artifacts 14 around the periphery of the black shape 10.
- the grey scale artifacts also exist within the black shape 10 but are obscured by the surrounding black.
- the artifacts 14 are confined to the 8 X 8 pixel blocks that cross the boundary between the shape and the white background. These artifacts are referred to as JPEG 'ringing'.
- Figure 4 shows the histogram for Figure 3. While most of the pixels are in level 0 or 255 (white or black), the noise appears in the levels near the two extremities 16 and 18. The noise is restricted to the ends of the histogram because compression tends to cause only small shifts in a pixels color level. In a 'normal' photographic image, most if not all of the intensity levels in each colour plane have some pixels. The noise from compression does not shift the colour levels very far from the original level, and mixes with the other color planes, so the artifacts occur at a high spatial frequency. The eye is insensitive to high frequency noise made up of small colour levels shifts. It is only the sharp edges between strongly contrasting colors where the artifacts become visible.
- the present invention provides a method of preserving signal data at a predetermined level within the bandwidth of an input signal to be processed for use by an output device, the method comprising: rescaling the signal data in levels other than the predetermined level to move at least some of the signal data out of a buffer section of the bandwidth adjacent to the predetermined level; processing the signal for use by the output device; re-assigning any data in the buffer section to the predetermined level; and, rescaling the signal data in levels other than the predetermined level to move data back into the buffer section.
- Inaccuracies in the signal processing shifts some signal data from its original level in the input signal to different level in the output signal. This shift in data generates the noise in the output signal. If data does shift because of the signal processing, there is a high probability that it only shifts to a nearby level in the bandwidth. If the signal data at a particular level is of greater importance relative to most of the other levels, the invention allows this data to be preserved at its original level with very little, if any, lost to noise.
- the input signal is image data for a color plane of an image and the output device is a printer.
- the signal data is pixel intensity values for the color plane quantized into a number of discrete intensity levels, such that the number of levels is the bandwidth of the input signal.
- the predetermined level is the intensity level corresponding to 'white' (or zero color intensity).
- the method preserves the data in a second predetermined level, the second predetermined level being the maximum intensity level in the bandwidth.
- the processing of the signal involves lossy transmission of the signal data.
- the processing of the signal involves the lossy compression of the signal data.
- the processing of the signal involves lossy image compression.
- the processing of the signal includes JPEG compression.
- the input signal is rescaled by quantizing the image data into a lesser number of the discrete intensity levels except for image data in the or each predetermined level.
- the image data is rescaled to floating point values and then rounded to the closest of the intensity levels.
- the method further comprises converting the image data from a first color space to a second color space wherein the rescaling of the input image data is performed simultaneously with the color space conversion.
- the second color space is the printer color space.
- the step of rescaling the image data back into the or each buffer section after JPEG compression is performed via a dither matrix by adjusting the threshold values in the dither matrix.
- the image includes text characters.
- the image includes line art.
- the image has a white background.
- the color intensity values are 8-bit values and the bandwidth of the input signal is 256 levels.
- the predetermined level is O'.
- the second predetermined level is '255'.
- the buffer section corresponding to level 0 is levels 1 to 16.
- the buffer section corresponding to level 255 is levels 240 to 254.
- Figure 1 is an image that is particularly prone to JPEG ringing
- Figure 2 is the histogram associated with the image of Figure 1 ;
- Figure 3 is the image of Figure 1 with JPEG compression noise or 'ringing' around the hard edges;
- Figure 4 is the histogram associated with the image of Figure 3;
- Figure 5 is the histogram associated with the image of Figure 1 with the buffer sections set at levels 1-16 and 240-254;
- Figure 6 shows the image of Figure 3 with the noise in the low and high buffer sections mapped to levels 0 and 255 respectively;
- Figure 7 is a sketch of the end portions of a histogram
- Figure 8 is a sketch of the end portions of the histogram with the data moved out of the buffer sections
- Figure 9 is a sketch of the end portions of the histogram after JPEG decompression.
- Figure 10 is a sketch of the histogram rescaled to distribute data back into the buffer sections
- Figure 11 shows the rescaling of the input image data to create the buffer sections
- Figure 12 shows an alternative rescaling technique of the input image data.
- Figure 1 shows an image 10 on a white background 12.
- the edge of the shape 10 is referred to as a 'hard edge' because the color intensity values drop from maximum intensity to zero (white) instantly.
- the histogram shown in Figure 2 only has data in levels 0 and 255 (8 bit color values).
- the edge of the shape 10 is surrounded grey pixel noise 14.
- the noise 14 is sometimes referred to as mosquito noise as it is most visible as a cloud of dark dots on the light side of a hard edge such as text or line art.
- the loss of detail in the data during compression can shift pixels color values away from their input values. These shifts are likely to be small so in a contone image with smoother tone gradients, the noise is high frequency and invisible to the eye. However, the noise can become visible around hard edges where input data at level '0' shifts to nearby grey levels from decompression errors.
- This noise 14 is shown in the histogram of Figure 4. Input data at level '255' also shifts but is less visible amongst the predominantly level 255 pixels. This noise is shown at 18 on the histogram of Figure 4.
- Figure 5 shows the settings for a histogram expansion to remedy the majority of the noise.
- a histogram expansion rescales the input data by reducing the number of levels in the bandwidth.
- levels 1 to 16 are mapped down to level 0 and levels 240 to 254 are mapped up to level 255.
- the intermediate levels are rescaled, or widened, to encompass the greys between the extremes.
- the resulting histogram has fewer levels (224), with more contrast between adjacent levels.
- the increased color contrast is the primary purpose of histogram expansion, but in this case, the expansion has corrected most of the noise 14 as shown in Figure 6.
- the buffers need not be the same size or symmetrically positioned in the signal bandwidth. It should also be noted that the buffers need not be at the extremes of the bandwidth. For example, if the signal is image data in a YCC-style color space (luminance, chroma red and chroma blue), the important data in the chroma channels is the neutral level in the middle of the bandwidth (level 128 in 8 bit color values). The important data in the luminance channel is at the extremes.
- Figure 7 is a schematic representation of the histogram corresponding to a contone image such as a photograph.
- the image has some pixels at all levels of the 0 to 255 bandwidth.
- the image is typically JPEG compressed and then decompressed at the output device.
- the number of pixels in the output levels should be roughly the same as the corresponding input levels. Any errors that do occur, most likely put the pixel into a nearby level and this happens at high frequency so the noise is imperceptible.
- the exception to this is the hard edged components of the image such as text on a white background or line art. The eye does tend to register the noise generated in the 8 X 8 pixel blocks that span or contain such edges.
- the quality of the JPEG compression is known, and so the section on the bandwidth in which the majority of noise induced in the level 0 pixels 12 is also known.
- These buffer sections 20 and 22 of the bandwidth are chosen as levels 1-16 and levels 240- 254. For the purposes of this example, the vast majority of noise induced by decompressing levels 0 and 255 will appear in these buffer sections.
- Figure 8 shows the image data moved out of the buffer section 20 and 22 by rescaling the input data 24 of levels 1-254 into levels 17 to 239. Rescaling is done using a simple algorithm such as Equation 1 below:
- L r is the rescaled level that the pixels in the input level are mapped to;
- L 1 is the threshold of the buffer section at the lower end of the bandwidth;
- L h is the threshold of the buffer section at the upper end of the bandwidth;
- L is the input level being rescaled
- Lma x is the upper extremity of the bandwidth
- L m i n is the lower extremity of the bandwidth.
- L max 255
- L mm 0,
- L r can be rounded to the nearest integer or left as a floating point value to more accurately invert the rescaling process when the input data 24 is distributed back across the full bandwidth.
- Figure 8 shows levels 1 to 254 rescaled to move the input data out of the buffer sections 20 and 22.
- the data 12 and 10 in levels 0 and 255 respectively, is not rescaled. This is the data that is being 'quarantined' from the rest of the data 24 by the buffer sections 20 and 22.
- Figure 9 shows the histogram corresponding to the image data after it has been JPEG compressed, transmitted to an output device and subsequently decompressed.
- the data 16 and 18 in the buffer sections 20 and 22 must be noise from levels 0 or 10 (or from the rest of the image data 24, but as explained above, this noise is generally invisible to the eye). Therefore, mapping the data in buffer 20 back to level 0 and mapping the data in buffer 22 up to level 255 will correct any noise that would otherwise turn up in the white background or the full color side of a hard edge component in the image. Some noise in the buffers is from the rest of the data 24. These pixels are also mapped to 0 or 255 and so end up slightly more erroneous in the output image, but the eye will not be able to see this.
- the manipulation of the image data can be achieved in a computationally efficient way by incorporating it into existing data processing steps.
- the rescaling of the signal to move data out of the buffer sections can be done when the image data is color space converted from RGB to CMY(K).
- the re-distribution of data back across the foil bandwidth can be done by adjusting the threshold values used in the dither matrix during halftoning.
- the Applicant's co-pending USSN (KIPOOlUS) incorporated herein by reference describes how the histogram can be expanded (or contracted) using the dither matrix. In light of this, the computational cost for preserving the data at one or more levels in the bandwidth is relatively little, yet the tangible image quality improvement is significant.
- the threshold values in the compressed range in the secondary matrix are determined using Equation 2:
- Tnew L 1 + T 0 Id-(Lh - LO/256 Eq. 2
- T new is the compressed threshold values in the secondary dither matrix
- T 0Jd is the threshold value in the primary dither matrix.
- the adjusted dither matrix will not affect data at the extreme levels of the bandwidth as level 0 will still be below the lowest threshold value and level 255 will still be above the highest threshold level. Only data in the levels between the buffer sections will be 'expanded' by the adjusted dither matrix.
- the noise in the white background of a hard edge is more visible than the noise in the full color area along the edge. This is particularly true if the output device is a printer. In light of this, only the data in level 0 can be preserved for a significant reduction in noise. This reduces the rescaling of the remaining signal so that when it is expanded back to the full bandwidth, less levels are lost and the contone image is not as coarse.
- the input signal is rescaled in a manner different to that the technique set out in Equation 1.
- Figure 11 shows the hard edged rescaling used in the above example.
- AU the data in the buffer sections is shifted to the levels between 16 and 240.
- the output image may be improved by rescaling the image with a non- linear function as shown in Figure 12 where most of the data is removed from the buffer sections but not all.
- Equations 1 and 2 would not apply to this method of rescaling.
- the invention has been described herein by way of example only. Skilled workers in this field will readily recognize many variations and modification that do not depart from the spirit and scope of the broad inventive concept.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Of Band Width Or Redundancy In Fax (AREA)
- Facsimile Image Signal Circuits (AREA)
Abstract
Description
Claims
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/AU2006/001788 WO2008064388A1 (en) | 2006-11-28 | 2006-11-28 | Localized signal data preservation within signal bandwidth |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP2097872A1 true EP2097872A1 (en) | 2009-09-09 |
Family
ID=39467324
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP06817542A Withdrawn EP2097872A1 (en) | 2006-11-28 | 2006-11-28 | Localized signal data preservation within signal bandwidth |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP2097872A1 (en) |
| KR (1) | KR101023588B1 (en) |
| WO (1) | WO2008064388A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012167147A1 (en) * | 2011-06-03 | 2012-12-06 | Echostar Technologies L.L.C. | Systems and methods for testing video hardware by evaluating output video frames containing embedded reference characteristics |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6771793B1 (en) * | 1999-02-17 | 2004-08-03 | Fuji Photo Film Co., Ltd. | Image processing method and apparatus |
| US6707578B1 (en) * | 1999-09-20 | 2004-03-16 | Hewlett-Packard Development Company, L.P. | Method and apparatus for improving image presentation in a digital copier |
| US6985632B2 (en) * | 2000-04-17 | 2006-01-10 | Canon Kabushiki Kaisha | Image processing system, image processing apparatus, and image processing method |
| JP3809818B2 (en) * | 2000-07-06 | 2006-08-16 | セイコーエプソン株式会社 | Image processing method, recording medium, and image processing apparatus |
| FR2818863A1 (en) * | 2000-12-26 | 2002-06-28 | Koninkl Philips Electronics Nv | Received digital image processing method includes analysis of spatial activity values for pixel to detect and correct MPEG image errors |
| JP2002252759A (en) * | 2001-02-26 | 2002-09-06 | Sanyo Electric Co Ltd | Image quantization method and device, and image coder utilizing them |
-
2006
- 2006-11-28 KR KR1020097011407A patent/KR101023588B1/en not_active Expired - Fee Related
- 2006-11-28 WO PCT/AU2006/001788 patent/WO2008064388A1/en not_active Ceased
- 2006-11-28 EP EP06817542A patent/EP2097872A1/en not_active Withdrawn
Non-Patent Citations (1)
| Title |
|---|
| See references of WO2008064388A1 * |
Also Published As
| Publication number | Publication date |
|---|---|
| KR101023588B1 (en) | 2011-03-21 |
| WO2008064388A1 (en) | 2008-06-05 |
| KR20090075752A (en) | 2009-07-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4587838B2 (en) | Display system | |
| US5539842A (en) | Method and apparatus for compressing and decompressing images of documents | |
| EP0635985B1 (en) | Improved decompression standard for ADCT-compressed document images | |
| US7995849B2 (en) | Method and apparatus for improving video quality of low bit-rate video | |
| US9918095B1 (en) | Pixel processing and encoding | |
| US7013050B2 (en) | Image encoding apparatus and method, program code, and storage medium | |
| JP2006005939A (en) | Hybrid compression mechanism based on segmentation for scanned documents | |
| US6640017B1 (en) | Method and apparatus for adaptively sharpening an image | |
| US20090021791A1 (en) | Compression of grayscale image data using multi-bit halftoning | |
| US7486829B2 (en) | Apparatus and method for image processing, and computer product | |
| US20080267495A1 (en) | Image compressing method and image compressing apparatus | |
| JP2004533181A (en) | Selective chrominance decimation for digital images | |
| US20060256123A1 (en) | Generation of attribute pattern image by patterning attribute information | |
| US7057671B2 (en) | Image and video processing with chrominance attenuation | |
| JP4898601B2 (en) | Image processing apparatus, image processing method, and program thereof | |
| CN107925778A (en) | Pixel pre-processes and coding | |
| JP4380498B2 (en) | Block distortion reduction device | |
| US8115967B2 (en) | Localized signal data preservation within signal bandwidth | |
| JP2015122619A (en) | Information processing apparatus, information processing method, and program | |
| WO2008064388A1 (en) | Localized signal data preservation within signal bandwidth | |
| JP3953183B2 (en) | Image communication method and image communication apparatus | |
| JP4011494B2 (en) | Image processing apparatus, image processing method, program, and recording medium | |
| JP2015122617A (en) | Information processing device, information processing method, and program | |
| JP3347409B2 (en) | Image coding apparatus and method | |
| JP2004274143A (en) | Image processing apparatus and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20090616 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
| DAX | Request for extension of the european patent (deleted) | ||
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: ZAMTEC LIMITED |
|
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: ZAMTEC LIMITED |
|
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: MEMJET TECHNOLOLGY LIMITED |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN |
|
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: MEMJET TECHNOLOGY LIMITED |
|
| 18W | Application withdrawn |
Effective date: 20140903 |