TW404136B - Process method preceding the image compression and the device itself - Google Patents
Process method preceding the image compression and the device itself Download PDFInfo
- Publication number
- TW404136B TW404136B TW88112042A TW88112042A TW404136B TW 404136 B TW404136 B TW 404136B TW 88112042 A TW88112042 A TW 88112042A TW 88112042 A TW88112042 A TW 88112042A TW 404136 B TW404136 B TW 404136B
- Authority
- TW
- Taiwan
- Prior art keywords
- brightness
- image
- average
- item
- patent application
- Prior art date
Links
- 238000007906 compression Methods 0.000 title claims abstract description 63
- 230000006835 compression Effects 0.000 title claims abstract description 62
- 238000000034 method Methods 0.000 title claims abstract description 44
- 230000008569 process Effects 0.000 title claims abstract description 5
- 230000006870 function Effects 0.000 claims abstract description 51
- 230000000873 masking effect Effects 0.000 claims abstract description 22
- 238000007781 pre-processing Methods 0.000 claims description 19
- 239000011159 matrix material Substances 0.000 claims description 18
- 230000002079 cooperative effect Effects 0.000 claims description 14
- 230000000694 effects Effects 0.000 claims description 12
- 238000004364 calculation method Methods 0.000 claims description 7
- 230000008859 change Effects 0.000 claims description 7
- 230000015572 biosynthetic process Effects 0.000 claims description 4
- 238000003786 synthesis reaction Methods 0.000 claims description 4
- 230000011218 segmentation Effects 0.000 claims description 3
- 238000009434 installation Methods 0.000 claims description 2
- 235000019557 luminance Nutrition 0.000 claims 4
- 230000000875 corresponding effect Effects 0.000 claims 3
- 238000003672 processing method Methods 0.000 claims 3
- PCTMTFRHKVHKIS-BMFZQQSSSA-N (1s,3r,4e,6e,8e,10e,12e,14e,16e,18s,19r,20r,21s,25r,27r,30r,31r,33s,35r,37s,38r)-3-[(2r,3s,4s,5s,6r)-4-amino-3,5-dihydroxy-6-methyloxan-2-yl]oxy-19,25,27,30,31,33,35,37-octahydroxy-18,20,21-trimethyl-23-oxo-22,39-dioxabicyclo[33.3.1]nonatriaconta-4,6,8,10 Chemical compound C1C=C2C[C@@H](OS(O)(=O)=O)CC[C@]2(C)[C@@H]2[C@@H]1[C@@H]1CC[C@H]([C@H](C)CCCC(C)C)[C@@]1(C)CC2.O[C@H]1[C@@H](N)[C@H](O)[C@@H](C)O[C@H]1O[C@H]1/C=C/C=C/C=C/C=C/C=C/C=C/C=C/[C@H](C)[C@@H](O)[C@@H](C)[C@H](C)OC(=O)C[C@H](O)C[C@H](O)CC[C@@H](O)[C@H](O)C[C@H](O)C[C@](O)(C[C@H](O)[C@H]2C(O)=O)O[C@H]2C1 PCTMTFRHKVHKIS-BMFZQQSSSA-N 0.000 claims 1
- 238000012856 packing Methods 0.000 claims 1
- 230000000007 visual effect Effects 0.000 abstract description 12
- 230000008447 perception Effects 0.000 abstract description 3
- 238000013139 quantization Methods 0.000 description 20
- 238000010586 diagram Methods 0.000 description 10
- 238000012545 processing Methods 0.000 description 6
- 238000006243 chemical reaction Methods 0.000 description 5
- 230000009467 reduction Effects 0.000 description 3
- 230000035945 sensitivity Effects 0.000 description 2
- 206010024796 Logorrhoea Diseases 0.000 description 1
- 241000282520 Papio Species 0.000 description 1
- 241001504519 Papio ursinus Species 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression Of Band Width Or Redundancy In Fax (AREA)
Abstract
Description
File :TW0028D3 revlFile: TW0028D3 revl
File :TW0028D3 revl 經濟部中央標準局員工消費合作社印製 ___B7__一 五、發明説明M ) 404136 本發明是有關於一種影像壓縮前處理之方法及其裝 置,且特別是有關於一種針對以離散式餘弦轉換(Discrete Cosine Transform ; DCT)爲基礎的影像編碼器(例如· JPEG、MPEG及H.263)所設計的影像壓縮前處理之方法及 其裝置。 根據視覺生理學家的硏究指出,人類視覺系統(Human Visual System)存在著兩種主要的遮蔽效應(Masking Effect),簡述如下: (1) 對比遮蔽(Contrast Masking),此種遮蔽效應主要源 於人類視覺系統對不同的背景売度(Background Luminance),具有不同的亮度對比敏感度(Contrast Sensibility),也就是說同一影像出現於不同背景中,可被 人類視覺系統察覺的程度是不同的,例如:黑色背景中的 影像會比白色背景的同一影像不容易察覺,而白色背景中 的影像又比中灰色背景的同一影像更不容易察覺。 (2) 空間遮蔽(Spatial Masking)或稱質地遮蔽(Texture Masking) ’此種遮蔽效應主要來自於背景亮度於空間分佈 的不均勻性,實際上,影像的變化若發生在高空間頻率 (Spatial Frequency)之背景上會比在低空間頻率背景,較不 容易被人類視覺系統察覺,因此,當一背景亮度具有相當 程度的空間分佈頻率,將一影像放入或取出於此背景中, 根本無法被人類視覺系統所察覺。 本影像壓縮(Image Compression)前處理方法的基本原 (请先閱讀背面之注意事項再填寫本頁) .裝_ 訂 )A4規格(210X297公釐) 經濟部中央標準局員工消費合作社印製File: TW0028D3 revl Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs _B7__15. Invention Description M) 404136 The present invention relates to a method and device for image compression preprocessing, and in particular, to a method for processing discrete images Image compression preprocessing method and device designed by image cosine transform (DCT) -based image encoders (such as JPEG, MPEG, and H.263). According to the research of visual physiologists, there are two main Masking effects in the Human Visual System, which are briefly described as follows: (1) Contrast Masking The human visual system has different background sensitivity (Contrast Sensibility) to different background luminance, which means that the same image appears in different backgrounds and can be perceived by the human visual system to different degrees For example, an image in a black background will be harder to perceive than the same image in a white background, and an image in a white background will be less perceptible than the same image in a gray background. (2) Spatial Masking or Texture Masking 'This kind of masking effect mainly comes from the unevenness of the background brightness and spatial distribution. In fact, if the image changes occur at a high spatial frequency (Spatial Frequency) ) Background is less likely to be perceived by the human visual system than at low spatial frequency backgrounds. Therefore, when a background brightness has a considerable degree of spatial distribution frequency, an image can be placed in or taken out of this background, which cannot be detected at all. Perceived by the human visual system. The basic principles of this image compression (Image Compression) pre-processing method (please read the precautions on the back before filling this page). _ Order) A4 size (210X297 mm) Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs
File:TW0028D3_revl A/ B7 ------、 40ΓίΤ3ΐ--- 五、發明説明(2 ) 理係根據上述之遮蔽效應,在進行影像壓縮及編碼時’移 除人類視覺系統無法鑑別的部份’例如:高空間頻率背景 之影像,或是低亮度對比敏感度之影像’在不影響影像品 質的前提下,可降低影像壓縮後所佔的記憶體空間’而根 據上述兩種遮蔽效應’在影像壓縮前’儲存影像造成的記 憶體空間之多餘使用’便稱爲知覺冗餘(Perceptual Redundancy) 0 傳統用以定量估算上述知覺冗餘的方法’係使用 Jayant、Johnston及Safranek所提出的恰可察覺失真(Just-Noticeable-Distortion ; JND)函數値,此 JND 函數値是一 種定義在空間區域(Spatial Domain)上的函數値,它代表每 個空間位置亮度變化的一個臨界値(Threshold),如公式(1) 所示: JND(x, y) = max{/1(6(^, y), m(x, y)\ f2(b(x, jf))} (1) 其中b(x,y)代表圖素(Pixel)(x,y)附近的背景亮度平均 値,m(x,y)表示圖素(x, y)附近的亮度變化平均値,而函 數f\(x,y)模擬上述的空間遮蔽效應,函數f2(X)則模擬 上述的對比遮蔽效應。另外,公式(1)中取最大値(max)的 意思係取出同一個圖素(X,y)中上述兩種遮蔽效應較顯著的 一種。當影像經由壓縮及編碼之後,如果每個圖素的亮度 變化程度皆低於JND臨界値,此影像品質在壓縮過程的降 低是無法被人類視覺系統所察覺的。 請參照第1圖,其繪示傳統以DCT爲基礎去除空間遮 —=W--^—裝-- (請先閱讀背面之注意事項再填寫本頁)File: TW0028D3_revl A / B7 ------, 40ΓίΤ3ΐ --- V. Description of the invention (2) Based on the above-mentioned masking effect, the system is used to 'remove parts that cannot be distinguished by the human visual system during image compression and encoding. 'For example: an image with a high spatial frequency background or an image with low brightness contrast sensitivity' can reduce the memory space occupied by image compression without affecting the image quality. Before image compression, the 'excessive use of memory space caused by stored images' is called Perceptual Redundancy. 0 The traditional method for quantitatively estimating the above-mentioned perceptual redundancy is based on the use of the correct method proposed by Jayant, Johnston, and Safranek. Just-Noticeable-Distortion (JND) function 値, this JND function 値 is a function defined on the spatial domain (Spatial Domain), it represents a threshold 値 (Threshold) of the brightness change of each spatial location, such as Formula (1) shows: JND (x, y) = max {/ 1 (6 (^, y), m (x, y) \ f2 (b (x, jf))} (1) where b (x , Y) represents the background brightness near Pixel (x, y) Mean 値, m (x, y) represents the average brightness change 附近 near the pixel (x, y), while the function f \ (x, y) simulates the above-mentioned spatial shadowing effect, and the function f2 (X) simulates the above-mentioned contrast Masking effect. In addition, the meaning of taking maximum 値 (max) in formula (1) is to take out one of the above two masking effects in the same pixel (X, y). When the image is compressed and encoded, if each The brightness change of each pixel is lower than the JND threshold. The reduction in image quality during the compression process cannot be detected by the human visual system. Please refer to Figure 1, which shows the traditional DCT-based removal of spatial occlusion— = W-^ — 装-(Please read the precautions on the back before filling this page)
.1T.1T
T .Λ 本紙張尺度適用中國國家榡準(CNS ) A4規格(210 X 297公整) 經濟部中央榡準局員工消費合作衽印製T .Λ This paper size applies to China National Standards (CNS) A4 (210 X 297 metric) printed by the Central Government Standards Bureau of the Ministry of Economic Affairs for consumer cooperation
File :TW002 8D3 revl " B7 五、發明説明Ο ) 404136 蔽效應所造成的知覺冗餘影像編碼器(Image Coder)之方塊 圖。輸入之影像首先被分割成8X8的影像區塊(ImageFile: TW002 8D3 revl " B7 V. Description of the invention 0) 404136 Block diagram of perceptually redundant image coder (Image Coder) caused by shadowing effect. The input image is first divided into 8X8 image blocks (Image
Block)IB,接著利用DCT處理單元11對影像區塊IB進行 DCT轉換,並輸出64個DCT轉換係數TC給量化單元 (Quantization Unit)13 以及量化矩陣單元(QuantizationBlock) IB, and then DCT-converts the image block IB using the DCT processing unit 11 and outputs 64 DCT conversion coefficients TC to the Quantization Unit 13 and the Quantization Matrix Unit.
Matrix Unit)15,量化單元13再利用量化矩陣單元15提供 的一種量化矩陣,將DCT轉換係數TC加以量化,並輸出 一群量化係數QC給可變長度編碼單元(Variable-LengthMatrix Unit) 15, the quantization unit 13 then uses a quantization matrix provided by the quantization matrix unit 15 to quantize the DCT conversion coefficients TC and output a group of quantization coefficients QC to a variable-length encoding unit (Variable-Length
Coding Unit)17 ’用以對量化係數QC加以編碼,最後,輸 出一個位元串(Bitstream)BS。Coding Unit) 17 'is used to encode the quantization coefficient QC. Finally, a bitstream BS is output.
其中量化矩陣單元15係根據此64個DCT轉換係數TC 產生一群參數(Parameter),對不同的影像編碼器而言,此 群參數的數目、大小有不同的上下値限制,以及不同的相 鄰參數差距値,例如對JPEG及MPEG而言,此群參數共 有64個’係組成一個8X8量化矩陣,而H.263只使用一 個參數。 上述之影像編碼器,係對於上述之DCT轉換係數TC, 進f了一種知覺度量(Perceptual Measurement),也就是設定 量化矩陣中的參數,使得經量化單元13產生的量化係數 QC中屬於高頻部分的係數設爲〇,進而降低位元串BS之 位元數大小(一般而言量化係數qC中愈多係數爲〇,位元 串BS長度愈短),以改進壓縮效果。 雖然上述之方法具有消減位元數(Bit Reducing)之功 本&度適用中國國公- (請先閲讀背面之注意事項再填寫本頁) .裝. • '訂---- J-- ”旅The quantization matrix unit 15 generates a group of parameters based on the 64 DCT conversion coefficients TC. For different image encoders, the number and size of the group parameters have different upper and lower limits, and different neighboring parameters. Gap 値 For example, for JPEG and MPEG, this group of parameters has a total of 64 ', which constitutes an 8X8 quantization matrix, while H.263 uses only one parameter. The above-mentioned image encoder is a perceptual measurement for the above-mentioned DCT conversion coefficient TC, that is, setting parameters in the quantization matrix, so that the quantization coefficient QC generated by the quantization unit 13 belongs to the high-frequency part. The coefficient of is set to 0, thereby reducing the number of bits of the bit string BS (in general, the more coefficients in the quantization coefficient qC are 0, the shorter the length of the bit string BS) to improve the compression effect. Although the above method has the function of bit reduction (Bit Reducing) & degree is applicable to the Chinese Grandfather-(Please read the precautions on the back before filling this page). Install. • 'Order ---- J-- "trip
File:TW〇〇28D3_ A7 B7 經濟部中央標準局員工消費合作社印製 五、發明説明(叫 404136 能,然而仍具有下列之缺點: 1. 因爲每一個影像編碼器都有特定的量化矩陣編列方 式(Coding Syntax),例如上述的上下値限制以及相鄰參數 的差距値,因此若是利用設定量化矩陣的方式,來達到消 除知覺冗餘的目的,則量化矩陣的參數必須隨著編碼器的 不同而作修改,因而增加系統的複雜性。 2. 因爲DCT轉換係數經上述知覺度量,所處理的是輸 入影像之空間頻率特性(去除高頻部份),並未考慮影像中 每個圖素的亮度變化特性,例如:量化矩陣中不同參數的 差距値,因此,對於上述對比遮蔽效應所造成的知覺冗餘, 便無法由此方法消除。 有鑑於此/本發明的主要目的在於提供一種影像壓縮 的前處理裝置,此裝置設於以DCT爲基礎的影像編碼器 前面,用以事先對影像進行圖素亮度値之調整,再進行影 像之壓縮及編碼,除了可以消除影像之知覺冗餘,而且不 必隨著影像編碼器的不同而調整不同的量化矩陣參數設定 方式,以簡化系統之操作。 本發明的另一目的在於提供一種影像壓縮前處理方 法,利用上述JND函數値,作爲圖素亮度値調整之依據, 調整影像中每個圖素的亮度値,可消減空間及對比遮蔽效 應造成的知覺冗餘,在不影響影像的品質下,可進〜步縮 減影像壓縮所需的位元數。 根據本發明的主要目的,提出一種影像壓縮前處理裝 置,此裝置包括: 本紙張尺度適用中國國家標準(CNS ) A4規格(210X297公釐〉 (請先閱讀背C&之注意事項存填寫本 -装. ,ir 、泉 A7 B7File: TW〇〇28D3_ A7 B7 Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs 5. Description of the invention (called 404136), but still has the following disadvantages: 1. Because each image encoder has a specific quantization matrix arrangement method (Coding Syntax), such as the above-mentioned upper and lower limits, and the gap between adjacent parameters. Therefore, if the method of setting a quantization matrix is used to achieve the purpose of eliminating perceptual redundancy, the parameters of the quantization matrix must be different with different encoders. Make changes to it, which increases the complexity of the system. 2. Because the DCT conversion coefficient is measured by the above perception, the spatial frequency characteristics of the input image are processed (excluding the high frequency part), and the brightness of each pixel in the image is not considered. Variation characteristics, such as the difference between different parameters in the quantization matrix 因此, therefore, the perceptual redundancy caused by the above-mentioned contrast masking effect cannot be eliminated by this method. In view of this, the main purpose of the present invention is to provide an image compression Pre-processing device, which is located in front of the DCT-based image encoder, and is used to pre-process the image. The adjustment of pixel brightness and image compression and coding can not only eliminate the perceptual redundancy of the image, but also do not need to adjust different quantization matrix parameter setting methods with different image encoders to simplify the operation of the system. Another object of the invention is to provide an image compression pre-processing method, which uses the above-mentioned JND function 値 as a basis for adjusting pixel brightness , and adjusts the brightness 每个 of each pixel in the image to reduce the perception caused by space and contrast occlusion effects. Redundancy, without affecting the quality of the image, can further reduce the number of bits required for image compression. According to the main purpose of the present invention, an image compression pre-processing device is provided. The device includes: This paper scale is applicable to the country of China Standard (CNS) A4 specification (210X297 mm) (Please read the notes of C & fill in this booklet. Ir, spring A7 B7
File:TW〇〇28D3 re, 五、發明説明(艾) 404136 區塊分割單元,用以將輸入之影像分割成8X8的影像 區塊;JND計算單元,用以根據上述之影像,計算每一個 圖素的JND函數値,以形成一個JND圖表(Profile);失真 遮敝單兀(Distortion Masking Unit),接收上述之影像區塊 及JND圖表,用以對影像區塊中每個圖素亮度値,朝此影 像區塊的亮度平均値作調整;以及區塊合成單元,接收上 述失真遮蔽單元的輸出,將影像區塊組合成新的影像,再 傳給以DCT爲基礎的影像編碼器進行壓縮及編碼(例如: iPEG ’ MPEG,H.263 ),以形成一位元串。其中此失真遮 蔽單元利用此JKD圖表,對影像區塊中每個圖素亮度値, 1¾¾亮度平均値作調整,可消除人類視覺系統之知覺冗 且此裝置設於影像編碼器之前,所以不必更改影像編 碼器的內部設定即可消除知覺冗餘。 根據本發明的另一目的,提出一種影像壓縮前處理方 法,其步驟簡述如下: •首先’將影像分割成8X8的影像區塊;再對影像區塊 中的每一圖素計算jND函數値,以形成一個JND圖表; 根據此JND圖表,對該些JND函數値求取加權(Weighted) 蔭ί數値;求取每個影像區塊的亮度平均値;根據這些亮度 平均値及加權函數値,對每個影像區塊中所有圖素亮度 値’朝影像區塊的亮度平均値作調整,並形成新的影像區 塊;最後將新的影像區塊加以組合成新的影像,以進行壓 縮及編碼。此方法藉由降低相鄰圖素亮度之對比(即亮度 値的差距縮小),同時可消減影像中之高頻部份,因而消File: TW〇〇28D3 re, V. Description of the invention (Ai) 404136 A block division unit is used to divide the input image into 8X8 image blocks; a JND calculation unit is used to calculate each image based on the above images The prime JND function 値 forms a JND chart (Profile); the distortion masking unit (Distortion Masking Unit) receives the above-mentioned image blocks and JND charts for the brightness of each pixel in the image block 値, Make adjustments to the brightness average of this image block; and a block synthesis unit that receives the output of the above-mentioned distortion masking unit, combines the image blocks into a new image, and sends it to a DCT-based image encoder for compression and Encoding (eg: iPEG 'MPEG, H.263) to form a bit string. The distortion masking unit uses this JKD chart to adjust the brightness of each pixel in the image block, and the average brightness of 1¾¾, which can eliminate the verbosity of the human visual system and the device is set in front of the image encoder, so there is no need to change it. The image encoder's internal settings eliminate perceptual redundancy. According to another object of the present invention, a method for pre-compressing an image is proposed, the steps of which are briefly described as follows: • First 'divide the image into 8 × 8 image blocks; then calculate the jND function for each pixel in the image block. To form a JND chart; according to this JND chart, obtain weighted (Weighted) numbers for the JND functions; obtain the average brightness of each image block; and according to these brightness averages and weighting functions, , Adjust the brightness of all pixels in each image block 値 'toward the average brightness of the image block, and form a new image block; finally, combine the new image blocks into a new image for compression And encoding. This method reduces the contrast of the brightness of adjacent pixels (that is, the difference in brightness 缩小 is reduced).
CNS)峨格(2i〇x^¥T (請先聞讀背面之注意事項再填寫本頁) 裝CNS) Ege (2i〇x ^ ¥ T (Please read the precautions on the back before filling this page)
、1T 經濟部中央標準局員工消費合作社印製, 1T Printed by the Consumer Cooperatives of the Central Bureau of Standards of the Ministry of Economic Affairs
File :TW0 0 2 8 D3 re, A7 B7 經濟部中央標準局員工消費合作社印製 五、發明説明(〇 減了上述之兩種知覺冗餘,消減壓縮編碼所需的位元數, 且在調整不同影像區塊的圖素亮度値時,求取了加權函數 値,可保持影像區塊組合後之品質。 爲讓本發明之上述目的、特徵、和優點能更明顯易懂, 下文特舉一較佳實施例,並配合所附圖式,作詳細說明如 下: 圖式之簡單說明: 第1圖繪示傳統以DCT爲基礎去除空間遮蔽效應所 造成的知覺冗餘之影像編碼器之方塊圖; 第2圖繪示依照本發明一較佳實施例的一種影像處理 裝置結構圖; 第3圖繪不乃第2圖中失真遮敝單兀之結構圖; 第4圖繪示乃第3圖中調整單元之結構圖; 第5圖繪示乃以第4圖的結構來調整圖素亮度値之示 意圖; .第6A〜11A圖依序繪示傳統JPEG及H.263之影像圖; 以及 第6B〜11B圖依序繪不相對於第6A〜11A圖中影像經 本發明處理後的JNDM影像圖。 標號說明= 11 : DCT處理單元 15 :量化矩陣單元 21 :區塊分割單元 25 :失真遮蔽單元 13 :量化單元 Π:可變長度編碼單元 23 : JND計算單元 27 :區塊合成單元 (請先閲讀背面之注意事項再填寫本頁) 裝File: TW0 0 2 8 D3 re, A7 B7 Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs 5. Description of the invention (0 reduces the above two types of perceived redundancy, reduces the number of bits required for compression coding, and is adjusting When the pixel brightness of different image blocks is 値, a weighting function 求 is obtained to maintain the quality of the combined image blocks. In order to make the above-mentioned objects, features, and advantages of the present invention more obvious and easier to understand, one of the following is specifically enumerated. The preferred embodiment and the accompanying drawings are described in detail as follows: Brief description of the drawings: Figure 1 shows a block diagram of a traditional image encoder based on the DCT to remove the perceptual redundancy caused by the spatial shadowing effect. Figure 2 is a structural diagram of an image processing device according to a preferred embodiment of the present invention; Figure 3 is a structural diagram of a distortion masking unit in Figure 2; Figure 4 is a diagram of Figure 3 Structure diagram of the middle adjustment unit; Figure 5 shows the schematic diagram of adjusting the brightness of pixels with the structure of Figure 4; Figures 6A ~ 11A show the traditional JPEG and H.263 image maps in sequence; and 6B ~ 11B are not drawn in sequence relative to 6A ~ 11A The JNDM image of the Chinese image processed by the present invention. Symbol description = 11: DCT processing unit 15: quantization matrix unit 21: block segmentation unit 25: distortion masking unit 13: quantization unit Π: variable length coding unit 23: JND calculation Unit 27: Block Synthesis Unit (please read the precautions on the back before filling this page)
、1T Λ泉 本紙張尺度適用中國國家標準(CNS ) Α4規格(210Χ297公釐) le:TW0028D3 revl A7 B7 五、發明説明(7 ) 404136 29:DCT影像編碼器 31 33 :加權矩陣單元 35 41 :比較單元 43 45 :減法單元 47 49 :極小單元 平均値計算單元 調整單元 加法單元 極大單元 經濟部中央標準局員工消費合作社印製 較佳實施例 請參照第2圖,其繪示依照本發明一較佳實施例的一 種影像壓縮處理裝置結構圖。此一影像壓縮處理裝置包 括:區塊分割單元21,用以將輸入之影像畫面(Frame)F分 割成數個不相重疊的(Ncmoverlapping)8X8影像區塊IB; JND計算單元23,用以根據上述之影像畫面F,計算每一 個圖素的JND函數値,此處以JNDj⑴代表第j個影像區 塊IB中第i(i=l〜64)個圖素的JND函數値,以構成一個JND 圖表J ;失真遮蔽單元25,接收上述之影像區塊IB及JND 圖表J,用以對影像中每一個圖素亮度値做調整,並輸出 影像區塊以及區塊合成單元27,接收所有的上述 之影像區塊,加以組合成新的影像畫面Fjndm,再傳 給DCT影像編碼器29進行壓縮及編碼,產生影像位元串 BS。 請參照第3圖,其繪示第2圖中失真遮蔽單元25之結 構圖。其結構包括:平均値計算單元31,用以對每個影像 區塊ιέ求取亮度平均値,此處以巧代表第個影像區塊 IB的亮度平均値;加權矩陣單元(Weighted Matrix Unit) (請先閱讀背面之注意事項再填寫本頁) 裝. 訂 '.4. 本紙張尺度適用中國國家標準(CNS ) A4規格(210X 297公釐)、 1T Λ The size of this paper is applicable to the Chinese National Standard (CNS) A4 specification (210 × 297 mm) le: TW0028D3 revl A7 B7 V. Description of the invention (7) 404136 29: DCT image encoder 31 33: Weighting matrix unit 35 41: Comparison unit 43 45: Subtraction unit 47 49: Extremely small unit Average 値 Calculation unit Adjustment unit Addition unit Extremely large unit Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economics A preferred embodiment Please refer to FIG. 2, which shows a comparison according to the invention Structure of an image compression processing device of the preferred embodiment. This image compression processing device includes: a block division unit 21 for dividing the input image frame (Frame) F into a plurality of non-overlapping (Ncmoverlapping) 8X8 image blocks IB; a JND calculation unit 23 for performing For the image frame F, calculate the JND function for each pixel. Here, JNDj⑴ is used to represent the JND function i of the i-th (i = l ~ 64) pixels in the j-th image block IB to form a JND chart J The distortion masking unit 25 receives the above-mentioned image block IB and JND chart J, and is used to adjust the brightness of each pixel in the image, and outputs an image block and a block synthesis unit 27 to receive all the above-mentioned images The blocks are combined into a new image frame Fjndm, which is then transmitted to the DCT image encoder 29 for compression and encoding to generate an image bit string BS. Please refer to FIG. 3, which shows the structure of the distortion masking unit 25 in FIG. Its structure includes: an average 値 calculation unit 31 for obtaining a brightness average 値 for each image block, where the brightness average 値 of the first image block IB is represented here; a weighted matrix unit (please refer to Please read the notes on the back before filling this page.) Binding. Order '.4. This paper size is applicable to China National Standard (CNS) A4 (210X 297 mm)
File :TW0 02 8 D3 revl A/ B7 五、發明説明(s ) 33,根據上述之JND圖表J,用以對每個圖素的JND函數 値作加權計算,此處以JND7(〇代表第j個影像區塊IB中 的第i個圖素經加權後的JND函數値;以及調整單元35, 用以依照亮度平均値朽以及加權函數値_『(〇,來調整影 像中每一個圖素亮度値乃(〇,調整後的圖素亮度値以 /fDM(〇表示,如公式(2)、(3)及(4)所示。 \msx{A, Ρ}\ if Pj(J) > Pj, [min{^(, Pj\ otherwise, (2)File: TW0 02 8 D3 revl A / B7 5. Invention Description (s) 33. According to the JND chart J above, it is used to weight the JND function 每个 for each pixel. Here, JND7 (0 represents the jth A weighted JND function i of the i-th pixel in the image block IB; and an adjusting unit 35 for adjusting the brightness of each pixel in the image according to the brightness average decay and the weighting function 値 "(〇, (0, the adjusted pixel brightness 値 is represented by / fDM (0, as shown in formulas (2), (3), and (4). \ Msx {A, Ρ} \ if Pj (J) > Pj , [min {^ (, Pj \ otherwise, (2)
AA
Pj{i) + B (3) ----------^裝-I (請先閱讀背面之注意事項再填寫本頁)Pj (i) + B (3) ---------- ^ 装 -I (Please read the precautions on the back before filling this page)
B |- 1, iiPj(i) > Pj, [+ 1, otherwise, (4) 其中 JNDf.JNDjQxWMQ,WM(i) (i=l〜64)代表第 i 個JND函數値的加權値,此64個加權値可構成一種矩陣 形式,稱爲加權矩陣,如表1所示。 表1 0.4 0.8 0.4 0.8 0.4 0.8 0.4 0.8 0.8 1 1 1 1 1 1 0.4 0.4 1 1 1 1 1 1 0.8 0.8 1 1 1 1 1 1 0.4 0.4 1 1 1 1 1 1 0.8 0.8 1 1 1 1 1 1 0.4 0.4 1 1 1 1 1 1 0.8 0.8 0.4 0.8 0.4 0.8 0.4 0.8 0.4 其中影像晝面F分割後,位於每個影像區塊IB四個 邊界上的圖素,其加權値(係0.4與0.8兩種値交叉分佈) 本紙張尺度適用中國國家標準(CNS ) Α4規格(210X297公釐)B |-1, iiPj (i) > Pj, [+ 1, otherwise, (4) where JNDf.JNDjQxWMQ, WM (i) (i = l ~ 64) represents the weighted 値 of the i-th JND function 値, where The 64 weighted 値 can form a matrix form, called a weighting matrix, as shown in Table 1. Table 1 0.4 0.8 0.4 0.8 0.4 0.8 0.4 0.8 0.8 1 1 1 1 1 1 1 0.4 0.4 1 1 1 1 1 1 0.8 0.8 1 1 1 1 1 1 0.4 0.4 1 1 1 1 1 1 0.8 0.8 1 1 1 1 1 1 0.4 0.4 1 1 1 1 1 0.8 0.8 0.4 0.8 0.8 0.4 0.8 0.4 0.8 0.4 Among them, the pixels located on the four boundaries of each image block IB after F segmentation of the daytime image are weighted by 値 (both 0.4 and 0.8) Cross-distribution) This paper size applies to China National Standard (CNS) Α4 specification (210X297 mm)
、1T 經濟部中央標準局員工消費合作社印製, 1T Printed by the Consumer Cooperatives of the Central Bureau of Standards of the Ministry of Economic Affairs
File :TW0028D3 revl A7 B7 經濟部中央標準局員工消費合作社印製 五、發明説明(1 ^~~4ϋ4ΐ3ί 、…、息 取得比其它部份的加權値(1.0)還低,因而可減小邊界圖 素的JND臨界値,圖素亮度値乃(〇的調整便會縮小’當8 X8影像區塊IB組合成新的影像畫面F時,可降低重組 影像產生的人爲區塊效應(Blocking Effect)。 請參照第4圖,其繪示第3圖中調整單元之結構圖。 其結構包括:比較單元41,用以對每一個圖素亮度値 乃⑺與亮度平均値Λ作比較:加法單元43,用以對經比 較單元41比較後,小於平均値巧的圖素亮度値乃(0 ’加 上一個加權函數値JNE>7(〇 ;減法單元45,用以對經比較 單元比較後,大於平均値Λ的圖素亮度値乃(0 ’減去 —個加權函數値JND;T(〇 ;極大單元47,用以接收減法單 元45的輸出値,與亮度平均値巧作比較,而取其較大値 爲新的圖素亮度値ΡΓΜ(0 ;以及極小單元49,用以接收 加法單元43的輸出値,與亮度平均値巧作比較,而取其 較小値爲新的圖素亮度値 •請參照第5圖,其繪示依照本發明較佳實施例調整 單元調整圖素亮度値之示意圖。白色圈圏代表未調整的 圖素亮度値乃(〇,黑色圈圈代表調整後的圖素亮度値 PfDM(0,而雙箭頭長度表示圖素亮度値乃⑺可進行調整之 大小’也就是該圖素的加權函數値IND%)。由第5圖可明 顯看出,調整後的圖素亮度値黑色圈圈所示)較未 調整的圖素亮度値ρχ〇(白色圈圏所示)更集中於影像區塊 ΙΒ的亮度平均値Λ(中間粗黑線所示),而且每一個調整 後的圖素亮度値if’DM (0與原來的圖素亮度値乃(〇的差距絕 本紙張尺度適用中國國家標準(CNS ) Μ規格(2丨0>< 297公釐 I-----,--裝------^訂 ί-----^ 戒 (請先閱讀背面之注意事項再填寫本頁)File: TW0028D3 revl A7 B7 Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs 5. Description of the invention (1 ^ ~~ 4ϋ4ΐ3ί, ..., the gain of information is lower than the weighted 値 (1.0) of other parts, so the boundary map can be reduced The threshold of the prime JND is 値, and the brightness of the pixel will be adjusted. When the 8 X8 image block IB is combined into a new image frame F, the artificial blocking effect caused by the recombined image can be reduced. Please refer to Fig. 4, which shows the structural diagram of the adjustment unit in Fig. 3. Its structure includes: a comparison unit 41 for comparing the brightness of each pixel 値 値 and the average brightness 値 Λ: addition unit 43 Is used to compare the pixel brightness smaller than the mean value after comparison by the comparison unit 41 (0 ′ plus a weighting function 値 JNE> 7 (〇; subtraction unit 45), which is used to compare The pixel brightness 値 of the average 値 Λ is (0 'minus a weighting function 値 JND; T (0; a maximum unit 47 for receiving the output 値 of the subtraction unit 45, which is compared with the brightness average 値, and which is Larger is the new pixel brightness, ρΓΜ (0; and A small unit 49 is used to receive the output 加 of the adding unit 43 and compare it with the brightness average 値, and take the smaller 値 as the new pixel brightness 値 Please refer to FIG. 5, which shows that it is better according to the present invention. Schematic diagram for adjusting the pixel brightness 値 by the adjustment unit in the embodiment. The white circle 圏 represents the unadjusted pixel brightness 値 is (0, the black circle represents the adjusted pixel brightness 値 PfDM (0, and the double arrow length represents the pixel brightness値 is the size that can be adjusted ', which is the weighting function of the pixel (IND%). From Figure 5, it can be clearly seen that the adjusted pixel brightness (shown by the black circle) is less than the unadjusted pixel. The brightness 値 ρχ〇 (shown by the white circle) is more concentrated on the average brightness 値 Λ (shown by the thick black line in the middle) of the image block IB, and each adjusted pixel brightness 値 if'DM (0 and the original The pixel brightness is equal to (0), the absolute paper size is applicable to the Chinese National Standard (CNS) M specifications (2 丨 0 > < 297 mm I -----,-installation ------ ^ order ί ----- ^ Caution (Please read the notes on the back before filling in this page)
File :TW0 0 2 8 D3 re, A7 B7 五、發明説明(I。) 404136對値必不大於鐘,如公式⑺所示。因爲喊〇値必 不大於腳⑹値,而根據_ _値的定義,公式⑺ 表示經過本發__亮度_整後,影像品質的改變 是人類視覺系統所不可察覺的。 |^DM(〇 - ΡΛή\ (0· (5) 經濟部中央標準局員工消費合作社印製 請參照第6A〜11A圖及第6b〜Ub圖。其中,第6A〜8A 圖分別代表飛機、狒狒、全家福之JPEG影像圖;第9A〜11A 圖分別代表虛擬動物、母女、播報員之H 263影像圖;第 6B〜11B圖分別代表前述jpEG影像及h.263影像經本發明 處理後的JNDM影像圖。 並請同時參照表2及表3,分別將利用本發明之影像 與傳統JPEG影像及H.263影像中所需之位元數列表比較。 由表2及表3可知,對不同的JPEg影像及H 263影像作 壓縮/編碼處理,所得到的JNDM影像與原來的影像作比 較’可達到9.27%〜14.49%位元數消減率(Bit Reducing Ratio)’且不影響影像的品質。在第从〜丨1A圖與第6B~1 IB 圖所示之影像圖中’可發現經本發明處理後之JNDM影像 圖與原本之JPEG影像圖以及H.263影像圖在人類之視覺 效果上幾乎分別不出來,亦即其效果幾乎是相同的,但卻 節省了不少的儲存位元比率。 本紙張尺度適用中國國家標準(CNS ) A4規格(210X297公楚) (請先閲讀背面之注意事項再填寫本頁) .絮· -V. ’.4File: TW0 0 2 8 D3 re, A7 B7 V. Description of the invention (I.) 404136 The confrontation must not be greater than the clock, as shown in formula ⑺. Because shouting 0 値 must not be larger than the foot 根据, and according to the definition of _ _⑺, the formula ⑺ indicates that the change in image quality after the present __brightness_ is invisible to the human visual system. | ^ DM (〇- ΡΛή \ (0 · (5) Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs, please refer to Figures 6A ~ 11A and Figures 6b ~ Ub. Among them, Figures 6A ~ 8A represent aircraft and baboons, respectively , JPEG image maps of family portraits; Figures 9A-11A represent the H 263 image maps of virtual animals, mother and daughter, and broadcasters; Figures 6B-11B represent the aforementioned jpEG images and h.263 images processed by the present invention. Please refer to Table 2 and Table 3 at the same time, and compare the list of bits required in the image using the present invention with the traditional JPEG image and H.263 image, respectively. From Table 2 and Table 3, we can know that for different JPEg The image and H 263 image are compressed / encoded. Compared with the original image, the obtained JNDM image is 'up to 9.27% ~ 14.49% Bit Reducing Ratio' without affecting the quality of the image. From the image diagrams shown in ~ 丨 1A and 6B ~ 1IB, it can be found that the processed JNDM image, the original JPEG image, and the H.263 image are almost different in human visual effects. Out, meaning the effect is almost the same, but Save a lot of storage bit rate. This paper scales applicable Chinese National Standard (CNS) A4 size (210X297 public Chu) (Please read the notes and then fill in the back of this page). Xu · -V. '.4
File:TW0028D3一revl B7 五、發明説明(")404136 表2 JPEG影像 原來影像 JNDM影像 位元數消減 率(%) 位元數 位元數 飛機 6161 5460 11.38 狒狒 9457 8572 9.36 全家福 6863 6158 10.27 J 1 —.. 表3 -------- H.263影像 原來影像 JNDM影像 位元數消減 位元數 位元數 率(%) ... 虛擬動物 6244 5339 14.49 母女 15766 13913 11.75 播報員 8680 7875 9.27 因此,本發明具有下列幾項優點: 翅濟部中央標準局員工消費合作社印製 (1) 由於本發明之影像壓縮前處理裝置係安裝於影像編 碼器之前,對影像先作圖素亮度値之調整,再將結果傳給 影像編碼器進行壓縮及編碼’因此,不必隨影像編碼器不 同而調整影像編碼器中參數的設定方式,可簡化系統之操 作過程。 (2) 利用JND函數値對每一個圖素的亮度値,朝影像區 塊亮度平均値作調整,使得調整後的圖素亮度値更集中於 亮度平均値(通常爲低頻部份),可去除影像中之高頻訊號 部份,消減影像壓縮/編碼後的位元數。 本紙張尺度顧t @ S家樟準(CNS ) A4規格(File: TW0028D3_revl B7 V. Explanation of the invention (") 404136 Table 2 JPEG image original image JNDM image Bit reduction rate (%) Bit number Bit number Plane 6161 5460 11.38 Baboon 9457 8572 9.36 Family portrait 6863 6158 10.27 J 1 — .. Table 3 -------- H.263 original image JNDM image bit number subtraction bit number bit rate (%) ... virtual animal 6244 5339 14.49 mother and daughter 15766 13913 11.75 broadcaster 8680 7875 9.27 Therefore, the present invention has the following advantages: Printed by the Consumer Cooperative of the Central Bureau of Standards of the Ministry of Economic Affairs (1) Because the image compression pre-processing device of the present invention is installed before the image encoder, the pixel brightness of the image is first After the adjustment, the result is passed to the image encoder for compression and encoding. Therefore, it is not necessary to adjust the parameter setting method of the image encoder with different image encoders, which can simplify the operation process of the system. (2) Use the JND function 値 to adjust the brightness 每 of each pixel toward the brightness average 影像 of the image block, so that the adjusted pixel brightness 値 is more concentrated on the brightness average 値 (usually the low frequency part), which can be removed The high-frequency signal part of the image reduces the number of bits after image compression / encoding. Specifications of this paper Gu t @ S 家 张 准 (CNS) A4 Specification (
File :TW0028D3 rev1 A/ ___~___B7___ 五、發明説明(π )404136 (3)利用JND技術’在空間區域中對每一個圖素的亮度 値,朝影像區塊亮度平均値作調整,且調整之大小不超過 圖素的JND函數値’如公式⑴所示,jND函數値係考慮 對比遮蔽與空間遮蔽效應較顯著者,因而,可同時降低對 比遮蔽效應所相關的知覺冗餘,在不影響影像的品質前提 下’比習知技術更進一步縮減了影像壓縮/編碼所需的位 元數。 綜上所述,雖然本發明已以一較佳實施例揭露如上, 然其並非用以限定本發明,任何熟習此技藝者,在不脫離 本發明之精神和範圍內,當可作各種更動與潤飾,因此本 發明之保護範圍當視後附之申請專利範圍所界定者爲準。 (請先閱讀背面之注意事項再填寫本頁) 裝 訂 經濟部中央標準局員工消費合作社印製File: TW0028D3 rev1 A / ___ ~ ___ B7___ V. Description of the invention (π) 404136 (3) Use the JND technology to adjust the brightness of each pixel in the spatial area, and adjust it toward the average brightness of the image block, and adjust the The JND function whose size does not exceed the pixel (as shown in the formula), the jND function does not consider those with significant contrast and spatial shadow effects. Therefore, it can reduce the perceptual redundancy related to the contrast shadow effect at the same time, without affecting the image. Under the premise of quality, the number of bits required for image compression / encoding is further reduced than the conventional technology. In summary, although the present invention has been disclosed as above with a preferred embodiment, it is not intended to limit the present invention. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Retouching, so the scope of protection of the present invention shall be determined by the scope of the attached patent application. (Please read the notes on the back before filling out this page) Binding Printed by the Staff Consumer Cooperative of the Central Standards Bureau of the Ministry of Economic Affairs
Claims (2)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW88112042A TW404136B (en) | 1999-07-16 | 1999-07-16 | Process method preceding the image compression and the device itself |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW88112042A TW404136B (en) | 1999-07-16 | 1999-07-16 | Process method preceding the image compression and the device itself |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| TW404136B true TW404136B (en) | 2000-09-01 |
Family
ID=21641520
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW88112042A TW404136B (en) | 1999-07-16 | 1999-07-16 | Process method preceding the image compression and the device itself |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TW404136B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7856149B2 (en) | 2002-07-29 | 2010-12-21 | Qualcomm Incorporated | Digital image encoding |
-
1999
- 1999-07-16 TW TW88112042A patent/TW404136B/en not_active IP Right Cessation
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7856149B2 (en) | 2002-07-29 | 2010-12-21 | Qualcomm Incorporated | Digital image encoding |
| US8194987B2 (en) | 2002-07-29 | 2012-06-05 | Qualcomm Incorporated | Digital image encoding |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9467704B2 (en) | Adaptive ratio images in HDR image representation | |
| EP3566203B1 (en) | Perceptually preserving scene-referred contrasts and chromaticities | |
| US9842385B2 (en) | Display management for images with enhanced dynamic range | |
| WO1999031887A2 (en) | Method of frame by frame calculation of quantization matrices | |
| EP2449526A1 (en) | Zone-based tone mapping | |
| CN108933933B (en) | A video signal processing method and device | |
| JP2018533860A (en) | Method and apparatus for quantization in video encoding and decoding | |
| CN103096079B (en) | A kind of multi-view video rate control based on proper discernable distortion | |
| CN107771392A (en) | Real time content for high dynamic range images adaptively perceives quantizer | |
| CN114467298B (en) | Image signal conversion processing method and device and terminal equipment | |
| CN116886917A (en) | Gain map encoding method, decoding method, device, equipment and medium | |
| Kumar et al. | Performance of quality metrics for compressed medical images through mean opinion score prediction | |
| EP4066505B1 (en) | Rate-control-aware reshaping in hdr imaging | |
| TW404136B (en) | Process method preceding the image compression and the device itself | |
| US7657110B2 (en) | Image compression using a color visual model | |
| JP4383760B2 (en) | Digital watermark embedding apparatus, method thereof, and storage medium storing program for executing the method | |
| CN118381937B (en) | Self-adaptive QP (program guide) adjustment method, system and device for point cloud video | |
| Li et al. | High dynamic range image compression based on visual saliency | |
| Chen et al. | A robust video watermarking algorithm based on spatial domain | |
| Zeng et al. | Perceptual quality measure using JND model of the human visual system | |
| CN116527902A (en) | Image weighted quantization processing method, device, computer equipment and storage medium | |
| Ma et al. | Adaptive block-size transform based just-noticeable difference profile for images | |
| Zhang et al. | Region-of-interest image coding based on perceptually optimized bitplane realignment | |
| CN121414637A (en) | A high dynamic range image processing method, apparatus, device and storage medium | |
| HK1221544B (en) | Image processing for hdr images |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GD4A | Issue of patent certificate for granted invention patent | ||
| MM4A | Annulment or lapse of patent due to non-payment of fees |