TW404136B - Process method preceding the image compression and the device itself - Google Patents

Process method preceding the image compression and the device itself Download PDF

Info

Publication number
TW404136B
TW404136B TW88112042A TW88112042A TW404136B TW 404136 B TW404136 B TW 404136B TW 88112042 A TW88112042 A TW 88112042A TW 88112042 A TW88112042 A TW 88112042A TW 404136 B TW404136 B TW 404136B
Authority
TW
Taiwan
Prior art keywords
brightness
image
average
item
patent application
Prior art date
Application number
TW88112042A
Other languages
Chinese (zh)
Inventor
Chi-Chang Guo
Jin-Jang Liou
Original Assignee
Ind Tech Res Inst
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ind Tech Res Inst filed Critical Ind Tech Res Inst
Priority to TW88112042A priority Critical patent/TW404136B/en
Application granted granted Critical
Publication of TW404136B publication Critical patent/TW404136B/en

Links

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)

Abstract

The invention is a process method preceding the image compression and the device itself. It uses Just-Noticeable-Distortion (JND) technique to take account of the most notable between Contrast masking and Spatial masking effects to acquire a JND function value. It adjusts the brightness value of each pixel in the spatial domain towards the averages of the image block brightness, and the adjustment is under the JND function value of the pixel. The bit stream length is effectively shortened after the image compression by using the masking effects of human visual system. It reduces the perception redundancy related to the contrast masking effect without affecting the image quality to make the pixel brightness after the adjustment concentrated to the brightness average, so that the high frequency part of the image is deleted and the bit number required for image compression/decoding is reduced.

Description

File :TW0028D3 revlFile: TW0028D3 revl

File :TW0028D3 revl 經濟部中央標準局員工消費合作社印製 ___B7__一 五、發明説明M ) 404136 本發明是有關於一種影像壓縮前處理之方法及其裝 置,且特別是有關於一種針對以離散式餘弦轉換(Discrete Cosine Transform ; DCT)爲基礎的影像編碼器(例如· JPEG、MPEG及H.263)所設計的影像壓縮前處理之方法及 其裝置。 根據視覺生理學家的硏究指出,人類視覺系統(Human Visual System)存在著兩種主要的遮蔽效應(Masking Effect),簡述如下: (1) 對比遮蔽(Contrast Masking),此種遮蔽效應主要源 於人類視覺系統對不同的背景売度(Background Luminance),具有不同的亮度對比敏感度(Contrast Sensibility),也就是說同一影像出現於不同背景中,可被 人類視覺系統察覺的程度是不同的,例如:黑色背景中的 影像會比白色背景的同一影像不容易察覺,而白色背景中 的影像又比中灰色背景的同一影像更不容易察覺。 (2) 空間遮蔽(Spatial Masking)或稱質地遮蔽(Texture Masking) ’此種遮蔽效應主要來自於背景亮度於空間分佈 的不均勻性,實際上,影像的變化若發生在高空間頻率 (Spatial Frequency)之背景上會比在低空間頻率背景,較不 容易被人類視覺系統察覺,因此,當一背景亮度具有相當 程度的空間分佈頻率,將一影像放入或取出於此背景中, 根本無法被人類視覺系統所察覺。 本影像壓縮(Image Compression)前處理方法的基本原 (请先閱讀背面之注意事項再填寫本頁) .裝_ 訂 )A4規格(210X297公釐) 經濟部中央標準局員工消費合作社印製File: TW0028D3 revl Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs _B7__15. Invention Description M) 404136 The present invention relates to a method and device for image compression preprocessing, and in particular, to a method for processing discrete images Image compression preprocessing method and device designed by image cosine transform (DCT) -based image encoders (such as JPEG, MPEG, and H.263). According to the research of visual physiologists, there are two main Masking effects in the Human Visual System, which are briefly described as follows: (1) Contrast Masking The human visual system has different background sensitivity (Contrast Sensibility) to different background luminance, which means that the same image appears in different backgrounds and can be perceived by the human visual system to different degrees For example, an image in a black background will be harder to perceive than the same image in a white background, and an image in a white background will be less perceptible than the same image in a gray background. (2) Spatial Masking or Texture Masking 'This kind of masking effect mainly comes from the unevenness of the background brightness and spatial distribution. In fact, if the image changes occur at a high spatial frequency (Spatial Frequency) ) Background is less likely to be perceived by the human visual system than at low spatial frequency backgrounds. Therefore, when a background brightness has a considerable degree of spatial distribution frequency, an image can be placed in or taken out of this background, which cannot be detected at all. Perceived by the human visual system. The basic principles of this image compression (Image Compression) pre-processing method (please read the precautions on the back before filling this page). _ Order) A4 size (210X297 mm) Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs

File:TW0028D3_revl A/ B7 ------、 40ΓίΤ3ΐ--- 五、發明説明(2 ) 理係根據上述之遮蔽效應,在進行影像壓縮及編碼時’移 除人類視覺系統無法鑑別的部份’例如:高空間頻率背景 之影像,或是低亮度對比敏感度之影像’在不影響影像品 質的前提下,可降低影像壓縮後所佔的記憶體空間’而根 據上述兩種遮蔽效應’在影像壓縮前’儲存影像造成的記 憶體空間之多餘使用’便稱爲知覺冗餘(Perceptual Redundancy) 0 傳統用以定量估算上述知覺冗餘的方法’係使用 Jayant、Johnston及Safranek所提出的恰可察覺失真(Just-Noticeable-Distortion ; JND)函數値,此 JND 函數値是一 種定義在空間區域(Spatial Domain)上的函數値,它代表每 個空間位置亮度變化的一個臨界値(Threshold),如公式(1) 所示: JND(x, y) = max{/1(6(^, y), m(x, y)\ f2(b(x, jf))} (1) 其中b(x,y)代表圖素(Pixel)(x,y)附近的背景亮度平均 値,m(x,y)表示圖素(x, y)附近的亮度變化平均値,而函 數f\(x,y)模擬上述的空間遮蔽效應,函數f2(X)則模擬 上述的對比遮蔽效應。另外,公式(1)中取最大値(max)的 意思係取出同一個圖素(X,y)中上述兩種遮蔽效應較顯著的 一種。當影像經由壓縮及編碼之後,如果每個圖素的亮度 變化程度皆低於JND臨界値,此影像品質在壓縮過程的降 低是無法被人類視覺系統所察覺的。 請參照第1圖,其繪示傳統以DCT爲基礎去除空間遮 —=W--^—裝-- (請先閱讀背面之注意事項再填寫本頁)File: TW0028D3_revl A / B7 ------, 40ΓίΤ3ΐ --- V. Description of the invention (2) Based on the above-mentioned masking effect, the system is used to 'remove parts that cannot be distinguished by the human visual system during image compression and encoding. 'For example: an image with a high spatial frequency background or an image with low brightness contrast sensitivity' can reduce the memory space occupied by image compression without affecting the image quality. Before image compression, the 'excessive use of memory space caused by stored images' is called Perceptual Redundancy. 0 The traditional method for quantitatively estimating the above-mentioned perceptual redundancy is based on the use of the correct method proposed by Jayant, Johnston, and Safranek. Just-Noticeable-Distortion (JND) function 値, this JND function 値 is a function defined on the spatial domain (Spatial Domain), it represents a threshold 値 (Threshold) of the brightness change of each spatial location, such as Formula (1) shows: JND (x, y) = max {/ 1 (6 (^, y), m (x, y) \ f2 (b (x, jf))} (1) where b (x , Y) represents the background brightness near Pixel (x, y) Mean 値, m (x, y) represents the average brightness change 附近 near the pixel (x, y), while the function f \ (x, y) simulates the above-mentioned spatial shadowing effect, and the function f2 (X) simulates the above-mentioned contrast Masking effect. In addition, the meaning of taking maximum 値 (max) in formula (1) is to take out one of the above two masking effects in the same pixel (X, y). When the image is compressed and encoded, if each The brightness change of each pixel is lower than the JND threshold. The reduction in image quality during the compression process cannot be detected by the human visual system. Please refer to Figure 1, which shows the traditional DCT-based removal of spatial occlusion— = W-^ — 装-(Please read the precautions on the back before filling this page)

.1T.1T

T .Λ 本紙張尺度適用中國國家榡準(CNS ) A4規格(210 X 297公整) 經濟部中央榡準局員工消費合作衽印製T .Λ This paper size applies to China National Standards (CNS) A4 (210 X 297 metric) printed by the Central Government Standards Bureau of the Ministry of Economic Affairs for consumer cooperation

File :TW002 8D3 revl " B7 五、發明説明Ο ) 404136 蔽效應所造成的知覺冗餘影像編碼器(Image Coder)之方塊 圖。輸入之影像首先被分割成8X8的影像區塊(ImageFile: TW002 8D3 revl " B7 V. Description of the invention 0) 404136 Block diagram of perceptually redundant image coder (Image Coder) caused by shadowing effect. The input image is first divided into 8X8 image blocks (Image

Block)IB,接著利用DCT處理單元11對影像區塊IB進行 DCT轉換,並輸出64個DCT轉換係數TC給量化單元 (Quantization Unit)13 以及量化矩陣單元(QuantizationBlock) IB, and then DCT-converts the image block IB using the DCT processing unit 11 and outputs 64 DCT conversion coefficients TC to the Quantization Unit 13 and the Quantization Matrix Unit.

Matrix Unit)15,量化單元13再利用量化矩陣單元15提供 的一種量化矩陣,將DCT轉換係數TC加以量化,並輸出 一群量化係數QC給可變長度編碼單元(Variable-LengthMatrix Unit) 15, the quantization unit 13 then uses a quantization matrix provided by the quantization matrix unit 15 to quantize the DCT conversion coefficients TC and output a group of quantization coefficients QC to a variable-length encoding unit (Variable-Length

Coding Unit)17 ’用以對量化係數QC加以編碼,最後,輸 出一個位元串(Bitstream)BS。Coding Unit) 17 'is used to encode the quantization coefficient QC. Finally, a bitstream BS is output.

其中量化矩陣單元15係根據此64個DCT轉換係數TC 產生一群參數(Parameter),對不同的影像編碼器而言,此 群參數的數目、大小有不同的上下値限制,以及不同的相 鄰參數差距値,例如對JPEG及MPEG而言,此群參數共 有64個’係組成一個8X8量化矩陣,而H.263只使用一 個參數。 上述之影像編碼器,係對於上述之DCT轉換係數TC, 進f了一種知覺度量(Perceptual Measurement),也就是設定 量化矩陣中的參數,使得經量化單元13產生的量化係數 QC中屬於高頻部分的係數設爲〇,進而降低位元串BS之 位元數大小(一般而言量化係數qC中愈多係數爲〇,位元 串BS長度愈短),以改進壓縮效果。 雖然上述之方法具有消減位元數(Bit Reducing)之功 本&度適用中國國公- (請先閲讀背面之注意事項再填寫本頁) .裝. • '訂---- J-- ”旅The quantization matrix unit 15 generates a group of parameters based on the 64 DCT conversion coefficients TC. For different image encoders, the number and size of the group parameters have different upper and lower limits, and different neighboring parameters. Gap 値 For example, for JPEG and MPEG, this group of parameters has a total of 64 ', which constitutes an 8X8 quantization matrix, while H.263 uses only one parameter. The above-mentioned image encoder is a perceptual measurement for the above-mentioned DCT conversion coefficient TC, that is, setting parameters in the quantization matrix, so that the quantization coefficient QC generated by the quantization unit 13 belongs to the high-frequency part. The coefficient of is set to 0, thereby reducing the number of bits of the bit string BS (in general, the more coefficients in the quantization coefficient qC are 0, the shorter the length of the bit string BS) to improve the compression effect. Although the above method has the function of bit reduction (Bit Reducing) & degree is applicable to the Chinese Grandfather-(Please read the precautions on the back before filling this page). Install. • 'Order ---- J-- "trip

File:TW〇〇28D3_ A7 B7 經濟部中央標準局員工消費合作社印製 五、發明説明(叫 404136 能,然而仍具有下列之缺點: 1. 因爲每一個影像編碼器都有特定的量化矩陣編列方 式(Coding Syntax),例如上述的上下値限制以及相鄰參數 的差距値,因此若是利用設定量化矩陣的方式,來達到消 除知覺冗餘的目的,則量化矩陣的參數必須隨著編碼器的 不同而作修改,因而增加系統的複雜性。 2. 因爲DCT轉換係數經上述知覺度量,所處理的是輸 入影像之空間頻率特性(去除高頻部份),並未考慮影像中 每個圖素的亮度變化特性,例如:量化矩陣中不同參數的 差距値,因此,對於上述對比遮蔽效應所造成的知覺冗餘, 便無法由此方法消除。 有鑑於此/本發明的主要目的在於提供一種影像壓縮 的前處理裝置,此裝置設於以DCT爲基礎的影像編碼器 前面,用以事先對影像進行圖素亮度値之調整,再進行影 像之壓縮及編碼,除了可以消除影像之知覺冗餘,而且不 必隨著影像編碼器的不同而調整不同的量化矩陣參數設定 方式,以簡化系統之操作。 本發明的另一目的在於提供一種影像壓縮前處理方 法,利用上述JND函數値,作爲圖素亮度値調整之依據, 調整影像中每個圖素的亮度値,可消減空間及對比遮蔽效 應造成的知覺冗餘,在不影響影像的品質下,可進〜步縮 減影像壓縮所需的位元數。 根據本發明的主要目的,提出一種影像壓縮前處理裝 置,此裝置包括: 本紙張尺度適用中國國家標準(CNS ) A4規格(210X297公釐〉 (請先閱讀背C&之注意事項存填寫本 -装. ,ir 、泉 A7 B7File: TW〇〇28D3_ A7 B7 Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs 5. Description of the invention (called 404136), but still has the following disadvantages: 1. Because each image encoder has a specific quantization matrix arrangement method (Coding Syntax), such as the above-mentioned upper and lower limits, and the gap between adjacent parameters. Therefore, if the method of setting a quantization matrix is used to achieve the purpose of eliminating perceptual redundancy, the parameters of the quantization matrix must be different with different encoders. Make changes to it, which increases the complexity of the system. 2. Because the DCT conversion coefficient is measured by the above perception, the spatial frequency characteristics of the input image are processed (excluding the high frequency part), and the brightness of each pixel in the image is not considered. Variation characteristics, such as the difference between different parameters in the quantization matrix 因此, therefore, the perceptual redundancy caused by the above-mentioned contrast masking effect cannot be eliminated by this method. In view of this, the main purpose of the present invention is to provide an image compression Pre-processing device, which is located in front of the DCT-based image encoder, and is used to pre-process the image. The adjustment of pixel brightness and image compression and coding can not only eliminate the perceptual redundancy of the image, but also do not need to adjust different quantization matrix parameter setting methods with different image encoders to simplify the operation of the system. Another object of the invention is to provide an image compression pre-processing method, which uses the above-mentioned JND function 値 as a basis for adjusting pixel brightness , and adjusts the brightness 每个 of each pixel in the image to reduce the perception caused by space and contrast occlusion effects. Redundancy, without affecting the quality of the image, can further reduce the number of bits required for image compression. According to the main purpose of the present invention, an image compression pre-processing device is provided. The device includes: This paper scale is applicable to the country of China Standard (CNS) A4 specification (210X297 mm) (Please read the notes of C & fill in this booklet. Ir, spring A7 B7

File:TW〇〇28D3 re, 五、發明説明(艾) 404136 區塊分割單元,用以將輸入之影像分割成8X8的影像 區塊;JND計算單元,用以根據上述之影像,計算每一個 圖素的JND函數値,以形成一個JND圖表(Profile);失真 遮敝單兀(Distortion Masking Unit),接收上述之影像區塊 及JND圖表,用以對影像區塊中每個圖素亮度値,朝此影 像區塊的亮度平均値作調整;以及區塊合成單元,接收上 述失真遮蔽單元的輸出,將影像區塊組合成新的影像,再 傳給以DCT爲基礎的影像編碼器進行壓縮及編碼(例如: iPEG ’ MPEG,H.263 ),以形成一位元串。其中此失真遮 蔽單元利用此JKD圖表,對影像區塊中每個圖素亮度値, 1¾¾亮度平均値作調整,可消除人類視覺系統之知覺冗 且此裝置設於影像編碼器之前,所以不必更改影像編 碼器的內部設定即可消除知覺冗餘。 根據本發明的另一目的,提出一種影像壓縮前處理方 法,其步驟簡述如下: •首先’將影像分割成8X8的影像區塊;再對影像區塊 中的每一圖素計算jND函數値,以形成一個JND圖表; 根據此JND圖表,對該些JND函數値求取加權(Weighted) 蔭ί數値;求取每個影像區塊的亮度平均値;根據這些亮度 平均値及加權函數値,對每個影像區塊中所有圖素亮度 値’朝影像區塊的亮度平均値作調整,並形成新的影像區 塊;最後將新的影像區塊加以組合成新的影像,以進行壓 縮及編碼。此方法藉由降低相鄰圖素亮度之對比(即亮度 値的差距縮小),同時可消減影像中之高頻部份,因而消File: TW〇〇28D3 re, V. Description of the invention (Ai) 404136 A block division unit is used to divide the input image into 8X8 image blocks; a JND calculation unit is used to calculate each image based on the above images The prime JND function 値 forms a JND chart (Profile); the distortion masking unit (Distortion Masking Unit) receives the above-mentioned image blocks and JND charts for the brightness of each pixel in the image block 値, Make adjustments to the brightness average of this image block; and a block synthesis unit that receives the output of the above-mentioned distortion masking unit, combines the image blocks into a new image, and sends it to a DCT-based image encoder for compression and Encoding (eg: iPEG 'MPEG, H.263) to form a bit string. The distortion masking unit uses this JKD chart to adjust the brightness of each pixel in the image block, and the average brightness of 1¾¾, which can eliminate the verbosity of the human visual system and the device is set in front of the image encoder, so there is no need to change it. The image encoder's internal settings eliminate perceptual redundancy. According to another object of the present invention, a method for pre-compressing an image is proposed, the steps of which are briefly described as follows: • First 'divide the image into 8 × 8 image blocks; then calculate the jND function for each pixel in the image block. To form a JND chart; according to this JND chart, obtain weighted (Weighted) numbers for the JND functions; obtain the average brightness of each image block; and according to these brightness averages and weighting functions, , Adjust the brightness of all pixels in each image block 値 'toward the average brightness of the image block, and form a new image block; finally, combine the new image blocks into a new image for compression And encoding. This method reduces the contrast of the brightness of adjacent pixels (that is, the difference in brightness 缩小 is reduced).

CNS)峨格(2i〇x^¥T (請先聞讀背面之注意事項再填寫本頁) 裝CNS) Ege (2i〇x ^ ¥ T (Please read the precautions on the back before filling this page)

、1T 經濟部中央標準局員工消費合作社印製, 1T Printed by the Consumer Cooperatives of the Central Bureau of Standards of the Ministry of Economic Affairs

File :TW0 0 2 8 D3 re, A7 B7 經濟部中央標準局員工消費合作社印製 五、發明説明(〇 減了上述之兩種知覺冗餘,消減壓縮編碼所需的位元數, 且在調整不同影像區塊的圖素亮度値時,求取了加權函數 値,可保持影像區塊組合後之品質。 爲讓本發明之上述目的、特徵、和優點能更明顯易懂, 下文特舉一較佳實施例,並配合所附圖式,作詳細說明如 下: 圖式之簡單說明: 第1圖繪示傳統以DCT爲基礎去除空間遮蔽效應所 造成的知覺冗餘之影像編碼器之方塊圖; 第2圖繪示依照本發明一較佳實施例的一種影像處理 裝置結構圖; 第3圖繪不乃第2圖中失真遮敝單兀之結構圖; 第4圖繪示乃第3圖中調整單元之結構圖; 第5圖繪示乃以第4圖的結構來調整圖素亮度値之示 意圖; .第6A〜11A圖依序繪示傳統JPEG及H.263之影像圖; 以及 第6B〜11B圖依序繪不相對於第6A〜11A圖中影像經 本發明處理後的JNDM影像圖。 標號說明= 11 : DCT處理單元 15 :量化矩陣單元 21 :區塊分割單元 25 :失真遮蔽單元 13 :量化單元 Π:可變長度編碼單元 23 : JND計算單元 27 :區塊合成單元 (請先閲讀背面之注意事項再填寫本頁) 裝File: TW0 0 2 8 D3 re, A7 B7 Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs 5. Description of the invention (0 reduces the above two types of perceived redundancy, reduces the number of bits required for compression coding, and is adjusting When the pixel brightness of different image blocks is 値, a weighting function 求 is obtained to maintain the quality of the combined image blocks. In order to make the above-mentioned objects, features, and advantages of the present invention more obvious and easier to understand, one of the following is specifically enumerated. The preferred embodiment and the accompanying drawings are described in detail as follows: Brief description of the drawings: Figure 1 shows a block diagram of a traditional image encoder based on the DCT to remove the perceptual redundancy caused by the spatial shadowing effect. Figure 2 is a structural diagram of an image processing device according to a preferred embodiment of the present invention; Figure 3 is a structural diagram of a distortion masking unit in Figure 2; Figure 4 is a diagram of Figure 3 Structure diagram of the middle adjustment unit; Figure 5 shows the schematic diagram of adjusting the brightness of pixels with the structure of Figure 4; Figures 6A ~ 11A show the traditional JPEG and H.263 image maps in sequence; and 6B ~ 11B are not drawn in sequence relative to 6A ~ 11A The JNDM image of the Chinese image processed by the present invention. Symbol description = 11: DCT processing unit 15: quantization matrix unit 21: block segmentation unit 25: distortion masking unit 13: quantization unit Π: variable length coding unit 23: JND calculation Unit 27: Block Synthesis Unit (please read the precautions on the back before filling this page)

、1T Λ泉 本紙張尺度適用中國國家標準(CNS ) Α4規格(210Χ297公釐) le:TW0028D3 revl A7 B7 五、發明説明(7 ) 404136 29:DCT影像編碼器 31 33 :加權矩陣單元 35 41 :比較單元 43 45 :減法單元 47 49 :極小單元 平均値計算單元 調整單元 加法單元 極大單元 經濟部中央標準局員工消費合作社印製 較佳實施例 請參照第2圖,其繪示依照本發明一較佳實施例的一 種影像壓縮處理裝置結構圖。此一影像壓縮處理裝置包 括:區塊分割單元21,用以將輸入之影像畫面(Frame)F分 割成數個不相重疊的(Ncmoverlapping)8X8影像區塊IB; JND計算單元23,用以根據上述之影像畫面F,計算每一 個圖素的JND函數値,此處以JNDj⑴代表第j個影像區 塊IB中第i(i=l〜64)個圖素的JND函數値,以構成一個JND 圖表J ;失真遮蔽單元25,接收上述之影像區塊IB及JND 圖表J,用以對影像中每一個圖素亮度値做調整,並輸出 影像區塊以及區塊合成單元27,接收所有的上述 之影像區塊,加以組合成新的影像畫面Fjndm,再傳 給DCT影像編碼器29進行壓縮及編碼,產生影像位元串 BS。 請參照第3圖,其繪示第2圖中失真遮蔽單元25之結 構圖。其結構包括:平均値計算單元31,用以對每個影像 區塊ιέ求取亮度平均値,此處以巧代表第個影像區塊 IB的亮度平均値;加權矩陣單元(Weighted Matrix Unit) (請先閱讀背面之注意事項再填寫本頁) 裝. 訂 '.4. 本紙張尺度適用中國國家標準(CNS ) A4規格(210X 297公釐)、 1T Λ The size of this paper is applicable to the Chinese National Standard (CNS) A4 specification (210 × 297 mm) le: TW0028D3 revl A7 B7 V. Description of the invention (7) 404136 29: DCT image encoder 31 33: Weighting matrix unit 35 41: Comparison unit 43 45: Subtraction unit 47 49: Extremely small unit Average 値 Calculation unit Adjustment unit Addition unit Extremely large unit Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economics A preferred embodiment Please refer to FIG. 2, which shows a comparison according to the invention Structure of an image compression processing device of the preferred embodiment. This image compression processing device includes: a block division unit 21 for dividing the input image frame (Frame) F into a plurality of non-overlapping (Ncmoverlapping) 8X8 image blocks IB; a JND calculation unit 23 for performing For the image frame F, calculate the JND function for each pixel. Here, JNDj⑴ is used to represent the JND function i of the i-th (i = l ~ 64) pixels in the j-th image block IB to form a JND chart J The distortion masking unit 25 receives the above-mentioned image block IB and JND chart J, and is used to adjust the brightness of each pixel in the image, and outputs an image block and a block synthesis unit 27 to receive all the above-mentioned images The blocks are combined into a new image frame Fjndm, which is then transmitted to the DCT image encoder 29 for compression and encoding to generate an image bit string BS. Please refer to FIG. 3, which shows the structure of the distortion masking unit 25 in FIG. Its structure includes: an average 値 calculation unit 31 for obtaining a brightness average 値 for each image block, where the brightness average 値 of the first image block IB is represented here; a weighted matrix unit (please refer to Please read the notes on the back before filling this page.) Binding. Order '.4. This paper size is applicable to China National Standard (CNS) A4 (210X 297 mm)

File :TW0 02 8 D3 revl A/ B7 五、發明説明(s ) 33,根據上述之JND圖表J,用以對每個圖素的JND函數 値作加權計算,此處以JND7(〇代表第j個影像區塊IB中 的第i個圖素經加權後的JND函數値;以及調整單元35, 用以依照亮度平均値朽以及加權函數値_『(〇,來調整影 像中每一個圖素亮度値乃(〇,調整後的圖素亮度値以 /fDM(〇表示,如公式(2)、(3)及(4)所示。 \msx{A, Ρ}\ if Pj(J) > Pj, [min{^(, Pj\ otherwise, (2)File: TW0 02 8 D3 revl A / B7 5. Invention Description (s) 33. According to the JND chart J above, it is used to weight the JND function 每个 for each pixel. Here, JND7 (0 represents the jth A weighted JND function i of the i-th pixel in the image block IB; and an adjusting unit 35 for adjusting the brightness of each pixel in the image according to the brightness average decay and the weighting function 値 "(〇, (0, the adjusted pixel brightness 値 is represented by / fDM (0, as shown in formulas (2), (3), and (4). \ Msx {A, Ρ} \ if Pj (J) > Pj , [min {^ (, Pj \ otherwise, (2)

AA

Pj{i) + B (3) ----------^裝-I (請先閱讀背面之注意事項再填寫本頁)Pj (i) + B (3) ---------- ^ 装 -I (Please read the precautions on the back before filling this page)

B |- 1, iiPj(i) > Pj, [+ 1, otherwise, (4) 其中 JNDf.JNDjQxWMQ,WM(i) (i=l〜64)代表第 i 個JND函數値的加權値,此64個加權値可構成一種矩陣 形式,稱爲加權矩陣,如表1所示。 表1 0.4 0.8 0.4 0.8 0.4 0.8 0.4 0.8 0.8 1 1 1 1 1 1 0.4 0.4 1 1 1 1 1 1 0.8 0.8 1 1 1 1 1 1 0.4 0.4 1 1 1 1 1 1 0.8 0.8 1 1 1 1 1 1 0.4 0.4 1 1 1 1 1 1 0.8 0.8 0.4 0.8 0.4 0.8 0.4 0.8 0.4 其中影像晝面F分割後,位於每個影像區塊IB四個 邊界上的圖素,其加權値(係0.4與0.8兩種値交叉分佈) 本紙張尺度適用中國國家標準(CNS ) Α4規格(210X297公釐)B |-1, iiPj (i) > Pj, [+ 1, otherwise, (4) where JNDf.JNDjQxWMQ, WM (i) (i = l ~ 64) represents the weighted 値 of the i-th JND function 値, where The 64 weighted 値 can form a matrix form, called a weighting matrix, as shown in Table 1. Table 1 0.4 0.8 0.4 0.8 0.4 0.8 0.4 0.8 0.8 1 1 1 1 1 1 1 0.4 0.4 1 1 1 1 1 1 0.8 0.8 1 1 1 1 1 1 0.4 0.4 1 1 1 1 1 1 0.8 0.8 1 1 1 1 1 1 0.4 0.4 1 1 1 1 1 0.8 0.8 0.4 0.8 0.8 0.4 0.8 0.4 0.8 0.4 Among them, the pixels located on the four boundaries of each image block IB after F segmentation of the daytime image are weighted by 値 (both 0.4 and 0.8) Cross-distribution) This paper size applies to China National Standard (CNS) Α4 specification (210X297 mm)

、1T 經濟部中央標準局員工消費合作社印製, 1T Printed by the Consumer Cooperatives of the Central Bureau of Standards of the Ministry of Economic Affairs

File :TW0028D3 revl A7 B7 經濟部中央標準局員工消費合作社印製 五、發明説明(1 ^~~4ϋ4ΐ3ί 、…、息 取得比其它部份的加權値(1.0)還低,因而可減小邊界圖 素的JND臨界値,圖素亮度値乃(〇的調整便會縮小’當8 X8影像區塊IB組合成新的影像畫面F時,可降低重組 影像產生的人爲區塊效應(Blocking Effect)。 請參照第4圖,其繪示第3圖中調整單元之結構圖。 其結構包括:比較單元41,用以對每一個圖素亮度値 乃⑺與亮度平均値Λ作比較:加法單元43,用以對經比 較單元41比較後,小於平均値巧的圖素亮度値乃(0 ’加 上一個加權函數値JNE>7(〇 ;減法單元45,用以對經比較 單元比較後,大於平均値Λ的圖素亮度値乃(0 ’減去 —個加權函數値JND;T(〇 ;極大單元47,用以接收減法單 元45的輸出値,與亮度平均値巧作比較,而取其較大値 爲新的圖素亮度値ΡΓΜ(0 ;以及極小單元49,用以接收 加法單元43的輸出値,與亮度平均値巧作比較,而取其 較小値爲新的圖素亮度値 •請參照第5圖,其繪示依照本發明較佳實施例調整 單元調整圖素亮度値之示意圖。白色圈圏代表未調整的 圖素亮度値乃(〇,黑色圈圈代表調整後的圖素亮度値 PfDM(0,而雙箭頭長度表示圖素亮度値乃⑺可進行調整之 大小’也就是該圖素的加權函數値IND%)。由第5圖可明 顯看出,調整後的圖素亮度値黑色圈圈所示)較未 調整的圖素亮度値ρχ〇(白色圈圏所示)更集中於影像區塊 ΙΒ的亮度平均値Λ(中間粗黑線所示),而且每一個調整 後的圖素亮度値if’DM (0與原來的圖素亮度値乃(〇的差距絕 本紙張尺度適用中國國家標準(CNS ) Μ規格(2丨0>< 297公釐 I-----,--裝------^訂 ί-----^ 戒 (請先閱讀背面之注意事項再填寫本頁)File: TW0028D3 revl A7 B7 Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs 5. Description of the invention (1 ^ ~~ 4ϋ4ΐ3ί, ..., the gain of information is lower than the weighted 値 (1.0) of other parts, so the boundary map can be reduced The threshold of the prime JND is 値, and the brightness of the pixel will be adjusted. When the 8 X8 image block IB is combined into a new image frame F, the artificial blocking effect caused by the recombined image can be reduced. Please refer to Fig. 4, which shows the structural diagram of the adjustment unit in Fig. 3. Its structure includes: a comparison unit 41 for comparing the brightness of each pixel 値 値 and the average brightness 値 Λ: addition unit 43 Is used to compare the pixel brightness smaller than the mean value after comparison by the comparison unit 41 (0 ′ plus a weighting function 値 JNE> 7 (〇; subtraction unit 45), which is used to compare The pixel brightness 値 of the average 値 Λ is (0 'minus a weighting function 値 JND; T (0; a maximum unit 47 for receiving the output 値 of the subtraction unit 45, which is compared with the brightness average 値, and which is Larger is the new pixel brightness, ρΓΜ (0; and A small unit 49 is used to receive the output 加 of the adding unit 43 and compare it with the brightness average 値, and take the smaller 値 as the new pixel brightness 値 Please refer to FIG. 5, which shows that it is better according to the present invention. Schematic diagram for adjusting the pixel brightness 値 by the adjustment unit in the embodiment. The white circle 圏 represents the unadjusted pixel brightness 値 is (0, the black circle represents the adjusted pixel brightness 値 PfDM (0, and the double arrow length represents the pixel brightness値 is the size that can be adjusted ', which is the weighting function of the pixel (IND%). From Figure 5, it can be clearly seen that the adjusted pixel brightness (shown by the black circle) is less than the unadjusted pixel. The brightness 値 ρχ〇 (shown by the white circle) is more concentrated on the average brightness 値 Λ (shown by the thick black line in the middle) of the image block IB, and each adjusted pixel brightness 値 if'DM (0 and the original The pixel brightness is equal to (0), the absolute paper size is applicable to the Chinese National Standard (CNS) M specifications (2 丨 0 > < 297 mm I -----,-installation ------ ^ order ί ----- ^ Caution (Please read the notes on the back before filling in this page)

File :TW0 0 2 8 D3 re, A7 B7 五、發明説明(I。) 404136對値必不大於鐘,如公式⑺所示。因爲喊〇値必 不大於腳⑹値,而根據_ _値的定義,公式⑺ 表示經過本發__亮度_整後,影像品質的改變 是人類視覺系統所不可察覺的。 |^DM(〇 - ΡΛή\ (0· (5) 經濟部中央標準局員工消費合作社印製 請參照第6A〜11A圖及第6b〜Ub圖。其中,第6A〜8A 圖分別代表飛機、狒狒、全家福之JPEG影像圖;第9A〜11A 圖分別代表虛擬動物、母女、播報員之H 263影像圖;第 6B〜11B圖分別代表前述jpEG影像及h.263影像經本發明 處理後的JNDM影像圖。 並請同時參照表2及表3,分別將利用本發明之影像 與傳統JPEG影像及H.263影像中所需之位元數列表比較。 由表2及表3可知,對不同的JPEg影像及H 263影像作 壓縮/編碼處理,所得到的JNDM影像與原來的影像作比 較’可達到9.27%〜14.49%位元數消減率(Bit Reducing Ratio)’且不影響影像的品質。在第从〜丨1A圖與第6B~1 IB 圖所示之影像圖中’可發現經本發明處理後之JNDM影像 圖與原本之JPEG影像圖以及H.263影像圖在人類之視覺 效果上幾乎分別不出來,亦即其效果幾乎是相同的,但卻 節省了不少的儲存位元比率。 本紙張尺度適用中國國家標準(CNS ) A4規格(210X297公楚) (請先閲讀背面之注意事項再填寫本頁) .絮· -V. ’.4File: TW0 0 2 8 D3 re, A7 B7 V. Description of the invention (I.) 404136 The confrontation must not be greater than the clock, as shown in formula ⑺. Because shouting 0 値 must not be larger than the foot 根据, and according to the definition of _ _⑺, the formula ⑺ indicates that the change in image quality after the present __brightness_ is invisible to the human visual system. | ^ DM (〇- ΡΛή \ (0 · (5) Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs, please refer to Figures 6A ~ 11A and Figures 6b ~ Ub. Among them, Figures 6A ~ 8A represent aircraft and baboons, respectively , JPEG image maps of family portraits; Figures 9A-11A represent the H 263 image maps of virtual animals, mother and daughter, and broadcasters; Figures 6B-11B represent the aforementioned jpEG images and h.263 images processed by the present invention. Please refer to Table 2 and Table 3 at the same time, and compare the list of bits required in the image using the present invention with the traditional JPEG image and H.263 image, respectively. From Table 2 and Table 3, we can know that for different JPEg The image and H 263 image are compressed / encoded. Compared with the original image, the obtained JNDM image is 'up to 9.27% ~ 14.49% Bit Reducing Ratio' without affecting the quality of the image. From the image diagrams shown in ~ 丨 1A and 6B ~ 1IB, it can be found that the processed JNDM image, the original JPEG image, and the H.263 image are almost different in human visual effects. Out, meaning the effect is almost the same, but Save a lot of storage bit rate. This paper scales applicable Chinese National Standard (CNS) A4 size (210X297 public Chu) (Please read the notes and then fill in the back of this page). Xu · -V. '.4

File:TW0028D3一revl B7 五、發明説明(")404136 表2 JPEG影像 原來影像 JNDM影像 位元數消減 率(%) 位元數 位元數 飛機 6161 5460 11.38 狒狒 9457 8572 9.36 全家福 6863 6158 10.27 J 1 —.. 表3 -------- H.263影像 原來影像 JNDM影像 位元數消減 位元數 位元數 率(%) ... 虛擬動物 6244 5339 14.49 母女 15766 13913 11.75 播報員 8680 7875 9.27 因此,本發明具有下列幾項優點: 翅濟部中央標準局員工消費合作社印製 (1) 由於本發明之影像壓縮前處理裝置係安裝於影像編 碼器之前,對影像先作圖素亮度値之調整,再將結果傳給 影像編碼器進行壓縮及編碼’因此,不必隨影像編碼器不 同而調整影像編碼器中參數的設定方式,可簡化系統之操 作過程。 (2) 利用JND函數値對每一個圖素的亮度値,朝影像區 塊亮度平均値作調整,使得調整後的圖素亮度値更集中於 亮度平均値(通常爲低頻部份),可去除影像中之高頻訊號 部份,消減影像壓縮/編碼後的位元數。 本紙張尺度顧t @ S家樟準(CNS ) A4規格(File: TW0028D3_revl B7 V. Explanation of the invention (") 404136 Table 2 JPEG image original image JNDM image Bit reduction rate (%) Bit number Bit number Plane 6161 5460 11.38 Baboon 9457 8572 9.36 Family portrait 6863 6158 10.27 J 1 — .. Table 3 -------- H.263 original image JNDM image bit number subtraction bit number bit rate (%) ... virtual animal 6244 5339 14.49 mother and daughter 15766 13913 11.75 broadcaster 8680 7875 9.27 Therefore, the present invention has the following advantages: Printed by the Consumer Cooperative of the Central Bureau of Standards of the Ministry of Economic Affairs (1) Because the image compression pre-processing device of the present invention is installed before the image encoder, the pixel brightness of the image is first After the adjustment, the result is passed to the image encoder for compression and encoding. Therefore, it is not necessary to adjust the parameter setting method of the image encoder with different image encoders, which can simplify the operation process of the system. (2) Use the JND function 値 to adjust the brightness 每 of each pixel toward the brightness average 影像 of the image block, so that the adjusted pixel brightness 値 is more concentrated on the brightness average 値 (usually the low frequency part), which can be removed The high-frequency signal part of the image reduces the number of bits after image compression / encoding. Specifications of this paper Gu t @ S 家 张 准 (CNS) A4 Specification (

File :TW0028D3 rev1 A/ ___~___B7___ 五、發明説明(π )404136 (3)利用JND技術’在空間區域中對每一個圖素的亮度 値,朝影像區塊亮度平均値作調整,且調整之大小不超過 圖素的JND函數値’如公式⑴所示,jND函數値係考慮 對比遮蔽與空間遮蔽效應較顯著者,因而,可同時降低對 比遮蔽效應所相關的知覺冗餘,在不影響影像的品質前提 下’比習知技術更進一步縮減了影像壓縮/編碼所需的位 元數。 綜上所述,雖然本發明已以一較佳實施例揭露如上, 然其並非用以限定本發明,任何熟習此技藝者,在不脫離 本發明之精神和範圍內,當可作各種更動與潤飾,因此本 發明之保護範圍當視後附之申請專利範圍所界定者爲準。 (請先閱讀背面之注意事項再填寫本頁) 裝 訂 經濟部中央標準局員工消費合作社印製File: TW0028D3 rev1 A / ___ ~ ___ B7___ V. Description of the invention (π) 404136 (3) Use the JND technology to adjust the brightness of each pixel in the spatial area, and adjust it toward the average brightness of the image block, and adjust the The JND function whose size does not exceed the pixel (as shown in the formula), the jND function does not consider those with significant contrast and spatial shadow effects. Therefore, it can reduce the perceptual redundancy related to the contrast shadow effect at the same time, without affecting the image. Under the premise of quality, the number of bits required for image compression / encoding is further reduced than the conventional technology. In summary, although the present invention has been disclosed as above with a preferred embodiment, it is not intended to limit the present invention. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Retouching, so the scope of protection of the present invention shall be determined by the scope of the attached patent application. (Please read the notes on the back before filling out this page) Binding Printed by the Staff Consumer Cooperative of the Central Standards Bureau of the Ministry of Economic Affairs

Claims (2)

經濟部中央標準局貞工消費合作社印製 A8 File :TW0 0 2 8 D3_revl 〇8 ~ D8 六、申請專利範圍 1. 一種影像壓縮前處理方法,用以對一第一影像進行影 像壓縮前處理,該第一影像包括複數個圖素,其步驟 包括: 將該第一影像分割成複數個箄一影像區塊; 根據該第一影像,計算該_些圖素@複數個恰可察覺失 真(Just-Noticeable-Distortion ; JND)函數値; 根據該些JND函數値,以各該些箏一影像區塊的一亮 度平均値爲依據,調整各該些第一影像區塊中該些圖 素的複數個第一亮度値,並獲得複數個第二影像區塊; 以及 將該些第二影像區塊,組合成一第二影像。 2. 如申請專利範圍第1項所述之影像壓縮前處理方法, 係一利用離散式餘弦轉換(Discrete Cosine Transform ; DCT)進行影像編碼之影像壓縮前處理方法。 3. 如申請專利範圍第1項所述之影像壓縮前處理方法, 其中該些第一及第二影像區塊係不相重疊的影像區 塊。 — — — 4. 如申請專利範圍第1項所述之影像壓縮前處理方法, 其中該JND函數値係一定義在空間區域上的函數値, 且取該些JND函數値對應之圖素的一模擬空間遮蔽效 應的®數ik及一 i擬對比遮蔽效應的函數値中之最大 値。 5. 如申請專利範園第4項所述之影像壓縮前處理方法, (請先閱讀背面之注意事項再填寫本頁)Printed by A8 File: TW0 0 2 8 D3_revl 〇8 ~ D8 of the Central Standards Bureau of the Ministry of Economic Affairs 6. Application for patent scope 1. An image compression pre-processing method for pre-compressing a first image. The first image includes a plurality of pixels, and the steps include: dividing the first image into a plurality of first image blocks; and based on the first image, calculating the pixels @ plural just-perceivable distortion (Just -Noticeable-Distortion; JND) function 値; according to the JND functions 値, adjust the complex numbers of the pixels in each of the first image blocks based on a brightness average 値 of each of the image blocks And a plurality of second image blocks; and combining the second image blocks into a second image. 2. The image compression pre-processing method described in item 1 of the scope of the patent application is an image compression pre-processing method that uses discrete cosine transform (DCT) for image coding. 3. The image compression pre-processing method as described in item 1 of the scope of the patent application, wherein the first and second image blocks are non-overlapping image blocks. — — — 4. The image pre-compression processing method described in item 1 of the scope of the patent application, wherein the JND function 値 is a function 定义 defined on a spatial region, and one of the pixels corresponding to the JND functions 取 is taken. The maximum number of functions ® and i i i i i i i i i i i i i i i i i i 拟 i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i i had had had since since since since when if if if i if if if if if since since since been the case since then since when since then since when since then if any-since the number i and i have been the same 5. For the image compression pre-processing method described in item 4 of the patent application park, (please read the precautions on the back before filling this page) 本紙張尺度適用中國國家標準(CNS ) A4規格U10X297公釐) 經濟部中央標準局員工消費合作社印製 A8 B8 File : TW0 0 2 8 D3 revl C8 "" D8 六、申請專利範圍404i36 其中該模擬空間遮蔽效應的函數値係得自各該些圖素 '附近的一#景亮度平均値與一亮度變化平均値/其3 該一模擬對比遮蔽效應的函數値係得自各該些圖素附 近的該背景亮度平均値_。 6. 如申請專利範圍第4項所述之影像壓縮前處理方法, 其中該JND函數値代表各該些第一亮度値變化的一臨 界値。 7. 如申請專利範圔第4項所述之影像壓縮前處理方法, 其中根據JND函數値以調整該些第一亮度値之步驟包 括: 對各該些第一影像區塊各求取該亮度平均値; 對該些JND函數値求取對應的加權函數値;以及 根據各該些亮度平均値及該些加權函數値,調整各該 些第一影像中的該些第一亮度値,以獲得對應的 第二亮度値,並形成各該些第二影像區塊。 8. 如申請專利範圍第7項所述之影像壓縮前處理方法, 其中各該些加權函數値係由各該些JND函數値乘上一 加權値所產生。 9. 如申請專利範圍第8項所述之影像壓縮前處理方法’ 其中之加權値對於同一第一影像區塊的該些周素係爲 一固定値。 10. 如申請專利範圍第8項所述之影像壓縮前處理方法’ 其中之加權値相對於該第一影像區塊四個邊界上的該 些圖素,係取爲比1小的兩相異値交叉分佈,而於該 (請先聞讀背面之注意事項再填寫本頁) .裝-- • 1C 1· ί I (n m^i i Hal 本紙張尺度適用中國國家標準(CNS ) A4現格(210X297公釐) File :TW0 0 2 8 D3 revl A8 Βδ C8 D8 申㈣I區麵 經濟部中央標準局員工消費合作社印製 它圖素之加權値則取爲1.0。 11. 如申請專利範圍第10項所述之影像壓縮前處理方法, 其中之加權値相對於該第一影像區塊四個邊界上的該 些圖素係取爲0.4與0.8兩種値交叉分佈,而於該 筹二的其它圖素之加權値則取爲1.0。 12. 如申請專利範圍第7項所述之影像壓縮前處理方法, 其中根據各該些亮度平均値及該些加權函數値,調整 該些第一亮度値之步驟包括: ^ 對各該些第一影像區塊中的該些第一亮度値與各該些 亮度平均値作較; 根據該比較結果,對小於各該些亮度平均値的該些第 一亮度値,加上該些加權函數値,以獲得複數個第三 亮虞樓^且對大於各te些亮度平均値的該些第一亮度 値,減去該些加權·函數以獲得複數個第四亮度値; . 、 .一 、 以及 對該些第三亮度値,與各該些亮度平均値作比較,取 其中較小値作爲該第二亮度値,''且對該些第四亮度値, 與各該些亮度平均値作比較,取其中較大値作爲該第 二亮度値。 ' 13. 如申請專利範圍第7項所述之影像壓縮前處理方法, 其中該些圖素的該些第二亮度値與該些第一亮度値的 差距絕對値不大於該些JND函數値。 14_如申請專利範圍第7填所述之影像壓縮前處理方法, 其中該些第一影像區塊中調整後的各該些第二亮度値 (請先閱讀背面之注意事項再填寫本頁) 裝 卜訂 J 本紙張尺度適用中國國家標準(CNS ) A4規格(210X297公釐) 〜----- .le : TW0028D3 rev: A8 B8 C8 D8 經濟部中央標準局員工消費合作社印製 六、申請專利範圍404136 。 19. 如申請專利範圍第π項所述之影像壓縮方法,其中之 加權値相對於該第一影像區塊四個邊界上的該些圖 素,係取爲0.4翁—0.8兩種値交叉分佈,而於該第〜 '影像區塊的其它圖素之加權値則取爲1.0,用以~調整 該桌一影像區塊邊緣之該些第一売度値與該第二影像 的區塊效應。 20. 如申請專利範圍第15項所述之影像壓縮方法,其中調 整該些第一亮度値之步驟包括: 對各該些第一影像區塊中的該些第一亮度値與各該些 亮度平均値%較卜. 根據該比較結果,對小於各該些亮度平均値的該些第 二亮度加上該些加_權函數値二以獲得複數個第三 、亮度値,且對大於各該些亮度平均値的該些第二亮度 値,減去該些加權函數値,以獲得複數個第四亮度値; 苡及 對該些第三亮度値,與各該些亮度歪均値作比較,取 其中較小値作爲該第二亮度値,且對該些第四亮度値, 與各該些亮度平均値作比較,取其中較大慎作爲該第 二亮度値^ 一 21. ίπ申請專利範圍第15項所述之影像壓縮方法,其中該 些圖素的該些第二亮度値與該些第一亮度値的差距絕 對値不大於該些JND函數値。 22. 如申請專利範圍第15項所述之影像壓縮方法,其中各 mu > B- —-— Bn— In i nn mV · - I I (請先閔讀背面之注意事項再填寫本頁j ------- 本紙張尺度適用中國國家標準(CNS ) A4現格(210 X 297公釐) e r ABCD 經濟部中央標準局員工消費合作社印製 六、申請專利範圍 該些第一影像區塊中調整後的各該些第二亮度値與該 亮度平均値的差距絕對値小於各該些巢一亮度値與該 ~ —— _ 亮度平均値的差距絕對値。 23·—種影像壓縮裝置,用以處理一第一影像’並壓縮成 —第一位元串,該第一影像包括複''數個圖素,該影像 壓縮裝置包括: ~ 一分割單元,用以將該第一影像分割成複數個第一影 像區塊; 、 一計算單元,用以根據該第一影像,計算該些圖素的 複數個恰可察覺失真(JND)函數値,並形成一一圖 表加以輸出; 一遮蔽單元,接收該些第一影像區塊及該JND圓表, 用對該些第一影像區塊f的複數個第一亮度値,朝 各該些第一影~像區塊的一亮度平均値作調整,並輸出 複數個第二影像區塊;_以及 一合成單元,接收該些第二影像1^逸_丄加以組合成— 第二影像,再傳給一以離散餘弦轉換爲基礎的影像編 碼器進行壓縮及編碼,以產生該ft —位元串\ v _ 24·如申請專利範圍第23項所述之影像壓縮,其中該. 複數個第一及第二影像區塊係不相重疊的影像區塊。 25.如申請專利範圍第23項所述之影像壓縮裝置,其中 該JND函數値係一定義在空間區域上的函數値,且取 —模擬空間遮蔽效應的第一函數値及一模擬對比遮蔽 (請先閲讀背面之注意事項再填寫本頁) •裝--- 訂 J 本紙張尺度適用中國國家標準(CNS ) A4規格(210X297公釐) A8 B8 C8 D8 File :TW0 0 2 8 D3 re1 -;~~4041¾6 六、申請專利範圍 交女應的一第二函數中之最大値。 26. 如申請專初範圍第25項所述之影像壓縮裝置,其中該 第一函數値係得自各該些圖素附近的一背景亮度平均 1直與一亮度變化平均値。 27. 如串請專利範圍第25項所述之影像壓縮裝置,其中該 第二函數値係得自各該些圖素附近的該背景亮度平均 値。 28. 如,申請專利範圍第25項所述之影像壓縮裝置,其中該 JND函數値代表該些第一亮度値變化的一臨界値。 29. %申請專利範圍第23項所述之影像壓縮裝置,其中該 遮蔽單元包括: 平均値計算單元,用以對各該些第一影像區塊各求 取一亮度平均値; 一加權矩陣單元,用以根據該JND 函數値求取複數個加權函數値;以及 整覃'元,接收各該些亮度平均値以及該些加權函 數直,用以調整各該些第一影像區塊中的該些第一亮 '度値,以獲得複數個第二亮度値,並輸出各該些第二 影像區塊。 _This paper size applies to Chinese National Standard (CNS) A4 specification U10X297 mm. Printed by A8 B8 File: TW0 0 2 8 D3 revl C8 " " D8 of the Central Standards Bureau of the Ministry of Economic Affairs. The function of the simulated spatial shadowing effect is obtained from the average brightness of the scene near each of these pixels, and an average of the brightness change, and / or 3 The function of the simulated contrast shadowing effect is obtained from the vicinity of each of these pixels. The background brightness averages 値 _. 6. The image compression pre-processing method as described in item 4 of the scope of patent application, wherein the JND function 値 represents a threshold 値 for each of the first brightness changes. 7. The image compression pre-processing method as described in item 4 of the patent application, wherein the steps of adjusting the first brightness according to the JND function include: obtaining the brightness for each of the first image blocks. Average 値; obtain corresponding weighting functions 对该 for the JND functions 値; and adjust the first brightness 中 in each of the first images according to the brightness averages 値 and the weighting functions 値 to obtain Corresponding second brightness 値, and each of the second image blocks is formed. 8. The image compression pre-processing method as described in item 7 of the scope of patent application, wherein each of the weighting functions 値 is generated by multiplying each of the JND functions 上 by a weighting 値. 9. The image compression pre-processing method as described in item 8 of the scope of the patent application, wherein the weighting 値 is a fixed 该 for these weeks in the same first image block. 10. The image compression pre-processing method as described in item 8 of the scope of the patent application, wherein the weighting 値 is different from the pixels on the four boundaries of the first image block, which are smaller than 1.分布 Cross-distributed, and here (please read the notes on the back before filling out this page). Install-• 1C 1 · ί I (nm ^ ii Hal) This paper applies the Chinese National Standard (CNS) A4. 210X297 mm) File: TW0 0 2 8 D3 revl A8 Βδ C8 D8 The weight of the pixels printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs, District I, Area 1.0 is taken as 1.0. 11. If item 10 of the scope of patent application The image compression pre-processing method, wherein the weighting 値 relative to the pixels on the four boundaries of the first image block is taken as 0.4 and 0.8 値 cross-distribution, and other pictures in the second The weighting factor of the prime is taken as 1.0. 12. The image pre-compression processing method described in item 7 of the scope of the patent application, wherein the first brightness values are adjusted according to the brightness average values and the weighting functions. The steps include: ^ for each of the first image blocks The first brightness 値 is compared with each of the brightness averages 根据; according to the comparison result, the weighted functions 加上 are added to the first brightness 小于 smaller than the brightness averages 以 获得 to obtain a plurality of third brightness Yu Lou ^ and for the first brightness 大于 greater than the average brightness 各 of each te, subtract the weighting functions to obtain a plurality of fourth brightness 値;., .1, and the third brightness 値, Compare with each of the brightness averages ,, and take the smaller 値 as the second brightness 値, and compare the fourth brightness 値 with each of the brightness averages 取, and take the larger 値 as the The second brightness 値. 13. As described in the image compression pre-processing method described in item 7 of the scope of patent application, wherein the difference between the second brightness 値 of the pixels and the first brightness 値 is definitely not greater than the Some JND functions 値. 14_ The image pre-compression processing method described in the seventh fill of the patent application scope, wherein the adjusted second brightness in the first image block 値 (Please read the precautions on the back first (Fill in this page again) Binding J Paper Size Printed in Chinese National Standard (CNS) A4 specification (210X297 mm) ~ ----- .le: TW0028D3 rev: A8 B8 C8 D8 Printed by the Consumer Cooperatives of the Central Bureau of Standards of the Ministry of Economic Affairs 6. The scope of patent application is 404136. 19. Such as The image compression method described in the scope of the patent application No. π, wherein the weighting 値 relative to the pixels on the four boundaries of the first image block is taken as 0.4 W-0.8 two kinds of cross-distribution, and The weights of the other pixels of the first image block are taken as 1.0, and are used to adjust the block effects of the first images and the second image of the edge of the table image block. 20. The image compression method according to item 15 of the scope of patent application, wherein the step of adjusting the first brightness 値 includes: the first brightness 値 and the brightness in each of the first image blocks. The average 値% is relatively good. According to the comparison result, the second brightnesses that are less than each of the brightness averages are added to the weighting function 値 2 to obtain a plurality of third, brightness 値, and The second brightness 値 of the brightness average 値, subtracting the weighting functions 値 to obtain a plurality of fourth brightness 値; 苡 and comparing the third brightness 値 with each of the brightness distortions 値, Take the smaller 値 as the second brightness 値, and compare the fourth brightness 与 with the average brightness 値, and take the larger one as the second brightness 値 ^ 21. Application scope The image compression method according to item 15, wherein the differences between the second luminances 値 of the pixels and the first luminances 値 are absolutely not greater than the JND functions 値. 22. The image compression method described in item 15 of the scope of patent application, wherein each mu > B- —-— Bn— In i nn mV ·-II (Please read the notes on the back before filling in this page j- ------ This paper size is applicable to Chinese National Standard (CNS) A4 (210 X 297 mm) er ABCD Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs 6. The scope of patent application for these first image blocks After the adjustment, the difference between each of the second brightnesses 値 and the brightness average 値 is definitely smaller than the difference between each of the nested brightness 値 and the ~ _ _ brightness average 値. Absolutely 値. 23 · —an image compression device, It is used to process a first image 'and compress it into a first bit string. The first image includes a plurality of pixels. The image compression device includes: ~ a segmentation unit for segmenting the first image Into a plurality of first image blocks; and a calculation unit for calculating a plurality of precisely detectable distortion (JND) functions 该 of the pixels based on the first image, and forming a graph for output; a mask A unit for receiving the first image blocks and the J The ND circle table uses a plurality of first brightness values 对该 of the first image blocks f to adjust an average brightness value of each of the first image to image blocks, and outputs a plurality of second image blocks. ; And a synthesis unit that receives the second images 1 ^ yi_ 丄 and combines them into a second image, which is then compressed and encoded to an image encoder based on discrete cosine transform to generate the ft — Bit string \ v _ 24 · The image compression as described in item 23 of the patent application range, wherein the plurality of first and second image blocks are non-overlapping image blocks. 25. The image compression device according to item 23, wherein the JND function is a function defined on a spatial region, and takes the first function that simulates the effect of spatial shadowing and a simulated contrast shadowing (please read the precautions on the back first) (Fill in this page again) • Packing --- Order J This paper size is applicable to Chinese National Standards (CNS) A4 specifications (210X297 mm) A8 B8 C8 D8 File: TW0 0 2 8 D3 re1-; ~~ 4041¾6 6. Apply for a patent The largest in a second function of the range 26. The image compression device as described in item 25 of the application scope, wherein the first function 値 is obtained from a background brightness average 1 and a brightness change average 附近 near each of the pixels. 27. 如 串The image compression device described in item 25 of the patent scope, wherein the second function 値 is obtained from the background brightness average 附近 near each of the pixels. 28. For example, the image compression device described in item 25 of the patent scope Where the JND function 値 represents a critical value of the first brightness changes. 29. The image compression device described in item 23 of the scope of patent application, wherein the masking unit includes: an average chirp calculation unit for obtaining a brightness average chirp for each of the first image blocks; a weighting matrix unit To obtain a plurality of weighting functions 根据 according to the JND function 値; and to integrate Qin 'yuan to receive each of the brightness averages 値 and the weighting functions Straight to adjust the The first brightness levels are obtained to obtain a plurality of second brightness levels, and the second image blocks are output. _ 30.IcT申請專利範圍第29項所述之影像壓縮裝置,其中該 調整單元包括: =比較_單元,用以對各該些第一影像區塊中的該些圖 素亮度値與各該些亮度平均値 1 乍較; 一加法單元,用以對各該些第一影像區塊中,經該比 (請先閔讀背面之注意事項再填寫本頁) -裝 對該些JND 經濟部中央標準局員工消費合作社印製 本紙張尺度適用中國國家標準(CNS ) A4規格(210X297公釐) 經濟部中央標準局員工消費合作社印裝 File:TW0028D3_revl °° _;_I 4Π4136 沉_ 六、申請專利笔圍 與該亮度平均値的差距絕對値小於各該些第一亮度値 與該亮度平均値的差距絕對値。 15. —種影像壓縮方法,用以壓縮一第一影像,該第一影 像包括複數個圖素,其步驟包括: _ 將該第一影像¥割成複數個第一影像區塊; 根據該第一影像,計算該些圖素的複數個恰可察覺失 真(JND)函數値,以獲得一 JND圖表; 根據該JND圖表,對該些:TND函數値求取複數個加權 函數値·; ' 求取各該些第一影像區塊的一亮度平均値; * 、 - 根據各該些亮度平均値及該些加權函數値,對各該些 第一影像區塊中該每圖素的複數個第一亮度値,朝各 ή些第一影像區塊的一亮度平均値作調整,以獲得複 數個第二亮度値,並形成複數個第塊;以及 將該些第二影像區塊,組合成一第二影像,再利用該 第二影像進行壓^及編碼。 ' 16. 如申請專利範圍第15項所述之影像壓縮方法,其中該 複數個第一及第二影像區塊係不相重疊的矩形影像區 塊。 Π.如申請專利範圍第15項所述之影像壓縮方法,其中各 該些加權函數値係由各該些jND函數値乘上一加權値 所產生。 18_如申請專利範圍第17項所述之影像壓縮方法,其中之 加權値對於同一第一影像區塊的該些圖素係爲一固定 本纸張尺度適用中國國家標準(CNS ) A4規格(2丨〇X 297公釐) (請先閲讀背面之注意事項再填寫本頁)30. The image compression device described in item 29 of the IcT patent application range, wherein the adjustment unit includes: = comparison_ unit, for comparing the brightness of the pixels in each of the first image blocks with each of the Brightness average 値 1 comparison; an addition unit for each of the first image blocks, after the ratio (please read the precautions on the back before filling this page)-installed to the central of the JND Ministry of Economic Affairs Printed by the Bureau of Standards Consumer Cooperatives The paper size applies to the Chinese National Standard (CNS) A4 specification (210X297 mm) Printed by the Consumers' Cooperative of Central Standards Bureau of the Ministry of Economic Affairs File: TW0028D3_revl °° _; _I 4Π4136 Shen_ VI. Patent application The difference between the ambient brightness and the average brightness 値 is definitely smaller than the difference between each of the first brightness 値 and the brightness average 値. 15. An image compression method for compressing a first image, the first image including a plurality of pixels, the steps include: _ cutting the first image ¥ into a plurality of first image blocks; according to the first An image, calculate a plurality of precisely detectable distortion (JND) functions 该 of the pixels to obtain a JND chart; according to the JND chart, for these: TND function 値 find a plurality of weighting functions 値 ·; Take a brightness average 値 of each of the first image blocks; *,-according to the brightness averages 値 and the weighting functions 値, for the plurality of first pixels of each of the first image blocks, A brightness level, adjusting towards a brightness average level of each of the first image blocks to obtain a plurality of second brightness levels and forming a plurality of first blocks; and combining the second image blocks into a first Two images, and then use the second image to perform compression and encoding. '16. The image compression method according to item 15 of the scope of patent application, wherein the plurality of first and second image blocks are rectangular image blocks which do not overlap. Π. The image compression method according to item 15 of the scope of patent application, wherein each of the weighting functions 値 is generated by multiplying each of the jND functions 上 by a weighting 値. 18_ The image compression method as described in item 17 of the scope of patent application, wherein the weighting is a fixed paper size for the pixels of the same first image block and applies the Chinese National Standard (CNS) A4 specification ( 2 丨 〇X 297 mm) (Please read the notes on the back before filling this page) 404136 .e : TW002 8D3 revl A8 B8 C8 D8 六、申請專利範圍 較單元進行比較後,小於各該些亮度平均値的該些第 一亮度値,加上該些加權函數値; -· —減法單法,用以對各該些第一影像區塊中,經該比 較'單元進行比較後,大於各該些亮度平均値的該些第 —亮度値,減去該些加權祖數itJ_一 _>一 一極大單元,接收該減法單元的輸出,用以與各該些 亮度平均値作比較’取其中較大値作爲該第二亮度値; ... "" ' « ~ '以及 一極小單元,接收該加法單元的輸出,用以與各該些 亮度平均値作比較,取其中較小値作爲該第二亮度値。 31.茹申請專利範圍第23項所述之影像壓縮裝置,其中^ 些圖素的各該些第二亮度値與各該些第一亮度値的差 距1色對値不大於各該些JND函數値。 32_如申請專利範圍第23項所述之影像壓縮裝置,其中各 該些第一影像區塊中調整後的各該些第二亮度値與該 亮度平均値的差距絕對値小於各該些第一亮度値與該 亮度平均値的差距絕對値。 (請先閱讀背面之注意事項再填寫本頁 1'裝丨 '1T isj - I— fm 4i 經濟部中央標準局員工消費合作社印製 » ^ Jn- —HI— 本纸乐尺度適用中國國家標準(CNS ) A4規格(210X297公釐) I..... «ms tm «^i·—404136 .e: TW002 8D3 revl A8 B8 C8 D8 6. After comparing the patent application scope with the units, the first brightness 値 smaller than the respective brightness average 各 is added to the weighting functions 値; Method for comparing the first-brightness values greater than the average brightness value of each of the first image blocks after the comparison unit is subtracted from the weighted ancestors itJ_ 一 _ > A maximal unit that receives the output of the subtraction unit and compares it with each of the average brightness values' take the larger one as the second brightness value; ... " " '«~' and An extremely small unit receives the output of the addition unit for comparison with each of the brightness average 値, and takes the smaller 値 as the second brightness 値. 31. The image compression device described in item 23 of the scope of patent application, wherein the difference between each of the second brightness 値 of each pixel and each of the first brightness 1 is not greater than each of the JND functions. value. 32_ The image compression device according to item 23 of the scope of patent application, wherein the difference between the adjusted second luminances 値 and the average luminance 中 in each of the first image blocks is absolutely smaller than each of the first The difference between a brightness 値 and the average brightness 値 is absolutely 値. (Please read the precautions on the back before filling out this page. 1'Installation 丨 '1T isj-I— fm 4i Printed by the Consumer Cooperatives of the Central Standards Bureau of the Ministry of Economic Affairs »^ Jn- —HI— The paper scale is applicable to Chinese national standards ( CNS) A4 specification (210X297 mm) I ..... «ms tm« ^ i · —
TW88112042A 1999-07-16 1999-07-16 Process method preceding the image compression and the device itself TW404136B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW88112042A TW404136B (en) 1999-07-16 1999-07-16 Process method preceding the image compression and the device itself

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW88112042A TW404136B (en) 1999-07-16 1999-07-16 Process method preceding the image compression and the device itself

Publications (1)

Publication Number Publication Date
TW404136B true TW404136B (en) 2000-09-01

Family

ID=21641520

Family Applications (1)

Application Number Title Priority Date Filing Date
TW88112042A TW404136B (en) 1999-07-16 1999-07-16 Process method preceding the image compression and the device itself

Country Status (1)

Country Link
TW (1) TW404136B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7856149B2 (en) 2002-07-29 2010-12-21 Qualcomm Incorporated Digital image encoding

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7856149B2 (en) 2002-07-29 2010-12-21 Qualcomm Incorporated Digital image encoding
US8194987B2 (en) 2002-07-29 2012-06-05 Qualcomm Incorporated Digital image encoding

Similar Documents

Publication Publication Date Title
US9467704B2 (en) Adaptive ratio images in HDR image representation
EP3566203B1 (en) Perceptually preserving scene-referred contrasts and chromaticities
US9842385B2 (en) Display management for images with enhanced dynamic range
WO1999031887A2 (en) Method of frame by frame calculation of quantization matrices
EP2449526A1 (en) Zone-based tone mapping
CN108933933B (en) A video signal processing method and device
JP2018533860A (en) Method and apparatus for quantization in video encoding and decoding
CN103096079B (en) A kind of multi-view video rate control based on proper discernable distortion
CN107771392A (en) Real time content for high dynamic range images adaptively perceives quantizer
CN114467298B (en) Image signal conversion processing method and device and terminal equipment
CN116886917A (en) Gain map encoding method, decoding method, device, equipment and medium
Kumar et al. Performance of quality metrics for compressed medical images through mean opinion score prediction
EP4066505B1 (en) Rate-control-aware reshaping in hdr imaging
TW404136B (en) Process method preceding the image compression and the device itself
US7657110B2 (en) Image compression using a color visual model
JP4383760B2 (en) Digital watermark embedding apparatus, method thereof, and storage medium storing program for executing the method
CN118381937B (en) Self-adaptive QP (program guide) adjustment method, system and device for point cloud video
Li et al. High dynamic range image compression based on visual saliency
Chen et al. A robust video watermarking algorithm based on spatial domain
Zeng et al. Perceptual quality measure using JND model of the human visual system
CN116527902A (en) Image weighted quantization processing method, device, computer equipment and storage medium
Ma et al. Adaptive block-size transform based just-noticeable difference profile for images
Zhang et al. Region-of-interest image coding based on perceptually optimized bitplane realignment
CN121414637A (en) A high dynamic range image processing method, apparatus, device and storage medium
HK1221544B (en) Image processing for hdr images

Legal Events

Date Code Title Description
GD4A Issue of patent certificate for granted invention patent
MM4A Annulment or lapse of patent due to non-payment of fees