TWI508530B - Image compression methods, media data files, and decompression methods - Google Patents

Image compression methods, media data files, and decompression methods Download PDF

Info

Publication number
TWI508530B
TWI508530B TW100145855A TW100145855A TWI508530B TW I508530 B TWI508530 B TW I508530B TW 100145855 A TW100145855 A TW 100145855A TW 100145855 A TW100145855 A TW 100145855A TW I508530 B TWI508530 B TW I508530B
Authority
TW
Taiwan
Prior art keywords
frame
reconstructed
reduced
auxiliary information
generate
Prior art date
Application number
TW100145855A
Other languages
Chinese (zh)
Other versions
TW201316774A (en
Inventor
Sung Wen Wang
Chia Chiang Ho
Yi Shin Tung
Original Assignee
Mstar Semiconductor Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mstar Semiconductor Inc filed Critical Mstar Semiconductor Inc
Priority to US13/644,487 priority Critical patent/US20130089153A1/en
Publication of TW201316774A publication Critical patent/TW201316774A/en
Application granted granted Critical
Publication of TWI508530B publication Critical patent/TWI508530B/en

Links

Description

影像壓縮方法、媒體資料檔案與解壓縮方法Image compression method, media data file and decompression method

本發明係相關於影像壓縮方法、相關的媒體資料檔案與解壓縮方法,尤指可以適度地減少資料量、又可以維持影像品質的一種影像壓縮方法。The invention relates to an image compression method, a related media data file and a decompression method, and more particularly to an image compression method which can moderately reduce the amount of data and maintain image quality.

在移動式通訊裝置中,影音娛樂往往是不可或缺的一環。舉例來說,能夠隨時隨地在手機或是平板電腦上點選並播放電影,已經是大多使用者所希望或是已經習慣擁有的一種應用。In mobile communication devices, audio-visual entertainment is often an indispensable part. For example, being able to click and play a movie on a mobile phone or tablet anytime and anywhere is an application that most users want or are used to.

一般關於電影的媒體資料檔案,是為要在電視機或是投影機之大螢幕上呈現足夠細膩的影像,因此,媒體資料檔案中每個圖幀之解析度會相當的高,連帶的,媒體資料檔案便會相當的龐大。這樣的檔案要在移動式通訊裝置中播放的話,會有以下缺點。Generally speaking, the media data file of a movie is to present a sufficiently delicate image on the large screen of a television or a projector. Therefore, the resolution of each frame in the media data file will be quite high, with the media. The data file will be quite large. Such a file to be played in a mobile communication device has the following disadvantages.

1.畫面可能延遲。龐大的媒體資料檔案,需要有高速的通訊網路來維持影像播放之流暢。但是,移動式通訊裝置的通訊網路頻寬往往是受限的,因此很容易造成畫面停格延遲之事件的發生。1. The picture may be delayed. A huge media data file requires a high-speed communication network to maintain smooth video playback. However, the communication network bandwidth of the mobile communication device is often limited, so it is easy to cause an event of the screen stop delay.

2.需要較多的儲存硬體。在移動式通訊裝置中的儲存硬體是較一般裝置更為昂貴。要播放高解析度之影像,需要較多儲存媒體,這對移動式通訊裝置而言,是相當奢侈的。2. Need more storage hardware. Storage hardware in mobile communication devices is more expensive than conventional devices. To play high-resolution images, more storage media is needed, which is quite extravagant for mobile communication devices.

3.縮短移動式通訊裝置之操作時間。處理高解析度之影像,需要較多之運算,因此會消耗較多電能,因而影響移動式通訊裝置的操作時間。3. Shorten the operating time of the mobile communication device. Processing high-resolution images requires more computation, and therefore consumes more power, thus affecting the operating time of the mobile communication device.

為此,如何提供一種有效的影像壓縮方法,在縮小媒體資料檔案大小之餘,同時適切保留媒體資料檔案中每個圖幀的品質,是十分被需要的。To this end, how to provide an effective image compression method, in addition to reducing the size of the media data file, while properly retaining the quality of each frame in the media data file, is very much needed.

本發明之實施例提供一影像壓縮方法,包含有:分割一原始圖幀為一第一部份以及一第二部份;縮減該第二部份,以產生一縮減部份;以及,重構該第一部份以及該縮減部份,以產生一重構圖幀。該重構圖幀與該原始圖幀具有一樣的圖幀大小。An embodiment of the present invention provides an image compression method, including: dividing a original image frame into a first portion and a second portion; reducing the second portion to generate a reduced portion; and, reconstructing The first portion and the reduced portion are used to generate a reconstructed frame. The reconstructed picture frame has the same picture frame size as the original picture frame.

本發明之實施例提供一種媒體資料檔案之解壓縮方法,該解壓縮方法包含有:從該媒體資料檔案產生一重構圖幀以及一輔助資訊;依據該輔助資訊,找出該重構圖幀中的一第一部份以及一縮減部份;放大該縮減部份,以產生一模糊部份;以及,依據該輔助資訊,重構該第一部份以及該模糊部份,以產生一組合圖幀。An embodiment of the present invention provides a method for decompressing a media data file. The decompression method includes: generating a reconstructed image frame and an auxiliary information from the media data file; and finding one of the reconstructed image frames according to the auxiliary information. a first portion and a reduced portion; the reduced portion is enlarged to generate a blurred portion; and the first portion and the blurred portion are reconstructed according to the auxiliary information to generate a combined image frame.

本發明之實施例提供一種媒體資料檔案,其符合一特定檔案格式。該媒體資料檔案包含有複數第一物件以及複數第二物件。該等第一物件包含有複數重構圖幀的媒體資料。每一第二物件包含有一相對應重構圖幀之附屬資訊以及輔助資訊。該附屬資訊可用來對該媒體資料解壓縮,以產生該對應重構圖幀。該輔助資訊可以用來找出該對應重構圖幀中之一第一部份以及一縮減部份,以及紀錄有該縮減部分之一縮減比例。Embodiments of the present invention provide a media data archive that conforms to a particular file format. The media data file contains a plurality of first objects and a plurality of second objects. The first object includes media material having a plurality of reconstructed frame frames. Each of the second objects includes an auxiliary information corresponding to the reconstructed frame and auxiliary information. The affiliate information can be used to decompress the media data to generate the corresponding reconstructed map frame. The auxiliary information can be used to find a first part and a reduced part of the corresponding reconstructed picture frame, and record a reduction ratio of the reduced part.

本發明之實施例提供一種媒體資料檔案,包含有一影音檔案以以及詮釋資料。該影音檔案符合一特定檔案格式,經解碼後可得複數重構圖幀以及相對應之音訊。該詮釋資料包含有對應該等重構圖幀的輔助資訊。該輔助資訊可以用來找出一對應重構圖幀中之一第一部份以及一縮減部份,以及紀錄有該縮減部分之一縮減比例。Embodiments of the present invention provide a media data file that includes a video file and an interpretation data. The video file conforms to a specific file format, and after decoding, a plurality of reconstructed frame frames and corresponding audio information are obtained. The interpretation data contains auxiliary information corresponding to the reconstructed frame. The auxiliary information can be used to find a first part and a reduced part of a corresponding reconstructed picture frame, and record a reduction ratio of the reduced part.

為了對本發明之上述及其他方面有更佳的瞭解,下文特舉較佳實施例,並配合所附圖式,作詳細說明如下:In order to better understand the above and other aspects of the present invention, the preferred embodiments are described below, and in conjunction with the drawings, the detailed description is as follows:

在此說明書中,相同符號的元件或信號,為具有相同或是類似功能的元件或信號。業界具有通常能力者,可以依據本說明書教導,推知相同符號的元件或信號,其實施方式,可能不侷限於本說明書所揭露的,而是有許多不同的變化。In this specification, elements or signals of the same symbol are elements or signals having the same or similar functions. Those of ordinary skill in the art can deduce the elements or signals of the same symbols in accordance with the teachings of the present specification, and the embodiments thereof may not be limited to the one disclosed in the present specification, but may have many different variations.

第1圖顯示依據本發明所實施的影像壓縮方法10,適用於一媒體資料檔案,可運用於一編碼器(encoder)中。媒體資料檔案中具有數個用來依序播放的原始圖幀。每一原始圖幀經過影像壓縮方法10處理後,會產生一相對應的重構圖幀。重構圖幀由原始圖幀中的有興趣部分、無興趣部分以及輔助資訊所構成。本實施例中,有興趣部分定義為第一權重部分,無興趣部分為第二權重部分,其中第一權重高於第二權重,關於權重的選擇,舉例來說,如使用者的需求在於字幕清晰,可將字幕部份之權重提高,如使用者的需求在於圖幀中特定物體的清晰(例如人臉、人形或物體等),則可將對應部份之權重提高。例如,可將一定比例的畫面下部、或畫面中白色或高對比的部份作為判斷該部分為字幕的參考。FIG. 1 shows an image compression method 10 implemented in accordance with the present invention, which is applicable to a media data file and can be used in an encoder. The media data file has several original image frames for playing in sequence. After each original picture frame is processed by the image compression method 10, a corresponding reconstructed picture frame is generated. The reconstructed picture frame is composed of the interested part, the uninterested part and the auxiliary information in the original picture frame. In this embodiment, the interested portion is defined as the first weight portion, and the non-interest portion is the second weight portion, wherein the first weight is higher than the second weight, and regarding the weight selection, for example, the user's demand lies in the subtitle Clear, the weight of the subtitle part can be increased. If the user's needs are the clarity of a specific object in the frame (such as a face, a human figure or an object, etc.), the weight of the corresponding part can be increased. For example, a certain proportion of the lower part of the picture, or a white or high contrast part of the picture can be used as a reference for judging the part as a subtitle.

或者,定義一位於一定比例的畫面下部,顏色接近白色且其往垂直、水平或一定角度延伸的同色色塊為筆觸區域,並將筆觸區域及其周圍一定範圍定義為第一權重部份。於本實施例中,於決定權重之高低後,進行圖幀的重構,權重較低的第二權重部份中的像素被對應的縮減為較低解析度的影像,此處的縮減包含等比例縮減(scale down)以及非等比例的縮減。權重較高的第一權重部份,則不進行縮減操作,並被置放於該畫幀中未經處理時的原始位置上。縮減後的第二權重部份被重新安排於畫幀中,因第二權重部份經過縮減,經此處理後畫幀將產生不屬於第一權重部分亦不屬於第二權重部份的空白,此部份可填入黑/白作為底色來減少資訊量,亦可選用其他色階填入,亦可達成減少資訊量之目的。換言之,使用者有興趣部分的解析度維持不變,無興趣部分則解析度(相對於原始圖幀)減少。因此,以重構圖幀進行壓縮編碼所產生的新媒體資料檔案,可以小於原本的媒體資料檔案,達到縮小檔案大小之目的,同時又可以完整保有原始圖幀中有興趣部分。此外,亦可將有第一權重部分以及第二權重部份分別以不同壓縮率進行壓縮編碼,只要有興趣部分的壓縮率低於無興趣部分的壓縮率,使還原後的有興趣部分的解析度高於無興趣部分的解析度。Alternatively, defining a lower portion of the screen at a certain proportion, the color is close to white and the same color block extending vertically, horizontally or at an angle is a stroke area, and the stroke area and a certain range around it are defined as the first weight portion. In this embodiment, after determining the weight of the weight, the reconstruction of the frame is performed, and the pixels in the second weight portion with lower weight are correspondingly reduced to the lower resolution image, where the reduction includes Scale down and non-equal reduction. The first weight portion with a higher weight is not subjected to the reduction operation and is placed in the original position in the frame where the frame is not processed. The reduced second weight portion is rearranged in the frame, because the second weight portion is reduced, and after processing, the frame will generate a blank that does not belong to the first weight portion or the second weight portion. This part can be filled with black/white as the background color to reduce the amount of information. It can also be filled in with other color levels, and the purpose of reducing the amount of information can also be achieved. In other words, the resolution of the portion of interest of the user remains unchanged, and the resolution of the uninterested portion is reduced (relative to the original frame). Therefore, the new media data file generated by the compression coding of the reconstructed image frame can be smaller than the original media data file to achieve the purpose of reducing the file size, and at the same time, the interested part of the original picture frame can be completely preserved. In addition, the first weight portion and the second weight portion may be compression-encoded at different compression rates, respectively, as long as the compression ratio of the portion of interest is lower than the compression ratio of the non-interest portion, so that the restored portion of the interest is resolved. The degree is higher than the resolution of the uninterested part.

在步驟12中,影像壓縮方法10從一媒體資料檔案裡,接收一原始圖幀。第2圖例示了原始圖幀30,將用以解釋影像壓縮方法10中一些步驟所產生的結果。In step 12, the image compression method 10 receives an original picture frame from a media data file. Figure 2 illustrates an original picture frame 30 that will be used to explain the results of some of the steps in the image compression method 10.

步驟14分割原始圖幀30,以產生不相重疊的至少一有興趣部分以及至少一無興趣部分。這裡所謂有興趣與無興趣部分是相對的。簡單的說,有興趣部分大概指的是畫質不想被犧牲的部分;無興趣部分大概指的是畫質可以被犧牲的部分。舉例來說,每一原始圖幀可被定義為排列成矩陣的數個影像區塊(image block);每個影像區塊大致為一正方形,由16X16(或8X8)個影像畫素(image pixel)所構成;每一影像畫素具有對應紅綠藍三原色之數個畫素(pixel)。步驟14可以一個一個影像區塊來檢查。如果一個當下被檢查之影像區塊符合一個預設規則,那便可以把該影像區塊隸屬於有興趣部分;反之則把該影像區塊隸屬於無興趣部分。這預設規則可以由使用者任意定義。舉例來說,在一實施例中,只要位在一原始圖幀下方四分之一之內的影像區塊,因為其大致包含有字幕訊息,所以全部隸屬於有興趣部分;其他影像區塊都隸屬於無興趣部分。在另一實施例中,如果一影像區塊中的影像畫素之一對比關係超過一定程度,則該影像區塊隸屬於有興趣部分;反之,該影像區塊隸屬於無興趣部分。在另一實施例中,如果一影像區塊具有一筆觸(stroke)部分,則該影像區塊隸屬於有興趣部分;反之,該影像區塊隸屬於無興趣部分。Step 14 divides the original map frame 30 to produce at least one interesting portion and at least one non-interest portion that do not overlap. The so-called interest and non-interest parts are relative here. To put it simply, the part of interest is probably the part of the picture quality that you don't want to be sacrificed; the part that is not interested is probably the part of the picture quality that can be sacrificed. For example, each original picture frame can be defined as a plurality of image blocks arranged in a matrix; each image block is roughly a square, and is 16×16 (or 8×8) image pixels (image pixel) It is composed of; each image pixel has a number of pixels corresponding to the three primary colors of red, green and blue. Step 14 can be checked one by one. If a currently checked image block conforms to a preset rule, then the image block can be subordinate to the interested portion; otherwise, the image block is attached to the uninterested portion. This preset rule can be arbitrarily defined by the user. For example, in an embodiment, as long as the image block is located within a quarter of the original frame frame, because it generally contains the caption message, all belong to the interested part; other image blocks are Belongs to the non-interest part. In another embodiment, if one of the image pixels in an image block has a comparison relationship exceeding a certain degree, the image block belongs to the interested portion; otherwise, the image block belongs to the non-interest portion. In another embodiment, if an image block has a stroke portion, the image block belongs to the interested portion; otherwise, the image block belongs to the non-interest portion.

第3圖顯示原始圖幀30經過步驟14處理後,所可能產生的一些結果。步驟14可以產生原始位置資訊圖38。原始位置資訊圖38中,有記號區域對應到原始圖幀30中的太陽與字幕所在部分,因其對比較大或是包含有筆觸,所以在此實施例中,是隸屬有興趣部分。原始位置資訊圖38中空白區域對應的是無興趣部分。因此,原始圖幀30分割成有興趣部分32與34、以及無興趣部分36。第3圖中,圖幀33顯示由有興趣部分32與34所構成的一圖幀。Figure 3 shows some of the possible outcomes of the original image frame 30 after processing through step 14. Step 14 may generate a raw location information map 38. In the original location information map 38, the marked area corresponds to the portion of the original picture frame 30 where the sun and the subtitle are located. Since the contrast is large or contains a stroke, in this embodiment, the part of interest is attached. The blank area in the original location information map 38 corresponds to the non-interest part. Therefore, the original picture frame 30 is divided into interested parts 32 and 34, and no interest part 36. In Fig. 3, frame 33 shows a frame composed of interested portions 32 and 34.

接著,以一個縮減比例,步驟16縮減(scale down)無興趣部分36,以產生縮減部分36a,如同第4圖所示。可以推知的,縮減部分36a之解析度,將低於無興趣部分36。Next, at a reduced scale, step 16 scales down the non-interest portion 36 to produce a reduced portion 36a, as shown in FIG. It can be inferred that the resolution of the reduced portion 36a will be lower than the non-interest portion 36.

步驟18重構(recomposite)縮減部分36a以及有興趣部分32與34,以形成一重構圖幀(recomposition frame),其圖幀尺寸與原始圖幀30相同。第5A圖例示重構圖幀40,其保持有興趣部分32與34的原始位置與大小,而縮減部分36a則位於重構圖幀40中有興趣部分32與34沒有佔據的一區域內。Step 18 recomposes the reduced portion 36a and the interested portions 32 and 34 to form a reconstruct frame having the same frame size as the original frame 30. Figure 5A illustrates a reconstructed map frame 40 that maintains the original position and size of the portions of interest 32 and 34, while the reduced portion 36a is located in an area of the reconstructed map frame 40 in which the portions of interest 32 and 34 are not occupied.

在一實施例中,步驟18是先把有興趣部分32與34複製並放置於一空白的重構圖幀中,並保持有興趣部分32與34之相對位置與大小皆不變。然後,依據一規則,來決定縮減部分36a大致位於重構圖幀中之一放置位置。依據所決定的放置位置,把縮減部分36a放置在重構圖幀尚未被占據的空白區域中,以完成重構圖幀40。決定放置位置之規則可以依據使用者喜好而訂定。In one embodiment, step 18 is to first copy and place the interested portions 32 and 34 in a blank reconstructed map frame, and keep the relative positions and sizes of the interested portions 32 and 34 unchanged. Then, according to a rule, it is determined that the reduced portion 36a is located substantially at one of the placement positions in the reconstructed map frame. Based on the determined placement position, the reduced portion 36a is placed in a blank area in which the reconstructed map frame has not been occupied to complete the reconstructed map frame 40. The rules for determining the placement location can be tailored to the user's preferences.

舉例來說,縮減部分36a可以嘗試放在重構圖幀所有的可能放置位置,其中有的放置位置會使得被放置之縮減部分36a部分重疊到興趣部分32或34。如果一特定之放置位置使得被放置之縮減部分36a完全不重疊到興趣部分32與34,或是使得重疊部分為最小,那縮減部分36a就放在這特定之放置位置,來產生最後的重構圖幀。如同第5A圖所例示,最後完成之重構圖幀40,其中的縮減部分36a並沒有重疊到興趣部分32或34。For example, the reduced portion 36a may attempt to place all of the possible placement positions of the reconstructed map frame, with some of the placement locations causing the placed reduced portion 36a to partially overlap the portion of interest 32 or 34. If a particular placement position is such that the reduced portion 36a being placed does not overlap the interest portions 32 and 34 at all, or the overlap portion is minimized, then the reduced portion 36a is placed at the particular placement position to produce the final reconstructed map. frame. As illustrated in FIG. 5A, the reconstructed map frame 40 is completed, wherein the reduced portion 36a does not overlap the interesting portion 32 or 34.

在另一實施例中,被決定的放置位置,可以使得相對之重構圖幀,依照MPEG-4之壓縮標準壓縮後,所產生的圖幀資料之大小為最小。縮減部分36a的每一個可能的放置位置,會產生一對應的重構圖幀,經過MPEG-4之壓縮標準進行壓縮後,也會產生一相對應的圖幀資料,以及一相對應的資料大小。因此,只要找到最小資料大小,便可以以其對應的放置位置,來做為被決定的放置位置。In another embodiment, the determined placement position may be such that, relative to the reconstructed frame, the size of the generated frame data is minimized after compression according to the compression standard of MPEG-4. Each of the possible placement positions of the reduced portion 36a produces a corresponding reconstructed frame. After compression by the MPEG-4 compression standard, a corresponding frame data is generated, and a corresponding data size is generated. Therefore, as long as the minimum data size is found, the corresponding placement position can be used as the determined placement position.

在產生第5A圖之重構圖幀40的過程中,步驟18也會產生輔助資訊(side information)。第5B圖例示輔助資訊37,其包含有原始位置資訊圖38以及重構資訊42。如同先前所述,原始位置資訊圖38包含有興趣部分32或34以及無興趣部分36之原始位置資訊。重構資訊42則包含有縮減部分36a的縮減比例、以及縮減部分36a於重構圖幀40中的放置位置。輔助資訊37並不限於第5B圖中所舉例的內容,而可以包含有其他使用者所希望之資訊。關於有興趣部分的重構資訊42之實現,於利用MPEG格式進行壓縮時,可在包含有興趣部分的壓縮單元(例如一8x8像素或一16x16像素單元)中的輔助或自定區域增加一權重參數,以定義該壓縮單元是否屬於有興趣部分,該權重參數可為一二位元制的0或一1數值,有興趣部分的該權重參數被定義為1。當重構後的圖幀出現重疊數據時,權重參數為1的部份被移至非有興趣部分亦非無興趣部分36的空白部份,並以預先定義(例如由左至右、由上至下)的方式沿空白部分排列。如此一來,在還原圖幀時,當出現權重參數為1,但不存在像素數據的位置時,則依據該預先定義的排列方式,將像素數據還原至有興趣部分的原始位置。In the process of generating the reconstructed map frame 40 of Figure 5A, step 18 also generates side information. FIG. 5B illustrates auxiliary information 37 including an original location information map 38 and reconstruction information 42. As previously described, the home location information map 38 contains the original location information of the interested portion 32 or 34 and the non-interest portion 36. The reconstruction information 42 then includes a reduction ratio of the reduced portion 36a and a placement position of the reduced portion 36a in the reconstructed map frame 40. The auxiliary information 37 is not limited to the contents exemplified in FIG. 5B, but may include information desired by other users. Regarding the implementation of the reconstruction information 42 of the interested portion, when compressing using the MPEG format, a weight may be added to the auxiliary or custom region in the compression unit (for example, an 8x8 pixel or a 16x16 pixel unit) including the interested portion. A parameter to define whether the compression unit belongs to an interested part, and the weight parameter may be a two-digit 0 or a 1 value, and the weight parameter of the interested portion is defined as 1. When there is overlapping data in the reconstructed picture frame, the part with the weight parameter of 1 is moved to the blank part of the non-interest part or the non-interest part 36, and is pre-defined (for example, from left to right, from top) The way to the bottom is arranged along the blanks. In this way, when the map frame is restored, when the weight parameter is 1, but there is no position of the pixel data, the pixel data is restored to the original position of the interested portion according to the predefined arrangement.

雖然在本實施例中,有興趣部份於重構時被放置在圖幀的原來位置上,但並不以此為限,有興趣部分在重構時亦可被放置在圖幀的其他位置上。以MPEG為例,資料因轉換至頻域後,連續排列的資料之高頻成分較大,進行壓縮時可以得到較大的壓縮量,因此在進行重構時應以使資料連續排列為原則來放置影像區塊,使得重構後的圖幀在壓縮時具有最大的壓縮率。當有興趣部份的位置於重構下亦被重新調整時,重構資訊42更包含有興趣部份於重構圖幀上的位置資訊。Although in this embodiment, the portion of interest is placed at the original position of the frame during reconstruction, it is not limited thereto, and the portion of interest may be placed in other positions of the frame during reconstruction. on. Taking MPEG as an example, after the data is converted to the frequency domain, the high-frequency components of the continuously arranged data are large, and a large amount of compression can be obtained when compressing. Therefore, the data should be continuously arranged as a principle in the reconstruction. The image block is placed such that the reconstructed picture frame has the greatest compression ratio when compressed. When the location of the portion of interest is also re-adjusted under reconstruction, the reconstruction information 42 further includes location information of the portion of the reconstructed map.

一旦縮減部分36a在一重構圖幀中的放置位置被決定時,難免地,縮減部分36a可能跟有興趣部分32或34有部分重疊。當重疊事件發生時,為解決此問題,首先可使用適當的比例縮減參數,舉例來說,當有興趣部分的寬度部份佔圖幀的三分之一時,只要選擇適當的縮減比例使縮減後縮減部分的寬度低於圖幀的三分之二,便能解決重疊的問題。然而,在使用者的需求在於字幕清晰,且利用畫面中白色或者高對比色塊作為判斷字幕的情形下,可能使得其他高對比或白色部分亦被判斷為高權重的需保留部分,而使得有興趣部分呈現不規則的狀況,於此情形下,縮減部分之區塊則為有興趣部分區塊的互補形狀,兩者可能互相交錯穿插,換言之,同一高度以及寬度內可能同時包含有興趣部分區塊以及縮減部分。如此一來,將無法單純利用寬度或高度調整避免有興趣部分以及縮減部分間重疊的問題。此時,可以依照一預定搬移方式與規則,把縮減部份36a或是有興趣部分32與34中之一重疊部份,置放在重構圖幀中還沒有被縮減部份36a、有興趣部分32與34所佔據的區域。第6圖例示另一重構圖幀40a,其中縮減部分36a的放置位置大約是重構圖幀40a的左上角,因此縮減部分36a與有興趣部分32有部分重疊。影像區塊44a~44d顯示縮減部分36a中會跟興趣部分32重疊的部分。影像區塊44a~44d並沒有置放在重構圖幀40a中有興趣部分32所在的區域,而是依照一預定搬移方式與規則,分別被置放在區域46a~46d。在重構圖幀40a中,被搬移的是縮減部分36a中的重疊部分。在另一個實施例中,被搬移的是有興趣部分中的重疊部分,預定搬移方式是依據以由左至右由上而下之順序。Once the placement position of the reduced portion 36a in a reconstructed frame is determined, it is inevitable that the reduced portion 36a may partially overlap the interested portion 32 or 34. To solve this problem when overlapping events occur, first use the appropriate scale reduction parameters. For example, when the width portion of the interested portion occupies one-third of the frame, just select the appropriate reduction ratio to reduce the size. The width of the post-reduced portion is less than two-thirds of the frame of the picture, and the problem of overlap can be solved. However, in the case where the user's demand is that the subtitles are clear and the white or high contrast color blocks in the picture are used as the judging subtitles, other high contrast or white parts may be judged as high-weight reserved parts, which makes them interested. Partially present an irregular situation. In this case, the reduced portion of the block is a complementary shape of the block of interest, and the two may be interlaced with each other. In other words, the same height and width may include the partial block of interest. And a reduction. As a result, it is not possible to simply use the width or height adjustment to avoid the problem of overlapping between the interested portion and the reduced portion. At this time, the portion of the reduced portion 36a or one of the interested portions 32 and 34 may be placed in the reconstructed map frame according to a predetermined shifting manner and rules, and the portion 36a and the interested portion are not yet reduced. The area occupied by 32 and 34. Fig. 6 illustrates another reconstructed map frame 40a in which the placement position of the reduced portion 36a is approximately the upper left corner of the reconstructed map frame 40a, and thus the reduced portion 36a partially overlaps the interested portion 32. The image blocks 44a to 44d display portions of the reduced portion 36a that overlap with the portion of interest 32. The image blocks 44a to 44d are not placed in the region where the interesting portion 32 is located in the reconstructed image frame 40a, but are placed in the regions 46a to 46d according to a predetermined moving manner and rules. In the reconstructed map frame 40a, the overlapped portion in the reduced portion 36a is moved. In another embodiment, the overlapped portion of the portion of interest is moved, and the predetermined shifting manner is based on the order from top to bottom from left to right.

步驟20對步驟18所產生的重構圖幀進行編碼,以產生圖幀資料。舉例來說,依照MPEG-4之壓縮標準或是其他影像之編碼協定,對重構圖幀編碼,產生相對應的圖幀資料。Step 20 encodes the reconstructed picture frame generated in step 18 to generate picture frame data. For example, according to the compression standard of MPEG-4 or other image coding protocol, the reconstructed picture frame is encoded to generate corresponding picture frame data.

步驟22把圖幀資料與輔助資訊,一起結合產生一媒體資料檔案。在一實施例中,數個圖幀資料存放於一MP4檔,而對應圖幀資料的輔助資訊存放於一詮釋資料(metadata)檔,而步驟22所產生的媒體資料檔案是MP4檔與詮釋資料檔的組合。在另一實施例中,步驟22所產生的媒體資料檔案只是一MP4檔,輔助資訊則存放在該MP4檔中使用者可以制定的欄位中。Step 22 combines the frame data with the auxiliary information to generate a media data file. In an embodiment, the plurality of frame data is stored in an MP4 file, and the auxiliary information corresponding to the frame data is stored in a metadata file, and the media data file generated in step 22 is an MP4 file and an interpretation data. The combination of files. In another embodiment, the media data file generated in step 22 is only an MP4 file, and the auxiliary information is stored in a field that the user can make in the MP4 file.

相較於原始圖幀30中的無興趣部分36,重構圖幀40中的縮減部份36a的解析度比較低,而且重構圖幀40也有許多空白部分。所以可以預期的,依據重構圖幀所產生的媒體資料檔案應該就會比較小,比較適用於移動式通訊裝置。Compared to the non-interest portion 36 in the original picture frame 30, the resolution of the reduced portion 36a in the reconstructed picture frame 40 is relatively low, and the reconstructed picture frame 40 also has a plurality of blank portions. Therefore, it can be expected that the media data file generated according to the reconstructed frame should be relatively small, and is suitable for mobile communication devices.

步驟22所產生的媒體資料檔案可以透過有線或是無線網路,傳送到一移動式通訊裝置。只要移動式通訊裝置具有相對應的解碼程式或是解碼器,就可以依據媒體資料檔案中的圖幀資料與輔助資訊,產生並放映與原始圖幀非常接近之組合圖幀。The media data file generated in step 22 can be transmitted to a mobile communication device via a wired or wireless network. As long as the mobile communication device has a corresponding decoding program or decoder, the combined frame frame which is very close to the original image frame can be generated and displayed according to the frame data and the auxiliary information in the media data file.

第7圖顯示一種解壓縮方法60,可以適用於一解碼器(decoder),用來處理第1圖所產生的媒體資料檔案。解壓縮方法60基本上是第1圖之影像壓縮方法10的反操作。Figure 7 shows a decompression method 60 that can be applied to a decoder for processing the media data files generated in Figure 1. The decompression method 60 is basically the inverse of the image compression method 10 of FIG.

步驟62接收一媒體資料檔案。在一實施例中,解壓縮方法60使用於一手機,其透過無線網路,接收媒體資料檔案。Step 62 receives a media data file. In one embodiment, the decompression method 60 is used in a mobile phone that receives media data files over a wireless network.

依據一解碼協定,步驟64對媒體資料檔案中的圖幀資料解碼,產生重構圖幀。舉例來說,如果圖幀資料是依據MPEG-4之壓縮標準而壓縮編碼產生,那步驟64就依據MPEG-4之解壓縮標準,來大致還原產生重構圖幀。因為經歷了壓縮與解壓縮,所以步驟64所還原產生的重構圖幀,即使沒有跟第1圖之步驟18所產生的重構圖幀完全相同,但是,大致上是非常類似。步驟64也從媒體資料檔案中找出相對應的輔助資訊。According to a decoding protocol, step 64 decodes the frame data in the media data file to generate a reconstructed frame. For example, if the frame data is compressed and encoded according to the compression standard of MPEG-4, then step 64 is based on the decompression standard of MPEG-4 to roughly restore the reconstructed frame. Because compression and decompression have been experienced, the reconstructed map frame produced by step 64 is substantially identical, even though it is not identical to the reconstructed map frame generated in step 18 of Figure 1. Step 64 also finds the corresponding auxiliary information from the media data file.

依據輔助資訊中的原始位置資訊圖38以及重構資訊42,步驟66從步驟64所產生的重構圖幀中,找出有興趣部分與縮減部分。舉例來說,依據第5B圖中的原始位置資訊圖38,可以從第5A圖之重構圖幀40中找出有興趣部分32與34。依據第5B圖中的重構資訊42,可以從第5A圖之重構圖幀40中找出縮減部分36a。Based on the original location information map 38 and the reconstruction information 42 in the auxiliary information, step 66 finds the interested portion and the reduced portion from the reconstructed map frame generated in step 64. For example, according to the original position information map 38 in FIG. 5B, the interested portions 32 and 34 can be found from the reconstructed map frame 40 of FIG. 5A. According to the reconstruction information 42 in Fig. 5B, the reduced portion 36a can be found from the reconstructed map frame 40 of Fig. 5A.

類似的,原始位置資訊圖38與重構資訊42也可以得知重構圖幀40是否有重疊部分。只要知道影像壓縮方法10中,針對重疊事件的預定搬移方式與規則,步驟66可以從重構圖幀40中,找出以及/或拼湊出有興趣部分32與34以及縮減部分36a。Similarly, the original location information map 38 and the reconstruction information 42 may also know whether the reconstructed map frame 40 has an overlapping portion. As long as the image compression method 10 is known, for predetermined shifting methods and rules for overlapping events, step 66 may find and/or piece together the interested portions 32 and 34 and the reduced portion 36a from the reconstructed map frame 40.

步驟68把縮減部分36a放大,以形成模糊部分,使其大小與重構圖幀之大小相同。以第4圖之縮減部分36a為例,因為經歷了縮小與放大過程,所以,步驟68所產生的模糊部分大致上是與無興趣部分36雷同,但是有較低的解析度。Step 68 amplifies the reduced portion 36a to form a blurred portion having the same size as the reconstructed frame. Taking the reduced portion 36a of Fig. 4 as an example, since the reduction and enlargement process has been performed, the blurred portion produced in step 68 is substantially the same as the non-interest portion 36, but has a lower resolution.

依據原始位置資訊圖38,步驟70重構模糊部分以及有興趣部分,形成組合圖幀。模糊部分就放置在無興趣部分所對應的位置上。大致來說,組合圖幀與一相對應的原始圖幀會有享有相同的有興趣部分,但是,組合圖幀中模糊部分,相較於相對應原始圖幀中無興趣部分,會比較模糊。模糊部分與有興趣部分的交界處,可以稍加處理,以減低或是避免因為解析度的差異所造成的圖像不連續現象。步驟70所產生的組合圖幀,則交由步驟74播放。Based on the original location information map 38, step 70 reconstructs the blurred portion and the portion of interest to form a combined map frame. The blurred portion is placed at the position corresponding to the uninterested portion. In general, the combined picture frame and the corresponding original picture frame will have the same interested part, but the blurred part in the combined picture frame will be more fuzzy than the uninterested part in the corresponding original picture frame. The intersection of the blurred part and the interested part can be slightly processed to reduce or avoid image discontinuity caused by the difference in resolution. The combined frame generated by step 70 is then played back in step 74.

儘管組合圖幀中,模糊部分的解析度比較低,但是因為其中資訊本來就比較不重要或是無興趣,也可能在手機或是平板電腦上的小螢幕中根本就難以被肉眼辨識,所以模糊部分是可以被接受的。至於使用者可能比較在乎的有興趣部分,組合圖幀依然維持其原始的解析度。所以以組合圖幀取代原始圖幀來播放,大致不會影響使用者觀看的感覺。Although the resolution of the blurred part is lower in the combination frame, because the information is inherently less important or uninteresting, it may not be visible to the naked eye in the small screen on the mobile phone or tablet, so it is blurred. Part of it is acceptable. As for the interested parts that the user may care about, the combined frame still maintains its original resolution. Therefore, the original picture frame is replaced by the combined picture frame to play, which does not substantially affect the user's feeling of viewing.

在本發明之一實施例中,第1圖之影像壓縮方法10所產生的媒體資料檔案為一MP4檔案,其符合MP4的檔案格式。MP4檔案包含有數個物件,每個物件稱之為原子(atom)。舉例來說,關於第5A圖之重構圖幀40之真正媒體資料,存放在媒體資料原子(media data atom)中。媒體資料原子一般稱為mdat atom。重構圖幀40的壓縮方式、磁軌(track)型態、時間戳記等附屬資訊,則存放在電影原子(movie atom)中,一般稱為moov atom。對應重構圖幀40的輔助資訊37,則是存放在,moov atom內使用者可以自訂的使用者資料原子(user data atom)中。所以,在本發明的一實施例中,一電影原子存有一重構圖幀所對應的附屬資訊以及輔助資訊。或者,輔助資訊以及附屬資訊可以被附加於MPEG資料之後。於另一實施例中,當重構圖幀40係藉由H.264方式壓縮時,輔助資訊以及附屬資訊則可被附加於每一個傳送的圖幀之後(例如圖幀1+第一輔助資訊、圖幀2+第二輔助資訊...)。輔助資訊在本發明中是重要的,失去了輔助資訊,利用解壓縮方法只能還原出重構後的圖幀40,而無法還原成原來的圖幀了,因此上述幾種不同的輔助資訊附加方法,並不限定單獨使用,亦可同時將輔助資訊附加前述不同的位置上,以避免丟失圖幀獲封包時,一並丟失了輔助資訊。In an embodiment of the present invention, the media data file generated by the image compression method 10 of FIG. 1 is an MP4 file, which conforms to the file format of the MP4. The MP4 file contains several objects, each of which is called an atom. For example, the real media material for the reconstructed map frame 40 of Figure 5A is stored in a media data atom. Media data atoms are generally referred to as mdat atoms. The auxiliary information such as the compression mode, the track type, and the time stamp of the reconstructed picture frame 40 is stored in a movie atom, which is generally called a moov atom. The auxiliary information 37 corresponding to the reconstructed map frame 40 is stored in a user data atom that can be customized by the user in the moov atom. Therefore, in an embodiment of the present invention, a movie atom stores an auxiliary information corresponding to a reconstructed frame and auxiliary information. Alternatively, auxiliary information and affiliate information can be appended to the MPEG material. In another embodiment, when the reconstructed frame 40 is compressed by the H.264 method, the auxiliary information and the auxiliary information may be appended to each transmitted frame (for example, frame 1 + first auxiliary information, Figure frame 2+ second auxiliary information...). The auxiliary information is important in the present invention, and the auxiliary information is lost. The reconstructed image frame 40 can only be restored by using the decompression method, and cannot be restored to the original frame frame. Therefore, the above several different auxiliary information are attached. The method is not limited to use alone, and the auxiliary information may be attached to the different positions at the same time to avoid losing the auxiliary information when the frame is lost.

在本發明的另一實施例中,第1圖之影像壓縮方法10所產生的媒體資料檔案為一MP4檔案與一詮釋資料(metadata)的組合。此MP4檔案存放有所有重構圖幀之真正媒體資料以及相對應附屬資訊。也就是直接對此MP4檔案以MPEG-4之解壓縮標準解壓縮後,就可以得到數個重構圖幀與相對應之音訊,但無法得到相對應的輔助資訊。詮釋資料存放對應所有重構圖幀的輔助資訊以及時間戳記。時間戳記可以使解碼器在處理一重構圖幀時,快速的找到相對應的輔助資訊。In another embodiment of the present invention, the media data file generated by the image compression method 10 of FIG. 1 is a combination of an MP4 file and a metadata. This MP4 file stores the real media data of all reconstructed frames and the corresponding affiliate information. That is, after directly decompressing the MP4 file with the MPEG-4 decompression standard, several reconstructed picture frames and corresponding audio information can be obtained, but the corresponding auxiliary information cannot be obtained. The interpretation data stores auxiliary information and time stamps corresponding to all reconstructed image frames. The timestamp allows the decoder to quickly find the corresponding auxiliary information when processing a reconstructed frame.

在第1圖之實施例中,影像壓縮方法10只有把原始圖幀分割成兩種部分:有興趣與無興趣部分。但是,本發明也可以把原始圖幀分割成兩種以上的部分。譬如說,在本發明之另一個實施例中,原始圖幀被分割成三種部分:有興趣、無興趣、與非常無興趣部分。無興趣與非常無興趣部分可以用不同之縮減比例縮減,然後才與有興趣部分一起重構成一重構圖幀。此時,輔助資訊可能包含有有興趣、無興趣、與非常無興趣部分的原始位置資訊圖、無興趣部分的縮減比例與放置位置、非常無興趣部分的縮減比例與放置位置...等等。In the embodiment of Fig. 1, the image compression method 10 divides only the original picture frame into two parts: an interesting and a non-interest part. However, the present invention can also divide the original picture frame into two or more parts. For example, in another embodiment of the invention, the original picture frame is divided into three parts: interested, uninterested, and very uninteresting parts. Non-interested and very uninteresting parts can be reduced with different reduction ratios, and then reconstructed with a portion of interest to reconstruct a reconstructed frame. At this time, the auxiliary information may include original location information maps with interest, no interest, and very uninteresting parts, reduction ratios and placement positions of non-interest parts, reduction ratios and placement positions of very uninteresting parts, etc. .

綜上所述,雖然本發明已以較佳實施例揭露如上,然其並非用以限定本發明。本發明所屬技術領域中具有通常知識者,在不脫離本發明之精神和範圍內,當可作各種之更動與潤飾。因此,本發明之保護範圍當視後附之申請專利範圍所界定者為準。In conclusion, the present invention has been disclosed in the above preferred embodiments, and is not intended to limit the present invention. A person skilled in the art can make various changes and modifications without departing from the spirit and scope of the invention. Therefore, the scope of the invention is defined by the scope of the appended claims.

10...影像壓縮方法10. . . Image compression method

12、14、16、18、20、22...步驟12, 14, 16, 18, 20, 22. . . step

30...原始圖幀30. . . Original frame

32、34...有興趣部分32, 34. . . Interested part

33...圖幀33. . . Frame

36...無興趣部分36. . . Uninterested part

36a...縮減部分36a. . . Reduced part

37...輔助資訊37. . . Auxiliary information

38...原始位置資訊圖38. . . Original location map

40、40a...重構圖幀40, 40a. . . Reconstructed frame

42...重構資訊42. . . Refactoring information

44a~44d...影像區塊44a~44d. . . Image block

46a~46d...區域46a~46d. . . region

60...解壓縮方法60. . . Decompression method

62、64、66、68、70、74...步驟62, 64, 66, 68, 70, 74. . . step

第1圖顯示依據本發明所實施的影像壓縮方法。Figure 1 shows an image compression method implemented in accordance with the present invention.

第2圖例示一原始圖幀。Figure 2 illustrates an original picture frame.

第3圖顯示一原始圖幀經過步驟14處理後,所可能產生的一些結果。Figure 3 shows some of the possible outcomes of a raw frame after processing through step 14.

第4圖顯示一無興趣部分縮減成一縮減部分。Figure 4 shows an inconspicuous portion reduced to a reduced portion.

第5A圖例示一重構圖幀。Figure 5A illustrates a reconstructed picture frame.

第5B圖例示輔助資訊。Figure 5B illustrates the auxiliary information.

第6圖例示另一重構圖幀。Figure 6 illustrates another reconstructed picture frame.

第7圖顯示一種解壓縮方法。Figure 7 shows a decompression method.

12、14、16、18、20、22...步驟12, 14, 16, 18, 20, 22. . . step

Claims (17)

一種影像壓縮方法,包含有:分割一原始圖幀(frame)為一第一部份以及一第二部份;縮減該第二部份,以產生一縮減部份;重構該第一部份以及該縮減部份,以產生一重構圖幀;以及對該重構圖幀進行編碼,以產生一圖幀資料;其中,該重構步驟包含有:依據一規則,決定該縮減部份位於該重構圖幀之一放置位置,且該規則係相關於該圖幀資料的大小。 An image compression method includes: dividing a original frame into a first portion and a second portion; and reducing the second portion to generate a reduced portion; reconstructing the first portion And the reduced portion to generate a reconstructed frame; and encoding the reconstructed frame to generate a frame data; wherein the reconstructing step comprises: determining, according to a rule, the reduced portion is located in the reconstructed map One of the frames is placed in position and the rule is related to the size of the frame data. 一種影像壓縮方法,包含有:分割一原始圖幀(frame)為一第一部份以及一第二部份;縮減該第二部份,以產生一縮減部份;重構該第一部份以及該縮減部份,以產生一重構圖幀;以及對該重構圖幀進行編碼,以產生一圖幀資料;其中,該重構步驟包含有:決定該縮減部份位於該重構圖幀之一放置位置;以及當該放置位置使該縮減部份與該第一部份重疊時,依照一預先定義方式,放置該縮減部份或是該第一部份中之一重疊部份於該重構圖幀中尚未被該第一部份與該縮減部份所佔據的區域。 An image compression method includes: dividing a original frame into a first portion and a second portion; and reducing the second portion to generate a reduced portion; reconstructing the first portion And the reduced portion to generate a reconstructed frame; and encoding the reconstructed frame to generate a frame data; wherein the reconstructing step comprises: determining that the reduced portion is placed in one of the reconstructed frames a position; and when the placement position overlaps the reduced portion with the first portion, placing the reduced portion or one of the first portion overlaps the reconstructed frame in a predefined manner The area that has not been occupied by the first part and the reduced part. 一種影像壓縮方法,包含有:分割一原始圖幀(frame)為一第一部份以及一第二部份;縮減該第二部份,以產生一縮減部份;重構該第一部份以及該縮減部份,以產生一重構圖幀;以及對該重構圖幀進行編碼,以產生一圖幀資料;其中,該重構步驟包含有:放置該第一部份於該重構圖幀中;以及將該縮減部份放置於該重構圖幀中該第一部份所沒有佔據的區域。 An image compression method includes: dividing a original frame into a first portion and a second portion; and reducing the second portion to generate a reduced portion; reconstructing the first portion And the reduced portion to generate a reconstructed frame; and encoding the reconstructed frame to generate a frame data; wherein the reconstructing step comprises: placing the first portion in the reconstructed frame; And placing the reduced portion in an area of the reconstructed frame that is not occupied by the first portion. 一種影像壓縮方法,包含有:分割一原始圖幀(frame)為一第一部份以及一第二部份;縮減該第二部份,以產生一縮減部份;重構該第一部份以及該縮減部份,以產生一重構圖幀,其中該重構步驟係依據一規則,決定該縮減部份位於該重構圖幀之一放置位置,且該規則係相關於該縮減部份與該第一部份之一重疊面積;以及對該重構圖幀進行編碼,以產生一圖幀資料。 An image compression method includes: dividing a original frame into a first portion and a second portion; and reducing the second portion to generate a reduced portion; reconstructing the first portion And the reduced portion to generate a reconstructed frame, wherein the reconstructing step determines, according to a rule, that the reduced portion is located at a position of the reconstructed frame, and the rule is related to the reduced portion and the first One of the overlapping areas; and encoding the reconstructed frame to generate a frame of data. 如申請專利範圍第4項所述之影像壓縮方法,其中,該原始圖幀包含有複數相同大小之影像區塊(block),每一影像區塊具有複數畫素,該分割步驟係依據一預設規則,而決定一對應影像區塊隸屬於該第一部份或是該第二部份。 The image compression method of claim 4, wherein the original image frame comprises a plurality of image blocks of the same size, each image block has a plurality of pixels, and the segmentation step is based on a A rule is set to determine whether a corresponding image block belongs to the first part or the second part. 如申請專利範圍第5項所述之影像壓縮方法,其中,該預設規則係為該對應影像區塊中之對比關係。 The image compression method of claim 5, wherein the preset rule is a comparison relationship in the corresponding image block. 如申請專利範圍第5項所述之影像壓縮方法,其中,該預設規則係為該對應影像區塊是否具有一筆觸(stroke)部分。 The image compression method of claim 5, wherein the preset rule is whether the corresponding image block has a stroke portion. 如申請專利範圍第4項所述之影像壓縮方法,其中,另包含有:對該重構圖幀進行編碼,以產生該圖幀資料,並產生一媒體資料檔案,其包含有該圖幀資料以及輔助資訊,該輔助資訊包含有標示該縮減部份於該重構圖幀中的一放置位置。 The image compression method of claim 4, further comprising: encoding the reconstructed frame to generate the frame data, and generating a media data file, wherein the frame data is included The auxiliary information includes a placement position indicating the reduced portion in the reconstructed frame. 如申請專利範圍第8項所述之影像壓縮方法,其中,該輔助資訊包含有標示該縮減部份之一縮減比例。 The image compression method of claim 8, wherein the auxiliary information includes a reduction ratio indicating one of the reduced portions. 如申請專利範圍第8項所述之影像壓縮方法,其中,該輔助資訊包含有該第一部份以及該第二部份之原始位置資訊。 The image compression method of claim 8, wherein the auxiliary information includes original information of the first portion and the second portion. 一種儲存媒體,用以儲存一媒體資料檔案,該媒體資料檔案符合一特定檔案格式,並包含有:複數第一物件,其包含有複數重構圖幀的媒體資料; 複數第二物件,每一第二物件包含有該等重構圖幀中一對應重構圖幀之附屬資訊以及輔助資訊;其中,該附屬資訊可用來對該媒體資料解壓縮,以產生該對應重構圖幀;以及,該輔助資訊可以用來找出該對應重構圖幀中之一第一部份以及一縮減部份,以及紀錄有該縮減部分之一縮減比例,且該輔助資訊至少包含有該第一部份之原始位置資訊。 A storage medium for storing a media data file, the media data file conforming to a specific file format, and comprising: a plurality of first objects, the media data comprising a plurality of reconstructed frames; a plurality of second objects, each of the second objects includes auxiliary information of a corresponding reconstructed frame in the reconstructed frame and auxiliary information; wherein the auxiliary information is used to decompress the media data to generate the corresponding reconstructed image And the auxiliary information may be used to find a first part and a reduced part of the corresponding reconstructed picture frame, and record a reduction ratio of the reduced part, and the auxiliary information includes at least the first Part of the original location information. 如申請專利範圍第11項所述之儲存媒體,其中,該特定檔案格式係為MP4檔案格式,該輔助資訊係存放於一電影物件內,一使用者可以自訂的一使用者資料物件中。 The storage medium of claim 11, wherein the specific file format is an MP4 file format, and the auxiliary information is stored in a movie object, and a user can customize a user data item. 一種儲存媒體,用以儲存一媒體資料檔案,該媒體資料檔案包含有:一影音檔案,其符合一特定檔案格式,經解碼後可得複數重構圖幀以及相對應之音訊;以及詮釋資料,包含有對應該等重構圖幀的輔助資訊以及時間戳記;其中,該輔助資訊可以用來找出一對應重構圖幀中之一第一部份以及一縮減部份,以及紀錄有該縮減部分之一縮減比例,且該輔助資訊至少包含有該第一部份之原始位置資訊。 A storage medium for storing a media data file, the media data file comprising: a video file, which conforms to a specific file format, and is decoded to obtain a plurality of reconstructed frames and corresponding audio; and the interpretation data includes There are auxiliary information corresponding to the reconstruction frame and a time stamp; wherein the auxiliary information can be used to find a first part and a reduced part of a corresponding reconstructed picture frame, and the recording has one of the reduced parts The ratio is reduced, and the auxiliary information includes at least the original location information of the first part. 如申請專利範圍第13項所述之儲存媒體,其中,該特定檔案格式係為MP4檔案格式。 The storage medium of claim 13, wherein the specific file format is an MP4 file format. 一種媒體資料檔案之解壓縮方法,該解壓縮方法包含有:從該媒體資料檔案產生一重構圖幀以及一輔助資訊;依據該輔助資訊,找出該重構圖幀中的一第一部份以及一縮減部份;放大該縮減部份,以產生一模糊部份;以及依據該輔助資訊,重構該第一部份以及該模糊部份以產生一組合圖幀;其中,該輔助資訊包含有該第一部份以及該模糊部份之原始位置資訊。 A method for decompressing a media data file, the decompression method comprising: generating a reconstructed image frame and an auxiliary information from the media data file; and finding a first part and a first part of the reconstructed image frame according to the auxiliary information Reducing the portion; enlarging the reduced portion to generate a blurred portion; and reconstructing the first portion and the blurred portion to generate a combined image frame according to the auxiliary information; wherein the auxiliary information includes the The first part and the original position information of the blurred part. 如申請專利範圍第15項所述之解壓縮方法,其中,該輔助資訊包含有一縮減比例,該放大步驟係依據該縮減比例來產生該模糊部份。 The decompression method according to claim 15, wherein the auxiliary information includes a reduction ratio, and the amplification step generates the blurred portion according to the reduction ratio. 如申請專利範圍第15項所述之解壓縮方法,其中,該重構圖幀包含有一空白部分。 The decompression method of claim 15, wherein the reconstructed frame comprises a blank portion.
TW100145855A 2011-10-06 2011-12-12 Image compression methods, media data files, and decompression methods TWI508530B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/644,487 US20130089153A1 (en) 2011-10-06 2012-10-04 Image compression method, and associated media data file and decompression method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US201161543886P 2011-10-06 2011-10-06

Publications (2)

Publication Number Publication Date
TW201316774A TW201316774A (en) 2013-04-16
TWI508530B true TWI508530B (en) 2015-11-11

Family

ID=48023662

Family Applications (1)

Application Number Title Priority Date Filing Date
TW100145855A TWI508530B (en) 2011-10-06 2011-12-12 Image compression methods, media data files, and decompression methods

Country Status (2)

Country Link
CN (1) CN103037247B (en)
TW (1) TWI508530B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI813988B (en) * 2021-05-05 2023-09-01 宏正自動科技股份有限公司 Image transmission method and image transmission system

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108668130A (en) * 2017-03-31 2018-10-16 晨星半导体股份有限公司 The method for recombinating image file
CN110636310A (en) * 2018-06-25 2019-12-31 晨星半导体股份有限公司 Method for operating image processing device and image processing device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6057884A (en) * 1997-06-05 2000-05-02 General Instrument Corporation Temporal and spatial scaleable coding for video object planes
TWI230516B (en) * 2002-04-25 2005-04-01 Microsoft Corp Segmented layered image system
US20060044636A1 (en) * 2004-09-02 2006-03-02 Canon Kabushiki Kaisha Image processing apparatus, image processing method, program, and storage medium
US20070189615A1 (en) * 2005-08-12 2007-08-16 Che-Bin Liu Systems and Methods for Generating Background and Foreground Images for Document Compression
US20100260438A1 (en) * 2009-04-08 2010-10-14 Nikon Corporation Image processing apparatus and medium storing image processing program

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE60142826D1 (en) * 2000-02-04 2010-09-30 Listen Com Inc System with a distributed multimedia network and a metadata server

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6057884A (en) * 1997-06-05 2000-05-02 General Instrument Corporation Temporal and spatial scaleable coding for video object planes
TWI230516B (en) * 2002-04-25 2005-04-01 Microsoft Corp Segmented layered image system
US20060044636A1 (en) * 2004-09-02 2006-03-02 Canon Kabushiki Kaisha Image processing apparatus, image processing method, program, and storage medium
US20070189615A1 (en) * 2005-08-12 2007-08-16 Che-Bin Liu Systems and Methods for Generating Background and Foreground Images for Document Compression
US20100260438A1 (en) * 2009-04-08 2010-10-14 Nikon Corporation Image processing apparatus and medium storing image processing program

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
H. Emrah Tasli and Kemal Ugur, "Interactive 2D/3D Image Conversion Method for Mobile Devices," Proc. of 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON), pp.1-4, May 2011^&rn^ *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI813988B (en) * 2021-05-05 2023-09-01 宏正自動科技股份有限公司 Image transmission method and image transmission system

Also Published As

Publication number Publication date
CN103037247A (en) 2013-04-10
CN103037247B (en) 2016-08-24
TW201316774A (en) 2013-04-16

Similar Documents

Publication Publication Date Title
US11798166B2 (en) Sphere pole projections for efficient compression of 360-degree video
US10319071B2 (en) Truncated square pyramid geometry and frame packing structure for representing virtual reality video content
TW201903710A (en) Sphere equator projection for efficient compression of 360-degree video
JP5086067B2 (en) Method for encoding a high dynamic range image, data structure for representing, and encoding apparatus
US9124858B2 (en) Content processing apparatus for processing high resolution content and content processing method thereof
TW201817231A (en) Systems and methods of generating and processing files for partial decoding and most interested regions
TW201824865A (en) Systems and methods of signaling of regions of interest
CN108063976B (en) Video processing method and device
WO2018132317A1 (en) Adjusting field of view of truncated square pyramid projection for 360-degree video
CN109640167B (en) Video processing method and device, electronic equipment and storage medium
TW201230768A (en) Encoding method, display device, and decoding method
CN111149346B (en) Method, apparatus and medium for encoding and decoding high dynamic range video
JP2014522600A (en) Video compression implementing resolution tradeoffs and optimization
CA3018600C (en) Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices
US11523127B2 (en) Frame-rate scalable video coding
TWI508530B (en) Image compression methods, media data files, and decompression methods
US20080260290A1 (en) Changing the Aspect Ratio of Images to be Displayed on a Screen
JP5941000B2 (en) Video distribution apparatus and video distribution method
US20130089153A1 (en) Image compression method, and associated media data file and decompression method
KR20200143287A (en) Method and apparatus for encoding/decoding image and recording medium for storing bitstream
WO2021056575A1 (en) Low-delay joint source-channel coding method, and related device
US20200413094A1 (en) Method and apparatus for encoding/decoding image and recording medium for storing bitstream
CN116684629A (en) Video encoding and decoding methods, video encoding and decoding devices, electronic equipment and media
Ruud Video Quality Measurement of Scalable Video Streams

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees