TW201116067A - Video codec method, video encode device and video decode device - Google Patents

Video codec method, video encode device and video decode device Download PDF

Info

Publication number
TW201116067A
TW201116067A TW98136246A TW98136246A TW201116067A TW 201116067 A TW201116067 A TW 201116067A TW 98136246 A TW98136246 A TW 98136246A TW 98136246 A TW98136246 A TW 98136246A TW 201116067 A TW201116067 A TW 201116067A
Authority
TW
Taiwan
Prior art keywords
video
reference frame
frame
encoding
decoding
Prior art date
Application number
TW98136246A
Other languages
Chinese (zh)
Inventor
Chia-Wei Liao
Ya-Ting Yang
Yi-Shin Tung
Original Assignee
Hon Hai Prec Ind Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hon Hai Prec Ind Co Ltd filed Critical Hon Hai Prec Ind Co Ltd
Priority to TW98136246A priority Critical patent/TW201116067A/en
Publication of TW201116067A publication Critical patent/TW201116067A/en

Links

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

A video codec method for a video communication system controls encode modes and reference frame types of video encode devices according to network status and reports sent by a video decode device. When the network is congested, the video encode device encodes a current frame in inter encode mode and sets reference frames as long term reference frames, then determines whether the video decode device receives the reference frames according to the reports sent by the video decode device, so as to make sure the reference frames of the video decode device in step with these of the video encode device. A video decode device and a video encode device are also provided.

Description

201116067 六、發明說明: 【發明所屬之技術領域1 [0001] 本發明涉及視訊編解碼技術,特別涉及一種用於視訊通 訊系統的視訊編解碼方法、視訊編碼裝置及視訊解碼裝 置。 [先前技術] [0002]視訊通訊技術(如電視會議,視訊監控,視訊聊天等) 中’通常採用H.264標準’利用Φ貞内及幢間(intra/ inter)預測兩種模式對視訊圖像進行編解碼。視訊圖像 根據編碼模式可分為I幀,p幀及g钱三種β其中,j幀為 採用Ί1 貞内預螂編碼,僅利用,'秦鞭柯..靜费^^行編碼的圖 像。Ρ幀或Β螬為採用幀間預舍巧嗓,^^马^碼幀作為 參考幘魏行預測編碼的圖像/因上,幀在編碼時 需利甩已編碼幀作為參考幀,同樣,在解碼時也必須利 用同樣的已編碼幀作為參考幀。但當網路發生擁塞時將 發生資料封包丟失,财導致羞收‘無婊也^丟失資料封 包中的已編碼幀,從而使得需利用,這些-已編碼幀作為參 ' * I - V » 考幀的B幀或P幀在解碼時發生錯誤,影響視訊通訊中視 訊圖像的品質》 【發明内容】 ‘剛t#於此’需提供-魏訊編碼裝置及視訊解碼裝置, 可消除視訊通訊時由網路擁塞造成參考幀丟失進而導致 的解碼錯誤,提高視訊通訊中視訊圖像的品質。 [0004]相應地,還需提供一種視訊編解碼方法。 [0005] 098136246 本發明實施方式中的視訊編碼裝置, 表單編號A0101 S 4頁/共25頁 用於將視訊採集裝 0982062110-0 201116067201116067 VI. Description of the Invention: [0001] The present invention relates to video codec technology, and more particularly to a video encoding and decoding method, a video encoding device and a video decoding device for a video communication system. [Prior Art] [0002] Video communication technology (such as video conferencing, video surveillance, video chat, etc.) in the 'usually using the H.264 standard' using Φ 贞 intra and inter (inter / inter) prediction two modes of video map Like coding and decoding. According to the coding mode, the video image can be divided into I frame, p frame and g money. Among them, the j frame is pre-coded with Ί1 ,, and only the image encoded by 'Qin Whie.. static fee ^^ line is used. . Ρ Frame or Β螬 is the use of inter-frame pre-decoration, ^^ Ma ^ code frame as a reference 帻 Wei line predictive coding image / factor, the frame needs to benefit from the encoded frame as a reference frame, similarly, The same encoded frame must also be utilized as a reference frame when decoding. However, when the network is congested, the data packet will be lost, and the money will lead to a fuss. 'There is no loss of the encoded frame in the data packet, which makes it necessary to use these - encoded frames as the reference ' * I - V » The B frame or P frame of the frame has an error during decoding, which affects the quality of the video image in the video communication. [Summary of the Invention] 'Just t# is required to provide the Weixin encoding device and the video decoding device, which can eliminate the video communication. When the network is congested, the reference frame is lost and the decoding error is caused, and the quality of the video image in the video communication is improved. Accordingly, there is still a need to provide a video encoding and decoding method. [0005] 098136246 The video encoding device in the embodiment of the present invention, the form number A0101 S 4 pages / total 25 pages for the video capture device 0982062110-0 201116067

[0006] 置採集的視tfl®像進行_編碼以生成糾資訊流,並 經由網路發送JL視,购瑪裝置。該視訊編瑪裝置包括預 測編碼器、參考f貞記憶趙及編碼控制器。其中預測編 碼器用於麟視訊圖像進㈣内賴編碼或㈣預測編 碼。參考幀圮憶體用於存儲參考幀並設置參考幀類型為 短期參考Μ、預定長期參考贼確定長期參考幢。編瑪 控制器用於偵測該網路的狀況及接收該視訊解碼裝置發 送的通知報文,並根據網路狀況及該通知報文控制該視 訊編碼裝置的預測編碼類型及該參考幀記憶體設置參考 幀的類型。當該編碼控制器偵測到網路發生擁塞,則控 制該預測編碼器利用參考帻對視訊圖像·零綠焯進行幀間 預測編碼’並控制該參考幀記禮雄.設隻’對應為參考幀為 , 、 、 預定長期參考幀;當該編毒審+ri灰通知報文時 ’則控制該參考幀記憶體設置該預定長斯參考幀為破定 長期參考幀,並在偵轉到網路恢復前控制該視訊編碼裝 置利甩該確定長期參考楨4議徽^進行幀間預 測編碼。.:.二囊r fMpt^rfy ▼.+ + +++: ... ^ ^ --: .:.Sv. 奢、 本發明實施方式中的視訊解^裝蓋,用於接收視訊編碼 裝置生成的編碼資訊流,並進行解碼後傳輸至視訊處理 裝置。該視訊解碼裝置包括預測解碼器、參考幀記憶體 及解碼控制器。其中,預測解碼器用於對該視訊圖像進 行幀内預測解碼或幀間預測解碼。參考幀記憶體用於存 儲參考幀,並設置該參考幀的類型為短期參考幀、預定 長期參考幀或確定長期參考幀。解碼控制器用於根據所 接收的編碼資訊流控制參考幀記憶體設置參考幀的類型 098136246 表單編號A0101 第5頁/共25頁 0982062110-0 201116067 ’並發送通純文轉祕編料置。當職收的編碼 資訊流的編碼類型為_預測編瑪,且對應的參考幢為 長期參考㈣,賴預測解碼器從該參考敝憶體中查 找到該對應的參考⑽進行㈣預測解碼,該參考悄記憶 體則將該對應的參考㈣置為預定長期參考_,並由該[0006] The captured tfl® image is _coded to generate a correction information stream, and the JL view device is sent via the network. The video gamma device includes a predictive encoder, a reference memory, and an encoding controller. The predictive encoder is used for the video of the video (4) or the (4) predictive coding. The reference frame memory is used to store the reference frame and set the reference frame type to be a short-term reference, and the predetermined long-term reference thief determines the long-term reference block. The coder controller is configured to detect the status of the network and receive the notification message sent by the video decoding device, and control the prediction coding type and the reference frame memory setting of the video coding device according to the network condition and the notification message. The type of reference frame. When the coding controller detects that the network is congested, the predictive encoder is controlled to use the reference frame to perform interframe prediction coding on the video image and zero green frame and control the reference frame to be honoured. The reference frame is , , and a predetermined long-term reference frame; when the code-picking review + ri gray notification message, then controlling the reference frame memory to set the predetermined long-term reference frame to break the long-term reference frame, and in the detection Controlling the video encoding device before the network recovery facilitates determining the long-term reference frame to perform inter-frame prediction encoding. . . . two pockets r fMpt^rfy ▼.+ + +++: ... ^ ^ --: .:.Sv. luxury, the video decoding device cover in the embodiment of the present invention, for receiving video encoding device The generated encoded information stream is decoded and transmitted to the video processing device. The video decoding device includes a predictive decoder, a reference frame memory, and a decoding controller. The predictive decoder is configured to perform intra prediction decoding or inter prediction decoding on the video image. The reference frame memory is used to store the reference frame and set the type of the reference frame to be a short-term reference frame, a predetermined long-term reference frame, or a long-term reference frame. The decoding controller is configured to control the type of the reference frame memory reference frame according to the received encoded information stream. 098136246 Form No. A0101 Page 5 of 25 0982062110-0 201116067 ‘And send the plain text to the secret programming. When the coding type of the encoded information stream of the service is _predicted, and the corresponding reference frame is a long-term reference (4), the prediction decoder finds the corresponding reference (10) from the reference memory for (4) prediction decoding, Referring to the quiet memory, the corresponding reference (4) is set as a predetermined long-term reference _, and

解碼控㈣發送通知報文至該視訊編魏置;當所接收 的編碼資賊對應时考㈣該參考敝㈣中的該預 定長期參考幀時,該參考幀記憶體將該預定長期參考幀 設置為確定長期參考幀,並由該預測解碼器利用該確定 長期參考幀進行幀間預測解碼。 [0007] 本發明實施方式中的視訊 碼裝置與視訊解碼裝置的Decoding control (4) transmitting a notification message to the video editing device; when the received encoding thief corresponds to the predetermined long-term reference frame in the reference 敝(4), the reference frame memory sets the predetermined long-term reference frame To determine a long-term reference frame, the predictive decoder utilizes the determined long-term reference frame for inter-prediction decoding. [0007] The video code device and the video decoding device in the embodiment of the present invention

4於包括視訊編 i衡視訊採集 裝置採.集的視訊圖_稼_:造射編碼後’經由網路傳輸後再進 行解碼並發送至視訊處理裝置’該視訊編解碼方法包括4, including the video editing device, the video recording device of the video capture device, the image is collected, transmitted through the network, and then decoded and sent to the video processing device. The video encoding and decoding method includes

:偵測網路狀況,姐根據網路狀況控制視第編碼裝置的 預測編碼類型及對應的參4幀類型;當網路擁塞時,視 訊編碼裝置對視訊两像當前,禎丨貞問預測編碼,並將 該對應的參考幀設置為預定長期參考幀;將梘訊圖像當 前幢的編碼資訊流經由網路發送至視訊解瑪裝置.視$ 解碼裝置接收並分析該視訊圖像當前幀的編碼資訊流, 判斷該視訊圖像當前幀的預測編碼類型及對應的參考幢 類型;若預測編碼類型為幀間預測編碼,且對應的參考 賴為長期參考情,則視訊解碼裝置查找該對應的參考+負 進行幀間預測解碼;若查找到該對應參考幢,則視訊解 碼裝置利用該對應的參考幀進行幀間預測解瑪,並將談 098136246 表單编號A0101 第6 共25頁 0982062110-0 201116067 對應的參㈣設置為預定長轉料;視訊解碼裝置發 送通知報文至視訊編瑪器告知已接收到該預定長期參考 Z,若視賴縣置触職通知報文,_視訊編碼 裝置中的該預;t長期參考賴設置為衫長期參考賴並 利用該確定長期參考_視訊圖像下1進行㈣預測 編碼’並將生成的編碼資訊流發送至視訊_裝置;視 訊解瑪裝置接收好析所接收的魏·像下一賴編 碼資訊流,判斷該視訊®像下—㈣制編㈣型及對 應的參考㈣型;若預測編碼_為+貞間_編碼且 對應的參考㈣長期參考H麟篇幫置中的該 預定長期轉_置為確定純該破定 長期參考幘進行㈣預測解漆,並根據 網路狀職制獅編衫置及對應的參 考幀類型,若網路發生擁塞,則控制視訊編碼裝置利用 該確定長期參考幀對視訊圖像後續幀進行幀間預測編碼 ,- [0008] 本發明所提出的視訊編解碼方舍視訊編碼裝置及視訊 ^ | j i —、! 解碼裝置’利用確定長期ϋ幀對視訊圖像進行編解碼 ,使得視訊通訊系統進行編解碼時利用的參考幀保挤一 致,避免了封包丟失而導致參考幀丟失進而解碼錯誤的 現象’提高了視訊通訊中的視訊圖像品質。 【實施方式】 [0009]圖1為本發明提出的視訊通訊系統1〇的應用環境圖。如圖 1所示,視訊通訊系統10包括視訊採集裝置11〇、視訊編 碼裝置120 '發送裝置130、接收裝置21〇 '視訊解碼裝 098136246 表單编號Α0101 第7頁/共25頁 0982062110-0 201116067 置220及視訊處理裝置23〇。其中,視訊採集裝置ιι〇用 於採集視像β視訊編碼裝置12G對採集的視訊圖像進 行編碼以生成編碼資訊流。發送裝置130用於將該編碼資 訊流以資料封包的形式通過網路發送至接收裝置21〇。接 收裝置210接收發送裝置130發送的資料封包並轉換為編 碼資訊流,並輪出至視訊解碼裝置22〇。視訊解碼裝置 220接收該編碼資訊流並進行解碼後輸出視訊圖像至視訊 處理裝置230。視訊處理裝置23〇對經解碼得到的視訊圖 像進行儲存、傳輸或顯示等處理。在本實施方式中,視 訊編碼裝置120及視訊解碼裝置22§αΗ·!&4標準對視訊 ,: Detecting the status of the network, the sister controls the predictive coding type of the video encoding device and the corresponding reference frame type according to the network condition; when the network is congested, the video encoding device checks the predictive coding for the video two images. And setting the corresponding reference frame as a predetermined long-term reference frame; sending the encoded information stream of the current frame of the video image to the video decoding device via the network. The decoding device receives and analyzes the current frame of the video image. Encoding the information stream, determining a prediction coding type of the current frame of the video image and a corresponding reference frame type; if the prediction coding type is inter prediction coding, and the corresponding reference is a long-term reference, the video decoding device searches for the corresponding Refer to +n for inter-prediction decoding; if the corresponding reference block is found, the video decoding device uses the corresponding reference frame for inter-predictive decoding, and will talk about 098136246 form number A0101 6th 25 pages 0982062110-0 201116067 The corresponding reference (4) is set to a predetermined long transfer; the video decoding device sends a notification message to the video coder to inform that the predetermined long-term reference Z has been received. If the county relies on the notification message, the pre-code in the video encoding device; t long-term reference is set to the long-term reference of the shirt and uses the determined long-term reference _ video image to perform (four) predictive encoding 'and will generate The encoded information stream is sent to the video_device; the video gamma device receives the received Wei-like image of the encoded information stream, and determines the video image as follows - (4) programming (four) type and corresponding reference (four) type; Predictive coding _ is + 贞 编码 code and the corresponding reference (4) long-term reference H lining help set the predetermined long-term turn _ set to determine the pure long-term reference 帻 to carry out (four) predictive lacquer, and according to the network-like system The lion shirt and the corresponding reference frame type, if the network is congested, the control video encoding device uses the determined long-term reference frame to perform inter-frame prediction encoding on the subsequent frames of the video image, [0008] the video proposed by the present invention Codec side video coding device and video ^ | ji —,! The decoding device uses the determined long-term frame to encode and decode the video image, so that the reference frame used by the video communication system for encoding and decoding is consistently squeezed, thereby avoiding the loss of the reference frame and the decoding error caused by the loss of the packet. Video image quality in communication. [Embodiment] FIG. 1 is an application environment diagram of a video communication system 1 according to the present invention. As shown in FIG. 1 , the video communication system 10 includes a video capture device 11 , a video encoding device 120 'transmitting device 130 , and a receiving device 21 〇 'video decoding device 098136246 Form No. 101 0101 Page 7 / 25 pages 0962062110-0 201116067 220 and video processing device 23〇. The video capture device ιι〇 is used to capture the video. The video encoding device 12G encodes the captured video image to generate an encoded information stream. The transmitting device 130 is configured to send the encoded information stream to the receiving device 21 through the network in the form of a data packet. The receiving device 210 receives the data packet transmitted by the transmitting device 130 and converts it into a coded information stream, and rotates to the video decoding device 22A. The video decoding device 220 receives the encoded information stream and decodes it, and then outputs the video image to the video processing device 230. The video processing device 23 performs processing such as storing, transmitting, or displaying the decoded video image. In the present embodiment, the video encoding device 120 and the video decoding device 22 §αΗ·!&4 standard pair video,

121、減法器122、變換及量化器123、熵編碼器124、反 量化及反變換器125、加法器126、去塊濾波器(de_ blocking filter) m、參考幀訖憶體128及編碼控制 器129 β視訊解碼裝置220包相熵解碼器221、反量化及 反變換器222、預測解碼器223、加法器224、參考賴記 憶體225、解碼控制器226及去塊濾波器227。 [0011] 視訊編碼裝置120接收視訊採集裝置110輸出的視訊圖像 ,並以幀為單位進行編碼後生成編碼資訊流進行發送。 預測編碼器121對當前幀進行幀内或幀間預測編碼,其包 括幀内預測模組1211及幀間預測模組1212。其中,φ貞内 預測模組1211用於根據當前幀本身的資料進行編碼,並 生成當前幀的幀内預測幀。幀間預測模組1212用於利用 098136246 表單編號A0101 第8頁/共25頁 201116067 已編碼賴料參考_當前㈣行㈣預測編碼, 成當前__預咖。U咐規定,魏編碼裝置 120首先對視訊圖像的第1進行㈣預測編瑪,再根姑 預定規則對視訊圖像中後_進㈣__ Φ [0012] 個在本實施方式中,當網路正常時,視訊編科置 個週期對視訊圖像進行—次_預測編碼。其中談母 期設定為丨秒。在其他實财式巾,贿射以根據遇 ^求進行預先設定。在其他實施方式中,_料器^ 還可根據當d貞内容進行㈣或_預測糾,如 幢的場景㈣先前料_大時,騎當前料行2 預_碼。 ^ 減法器122用於比較當前賴,.辦^_出的預測 ,、並得到兩者間的原始殘差,變換_^;23用於 原始殘差進行離散余弦變換(Discrete c〇sine 、、121, a subtractor 122, a transform and quantizer 123, an entropy encoder 124, an inverse quantization and inverse transformer 125, an adder 126, a deblocking filter m, a reference frame buffer 128, and an encoding controller The 129 β video decoding device 220 includes a phase entropy decoder 221, an inverse quantization and inverse transformer 222, a prediction decoder 223, an adder 224, a reference memory 225, a decoding controller 226, and a deblocking filter 227. [0011] The video encoding device 120 receives the video image output by the video capturing device 110, and performs encoding in units of frames to generate an encoded information stream for transmission. The predictive coder 121 performs intra or inter prediction encoding on the current frame, and includes an intra prediction module 1211 and an inter prediction module 1212. The φ 贞 intra prediction module 1211 is configured to perform coding according to the data of the current frame itself, and generate an intra prediction frame of the current frame. The inter prediction module 1212 is used to utilize 098136246 Form No. A0101 Page 8 of 25 201116067 Encoded Reference _ Current (4) Line (4) Predictive Coding, into the current __ pre-coffee. U咐 stipulates that the Wei encoding device 120 first performs (4) prediction on the video image, and then pre-determines the rule for the video image in the _in (four) __ Φ [0012] in this embodiment, when the network Normally, the video editing program performs a period-time prediction code for the video image. The mother time is set to leap seconds. In other real money styles, bribes are pre-set according to the circumstances. In other embodiments, the _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ^ Subtractor 122 is used to compare the current y, the prediction of the _, and obtain the original residual between the two, transform _^; 23 for the original residual to perform discrete cosine transform (Discrete c〇sine,

Transf_,DCT)及量$ ( ?e),並將經 及量化的原始殘差輸出至«_@〖214。童中,變化及 Φ \ # s' | '-Ί ' 。網編瑪3| ' 125對經變換及量化的原始殘差進%熵編碼後生成塢碼資 訊流。在H. 264標準中,每一幀視訊圓像對應的鵝 流中均包括一個頭檔(header) ’用於儲存編瑪資訊, 其包括但不限於熵編碼係數、變換及量化係數、預測鳴 碼類型及參考幀索引等。 其中’經變換及量化的原始殘差還輸出至反量化及反變 換器125進行反量化及反DCT變換,從而得到重建殘差 其中’反量化及反變器125包括反量化模組1251及反變換 098136246 表單編號A0101 第9頁/共25頁 的铷6211〇、〇 [0013] 201116067 模組1252。加法器125將««與_㈣器輸出的預 測賴叠加生成重建的當前幢。去塊據波器127對重建的當 前賴進行濾波並絲_編碼產生的塊效應後 ,即作為 新的參考㈣出至參考帕記憶艘128,以作為對視訊圖像 後續幢進行摘間預測編碼的參考幢。 參考幢記憶體128用於存料相,並設定參賴的類型 。在H.264標準中,參錢分為長期參賴及短期參考幢 兩種類型,且具有相應的參相索引格式。其中,短期 參考幢隨著編碼的進行以先入先由(First In First [0014]Transf_, DCT) and the quantity $ (?e), and output the quantized original residual to «_@〖214. Children, change and Φ \ # s' | '-Ί '.编 玛 玛 3| ' 125 pairs the transformed and quantized original residuals into the % entropy code to generate the dock code stream. In the H.264 standard, each frame of the video image corresponds to a goose stream that includes a header (for storing the marsh information, including but not limited to entropy coding coefficients, transform and quantization coefficients, predictions Code type and reference frame index, etc. The 'transformed and quantized original residuals are also output to the inverse quantization and inverse transformer 125 for inverse quantization and inverse DCT transform, thereby obtaining reconstruction residuals, wherein the 'inverse quantization and inverse transformer 125 includes the inverse quantization module 1251 and the inverse Transformation 098136246 Form No. A0101 Page 9 of 25 铷6211〇, 〇[0013] 201116067 Module 1252. The adder 125 superimposes the predicted values of the «« and _(4) outputs to generate the reconstructed current block. After the deblocking 127 filters and reconstructs the current slab of the reconstruction, it is used as a new reference (4) to the reference memory bank 128 for inter-predictive coding of the subsequent frames of the video image. Reference building. The reference block memory 128 is used to store the phase and set the type of the reference. In the H.264 standard, the participation of money is divided into two types: long-term participation and short-term reference building, and has a corresponding phase index format. Among them, the short-term reference building is first-in-first with the coding (First In First [0014]

Out, FIFO)的機财_更新4翔參考錢當收到視 訊編碼裝置潘的指令,卜 長期參考镝還分為預定長期 、長期 參考幀。 其中,視訊編碼裝置120利用^幢記娜⑶中的參考 賴作為長期參考㈣當叫進行_制編碼’冬未 核定視訊解碼裝置220是否接收到對應的參考_,參考 幢記龍128則設置對應的參考丨㈣預U期參考幢;當 確疋視訊解碼裝置2 3 0中的參七‘記憶體2 2 6已接收到對 應的參考㈣,參考設置該預定長 幀為確定長期參考幀。 [0015] 098136246 ------…•”濶说訊通訊系統10的網路狀況: 收視訊解碼裝置22〇發送的通知報文,並根據網路心 通知報文㈣視訊編碼裝置12Q的賴編賴型及 記憶體128設置參考賴類型。在本實施方式中 农 制器129«到網路正常時,則控制視訊編碼裝= 灯正常編碼’即進行賴内預測編瑪或㈣預娜編瑪。, 表單編號A0101 第10 胃/共25 頁 098206 201116067 編碼控制器129偵測到網路擁擠時’則控制視訊編碼裝置 120進行幀間預測編碼,並控制參考幀記憶體128將相應 的參考幀設置為預定長期參考幀。 [0016] 編碼生成的編碼資訊流經由發送裝置130轉換為資料封包 傳輸至網路,經由接收裝置210接收並重新轉換為編碼資 訊流’再由視訊解碼裝置220對編碼資訊流進行解碼。 [0017] 視訊解碼裝置220接收並分析當前幀的編碼資訊流,並根 據編碼資訊流的預測編碼類型及參考幀類型對編碼資訊 〇 流進行解碼。首先’熵解碼器221根據熵编碼係數進行熵 解碼’再由反變換及反量化量化係數對 編碼資訊流進行反變換及反舉^曾灸表著!重一差》其令 ,反變換及反量化器2 2 2包反變換器 2222。在Η. 264樣準中,由於熵編碼及解碼的無損性, 反變換及反量化器222生成的重建的重建殘差與反量化及 反變換器125生成的重建的預測解碼器 223根據預測編碼類型分別^释解碼或幀間預測 • 解碼。其中,預測解碼器内預測模組2231或幀 間預測模組2232。若當前幀的預測編碼類型為幀内預測 編碼,則由幀内預測模組2231進行幀内預測解碼。若當 前幀的預測編碼類型為幀間預測編碼,幀間預測模組 2232從記憶體225査找並提取重建殘差對應的參考情,經 由加法器224將對應的參考帕與重建殘差進行叠加生成重 建的當前幀。 [0018] 在本實施方式中,當預測解瑪器223進行_解碼時 ,若編碼資訊流對應的參相為短期參糾,則從參考 098136246 表單編號A0101 第11頁/共25頁 0982062110-0 201116067 幀記憶體225查找其所對應的參考幀以進行幀間預測解碼 。當預測解碼器223從參考幀記憶體225中查找到對應的 參考候’加法器224將該對應的參考幀與重建殘差進行疊 加後生成重建的當前幀,再經由去塊濾波器227對重建的 當前幀進行濾波並消除預測解碼時產生的塊效應,即作 為已解碼的視訊圖像輸出至視訊處理裝置23〇。同時,濾 波後的重建幀還作為新的參考幀輸出至參考幀記憶體128 ,以作為視訊圖像後續幀進行幀間預測解喝時的參考幀 [0019]Out, FIFO) of the money _ update 4 Xiang reference money when receiving the video encoding device Pan's instructions, long-term reference 镝 is also divided into predetermined long-term, long-term reference frames. The video encoding device 120 uses the reference ray in ^Bian Na (3) as the long-term reference. (4) When the _ encoding is performed, the winter unqualified video decoding device 220 receives the corresponding reference _, and the reference to the building block 128 is set to correspond. Reference 丨 (4) Pre-U phase reference building; when it is confirmed that the reference memory module 2 306 in the video decoding device 203 has received the corresponding reference (4), the reference setting of the predetermined long frame is to determine the long-term reference frame. [0015] 098136246 ------...•” 网路 讯 通讯 通讯 通讯 通讯 通讯 通讯 通讯 通讯 通讯 通讯 通讯 通讯 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收 收In the present embodiment, the agricultural device 129 «when the network is normal, then the video encoding device = normal encoding of the lamp is used to perform the prediction or the (4) pre-na M., Form No. A0101 No. 10 Stomach / Total 25 pages 098206 201116067 When the code controller 129 detects the network congestion, then the video encoding device 120 is controlled to perform interframe predictive coding, and the reference frame memory 128 is controlled to refer to the corresponding reference. The frame is set to a predetermined long-term reference frame. [0016] The encoded information stream generated by the encoding is converted into a data packet by the transmitting device 130 and transmitted to the network, and received and reconverted into the encoded information stream via the receiving device 210, and then the video decoding device 220 The encoded information stream is decoded. [0017] The video decoding device 220 receives and analyzes the encoded information stream of the current frame, and encodes according to the predictive coding type and the reference frame type of the encoded information stream. The signal stream is decoded. First, the 'entropy decoder 221 performs entropy decoding according to the entropy coding coefficient', and then the inverse transform and the inverse quantized quantized coefficient inversely transform the coded information stream and counter-attacks. Therefore, the inverse transform and inverse quantizer 2 2 2 packs the inverse transformer 2222. In the 264 sample, the reconstruction residual residual generated by the inverse transform and the inverse quantizer 222 is due to the losslessness of entropy encoding and decoding. The reconstructed predictive decoder 223 generated by the inverse quantization and inverse transformer 125 respectively performs decoding or inter prediction/decoding according to the predictive coding type, wherein the predictive intra-prediction module 2231 or the inter-prediction module 2232 is present. If the prediction coding type of the frame is intra prediction coding, intra prediction decoding is performed by the intra prediction module 2231. If the prediction coding type of the current frame is inter prediction coding, the inter prediction module 2232 searches for the memory 225 and The reference situation corresponding to the reconstruction residual is extracted, and the corresponding reference frame and the reconstruction residual are superimposed by the adder 224 to generate a reconstructed current frame. [0018] In the present embodiment, when the predictor arranger 223 is entered _When decoding, if the phase corresponding to the encoded information stream is short-term reference, the frame memory 225 looks up the reference frame from the reference 098136246 Form No. A0101 Page 11 / 25 pages 0962062110-0 201116067 for inter-frame Predictive decoding. When the prediction decoder 223 finds the corresponding reference candidate 'adder 224 from the reference frame memory 225, superimposes the corresponding reference frame with the reconstruction residual to generate a reconstructed current frame, and then passes the deblocking filter. 227 filters the reconstructed current frame and eliminates the blockiness generated during predictive decoding, that is, outputs the decoded video image to the video processing device 23A. At the same time, the filtered reconstructed frame is also output as a new reference frame to the reference frame memory 128 for use as a reference frame for inter-predictive de-consequence of subsequent frames of the video image [0019]

當視訊解碼裝置220進行檐、間預測解碼時,若編碼資訊流 對應的參考幀為長期參考幀飧記憶體225查 找所對應的參考巾貞骑行务。若參考幢記憶 體225中查找到對應的參考幀,預測解碼"g223提取對應 參考幀進行幀間預測解碼,並將對應的參考幀設定為預 定長期參考幀。同時,解碼控器226發送通知報文至視 訊編碼裝置12G的編碼控制:器12‘9 ",g知編碼控制器129 已接收到該預定長期參考幡實施方式中,若參考 幢記憶體225中沒有查找到對應:的I考幢,職束解碼。 在其他實施方式中,還可由解碼控制器226發送另一通知 報文至視訊編碼展置12〇,表示未查找到對應的參考摘。0 [0020] 當視訊編碼裝置120的編碼控制器129接收到該通知報文 後’則控轉考航㈣129將其巾對應的預定長期參^ 幢設置切定長期參考情’並控制視訊㈣裝幻2〇利用 該確定長期參考巾貞作為參考幢對下__視訊圖像進 間預測編碼’録成_資缝發送_簡⑱裝122〇 098136246 表單编娩A0101 第12頁/共25頁 0982062110-0 201116067 °在本實施方式中’若編碼控制器129在編碼資訊流發送 後的預定時間内未收到解碼控制 器226發出的通知報文, 則表不參考幢記憶體225中沒有查找到對應的參考幀,預 測編瑪器121則更換其他參考幀作為長期參考幀對當前幀 進行幢間預測編碼’且將該其他參考幀設置為預定長期 參考幀’並重新發送編碼資訊流。在其他實施方式中, 還可由解碼控制器226發送另一通知報文至編碼控制器 129 ’表示視訊解碼裝置22〇未查找到對應的參考幀。When the video decoding device 220 performs inter-predictive decoding, if the reference frame corresponding to the encoded information stream is the long-term reference frame, the memory 225 searches for the corresponding reference frame. If the corresponding reference frame is found in the reference block 225, the predictive decoding "g223 extracts the corresponding reference frame for inter-prediction decoding, and sets the corresponding reference frame as the predetermined long-term reference frame. At the same time, the decoding controller 226 sends a notification message to the encoding control device 12G of the encoding control device 12'9 ", knowing that the encoding controller 129 has received the predetermined long-term reference 幡 implementation manner, if the reference building memory 225 I did not find the corresponding: I test building, job beam decoding. In other embodiments, another notification message may also be sent by the decoding controller 226 to the video coding spread 12, indicating that the corresponding reference extract has not been found. [0020] When the encoding controller 129 of the video encoding device 120 receives the notification message, then the control transfer test (four) 129 sets the predetermined long-term reference configuration corresponding to the towel to the long-term reference situation and controls the video (four)幻〇 uses this to determine the long-term reference frame as the reference frame for the next __video image inter-predictive coding 'recorded _ sewed send _ Jane 18 loaded 122 〇 098136246 form birthing A0101 page 12 / a total of 25 pages 0962062110 -0 201116067 ° In the present embodiment, if the encoding controller 129 does not receive the notification message from the decoding controller 226 within a predetermined time after the transmission of the encoded information stream, the table memory 225 is not found in the reference memory 225. For the corresponding reference frame, the predictive coder 121 replaces the other reference frame as a long-term reference frame for inter-prediction encoding of the current frame 'and sets the other reference frame as a predetermined long-term reference frame' and retransmits the encoded information stream. In other embodiments, another notification message may also be sent by the decoding controller 226 to the encoding controller 129' indicating that the video decoding device 22 has not found a corresponding reference frame.

[0021] 視訊解碼裝置220再接收並分析重新發送的編碼資訊流進 行解碼,具體過程如上,故不再復述。視訊解碼裝置22〇 接收並分㈣並根據其 預測編碼類型及參考幀類型進·行齡瑪二·若幀視訊圖像下 一幢的預測編碼類型為幀間預測編碼,且對應的參考幀 類型為長期參考幀’解碼控制器226則控制參考幀記憶體 225將預定長期參考情設^為 ,幢並控制預 測解碼器223_該確定考 視訊 圖像下—幀進仃解碼。若雀下一幀的預測編 碼類尘為幀内預測編碼,或對應的參考幀類型不是長期 參考幀,則進行正常解碼,即進行幀内預測解碼或利用 參考幀進行幀間預測解碼。 [0022]視訊編碼裝置120中的編碼控制器129繼續偵測網路狀況 。若網路未恢復正常,則利用參考幀記憶體128中的確定 長期參考幀對視訊圖像的後續幀進行幀間預測編碼。若 網路恢復正常,則進行正常編碼,即進行幀内預測編碼 或幀間預測編碼。 098136246 表單編號A0101 第13頁/共25頁 0982062110-0 201116067 [0023] 圖3為本發明提出的一種視訊編解碼方法的流程圖。如圖 3所示,該視訊編碼解方法用於視訊通訊系統1〇,對視訊 採集裝置110採集的視訊圖像進行編碼經由網路傳輪後, 再進行解碼並發送至視訊處理裝置230,其包括以不步驟 [0024] 在步驟310中,編碼控制器129偵測網路狀況,並根據網 路狀況控制視訊編碼裝置120的預測編碼類型及參考幢類 型。若網路正常,則由視訊編碼裝置12〇進行正常編碼, 即,進行幀内預測編碼或者幀間預測編碼。在本實施方 式中,視訊編碼裝置120正常編碑時可採用幀内預測蝙碼 ,也可利用參考幀作為長期養短丨期迤行幀間預 編碼。 、,、··* [0025] 在步驟311中,若網路發生擁塞,視訊編碭裝置12〇對視 訊圖像當前幀進行卞間預測編碼,以生成編碼資訊流, 並將對應參考幀設置為預定長,期參考幀β 9· 7 i.· I ΐ- i I ι j [0026]在步驟312中,利用發送裝置接;收裝置21〇將當前 幀的編碼資訊流經由網路傳輸至视訑解碼裝置22〇。 闺好職Gt ’視崎喊置22{)接收並分析視訊圖像當 前幀的編瑪資訊流。 [0028] ’在步驟321中’視訊解碼裝置2_斷編碼資訊流的預測 編碼類型是否㈣間糊編瑪及參考賴型是否為長期 參考t貞。若制編碼類型不是_制編碼或參考傾類 型不是長期參料,則進行正常解碼,_關測模組 2231進订梢内預測解碼或幀間預測模組2232利用短期參 098136246 表單編號A0101 第14頁/共25頁 201116067 考幀進行幀間預測解碼。 剛好驟322中,若當前㈣預測編碼類型為額預測編瑪 且參考幀類型為長期參考幀,視訊解竭裝置220則查找 對應的參考幀以進行幀間預測解碼。若视訊解碼裝置22〇 沒有對應的參考幀,則結束對視訊圖像當前幀的解碼。 [0030][0021] The video decoding device 220 further receives and analyzes the retransmitted encoded information stream for decoding. The specific process is as above, and therefore will not be repeated. The video decoding device 22 receives and divides (4) and according to its prediction coding type and reference frame type, the prediction coding type of the next frame of the frame video image is inter prediction coding, and the corresponding reference frame type. For the long-term reference frame, the decoding controller 226 controls the reference frame memory 225 to set the predetermined long-term reference condition, and controls the prediction decoder 223 to determine the video image to be framed. If the predictive coding dust of the next frame is intra prediction coding, or the corresponding reference frame type is not a long-term reference frame, normal decoding is performed, that is, intra prediction decoding or inter prediction decoding using a reference frame. [0022] The encoding controller 129 in the video encoding device 120 continues to detect network conditions. If the network does not return to normal, the subsequent frames of the video image are inter-predictively encoded using the determined long-term reference frame in the reference frame memory 128. If the network returns to normal, normal coding is performed, that is, intra prediction coding or inter prediction coding is performed. 098136246 Form No. A0101 Page 13 of 25 0982062110-0 201116067 [0023] FIG. 3 is a flow chart of a video encoding and decoding method according to the present invention. As shown in FIG. 3, the video encoding solution method is used in the video communication system 1 to encode the video image collected by the video capture device 110 via the network, and then decode and send the video image to the video processing device 230. Including step [0024] In step 310, the encoding controller 129 detects the network condition and controls the predictive coding type and the reference building type of the video encoding device 120 according to the network condition. If the network is normal, the video encoding device 12 performs normal encoding, that is, intra prediction encoding or inter prediction encoding. In the present embodiment, the video encoding device 120 may use an intra-predicted bat code when the monument is normally used, or may use the reference frame as a long-term short-term inter-frame precoding. [0025] In step 311, if the network is congested, the video editing device 12 performs inter-time prediction encoding on the current frame of the video image to generate an encoded information stream, and sets the corresponding reference frame. For a predetermined length, the period reference frame β 9· 7 i.·I ΐ- i I ι j [0026] in step 312, using the transmitting device, the receiving device 21 〇 transmits the encoded information stream of the current frame to the network via The video decoding device 22 is closed.闺 Good job Gt ’ 崎 置 置 22{{{{{{{{{{{{ [0028] In step 321 the video decoding device 2_breaks whether the predictive coding type of the encoded information stream is (4) whether the paste type and the reference type are long-term reference t贞. If the coding type is not _ coding or the reference inclination type is not long-term reference, normal decoding is performed, and the _off module 2231 subscribes to the intra-prediction decoding or the inter prediction module 2232 uses the short-term parameter 098136246 Form No. A0101 No. 14 Page/Total 25 pages 201116067 The test frame is inter-predictive decoding. In just 322, if the current (4) predictive coding type is the predictive coding and the reference frame type is the long-term reference frame, the video de-energizing device 220 searches for the corresponding reference frame for inter-prediction decoding. If the video decoding device 22 does not have a corresponding reference frame, the decoding of the current frame of the video image is ended. [0030]

[0031] [0032][0032]

在步驟323中,若視訊編碼裝置220查找到對應的參考幀 ,則提取對應的參考幀對視訊圖像當前幀進行幀間預測 解碼,並將對應的參考幀設置為預定長期參考幀。在本 實施方式中,視訊解碼裝置中皭預定長期參考幀與視 訊編碼裝置12°中的預定穩寧 在步驟324中,視訊解碼器控&226發送 通知報文至視訊編碼器,從而告 知視訊編碼器120已接收到預定長期參考幀。 在步驟313中,判斷視訊編胃碼器中的編瑪控制器129 是否接收到該通知報文,碼控制器丨 J g- ^ j 1 ^ f1*- * U 沒有接收到該通知報文,啤則更換其他參考 檢再對當前幀進行幀間預測^碼了並生成編碼資訊流重 新發送至視訊解碼裳置22〇。 [0033]在步驟314中’若視訊編碼器12〇中的編碼控制器129接 收到該通知報文,則將視訊編碼器120中的預定長期參考 幀設置為確定長期參考幢。 [0034]在步驟315中’視訊編碼器12〇利用該確定長期參考幀對 視訊圖像下一幀進行幀間預測編碼,並將生成的編碼資 訊流發送至視訊解碼器220。 098136246 表單編號A0101 第15頁/共25頁 0982062110-0 201116067 [0035] [0036] 在步驟325中’視訊解碼裝置22〇接收並分析視訊圖像下 —幀的編碼資訊流。 在步驟326中,視訊解碼器22〇判斷編碼資訊流的預測編 瑪類型是否為賴預測編碼及參考細型是否為長期參 考幢*預測編碼類型不是㈣_測㈣或參考傾類型 不是長期參考賴’則進行正常解蜗,即幢内預測模組 231進行㈣預測解竭或幢間預測模組2挪利用短期參 考幀進行幀間預測解碼》 [0037] 在步驟327中,若該視訊酾像下 間預測編碼,且參考檢類 碼裝置220中的預定長期參 並利用該確定長期參考鴨 預測解碼》In step 323, if the video encoding device 220 finds the corresponding reference frame, the corresponding reference frame is extracted to perform inter prediction decoding on the current frame of the video image, and the corresponding reference frame is set as a predetermined long-term reference frame. In this embodiment, in the video decoding device, the predetermined long-term reference frame and the video encoding device are predetermined to be stable. In step 324, the video decoder control & 226 sends a notification message to the video encoder to notify the video. Encoder 120 has received a predetermined long-term reference frame. In step 313, it is determined whether the coder controller 129 in the video codec receives the notification message, and the code controller 丨J g- ^ j 1 ^ f1*- * U does not receive the notification message. The beer replaces other reference checks and then inter-predicts the current frame and generates a coded information stream to be resent to the video decoding device. [0033] In step 314, if the encoding controller 129 in the video encoder 12 receives the notification message, the predetermined long-term reference frame in the video encoder 120 is set to determine the long-term reference frame. [0034] In step 315, the video encoder 12 uses the determined long-term reference frame to perform inter-frame prediction encoding on the next frame of the video image, and transmits the generated encoded information stream to the video decoder 220. 098136246 Form No. A0101 Page 15 of 25 0982062110-0 201116067 [0036] In step 325, the video decoding device 22 receives and analyzes the encoded information stream of the video image frame. In step 326, the video decoder 22 determines whether the predictive coding type of the encoded information stream is dependent on the predictive coding and whether the reference picotype is a long-term reference block. * The predictive coding type is not (four) _ test (four) or the reference tilt type is not a long-term reference 赖' Then, the normal solution is performed, that is, the intra-prediction module 231 performs (4) the prediction decommissioning or the inter-frame prediction module 2 uses the short-term reference frame for inter-frame prediction decoding. [0037] In step 327, if the video is under the image Inter-predictive coding, and the predetermined long-term reference in the reference code device 220 utilizes the determined long-term reference duck prediction decoding

镝的隳測編碼類型為幀 6 ^則將視訊解 定長期參考幀, 一 +ih進行幀間 ❹ [0038] [0039] [0040] 參 在步驟316中,視訊編碼敦置⑵中的編碼控制器129偵 測網路狀況,並根據網路狀_魏訊劇裝置12〇的預 測編碼類型及參考㈣型。若:網__塞,則控制視 訊編碼裝置120則使用步驟315中的方法顧參考幢記憶 體128中的確定長期參相進行幢間預測編碼。 在步驟317中’若網路正常,則由視訊編碼裝置120進行 正常编碼’即進㈣内預測編碼,或利用參考+貞作為長 期或短期參考幢進行幀間預測蝙碼。 如上所述,本發明所提出的視訊編解碼方法、視訊編碼 裝置及視訊解碼裝置,利用確定長期參考㈣視訊圖像 進行編解碼’使得視訊軌“進行編解碼_用的參 098136246 表單編號;A0101 第代頁/共25頁 0982062110-0 201116067 考幀保持一致,避免了封包丟失而導致參考幀丟失進而 解碼錯誤的現象,提高了視訊通訊中的視訊圖像品質。 [0041] 綜上所述,本創作符合新型專利要件,爰依法提出專利 申奮准,以上所述僅為本創作之較佳實施例,舉凡熟 α本案技藝之人士,在爰依本創作精神所作之等效修飾 或變化,皆應涵蓋於以下之申請專利範圍内。 【圖式簡單說明】隳 隳 编码 编码 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧 帧The device 129 detects the network condition and is based on the predictive coding type and the reference (4) type of the network-like device. If the network __ is plugged, the control video encoding device 120 performs inter-frame predictive coding with reference to the determined long-term reference in the block memory 128 using the method in step 315. In step 317, if the network is normal, the video encoding device 120 performs normal encoding, that is, forward (four) intra prediction encoding, or uses the reference +贞 as a long-term or short-term reference block for inter-predicted bat codes. As described above, the video encoding and decoding method, the video encoding apparatus, and the video decoding apparatus of the present invention use the method of determining the long-term reference (4) video image for encoding and decoding 'making the video track "code-decoding" 098136246 form number; A0101 The first generation page/total 25 pages 0982062110-0 201116067 The test frame is consistent, avoiding the loss of the reference frame and the decoding error caused by the loss of the packet, and improving the video image quality in the video communication. [0041] In summary, This creation complies with the new patent requirements, and the patent application is based on law. The above is only the preferred embodiment of this creation. For those who are familiar with the skill of the case, the equivalent modification or change in the spirit of this creation, All should be covered by the following patent application. [Simplified description]

[0042] [0043] [0044][0044] [0044]

[0045] [0046] [0047] [0048] [0049] [0050] [0051] [0052] [0053] 圖1為本發明提出的視訊通訊系統的應用環境圖; 圖2為圖1中視訊編碼裝置及典郭辟瑪裝置海具體模組圖:及 Γ:1 圖3為本發明提出的視訊編解_碼方法的流程'圖β 【主要元件符號說明】· 視訊通訊系統.10 視訊採集裝置110 視訊編碼裝置120 發送裝置130 接收裝置210[0048] FIG. 1 is a diagram showing an application environment of a video communication system according to the present invention; FIG. 2 is a video coding of FIG. The specific module diagram of the device and the code of the 辟 辟 辟 装置 : : : : : 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 110 video encoding device 120 transmitting device 130 receiving device 210

098136246 視訊解碼裝置220 視訊處理裝置230 預測編碼器121 幀内預測模組1211、2231 表單編號Α0101 第17頁/共25頁 0982062110-0 201116067 [0054] 幀間預測模組1212 ' 2232098136246 Video decoding device 220 Video processing device 230 Prediction encoder 121 Intra prediction module 1211, 2231 Form number Α 0101 Page 17 / Total 25 page 0982062110-0 201116067 [0054] Inter prediction module 1212 ' 2232

[0055] 減法器122 [0056] 變換及量化器123 [0057] 熵編碼器124 [0058] 反量化及反變換器 125 、 222 [0059] 加法器126、224 [0060] 去塊濾波器127、 227 [0061] 參考幀記憶體128 ' 225 [0062] 編碼控制器129 [0063] 熵解碼器221 [0064] 預測解碼器223 • [0065] 解碼控制器226 :Subtractor 122 [0056] Entropy Encoder 124 [0058] Inverse Quantization and Inverting Converters 125, 222 [0059] Adders 126, 224 [0060] Deblocking Filter 127, 227 [0061] Reference Frame Memory 128' 225 [0062] Encoding Controller 129 [0063] Prediction Decoder 223 [0065] Decoding Controller 226:

098136246 表單編號A0101 第18頁/共25頁 0982062110-0098136246 Form No. A0101 Page 18 of 25 0982062110-0

Claims (1)

201116067 七、申請專利範圍: • 1 . 一種視訊編碼裝置,用於將視訊採集裝置採集的視訊圖像 進行預測編碼以生成編碼資訊流,並經由網路發送至視訊 解碼裝置’該視訊編碼裝置包括: 預測編碼器,用於對該視訊圖像進行幀内預測編碼或幀間 預測編碼;201116067 VII. Patent application scope: • 1. A video encoding device for predictively encoding a video image collected by a video capture device to generate a coded information stream, and transmitting it to a video decoding device via a network. The video encoding device includes : a prediction encoder, configured to perform intra prediction encoding or inter prediction encoding on the video image; 098136246 參考幢記憶體’用於存儲參考幀並設置參考幀類型為短期 參考幀、預定長期參考幀或確定長期參考幀;及 編碼控制器’用於偵測該網路的狀況及接收該視訊解碼裝 置發送的通知報文》並根據網路狀況及該通知報文控制該 視訊編碼裝置的預測編碼類亟及該參考楨妓,體設置參考 幀的類型; . :ft繼編 . 其中’當該編瑪控制器偵測到網路發生擁塞,則控制該預 測編瑪器利用參考情對視訊圖像當前幘進行幀間預測編碼 ’並控制該參考幀記憶體設置對择的參考_為預定長期參 考幀;當該編碼控制器接&到,則控制該參 J I V·. - « - j. ~ :· < «· 2 考幅記憶體設置該預定長期參考幀為毒定長期參考幀,並 在彳貞測到網路恢復前控制該巍訊編萬裝置利用該確定長期 參考幀對視訊圖像後續幀進行幀間預測編碼。 2 .如申請專利範圍第1項所述之視訊編碼裝置,其中該預測 編碼器包括: 幀間預測模組’用於對該視訊圖像進行幀間預測編碼;及 幀内預測模組’用於對該視訊囷像進行幀内預測編 一種視訊解碼裝置,用於接收視訊編碼裝 碼。 生成編碼資訊 表單編號A0101 第】9頁/共25頁 09物物1〇、〇 201116067 流,並進行解碼後傳輸至視訊處理襄置’該視訊解碼農置 包括: 預測解瑪器,用於對該視訊圖像進 預測解碼; 參考怕記憶體,㈣存儲參相,賴置該參相的類型 為短期參考檢、預定長期參考1 切定長期參考懷;及 解碼控制n ’錄根據所接_、料資訊餘料考幢飞 憶體設置參考㈣類型’並發送通知報文至該視訊編碼裝 置; 其中’ ㈣型為㈣預測編竭 ’且對應的參考幀為長期參考幀·.時,蜂^^^碼器從誃 參考㈣㈣巾錢到該對行抑預測解^ ,該參考幀記憶體則將該對m的參考幀詨置為預定長期參 考憤,並由該解碼控制器發送通知報文至該視訊編碼裝置 ;當所接收的編碼資訊流對應的參考幘為該參考悄記憶體 中的該預定長期參考幀時’該參考蟓記德髏將該預定長期 參考幀設置為碟定長期參考幀’並由譏領測解碼器利用該 確定長期參考幀進行幀間預測解碼。 如申請專利範圍第3項所述之視訊解碼裝置,其中該預測 解碼器包括: 幀間預測模組’用於對所接收的編喝資訊流進行頓間預測 解瑪;及 幀内預測模組’用於對所接收的編碼資訊流進行悄内預測 解碼。 一種視訊編解碼方法,用於包括視訊編碼裝置與視訊解瑪 裝置的視訊通訊系統中,該視訊通訊系統對視訊採集装置 098136246 表單煸號A0101 第20頁/共25頁 098206: 201116067 - 採集的視訊圖像進行編碼後,經由網路傳輸後再進行解碼 • 並發送至視訊處理裝置,該祝訊編解碼方法包括:. 偵測網路狀況,並根據網路狀况控制視訊編碼裝置的預測 編碼類型及對應的參考楨類迆,其中當網路擁塞時,視訊 編碼裝置對視訊圖像當前幀進行幀間預測編碼,並將該對 應的參考幀設置為預定長期參考幀’ 將視訊圖像當前幀的編碼資訊流經由網路發送至視訊解碼 裝置;098136246 reference block memory 'for storing reference frames and setting the reference frame type to short-term reference frame, predetermined long-term reference frame or determining long-term reference frame; and encoding controller 'for detecting the condition of the network and receiving the video decoding The notification message sent by the device controls the prediction coding class of the video coding device and the reference frame according to the network condition and the notification message, and sets the type of the reference frame; . : ft succession. When the controller detects that the network is congested, it controls the predictive coder to use the reference condition to perform interframe prediction encoding on the current video image and controls the reference frame memory to set a reference for the predetermined _ Reference frame; when the encoding controller is connected to &, then the control JIV·. - « - j. ~ :· < «· 2 The test memory sets the predetermined long-term reference frame as a poisoned long-term reference frame, And controlling the network programming device to perform inter-frame prediction encoding on subsequent frames of the video image by using the determined long-term reference frame before detecting the network recovery. 2. The video encoding apparatus according to claim 1, wherein the predictive encoder comprises: an inter prediction module 'for interframe predictive encoding of the video image; and an intra prediction module' Performing intra prediction on the video image to compose a video decoding device for receiving the video coding code. Generate coded information form number A0101 page 9th/total 25 pages 09 object 1〇, 〇201116067 stream, and then decode and transmit to video processing device 'This video decoding farm includes: Predicting maser, for pair The video image is predicted to be decoded; the reference is afraid of the memory, (4) the reference phase is stored, the type of the reference phase is the short-term reference check, the predetermined long-term reference 1 is determined for the long-term reference, and the decoding control is based on the received _ The information is left in the reference frame (see the type) and sends a notification message to the video encoding device; wherein '(4) is (4) predictive editing' and the corresponding reference frame is a long-term reference frame. The ^^^ coder selects (4) (4) the money to the pair of predictions, and the reference frame memory sets the reference frame of the pair to the predetermined long-term reference anger, and the notification message is sent by the decoding controller. And the video encoding device; when the reference code corresponding to the received encoded information stream is the predetermined long-term reference frame in the reference memory, the reference frame is set to the predetermined long-term reference frame Reference The frame is' and is used by the video decoder to perform inter-predictive decoding using the determined long-term reference frame. The video decoding device of claim 3, wherein the predictive decoder comprises: an inter prediction module 'for performing a predictive decompression on the received brewing information stream; and an intra prediction module 'For intra-predictive decoding of the received encoded information stream. A video encoding and decoding method for a video communication system including a video encoding device and a video gamma device, the video communication system for video capturing device 098136246, form nickname A0101, page 20 of 25 098206: 201116067 - video captured After the image is encoded, it is transmitted through the network and then decoded and sent to the video processing device. The method of encoding and decoding includes: detecting the network condition and controlling the predictive coding of the video encoding device according to the network condition. a type and a corresponding reference class, wherein when the network is congested, the video encoding device performs interframe prediction encoding on the current frame of the video image, and sets the corresponding reference frame to a predetermined long-term reference frame. The encoded information stream of the frame is sent to the video decoding device via the network; 098136246 視訊解碼裝置接收並分析該嗎訊圖像當前幀的編碼資訊流 ,判斷該視訊圖像當前幘的孩測編碼類型及對應的參考幀 類型; ,.·,,.. 右預測編碼顧型為幢間預測奪声,月j對應的·麥考ψ貞為長期 參考幀’則視訊解碼裝置查条_的篸暑幢進行幀間預 測解碼’並將該對應的參考摘設置為預定長期參考幀; 視訊解碼裝置發送通知報文至視訊編碼裝置告知已接收到 ..... Ί 該預定長期參考摘;· intent"-- ^1 -r 右視訊編碼裝置接收到該,則:將視訊編碼裝置中 的該預定長期參__嘗置參考械,並利用該確 定長期參考幀對視訊圖像下一幀進行幀間預測編碼,並將 生成的編碼資訊流發送至視訊解碼裝置; 視訊解碼裝置接收並分析所接收的該視訊圏像下一幀的編 碼資訊流,判斷該視訊圓像下一幀的預測編碼類型及對應 的參考幀類型; 若預測編碼類型為幀間預测編碼,且對應的參考幀為長期 參考幀,則將視訊解碼裝置中的該預定長期參考幀設置為 禮定長期參考# ’並利用該確定長期參相進行㈣預測 0982062110-0 表單編號A010I 第2】頁/共25頁 201116067 解碼; 繼續偵測網路狀況,並在網路狀況正常前利用該確定長期 參考幀對視訊圖像後續幀進行幀間預測編碼。 6 .如申請專利範圍第5項所述之視訊編解碼方法,還包括 當網路正常時,視訊編碼裝置對該視訊圖像當前幀進行正 常編碼。 7 .如申請專利範圍第5項所述之視訊編解碼方法,還包括以 下步驟: 若預測編碼類型不是幀間預測編碼,或對應的參考幀不是 長期參考幀,則視訊解碼裝置對該視訊圖像進行正常解碼 8 .如申請專利範固第5項所述之視訊編解碼方法,還包括以 下步驟: 若視訊解碼裝置未查找到對應參考幀,則結束對視訊圖像 當前幀的解碼。 9.如申請專利範圍第5項所述之視訊編解碼方法,還包括以 下步驟: 若視訊編碼裝置未接收到該通知報文,則更換其他參考幀 對該視訊圖像當前幀進行幀間預測編碼,並將生成的編碼 資訊流重新發送至該視訊解碼裝置。 098136246 表單編號A0101 第22頁/共25頁 0982(098136246 The video decoding device receives and analyzes the encoded information stream of the current frame of the image, determines the current child coding type of the video image and the corresponding reference frame type; , . . . , . . . For the prediction of the inter-tree prediction, the corresponding reference frame of the month j is the long-term reference frame 'the video decoding device checks the inter-frame prediction decoding' and sets the corresponding reference digest to the predetermined long-term reference. Frame; the video decoding device sends a notification message to the video encoding device to inform that it has been received..... Ί the predetermined long-term reference extract; · intent"-- ^1 -r The right video encoding device receives the: The predetermined long-term reference in the encoding device occupies the reference device, and uses the determined long-term reference frame to perform inter-frame prediction encoding on the next frame of the video image, and sends the generated encoded information stream to the video decoding device; video decoding The device receives and analyzes the received encoded information stream of the next frame of the video image, and determines the prediction coding type of the next frame and the corresponding reference frame type; For inter prediction coding, and the corresponding reference frame is a long-term reference frame, the predetermined long-term reference frame in the video decoding device is set as the ritual long-term reference # ' and is used to determine the long-term reference phase (4) prediction 0982062110-0 Form No. A010I Page 2] Total 25 pages 201116067 Decoding; Continue to detect the network condition and use the determined long-term reference frame to inter-predict and encode the subsequent frames of the video image before the network condition is normal. 6. The video encoding and decoding method according to claim 5, further comprising: when the network is normal, the video encoding device performs normal encoding on the current frame of the video image. 7. The video encoding and decoding method according to claim 5, further comprising the steps of: if the prediction coding type is not inter prediction coding, or the corresponding reference frame is not a long-term reference frame, the video decoding device is the video image. For example, the video encoding and decoding method described in claim 5 further includes the following steps: If the video decoding device does not find the corresponding reference frame, the decoding of the current frame of the video image is ended. 9. The video encoding and decoding method according to claim 5, further comprising the steps of: if the video encoding device does not receive the notification message, replacing the other reference frame to perform inter prediction on the current frame of the video image. Encoding and resending the generated encoded information stream to the video decoding device. 098136246 Form No. A0101 Page 22 of 25 0982(
TW98136246A 2009-10-27 2009-10-27 Video codec method, video encode device and video decode device TW201116067A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW98136246A TW201116067A (en) 2009-10-27 2009-10-27 Video codec method, video encode device and video decode device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW98136246A TW201116067A (en) 2009-10-27 2009-10-27 Video codec method, video encode device and video decode device

Publications (1)

Publication Number Publication Date
TW201116067A true TW201116067A (en) 2011-05-01

Family

ID=44934687

Family Applications (1)

Application Number Title Priority Date Filing Date
TW98136246A TW201116067A (en) 2009-10-27 2009-10-27 Video codec method, video encode device and video decode device

Country Status (1)

Country Link
TW (1) TW201116067A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI555388B (en) * 2014-06-11 2016-10-21 晨星半導體股份有限公司 Image encoding apparatus, image decoding apparatus and encoding and decoding methods thereof
TWI655860B (en) * 2016-08-30 2019-04-01 北京奇藝世紀科技有限公司 Inter prediction coding method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI555388B (en) * 2014-06-11 2016-10-21 晨星半導體股份有限公司 Image encoding apparatus, image decoding apparatus and encoding and decoding methods thereof
TWI655860B (en) * 2016-08-30 2019-04-01 北京奇藝世紀科技有限公司 Inter prediction coding method and device

Similar Documents

Publication Publication Date Title
RU2613738C2 (en) Signaling of state information for decoded picture buffer and reference picture lists
KR100878811B1 (en) Method of decoding for a video signal and apparatus thereof
TWI406572B (en) Error resilient video transmission using instantaneous receiver feedback and channel quality adaptive packet retransmission
KR100878812B1 (en) Method for providing and using information on interlayer prediction of a video signal
CN102045557B (en) Video encoding and decoding method and video encoding device and decoding device thereof
JP3957460B2 (en) Transmission header compression apparatus, moving picture encoding apparatus, and moving picture transmission system
JP4982024B2 (en) Video encoding method
TW200904194A (en) Feedback based scalable video coding
US20060188025A1 (en) Error concealment
US20040218669A1 (en) Picture coding method
US20090103613A1 (en) Method for Decoding Video Signal Encoded Using Inter-Layer Prediction
US20060146931A1 (en) Method and apparatus for low-complexity spatial scalable encoding
KR20070001134A (en) Method and apparatus for handling video communication errors
CN110392284B (en) Video encoding method, video data processing method, video encoding apparatus, video data processing apparatus, computer device, and storage medium
KR101377528B1 (en) Motion Vector Coding and Decoding Method and Apparatus
JP2003284078A (en) Method and apparatus for coding image, and method and apparatus for decoding image
US20100303151A1 (en) Method for decoding video signal encoded using inter-layer prediction
US20060193384A1 (en) Method and apparatus for low-complexity spatial scalable decoding
TW201116067A (en) Video codec method, video encode device and video decode device
JP2002010265A (en) Transmitting device and its method and receiving device and it method
EP1396091A2 (en) Motion compensation for fine-grain scalable video
CN110572675B (en) Video decoding and encoding methods and devices, storage medium, decoder and encoder
JP3183301B2 (en) Interframe difference signal change detection communication method
KR100363550B1 (en) Encoder and decoder in a wireless terminal for retransmitting a moving picture
CN110677647B (en) Video decoding and encoding methods and devices, storage medium, decoder and encoder