TW201230814A - Reference picture list management - Google Patents
Reference picture list management Download PDFInfo
- Publication number
- TW201230814A TW201230814A TW101109388A TW101109388A TW201230814A TW 201230814 A TW201230814 A TW 201230814A TW 101109388 A TW101109388 A TW 101109388A TW 101109388 A TW101109388 A TW 101109388A TW 201230814 A TW201230814 A TW 201230814A
- Authority
- TW
- Taiwan
- Prior art keywords
- view
- list
- reordering
- pic
- inter
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/114—Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
201230814 六、發明說明: 【發明所屬之技術領域】 大體而言’本發明係關於視頻編碼及解碼,更詳細地 說’係關於一種用於在使用高階語法之多視圖編碼視頻中 進行參考圖像清單管理的方法及裝置。 本申請案主張申請於2007年4月4日的美國臨時申請案第 60/921713號之權利,該申請案之全文以引用之方式併入 本文中。 【先前技術】 在目前基於H.264/MPEG-4 AVC的MVC之實施中,參考 軟體藉由用一單個編碼器對各個視圖進行編碼及考慮到交 叉視圖參考而達到多視圖預測。此外,MVC亦在該等不同 視圖間分離該frame_num及POC,從而使具有相同 frame一num及POC之圖像(例如屬於不同視圖之圖像)可被呈 現於解碼圖像緩衝區(DPB)。這些圖像使用與其關聯的 view_id而被差異化。 被用於重排序視圖間參考圖像之該等參考圖像清單重排 序命令強加一些限制於某些語法元素之該等值,此外,還 不能允許在該參考清單中複製一具有一特定view_id的圖 像。舉例來說’在參考圖像之一修改版本被當作一參考圖 像與該原始參考圖像一起使用之情況中,一參考圖像之複 製係有用的。這被使用於加權預測及自適應參考過濾中。 【發明内容】 在本發明之至少一項實施例中,對基於H 264/MPEG-4 I62373.doc 201230814 AVC的多視圖編碼標準之該高階語法做出一改變以允許高 效管理該等參考圖像清單。尤其係本發明允許藉由修改2 式而使視圖間參考圖像被複製於該最終參考清單中,該等 式係被用於選擇待添加至該參考清單之該視圓間圖像的索 引。舉例來說,在參考圖像之一修改版本被當作一參考圖 像與該原始參考圖像一起使用之情況中,該參考圖像之複 製係有用的》這被使用於加權預測及自適應參考過濾中。 經由本發明之一實施例,參考圖像之重排序亦可被更有 效地實施。例如,對於藉由使更加相關於該當前圖像之圖 像被呈現於該參考圖像清單之較低索引中來改進編碼效率 來說,參考圖像之重排序係有用的。在該MVC延伸中,一 組新的RPLR命令被引進以重排序視圖間參考圖像。這被 顯示於表2中。 在至少一個本發明之實施例中,該當前MVC規格中被具 體指定於該視圖索引值之衍生的該等等式被修改以允許對 該等參考圖像清單進行管理^此修改移除被強加於該當前 規格中之該等限制,並且允許在該參考清單中複製一視圖 間參考圖像。 【實施方式】 在本發明之至少一項實施例中,對基於H.264/MPEG-4 AVC的多視圖編碼標準之該高階語法做出一改變以允許高 效管理該等參考圖像清單。尤其係本發明允許視圖間圖像 藉由修改等式而被複製於該最終參考清單中,該等式係被 用於選擇待添加至該參考清單之該視圖間圖像的索引。 162373.doc 201230814 在目前基於H.264/MPEG-4 AVC的MVC之實施中,參考 軟體藉由用一單個編碼器對各個視圖進行編碼及考慮到交 叉視圖參考而達到多視圖預測。此外,MVC亦在該等不同 視圖間分離該frame_num及POC,從而使具有相同 frame一num及POC之圖像(例如屬於不同視圖之圖像)可被呈 現於DPB。這些圖像使用與其關聯的View_id而被差異化。 被用於重排序視圖間參考圖像之該等參考圖像清單重排 序命令強加一些限制於某些語法元素之該等值,此外,還 不能允許在該參考清單中複製一具有一特定view_id的圖 像。舉例來說’在參考圖像之一修改版本被當作一參考圖 像與該原始參考圖像一起使用之情況中’一參考圖像之複 製係有用的。這被使用於加權預測及自適應參考過濾中。 H.264/MPEG-4 AVC使編碼器/解碼器可為下一解碼切片 (slice)而暫時改變清單0(及B切片之清單丨)中之參考圖像的 預設順序。這可經由呈現於該切片標頭中之參考圖像重排 序(RPLR)命令而達成。這些RpLR命令被顯示於表丨中用於 RPLR之言吾法表中。 舉例來說’對於藉由使更加相關於該當前圖像之圖像被 呈現於該參考@像清單之較低索引^來改進編碼效率來 說’參考圖像之重排序係有用的。在河¥(:延伸中,一組新 的RPLR命令被引進以重排序視圖間參考圖像。這顯示於 表2中。 s亥等新RPLR命令之扭爲姑Ss _ | ^ t 義破顯不於表3中。此外語法 abs一diff_view_idx—minusl具有如下語義。 162373.doc 201230814 abs_diff_view_idx_minusl + l規定待置於該參考圖像清單 中之該當前索引的該圖像之該視圖索引及該視圖索引預測 值之間的絕對差。如果該當前解碼切片屬於一錨定圖像, 則 abs diff view idx minusl 應在 0 至 num anchor refs IX [curr_view_id]-l之範圍内,或者,如果其屬於一非猫定圖 像,則在0至 num_non_anchor_refs_IX[curr_view_id]-l 之範 圍内。curr_view」d等於容納該當前切片之該視圖的該 view_id。abs_diff_view_idx_minusl 之允許值被進一步限 制,如規定於MVC子條款H.8.2.2.3中。 一視圖間圖像之一視圖索引指示依賴MVC SPS延伸中之 當前解碼視圖而產生的該視圖間圖像之該view_id的順 序。對於一具有等於view_index之視圖索引的圖像來說, 如果該當前編碼切片屬於一錯定圖像,其view_id等於 anchor_ref_IX[curr_view_id][view_index],或者,如果該 編碼切片屬於一非猫定圖像,則其view_id等於non anchor_ref_IX[curr_view_id][view_index] 0 表1 :參考圖像清單在AVC中之重排序語法 ref_pic_list_reordering( ) { C 描述元 \f( slice_type != I && slice_type != SI && slice_type != El) { /* slice type El is specified in Annex F */ ref_pic_list一reordering^flagJO 2 u(l) if( ref pic list reordering flag 10 ) do { reordering^ofjic一nums一 idc 2 ue(v) if(reordering_of_pic_numsJdc == 0 11 reordering of pic nums idc == 1 ) abs一diffjpic一num_minusl 2 ue(v) else if( reordering_of_pic_nums_idc == 2) long^termjpic—num 2 ue(v) } while( reordering^ofjaic一nums一idc != 3 ) } 162373.doc 201230814 if( slice_type == B | 丨 slice_type == EB) { /* slice type EB is specified in Annex F */ refjjicJis^reordering^flag^ll 2 u(l) if( ref_pic_list_reordering_flag_ll ) do { reordering_of_pic_numsJdc 2 ue(v) if(reordering_of_pic_nums_idc == 0 11 reordering of pic nums idc == 1) abs_diff_pic 一 num一minusi 2 ue(v) else if( reordering_of_pic_nums_idc == 2 ) long_term_pic_num 2 ue(v) } while( reordering_of_pic—nums—idc != 3 ) } } 表2:參考圖像清單在MVC中之重排序語法 ref_pic_list_reordering() { C 描述元 if( slice_type != I && slice type != ) { ref_pic一 Hst_reordering^flagJO 2 u(l) if( ref_pic_list_reordering_flag_10 ) do { reordering一of_pic_nums_idc 2 ue(v) if( reorderingL_of_pic_nums_idc = = 0 11 reordering of pic nums idc == 1) abs 一diff_pic一 num_minusl 2 ue(v) else if( reordering一of_pic_nums_idc == 2) long_term_j)ic_nuin 2 ue(v) if (reordering一ofjpic一nums_idc == 4 11 reordering of pic nums idc == 5) abs一diff_view—idx一 minusl 2 ue(v) } while( reordering_of_pic_nums_idc != 3 ) } if( slice_type == B 11 slice_type == EB) { ref_pic一 list—reorderin^flag^ll 2 u(l) if( ref_picJist_reordering_flag_ll ) do { reordering_of_pic_nums_idc 2 ue(v) if( reordering_of_pic_nums_idc == 0 11 reordering of pic nums idc == 1 ) abs 一 diffjic一 num 一 minusl 2 ue(v) else if( reordering_of_pic_nums_idc == 2 ) long_term jpic_nu m 2 ue(v) if (reordering_of_pic_nums_idc == 4 11 reordering of pic nums idc == 5) abs一diff_view_idx_minusl 2 ue(v) } while( reordering_of_pic_nums_idc != 3 ) } > 162373.doc 201230814 表3 :在MVC中用於參考圖像清單重排序的reordering— of_pic_nums_idc 操作 reordering _of .pic_nums_ idc 指定之重排序 0 abs_diff_pic num minusl係存在並且對應於用以自圓像號碼預測伹減 去£差值-_ 1 abs_diff_pic_num_minusl係存在並且對應於用以加至圖像號瑪預測值 之i值 _ _ 2 long^term^pic num係存在並且指定參考圖像的長期圓像號瑪 3 結束重排序初始參考圈像清單之迴圈 4 abs_diff_view_idx minusl係存在並且對應於用以自視圖索引預測值減 去£差盈 ~ 5 abs diff view idx minusl係存在並且對應於用以加至視圓索引預測值 之;^值_ 一一 在至少一項實施例中,本發明修改在該當前MVC規格中 被具體指定於該視圖索引值之衍生的該等等式以允許對該 等參考圖像清單進行管理。此修改移除被強加於該當前規 格中之該等限制,並且允許在該參考清單中複製一視圖間 參考圖像。 視圖間圖像之該重排序過程一般被規定為: 輸入至此過程的為參考圖像清單RefPicListX(X為0或1) 及一索引refldxLX被輸入該清單。. 此過程之輸出為一可能修改的參考圖像清單 RefPicListX(X為0或 1)及該增量索引 refldxLX。 該可變picViewIdxLX如下而被導出: -If reordering_of_pic_nums_idc is equal to 4 picViewIdxLX = picViewIdxLXPred - ( abs_diff_view_idx_minusl + 1) (1) -Otherwise (reordering一of_pic_nums_idc is equal to 5), picViewIdxLX = picViewIdxLXPred + ( abs_diff_view_idx_minusl+ 1 ) (2) picViewIdxLXPred為該可變picViewIdxLX之預測值。當 -9- 162373.doc 201230814 規定於此子條款的該過程被首次行使用於一切片(即用於 在該 ref_pic_list_reordering()語法中等於 4 或 5之 reordering— of_pic_nums_idc的首次產生)時 ’ picViewIdxLOPred被最初 設定為等於〇。當規定於此子條款的該過程被首次行使用 於一切片且reordering_of_pic_nums_idc等於4及該隨後的 abs diff view idx minusl 等於 0 時’該 picViewIdxLX被直 接導出為0而無須使用上述該等等式。在picViewIdxLX之 各個分配後,picViewIdxLX之值被分配至picViewIdxLXPred。 接下去該等程式旨在將具有等於picViewIdxLX之視圖索 引的該視圖間圖像放置於該索引位置refldxLX中,稍後將 任何其他留下的圖像之位置轉移至該清單中,如下所示。201230814 VI. Description of the Invention: [Technical Field of the Invention] In general, the present invention relates to video encoding and decoding, and more particularly to a reference image for use in multi-view encoded video using higher-order syntax. Method and device for inventory management. The present application claims the benefit of U.S. Provisional Application No. 60/921,713, filed on Apr. 4, 2007, the disclosure of which is incorporated herein by reference. [Prior Art] In the current implementation of H.264/MPEG-4 AVC-based MVC, the reference software achieves multi-view prediction by encoding individual views with a single encoder and considering cross-view references. In addition, MVC also separates the frame_num and POC between the different views so that images with the same frame-num and POC (e.g., images belonging to different views) can be rendered in the decoded image buffer (DPB). These images are differentiated using the view_id associated with them. The reference image list reordering commands used to reorder the inter-view reference images impose some restrictions on certain grammar elements and, in addition, do not allow copying of a particular view id in the reference list. image. For example, in the case where a modified version of a reference image is used as a reference image with the original reference image, copying of a reference image is useful. This is used in weighted prediction and adaptive reference filtering. SUMMARY OF THE INVENTION In at least one embodiment of the present invention, a change is made to the higher-order syntax of the multi-view coding standard based on H 264/MPEG-4 I62373.doc 201230814 AVC to allow efficient management of the reference images List. In particular, the present invention allows an inter-view reference image to be copied into the final reference list by modifying Equation 2, which is used to select an index of the inter-circle image to be added to the reference list. For example, in the case where a modified version of a reference image is used as a reference image with the original reference image, the copying of the reference image is useful. This is used for weighted prediction and adaptation. Refer to the filter. Reordering of reference images can also be implemented more efficiently via an embodiment of the invention. For example, reordering of reference images is useful for improving coding efficiency by rendering images more relevant to the current image in a lower index of the list of reference images. In this MVC extension, a new set of RPLR commands was introduced to reorder the inter-view reference images. This is shown in Table 2. In at least one embodiment of the invention, the equation of the current MVC specification specifically designated for the derivative of the view index value is modified to allow management of the list of reference images. The limitations in this current specification and allow an inter-view reference image to be copied in the reference list. [Embodiment] In at least one embodiment of the present invention, a change is made to the higher order syntax of the H.264/MPEG-4 AVC based multiview coding standard to allow for efficient management of the reference picture lists. In particular, the present invention allows an inter-view image to be copied into the final reference list by modifying the equation, which is used to select an index of the inter-view image to be added to the reference list. 162373.doc 201230814 In the current implementation of H.264/MPEG-4 AVC-based MVC, the reference software achieves multi-view prediction by encoding individual views with a single encoder and considering cross-view references. In addition, MVC also separates the frame_num and POC between the different views so that images with the same frame-num and POC (e.g., images belonging to different views) can be rendered in the DPB. These images are differentiated using the View_id associated with them. The reference image list reordering commands used to reorder the inter-view reference images impose some restrictions on certain grammar elements and, in addition, do not allow copying of a particular view id in the reference list. image. For example, the copying of a reference image is useful in the case where a modified version of a reference image is used as a reference image with the original reference image. This is used in weighted prediction and adaptive reference filtering. The H.264/MPEG-4 AVC enables the encoder/decoder to temporarily change the preset order of the reference pictures in Listing 0 (and the list of B slices) for the next decoded slice. This can be achieved via a Reference Image Reordering (RPLR) command presented in the slice header. These RpLR commands are displayed in the table for the RPLR statement. For example, reordering of reference images is useful for improving coding efficiency by making images that are more relevant to the current image appear on the lower index of the reference @image list. In the river ¥ (: extension, a new set of RPLR commands was introduced to reorder the reference images between views. This is shown in Table 2. The new RPLR command of shai and other sin s _ | ^ t Not in Table 3. In addition, the syntax abs-diff_view_idx_minusl has the following semantics. 162373.doc 201230814 abs_diff_view_idx_minusl + l specifies the view index of the image of the current index to be placed in the reference image list and the view index Absolute difference between predicted values. If the current decoded slice belongs to an anchor image, abs diff view idx minusl should be in the range of 0 to num anchor refs IX [curr_view_id]-l, or if it belongs to a non- The cat image is in the range of 0 to num_non_anchor_refs_IX[curr_view_id]-l. curr_view"d is equal to the view_id of the view that holds the current slice. The allowable value of abs_diff_view_idx_minusl is further limited, as specified in the MVC sub-clause H. 8.2.2.3. An inter-view image one view index indicates the order of the view_id of the inter-view image generated depending on the current decoded view in the MVC SPS extension. For an image having a view index equal to view_index, if the current coded slice belongs to a mis-determined image, its view_id is equal to anchor_ref_IX[curr_view_id][view_index], or if the coded slice belongs to a non-cat image , its view_id is equal to non anchor_ref_IX[curr_view_id][view_index] 0 Table 1: Reordering syntax of reference picture list in AVC ref_pic_list_reordering( ) { C description element\f( slice_type != I && slice_type != SI && slice_type != El) { /* slice type El is specified in Annex F */ ref_pic_list-reordering^flagJO 2 u(l) if( ref pic list reordering flag 10 ) do { reordering^ofjic-nums-idc 2 ue(v) if(reordering_of_pic_numsJdc == 0 11 reordering of pic nums idc == 1 ) abs-diffjpic-num_minusl 2 ue(v) else if( reordering_of_pic_nums_idc == 2) long^termjpic-num 2 ue(v) } While( reordering^ofjaic-nums-idc != 3 ) } 162373.doc 201230814 if( slice_type == B | 丨slice_type == EB) { /* slice type EB is specified in Annex F */ re fjjicJis^reordering^flag^ll 2 u(l) if( ref_pic_list_reordering_flag_ll ) do { reordering_of_pic_numsJdc 2 ue(v) if(reordering_of_pic_nums_idc == 0 11 reordering of pic nums idc == 1) abs_diff_pic a num-minusi 2 ue(v) Else if( reordering_of_pic_nums_idc == 2 ) long_term_pic_num 2 ue(v) } while( reordering_of_pic—nums—idc != 3 ) } } Table 2: Reordering syntax of reference image list in MVC ref_pic_list_reordering() { C Description element if ( slice_type != I && slice type != ) { ref_pic - Hst_reordering^flagJO 2 u(l) if( ref_pic_list_reordering_flag_10 ) do { reordering an of_pic_nums_idc 2 ue(v) if( reorderingL_of_pic_nums_idc = = 0 11 reordering of pic nums Idc == 1) abs a diff_pic a num_minusl 2 ue(v) else if( reordering anof_pic_nums_idc == 2) long_term_j)ic_nuin 2 ue(v) if (reordering an ofjpic a nums_idc == 4 11 reordering of pic nums idc = = 5) abs-diff_view—idx-minusl 2 ue(v) } while( reordering_of_pic_nums_idc != 3 ) } if ( slice_type == B 11 slice_type == EB) { ref_pic_list_reorderin^flag^ll 2 u(l) if( ref_picJist_reordering_flag_ll ) do { reordering_of_pic_nums_idc 2 ue(v) if( reordering_of_pic_nums_idc == 0 11 reordering of pic nums idc == 1 ) abs a diffjic-num a minusl 2 ue(v) else if( reordering_of_pic_nums_idc == 2 ) long_term jpic_nu m 2 ue(v) if (reordering_of_pic_nums_idc == 4 11 reordering of pic nums idc == 5) abs one Diff_view_idx_minusl 2 ue(v) } while( reordering_of_pic_nums_idc != 3 ) } > 162373.doc 201230814 Table 3: reordering for the reference image list reordering in MVC — of_pic_nums_idc operation reordering _of .pic_nums_ idc specified reordering 0 Abs_diff_pic num minusl is present and corresponds to the difference from the round image number 伹 minus the difference - _ 1 abs_diff_pic_num_minus1 is present and corresponds to the i value used to add to the predicted value of the image number _ _ 2 long^term^ Pic num is present and specifies the long-term circular image of the reference image. Ma 3 ends the reordering of the initial reference circle. The loop 4 abs_diff_view_idx minusl exists and corresponds to the subtracted value from the view index prediction value. 5 abs diff view idx minusl exists and corresponds to the predicted value added to the view circle index; In at least one embodiment, the present invention modifies the equations specified in the current MVC specification that are specifically derived from the view index value to allow management of the list of reference images. This modification removes the restrictions imposed on the current specification and allows an inter-view reference image to be copied in the reference list. The reordering process of the inter-view image is generally specified as: The input image list RefPicListX (X is 0 or 1) and an index refldxLX are input to the list. The output of this process is a list of possible modified reference images RefPicListX (X is 0 or 1) and the incremental index refldxLX. The variable picViewIdxLX is derived as follows: -If reordering_of_pic_nums_idc is equal to 4 picViewIdxLX = picViewIdxLXPred - ( abs_diff_view_idx_minusl + 1) (1) -Otherwise (reordering_of_pic_nums_idc is equal to 5), picViewIdxLX = picViewIdxLXPred + ( abs_diff_view_idx_minusl+ 1 ) (2 ) picViewIdxLXPred is the predicted value of the variable picViewIdxLX. When -9-162373.doc 201230814 specifies that this process of this sub-clause is first exercised for a slice (ie for the first generation of reordering_of_pic_nums_idc equal to 4 or 5 in the ref_pic_list_reordering() syntax), picViewIdxLOPred is Initially set equal to 〇. When the process stipulated in this subclause is used for the first time in a slice and reordering_of_pic_nums_idc is equal to 4 and the subsequent abs diff view idx minusl is equal to 0, the picViewIdxLX is directly derived as 0 without using the above equation. After each assignment of picViewIdxLX, the value of picViewIdxLX is assigned to picViewIdxLXPred. Next, the programs are intended to place the inter-view image having a view index equal to picViewIdxLX in the index position refldxLX, and later transfer the position of any other remaining images to the list as shown below.
TargetViewID =num_multiview_refs_for_listX[picViewIdxLX] for( cldx = num_ref_idx_IX_active_minusl + 1; cldx > refldxLX; cldx—) RefPicListX[ cldx ] = RefPicListX[ cldx- 1]TargetViewID = num_multiview_refs_for_listX[picViewIdxLX] for( cldx = num_ref_idx_IX_active_minusl + 1; cldx >refldxLX; cldx—) RefPicListX[ cldx ] = RefPicListX[ cldx- 1]
RefPicListX[ refldxLX++ ] = inter-view reference picture with view id equal toRefPicListX[ refldxLX++ ] = inter-view reference picture with view id equal to
TargetViewIDTargetViewID
nldx = refldxLX for( cldx = refldxLX; cldx <= num_ref_idx_IX_active_minusl + 1; cldx++ ) if( ViewID(RefPicListX[ cldx ]) != TargetViewID | |Nldx = refldxLX for( cldx = refldxLX; cldx <= num_ref_idx_IX_active_minusl + 1; cldx++ ) if( ViewID(RefPicListX[ cldx ]) != TargetViewID | |
PictureOrderCnt(RefPicListX[ cldx ])!=CurrPOC )PictureOrderCnt(RefPicListX[ cldx ])!=CurrPOC )
RefPicListX[ nldx++ ] = RefPicListXf cldx ] 其中CurrPOC指示該當前解碼圖像之該PicOrderCnt()。 從上面可知其強加如下之限制: 當規定於此子條款的該過程被首次行使用於一切片且 reordering_of_pic_nums_idc 等於 4 及下一 abs_diff一view_ 162373.doc -10- 201230814 idx_minusl語法元素等於0,則該picViewIdxLX被直接導 出為0而無須使用上述等式。舉例來說,如果 picViewIdxLXPred及 abs_diff_view」dx_minusl 都具有初始 值0,其杜絕picViewIdxLX具有一負值之可能性。 此外使用等式(1)及(2)不可能複製該參考清單中之該整 體,因為這些等式將產生不正確值。 為解決此等問題,至少一項實施例建議以如下方式修改 該等兩個等式(1)及(2)。 該可變picViewIdxLX如下而被導出。 -If reordering_of_pic_nums_idc is equal to 4 if(picViewIdxLXPred - (abs_diff_view_idx_minusl + 1) < 0) picViewIdxLX = picViewIdxLXPred - (abs_diff_view_idx_minusl + 1) + MaxViewIdx (3) else picViewIdxLX = picViewIdxLXPred - (abs diff view idx minusl + 1) -Otherwise (reordering_of__pic_nums_idc is equal to 5), if(picViewIdxLXPred + (abs_diff_view_idx_minusl + 1) >= MaxViewIdx) 162373.doc 201230814 picViewIdxLX = picViewIdxLXPred + (absdiffviewidxminusl + 1)-MaxViewIdx (4) else picViewIdxLX = picViewIdxLXPred + (abs一diff一view_idx_minusl 十 1)RefPicListX[ nldx++ ] = RefPicListXf cldx ] where CurrPOC indicates the PicOrderCnt() of the currently decoded image. It can be seen from the above that it imposes the following restrictions: When the procedure specifying this sub-clause is exercised for a slice for the first time and reordering_of_pic_nums_idc is equal to 4 and the next abs_diff-view_162373.doc -10- 201230814 idx_minusl syntax element is equal to 0, then picViewIdxLX is directly exported to 0 without using the above equation. For example, if picViewIdxLXPred and abs_diff_view"dx_minusl both have an initial value of 0, it eliminates the possibility that picViewIdxLX has a negative value. Furthermore, it is not possible to copy the whole of the reference list using equations (1) and (2) because these equations will produce incorrect values. To address these issues, at least one embodiment suggests modifying the two equations (1) and (2) in the following manner. The variable picViewIdxLX is derived as follows. -If reordering_of_pic_nums_idc is equal to 4 if(picViewIdxLXPred - (abs_diff_view_idx_minusl + 1) < 0) picViewIdxLX = picViewIdxLXPred - (abs_diff_view_idx_minusl + 1) + MaxViewIdx (3) else picViewIdxLX = picViewIdxLXPred - (abs diff view idx minusl + 1) -Otherwise (reordering_of__pic_nums_idc is equal to 5), if(picViewIdxLXPred + (abs_diff_view_idx_minusl + 1) >= MaxViewIdx) 162373.doc 201230814 picViewIdxLX = picViewIdxLXPred + (absdiffviewidxminusl + 1)-MaxViewIdx (4) else picViewIdxLX = picViewIdxLXPred + (abs-diff one View_idx_minusl ten 1)
MaxViewIdx為一可變值,在等式(3)及(4)中之值 MaxViewIdx使用自該SPS MVC延伸的該語法而被導出, 如下所示: 若該當前圖像為一錨定圖像,則MaxViewIdx is a variable value, and the value MaxViewIdx in equations (3) and (4) is derived using the syntax extended from the SPS MVC, as follows: If the current image is an anchor image, then
MaxViewIdx=num_anchor_refs_IX[curr_view_id] 否則,MaxViewIdx=num_anchor_refs_IX[curr_view_id] Otherwise,
MaxViewIdx=num_non_anchor_refs_IX[curr_view id] 顯然,該編碼器及該解碼器都可導出MaxViewIdx之該等 值。 此方法之一優點為藉由用信號發送abs_diff_ view_idx_minusl至一等於(MaxViewIdx-Ι)的值,複製一特 定視圖索引值係可能的。意即,藉由使用表2之該語法以 用信號發送如此之一值,則一特定視圖索引值將被複製於 該解碼器之該參考清單中,因為picViewIdxLX= picViewIdxLXPred。 此外,當"reordering_of_pic_nums_idc=4"係 用於該切片 之第一條命令時,此方法移除原來被強加於 abs_diff_view」dx_minusl之該值上的限制。意即, picViewIdxLX需被自動設定為這係因為恰好在等式(3) I62373.doc -12- 201230814 上方的第一個"if"陳述式捕捉(catch)picViewIdLX之一潛在 無效值的發生(如用現存等式(1)計算)。 本文描述之特徵及態樣允許(例如)在一參考圖像清單中 複製一視圖間參考圖像。這種複製可僅涉及複製指向一實 際參考圖像之一指標(包括像素值),在這種情況中,該參 考圖像清單可以例如包括指向一個或多個實際參考圖像之 一系列指標。該等實際參考圖像可被儲存於例如一解碼圖 像緩衝區中。在一此種實施方案中,該參考圖像清單中之 該等指標之一或多者被複製,因此該等指標指向該相同的 實際參考圖像。 在一參考圖像清單中複製視圖間參考圖像可被用於例如 執行自適應參考過濾中,如2〇〇6年7月18曰申請,標題為 "用於視頻編碼之自適應參考圖框過濾,,(AdaptWe Reference Frame Filtering for Vide〇 c〇ding)的美國臨時申 請案第60/807,645號所描述,其全文以引用之方式併入於 本文中。 應明暸實施例亦可在-參考圖像清單中複製由多個指標 指向的該實際參考圖像。另外,實施例可維持一包括該等 實際參考圖像而不僅僅係指向該等實際參考圖像之指標的 參考圖像清單。 0 "" 所描述實施例之特徵及態樣亦適詩其他實施例。舉例 來說,維持參相像之—清單的其他編碼/解碼過程可允 許在該清單中之-參考圖像之複製。這些其他編碼 過程顧及到使用例如顯式信令或隱式信令的這種複製。作 162373.doc -13· 201230814 為顯式化令之—例樣,一實施例可包括每個編碼圈像指示 —特定參考圖像是否待複製於該清單中之語法。 过於此之該實施例可被實施於例如一種方法或過程, 種裝置’或一種軟體程式中。即使在只被論述於—實施MaxViewIdx=num_non_anchor_refs_IX[curr_view id] Obviously, both the encoder and the decoder can derive the value of MaxViewIdx. One of the advantages of this method is that it is possible to copy a particular view index value by signaling the value of abs_diff_view_idx_minusl to a value equal to (MaxViewIdx-Ι). That is, by using the syntax of Table 2 to signal such a value, a particular view index value will be copied into the reference list of the decoder because picViewIdxLX = picViewIdxLXPred. In addition, when "reordering_of_pic_nums_idc=4" is used for the first command of the slice, this method removes the restriction that was originally imposed on the value of abs_diff_view"dx_minusl. That is, picViewIdxLX needs to be automatically set to this because the first invalid value of one of the first "if"statement capture picViewIdLX just above equation (3) I62373.doc -12- 201230814 ( Use the existing equation (1) to calculate). The features and aspects described herein allow, for example, to copy an inter-view reference image in a reference image list. Such duplication may involve only copying an indicator (including pixel values) that points to an actual reference image, in which case the reference image list may, for example, include a series of indicators that point to one or more actual reference images. The actual reference images can be stored, for example, in a decoded image buffer. In one such embodiment, one or more of the indicators in the list of reference images are copied, such that the indicators point to the same actual reference image. Copying the inter-view reference image in a reference image list can be used, for example, to perform adaptive reference filtering, such as July 18, 2008, titled "Adaptive Reference for Video Coding </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; It should be understood that the embodiment may also copy the actual reference image pointed to by the plurality of indicators in the -reference image list. Additionally, embodiments may maintain a list of reference images that include the actual reference images and not just pointers to the actual reference images. 0 "" The features and aspects of the described embodiments are also applicable to other embodiments. For example, maintaining the parametric image—the other encoding/decoding process of the list—allows the copying of the reference image in the list. These other encoding processes allow for such replication using, for example, explicit signaling or implicit signaling. 162373.doc -13· 201230814 To be explicit, an embodiment may include a syntax for each coded circle image - whether a particular reference picture is to be copied in the list. This embodiment may be implemented, for example, in a method or process, a device, or a software program. Even if it is only discussed - implementation
例之"""單一形/ I 心式(例如,只如一方法而被論述)的背景下, 該實施例或論述特徵亦可被實施於其他形式(例如,一裝 置或程式)中。一裝置可被實施於例如適當硬體,軟體, 及動體中。該等方法可被實施於例如-裝置如-解碼器, 編碼器,或一些其他處理器件中。另外,該等方法可藉 被、處理器件或其他裝置執行之指令而被實施,這些指 、儲存於電腦可讀取媒體如一 CD或其他電腦可讀 取器件’或一積體電路中。 熟悉此項技術者應明白,實施例亦可產生一被編排以攜 帶例如可被儲存或發送之資訊的信號。該資訊可包括,例 如用於執仃一種方法之指令,或由一個上述該等實施例 產生,資料。舉例來說,_信號可被編排以如數據一樣攜 帶該等值,用於該顯式信令語法。 人此外,此申請案可計算出其他實施例。例如,可藉由組 。刪減 '修&,或增補該等被揭示之實施例的不同特徵 而創造出附加實施例。 該等請求項提供-簡短㈣时施狀料。該清單不 是為了詳盡徹底而僅僅是為對該等數個可能的實施例提供 若干簡短描述。 · 【圖式簡單說明】 I62373.doc 201230814 表1顯示該參考圖像清單在AVC中之重排序語法。 表2顯示該參考圖像清單在MVC中之重排序語法。 表3顯示在MVC中用於參考圖像清單重排 Reordering_of一pics_nums」dc操作 〇 162373.doc 15In the context of a """ unitary/I-heart (e.g., discussed only as a method), the embodiment or discussion features can be implemented in other forms (e.g., a device or program). . A device can be implemented, for example, in a suitable hardware, a soft body, and a moving body. The methods can be implemented, for example, in a device such as a decoder, an encoder, or some other processing device. In addition, the methods can be implemented by instructions executed by a processing device or other device, stored in a computer readable medium such as a CD or other computer readable device or an integrated circuit. Those skilled in the art will appreciate that embodiments can also produce a signal that is arranged to carry, for example, information that can be stored or transmitted. The information may include, for example, instructions for performing a method, or data generated by one of the above embodiments. For example, the _ signal can be arranged to carry the value as data for the explicit signaling syntax. In addition, this application can calculate other embodiments. For example, it can be by group. Additional embodiments are created by omitting the 'repair', or supplementing the different features of the disclosed embodiments. These request items are provided - short (four) time. This list is not intended to be exhaustive, but merely to provide a brief description of the several possible embodiments. · [Simple description of the schema] I62373.doc 201230814 Table 1 shows the reordering syntax of this reference image list in AVC. Table 2 shows the reordering syntax of this reference image list in MVC. Table 3 shows the reordering of the reference image list in MVC Reordering_of-pics_nums" dc operation 〇 162373.doc 15
Claims (1)
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US92171307P | 2007-04-04 | 2007-04-04 |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201230814A true TW201230814A (en) | 2012-07-16 |
TWI533669B TWI533669B (en) | 2016-05-11 |
Family
ID=39739681
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW097112372A TWI422230B (en) | 2007-04-04 | 2008-04-03 | Reference picture list management |
TW101109389A TWI551116B (en) | 2007-04-04 | 2008-04-03 | Reference picture list management |
TW101109388A TWI533669B (en) | 2007-04-04 | 2008-04-03 | Reference picture list management |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW097112372A TWI422230B (en) | 2007-04-04 | 2008-04-03 | Reference picture list management |
TW101109389A TWI551116B (en) | 2007-04-04 | 2008-04-03 | Reference picture list management |
Country Status (8)
Country | Link |
---|---|
US (1) | US20100118933A1 (en) |
EP (1) | EP2135456B1 (en) |
JP (5) | JP5273824B2 (en) |
KR (1) | KR101418627B1 (en) |
CN (1) | CN101647287B (en) |
BR (1) | BRPI0809210A2 (en) |
TW (3) | TWI422230B (en) |
WO (1) | WO2008123917A2 (en) |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010086500A1 (en) | 2009-01-28 | 2010-08-05 | Nokia Corporation | Method and apparatus for video coding and decoding |
WO2010090630A1 (en) * | 2009-02-03 | 2010-08-12 | Thomson Licensing | Methods and apparatus for motion compensation with smooth reference frame in bit depth scalability |
EP2424240A4 (en) * | 2009-04-22 | 2013-04-10 | Lg Electronics Inc | Reference picture list changing method of multi-view video |
ES2739475T3 (en) * | 2009-05-11 | 2020-01-31 | Ntt Docomo Inc | Device, method and program for encoding moving images, and device, method and program for decoding moving images |
US8780999B2 (en) | 2009-06-12 | 2014-07-15 | Qualcomm Incorporated | Assembling multiview video coding sub-BITSTREAMS in MPEG-2 systems |
US8411746B2 (en) * | 2009-06-12 | 2013-04-02 | Qualcomm Incorporated | Multiview video coding over MPEG-2 systems |
JPWO2011013257A1 (en) * | 2009-07-29 | 2013-01-07 | パナソニック株式会社 | Multi-view video decoding apparatus and method |
US9485492B2 (en) | 2010-09-14 | 2016-11-01 | Thomson Licensing Llc | Compression methods and apparatus for occlusion data |
JP2014506063A (en) * | 2011-01-07 | 2014-03-06 | サムスン エレクトロニクス カンパニー リミテッド | Video prediction method and apparatus capable of bidirectional prediction and unidirectional prediction, video encoding method and apparatus, and video decoding method and apparatus |
US9008176B2 (en) * | 2011-01-22 | 2015-04-14 | Qualcomm Incorporated | Combined reference picture list construction for video coding |
US8934552B2 (en) * | 2011-03-31 | 2015-01-13 | Qualcomm Incorporated | Combined reference picture list construction and mapping |
US9521418B2 (en) * | 2011-07-22 | 2016-12-13 | Qualcomm Incorporated | Slice header three-dimensional video extension for slice header prediction |
US11496760B2 (en) | 2011-07-22 | 2022-11-08 | Qualcomm Incorporated | Slice header prediction for depth maps in three-dimensional video codecs |
US9288505B2 (en) | 2011-08-11 | 2016-03-15 | Qualcomm Incorporated | Three-dimensional video with asymmetric spatial resolution |
EP2751998A4 (en) * | 2011-08-30 | 2015-08-12 | Intel Corp | Multiview video coding schemes |
US9338474B2 (en) | 2011-09-23 | 2016-05-10 | Qualcomm Incorporated | Reference picture list construction for video coding |
US9264717B2 (en) | 2011-10-31 | 2016-02-16 | Qualcomm Incorporated | Random access with advanced decoded picture buffer (DPB) management in video coding |
US9485503B2 (en) | 2011-11-18 | 2016-11-01 | Qualcomm Incorporated | Inside view motion prediction among texture and depth view components |
CN104054351B (en) | 2012-01-17 | 2017-07-14 | 瑞典爱立信有限公司 | Reference picture list processing |
KR20230111277A (en) * | 2012-01-19 | 2023-07-25 | 브이아이디 스케일, 인크. | Method and apparatus for signaling and construction of video coding reference picture lists |
CN107835428B (en) * | 2012-03-02 | 2021-09-24 | 太阳专利托管公司 | Image encoding method, image decoding method, image encoding device, image decoding device, and image encoding/decoding device |
CN104380750B (en) | 2012-04-16 | 2018-07-27 | 三星电子株式会社 | Method and apparatus for the reference picture collection for determining image |
US9438898B2 (en) | 2012-09-07 | 2016-09-06 | Vid Scale, Inc. | Reference picture lists modification |
US9807407B2 (en) * | 2013-12-02 | 2017-10-31 | Qualcomm Incorporated | Reference picture selection |
EP3197163A4 (en) * | 2014-10-07 | 2017-09-13 | Samsung Electronics Co., Ltd. | Method and device for encoding or decoding multi-layer image, using inter-layer prediction |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3443880B2 (en) * | 1992-09-18 | 2003-09-08 | ソニー株式会社 | Video signal encoding method and decoding method |
GB2352350B (en) * | 1999-07-19 | 2003-11-05 | Nokia Mobile Phones Ltd | Video coding |
JP2004007379A (en) * | 2002-04-10 | 2004-01-08 | Toshiba Corp | Method for encoding moving image and method for decoding moving image |
KR100481732B1 (en) * | 2002-04-20 | 2005-04-11 | 전자부품연구원 | Apparatus for encoding of multi view moving picture |
US7489342B2 (en) * | 2004-12-17 | 2009-02-10 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for managing reference pictures in multiview videos |
BRPI0413979A (en) * | 2003-08-26 | 2006-11-07 | Thomson Licensing | method and apparatus for minimizing the number of reference images used for inter-coding |
US20060083298A1 (en) * | 2004-10-14 | 2006-04-20 | Nokia Corporation | Reference picture management in video coding |
US7710462B2 (en) * | 2004-12-17 | 2010-05-04 | Mitsubishi Electric Research Laboratories, Inc. | Method for randomly accessing multiview videos |
US7728878B2 (en) * | 2004-12-17 | 2010-06-01 | Mitsubishi Electric Research Labortories, Inc. | Method and system for processing multiview videos for view synthesis using side information |
US7728877B2 (en) * | 2004-12-17 | 2010-06-01 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for synthesizing multiview videos |
KR100732961B1 (en) * | 2005-04-01 | 2007-06-27 | 경희대학교 산학협력단 | Multiview scalable image encoding, decoding method and its apparatus |
JP2007067842A (en) * | 2005-08-31 | 2007-03-15 | Victor Co Of Japan Ltd | Apparatus and method for editing moving image coding data |
US8559515B2 (en) * | 2005-09-21 | 2013-10-15 | Samsung Electronics Co., Ltd. | Apparatus and method for encoding and decoding multi-view video |
KR100937431B1 (en) * | 2006-03-30 | 2010-01-18 | 엘지전자 주식회사 | A method and apparatus for decoding/encoding a video signal |
JP2007336275A (en) * | 2006-06-15 | 2007-12-27 | Toshiba Corp | Moving image reproducing device |
KR101368493B1 (en) * | 2006-10-13 | 2014-02-28 | 톰슨 라이센싱 | Reference picture list management syntax for multiple view video coding |
JP5116175B2 (en) * | 2006-10-13 | 2013-01-09 | トムソン ライセンシング | Reference picture management method including multi-view video coding |
CA3006093C (en) * | 2006-10-16 | 2022-07-19 | Nokia Technologies Oy | System and method for implementing efficient decoded buffer management in multi-view video coding |
-
2008
- 2008-03-17 EP EP08726902.3A patent/EP2135456B1/en not_active Not-in-force
- 2008-03-17 KR KR1020097020719A patent/KR101418627B1/en active IP Right Grant
- 2008-03-17 BR BRPI0809210-9A patent/BRPI0809210A2/en active Search and Examination
- 2008-03-17 JP JP2010502080A patent/JP5273824B2/en not_active Expired - Fee Related
- 2008-03-17 CN CN2008800104037A patent/CN101647287B/en not_active Expired - Fee Related
- 2008-03-17 WO PCT/US2008/003492 patent/WO2008123917A2/en active Application Filing
- 2008-03-17 US US12/450,098 patent/US20100118933A1/en not_active Abandoned
- 2008-04-03 TW TW097112372A patent/TWI422230B/en not_active IP Right Cessation
- 2008-04-03 TW TW101109389A patent/TWI551116B/en not_active IP Right Cessation
- 2008-04-03 TW TW101109388A patent/TWI533669B/en not_active IP Right Cessation
-
2012
- 2012-11-07 JP JP2012245139A patent/JP5558545B2/en not_active Expired - Fee Related
-
2014
- 2014-06-03 JP JP2014114534A patent/JP6066425B2/en not_active Expired - Fee Related
-
2016
- 2016-11-17 JP JP2016224226A patent/JP2017063471A/en not_active Ceased
-
2018
- 2018-10-29 JP JP2018202442A patent/JP2019068427A/en active Pending
Also Published As
Publication number | Publication date |
---|---|
EP2135456B1 (en) | 2017-05-03 |
WO2008123917A2 (en) | 2008-10-16 |
TWI551116B (en) | 2016-09-21 |
EP2135456A2 (en) | 2009-12-23 |
WO2008123917A3 (en) | 2008-12-04 |
US20100118933A1 (en) | 2010-05-13 |
TW200904198A (en) | 2009-01-16 |
BRPI0809210A2 (en) | 2014-09-02 |
JP2010524338A (en) | 2010-07-15 |
JP5273824B2 (en) | 2013-08-28 |
CN101647287B (en) | 2013-10-30 |
JP2013066200A (en) | 2013-04-11 |
JP2014195320A (en) | 2014-10-09 |
JP5558545B2 (en) | 2014-07-23 |
CN101647287A (en) | 2010-02-10 |
JP2019068427A (en) | 2019-04-25 |
TW201230815A (en) | 2012-07-16 |
KR101418627B1 (en) | 2014-07-15 |
TWI422230B (en) | 2014-01-01 |
TWI533669B (en) | 2016-05-11 |
KR20100015366A (en) | 2010-02-12 |
JP2017063471A (en) | 2017-03-30 |
JP6066425B2 (en) | 2017-01-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
TW201230814A (en) | Reference picture list management | |
JP5351020B2 (en) | Method and apparatus using virtual reference picture | |
US10390024B2 (en) | Region of interest scalability with SHVC | |
TWI566589B (en) | View synthesis in 3d video | |
JP2016530773A (en) | Cross-layer parallel processing and offset delay parameters for video coding | |
KR20100032390A (en) | Single loop decoding of multi-view coded video | |
AU2021257985B2 (en) | Techniques for bitstream extraction for subpicture in coded video stream | |
WO2021252338A1 (en) | Techniques for bitstream extraction for subpicture in coded video stream | |
JP2023526369A (en) | Signaling coded picture buffer information in a video bitstream | |
JP7542066B2 (en) | Ordering Image Segments | |
WO2014168561A1 (en) | Constructing inter-layer reference picture lists | |
JP2023526371A (en) | Incremental decoding update and reference picture list signaling | |
JP2023529972A (en) | Signaling Quantization Information in Coded Video | |
US20170064301A1 (en) | Methods and Apparatus for Use of Reference Block in Video Coding | |
RU2787691C1 (en) | Method for the output layer set mode in a multi-level video stream | |
JP7506188B2 (en) | Indicating the end of a sequence in coded video - Patents.com |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
MM4A | Annulment or lapse of patent due to non-payment of fees |