CN105075266A

CN105075266A - Reference picture set signaling and restriction on an electronic device

Info

Publication number: CN105075266A
Application number: CN201480019238.7A
Authority: CN
Inventors: 萨钦·G·德施潘德
Original assignee: Sharp Corp
Current assignee: Huawei Technologies Co Ltd
Priority date: 2013-04-05
Filing date: 2014-04-03
Publication date: 2015-11-18
Also published as: HK1214709A1; EP2982119A4; JP6192734B2; JP2016518037A; EP2982119A1; WO2014162747A1

Abstract

In one embodiment, an inter layer reference picture set (RPS) is obtained from the bitstream, wherein no random access skipped leading (RASL) picture are included in the interlayer RPS if the current picture is a random access decodable leading (RADL) picture. In another embodiment, a previously signaled RPS is obtained. For a picture in the previously signaled RPS, a first flag (a keep picture flag) indication is obtained if the picture should be used as a reference picture for the current picture. If the first flag is positive, a second flag (a used by current picture flag) from at least one corresponding value of the previously signaled RPS is determined.

Description

Reference picture collection signaling on electronic installation and restriction

The cross reference of related application

This application claims U.S. Provisional Patent Application No.61/809, the priority of 201, this U.S. Provisional Patent Application is the U.S. Patent application No.13/355 being entitled as " DECODINGAPICTUREBASEDONAREFERENCEPICTURESETONANELECTRONI CDEVICE " submitted on January 20th, 2012, the partial continuous case of 472, this U.S. Patent application is the U.S. Patent application No.13/354 being entitled as " REDUCINGREFERENCEPICTURESETSIGNALOVERHEADONANELECTRONICD EVICE " submitted on January 19th, 2012, the partial continuous case of 277.All these entirety are incorporated herein by reference.

Technical field

The disclosure relates generally to electronic installation.More particularly, the disclosure relates on electronic installation between reference picture collection prediction and signaling.

Background technology

Electronic installation has become less more powerful to meet the needs of consumer and to improve portability and convenience.Consumer becomes and depends on electronic installation and the function starting to expect increase.Some examples of electronic installation comprise desktop computer, laptop computer, cell phone, smart phone, media player, integrated circuit etc.

Some electronic installations are used for process and display Digital Media.Such as, portable electron device nowadays allow almost consumer may any position consume digital media.In addition, some electronic installations can provide the download of digital media content or crossfire so that consumer uses and appreciates.Digital Media is more and more universal brings some problem.Such as, effectively high quality digital media is represented so that storage, transmission and playback encounter some challenges.Can notice from this discussion, more effectively representative digit media system and method can be favourable.

Summary of the invention

The solution of problem

An aspect of of the present present invention provides a kind of on the electronic device to the method that reference picture collection is decoded, and comprising: obtain bit stream; Current picture is obtained from described bit stream; And obtain inter-layer reference picture collection (RPS) from described bit stream, wherein, if current picture is random access decodable code guide (RADL:randomaccessdecodableleading) picture, does not then comprise random access in interlayer RPS and skip guiding (RASL:randomaccessskippedleading) picture.

Another aspect of the present invention provides a kind of method of the reference picture of signaling on the electronic device collection, comprising: the reference picture collection (RPS) indicating the previous signaling corresponding with current picture; If the picture in the RPS of previous signaling will be used as the reference picture of current picture, then to this picture setting first mark; And transmission bit stream.

Another aspect of the present invention provides a kind of electronic installation of signaling reference picture collection, comprising: processor; Memory, itself and described processor electronic communication; Store instruction in which memory, described instruction can be performed with the reference picture collection (RPS) indicating the previous signaling corresponding with current picture; If the picture in the RPS of previous signaling will be used as the reference picture of current picture, then to this picture setting first mark; And send bit stream.

Another aspect of the present invention provides a kind of on the electronic device to the method that reference picture collection is decoded, and comprising: obtain bit stream; Obtain current picture; Obtain the reference picture collection (RPS) of previous signaling; For the picture in the RPS of previous signaling, if described picture should be used as the reference picture of current picture, then obtain the first mark instruction; If first is just masked as, then determine the second mark from least one respective value of the RPS of previous signaling; And current picture is decoded.

Another aspect of the present invention provides a kind of electronic installation of decoding to reference picture collection, comprising: processor; Memory, itself and described processor electronic communication; Store instruction in which memory, described instruction can be performed with: obtain bit stream; Obtain current picture; Obtain the reference picture collection (RPS) of previous signaling; For the picture in the RPS of previous signaling, if described picture should be used as the reference picture of current picture, then obtain the first mark instruction; If first is just masked as, then determine the second mark from least one respective value of the RPS of previous signaling; And current picture is decoded.

Accompanying drawing explanation

Fig. 1 is the block diagram of the example of one or more electronic installations that the system and method that can realize for reducing reference picture collection (RPS) signal overhead is shown;

Fig. 2 is the block diagram of the configuration that picture group (GOP) is shown;

Fig. 3 is the block diagram of a configuration of the encoder illustrated on electronic installation;

Fig. 4 is the flow chart of the configuration that the method reducing RPS signal overhead is on the electronic device shown;

Fig. 5 is the flow chart configured more specifically that the method reducing RPS signal overhead is on the electronic device shown;

Fig. 6 is another flow chart configured more specifically that the method reducing RPS signal overhead is on the electronic device shown;

Fig. 7 is the block diagram of a configuration of the decoder illustrated on electronic installation;

Fig. 8 is the flow chart of the configuration that the method reducing RPS signal overhead is on the electronic device shown;

Fig. 9 is the flow chart of the configuration that the method drawing part RPS is on the electronic device shown;

Figure 10 is the flow chart of the configuration that the method drawing RPS template is on the electronic device shown;

Figure 11 is the flow chart of the configuration that the method creating the instruction of deleting at least one reference picture is on the electronic device shown;

Figure 12 is the flow chart of the configuration that the method for deleting at least one reference picture is on the electronic device shown;

Figure 13 illustrates available various parts in an electronic;

Figure 14 illustrates on the electronic device to the flow chart of a configuration of the method that picture is decoded;

Figure 15 illustrates on the electronic device to the flow chart configured more specifically of the method that picture is decoded;

Figure 16 illustrates on the electronic device to another flow chart configured more specifically of the method that picture is decoded;

Figure 17 is the flow chart of a configuration of the method that signaling reference picture collection is on the electronic device shown;

Figure 18 is the flow chart of another configuration of the method that signaling reference picture collection is on the electronic device shown;

Figure 19 is the flow chart configured more specifically of the method that signaling reference picture collection is on the electronic device shown;

Figure 20 is the flow chart of a configuration of the method that prediction reference pictures collection is on the electronic device shown;

Figure 21 is the flow chart of another configuration of the method that prediction reference pictures collection is on the electronic device shown; And

Figure 22 is the flow chart configured more specifically of the method that prediction reference pictures collection is on the electronic device shown.

Figure 23 is the block diagram of two configurations that different pictures type is shown.

Figure 24 is the block diagram that inter-layer reference picture collection update module is shown.

Embodiment

A kind of method of the reference picture of signaling on the electronic device collection is described.Indicate the reference picture collection (RPS) of the previous signaling corresponding with current picture.If the picture in the RPS of previous signaling will be used as the reference picture of current picture, then to this picture setting first mark.If the picture in the RPS of previous signaling is not used as the reference picture of current picture, then not to this picture setting first mark.Send bit stream.

Can not send current RPS by current picture service marking.The index that the RPS of previous signaling can be used as in the set of the RPS of previous signaling carrys out signaling.The RPS of previous signaling can comprise at least one respective value of another reference picture in the RPS of previous signaling.At least one respective value described can be used by the current picture value of statistical indicant of the second reference picture in the RPS of previous signaling.Mark instruction can be there is in the RPS of previous signaling by prediction short term reference picture collection.

First mark can be keep picture mark.Current picture can in the first picture group (GOP) after random access point.The RPS of previous signaling can carry out signaling via deletion action.The RPS of previous signaling can send from parameter sets (PPS), sequence parameter set (SPS), adaptation parameter collection (APS), one of video parameter collection (VPS) and head (SH).The RPS of previous signaling can send from the element bit stream.

A kind of electronic installation of signaling reference picture collection is also described.This electronic installation comprises processor and is stored in and the executable instruction in the memory of described processor electronic communication.The reference picture collection (RPS) of the previous signaling that the instruction of this electronic installation is corresponding with current picture.If the picture in the RPS of previous signaling will be used as the reference picture of current picture, then this electronic installation will be also to this picture setting first mark.If the picture in the RPS of previous signaling is not used as the reference picture of current picture, then this electronic installation is not to this picture setting first mark.This electronic installation also sends bit stream.

Also describe a kind of on the electronic device to the method that reference picture collection is decoded.Obtain bit stream.Obtain current picture.Obtain the reference picture collection (RPS) of previous signaling.For the picture in the RPS of previous signaling, if this picture should be used as the reference picture of current picture, then obtain the first mark instruction.If first is just masked as, then determine the second mark of at least one respective value of the RPS from previous signaling.Current picture is decoded.

Can decode to current picture based on the second mark.First mark can be keep picture mark.Second mark can be used by current picture mark.

At least one respective value described can obtain from the RPS of previous signaling.At least one respective value described can be used by the current picture value of statistical indicant of the second reference picture in the RPS of previous signaling.At least one respective value described can be Boolean.

Current picture can in the first picture group (GOP) after random access point.The RPS of previous signaling can carry out signaling via deletion action.The RPS of previous signaling can obtain from parameter sets (PPS), sequence parameter set (SPS), adaptation parameter collection (APS), one of video parameter collection (VPS) and head (SH).The RPS of previous signaling can obtain from the element bit stream.

A kind of electronic installation of decoding to reference picture collection is also described.This electronic installation comprises processor and is stored in and the executable instruction in the memory of described processor electronic communication.This electronic installation obtains bit stream.This electronic installation also obtains current picture.This electronic installation also obtains the reference picture collection (RPS) of previous signaling.For the picture in the RPS of previous signaling, if picture should be used as the reference picture of current picture, then this electronic installation obtains the first mark instruction.If first is just masked as, then this electronic installation determines the second mark from least one respective value of the RPS of previous signaling.Current picture is decoded by this electronic installation in addition.

System and method disclosed herein describes the some configurations reducing reference picture collection (RPS) signal overhead on the electronic device.Such as, system and method disclosed herein describes and carries out Code And Decode to RPS.Such as, some modes that RPS is decoded are described.In addition, the mode encoding to realize the signal overhead reduced to RPS is also described.

RPS is the set of the reference picture associated with picture.RPS can comprise according to the reference picture of decoding order before related image, its can be used for related image inter prediction and/or for according to any picture of decoding order after related image.RPS describes the one or more reference pictures in decoded picture buffer (DPB).This realizes in the head of each picture.Previous video encoding standard, such as H.264/AVC, carries out reference with relative mode to reference picture.Not that any picture of a part for reference picture collection can be marked as " not for reference " in DPB.

DPB can be used for the picture being stored in decoder place reconstruct (such as, decoding).Then these pictures stored can be used for such as Inter prediction mechanisms.When not decoding to picture in order, picture can be stored in DPB to make them to show in order after a while.In addition, the picture in DPB can associate with picture order count (POC).POC can be such variable, and it associates with each picture of encoding and has increases along with the picture position according to output order and the value increased.In other words, POC can be used for transmitting picture for display according to correct order by decoder.POC be also used in reference picture list structure and decoding reference picture mark phase between identification reference picture.

In some configurations, (such as, delta) is relatively utilized to carry out reference with reference to (such as, utilizing deltaPOC and currentPOC (current POC)) or absolute reference (such as, utilizing POC) to reference picture.Such as, DPB can comprise the set of the picture of reception.The subset of these pictures received can use (such as, delta) reference relatively, and the picture that residue receives can use absolute reference.It should be noted that buffer as herein described describe and grammer configuration in one or morely can to realize with the one or more combinations in mode as herein described.

RPS can comprise the list of the information of all reference pictures that decoder should keep.Such as, the set that this information can be used as the index being called as deltaPOC stores.DeltaPOC can be used for the POC of computing reference picture.Such as, POC_reference=POC_current+deltaPOC.In other words, utilize the current POC of picture and the deltaPOC of reference picture that will decode, position reference picture can be carried out according to relative mode.In addition, the RPS time ID that can store each reference picture and/or the mark that indicates specific reference picture whether to be used by current picture.

The example how RPS works at electronic installation place is as follows.Assuming that (I frame) picture between received frame, being then two bi-directional predicted (B frame) pictures, is then two bi-directional predicted (b frame) pictures.B frame is by the bi-directional predicted picture of other picture for predicting.B frame is not by the bi-directional predicted picture of other picture for predicting..

In other words, the order receiving picture is I ₀-B ₁-B ₂-b ₁-b ₂.In this example, GOP size is 4.

Further supposition I frame has POC0, and the b frame first received has POC1, and the B frame secondly received has POC2, and the b frame first received has POC3, and the B frame first received has POC4.In other words, POC order is I ₀-b ₁-B ₂-b ₂-B ₁.In addition, assuming that I frame is used as B ₁, B ₂and b ₁reference picture; B ₁as B ₂and b ₂reference picture; B ₂as b ₁and b ₂reference picture.

In this example, according to the second picture (such as, picture B of decoding order ₁/ POC4) picture (such as, the I of POC0 will be comprised at its RPS ₀).In order to store I ₀/ POC0, B ₁deltaPOC=-4 can be write in its RPS index value.In other words, be stored in RPS as index value relative to the difference of current POC with reference to POC.

According to the 3rd picture (that is, the picture B of decoding order ₂/ POC2) picture (such as, the B of POC0 and POC4 will be comprised at its RPS ₁).Therefore, the index value of deltaPOC=-2 and 2 is stored in its RPS.

Continue this example, according to the 4th picture (that is, the picture b of decoding order ₂/ POC1) picture (such as, the I of POC0 can be comprised at its RPS ₀) and picture (such as, the B of POC2 ₂) the two.In addition, b ₂/ POC1 also can comprise POC4 (such as, B ₁), because this picture will be used at future reference.Here, deltaPOC-1,1,3 is stored in its RPS.It should be noted that positive and negative deltaPOC all can be stored in RPS.

This example is last, according to the 5th picture (that is, the picture b of decoding order ₁/ POC3) picture (such as, the B of POC2 can be comprised at its RPS ₂) and picture (such as, the B of POC4 ₁).Therefore, deltaPOC=-1 and 1 is stored in b ₁rPS in as the relative value of index value.Also it may be noted that b ₁do not need to comprise POC0 (such as, I at its RPS ₀), unless I ₀will be used at future reference.If POC0 is (such as, I ₀) be not included in b ₁rPS in, then it can be labeled as " not for reference ".

Once list construct RPS, just get out signaling.Various mode is had to carry out signaling RPS.According to a mode, the set of the template that signaling associates with process RPS in parameter sets (PPS), and it utilizes the RPS index in head to carry out reference by each sheet.Under other method, can in head having to explicitly signaling RPS.

List (1) below illustrates an example of the grammer for notifying RPS in PPS.

List (1)

" partial_ref_pic_set_flag " [i] instruction uses complete RPS [i] to carry out generating portion RPS.Ref_flag specifies which reference key of complete RPS [i] to be copied in part RPS.

" seq_parameter_set_id " mark is by the sequence parameter set of parameter sets reference.The value of seq_parameter_set_id, by the scope of 0 to 31, comprises end value.

" pic_parameter_set_id " is identified at the parameter sets of reference in head.The value of pic_parameter_set_id, by the scope of 0 to 255, comprises end value." entropy_coding_mode_flag " instruction will be applied to the entropy decoding method of syntactic element.

" num_ref_pic_sets " specifies in the quantity of the reference picture collection of specifying in parameter sets." num_negative_pics " specifies the quantity of delta_poc_s0_minus1 [i] and used_by_curr_pic_s0_flag [i] syntactic element trailed.Num_positive_pics specifies the quantity of " delta_poc_s1_minus1 " [i] and used_by_curr_pic_s1_flag1 [i] syntactic element trailed.Delta_poc_s0_minus1 [i] adds the absolute difference between 1 appointment, two picture order count values.

" used_by_curr_pic_s0_flag " [i] equals the i-th reference picture that 0 assigned picture sequential counting is less than current picture and is not used in by current picture reference." delta_poc_s1_minus1 " [i] adds the absolute difference between 1 appointment, two picture order count values." used_by_curr_pic_s1_flag " [i] equals the i-th reference picture that 0 assigned picture sequential counting is greater than current picture and is not used in by current picture reference.

It should be noted that and can be applicable to all lists given in this article for the definition given by the parameter used in list (1).In addition, the parameter definition provided in follow-up list also can be applicable to the list previously listed.

List (2) illustrates an example of the grammer of signaling RPS in head.

List (2)

The syntactic element utilized in moving frame parameter set creates by the reference picture collection that " ref_pic_set_pps_flag " equals 1 appointment current picture.Syntactic element in the ref_pic_set () syntactic structure utilized in head creates by the reference picture collection that ref_pic_set_pps_flag equals 0 appointment current picture.

" ref_pic_set_pps_idx " specifies the index by being used for the list creating the reference picture collection of specifying in the moving frame parameter set of the reference picture collection of current picture.

In addition, RPS template signaling can be decoded to picture to decoder with help.Template can be used for eight pictures and is commonly used test condition by the random access of (such as, picture group (GOP)) in groups together.Following table 1 illustrates the RPS template commonly using test condition (GOP=8) for random access.Conveniently some terms are abridged in tables 1-4.These terms are abridged as follows: Temporal_id (TId), ref_buf_size (RBS) and RPS index value (RPSIndexValues).

RPS＃	Type	POC	Tld	RBS	ref_pic	＃ref_pics	RPS index value
								1：	B	8	0	4	1	4	-8 -10 -12 -16
2：	B	4	0	2	1	3	-4 -6 4
								3：	B	2	0	2	1	4	-2 -4 2 6
4：	B	1	0	2	0	4	-1 1 3 7
								5：	B	3	0	2	0	4	-1 -3 1 5
6：	B	6	0	2	1	4	-2 -4 -6 2
								7：	B	5	0	2	0	4	-1 -5 1 3
8：	B	7	0	2	0	4	-1 -3 -7 1

Table 1

In Table 1, type (Type) represents the type of the frame used.In this case, all frames are B frame.It should be noted that unshowned frame 0 is I frame.In Table 1, Temporal_id (TId) specifies the time horizon ID of this frame, ref_buf_size (RBS) is the reference buffer size needed for current picture, whether ref_pic indicates frame to be the reference picture of other picture, #ref_pics is the quantity of reference picture, and RPS index value (RPSIdxValues) represents the index value of the reference picture be stored in each RPS of each corresponding frame.

Additional part RPS can be generated for the frame due to instantaneous decoding refresh (IDR) or completely random access (CRA) with one or more unavailable reference picture.Table 2 illustrates the template commonly using the part RPS that test condition generates for random access.

RPS＃	Type	POC	Tld	RBS	ref_pic	＃ref_pics	RPS index value
								1：	B	8	0	4	1	1	-8
2：	B	4	0	2	1	2	-4 4
								3：	B	2	0	2	1	3	-2 2 6

Table 2

Can from complete RPS creating section RPS.In Table 1, the RPS index of frame 1 is-8 ,-10 ,-12 and-16.The RPS index of the part RPS of the frame 1 in table 2 is only-8.Similarly, compared with the complete RPS shown in table 1, the frame 2 and 3 in the part RPS in table 2 has the reference picture of lesser amt.Therefore, in this example, compared with complete RPS, the every frame of part RPS comprises less RPS index value.

Table 3 illustrates the template commonly using test condition for low delay, and wherein GOP equals 4.

RPS＃	Type	POC	Tld	RBS	ref_pic	＃ref_pics	RPS index value
								1	B	1	0	4	1	4	-1 -5 -9 -13
2	B	2	0	4	1	4	-1 -2 -6 -10
								3	B	3	0	4	1	4	-1 -3 -7 -11
4	B	4	0	4	1	4	-1 -4 -8 -12

Table 3

In table 3, each GOP has four pictures.In a template, for sequence 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14 etc., also there are four RPSs corresponding with the picture of each POC position:

RPS [0], it has the index value [-1 ,-5 ,-9 ,-13] for POC1;

RPS [1], it has the index value [-1-2-6-10] for POC2;

RPS [2], it has the index value [-1 ,-3 ,-7 ,-11] for POC3; And

RPS [3], it has the index value [-1 ,-4 ,-8 ,-12] for POC4.

Table 4 illustrates the template commonly using the part RPS that test condition generates for low delay.Table 4 is continuities of table 3.

Table 4

In table 4, additional index reference is generated for the frame with unavailable reference picture.Reference picture may be unavailable due to IDR or CRA.When commonly using test case generating portion RPS for low delay, the picture of the front several frame in the GOP after IDR or CRA is selected.Such as, the frame 1 to 4 of sequence beginning belongs to a GOP, the part RPS [5] to RPS [8] that it will use from RPS [0] to RPS [3] to draw.Frame 5 to 8 belongs to the 2nd GOP and will use the part RPS [9] to RPS [12] that also [3] draw from RPS [0] to RPS.Frame 9 belongs to the 3rd GOP and will use the part RPS [13] drawn from RPS [0].

In some configurations, show that the electronic installation of part RPS can adopt rule to draw part RPS from complete RPS.Such as, RPS numbering 7,8,9,11,12 and 13 all can increase RPS index value-2 (with runic instruction).It should be noted that this RPS index value is relative, depend on present frame position (such as, current POC).In addition, RPS numbering 8,9 and 10 increases RPS index value-3 (with runic instruction) separately.

According to known way, such as, in efficient video coding (HEVC) test model (HM) 5.0 specified method, both signaling complete RPS and part RPS in the bitstream.Such as, in the PPS of the beginning of picture, send the RPS template comprising complete RPS and part RPS.This causes the unnecessary expense sent in the bitstream.In PPS, this expense of signaling RPS template can from such as hundreds of bit to a few kilobit.In addition, extra and unnecessary work is also performed with generating portion RPS at encoder place.Therefore, one of the beneficial effect of system and method disclosed herein is by decreasing RPS signaling consumption at decoder-side based on the complete RPS generating portion RPS template received.

In addition, according to known way, such as, in HM5.0 specified mode, in a RPS, reference picture indices is differently encoded between negative index and between positive index.Therefore, it is beneficial that by adopting system and method disclosed herein to reduce the bit number being used for RPS template, signaling bit number may be reduced.Such as, this realizes by reducing the bit number needed for encoding to the list of RPS index value.

System and method disclosed herein can provide one or more additional beneficial effect in minimizing RPS signal overhead.In one configuration, the symmetry characteristic of positive and negative reference key can be adopted to reduce the bit being used for aligning RPS index value (such as, reference key) and carrying out encoding.Under another configuration, part RPS can be drawn at decoder place, but not transmitting portion RPS in the bitstream.Additionally or alternatively, the RPS template that definable all frequently uses in coder side and decoder-side, allows to carry out template described in signaling by the simple index in PPS.Additionally or alternatively, by with reference to complete RPS and delete in reference picture some to reach part RPS, carry out signaling notification section RPS.

Describe various configuration referring now to accompanying drawing, wherein similar label can the similar element of deixis.Large volume description in this paper accompanying drawing the system and method illustrated can be arranged according to various different configuration and design.Therefore, below claimed scope is not intended to limit to the more detailed description of some configurations represented in accompanying drawing, but only representative system and method.

Fig. 1 is the block diagram of the example of one or more electronic installation 102a-b that the system and method that can realize for reducing RPS signal overhead is shown.In this example, electronic installation A102a and electronic installation B102b is shown.However, it is noted that, be combined into single electronic device with one or more can the configuration according to some in the Characteristic and function of electronic installation A102a and electronic installation B102b associated description.

Electronic installation A102a comprises encoder 104 and RPS index initializer module (initializer module) 108.Each element (such as, encoder 104 and initializer module 108) be included in electronic installation A102a can be implemented in hardware, software or its combination.

Electronic installation A102a can obtain input picture 106.In some configurations, input picture 106 to utilize imageing sensor to catch on electronic installation A104a, receive from memory search and/or from another electronic installation.

Encoder 104 can encode to input picture 106 data generating coding.Such as, encoder 104 can be encoded to a series of input picture 106 (such as, video).In one configuration, encoder 104 can be HEVC encoder.The data of coding can be numerical data (such as, bit streams).Encoder 104 can generate expense signaling based on input signal.

Initializer module 108 can be used for process RPS index value.Such as, initializer module 108 can carry out initialization to the value for the treatment of positive reference picture.These data can be recorded in PPS, and its index can in the head of picture signaling.

Provide the more details of the initialization type that can be generated by electronic installation A102a below.It should be noted that in some configurations, initializer module 108 can be included in encoder 104.Initializer module 108 can make RPS signaling consumption to reduce.

Encoder 104 (and such as initializer module 108) can generate bit stream 114.Bit stream 114 can comprise the coded picture data based on input picture 106.In some configurations, bit stream 114 also can comprise overhead data, such as slice header information, PPS information etc.Provide the more details of overhead data below.When additional input picture 106 is by coding, bit stream 114 can comprise the picture of one or more coding.Such as, bit stream 114 can comprise reference picture and/or other picture of one or more coding.

Bit stream 114 can be provided to decoder 112.In one example, bit stream 114 can utilize wired or wireless link to be sent to electronic installation B102b.In some cases, this can carry out via the network of such as the Internet or local area network (LAN) (LAN).As shown in Figure 1, decoder 112 can be implemented on electronic installation B102b independent of the encoder 104 on electronic installation A102a.However, it is noted that encoder 104 and decoder 112 can be implemented on same electronic installation in some configurations.Such as, be implemented in the implementation on same electronic installation at encoder 104 and decoder 112, bit stream 114 can be provided to decoder 112 via bus or be stored in memory so that decoder 112 is retrieved.

Decoder 112 can be implemented in hardware, software or its combination.In one configuration, decoder 112 can be HEVC decoder.Decoder 112 can receive (such as, obtain) bit stream 114.Decoder 112 can generate the picture 118 (such as, the picture 118 of one or more decoding) of decoding based on bit stream 114.The picture 118 of decoding can be shown, playback, be stored in memory and/or be sent to another device etc.

Decoder 112 can comprise part RPS determination module 120, RPS formwork module 122 and/or RPS removing module 124.Part RPS determination module 120 can make decoder 112 can at decoder place generating portion RPS.Such as, part RPS determination module 120 can based on the complete RPS generating portion RPS received at decoder 112 place.Part RPS determination module 120 is described in greater detail below.

RPS formwork module 122 can based on the signal creation RPS template received in bit stream 114.Such as, RPS formwork module 122 can use GOP size, the coding structure Sum fanction obtained from bit stream to carry out drawing template establishment.RPS formwork module 122 is described in greater detail below.

In some configurations, RPS removing module 124 can identify the reference picture of loss and send feedback to encoder 104, and the one or more reference picture of signaling is lost.RPS removing module 124 can obtain instruction in bit stream to delete the one or more pictures in the RPS of current or previous receipt.In other configuration, RPS delete instruction can be received when not sending feedback to encoder.RPS removing module 124 is described in greater detail below.

In another example, such as scalable coding sight, bit stream can comprise the picture of different resolution.In this example, reference picture collects the different resolution version that can comprise (such as, identifying) same picture.

Fig. 2 is the block diagram of the configuration that picture group (GOP) 228 is shown.In some configurations, GOP228 can be Hierarchy coding structure, and what such as have the coded sequence of minimal solution code delay passs rank B structure.Such as, GOP228 can be have that four dyads pass class (dyadichierarchystage) pass rank predict.It should be noted that the quantity of the picture in GOP228 in some configurations can be eight (such as, GOP size=8), as shown in Figure 2.

Fig. 2 illustrates one or more picture 226.In some cases, these pictures can be reference pictures.Each picture 226 can belong to passs class.Such as, I frame picture 226 can have basis and pass class, such as 0 grade.In some cases, I frame can be IDR picture.B frame can have 1,2 or 3 grade.In some cases, described level may correspond in time extensibility.In other words, along with progression increases, the ability of refinement current picture also increases.Like this, having more rudimentary picture 226 can adopt the higher picture 226 of correspondence to increase definition and degree of refinement.

GOP228 can sort according to DISPLAY ORDER or POC229.But, coded sequence 230 or POC229 order can be different from from the order that bit stream obtains picture.

In some configurations, the picture 226 in GOP228 is passed rank pattern to sort according to symmetry.In this type of configuration, can be identical with the minimum range of positive reference picture apart from negative reference picture.That is, the positive deltaPOC in RPS is usually identical with the absolute value of negative deltaPOC.

Such as, assuming that POC2 is that instruction current picture is by decoded current POC231.In order to by the picture codec indicated by current POC231, what must obtain in RPS index value 232 is one or more.In this example, the picture indicated by current POC231 uses the picture indicated by POC2, POC4 and POC6 to decode.Be not use absolute value, current POC231 uses the relative value be stored in RPS to carry out position reference picture.In some cases, directly RPS is obtained from the head picture 226.In other cases, RPS is arranged in the PPS of the head signaling from corresponding picture 226.Here, current POC231 obtains RPS index value [-2,2,4].That is, current POC231 adopts deltaPOC233a, deltaPOC233b and deltaPOC233c to decode to picture 226.

Be in this example of POC2 at current POC, the symmetry of GOP228 passs rank character can be of value to minimizing RPS signaling consumption.The current POC231 with negative deltaPOC233a (such as ,-2) may have the corresponding positive deltaPOC233b of symmetry (such as, 2).Utilize this symmetry, the method reducing RPS signal overhead can be adopted.These class methods various describe in more detail below in conjunction with Fig. 5 and Fig. 6.

In another example, suppose that currentPOC is POC4, then a RPS index value can be deltaPOC-4.In addition, POC4 also can have index value deltaPOC=4 in its RPS, and it relates to reference picture POC8.In addition, the RPS reference picture of currentPOC=POC4 can be POC2 and POC6.Therefore, RPS index value can be [-4 ,-2,2,4].

In another example, suppose that currentPOC is POC2, then RPS can comprise the picture corresponding with POC0 and POC4.In addition, index value deltaPOC=6 can be stored in its RPS.This is because the RPS index value of deltaPOC=6 relates to owing to may may need the reference picture be kept in a decoder as the reference picture of future picture.In other words, the RPS index value with the positive deltaPOC value of the one or more picture of instruction may need to be kept in a decoder to be used as to need the reference picture of decoded future picture.

Fig. 3 is the block diagram of a configuration of the encoder 304 illustrated on electronic installation 302.To it should be noted that in the element being shown as and being included in electronic installation 302 one or more is implemented in hardware, software or its combination.Such as, electronic installation 302 comprises encoder 304, and it can be implemented in hardware, software or its combination.Such as, encoder 304 can be implemented as circuit, integrated circuit, application-specific integrated circuit (ASIC) (ASIC), with there is the processor, firmware, field programmable gate array (FPGA) etc. of memory electronic communication of executable instruction or it combines.In some configurations, encoder 304 can be HEVC encoder.

Electronic installation 302 can comprise supply 334.Picture or view data (such as, video) can be sent to encoder 304 as source 306 by supply 334.The example of supply 334 comprises imageing sensor, memory, communication interface, network interface, wireless receiver, port etc.

Source 306 can be provided to intra-framed prediction module and reconstruction buffer 340.Source 306 also can be provided to Motion estimation and compensation module 366 and subtraction block 346.

Intra-framed prediction module and reconstruction buffer 340 can based on signals 342 in source 306 and the data 380 delta frame internal schema information 358 reconstructed and frame.Motion estimation and compensation module 366 can based on source 306 and reference picture buffer 396 signal 398 delta frame inter mode information 368 and interframe signal 344.

Reference picture buffer 396 signal 398 can comprise the data from the one or more reference pictures be stored in reference picture buffer 396.Reference picture buffer 396 also can comprise RPS index initializer module 308.Initializer module 308 can process the reference picture 226 corresponding with the buffer of RPS and lists construction.In some configurations, reference picture buffer 396 signal 398 can comprise the data of the instruction one or more previous reference picture collection (RPS) corresponding with current picture.

Encoder 304 can be selected between signal 342 and interframe signal 344 in frame according to pattern.In frame, signal 342 utilizes the spatial character in picture under being used in intra-frame encoding mode.Interframe signal 344 utilizes the time response between picture under being used in interframe encoding mode.Time under intra-frame encoding mode, in frame, signal 342 can be provided to subtraction block 346, and frame mode information 358 can be provided to entropy code module 360.Time under interframe encoding mode, interframe signal 344 can be provided to subtraction block 346, and inter-frame mode information 368 can be provided to entropy code module 360.

Signal 342 or interframe signal 344 (depending on pattern) in frame is deducted from source 306, so that generation forecast residual error 348 at subtraction block 346 place.Prediction residual 348 is provided to conversion module 350.The compressible prediction residual 348 of conversion module 350 is to generate the signal 352 of conversion, and described signal is provided to quantization modules 354.The signal 352 of conversion is quantized the coefficient (TQC) 356 generating transform and quantization by quantization modules 354.

TQC356 is provided to entropy code module 360 and inverse quantization module 370.Inverse quantization module 370 couples of TQC356 perform re-quantization to generate the signal 372 of re-quantization, and described signal is provided to inverse transform module 374.The signal 372 of re-quantization decompresses with the signal 376 of generating solution compression by inverse transform module 374, and the signal 376 of described decompression is provided to reconstructed module 378.

Reconstructed module 378 can generate the data 380 of reconstruct based on the signal 376 decompressed.Such as, reconstructed module 378 restructural (amendment) picture.The data 380 of reconstruct can be provided to de-blocking filter 382 and intra-framed prediction module and reconstruction buffer 340.De-blocking filter 382 can generate the signal 384 of filtering based on the data 380 of reconstruct.

The signal 384 of filtering can be provided to sample self adaptation skew (SAO) module 386.SAO module 386 can generate the SAO information 388 being provided to entropy code module 360 and the SAO signal 390 being provided to auto-adaptive loop filter (ALF) 392.ALF392 generates the ALF signal 394 being provided to reference picture buffer 396.ALF signal 394 can comprise the data from the one or more pictures that can be used as reference picture.

Entropy code module 360 can encode to generate bit stream 314 to TQC356.In addition, entropy code module 360 can utilize context-adaptive variable length code (CAVLC) or context adaptive binary arithmetic coding (CABAC) to encode to TQC356.Specifically, entropy code module 360 can be encoded to TQC356 based on one or more in frame mode information 358, inter-frame mode information 368 and SAO information 388.Bit stream 314 can comprise the picture data of coding.

Quantification involved in the video compression of such as HEVC is the lossy compression by being realized to single quantum value by the Ratage Coutpressioit of value.Quantization parameter (QP) is the predefined zooming parameter for performing quantification based on both the quality of video of reconstruct and compression ratio.In HEVC, definition block type is with the characteristic representing given piece based on block size and colouring information thereof.QP, resolution information and block type can be determined before the entropy encoding.Such as, electronic installation 302 (such as, encoder 304) can determine QP, resolution information and block type, and it can be provided to entropy code module 360.

Entropy code module 360 can based on the block determination block size of TQC356.Such as, block size can be the quantity of the TQC356 of a dimension of block along TQC.In other words, the quantity of the TQC356 in the block of TQC can equal block size square.Such as, block size can be confirmed as the square root of the quantity of the TQC356 in the block of TQC.Resolution can be defined as pixel wide × pixels tall.Resolution information can comprise the quantity of the width for picture, the height for picture or the pixel of both.Block size can be defined as the quantity of the TQC356 of a dimension of the 2D block along TQC.

In some configurations, bit stream 314 can be sent to another electronic installation.Such as, bit stream 314 can be provided to communication interface, network interface, radio transmitters, port etc.Such as, bit stream 314 can be sent to another electronic installation via LAN, the Internet, cellular telephone base stations etc.Additionally or type ground, bit stream 314 can be stored in the memory on electronic installation 302.

Fig. 4 is the flow chart of the configuration that the method 400 reducing RPS signal overhead on electronic installation 302 is shown.Electronic installation 302 can obtain 402 pictures 226.Such as, picture 226 can receive from supply 334.In some cases, picture 226 can obtain from remote source.

Picture 226 can by coding 404.This can perform on such as encoder 304.Encoder 304 can be HEVC type encoder 304.

406 can be indicated based on the initialized index value RPS corresponding with picture 226.Such as, this instruction can be carried out in the head of picture 226 and/or in the PPS of picture 226.Initialized value can help electronic installation 302 to process RPS.In some cases, initialized value can help to reduce RPS signal overhead.In some cases, use initialized value can cause the less RPS index value sent in bit stream 314, thus reduce expense.Such as, less RPS index value can represent with less bit, to reduce expense.In other cases, use initialized index value can cause in bit stream 314, send a few RPS index value, this reduces RPS signaling consumption.

Electronic installation 302 can send 408 bit streams.Bit stream 314 can be sent out 408 to same electronic installation 302 and/or remote-control device.Bit stream 314 can comprise picture and the RPS of coding.

Fig. 5 is the flow chart configured more specifically that the method 500 reducing RPS signal overhead on electronic installation 302 is shown.In one configuration, electronic installation 302 can obtain 502 pictures 226 and carry out coding 504 to picture 226 as previously mentioned.

Electronic installation 302 can based on relatively negative RPS parameter by index value initialization 506.Such as, electronic installation 302 can process reference picture to obtain both negative, positive RPS index values.Positive and negative reference picture can be located in reason separately.These process are illustrated in list (3) below.

List (3) illustrates the grammer for aligning the known method that RPS index value carries out encoding.Specifically, list (3) is designed under HM5.0, process random access and passs rank B.

List (3)

" RPS_deltaPOC " refers to RPS index value.RPS_deltaPOC [0] to RPS_deltaPOC [num_negative_pics-1] stores negative RPS index value.RPS_deltaPOC [num_negative_pics] to RPS_deltaPOC [num_negative_pics+num_positive_pics-1] stores positive RPS index value.

List (3) illustrates the pseudo-code of a method for the treatment of positive RPS index value.Such as, the RPS with reference key [-2 ,-4,2] first encodes to negative RPS picture index.Then, positive picture index is differentially coded.This obtains four RPS index values.When processing positive and negative with reference to both RPS index values, previous index value or " prev " are set to 0.When processing positive RPS index value, such was the case with for this.Prev carrys out initialization independent of the quantity of negative picture or any negative RPS parameter.In this example, when RPS index value is [-2 ,-4,2], need 9 bits to send RPS index value.

Compared with list (3), system and method disclosed herein describes can based on relatively negative RPS parameter by index value initialization 506.Therefore, when not being each process positive RPS index value, prev is initialized as 0, but based on negative RPS parameter by prev initialization.List (4) illustrates the example of pseudo-code, and it illustrates this difference.Represent with runic according to the amendment of system and method disclosed herein to grammer.

List (4)

As shown in list (4), the least absolute value that prev can be initialized to negative RPS_deltaPoc subtracts 1.It should be noted that term RPS_deltaPOC and RPS index value are used interchangeably.The least absolute value of negative RPS_deltaPoc is the absolute value of the minimal negative reference picture be stored in the RPS index of current picture.Such as, if current picture comprises relative reference RPS index value [-4 ,-6,4], then-4 and-6 is negative RPS_deltaPoc index values.When getting each absolute value, obtain 4 and 6 respectively.Get minimum value and cause acquisition 4.

In known method, RPS_deltaPOC value in negative RPS_deltaPOC index value and in positive RPS_deltaPOC index value according to the descending of absolute value, to guarantee that the difference of encoding is not negative.This allows the bit when encoding less owing to avoiding negative.Usually, be identical negative absolute value positive bit compared with, negative cost more bits encode.Under this methodology, the least absolute value of negative RPS_deltaPoc can be positioned at RPS_deltaPoc (0).

Apply this example, prev=(least absolute value of negative RPS_deltaPoc)-1, prev=(4)-1=3.Be that in another example of 5, prev will equal 4 at the least absolute value of negative RPS_deltaPoc.Therefore, prev index value can be depending on negative RPS parameter value, such as the least absolute value of negative RPS_deltaPoc.

Utilize initialized value, electronic installation 302 can based on the picture of index value process 508 positive number.In one example, assuming that current picture has RPS reference key value [-2 ,-4,2].When positive reference picture is processed and prev is initialized to the least absolute value of negative RPS_deltaPoc, prev equals 1 (such as, (|-2|)-1=1).In order to process first on the occasion of (such as, 2), adopt RPS_deltaPoc (k)-prev-1.RPS_deltaPoc (k) equals the value of the first pending positive RPS index value.In this example, RPS_deltaPoc (k) equals 2.As implied above, prev equals 1.Therefore, RPS_deltaPoc (k)-prev-1=2-1-1=0.

This process obtains encoding [-2 ,-4,0], but not [-2 ,-4,2].Therefore, need 8 bits, but not 9 bits, expense reduces.Due to the symmetric property of coding structure, based on relatively negative RPS parameter, index value initialization will be obtained the null first positive index reference value usually.Therefore, along with the first positive index reference value increases, the bit number of saving also increases.

In some cases, electronic installation 302 can only based on the first positive RPS index value in the set of relatively negative RPS parameter processing RPS index value.Each follow-up positive index value can process as shown in list (3).In this case, the first positive index value of each RPS of each picture sent in bit stream 114 decreases expense.

Electronic installation 302 can send 510 bit streams 114.By applying system and method as herein described, the RPS expense in bit stream 114 can reduce.

Fig. 6 is another flow chart configured more specifically that the method 600 reducing RPS signal overhead on electronic installation 302 is shown.Electronic installation 302 can obtain 602 pictures 226 and carry out coding 604 to picture 226 as previously mentioned.

Whether alternatively, electronic installation can indicate 606 symmetric flag that will send in the bitstream, such as symmetric_flag, negative RPS index value can be utilized to carry out initialization to indicate the first positive RPS index value.Such as, described symmetric flag can indicate index value should be initialized to the least absolute value of negative RPS_deltaPoc.Alternatively, symmetric flag can indicate least absolute value index value not being initialized as negative RPS_deltaPoc.In this case, index value can be initialized to zero.

Electronic installation 302 can based on the picture of index value process 608 positive number.In some cases, described process is skipped when index value is initialised.In other words, when index value is initialised, the first iteration processing positive RPS index value is skipped and the first positive RPS index value is write RPS.When only there is a positive number, then do not carry out the process of positive number.Electronic installation 302 also can send 610 bit streams 314.

List (5) illustrates an example of the pseudo-code grammer can applying this method.Represent with runic according to the amendment of system and method disclosed herein to grammer.

List (5)

When in the process at positive RPS index value during j>0, condition j==0 is skipped.In other words, the first positive reference picture is skipped.

Turn back to condition j>0 now.In this case, in for circulation when processing positive RPS index value, j is initialized to 0.When initialization, the first positive RPS index value is skipped in the process of positive RPS index value.Such as, when RPS index value [-8 ,-4,4,6], when processing positive RPS index value, 4 will be skipped, and only 6 will be added to the RPS index of current picture.

In another example, for index value [-2 ,-4,2,6], if symmtetic_flag is true, then for positive RPS_deltaPOC value, first that draws from negative reference picture indices must equal 2.Like this, the process of positive RPS index value can start from the second positive RPS index value (such as, 6).The such as Hierarchy coding structure of random access (passing rank B), positive and negative RPS index initial between symmetric condition be generally true.This is the symmetric property due to each current picture relevant with deltaPOC reference picture.

When an only positive RPS index value, electronic installation 302 can skip on the occasion of process.Such as, for index value [-4 ,-8,4], after the treatment, RPS [-4 ,-8] can be sent to bit stream.Then, when receiving, the reception electronic installation of such as decoder can receive RPS index value [-4 ,-8], and draws reference key value [-4 ,-8,4] for decoded current picture.Therefore, by skipping the positive reference picture of first in each RPS of each current picture, significant expense can be realized save in RPS signaling.

Such as, list (6) illustrates the grammer for processing RPS index value on decoder.

List (6)

List (6) illustrates can by of the grammer of a decoder processes example.This grammer can utilize the method discussed in conjunction with list (5) to generate by electronic installation 302.Such as, decoder can check that symmertric_flag is to find out the instruction that whether there is minimal negative RPS index value and corresponding positive RPS index value symmetry.If symmertric_flag indicates like this, decoder can be decoded to RPS and the absolute value of the RPS index value place of the first positive RPS index value use minimal negative RPS index value.To understand, and can adopt other method of decoding to picture listed in list (6), it corresponds to above in conjunction with the coding method that list (5) is discussed.

Fig. 7 is the block diagram of a configuration of the decoder 712 illustrated on electronic installation 702.Decoder 712 can be included in electronic installation 702.Such as, decoder 712 can be HEVC decoder.One or more in the element illustrated included in decoder 712 and/or decoder 712 are implemented in hardware, software or its combination.Decoder 712 can receive bit stream 714 (such as, bit stream 714 comprise the picture of one or more codings) for decoding.In some configurations, the bit stream 714 of reception can comprise the Overhead of reception, the buffer descriptor etc. of the head such as received, the PPS of reception, reception.The picture of the coding that bit stream 714 comprises can comprise the reference picture of one or more coding and/or the picture of other coding one or more.

The symbol (in the picture of one or more codings that bit stream 714 comprises) received can be decoded by entropy decoder module 768 entropy, thus generate movement information signal 770 and quantize, the coefficient 772 of convergent-divergent and/or conversion.

Movement information signal 770 can combine at motion compensating module 774 place and the part from the frame signals 798 of frame memory 778, and it can generate Inter prediction signals 782.The coefficient 772 quantizing, separate convergent-divergent and/or conversion by inverse module 762 re-quantization, convergent-divergent and inverse transformation, thus can generate the residual signals 784 of decoding.The residual signals 784 of decoding can be added to prediction signal 792 to generate the signal 786 of combination.Prediction signal 792 can be the signal being selected from the Inter prediction signals 782 or infra-frame prediction signal 790 generated by intra-framed prediction module 788.In some configurations, this signal behavior can based on bit stream 714 (such as, being controlled by bit stream 714).

Infra-frame prediction signal 790 can from the information prediction of the early decoding of the signal 792 (such as, in present frame) from combination.Also filtering can be carried out by the signal 792 of de-blocking filter 794 to combination.The signal 796 of gained filtering can be written to frame memory 778.The signal 796 of gained filtering can comprise the picture of decoding.

Frame memory 778 can comprise DPB as described herein.DPB can comprise the picture of the one or more decodings that can be used as short-term or long term reference frame maintenance.Frame memory 778 also can comprise the Overhead corresponding with the picture of decoding.Such as, frame memory 778 can comprise head, PPS information, loop parameter, buffer descriptor etc.One or more in these information can carry out signaling from encoder (such as, encoder 304).Frame memory 778 can provide the picture 718 of decoding.

Decoder 712 can comprise part RPS determination module 720, RPS formwork module 722 and/or RPS removing module 724.Part RPS determination module 720 can carry out generating portion RPS based on the signal obtained from bit stream 714.In some cases, can based on complete RPS determining section RPS on decoder 712.More details about part RPS determination module 720 are described below.

RPS formwork module 722 can draw RPS template at decoder 712 place.In some cases, RPS template can based on the signal received for bit stream 714, and such as GOP size, coding structure Sum fanction create.

RPS removing module 724 can receive instruction with the RPS deleting previous receipt at decoder 712 place.Such as, bit stream 714 can comprise the bit field in the head of mark in PPS and picture.RPS removing module 724 can help to identify the reference picture lost.More details about RPS removing module 724 will be provided below.

Fig. 8 is the flow chart of the configuration that the method 800 reducing RPS signal overhead on electronic installation 702 is shown.Electronic installation 702 can obtain 802 bit streams 714.Such as, bit stream 714 can obtain from the electronic installation 702 at decoder 712 place, or alternatively, obtains from another electronic installation.

Electronic installation 702 can obtain 804GOP based on bit stream 714.In some cases, GOP can be designated as the order picture of specific quantity, such as four or eight pictures.Such as, electronic installation 702 can obtain the GOP that 804 comprise 8 pictures.

The various modes that electronic installation 702 can draw complete RPS can be there are.In one configuration, electronic installation 702 can receive GOP size, coding receives and other necessary information, such as PPS.

In order to draw complete RPS, electronic installation 702 can according to coding structure and GOP size determination coded sequence.Such as, for low delay coding, coded sequence can be DISPLAY ORDER.In another case, for passing rank B, coded sequence can adopt minimal solution code delay.In the example being similar to the example shown in Fig. 2, size be 8 GOP by according to POC8,4,2,1,3,6,5, the order of 7 encodes.Alternatively, coded sequence can from minimum rank of passing towards higher Hierarchy coding.In this example, size be 8 GOP by according to POC0,8,4,2,6,1,3,5, the order of 7 encodes.Additionally, can represent to use which coded sequence by service marking.In some cases, described mark can be bit flag.

In order to draw complete RPS, electronic installation 702 also can determine reference picture based on the quantity of coding structure, time horizon id, reference picture and the ancillary rules set by encoder.Such as, when having the low delay coding of N reference frame, what have identical or lower time horizon always can be used as reference picture at front picture.Then, for residue N-1 reference picture, ancillary rules can be specified according to coded sequence and/or pass stratum's selection reference picture.Operation parameter can specify to use which rule.The example of this parameter is reference_picture_selection_rule, associates below discuss with list (9).

In addition, in order to draw complete RPS, electronic installation 702 can circulate (such as, iteration) according to coded sequence to GOP.Electronic installation 702 can add or keep after a while by the reference picture in conjunction with subsequent pic reference.The GOP of these subsequent pic can be identical with current picture or more late than current picture.If reference picture will be used for reference after a while, then it can be marked as using future.Otherwise it can be marked as " being not used in reference ".

Electronic installation 702 can draw 806 part RPS based at least one relative indexing value from complete RPS.Such as, electronic installation 702 can be attempted drawing complete RPS.

But, lose due to some reference pictures or there is no, only can draw part RPS.

Part RPS can have the frame of unavailable reference picture for IDR or CRA occurred due to the section start such as at picture sequence.Such as, assuming that the first picture is at POC8 place, there is RPS index value [-8 ,-10 ,-12 ,-16].As the picture first received, also not there is the reference picture corresponding with RPS index value [-10 ,-12 ,-16].In this example, the first picture cannot use the complete RPS with index reference value [-8 ,-10 ,-12 ,-16].On the contrary, part RPS comprises index value [-8], this index value represent can be used for decoding to picture only have reference picture (such as, POC8).

Then electronic installation 702 can carry out decoding 808 based on part RPS to picture.In other words, electronic installation 702 can utilize its can reference picture decoding 808 is carried out to picture.

In some implementations, part RPS can be drawn in encoder 304 side of electronic installation 302 in addition.But by drawing part RPS at decoder 712 place, due to except sending complete RPS, non-transmitting portion RPS, the RPS expense in bit stream 714 reduces.

List (7) illustrates a method for drawing part RPS.

List (7)

In list (7), the quantity of the complete reference picture collection of specifying in " num_full_ref_pic_sets " assigned picture parameter set.The quantity of the part reference picture collection of specifying in " num_partial_ref_pic_sets " assigned picture parameter set." ref_flag " [j] specifies the content of complete reference picture collection whether to be copied to part reference picture collection.

Fig. 9 is the flow chart of the configuration that the method 900 drawing part RPS on electronic installation 702 is shown.In order to decode to picture, electronic installation 702 may need the RPS with reference to current picture.But complete RPS may be unavailable.In this case, part RPS can be constructed.

In one configuration, part RPS can be constructed by electronic installation 702.Electronic installation 702 can obtain 902 bit streams 714 and similar fashion obtains 904GOP based on bit stream as described above.

Electronic installation 702 can iteration 906 on each picture in GOP.Such as, electronic installation 702 can loop through each picture, and the RPS index value that mark is corresponding with each picture.In some cases, iteration also can be carried out on multiple GOP.

Electronic installation 702 can identify 908 current picture, and wherein relative indexing value corresponds to current picture.Such as, this can be the picture that electronic installation 702 is attempted to decode.In addition, when mark 908 current picture, electronic installation 702 also can identify the POC of current picture.Such as, POC can specify the POC of the current picture in GOP.

List (8) below illustrates the example of the grammer for generating portion RPS.In list (8), " current_poc_in_GOP " specifies the current POC in GOP.Current_poc_in_GOP is in the scope from 1 to GOP size.

List (8)

Electronic installation 702 can iteration 910 at least one the relative indexing value in the complete RPS of current picture.Such as, if current picture has RPS index value [-1 ,-5 ,-9 ,-13], then electronic installation will cycle through the reference picture being positioned at deltaPOC=-1, deltaPOC=-5, deltaPOC=-9 and deltaPOC=-13 place.

Electronic installation 702 can determine whether 912 can use for each relative indexing value reference picture.In the above example, electronic installation 702 can attempt accessing be positioned at deltaPOC=-1 ,-5, the reference picture at-9 and-13 places.But one or more reference picture may be lost.

Determine 912 reference pictures whether can a method be by the currentPOC+refDeltaPOC<POC_of_Latest_CRA that satisfies condition.POC_of_Latest_CRA indicates the position of nearest completely random access (CRA) picture.In other words, POC_of_Latest_CRA is the POC of nearest IDR or CRA picture.If RPS index value relates to the reference picture be positioned at before nearest CRA picture, then this reference picture is by unavailable.Therefore, if meet currentPOC+refDeltaPOC<POC_of_Latest_CRA, then relative reference picture is lost and is not added to part RPS.Such as, assuming that current picture has POC1 (such as, POC=1) and POC_of_Latest_CRA is 0.Equally, assuming that current picture has RPS index value [-1 ,-5 ,-9 ,-13].0 (such as, 1+-1=0) is obtained to the first index value application conditions currentPOC+refDeltaPOC.Due to do not meet this condition (such as, 1+-1 be not less than 0 or POC_of_Latest_CRA), so the first reference key value is added to part RPS.CurrentPOC+refDeltaPOC is applied to the result other RPS reference key value generation currentPOC+refDeltaPOC being less than to POC_of_Latest_CRA.Therefore, other index value is not all added to part RPS.

And for example, assuming that current picture has POC5 (such as, POC=5).Equally, assuming that current picture has RPS index value [-1 ,-5 ,-9 ,-13].RPS index value application conditions currentPOC+refDeltaPOC is obtained [4,0 ,-4 ,-8] respectively.Because the first two value is not less than zero, so corresponding RPS reference key value is added to part RPS.Therefore, the part RPS created in this example has index value [-1 ,-5].

If reference picture can be used, then this picture can be added 914 to part RPS by electronic installation 702.Electronic installation 702 also can utilize part RPS index value to carry out decoding 916 to current picture.

Other configuration in, electronic installation 702 can evaluation part RPS and determine insert additional screens.Such as, only have and can be modified to include to the part RPS of a reference of reference picture three the additional reference pictures that can be used for decoding to this current picture.

Figure 10 is the flow chart of the configuration that the method 1000 drawing RPS template on electronic installation 702 is shown.As associative list (1)-(4) are discussed, RPS template can be used for Video coding to help to process the frequent coding structure used.The example of this class formation is that the random access that GOP size equals 8 or 16 passs rank B coding structure.Another example is the low delay coding structure that GOP size equals 4 or 8.

In one configuration, RPS template can be created.It should be noted that and can draw at both coder side and decoder-side place the establishment of RPS template, and without the need to sending complete RPS in PPS.In addition, drawing of RPS template can be carried out in conjunction with the establishment of part RPS described above or independent of the establishment of part RPS.

Electronic installation 702 can obtain 1002 bit streams 714.Electronic installation 702 can obtain the mark that 1004 instructions create RPS template.Such as, this mark can be arranged in PPS and to send.

And for example, electronic installation 702 can have for conventional GOP size, coding structure, time horizon setting and time-interleaved pattern and/or obtain one group of rule for drawing RPS template.

Utilize these rules, electronic installation 702 can create 1006RPS template based on the amount of information reduced.Such as, information about GOP size, coding structure Sum fanction can be utilized to draw RPS template.Such as, coding structure can specify Stochastic accessing (passing rank B) or low delay.Such as, rule can the setting of fixed time layer.List (9) below illustrates

List (9) below illustrates the grammer for the mode drawing RPS.

List (9)

" derive_rps_with_model_flag " specifies whether draw RPS at decoder-side.Derive_rps_with_model_flag is set as that 0 instruction sends RPS in PPS.Derive_rps_with_model_flag is set as that 1 instruction draws RPS at decoder place.

" coding_structure " equals 0, and to mean coding structure be pass rank B to encode.It is low delay coding that coding structure equals 1 presentation code structure.

" GOP_size_log2 " refers to the log2 of GOP size.GOP size equals 2 ^{(GOP_size_log2)}." number_of_reference_pictures (i) " specifies the quantity (such as, RefPicList0 and/or RefPicList1) of passing the reference picture that the every reference picture list of stratum uses for i-th." reference_picture_selection_rule " specifies the rule for selecting reference picture usually defined by encoder.

" coding_order " can specify the rule determining coded sequence.Coding_order 0 can represent the first coded sequence, and coding_order 1 can represent the second coded sequence.In one configuration, such as, coding_order 0 can represent minimal solution code delay order, and coding_order 1 can represent and passs rank preferred sequence (such as, passing hierarchical coding from minimum stratum of passing to higher).

" temporal_layer_exist_flag " specifies whether there is different time horizons.Mark equals 0 and means all frames and have identical time horizon, and mark equals 1 and means to there is different time horizons.

" temporal_id_ordering " specifies the sequence of the picture in current GOP with identical temporal_id.Such as, value be there is in the current GOP of 1 instruction identical temporal_id picture on decoding order continuously.Alternatively, value is that the picture in the current GOP of 0 instruction with identical temporal_id interweaves on decoding order.

Utilize the RPS template created, electronic installation 702 can carry out decoding 1008 to picture.When non-common RPS coding structure, also by directly sending RPS template in PPS and/or head carrys out signaling RPS template.

Figure 11 is the flow chart of the configuration that the method 1100 creating the instruction of deleting at least one reference picture on electronic installation 302 is shown.In some known implementations, such as, in Video coding integration and cooperation group (JCTVC) document JCTVC-F803_d5 given by, do not support to indicate the deletion action to the RPS of previous signaling.In other words, PPS does not support to send the signal deleting the RPS previously sent.

In another known implementation (such as, JCTVC-G637), propose the pruning of reference picture collection.In this implementation, can in PPS signaling from the quantity of specific RPS abridged short term reference picture for pruning.In RPS signaling picture in some disabled examples be random access point after a GOP.But JCTVC-G637 only bears picture for pruning continuous print.

In another known implementation, such as JCT-G198, proposes a kind of signaling schemes, and it sends constant deltaRPS value.In addition, the field value (such as, 00) of transmission can should not be used (such as, should be skipped) by signaling previous reference picture.

In some known implementations, dominant signaling long term reference picture (LTRP) individually in each head.Therefore, when not having signaling LTRP, it is by deleted.Therefore, may not need to send erasure signal for LTRP.But in some implementations of signaling LTRP, deleting mechanism disclosed herein can be applied to LTRP in addition.

System and method disclosed herein can at permission signaling to providing one or more additional beneficial effect in the deletion action of the RPS of previous signaling.By also effectively the new RPS of signaling obtain additional beneficial effect.In one configuration, electronic installation 302 receives the feedback instruction of 1102 at least one reference picture lost alternatively.This feedback can from identical or different electronic installation.Such as, the decoder 712 of decoding to picture can find the reference picture lost in RPS, and sends the instruction about the reference picture lost to electronic installation 302.

In another configuration, 302 do not receive feedback.On the contrary, electronic installation 302 can send and delete instruction after new CRA or the IDR picture of signaling.Such as, CRA or IDR picture can send deletion instruction by triggerable electronic device, to delete one or more unnecessary reference picture listed in the RPS of previous receipt.

Electronic installation 302 can create the instruction of at least one reference picture listed in the RPS that 1104 deletions previously provided.This step can in conjunction with receiving the step of the feedback indicating the picture lost or carrying out independent of described step.Electronic installation 302 can send 1106 these instructions in the bitstream.

Such as, delete instruction (such as, erasure signal) to send after the GOP after random access point.This can carry out and feed back without the need to receiving from decoder 712.Delete the instruction mark that can be used as in PPS to send.Such as, in PPS sending value be 1 mark indicate there is deleted bit field in head.Alternatively, in PPS sending value be 0 mark indicate do not send deleted bit field in head.

Additionally and/or alternatively, can to send as the bit field in head for each picture in the RPS of instruction and delete instruction.Such as, bit field can send indicated value 0 and delete corresponding reference picture with instruction from the RPS of instruction in head, or bit field can send indicated value 1 and should be kept to indicate corresponding reference picture in head.Bit field can be sent in head for each reference picture in the RPS of instruction.In another configuration, only can send this bit field for the negative reference picture in the RPS of instruction in head.In some configurations, delete instruction to send in both PPS and bit field.

List (10) below provides and can be used in PPS to send an example of the grammer deleting instruction.Represent with runic according to the amendment of system and method disclosed herein to grammer.

List (10)

In list (10), delete_pics_info_present_flag equal 1 appointment head can signaling from the deletion action being included in the short term reference picture collection that frame parameter is concentrated.Delete_pics_info_present_flag equals 0 and specifies in head and do not have signaling for the deletion action being included in the short term reference picture collection that frame parameter is concentrated.Pic_parameter_set_id and seq_parameter_set_id defines as mentioned above.

List (11) below provides and can be used in head to send an example of the grammer deleting instruction.Represent with runic according to the amendment of system and method disclosed herein to grammer.

List (11)

In list (11), the corresponding jth short term reference picture that " keep_pic_flag " [j] equals the reference picture collection that frame parameter that 1 appointment has index short_term_ref_pic_set_idx is concentrated should be kept.Keep_pic_flag [j] equals the corresponding jth short term reference picture of the reference picture collection that frame parameter that 0 appointment has index short_term_ref_pic_set_idx is concentrated should deleted (such as, being omitted).

The lead-in section of frame of " pic_order_cnt_lsb " assigned picture sequential counting to coding or the MaxPicOrderCntLsb delivery of the field of coding.The length of pic_order_cnt_lsb syntactic element is log2_max_pic_order_cnt_lsb_minus4+4 bit.The value of pic_order_cnt_lsb, by the scope of 0 to MaxPicOrderCntLsb-1, comprises end value." MaxPicOrderCntLsb " refers to the maximum value possible to (" pic_order_cnt_lsb+1 ")." log2_max_pic_order_cnt_lsb_minus4 " specifies the value of the variable MaxPicOrderCntLsb of the decoding process being used for picture order count as follows: MaxPicOrderCntLsb=2 ^{(log2_max_pic_order_cnt_lsb_minus4+4)}.The value of log2_max_pic_order_cnt_lsb_minus4 in the scope of 0 to 12, can comprise end value.

The syntactic element utilized in moving frame parameter set creates by the short term reference picture collection that " short_term_ref_pic_set_pps_flag " equals 1 appointment current picture.Syntactic element in the short_term_ref_pic_set () syntactic structure utilized in head creates by the short term reference picture collection that short_term_ref_pic_set_pps_flag equals 0 appointment current picture.

" short_term_ref_pic_set_idx " specifies the index by being used for the list creating the short term reference picture collection of specifying in the moving frame parameter set of the reference picture collection of current picture.Syntactic element short_term_ref_pic_set_idx will be represented by ceil (log2 (num_short_term_ref_pic_sets)) bit.Short_term_ref_pic_set_idx, by the scope of 0 to num_short_term_ref_pic_sets-1, comprises end value, and wherein num_short_term_ref_pic_sets is the syntactic element from moving frame parameter set.

Variable StRpsIdx draws as shown in list (12) below.

List (12)

In list (12), " short_term_ref_pic_set " indicates short term reference picture collection, and " num_short_term_ref_pic_sets " indicates the sum of short term reference picture collection.

Figure 12 is the flow chart of the configuration that the method 1200 of deleting at least one reference picture on electronic installation 702 is shown.Alternatively, electronic installation 702 can delete at least one reference picture lost in 1202RPS.Such as, electronic installation 702 can perform the similar step of those steps of describing with the establishment of bound fraction RPS above, wherein determines whether reference picture can be used.Additionally or alternatively, electronic installation 702 can call reference picture and find that its is lost or damages, or can delete the reference picture of 1202 loss according to alternate manner.

Alternatively, electronic installation 702 can send the feedback of at least one reference picture lost of 1204 instructions.Such as, the feedback of the POC lost, RPS or other signal various is indicated can be sent out the picture indicating loss by backward channel.

Electronic installation 702 can obtain the instruction of at least one reference picture listed in the RPS that 1206 deletions had previously obtained.In one case, described signal can be obtained from the bit field in the head of the mark PPS and each picture in RPS.Such as, can signaling delete_pics_info_present_flag and keep_pic_flag [j].

Electronic installation 702 can delete at least one reference picture in 1208 RPS previously obtained.In some cases, delete instruction to receive with the follow-up RPS that should substitute the RPS that will delete.In another case, described instruction can specify deletion no longer to need the RPS of the previous receipt for further picture of decoding.In another case, described instruction can be that the RPS deleting previous receipt can be sent out to make follow-up alternative RPS.It should be noted that the instruction that at least one reference picture is deleted in acquisition 1206 and the picture that the step of deleting at least one reference picture described in 1208 can be lost with detection 1202 and send 1204 previous steps fed back and be combined or carry out independent of described step.

As its example, if the RPS previously obtained has index value [-2 ,-1,1,3,5], and electronic installation 702 receives the instruction of deletion second reference picture, then the reference set previously obtained will delete RPS index value-1.In other words, the reference set previously obtained will become [-2,1,3,5].

Figure 13 illustrates the various parts that can be used in electronic installation 1302.It is one or more that electronic installation 1302 can be implemented as in electronic installation as herein described (such as, electronic installation 102,302,702).

Electronic installation 1302 comprises the processor 1317 of the operation controlling electronic installation 1302.Processor 1317 also can be referred to as CPU.Can comprise read-only memory (ROM), random access memory (RAM) the two or the memory 1311 of device of any type of information can be stored, instruction 1313a (such as, executable instruction) and data 1315a is provided to processor 1317.A part for memory 1311 also can comprise nonvolatile RAM (NVRAM).Memory 1311 can with processor 1317 electronic communication.

Instruction 1313b and data 1315b also can reside in processor 1317.Be written into instruction 1313b in processor 1317 and/or data 1315b and also can comprise the instruction 1313a from memory 1311 in order to be performed by processor 1317 or be processed and load and/or data 1315a.Instruction 1313b can be performed to realize system and method disclosed herein by processor 1317.

Electronic installation 1302 can comprise one or more communication interface 1319 for other electronic device communications.Communication interface 1319 can based on cable communicating technology, wireless communication technology or both.The example of communication interface 1319 comprises the wireless transceiver etc. of serial port, parallel port, USB (USB), Ethernet Adaptation Unit, IEEE1394 bus interface, small computer system interface (SCSI) bus interface, infrared (IR) communication port, Bluetooth wireless communication adapter, foundation third generation partner program (3GPP) specification.

Electronic installation 1302 can comprise one or more output device 1323 and one or more input unit 1321.The example of output device 1323 comprises loud speaker, printer etc.The output device that can be included in the type in electronic installation 1302 is display unit 1325.The display unit 1325 used with configuration disclosed herein can utilize any suitable image projection technology, such as cathode ray tube (CRT), liquid crystal display (LCD), light-emitting diode (LED), gas plasma, electroluminescence etc.Display controller 1327 can be provided for and the data be stored in memory 1311 are converted to the text be presented on display 1325, figure and/or moving image (optionally).The example of input unit 1321 comprises keyboard, mouse, microphone, remote control, button, joystick, trace ball, touch pad, touch-screen, light pen etc.

The various parts of electronic installation 1302 are coupled by bus system 1329, and it also can comprise power bus, control signal bus and status signal bus in addition except data/address bus.But, for clarity, in fig. 13 various bus is depicted as bus system 1329.Electronic installation 1302 shown in Figure 13 is functional block diagrams, and the list of non-specific parts.

Figure 14 illustrates the flow chart to a configuration of the method 1400 that picture is decoded on electronic installation 702.Electronic installation 702 can obtain 1402 bit streams 714.Such as, bit stream 714 can obtain from electronic installation 702 (such as, from memory), or can receive from another electronic installation.

Electronic installation 702 can obtain 1404 current picture.Such as, electronic installation 702 can obtain the current picture in 1404 embedding bit streams 714.

Electronic installation 702 can obtain 1406 relative RPS parameters.Such as, relative RPS can in PPS signaling.Therefore, relative RPS parameter can obtain from PPS.In some configurations, relative RPS parameter can be that negative is to RPS parameter.In other configuration, relative RPS parameter can be just relative RPS parameter.In some configurations, relatively negative RPS parameter can be negative RPS index value.Such as, negative RPS index value can be the current picture relative to obtaining.In other words, relative RPS index value can refer to the position of the reference picture of the index position relative to current picture.

Although the relative RPS parameter that some examples relate to as negative RPS parameter with configuration, should be appreciated that and can use positive parameter according to corresponding manner.In other words, even if provide about the example of negative to RPS parameter herein, the similar instances of the just relative RPS parameter of use also can be adopted.Equally, in many cases, other example of plus or minus intension can be reversed.

Electronic installation 702 can by index value initialization 1408.In some configurations, index value can be initialized as 0 by electronic installation 702.In other configuration, electronic installation 702 can based on the parameter obtained by index value initialization.

Electronic installation 702 can based on another RPS parameter of index value process 1410.In some configurations, another RPS parameter described can be positive RPS parameter.In other configuration, another RPS parameter described can be negative RPS parameter.In some configurations, another RPS parameter described can be positive RPS index value.Such as, list (13) below illustrates a method based on the positive RPS parameter of index value process.

List (13)

In list (13), value=read () represents from bit stream reading information.In some configurations, index value can as shown in list (13) " prev ".In some configurations, index value can be RPS_deltaPoc.In addition, in some configurations, index value can be initialized to 0.In other configuration, index value can be initialized to the least absolute value of negative RPS index value.In other configuration, index value can be initialized to the negative value (such as, minimum positive RPS index value is multiplied by-1) of the minimum value in positive RPS index value.In some configurations or example, index value can be initialized to nonzero value.

Be similar to relative RPS parameter, another RPS parameter described in it should be noted that just can be or is being negative.In other words, even if provide the example relating to positive RPS parameter herein, the similar instances using negative RPS parameter also can be adopted.Therefore, in some configurations, relative RPS parameter can be negative, and another RPS parameter described is just.Alternatively, in some configurations, relative RPS parameter just can be, and another RPS parameter described is negative.Usually, relative RPS parameter and another RPS parameter described can have different symbols (such as, negative or positive).

Electronic installation 702 can carry out decoding 1412 to current picture.Such as, this can perform on decoder 712.Decoder 712 can be HEVC type decoder 712.

Figure 15 illustrates on the electronic device to the flow chart configured more specifically of the method 1500 that picture is decoded.In one configuration, electronic installation 702 can obtain 1502 bit streams, obtains 1504 current picture and obtains 1506 relative RPS parameters, as previously discussed in conjunction with Figure 14.

Electronic installation 702 can based on relative RPS parameter by index value initialization 1508.Such as, list (14) illustrates the grammer of index value initialization 1508 example based on relatively negative RPS parameter.Represent with runic according to the amendment of system and method disclosed herein to grammer.In some configurations, the method discussed in conjunction with list (14) may correspond to the method in previously discussed list (4).

List (14)

In some configurations, index value can be " prev " in list (14), and it can represent previous index value.In this case, prev can carry out initialization based on the least absolute value of negative RPS_deltaPoc." RPS_deltaPOC " refers to RPS index value.

Such as, assuming that obtained the RPS with reference key [-2 ,-4,2] by electronic installation 702.But, due to as composition graphs 4 in the mode discussed encode, such as, the first positive RPS index received at electronic installation 702 place can have value 0.Negative RPS index value is processed to generate one or more relatively negative RPS parameter.Here ,-2 are obtained as relatively negative RPS parameter.

Continue this example, based on relatively negative RPS parameter by index value initialization 1508.List (14) illustrates can based on relatively negative RPS parameter by prev initialization.Here, based on relatively bearing RPS parameter-2 by prev initialization.In some cases, relatively negative RPS parameter can be the least absolute value of the set of the negative RPS index value taking from current picture.Therefore, the least absolute value that prev is initialized to the set of taking from negative RPS index value subtracts 1.In other words, prev=1 (such as, |-2|-1).

Electronic installation 702 can based on another RPS parameter of index value process 1510.Such as, return above-mentioned example, electronic installation 702 can based on another RPS parameter of prev=1 process 1510.In one case, process positive RPS parameter and can relate to employing RPS_deltaPoc (k)=value+1+prev.In this case, RPS_deltaPoc (k) will equal value (such as, relative value 0) and adds 1 and add prev (1).In other words, RPS_deltaPoc (k)=2.Therefore, in this example, the positive RPS parameter of generation is 2.In addition, the RPS index value of the current picture of generation is [-2 ,-4,2].

Once obtain RPS index value, current picture just can be decoded 1512 by electronic installation 702.Such as, current picture can use the RPS index value of generation to decode.

In another example, assuming that RPS has index value [-4 ,-6,4].Here ,-4 will be obtained as negative to RPS parameter.Index value can be initialized to 3 or the least absolute value of negative RPS index value subtract 1.In other words, prev=|-4|-1=3.Process positive RPS parameter value and will obtain RPS index value 4.Therefore, in this example, the set of RPS index value will be [-4 ,-6,4].

Figure 16 illustrates another flow chart configured more specifically to the method 1600 that picture is decoded on electronic installation 702.Electronic installation 702 can obtain 1602 bit streams, obtains 1604 current picture and obtains 1606 relative RPS parameters, as previously discussed in conjunction with Figure 14.

Electronic installation 702 can obtain 1608 symmetric flag.In some configurations, symmetric flag can be same or similar with previously discussed symmetric flag.Such as, symmetric flag can indicate relatively negative RPS parameter to correspond to positive RPS parameter.Such as, the set [-2 ,-6,2,4] of given RPS index value, then symmetric flag can indicate index value-2 to correspond to index value 2.

In addition, whether symmetric_flag (symmetric flag) can send to indicate the first positive RPS index value negative RPS index value can be utilized to carry out initialization in bit stream 714.Such as, symmetric flag can indicate index value should be initialized to least absolute value in negative RPS_deltaPoc value.Alternatively, symmetric flag can indicate the least absolute value be not initialized as by index value in negative RPS_deltaPoc value.In this case, index value can be initialized to zero.

Electronic installation 702 can based on relatively negative RPS parameter and symmetric flag by index value initialization 1610.As an example, list (15) below illustrates index value initialization 1610 mode based on relatively negative RPS parameter and symmetric flag.Represent with runic according to the amendment of system and method disclosed herein to grammer.

List (15)

In a configuration of list (15), RPS_deltaPOC (num_negative_pics-1) stores negative RPS index value.RPS_deltaPOC (num_negative_pics) to RPS_deltaPOC (num_negative_pics+num_positive_pics-1) stores positive RPS index value.In this case, above-mentioned RPS_deltaPoc (num_negative_pics) stores the first positive RPS index value.In other words, RPS_deltaPoc (num_negative_pics) relates to the first positive RPS index value.First, electronic installation 702 is examined and be there is at least one positive RPS index value.Then, electronic installation 702 determines whether there is symmetric flag and whether this mark is set to very.Be set to genuine symmetric flag if existed, then electronic installation 702 is based on relatively bearing RPS parameter by index value initialization 1610.Therefore, the initialization of index value is based on both relatively negative RPS parameter and symmetric flag.In this configuration, the index value of RPS_deltaPoc (num_negative_pics) is initialized to the least absolute value of negative RPS_deltaPoc.Such as, when RPS index value [-8 ,-4,4,6], the first positive RPS index value can be initialized to the least absolute value of 4 or negative RPS_deltaPoc.

Electronic installation 702 can based on index value process 1612 other RPS parameter one or more.Such as, for positive index value 4, in the examples described above, electronic installation 702 can generate the second positive RPS index value 6.In addition, when index value is initialised, electronic installation 702 can skip at least one in other RPS parameter of process.In other words, when the first positive RPS index value is initialised, processes positive RPS index value and skip to the second positive RPS index value.Such as, in the examples described above, when the first positive RPS index value is initialized to 4, process skips to the second positive RPS index value with generation value 6.Therefore, in this example, the set [-8 ,-4,4,6] of RPS index value is obtained.

Under the certain situation that only there is a RPS index value, can skip the process of positive RPS index value when the initialization of index value.Such as, for index value [-4 ,-8,4], electronic installation 702 can receive RPS index value [-4 ,-8] and draw the reference key value [-4 ,-8,4] for decoded current picture.Therefore, by skipping the process of the positive reference picture of first in each RPS of each current picture, the processing time can be reduced.

Once obtain RPS index value, current picture just can be decoded 1614 by electronic installation 702.Such as, current picture can use the RPS index value of process to decode.

In another example, for RPS index value [-2 ,-4,2,6], if symmetric_flag is true, then for positive RPS_deltaPOC value, as drawn from negative RPS index value, first must equal 2.Also can generate other positive RPS index value from initialized index value.Such as, the process of positive RPS index value can start from the second positive RPS index value (such as, 6), and can based on initialized index value 2.

Figure 17 is the flow chart of a configuration of the method 1700 that signaling reference picture collection on electronic installation 302 is shown.In a known implementation, such as JCTVC-G637, proposes and prunes reference picture collection.This implementation proposes the mode of a kind of signaling some short term reference picture in specific reference picture collection (RPS) abridged of signaling from parameter sets (PPS).Such as, some parts due to the first picture group (GOP) after belonging to random access point in the picture of signaling in RPS and unavailable time, use which.

System and method disclosed herein can be reference picture collection (RPS) signaling and prediction provides one or more additional beneficial effect.Additional beneficial effect can be obtained, such as, relative to the efficiency improvement of known method by signaling between RPS and prediction when signaling part RPS.In addition, the comparable known method of system and method disclosed herein is simpler.

In one configuration, electronic installation 302 can indicate the reference picture collection (RPS) of 1702 previous signalings corresponding with current picture.Such as, electronic installation 302 can be encoder 304.Encoder 304 can be HEVC type encoder 304.

Current picture can belong to random access point after a GOP.The RPS of previous signaling can send as a part for sequence parameter set (SPS) or as the part of another parameter set (such as, parameter sets (PPS), adaptation parameter collection (APS), video parameter collection (VPS) etc.) at random access point place.Alternatively, the RPS of previous signaling can utilize another yuan in bit stream usually to send, or can obtain from the mechanism of some bands.In another case, current picture can not belong to random access point after a GOP.

The RPS of previous signaling can be identified by index.Such as, index can be RPS index, such as rps_idx [idx].Index can be included in the respective value used in the decoding of current picture.

Deletion action by the RPS to previous signaling carrys out the signaling RPS corresponding with current picture.Such as, reference picture may be lost, and decoder 712 can via feedback notification encoder 304 reference picture.But encoder 304 may not use the picture lost as reference frame.Such as, when this can betide and there is non-low delay condition.Utilize the RPS of previous signaling, decoder 712 can utilize the reference picture of one or more previous acquisition to decode to current picture.

Electronic installation 302 can be one or more picture setting 1,704 first marks in the RPS of previous signaling.If picture will be used as the reference picture of current picture, then can set 1,704 first marks.Such as, the first mark can represent Boolean, and if the reference picture being used as current picture then can be set to " 1 " by picture.Alternatively, can understand, in another configuration, the first mark can be set to " 0 " and will be used as the reference picture of current picture to indicate picture.

As used herein, the term " just (positive) " used when defining mark refers to that this mark is set.Such as, if be set as making picture by being used as the reference picture of current picture, then first be just masked as.If picture is not used as the reference picture of current picture, then this mark can not be set (that is, not just being).Should be appreciated that in some configurations, alternatively, negative value can be used when setting mark.In some configurations, if picture is not used as the reference picture of current picture, then mark can be omitted.

The RPS of previous signaling can indicate multiple pictures of the reference picture by being used as current picture.In this case, the first mark as each picture of the reference picture of current picture is just set to.In other words, for each reference picture in the RPS of previous signaling, if reference picture will be used as the reference picture of decoding to current picture, then respective flag will be set.In addition, in this case, the first mark being not used as each picture of the reference picture of current picture is set to just not be.

Electronic installation 302 can send 1704 bit streams.Bit stream can comprise the RPS of the previous signaling setting the first mark.Bit stream can comprise the second mark of multiple setting.Second mark of each setting may correspond to the reference picture of the reference picture that can be used as current picture in the RPS of previous signaling.

In some configurations, bit stream can get rid of current RPS by current picture service marking value.In other words, bit stream can not comprise current RPS by current picture service marking value.Current RPS can be predicted and/or be determined by the respective value of the electronic installation of such as decoder 712 based on other reference pictures one or more of signaling in the RPS of previous signaling by current picture service marking value.

In a mode, the RPS of previous signaling can at signaling in sequence parameter set (SPS).List (16) below provides and can be used in sequence parameter set raw byte sequence payload (RBSP) with an example of the grammer of signaling reference picture collection.Represent with runic according to the amendment of system and method disclosed herein to grammer.

List (16)

In list (16), the quantity of the complete short term reference picture collection of specifying in " num_short_term_ref_pic_sets " assigned picture parameter set.The value of num_short_term_ref_pic_sets, in the scope of 0 to 64, comprises end value.

" predicted_short_term_ref_pic_sets_present_flag " equals 1 appointment and is present in this sequential parameter with reference to some prediction short term reference picture collection of complete reference picture collection coding and concentrates.Predicted_short_term_ref_pic_sets_present_flag equals this sequential parameter of 0 appointment and concentrates the prediction short term reference picture collection do not existed with reference to complete reference picture collection coding.

In some configurations, part short term reference picture collection can be a part for prediction short term reference picture collection.Such as, part short term reference picture collection exists mark can be the part that prediction short term reference picture collection exists mark.

As shown in list (16), the reference picture collection (RPS) of previous signaling is by the mark in SPS, and such as predicted_short_term_ref_pic_sets_present_flag carrys out signaling.Bit field in SPS may correspond to each picture in the RPS predicted between application RPS.Such as, bit field signaling value " 1 " or " 0 " can keep to indicate or abandon from the corresponding reference picture in the RPS of previous signaling or corresponding reference picture.

The quantity of the prediction short term reference picture collection of specifying in " num_predicted_short_term_ref_pic_sets_minus1 " specified sequence parameter set subtracts 1.The value of num_short_term_ref_pic_sets_minus1, in the scope of 0 to 63, comprises end value.

In one configuration, decoder 712 can be the total allocation space of short term reference picture collection, because the video sequence of coding can be included at most a short term reference picture collection of dominant signaling in the head of current picture.Such as, if predicted_short_term_ref_pic_sets_present_flag mark equals 1, then the sum of short term reference picture collection can be determined to be equivalent to num_short_term_ref_pic_sets+num_predicted_short_term_ref _ pic_sets_minus1+1+1.If predicted_short_term_ref_pic_sets_present_flag mark equals 0, then the sum of short term reference picture collection can be determined to be equivalent to num_short_term_ref_pic_sets+1.

In the configuration, if predicted_short_term_ref_pic_sets_present_flag mark equals 1, then in the list of short term reference picture collection, in head, the short term reference picture collection of dominant signaling will always have the index equaling (num_short_term_ref_pic_sets+num_predicted_short_term_ref _ pic_sets_minus1+1).In addition, in the configuration, if predicted_short_term_ref_pic_sets_present_flag mark equals 0, then in the list of short term reference picture collection, in head, the short term reference picture collection of dominant signaling will always have the index equaling (num_short_term_ref_pic_sets+1).

" rps_idx [idx] " specifies the index drawing the complete short term reference picture collection used with the prediction short term reference picture collection of index idx signaling.The complete short term reference picture that " num_pics_in_rps_idx [idx] " specifies the frame parameter with index rps_idx [idx] to concentrate concentrates the sum of the negative picture comprised and the total sum of positive picture.In some configurations, num_pics_in_rps_idx [idx] does not need to concentrate signaling, because know it from the corresponding short term reference picture collection with index rps_idx [idx] at prediction short term reference picture.

The corresponding jth short term reference picture that " keep_pic_flag " [j] equals the reference picture collection that 1 appointment is concentrated from the sequential parameter with index rps_idx [idx] should be kept to draw this prediction reference pictures collection.Keep_pic_flag [j] equal the complete short term reference picture collection that 0 appointment is concentrated from the frame parameter with index rps_idx [idx] corresponding jth short term reference picture should deleted (such as, omit) to draw this prediction reference pictures collection.

In other method, the RPS of previous signaling can at signaling in parameter sets (PPS).List (17) below provides and can be used in parameter sets raw byte sequence payload (RBSP) with an example of the grammer of signaling inter-reference picture.Represent with runic according to the amendment of system and method disclosed herein to grammer.

List (17)

Figure 18 is the flow chart of another configuration of the method 1800 that signaling reference picture collection on electronic installation 302 is shown.Electronic installation 302 can signaling one or more complete reference picture collection (RPS).RPS can send in conjunction with the picture of early decoding.

Electronic installation 302 can determine that 1904 whether by any for signaling prediction RPS.If there is no by the prediction RPS of signaling, then electronic installation 302 can not predict RPS by signaling 1806.Such as, electronic installation 302 can equal " 0 " by signaling 1806predicted_short_term_ref_pic_sets_present_flag.

If existed one or more prediction RPS of signaling, then electronic installation 302 can one or more prediction RPS described in signaling 1808.Such as, electronic installation 302 can equal " 1 " by signaling 1808predicted_short_term_ref_pic_sets_present_flag.

Electronic installation 302 can send the quantity of 1810 prediction RPS.Such as, electronic installation 302 can send 1810num_predicted_short_term_ref_pic_sets_minus1.

For each prediction RPS of signaling, electronic installation 302 can send 1812 references to the complete RPS of previous signaling.Such as, electronic installation 302 can send 1812rps_idx [idx].

For each reference picture in the RPS of previous signaling, if reference picture will be used as the reference picture of current picture, then electronic installation 302 can signaling 1814.Such as, electronic installation 302 can set the mark of the reference picture of current picture whether instruction reference picture will be used as, such as, keep picture mark.

Electronic installation 302 can get rid of or do not send 1816 current RPS by current picture service marking.In other words, electronic installation 302 can not indicate, signaling or the current RPS that encodes by current picture service marking value.Current RPS can be predicted and/or be determined by the electronic installation of such as decoder 712 by current picture service marking value.

In another way, the RPS of previous signaling can concentrate signaling at short term reference picture.List (18) below provides and can be used on short term reference picture and concentrate an example with the grammer of signaling reference picture collection.Represent with runic according to the amendment of system and method disclosed herein to grammer.

List (18)

In alternate manner, the RPS of previous signaling can at adaptation parameter collection (APS), video parameter collection (VPS), the first-class middle signaling of sheet.In addition, the RPS of previous signaling can utilize another element in bit stream to carry out signaling.

Figure 19 is the flow chart configured more specifically of the method 1900 that signaling reference picture collection on electronic installation 302 is shown.Electronic installation 302 can utilize prediction short term reference picture collection to there is mark to indicate 1902 and predict short-term RPS based on reference picture collection (RPS) signaling of previous signaling.Such as, the current picture that usage forecastings short term reference picture collection exists mark can be Boolean, and whether it indicates the RPS of previous signaling to be decoded for current picture by signaling.In some configurations, electronic installation 302 can be encoder 304.Encoder 304 can be HEVC type encoder 304.

Current picture can belong to random access point and/or to the GOP after the deletion action of the RPS of previous signaling.In either case, compared with current known methods, the RPS of the previous signaling of signaling can raise the efficiency.

The RPS of previous signaling may correspond in index.Such as, the RPS of previous signaling carrys out signaling as the index in the RPS set of one group of previous signaling.In addition, described index can be RPS index, such as rps_idx [idx].Described index can indicate predicts the RPS by the previous signaling be used for the RPS that current picture is decoded by being used for.

Electronic installation 302 can indicate the second reference picture in the RPS of 1904 previous signalings by current picture service marking value.Second reference picture can be the value corresponding with current picture by current picture service marking value.In other words, when the RPS of the previous signaling of instruction 1902, electronic installation 302 can indicate one or more respective value of other reference picture in the RPS of previous signaling.Described one or more respective value of other reference picture in the RPS of previous signaling can be used by the current picture value of statistical indicant of other reference picture in the RPS of previous signaling.Respective value can indicate 1904 by electronic installation 302 and be encoded by encoder 304.

If the picture in the RPS of previous signaling will be used as the reference picture of current picture, then electronic installation 302 can be this picture setting 1906 maintenance picture marks.In one configuration, the bit field in the index keeping picture mark can represent corresponding with the RPS of previous signaling.Such as, each reference picture available signal in the RPS corresponding with index rps_idx [idx] notifies to keep picture mark, and the instruction of this maintenance picture mark keeps or abandons corresponding reference picture or corresponding reference picture values from the RPS of previous signaling.

Electronic installation 302 can get rid of 1908 current RPS by current picture service marking.In other words, the electronic installation 302 of such as encoder 304 can not indicate, signaling or the current RPS that encodes by current picture service marking value.Current RPS's can by the electronic installation of such as decoder 712 being predicted by current picture service marking value and/or being determined based on other pictures one or more in the RPS by previous signaling by current picture service marking value.

Electronic installation 302 can send 1910 bit streams.This bit stream can comprise the RPS of the previous signaling being set with prediction short term reference picture collection existence mark.Bit stream also can comprise corresponding with the one or more reference pictures for decoding to the current picture multiple set by current picture service marking.

Figure 20 is the flow chart of a configuration of the method 2000 that prediction reference pictures collection on electronic installation 302 is shown.In some known implementations, such as, in HEVC draft 6 given by, support to predict between RPS.But compared with method as herein described, the method is more complicated and efficiency is lower.

In another known implementation, such as JCTVC-I0347, provides the grammer for predicting between RPS.This grammer have modified HEVC draft 6 grammer by delta_rps_sign and abs_delta_rps_minus1 being merged into a syntactic element.

In another known implementation, such as JCT-G198, proposes between reference picture collection and predicts.Main service condition in this implementation to be encoded to new RPS by the RPS relative to previous signaling to reduce the bit number of the new RPS of signaling.In this implementation, signaling schemes sends constant deltaRPS value.Added field can be sent whether will be skipped (such as, should not use) with the POC of notice from previous RPS.

In one configuration, electronic installation 302 obtains 2002 bit streams.Electronic installation 302 can obtain 2004 current picture.Such as, current picture can obtain from bit stream.

Electronic installation 302 can obtain the reference picture collection (RPS) of previous signaling.The RPS of previous signaling may Already on electronic installation 302.In this case, bit stream can be the signal that current picture sends the use of the RPS of the previous signaling of instruction.

In some configurations, the RPS of previous signaling can be sent by encoder 304 and receive in the bitstream.Such as, bit stream can comprise indicate the RPS of previous signaling for current picture is decoded first mark.

The RPS of previous signaling can comprise the one or more pictures for decoding to previous picture.The RPS of previous signaling may correspond in index.Such as, the RPS of previous signaling carrys out signaling as the index in the RPS set of one group of previous signaling.This index can indicate corresponding reference picture for decoding to current picture and/or value.

For each picture in the RPS of previous signaling, if this picture should be used as the reference picture of current picture, then electronic installation can obtain 2,008 first mark instructions.First mark can indicate picture whether will to be used as the reference picture of current picture.Such as, the first mark can represent Boolean, and if the reference picture being used as current picture then can be set to " 1 " by picture.Alternatively, can understand, in another configuration, the first mark can be set to " 0 " and will be used as the reference picture of current picture to indicate picture.

If the first mark is set so that picture in the RPS of previous signaling is by being used as the reference picture of current picture, then first be just masked as.If picture is not used as the reference picture of current picture, then this mark can not be set (that is, not just being).Should be appreciated that in some configurations, can negative value be used when setting first indicates.Multiple pictures in the RPS of previous signaling are by when being used as the reference picture of current picture, and each picture can have the first corresponding mark.

If first is just masked as, then from of the RPS of a previous signaling respective value, electronic installation 302 can determine that 2,010 second indicate.In other words, if the picture in the RPS of previous signaling is used as the reference picture of current picture, then electronic installation 302 can infer the second value of statistical indicant of current picture.Can infer, predict or determine the second value of statistical indicant from the second value of statistical indicant of the reference picture the RPS of previous signaling.Second mark can be used by current picture mark.

Electronic installation 302 can carry out decoding 2012 to current picture.This can perform on such as decoder 712.Decoder 712 can be HEVC type decoder 712.

Figure 21 is the flow chart of another configuration of the method 2100 that prediction reference pictures collection on electronic installation 302 is shown.Electronic installation 302 can obtain the signal of the complete reference picture collection (RPS) of 2102 one or more previous receipt.Such as, this signal can indicate the RPS for the previous receipt of decoding to previous picture.

Electronic installation 302 can determine the 2104 any prediction RPS that whether there is signaling.If there is no the prediction RPS of signaling, then electronic installation 302 can obtain the signal that RPS is not predicted in 2106 instructions.Such as, electronic installation 302 can obtain the signal that 2106 such as predicted_short_term_ref_pic_sets_present_flag equal " 0 ".

If there is the prediction RPS of one or more signaling, then electronic installation 302 can obtain the signal of 2108 instructions one or more prediction RPS.Such as, electronic installation 302 can obtain the signal that 2108 such as predicted_short_term_ref_pic_sets_present_flag equal " 1 ".

Electronic installation 302 can obtain the quantity of 2110 prediction RPS.Such as, electronic installation 302 can obtain 2110num_predicted_short_term_ref_pic_sets_minus1.

For each prediction RPS of signaling, electronic installation 302 can obtain 2112 references to the complete RPS of previous signaling.Such as, electronic installation 302 can obtain 2112rps_idx [idx].

For each reference picture in the RPS of previous signaling, if reference picture will be used as the reference picture of current picture, then electronic installation 302 can obtain 2114 signals.Such as, electronic installation 302 can obtain instruction reference picture and whether will be used as the mark of the reference picture of current picture, such as, keep picture mark.

Electronic installation 302 can from the value of the corresponding reference picture the RPS of previous signaling determine 2116 current picture by current picture service marking value.Electronic installation 302 by the one or more correspondences based on the one or more reference pictures notified in previous RPS (such as, by current picture service marking value) value infer or prediction by current picture service marking value, determine 2116 current picture by current picture service marking value.

Electronic installation 302 can carry out decoding 2118 based on by current picture service marking value to current picture.By current picture service marking value can comprise current picture by current picture service marking value.

Figure 22 is the flow chart configured more specifically of the method 2200 that prediction reference pictures collection on electronic installation 302 is shown.Electronic installation 302 can obtain 2202 bit streams and obtain 2204 current picture.Such as, current picture can obtain from bit stream.

The reference picture collection (RPS) of the previous signaling of mark acquisition 2204 can be there is in electronic installation 302 based on prediction short term reference picture.Like this, previous signaling and the RPS be present on electronic installation 302 can be used and/or be reused to decode to current picture together with the reference picture of early decoding.

There is the existence that mark can notify the RPS of previous signaling in prediction short term reference picture.Such as, be set if prediction short term reference picture exists mark, then it can notify the RPS of previous signaling to electronic installation 302.In some configurations, predict that short term reference picture exists the existence indicated can notify RPS from previous signaling to electronic installation 302.

RPS can separate with the current of reality or previous picture and sends.The part that RPS can be used as sequence parameter set (SPS), parameter sets (PPS), another parameter set and/or head sends.

For each reference picture in the RPS of previous signaling, if picture should be used as the reference picture of current picture, then electronic installation 302 can obtain 2206 maintenance picture mark instructions.Picture mark is kept to indicate the picture in the RPS of previous signaling whether will be used as the reference picture of decoding to current picture.

Electronic installation 302 can obtain 2210 respective value based on maintenance picture mark from the RPS of previous signaling.Such as, if keep picture mark to indicate the picture in the RPS of previous signaling to be used as the reference picture of current picture, then electronic installation 302 can obtain respective value from the RPS of the previous signaling corresponding with this picture, such as, by current picture service marking value.In some configurations, the one or more reference pictures in the RPS of previous signaling can be sent to electronic installation 302 by encoder 304 by current picture service marking value.

Electronic installation 302 can from the respective value of the second reference picture the RPS of previous signaling determine 2212 current picture by current picture service marking value.Electronic installation 302 by the one or more reference pictures in the RPS based on previous signaling one or more correspondences (such as, by current picture service marking value) value infer or prediction by current picture service marking value, determine current picture by current picture service marking value.

Electronic installation 302 can carry out decoding 2214 based on by current picture service marking value to current picture.By current picture service marking value can comprise current picture by the corresponding reference picture in the RPS of current picture service marking value and signaling by current picture service marking value.

The bit stream of-video can comprise the syntactic structure in the logical data grouping being placed in and being commonly referred to as network abstract layer (NAL) unit.Each NAL unit comprises NAL unit head, such as two byte NAL unit heads (such as, 16 bits), to identify the object of the data payload of association.Such as, the sheet (and/or picture) of each coding can be coded in one or more (and/or picture) NAL unit.Other NAL unit can be comprised for other data category, such as, supplemental enhancement information, the coded slice of time sublayer access (TSA) picture, the coded slice of stepping time sublayer access (STSA) picture, the coded slice of non-TSA, non-STSA hangover picture, the coded slice of chain rupture access picture, the coded slice of instantaneous decoding refresh picture, the coded slice of completely random access picture, the coded slice of decodable code guide picture, be marked as the coded slice abandoning picture, video parameter collection, sequence parameter set, parameter sets, access unit delimiter, the ending of sequence, the ending of bit stream, padding data and/or sequence strengthen informational message.Table 5 illustrates an example of NAL unit coding and NAL unit classification of type.Other NAL unit type can be comprised as required.It is also understood that the NAL unit types value of the NAL unit shown in table 5 can be reorganized and redistribute.In addition, additional NAL unit type can be increased.In addition, some NAL unit types can be removed.

Interior random access point (IRAP) picture is the coded picture that each video coding layer NAL unit has the nal_unit_type in the scope of the BLA_W_LP to RSV_IRAP_VCL23 comprising end value.IRAP picture only comprises intraframe coding (I) sheet, as shown in table 5.Instantaneous decoding refresh (IDR) picture is the IRAP picture that each video coding layer NAL unit has the nal_unit_type equaling IDR_W_RADL or IDR_N_LP, as shown in table 5.Instantaneous decoding refresh (IDR) picture only comprises I sheet, and can be the first picture in bit stream according to decoding order, or can occur a little later in the bitstream.Each IDR picture is the first picture of encoded video sequence (CVS) according to decoding order.Chain rupture access (BLA) picture is the IRAP picture that each video coding layer NAL unit has the nal_unit_type equaling BLA_W_LP, BLA_W_RADL or BLA_N_LP, as shown in table 5.BLA picture only comprises I sheet, and can be the first picture in bit stream according to decoding order, or can occur a little later in the bitstream.Each BLA picture starts new encoded video sequence, and has the effect identical with IDR picture to decoding process.But BLA picture comprises the syntactic element of specifying non-NULL reference picture collection.

When current picture is IRAP picture, be below suitable for:

If-current picture is according to the first picture of decoding order or according to first picture of decoding order after the ending of sequence NAL unit, then variable NoRaslOutputFlag is set equal to 1 in IDR picture, BLA picture, bit stream.

-otherwise, if certain external means can be used for value variable HandleCraAsBlaFlag being set as current picture, then variable HandleCraAsBlaFlag is set equal to the value provided by this external means, and variable NoRaslOutputFlag is set equal to HandleCraAsBlaFlag.

-otherwise variable HandleCraAsBlaFlag is set equal to 0, and variable NoRaslOutputFlag is set equal to 0.

Random access decodable code guides (RADL) picture to be the coded picture that each VCLNAL unit has the nal_unit_type equaling RADL_R or RADL_N.All RADL pictures are guide pictures.RADL picture is not used as the reference picture of the decoding process of the hangover picture of the IRAP picture of identical association.When it is present, all RADL pictures according to decoding order before all hangover pictures of the IRAP picture of identical association.

It is the coded picture that each VCLNAL unit has the nal_unit_type equaling RASL_R or RASL_N that random access skips guiding (RASL) picture.All RASL pictures are the guide pictures of BLA or the CRA picture of association.When the IRAP picture associated has the NoRaslOutputFlag equaling 1, RASL picture does not export, and cannot correctly decode, because RASL picture can comprise the reference to picture non-existent in bit stream.RASL picture is not used as the reference picture of the decoding process of non-RASL picture.When it is present, all RASL pictures according to decoding order before all hangover pictures of the IRAP picture of identical association.

Table 5

With reference to table 6, NAL unit head grammer can comprise the data of two bytes, that is, 16 bits.First bit be always be set at the section start of NAL unit zero " forbidden_zero_bit ".Ensuing six bits are the type of raw byte sequence payload (" the RBSP ") data structure comprised in appointment NAL unit as shown in table 5 " nal_unit_type ".Ensuing 6 bits are the identifier of designated layer " nuh_layer_id ".In some cases, on the contrary, this six bit can be designated as " nuh_reserved_zero_6bits ".In the fundamental norms of standard, nuh_reserved_zero_6bits can equal 0.In scalable video coding and/or grammer expansion, nuh_layer_id can specify this specific NAL unit to belong to the layer identified by the value of this 6 bit.Ensuing syntactic element is " nuh_temporal_id_plus1 ".Nuh_temporal_id_plus1 subtracts the time identifier that 1 can be designated as NAL unit.Variant time identifier TemporalId can be designated as TemporalId=nuh_temporal_id_plus1-1.Time identifier TemporalId is used for identified time sublayer.Variable HighestTid identifies the highest time sublayer to be decoded.

Table 6

Figure 23 illustrates the sight comprising RADL and RASL picture type.In Figure 23 (b), for the picture of identical value with PicOrderCntVal, if RASL picture is present in the place of lower floor as the direct reference layer of current layer and RADL picture appears at current layer place, then RADL picture can not utilize the current RPS restriction be present in HEVC draft standard to decode.In this case, the decoding process of the inter-layer reference picture collection described in current use SHVC draft text 1, RASL picture will be included in the RefPicSetInterLayer of the RADL picture of inter-layer reference picture collection-enhancement layer.But when this makes to perform random access at the CRA picture place of the association of RADL picture, the RADL picture at enhancement layer place can not be decoded.Figure 23 (a) illustrates the sight that this problem does not occur.About Figure 23 (b), we describe the restriction to reference picture collection, in its RefPicSetInterLayer causing the RASL picture from basic unit not to be included in from the RADL picture of enhancement layer.

In one embodiment, described restriction is as given a definition:

When current picture is RADL picture, in RefPicSetStInterLayer by do not comprise in following picture any one:

-RASL picture

-by for generate unavailable reference picture decoding process generate picture.When current picture is CRA picture or the BLA picture with the NoRaslOutputFlag equaling 1, each coded picture calls once for generating the decoding process of unavailable reference picture.Mainly only this is specified to process for the specification of the linguistic constraints of RASL picture.The whole specification of the decoding process of the RASL picture that the IRAP picture equaling 1 with NoRaslOutputFlag associates only is used to specify the constraint of the permission grammer content to this type of RASL picture.During decoding process, any RASL picture that the IRAP picture equaling 1 with NoRaslOutputFlag associates can be left in the basket, because these pictures are designated as does not export, and does not affect the decoding process of other picture any being designated as output.

In another embodiment, described restriction is as given a definition:

-when current picture is RADL picture, RASL picture will not be comprised in RefPicSetInterLayer.

In additional alternative embodiment, described restriction is as given a definition:

-RASL picture

-by for generate unavailable reference picture decoding process generate picture.

-according to the picture of decoding order before the IRAP picture of association.

Figure 24 is the block diagram that inter-layer reference picture collection (RPS) update module 2418 is shown.Inter-layer reference picture collection (RPS) update module 2418 can be a part for the decoder 112 on electronic installation 102b.Inter-layer reference picture collection (RPS) update module 2418 can be used for reference picture collection (RPS) (RefPicSetInterLayer) between update step by decoder 112.

Inter-layer reference picture collection (RPS) update module 2418 can comprise interlayer picture 2434.In one configuration, interlayer picture 2434 can be non-IRAP (interior random access point) picture or interior random access point (IRAP) picture.Interlayer picture 2434 can be the picture received from another electronic installation 102a via bit stream 110.Inter-layer reference picture collection (RPS) update module 2418 can determine whether interlayer picture 2434 is added to reference picture collection (RPS).

Interlayer picture 2434 can comprise layer identifier (nuh_layer_id) 2436, time identifier (TemporalId) 2438 and picture order count (POC) 2453.If the layer identifier of interlayer picture 2434 (nuh_layer_id) 2436 corresponds to the layer as the direct reference layer of current layer, and the picture order count of interlayer picture 2434 (POC) 2453 equals the picture order count (POC) 2461 of current picture (nuh_layer_id) 2459, perform additional examination (to determine whether interlayer picture 2434 should be added to reference picture collection (RPS) 120).

The decoding process of inter-layer reference picture collection is illustrated in following table 7.In this pseudo-code, if current picture is not RADL picture, then as the direct reference layer of current picture and the inter-layer reference picture with each layer of the picture order count value identical with current picture is added to the inter-layer reference picture collection RefPicSetInterLayer of current picture.In addition, if current picture is RADL picture, and inter-layer reference picture is not RASL picture and neither unavailable reference picture, then the inter-layer reference picture with the picture order count value identical with current picture is added to the inter-layer reference picture collection RefPicSetInterLayer of current picture.

Table 7

Wherein layer_id_in_nuh [i] specifies the value of the nuh_layer_id syntactic element in the VCLNAL unit of i-th layer.When not existing, the value of layer_id_in_nuh [i] is presumed to and equals i.Variables L ayerIdInVps [layer_id_in_nuh [i]] is set equal to i.

Direct_dependency_flag [i] [j] equals the direct reference layer that layer that 0 appointment has an index j is not the layer with index i.Direct_dependency_flag [i] [j] equals the direct reference layer that layer that 1 appointment has an index j can be the layer with index i.When not existing for i and j in the scope of 0 to vps_max_layers_minus1, direct_dependency_flag [i] [j], it is presumed to and equals 0.Draw variable NumDirectRefLayers [i] and RefLayerId [i] [j] as follows:

The further embodiment of the decoding process of inter-layer reference picture collection is illustrated in table 8 below and table 9.They are carrying out realization and the same or analogous result of table 7 in decoding to inter-layer reference picture collection, but utilize slightly different logics to operate.

Table 8

Table 9

As shown in table 10ly draw variable NumPocTotalCurr.

Table 10

Wherein StRpsIdx is the index of short-term RPS.

The quantity of the entry in the long-term RPS of the current picture that num_long_term_sps specifies candidate's long term reference picture of specifying in based upon activities SPS to draw.The value of num_long_term_sps, by the scope of 0 to num_long_term_ref_pics_sps, comprises end value.When not existing, the value of num_long_term_sps is presumed to and equals 0.

Num_long_term_pics specifies the quantity of the entry in the long-term RPS of the current picture of direct signaling notice in head.When not existing, the value of num_long_term_pics is presumed to and equals 0.

Index in the list of candidate's long term reference picture that lt_idx_sps [i] specifies the i-th entry in the long-term RPS of current picture to specify in movable SPS.For representing that the bit number of lt_idx_sps [i] equals Ceil (Log2 (num_long_term_ref_pics_sps)).When not existing, the value of lt_idx_sps [i] is presumed to and equals 0.The value of lt_idx_sps [i], by the scope of 0 to num_long_term_ref_pics_sps-1, comprises end value.

Poc_lsb_lt [i] assigned picture sequential counting is to the value of the MaxPicOrderCntLsb delivery of the i-th entry in the long-term RPS of current picture.The i-th entry that used_by_curr_pic_lt_flag [i] equals in the long-term RPS of 0 appointment current picture is not used in by current picture reference.

Variable PocLsbLt [i] and UsedByCurrPicLt [i] draws as follows:

If-i is less than num_long_term_sps, then PocLsbLt [i] is set equal to lt_ref_pic_poc_lsb_sps [lt_idx_sps [i]], and UsedByCurrPicLt [i] is set equal to used_by_curr_pic_lt_sps_flag [lt_idx_sps [i]].

-otherwise PocLsbLt [i] is set equal to poc_lsb_lt [i], and UsedByCurrPicLt [i] is set equal to used_by_curr_pic_lt_flag [i].

Num_negative_pics assigned picture Order Count value is less than the number of entries in the stRpsIdx candidate short-term RPS of the picture order count value of current picture.The value of num_negative_pics in the scope of 0 to sps_max_dec_pic_buffering_minus1 [sps_max_sub_layers_minus1], will comprise end value.

Num_positive_pics assigned picture Order Count value is greater than the number of entries in the stRpsIdx candidate short-term RPS of the picture order count value of current picture.The value of num_positive_pics in the scope of 0 to sps_max_dec_pic_buffering_minus1 [sps_max_sub_layers_minus1]-num_negative_pics, will comprise end value.

Delta_poc_s0_minus1 [i] adds 1 when i equals 0, the picture order count value of current picture and picture order count value is specified to be less than the difference of the i-th entry in the stRpsIdx candidate short-term RPS of current picture, or when i is greater than 0, assigned picture Order Count value is less than the difference of the picture order count value of the i-th entry in the stRpsIdx candidate short-term RPS of the picture order count value of current picture and (i+1) entry.The value of delta_poc_s0_minus1 [i] will 0 to 2 ¹⁵in the scope of-1, comprise end value.

Used_by_curr_pic_s0_flag [i] equals the i-th entry that 0 assigned picture Order Count value is less than in the stRpsIdx candidate short-term RPS of current picture and is not used in by current picture reference.

Delta_poc_s1_minus1 [i] adds 1 when i equals 0, current picture and picture order count value is specified to be greater than the difference of the picture order count value of the i-th entry in the stRpsIdx candidate short-term RPS of current picture, or when i is greater than 0, assigned picture Order Count value is greater than the difference of the picture order count value of (i+1) entry in the current candidate short-term RPS of the picture order count value of current picture and the i-th entry.The value of delta_poc_s1_minus1 [i] will 0 to 2 ¹⁵in the scope of-1, comprise end value.

Used_by_curr_pic_s1_flag [i] equals the i-th entry that 0 assigned picture Order Count value is greater than in the current candidate short-term RPS of current picture and is not used in by current picture reference.

When inter_ref_pic_set_prediction_flag equals 0, draw variable NumNegativePics [stRpsIdx], NumPositivePics [stRpsIdx], UsedByCurrPicS0 [stRpsIdx] [i], UsedByCurrPicS1 [stRpsIdx] [i], DeltaPocS0 [stRpsIdx] [i] and DeltaPocS1 [stRpsIdx] [i] as follows:

NumNegativePics[stRpsldx]＝num_negative_pics

NumPositivePics[stRpsldx]＝num_positive_pics

UsedByCurrPicS0[stRpsldx][i]＝used_by_curr_pic_s0_flag[i]

UsedByCurrPicS1[stRpsldx][i]＝used_by_curr_pic_s1_flag[i]

If-i equals 0, then following applicable:

DeltaPocS0[stRpsldx][i]＝-(delta_poc_s0_minus1[i]+1)

DeltaPocS1[stRpsldx][i]＝delta_poc_s1_minus1[i]+1

-otherwise, be below suitable for:

DeltaPocS0[stRpsldx][i]＝DeltaPocS0[stRpsldx][i-1]-(delta_poc_s0_minus1[i]+1)

DeltaPocS1[stRpsldx][i]＝DeltaPocS1[stRpsldx][i-1]+(delta_poc_s1_minus1[i]+1)

Draw variable NumDeltaPocs [stRpsId] as follows:

NumDeltaPocs[stRpsIdx]＝NumNegativePics[stRpsIdx]+NumPositivePics[stRpsIdx]

The change of the restriction aspect of the NumPocTotalCurr value to CRA picture is described below.Because CRANAL unit nuh_layer_id being greater than to zero allows inter-layer prediction, and do not allow inter prediction.Because the NumPocTotalCurr that calculates as described in Table 10 is with the quantity of the picture comprising inter-layer reference picture and concentrate, we propose following change in the restriction of the NumPocTotalCurr value to CRA picture.

Variable NumPocTotalCurr is drawn as specified in table 10.Applying following restriction to the value of NumPocTotalCurr is the conforming requirement of bit stream:

If-current picture is nuh_layer_id equal 0 CRA picture or BLA picture, then the value of NumPocTotalCurr will equal 0.

-otherwise when current picture comprises P or B sheet, or when nuh_layer_id is greater than the CRA picture of 0, the value of NumPocTotalCurr will be not equal to 0.

In variant embodiment, applying following restriction to the value of NumPocTotalCurr is the conforming requirement of bit stream:

-otherwise when current picture comprises P or B sheet, the value of NumPocTotalCurr will be not equal to 0.

In other embodiments, if current picture is nuh_layer_id value be greater than zero CRA picture, then NumPocTotalCurr can equal zero or can be not equal to zero.

Term " computer-readable medium " refers to can by any usable medium of computer or processor access.As used herein, term " computer-readable medium " can represent tangible computer and/or the processor readable medium of non-transient.Exemplarily unrestricted, computer-readable or processor readable medium can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage apparatus, disk storage device or other magnetic memory apparatus, or can be used for the program code expected with the form of instruction or data structure carrying or store and can by other medium any of computer or processor access.As used herein, dish comprises compact disk (CD), laser disk, CD, digital versatile disc (DVD), floppy disk and blue light (registered trade mark) dish, wherein disk is usually according to the mode rendering data of magnetic, and cd-rom using laser rendering data to be optically.

It should be noted that one or more method as herein described can realize within hardware and/or utilize hardware to perform.Such as, one or more method as herein described can realize and/or use it to realizing in chipset, ASIC, large scale integrated circuit (LSI) integrated circuit etc.

Each method disclosed herein comprises one or more step for realizing described method or action.When the scope of the claim do not departed from, method step and/or action can be interchangeable with one another and/or be combined into single step.In other words, unless needed the concrete order of step or action in order to the proper operation of described method, otherwise when the scope of the claim do not departed from, order and/or the use of particular step and/or action can be revised.

Accurate configuration and parts that claim is not limited to illustrate above will be understood.Without departing from the scope of the claims, various amendment, change and change can be carried out to the arrangement of system as herein described, method and apparatus, operation and details.

Claims

1., on the electronic device to the method that reference picture collection is decoded, comprising:

Obtain bit stream;

Current picture is obtained from described bit stream; And

Inter-layer reference picture collection (RPS) is obtained from described bit stream,

Wherein, if described current picture is random access decodable code guide (RADL) picture, does not then comprise random access in described interlayer RPS and skip guiding (RASL) picture.

2. a method for signaling reference picture collection on the electronic device, comprising:

Indicate the reference picture collection (RPS) of the previous signaling corresponding with current picture;

If the picture in the RPS of described previous signaling will be used as the reference picture of described current picture, then to described picture setting first mark; And

Send bit stream.

3. method according to claim 2, comprise further do not send current RPS by current picture service marking.

4. method according to claim 2, wherein, the RPS of described previous signaling carrys out signaling as the index in the set of the RPS of previous signaling.

5. method according to claim 2, wherein, the RPS of described previous signaling is included at least one respective value of another reference picture in the RPS of described previous signaling.

6. method according to claim 5, wherein, at least one respective value described be the second reference picture in the RPS of described previous signaling by current picture service marking value.

7. method according to claim 5, wherein, the RPS of described previous signaling is by predicting that short term reference picture collection exists mark instruction.

8. method according to claim 2, wherein, described first mark keeps picture mark.

9. method according to claim 2, wherein, in the first picture group (GOP) of described current picture after random access point.

10. method according to claim 2, wherein, the RPS of described previous signaling carrys out signaling via deletion action.

11. methods according to claim 2, wherein, the RPS of described previous signaling is from a transmission parameter sets (PPS), sequence parameter set (SPS), adaptation parameter collection (APS), video parameter collection (VPS) and head (SH).

12. methods according to claim 2, wherein, the RPS of described previous signaling sends from the element described bit stream.

The electronic installation of 13. 1 kinds of signaling reference picture collection, comprising:

Processor;

With the memory of described processor electronic communication;

Store instruction in which memory, described instruction can be performed with:

Send bit stream.

14. electronic installations according to claim 13, comprise further can perform not send current RPS by the instruction of current picture service marking.

15. electronic installations according to claim 13, wherein, the RPS of described previous signaling carrys out signaling as the index in the RPS set of one group of previous signaling.

16. electronic installations according to claim 13, wherein, the RPS of described previous signaling is included at least one respective value of another reference picture in the RPS of described previous signaling.

17. electronic installations according to claim 16, wherein, at least one respective value described be the second reference picture in the RPS of described previous signaling by current picture service marking value.

18. electronic installations according to claim 16, wherein, described first mark keeps picture mark.

19. electronic installations according to claim 13, wherein, described first mark is that prediction short term reference picture collection exists mark.

20. electronic installations according to claim 13, wherein, in the first picture group (GOP) of described current picture after random access point.

21. electronic installations according to claim 13, wherein, the RPS of described previous signaling carrys out signaling via deletion action.

22. electronic installations according to claim 13, wherein, the RPS of described previous signaling is from a transmission parameter sets (PPS), sequence parameter set (SPS), adaptation parameter collection (APS), video parameter collection (VPS) and head (SH).

23. electronic installations according to claim 13, wherein, the RPS of described previous signaling sends from the element described bit stream.

24. 1 kinds, on the electronic device to the method that reference picture collection is decoded, comprising:

Obtain bit stream;

Obtain current picture;

Obtain the reference picture collection (RPS) of previous signaling;

If the picture in the RPS of described previous signaling should be used as the reference picture of described current picture

Then for described picture, obtain the first mark instruction;

If described first is just masked as, then determine the second mark from least one respective value of the RPS of described previous signaling; And

Described current picture is decoded.

25. methods according to claim 24, wherein, decode to described current picture based on described second mark.

26. methods according to claim 24, wherein, described first mark keeps picture mark.

27. methods according to claim 24, wherein, described second mark is by current picture service marking.

28. methods according to claim 24, wherein, at least one respective value described obtains from the RPS of described previous signaling.

29. methods according to claim 28, wherein, at least one respective value described be the second reference picture in the RPS of described previous signaling by current picture service marking value.

30. methods according to claim 28, wherein, at least one respective value described is Boolean.

31. methods according to claim 24, wherein, in the first picture group (GOP) of described current picture after random access point.

32. methods according to claim 24, wherein, the RPS of described previous signaling carrys out signaling via deletion action.

33. methods according to claim 24, wherein, the RPS of described previous signaling is from an acquisition parameter sets (PPS), sequence parameter set (SPS), adaptation parameter collection (APS), video parameter collection (VPS) and head (SH).

34. methods according to claim 24, wherein, the RPS of described previous signaling obtains from the element described bit stream.

35. 1 kinds of electronic installations of decoding to reference picture collection, comprising:

Processor;

With the memory of described processor electronic communication;

Store instruction in which memory, described instruction can be performed with:

Obtain bit stream;

Obtain current picture;

Obtain the reference picture collection (RPS) of previous signaling;

For the picture in the RPS of described previous signaling, if described picture should be used as the reference picture of described current picture, then obtain the first mark instruction;

Described current picture is decoded.

36. electronic installations according to claim 35, wherein, decode to described current picture based on described second mark.

37. electronic installations according to claim 35, wherein, described first mark keeps picture mark.

38. electronic installations according to claim 35, wherein, described second mark is by current picture service marking.

39. electronic installations according to claim 35, wherein, at least one respective value described obtains from the RPS of described previous signaling.

40. according to electronic installation according to claim 39, wherein, at least one respective value described be the second reference picture in the RPS of described previous signaling by current picture service marking value.

41. according to electronic installation according to claim 39, and wherein, at least one respective value described is Boolean.

42. electronic installations according to claim 35, wherein, in the first picture group (GOP) of described current picture after random access point.

43. electronic installations according to claim 35, wherein, the RPS of described previous signaling carrys out signaling via deletion action.

44. electronic installations according to claim 35, wherein, the RPS of described previous signaling is from an acquisition parameter sets (PPS), sequence parameter set (SPS), adaptation parameter collection (APS), video parameter collection (VPS) and head (SH).

45. electronic installations according to claim 35, wherein, the RPS of described previous signaling obtains from the element described bit stream.