CN101072345B - Image encoding apparatus and encoding method, image decoding apparatus and decoding method - Google Patents

Image encoding apparatus and encoding method, image decoding apparatus and decoding method Download PDF

Info

Publication number
CN101072345B
CN101072345B CN2007101011770A CN200710101177A CN101072345B CN 101072345 B CN101072345 B CN 101072345B CN 2007101011770 A CN2007101011770 A CN 2007101011770A CN 200710101177 A CN200710101177 A CN 200710101177A CN 101072345 B CN101072345 B CN 101072345B
Authority
CN
China
Prior art keywords
picture
encoding scheme
coding
inter prediction
scheme
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2007101011770A
Other languages
Chinese (zh)
Other versions
CN101072345A (en
Inventor
福泽敬一
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2006130883A external-priority patent/JP4974583B2/en
Application filed by Canon Inc filed Critical Canon Inc
Publication of CN101072345A publication Critical patent/CN101072345A/en
Application granted granted Critical
Publication of CN101072345B publication Critical patent/CN101072345B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

An encoding method and apparatus which include a coded picture that enables special playback to be easily performed while suppressing reduction in coding efficiency are provided. Coding is performed per a certain number of pictures, including pictures for special playback. When coded pictures for special playback using an interframe predictive coding scheme, referencing is limited to coded pictures encoded using an intraframe predictive coding scheme or coded pictures encoded using the interframe predictive coding scheme having the same reference limitation.

Description

Image encoding apparatus and coding method, image decoding apparatus and coding/decoding method
Technical field
The present invention relates to coded image information, the technology of motion picture information particularly, and the technology that the motion picture information of coding is decoded.
Background technology
In recent years, to the more high definition of image information need increase.Thereby television broadcasting is changed to the HD with 1920 * 1080 pixels (high definition) from the SD (single-definition) of 720 * 480 traditional pixels.
The growth of the data volume relevant with high definition has caused developing the more demand of high efficient coding algorithm.Standardization effort for the compression coding scheme that uses inter prediction has proceeded to ITU-T SG16 and ISO/IEC JTC1/SC29/WG11 at present.
As affairs stand, H.264/AVC (MPEG-4PART10) encoding scheme is considered to have high coding efficiency.The up-to-date a kind of technical characterictic that is incorporated into this encoding scheme allows to select a reference picture that is used for inter prediction encoding from a plurality of frames.In other words, even the image frame at interval also can be used as reference picture on the time domain, if can expect to improve code efficiency.
But, realize that by the flexible selection that allows this reference picture there is a problem (treat publication 2004-328511[reference paper D1 with reference to Japan]) when the special playback in high efficient coding.
Usually, be extensive use of MPEG2 scheme coding motion picture information, carry out the coding of each image frame by any interframe encode in forward direction interframe encode and the two-way interframe encode.According to employed encoding scheme, the frame behind the coding is called I picture, P picture or B picture.
Use the MPEG2 scheme, the reference picture of P picture is restricted to and is right after I picture or P picture the preceding.So only allow to extract I picture and P picture, and allow correct decoding and playback.As a result, realized for example fast speed playback simply.
But H.264 scheme not only allows the P picture to use a plurality of pictures as the reference picture, also allows to use the B picture as the reference picture.Therefore, when attempting, be difficult to using the B picture to carry out normal decoding on as the P picture of reference picture by only extracting the I picture and the P picture comes playback time from coded image stream.
According to reference paper D1, when carrying out quick playback time, for the I picture be right after interval between the picture before next I picture, decoding is from this I picture to one group of frame that time domain is continuous of first P picture at least.Subsequently, only reset and be included in I picture and P picture in the decoded frame group.
As mentioned above, use H.264 scheme, the result as allow to select flexibly reference picture during interframe encode in principle, only can use the I picture to carry out special playback.
If the picture that reference paper D1 has described between I picture and the P picture is deleted, then decodable code I picture and P picture.But, since H.264/AVC standard allow the reference of P picture institute the B picture with reference to the picture older than I picture, have the risk that the P picture can not be decoded.In reference paper D1, there is not open measure at this situation.
Though can carry out coding for the special playback pattern by increasing the I picture, this coding can reduce code efficiency convincingly, the result realizes that by allowing flexibly referring-to relation the feature of the H.264 scheme of high efficient coding may not can be utilized again.
In addition, the MPEG project management comprises the picture group of predetermined number continuous pictures as a group of pictures (GOP), and based on each GOP management coding.When expecting to improve the number of pictures of configuration GOP in order to realize high efficient coding, reference paper D1 does not provide under the situation that gop structure during encoding changes the explanation about the special playback method.
Summary of the invention
The invention solves at least a in encountering problems in the above-mentioned prior art.
More specifically, the invention provides a kind of encoding device and a kind of coding method, its motion picture information of can encoding suppresses the decline of code efficiency simultaneously, and comprises the coded picture that allows simple playback.
In addition, the present invention further provides a kind of encoding device and coding method, its motion picture information of can encoding suppresses the decline of code efficiency simultaneously, and comprises the coded picture that allows simple playback, even when number of pictures comprises one group of change.
In addition, the present invention also further provides decoding device and coding/decoding method, and it is to being decoded by the motion picture information of encoding device according to the present invention and coding method coding.
The invention provides a kind of encoding device, it uses intraframe predictive coding scheme or inter prediction encoding scheme that each picture of component movement picture is encoded, and described encoding device comprises: control unit, and its selection is applied to the encoding scheme of each picture; And coding unit, its described encoding scheme of selecting based on described control unit each picture of encoding, wherein said control unit carries out following selection: be each picture corresponding to a predetermined period, select described intraframe predictive coding scheme, or described inter prediction encoding scheme, wherein reference picture is restricted to another picture corresponding to described predetermined period; And, select described intraframe predictive coding scheme for other picture, or described inter prediction encoding scheme, wherein reference picture is not provided with restriction.
The invention provides a kind of encoding device, it uses intraframe predictive coding scheme or inter prediction encoding scheme that each picture of component movement picture is encoded, described encoding device comprises: determining unit, and it is determined to treat conduct for each group and organizes the number of the picture of management; Control unit, it waits to be applied to the encoding scheme of each picture based on each group selection; And coding unit, its encoding scheme of selecting based on described control unit each picture of encoding, wherein said control unit carries out following selection: for each group in described group, for being present in the picture on the same position that begins from this group top, select described intraframe predictive coding scheme, and the group that the determined number of pictures of wherein said determining unit is surpassed predetermined value, select described inter prediction encoding scheme, wherein reference picture only is restricted to and can carries out decoded pictures from the coded data of following picture, these pictures are coded datas of picture from it has been selected same group of described intraframe predictive coding scheme, in the picture that is included in the group of having selected described intraframe predictive coding scheme, with respect to the picture the preceding that is right after of corresponding picture of cycle with described predetermined value.
The invention provides a kind of decoding device, the motion picture information that its reception and decoding are encoded, wherein said coding motion picture information comprises: the coded data that first picture, second picture and three-picture are formed, this first picture uses intraframe predictive coding scheme coding, this second picture uses inter prediction encoding scheme coding, for this inter prediction encoding scheme, reference picture is restricted to described first picture or another second picture, this three-picture uses inter prediction encoding scheme coding, wherein reference picture is not provided with restriction; And indication be used to the to encode information of encoding scheme of each picture, described decoding device comprises: acquiring unit, and it obtains the information of described indication encoding scheme from described motion picture information; Decoding unit, it is decoded to the coded data that is included in the described motion picture information based on the described information of the indication encoding scheme of being obtained by described acquiring unit; Detecting unit, its detection is used for the execution command of fast speed playback; And playback control unit, when described detecting unit detects the described execution command that is used for fast speed playback, described first and second pictures in the described coded data of only decoding, and when described detecting unit does not detect the described execution command that is used for fast speed playback, decode described first, second and three-picture.
The invention provides a kind of coding method, be used to use intraframe predictive coding scheme or inter prediction encoding scheme that each picture of component movement picture is encoded, described coding method comprises: controlled step is used to select to be applied to the encoding scheme of each picture; And coding step, be used for based on the encoding scheme that described controlled step is selected each picture of encoding, wherein said controlled step is carried out following selection: be each picture corresponding to predetermined period, select described intraframe predictive coding scheme, or described inter prediction encoding scheme, wherein reference picture is restricted to another picture corresponding to described predetermined period; Be the described intraframe predictive coding scheme of other picture and selecting, or described inter prediction encoding scheme wherein is not provided with restriction to reference picture.
The invention provides a kind of coding method, be used to use intraframe predictive coding scheme or inter prediction encoding scheme that each picture of component movement picture is encoded, described coding method comprises: determining step is used to each group to determine to treat number as the picture of group management; Controlled step is used for waiting to be applied to based on each group selection the encoding scheme of each picture; And coding step, be used for based on the selected encoding scheme of described controlled step each picture of encoding, wherein said controlled step is carried out following selection: for each group of described group, for being present in the picture on the same position that begins from this group top, select described intraframe predictive coding scheme, and be the picture that the definite number of pictures of wherein said determining step surpasses predetermined value, select described inter prediction encoding scheme, wherein reference picture only is restricted to and can carries out decoded pictures from the coded data of following picture, these pictures are coded datas of picture from it has been selected same group of described intraframe predictive coding scheme, in the picture that is included in the described group of having selected described intraframe predictive coding scheme, with respect to the picture the preceding that is right after of corresponding picture of cycle with described predetermined value.
The invention provides a kind of coding/decoding method, be used to the motion picture information that receives and decode and be encoded, the motion picture information of wherein said coding comprises: the coded data that first picture, second picture and three-picture are formed, this first picture uses intraframe predictive coding scheme coding, this second picture uses inter prediction encoding scheme coding, for this inter prediction encoding scheme, reference picture is restricted to described first picture or another second picture, this three-picture uses inter prediction encoding scheme coding, wherein reference picture is not provided with restriction; And indication be used to the to encode information of encoding scheme of each picture, described coding/decoding method comprises: obtaining step is used for obtaining from described motion picture information the information of described indication encoding scheme; Decoding step is used for the described information based on the indication encoding scheme of obtaining at described obtaining step, and the coded data that is included in the described motion picture information is decoded; Detect step, be used to detect the execution command that is used for fast speed playback; And playback controlled step, be used for when described detection step detects the described execution command that is used for fast speed playback, described first and second pictures in the described coded data of only decoding, and when not detecting the described execution command that is used for fast speed playback in the described detection step, decode described first, second and three-picture.
By the explanation (with reference to the accompanying drawings) of following exemplary embodiment, further aspect of the present invention will be more obvious.
Description of drawings
Fig. 1 is a flow chart, and it has described the operation of being selected encoding scheme according to first embodiment of the invention by coding processing unit;
Fig. 2 is a block diagram, and it has represented according to one embodiment of present invention, as the exemplary configuration of the video camera of an example of image encoding apparatus and image decoding apparatus;
Fig. 3 is a block diagram, and it has been represented according to one embodiment of present invention, the exemplary configuration of coding processing unit;
Fig. 4 is a block diagram, and it has been represented according to one embodiment of present invention, the exemplary configuration of codec processing unit;
Fig. 5 is a schematic diagram, and it has described the coding target picture of waiting to be input to coding processing unit shown in Figure 2, and the example of the referring-to relation that H.264 allows in the encoding scheme;
Fig. 6 has described the method that is used to select the coded prediction scheme according to first embodiment of the invention;
Fig. 7 has described the method that is used to select the coded prediction scheme according to second embodiment of the invention;
Fig. 8 A and 8B are flow charts, and it has described the operation that is used for being selected by coding processing unit encoding scheme according to first embodiment of the invention;
Fig. 9 A and 9B are flow charts, and it has described the encoding process operation by the coding processing unit execution according to third embodiment of the invention;
Figure 10 has described the method according to the selection coded prediction scheme of third embodiment of the invention;
Figure 11 is a flow chart, and it has described the processing details of the number of determining the GOP continuous pictures carried out in the S3001 shown in Fig. 9 A.
Embodiment
<the first embodiment 〉
Fig. 2 is a block diagram, and it has represented according to first embodiment of the invention, as the exemplary configuration of the video camera (video camera player) of the example of image encoding apparatus and image decoding apparatus.
In Fig. 2, UI processing unit 10 comprises switch, button, touch pad or dial etc., is used for by the user to video camera issue operational order or to this video camera configuration settings.The operation of carrying out on UI processing unit 10 is transmitted to system control unit 20.
System control unit 20 is microcomputers etc., controls the whole video video camera by the control program that execution is stored among for example inner ROM, thereby controls the operation of each unit.Image input unit 100 comprises camera lens, image-forming component, A/D converter etc.Image input unit 100 converts target image to numerical data, and exports this numerical data.Coding processing unit 200 is carried out compressed encoding on the DID from image input unit 100.
Recording processing unit 300 is based on the predetermined recording scheme, and the DID that coding processing unit 200 compressed encodings are crossed records on the recording medium 400, all tapes in this way of this recording medium, CD or semiconductor memory.Playback processing unit 500 reads out the view data of encoding from recording medium 400.600 pairs of coded image datas that read out by playback processing unit 500 of codec processing unit are decoded.Image output unit 700 comprises the display unit such as LCD, and shows decode image data and setting screen etc.
The performed recording operation of video camera of configuration as mentioned above will be described now.
When the user ordered opening entries by UI processing unit 10, system control unit 20 control charts came opening entry to handle as input unit 100, coding processing unit 200 and recording processing unit 300.During writing down, image input unit 100 is caught target image, then it is exported as DID.Coding processing unit 200 coded image datas, and it is exported as the coded image data with amount of compressed data.In the present embodiment, coding processing unit 200 is also carried out picture to special playback and is handled, and this will be described later.Encoded image data is subjected to being suitable for the signal processing of recording medium 400 in recording processing unit 300, be recorded to subsequently on the recording medium 400.
Except from the view data of image input unit (video camera) 100 inputs, can be according to video camera of the present invention to encoding and record from the view data of this video camera outside input (circuit input) by outside input terminal (not shown).
Next, will specific replay operations be described.When the user began special playback by 10 orders of UI processing unit, system control unit 20 control playback processing units 500, codec processing unit 600 and the specific playback of image output unit 700 beginnings were handled.
Playback processing unit 500 reads out the coded image data (this will be described later) of special playback picture from the coded image data that is recorded on the recording medium 400, and is suitable for the signal processing of decoding processing based on the data execution that reads out.The coded image data of the special playback picture that reads out is decoded into view data on codec processing unit 600.Export these decode image data by image output unit 700 subsequently, thereby realize that specific playback shows.
(encoding process)
Configuration and operation according to this embodiment coding processing unit 200 will be described now.
Fig. 3 is a block diagram, and it has represented the exemplary configuration according to the coding processing unit 200 of this embodiment.
In Fig. 3, provide the DID of image input unit 100 outputs by picture image input 210.Subtracter 212 deducts the predictive picture information that will be described later from input image data.Transducer (DCT) 214 takes advantage of 4 integer orthogonal transform to be applied on the picture variance data (prediction error data) of subtracter 212 outputs with 4.
Quantifying unit (Q) 216 is carried out the conversion coefficient of transducer 214 outputs with predetermined quantification gradation and is quantized.Conversion coefficient after the 218 pairs of quantifications in entropy coding unit (EC) is carried out entropy coding and is handled to carry out data compression.
Conversion coefficient after 230 pairs of quantifications of inverse quantization unit (I-Q) is carried out re-quantization.Conversion coefficient behind 232 pairs of re-quantizations of inverse converter (I-DCT) is carried out contrary integer orthogonal transform to recover the picture variance data.Adder 234 is added to the view data of prediction on the picture variance data after this recovery, and this predicted image data will be described later.
First frame memory (FM), 236 storages are from predicted image data image restored data (view data of local decode), and this predicted image data will be described later.Inner (Intra) predict coding unit 240 is segmented into predetermined module unit with the view data of storage in first frame memory 236, and by predicting that from its surrounding pixel the view data of each piece produces predicted image data.Switch unit 260 will be exported as predicted image data from the output of intraperdiction encoding unit 240 or medium range forecast coding unit 256 according to the control of picture control unit 280, and this medium range forecast coding unit 256 will be described later.
Deblocking filter (DBF) 250 is proofreaied and correct the discontinuity (being called block noise) that occurs at the coding unit piece from predicted image data image restored data, and this predicted image data will be described later.View data behind second frame memory, 252 recovery of stomge has been carried out the block boundary treatment for correcting on the view data after this recovery, be used for the reference picture as predicted image data, and it will be described later.
The current images data that middle (Inter) predict coding unit 256 is imported from image input unit 210 are obtained the reference picture that keeps the action message and second frame memory 252, and produce the predicted image data of current image date.Picture control unit 280 is the definite predictive coding method that will use of each picture (frame) thereon.
Next, encoding operation will be described.
Subtracter 212 is deducting predicted image data from the view data of image input unit 210 inputs, thereby obtains the variance data relevant with this predicted image data.The integer orthogonal transform that this variance data experiences such as DCT by transducer 214, and be converted into the frequency content data.By step wide quantize and each frequency content corresponding conversion coefficient of quantifying unit 216 by being scheduled to.Transform coefficient data after compressed encoding on the entropy coding unit 218 should quantize.In addition, the compound and compressed encoding of being carried out by entropy coding unit 218 also comprises the information that relates to prediction encoded picture (will be described later).
Next, will the processing of predicted image data be described.The method that produces predicted image data comprises intraperdiction encoding scheme and medium range forecast encoding scheme, this intraperdiction encoding scheme is carried out reference in the input coding target image, this medium range forecast encoding scheme is then with reference to the image except that the input coding target image.
At first, will the method that produce predicted picture information according to this intraperdiction encoding scheme be described.
230 pairs of quantifying unit 216 quantized transform coefficients of inverse quantization unit are carried out re-quantization, thereby recover this conversion coefficient.By further carry out contrary integer orthogonal transform on inverse transformation block 232, the conversion coefficient after the recovery is resumed and is the variance data between input image data and predicted image data.By the variance data after on the adder 234 predicted image data being joined this recovery, obtain the recovery view data (local decode view data) of input picture, this predicted image data will be described later.
View data after this recovery is stored in first frame memory 236.Subsequently, use intraperdiction encoding unit 240 on the view data after this recovery, to carry out intraperdiction encoding.More specifically, the view data after the recovery is segmented into the module unit with pre-sizing, the recovery view data in each piece of peripheral pixel value prediction of piece.Predicted image data is sent to switch unit 260.Switch unit 260 is subjected to the control of picture control unit 280 (will be described later).When according to the intraperdiction encoding scheme prediction of output view data, picture control unit 280 causes switch unit 260c to select 260a.
Predicted image data according to the intraperdiction encoding scheme is sent to subtracter 212 or adder 214 from switch unit 260, be used to produce the predicted picture variance data and recover view data.
Next, will the method that produce predicted image data according to the medium range forecast encoding scheme be described.
Until obtain the processing of recovery view data with above-described identical by adder 234.Therefore, omitted explanation about it.The recovery view data that obtains on adder 234 is transmitted to deblocking filter unit 250, is used for deleting the discontinuity (block noise) of the data on block boundary, and this will be described later.Predetermined filtration treatment is carried out in this deblocking filter unit 250 on the pixel data on adjacent blocks border, and suppresses the discontinuity in the block boundary data.But deblocking filter is optionally, and the block noise rank in determining the recovery view data does not need to carry out filtration treatment when enough low.
Recovering view data is stored in after filtration treatment in second frame memory 252.This second frame memory 252 has enough capacity and keeps recovering view data accordingly with a plurality of frames (picture).
Medium range forecast coding unit 256 obtains correlation between input picture and a plurality of recovery view data that is stored in second frame memory 252 based on each piece, and this input picture is the predictive coding target, and it provides from image input unit 210.The coding object block is detected as movable information with relative position relation between the piece that has high correlation in recovery a plurality of in the view data.In addition, medium range forecast coding unit 256 produces predicted image data based on this movable information and recovery view data.
The predicted image data that is produced according to the medium range forecast encoding scheme is transmitted to switch unit 260.This switch unit 260 is subjected to the control of picture control unit 280 (will be described later).When according to the medium range forecast encoding scheme prediction of output view data, picture control unit 280 causes switch unit 260c to select 260b.
Predicted image data according to the medium range forecast encoding scheme is sent to subtracter 212 or adder 234 from switch unit 260, be used to produce the predicted picture variance data and recover view data.
According to the preordering method of selecting the predictive coding scheme, in the situation of intraperdiction encoding scheme (I), picture control unit 280 is connected to 260a with switch unit 260c, at medium range forecast encoding scheme (P, B) in the situation, 260c is connected to 260b with switch unit.
In addition, in the situation of medium range forecast encoding scheme, picture control unit 280 is that medium range forecast coding unit 256 produces instruction based on each picture, and this instruction is used for forward prediction medium range forecast encoding scheme (forward prediction scheme: P) or bi-directional predicted medium range forecast encoding scheme (bi-directional predicted scheme: B).
The forward prediction scheme is such medium range forecast encoding scheme, and the reference image data that wherein is ready to use in predictive coding is restricted to the recovery view data of recovering from single image, arrives before this coding target picture at this single image on the DISPLAY ORDER.On the other hand, bi-directional predicted scheme does not have the restriction of this relevant DISPLAY ORDER, realizes predictive coding by reference from the recovery view data of recovering upward to image.
On picture control unit 280 based on the predictive coding scheme of each picture and selecting (I, P B) are transmitted to entropy coding unit 218, thus the coded data of being combined into.
Though for simply, present embodiment is described as being designed to based on each picture and selecting predictive coding scheme, but also can be based on each segment (slice) rather than each picture and selecting predictive coding scheme, this segment is made up of one or more block of pixels (macro block).In addition, under any circumstance, can use different predictive coding schemes based on each block of pixels.For example, can be the block of pixels (P segment) of forming the P picture and select intra-prediction scheme or forward prediction scheme, and can be in block of pixels (B segment) selection intra-prediction scheme, forward prediction scheme or the bi-directional predicted scheme of forming the B picture any one.In addition, only can be the block of pixels (I segment) of forming the I picture and select the intra-prediction scheme.
Relevant by this encoding scheme, can be only from the coded data decoding I picture of I picture, and can be from the coded data of P picture and the coded data decoding P picture of single reference picture.
The method of selecting the predictive coding scheme according to present embodiment below will be described.
Fig. 5 is a schematic diagram, and it has described the coding target picture of waiting to input to coding processing unit shown in Figure 2 200, and the example of the referring-to relation that H.264 allows in the encoding scheme.
In Fig. 5, reference symbol I, P and B represent aforesaid intraperdiction encoding picture (I picture), forward predictive coded picture (P picture) and bi-directional predictive coding picture (B picture) respectively, and it is inputed to coding processing unit 200 shown in Figure 2 in proper order from the picture shown in Fig. 2 left side.Input sequence is identical with decoding DISPLAY ORDER afterwards.
In the present embodiment, per 15 picture interval are provided with the I picture.The group that comprises a plurality of coded pictures is called picture group (GOP), and wherein this picture group comprises at least one I picture, and this group is managed respectively.In Fig. 5, the picture group 1000 that comprises 15 pictures from B0 to P14 is GOP.
As mentioned above, can only use the coded data decoding I picture of I picture.Therefore, by managing the position of I picture among each GOP, may obtain the coded data of I picture and decode this coded data that obtains from coded data.In the present embodiment, can carry out decoding and displaying by per 15 picture interval.By showing the I picture that obtains and decode from each GOP, can realize that the special playback that is equivalent to 15 times of usual speed shows with common frame frequency.
In addition, in Fig. 5, numeral 0 to 14 each GOP of expression after symbol I, P and B is input to the order of coding processing unit shown in Figure 2 200.
In addition, the arrow shown in Fig. 5 represents to treat the reference image data that used by medium range forecast coded picture (P picture or B picture).In other words, in this example, picture P5 is with reference to the picture P14 among the GOP of front.Picture P11 reference picture P5.Picture P8 reference picture I2.Picture P14 reference picture P8.On the other hand, picture B0 reference picture P14 and B1.Picture P1 reference picture P14 and I2.
As can be seen, H.264 make the P picture with reference to I picture or the not direct P picture adjacent with this P picture, although not expression, H.264 scheme also allows the picture with reference to B.In addition, H.264 scheme also allows the B picture with reference to other B picture, or reference is than farther picture on nearest I picture or the P image time.By allowing this reference picture flexibly to select, can be reference picture with picture and selecting with high correlation.As a result, realized high efficient coding.
But, as mentioned above, during special playback, allow unconfined reference shown in Figure 5 to have adverse influence, particularly at quick playback duration.In Fig. 5,, realized showing with the playback of 15 times of usual speed by the I picture that comprises among each GOP that only decodes because a GOP is made up of 15 pictures.But, for example show the P picture that will need extraly to decode with 6 times of usual speed execution.
Next, will be with reference to the principle by picture control unit 280 selection coded prediction schemes of figure 6 descriptions according to present embodiment.
In Fig. 6, Reference numeral 2000 and 2001 is represented GOP, and Reference numeral 2100 and 2101 is represented the I picture, and Reference numeral 2200 to 2203 and 2300 to 2303 is represented the P picture.
In this case, P picture 2200 surrounds the I picture 2100 among nearest P picture 2300 and the same GOP 2000 of reference.Similarly, P picture 2201 surrounds the P picture 2200 among nearest P picture 2301 and the same GOP 2000 of reference.In addition, P picture 2202 is with reference to nearest I picture 2101 among the same GOP 2001.In addition, P picture 2203 surrounds the P picture 2202 among nearest P picture 2302 and the same GOP 2001 of reference.
According to present embodiment, arrange I picture 2100 and P picture 2200 to 2203 with per 6 picture interval of rule.In addition, if, then keep referring-to relation, to allow all pictures decoded except that above-mentioned the picture 2100 and 2200 I picture 2101 of to 2203, also decoding.In the situation of this embodiment, because there is a decodable picture in per 6 pictures (per the 6th picture), can be by extracting such picture and showing that with normal frame frequency they realize that 6 times of playbacks to usual speed show.
As can be seen, in the present embodiment, the reference picture that is used for the forward predictive coded picture that fast speed playback shows be restricted in the same GOP the I picture or by the P picture of a plurality of fronts that picture separated corresponding to playback speed.As a result, can be only by I picture or the decoding that realize the I picture of the decoded data of P picture at interval of rule in the same GOP, and by rule at interval by the decoding of the picture of forming with reference to restriction P picture.
In other words, can be by realizing playback speed arbitrarily for special playback is provided with I picture and P picture (promptly with reference to limiting the P picture) at interval with rule.
Next, will the operation by the performed selection encoding scheme of coding processing unit 200 according to present embodiment be described with reference to flow chart shown in Figure 1.
At first, when encoding, begin to be each picture and selecting encoding scheme.When the coding target picture is transfused to coding processing unit 200 (S2401), coding processing unit 200 is used predetermined method to determine whether should be this input picture and is used intraframe coding scheme (S2402).If do not use the intraframe coding scheme, the common method that coding processing unit is selected to carry out according to scheme H.264 is as encoding scheme (S2403).Usually, be preceding two input picture and selecting and definite bi-directional predictive coding scheme.
On the other hand, if selected intraframe coding scheme (S2402), then coding processing unit 200 is initialized as 1 with counter (variable k), and carries out intraframe coding and handle (S2401) on this input picture.When next picture is imported into this coding processing unit (S2411), coding processing unit 200 determines whether Counter Value k is 6 (S2413).If k is not equal to 6, then Counter Value adds 1 (S2414), and uses the preordering method of carrying out usually to determine encoding scheme (S2415).After having carried out encoding process based on selected encoding scheme, coding processing unit 200 has determined whether to send the instruction (S2416) that stops encoding process.If also do not send command for stopping, then picture is inputed to continuously coding processing unit 200 (S2411).If sent command for stopping, then will stop the selection of encoding process and encoding scheme.
On the other hand, if Counter Value k equals 6 in S2413, then coding processing unit 200 at first is reset to Counter Value k 1 (S2420), and with S2402 in same mode determine whether this input picture is I picture (S2421).When definite this input picture was the I picture, coding processing unit 200 was selected intraframe coding scheme (S2422), handled proceeding to S2416.
But when determining that in S2421 this input picture is not the I picture, the forward predictive coded scheme (S2423) of coding processing unit 200 selectional restriction reference positions.In other words,, selected the forward predictive coded scheme as described with reference to figure 6, wherein the I picture in same GOP or based on similar the P picture (restriction P picture) of coding is used as reference picture with reference to restriction.
The coded image data of restriction P picture is compound by metadata, and this metadata indication restriction P picture is real restriction P picture.
Next, will describe for the playback method that limits the P picture with reference to figure 4.
Fig. 4 is a block diagram, and it has represented the exemplary configuration of codec processing unit shown in Figure 2 600.
From the coded data of data input cell 610 inputs from playback processing unit 500.In addition, be used for the instruction from the decoding processing of control unit (shown in Fig. 2 Reference numeral 20) of whole system by the input of control input unit 611.Entropy codec processing unit 612 is carried out decoding processing to carry out the data expansion on the entropy coding data.This entropy codec processing unit 612 also produces the metadata such as mobile message etc., and it is compounded on the coded data.
Inverse quantization unit (I-Q) 614 is carried out re-quantization with predetermined quantization level on entropy decoded digital data, and the computes integer conversion coefficient.The integer transform coefficient that 616 pairs of inverse converters (I-DCT) calculate is carried out contrary integer orthogonal transform to recover view data.Adder 618 adds predicted image data (will be described later) on this recovery view data.
Switch unit 635 is subjected to the control of prediction scheme control unit 680, and to the output (decode image data) of the 3rd frame memory (FM) 636 or deblocking filter unit (DBF) 650 output adders 618.The decode image data that provides from switch unit 635 is provided the 3rd frame memory 636.Intra-prediction decoding unit 640 uses and is retained in the view data of view data from this piece of peripheral pixel prediction of piece to be decoded in the 3rd frame memory 636.Switch unit 660 is subjected to the control of prediction scheme control unit 680, and to the output of adder 618 output intra-prediction decoding units 640 or the output of medium range forecast decoding unit 656.
The continuity that deblocking filter unit 650 is proofreaied and correct on the block boundary of decode image data.The local decode view data that the 4th frame memory 652 will have been carried out the block boundary treatment for correcting thereon keeps conduct with reference to picture.
Medium range forecast decoding unit 656 uses a plurality of reference pictures and the metadata that are retained in the 4th frame memory to produce predicted image data, all mobile messages that produces in this way of this metadata in the entropy decoding processing.
According to metadata control prediction decoding processing method, this metadata relates to the predictive coding of the mobile message that produces such as entropy coding processing unit 612 to prediction scheme control unit 680 based on each picture.
Handle according to the special playback of present embodiment referring now to Fig. 4 description.In this specification, use the coded data that in above-mentioned encoding process, produces to handle an example that is provided as special playback with the playback of 6 times of usual speed.
Decoded by entropy on entropy codec processing unit 612 from the coded data of data input cell 610 input, and be separated into view data and compound metadata on coded data.Metadata is indication mobile message or the data that relate to the information of encoding scheme.When carrying out the playback processing with 6 times of usual speed, metadata is by reference, with the view data of only decode I picture or reference restriction P picture.
At first, on entropy decoded digital data, carry out re-quantization by inverse quantization unit 614, and produce an integer transform coefficient with the predetermined quantitative rank.Recover view data by in inverse transformation block 616, the integer transform coefficient being carried out contrary integer orthogonal transform.Adder 618 is recovering to add that the predicted image data that will be described later produces view data on the view data, and this is the final result of decoding.From output unit 620 these decode image data of output.
In addition, described decode image data is transmitted to switch unit 635 as the reference image data that is used in the subsequent decoding processing.On the other hand, the metadata that relates to the predictive coding scheme that entropy codec processing unit 612 produces is transmitted to prediction scheme control unit 680.Prediction scheme control unit 680 is by controlling input unit 611 based on whether having received specific playback instructions and controlled switch unit 635 based on metadata from system control unit 20.
In other words, when having sent specific playback instructions (in this case, being the instruction of resetting), select I picture or reference restriction P picture by the reference metadata with 6 times of usual speed.In the situation of I picture, switch 635c and 635a are connected to each other, and in the situation with reference to restriction P picture, switch 635c and 635b are connected to each other.As a result, the decoded picture of I picture is stored in the 3rd frame memory 636.Intra-prediction decoding unit 640 produces the predicted image data of having carried out the intra-prediction decoding on it from peripheral decode image data, and sends the data that produced to switch unit 660.In the situation of I picture, switch 635c and 635a are connected to each other according to the instruction from prediction scheme control unit 680, and predicted image data is transmitted to adder 618.
On the other hand, in the situation with reference to restriction P picture, proofread and correct by execution block border on decode image data, deblocking filter unit 650, it is retained in the 4th frame memory 652 subsequently.The view data that is kept is retained conduct and is used for another reference picture with reference to restriction P picture, and is used to produce predicted image data in conjunction with metadata by medium range forecast decoding unit 656, and this metadata relates to the predictive coding that entropy codec processing unit 612 produces.Predicted image data is transmitted to switch unit 660.At switch unit 660, switch 660b and 660c are connected to each other by prediction scheme control unit 680.Predicted image data is transmitted to adder 618 then to use in image data decoding is handled.
As can be seen, according to present embodiment, in the situation of having sent the special playback instruction, can only decode now I picture or of codec processing unit 600 with reference to restriction P picture, thus allow to carry out smoothly special playback.
In addition, the to be encoded and I picture that comprised at interval by rule or with reference to restriction P picture by the picture that is arranged to each predetermined number can be realized special playback at a predetermined velocity simply.
For present embodiment, though described the situation that realizes playback with 6 times of usual speed as an example of special playback, but need not many speeches, the decoded picture by further selection can realize with for example fast speed playback of 12 times of usual speed, 18 times of usual speed and 24 times of usual speed.In addition, understand easily, limit the frequency of occurrences of P picture and correspondingly carry out decoding, can realize with 2 to 5 times to the playback of usual speed (and double) by improving I picture and reference.In addition, also can use traditional special playback method, wherein only extract the I picture and reset.
In addition, in this embodiment, owing to can be independent of the frequency of occurrences that the number of pictures that constitutes GOP is set the picture that is used for special playback, can flexible way set the frequency of occurrences of the picture that is used for special playback.
In addition, in the present embodiment,, can realize simply that special playback suppresses the decline of code efficiency simultaneously because main the use than I picture has the picture that the more P picture realization of high coding efficiency is used for special playback.
In the present embodiment, be used as the P picture that is used for special playback with reference to the I picture among the same GOP or other P picture of being applied thereon with reference to restriction P picture.But, can replace using the picture of other encoding scheme, as long as still keep this referring-to relation.For example, but the inter-coded prediction picture with random access of the reference picture relation that is comprised in the predetermined number picture can be used as the picture that is used for special playback.
<the second embodiment 〉
Next, second embodiment of the present invention will be described.
Because present embodiment also is applicable to the video camera of describing about first embodiment, therefore will omit the content of having described relevant for the there.
Fig. 7 has represented an example according to the encoding scheme selection of the video camera execution of this embodiment.In Fig. 7, Reference numeral 2500 to 2505 expressions are used as the picture group of GOP management, Reference numeral 2600 to 2605 statement I pictures, and Reference numeral 2700 to 2711 and 2800 to 2811 is represented the P picture respectively.
In this case, P picture 2800 and 2700 is with reference to the I picture 2600 among the same GOP 2500.Next, P picture 2701 is with reference to the P picture 2700 among the same GOP 2500, and P picture 2702 is with reference to the P picture 2601 among the same GOP 2501.In addition, P picture 2703 is with reference to the P picture 2702 among the same GOP 2501, and P picture 2803 is with reference to the P picture 2703 among the same GOP2501, and I picture 2602 is 3 pictures after P picture 2703.
In addition, P picture 2704 is with reference to the I picture 2602 among the same GOP 2502, and P picture 2805 and 2705 is with reference to the P picture 2704 among the same GOP 2502.In addition, P picture 2706 is with reference to the I picture 2603 among the same GOP 2503, and P picture 2806 and 2707 is with reference to the P picture 2706 among the same GOP 2503.After this, P picture 2808,2708,2709,2710 and 2811 referring-to relation are restricted to similar pattern.
In the present embodiment, identical among the reference restriction that is applied to P picture 2700 to 2711 and first embodiment.If the second restriction encoding scheme is represented in these new restrictions that, then are applied to P picture 2800,2803,2805,2806,2808 and 2811 with reference to limiting the representative that can be considered to the first restriction encoding scheme.
According to present embodiment, I picture 2600,2602,2604 and P picture 2700 to 2711 are set with per 6 picture interval (per the 6th picture) of rule.For these pictures of decoding, except these pictures itself of decoding, decoding I picture 2601,2603 and 2605 is all needed.
Therefore, can wherein the first restriction encoding scheme be applied to this P picture by extracting I picture and P picture all pictures that extract of decoding.As a result, because per 6 all pictures of picture decodable code can realize that 6 times of playbacks to usual speed show by show decoded result with common frame frequency.This is identical with first embodiment.
In this embodiment, except the P picture (the first restriction P picture) of having used the first restriction encoding scheme on it, the second restriction encoding scheme is applied to P picture 2800,2803,2805,2806,2808 and 2811.
The P picture (the second restriction P picture) of having used the second restriction encoding scheme on it also is arranged to the I picture or the first restriction P picture that makes with reference to being restricted among the same GOP.As a result, referring-to relation is included in the I picture exclusively and is had in the P picture of first and second restrictions.In other words, can be independent of other picture group and carry out decoding.
To consider special playback now with 10 times of usual speed or more speed.For example, when considering with 12 times of usual speed playback times, it is than 6 times of fast twices of usual speed, the simplest implementation method will be referred to carry out and is included in resetting every an I picture or every the normal rate of one first restriction P picture in per 6 pictures and shows, in other words, view data of per 12 pictures.
But the picture of per the 12nd picture setting may not have high correlation.In this case, the user can obtain factitious impression, is similar to show from the tabulation of the demonstration of falling the frame motion picture or rest image and to receive.In this case, present embodiment is arranged to and makes the picture that has strong correlation with the display image that is used for special playback being used for additionally showing between the picture of special playback (it shows every 12 pictures).As a result, can suppress visual not nature, can between picture, produce the impression that takes over seamlessly, be similar to motion picture.
In the present embodiment, can (limit reference picture by the picture except being used for special playback is provided for it, hereinafter referred to as " first restriction P picture ", it was described in conjunction with first embodiment) outside the second restriction P picture be implemented in the improvement of the above-mentioned visual signature of quick playback duration.
More specifically, in the situation of the fast speed playback that surpasses predetermined playback (in this specification, being 12 times of usual speed or higher), will for example on following picture, carry out in succession and reset and demonstration.
Decoding processing: I picture 2600,
Decoding processing: the second restriction P picture 2800,
Decoding processing: the first restriction P picture 2701,
Decoding processing: I picture 2601,
Decoding processing: the first restriction P picture 2703,
Decoding processing: the second restriction P picture 2803,
Decoding processing: the first restriction P picture 2704,
Decoding processing: the second restriction P picture 2805,
Decoding processing: the first restriction P picture 2706,
Decoding processing: the second restriction P picture 2806,
Decoding processing: I picture 2604,
Decoding processing: the second restriction P picture 2808,
Decoding processing: the first restriction P picture 2709,
Decoding processing: I picture 2605,
Decoding processing: the first restriction P picture 2711,
Decoding processing: the second restriction P picture 2811,
In this example, for show every 12 pictures be used for special playback every a picture (2600,2701,2703,2704,2706,2604,2709,2711), picture (2800,2601,2803,2805,2806,2808,2605,2811) after 3 pictures shown extraly, as having the picture of strong correlation with the picture that is used for special playback.
As a result, nature of the vision that causes owing to the low correlation between the picture of 12 the picture settings of being separated by can be suppressed, the level and smooth demonstration that is similar to motion picture can be realized.Owing to improved the number of display frame by this way, even, also can realize the frame updating speed that 6 times of usual speed are reset every 12 execution demonstrations on picture.But, since the focus of present embodiment be search fast have the low correlation picture during realize vision enhancement, the numerical value of 12 times of usual speed itself is unessential.In other words, be 24 times of usual speed if having the search speed of the quick picture of low correlation, then corresponding to the number that inserts picture, actual renewal speed is reduced to 12 times of usual speed.Yet this does not mean that the search speed of being felt will reduce by half, and gives the credit to the improvement of visual signature, and actual fast speed playback can be provided.Because for easy, described the example of 12 times of usual speed about present embodiment, this explanation can be not different with the screen updates speed of 6 times of usual speed.But the given purpose of this explanation is to guarantee to understand easily in this content, should be appreciated that these details are not particular importances from practical point of view.The user in addition when the search from 6 times of usual speed moves to the search of 12 times of usual speed, do not change the demonstration time always and do not feel well, in this unlikely situation, the quick search speed of next after 6 times of usual speed should be set at 24 times of usual speed.In addition, can feel by only showing in the picture that extracts with 12 times of usual speed and alleviating this discomfort with 1/60 second refresh frame.
As can be seen, two kinds of restriction encoding schemes have been used in the present embodiment.The first restriction encoding scheme is restricted to the I picture among the same GOP to the reference of the forward prediction picture (P picture) that uses in the fast speed playback or it has been used another P picture of the first restriction encoding scheme.In addition, the reference with forward prediction picture of high correlation of the second restriction encoding scheme handle and employed picture in fast speed playback is restricted to the I picture among the same GOP or it has been used another P picture of the first restriction encoding scheme.
Present embodiment has been arranged to and has made the second restriction encoding scheme be applied to the I picture or seem near being the P picture that is ready to use in the picture of fast speed playback.In the situation of as shown in Figure 7 arrangement I, P and B picture, the second restriction encoding scheme will be applied to being ready to use in the picture of 3 pictures after the described picture of fast speed playback.
As a result, can use the I picture or first and second coded datas that limit the P pictures among the same GOP to realize to comprising the picture codec of the I picture and the first and second restriction P pictures.
Next, will the operation by the performed selection encoding scheme of coding processing unit 200 according to present embodiment be described in conjunction with the flow chart shown in Fig. 8 A and the 8B.
At first, when encoding, begin to be each picture and selecting encoding scheme.When having imported the coding target picture (S2901), coding processing unit 200 is used predetermined method to determine whether to tackle in the input picture and is used intraframe coding scheme (S2902).If encoding scheme in the application of frame not, then coding processing unit 200 select a kind of basis H.264 the commonsense method carried out of scheme as encoding scheme (S2903).Usually, be preceding two input picture and selecting and definite bi-directional predictive coding scheme.
On the other hand, will be if determine to encoding scheme (S2902) in the input picture application of frame, then coding processing unit 200 is initialized as 1 with the first counter k, the second counter l is initialized as 0, the second restriction coded markings is initialized as 1, and on this input picture, carries out intraframe coding and handle (S2910).
When having imported next picture (S2911), coding processing unit 200 determines whether the first Counter Value k is 6 (S2913).If k is not equal to 6, then coding processing unit 200 determine the second restriction coded markings whether be 1 and picture be I picture or P picture (S2914).Usually, because I picture heel is with the B picture, this condition is ungratified.Therefore, coding processing unit 200 adds 1 (S2915) with the first Counter Value k, selects encoding scheme (S2916) by the preordering method of common execution.
After the selected encoding scheme of use had been carried out encoding process, coding processing unit 200 had determined whether to send the instruction (S2917) that stops encoding process.If also do not send command for stopping, then picture can be continued to input to coding processing unit 200 (S2911).If sent command for stopping, then coding processing unit 200 stops the selection (S2950) of encoding process and encoding scheme.
During handling next input picture, when the first counter k is not equal to 6 (S2913), the second restriction coded markings is 1, and picture is when being I picture or P picture ("Yes" in S2914), and coding processing unit 200 proceeds to S2940 with processing.For example, when the P picture of two B pictures is followed in input, carry out following processing.At first, coding processing unit 200 adds 1 with the first Counter Value k, and the second restriction coded markings is reset to 0 (S2940).Next coding processing unit 200 selects the second restriction encoding scheme (S2941).
As a result, for rule at interval (in this example, being per 6 pictures) arrange every a picture (wherein having selected the first restriction encoding scheme) for it, will be that nearest P picture or I picture and selecting second limit encoding scheme.In the situation of I picture, when selecting the second restriction encoding scheme, can not carry out specific processing yet, and will carry out common intraperdiction encoding even note.On the other hand, in the situation of P picture, will carry out the medium range forecast coding, wherein with reference to the I picture or the first restriction P picture that are restricted among the same GOP.For the P picture, this picture be second the restriction picture the fact be used as treat stream on the stack metadata and manage.
When the first counter k is 6 (S2913), coding processing unit 200 at first is reset to 1 with the first counter k, and the second counter l is added 1 (S2920).Next, coding processing unit 200 determines whether the remainder of mould 2 operations of the second Counter Value l is 0 (S2911).If coding processing unit 200 second restriction coded markings are set to 1 (S2930).As a result, for the cells arranged at regular intervals first restriction picture (P picture or I picture), set the mark of the second restriction picture and set every a picture.In this processing (S2930) afterwards or when the remainder of mould 2 operation of the second Counter Value l is 1 (S2921), coding processing unit 200 determines in the mode identical with S2902 whether this input picture is I picture (S2923).When definite this input picture was the I picture, coding processing unit 200 was selected intraframe coding scheme (S2924), and proceeds to S2917.
When having determined that at S2923 this input picture is not the I picture, coding processing unit 200 is selected the first restriction encoding scheme (S2922).In other words,, select the forward predictive coded scheme as described with reference to figure 6, among the wherein same GOP I picture or similar with reference to restriction under the P picture (restriction P picture) of coding be used as reference picture.For the coded image data of encoding under the encoding scheme in first restriction, the fact that described picture has experienced the first restriction encoding scheme is used as metadata that will stack on stream and manages.
Since can by with the playback of carrying out the encoded data stream that produces in the present embodiment with reference to the essentially identical program of using among figure 4 described first embodiment of program, with the explanation of omitting to it.The difference of the present embodiment and first embodiment is that switching is used for decoding and picture displayed according to playback speed, and this playback speed is included in from the quick playback instructions of control input unit 611 inputs.
In other words, in this embodiment,, will carry out with reference to the described fast speed playback of first embodiment and show processing when when control input unit 611 has sent the instruction of resetting with 6 times of usual speed.On the other hand, if sent equal or exceed predetermined speed quick playback instructions (in this case, reset with 12 times of usual speed), the metadata that is produced based on entropy codec processing unit 612, except the I picture and the first restriction P picture, in the decoding target that the second restriction P picture will be included in.Next, as described, with the picture and the second restriction picture that shows with 12 picture interval of rule with reference to figure 7.
In this second embodiment, the visual signature that the second restriction picture is used to suppress to reduce to cause owing to correlation between the display image descends, and correlation reduces to cause owing to showing to increase at interval at quick playback duration picture between this display image.In the above description, the playback of the second restriction picture is not being carried out with 6 times of usual speed playback durations, and is carrying out with 12 times of usual speed playback durations.But, can set playback speed arbitrarily.
In addition, in the explanation of present embodiment, the picture that the second restriction encoding scheme is applied to it has been restricted to the P picture.But, can be restricted to the restriction of first among same GOP picture by picture and obtain similar effects B picture institute reference folded between the first restriction picture.
In addition, in this embodiment, owing to can be independent of the frequency of occurrences that the number of pictures that constitutes GOP is set the picture that is used for special playback, can flexible way set the frequency of occurrences of the picture that is used for special playback.
In addition, in this embodiment since main use have than I picture more the P picture of high coding efficiency realize being used for the picture of special playback, can suppress to realize special playback simply when code efficiency descends.
In this embodiment, with reference to the I picture among the same GOP or be employed other P picture on it with reference to restriction P picture, with first embodiment in same mode be used as the P picture that is used for special playback.But the picture of alternative other encoding scheme of use is as long as this referring-to relation still keeps.For example, but the inter-coded prediction picture with random access of the reference picture relation that is comprised in the predetermined number picture can be used as the picture that is used for special playback.
<the three embodiment 〉
Next, the third embodiment of the present invention will be described.
Because present embodiment is applicable to the described video camera with reference to first embodiment similarly, will omit with reference to its content of describing.
As described with reference to figure 5, H.264 the scheme restriction of forcing on the reference picture of P picture is unusual pine.Allow this undemanding reference to have adverse influence during special playback, particularly at above-mentioned quick playback duration, wherein the user can be compelled to use the playback method that wherein only extracts the I picture.In other words, although form a single GOP by 15 pictures in example shown in Figure 5, the number of pictures of forming a GOP is not fixed.For example, in order to realize having the coding of bigger efficient, exist and use even situation that more more number picture (for example 30) disposes a GOP.When carrying out quick playback time by the I picture that extracts among the GOP, the change of forming the number of pictures of GOP has caused the change of playback speed.Video camera is as according to the image encoding apparatus of present embodiment and an example of image decoding apparatus, and it has suppressed the variation of quick playback duration playback speed as described below, even when the number of the picture that changes formation GOP.
To principle that select the coded prediction schemes according to the picture control unit 280 of the video camera of present embodiment be described with reference to Figure 10.
In Figure 10, Reference numeral 3200 to 3204 expression GOP, Reference numeral 3300 to 3304 expression I pictures, Reference numeral 3350,3400 to 3411 and 3500 to 3511 is represented the P picture respectively.In addition, in Figure 10, GOP 3200,3201,3203 and 3204 is made up of 15 pictures respectively, and GOP 3202 is made up of 30 pictures.
P picture 3400 is with reference to the I picture 3300 among the same GOP 3200, and P picture 3401 is with reference to the P picture 3400 among the same GOP 3200.P picture 3402 is with reference to the I picture 3301 among the same GOP 3201, and P picture 3403 is with reference to the P picture 3402 among the same GOP 3201.P picture 3404 is with reference to the I picture 3302 among the same GOP 3202, and P picture 3405 is with reference to the P picture 3404 among the same GOP 3202.
P picture 3350 is with reference to the P picture 3405 among the same GOP 3202.Next P picture 3406 is with reference to the P picture 3350 among the same GOP 3202, and P picture 3407 is with reference to the P picture 3406 among the same GOP 3202.Subsequently, GOP 3203 has and GOP 3200 and 3201 identical referring-to relations with 3204 P picture 3408,3409,3410 and 3411.
The reference picture that is used for each GOP 3200 to 3204 is an I picture 3300 to 3304.But other GOP that the I picture occurs with per 15 pictures wherein is different, and I picture 3303 is the 30th pictures behind the I picture 3302 formerly.This is that GOP 3202 is by 30 picture this facts that configuration replaces owing to consider code efficiency.In other words, unless the number of pictures of the formation GOP of GOP changes, otherwise its ability can be replaced by P picture 3350 by the coded picture of I picture.
Consider these, I picture and the P picture arranged for the every minimal amount picture that constitutes GOP, present embodiment is the first restriction coded picture with I picture 3300 to 3304 and 3350 management of P picture.In other words, for the first restriction coded picture, when the GOP that comprises picture is made up of the minimal amount picture, use the intraframe predictive coding scheme to carry out coding.For being included in first among the GOP that forms by greater number picture restriction coded picture, can carry out decoded pictures to being right after the preceding the coded data of coded picture from the first nearest restriction coded picture with reference to only being restricted to.Below, above-mentioned reference restriction encoding scheme will be called " the first restriction encoding scheme ".
More specifically, in example shown in Figure 10, the minimal amount that constitutes the picture of GOP is 15.I picture 3300 is the 3rd pictures of GOP 3200.The following picture that begins to be respectively 15x n (wherein n represents natural number) picture from I picture 3300 is configured to one group of first restriction coded picture.
I picture 3300
I picture 3301
I picture 3302
I picture 3350
I picture 3303
I picture 3304
Because GOP 3202 is made up of the picture more than minimal amount, the 15th picture that begins from I picture 3320 is P picture 3350.
In this case, can only can be restricted to by the picture of 3350 references of P picture that will carry out inter prediction encoding and can carry out decoded pictures from the coded data of I picture 3302 to B pictures 3340, this I picture 3302 is the nearest coded pictures with first restriction, and this B picture 3340 is to be right after picture the preceding.Therefore, P picture 3350 will be used the interframe encode scheme and encode, and the one or more conducts in this interframe encode scheme use I picture 3302 and the P picture 3404,3405 are with reference to picture.In example shown in Figure 10, P picture 3350 is with reference to P picture 3405.
In addition, in this embodiment, use the coded picture with first restriction as the reference picture, will provide the second restriction coded picture by each predetermined number (being 6 in this example) picture, this number is less than the minimal amount of the picture of forming GOP.More specifically, be provided as the second restriction coded picture with reference to first coded picture or other the P picture that is included in the picture that is used for special playback among this same GOP that are included among the same GOP.
In Figure 10, the second restriction coded picture is a P picture 3400 to 3411, and it occurs from per 6 pictures of I picture 3300 beginnings.As can be seen, the picture group that provides at per 6 pictures of I picture 3300 beginnings is independent of the change of the number of pictures that constitutes GOP and is provided with.In addition, all pictures in these picture groups are decodable, as long as decoded the first restriction coded picture group.This means that by extracting the first restriction coded picture and the second restriction coded picture, the picture that per 6 pictures provide is always decodable, and irrelevant with the number of pictures that constitutes GOP.Therefore, by show per 6 pictures that picture provides with common frame frequency, even form the number of pictures of GOP change having taken place, also can realize keeping the playback of 6 times of usual speed to show.
Next, will be with reference to the encoding operation performed of the flow chart description shown in figure 9A and the 9B according to the coding processing unit 200 of present embodiment.
When the encoding process of beginning view data, at first will the encode value k of target picture counter of coding processing unit 200 is reset to 1 (S3000).Coding processing unit 200 checkings constitute the number of pictures (the formation number of GOP) of GOP, and the value j of the inner picture counter of GOP is reset to 1 (S3001).
Next, will be with reference to the flow chart description shown in Figure 11 method that GOP composition number is set according to present embodiment.When beginning the setting of GOP composition number, system control unit 20 at first verifies whether can import view data to be encoded (coding target picture) (S3101) from video camera.Use is according to the video camera of present embodiment, and the coding target picture is provided as video camera input (from 100 inputs of image input unit) or circuit input (from the outside input terminal input of for example USB or IEEE 1394).
When determining that at S3101 the coding target picture will be imported by circuit, system control unit 20 proceeds to S3106 with processing.On the other hand, will be imported by video camera if determine the coding target picture, system control unit 20 determines whether logging mode is set up for high definition logging mode (S3102).
Available in the present embodiment logging mode is the high definition logging mode, and it uses high data rate also to emphasize picture quality, and prolongs logging mode, and its use is lower than the data rate of high definition logging mode, has realized longer record but compare with it.When being provided with when prolonging logging mode, system control unit 20 proceeds to S3106 with processing.
On the other hand, when being provided with the high definition logging mode, system control unit 20 determines whether recording medium is dish (S3103).For present embodiment, the recording medium that can be used as posting field comprises the dish (DVD-R etc.) that is suitable for huge storage capacity recording, and is easy to carry about with one but is not suitable for the storage card of huge storage capacity recording.If recording medium is a storage card, system control unit 20 proceeds to S3106 with processing.If will be on dish executive logging, the then free space (S3104) on the system control unit 20 checking recording mediums.If free space is not equal to or surpass predetermined value, then system control unit 20 proceeds to S3106 with processing.On the other hand, if the free space on the recording medium has equaled or exceeded predetermined value, then system control unit 20 proceeds to S3105 with processing.In S3105, system control unit 20 is set at minimum composition number m (being 15 in this embodiment) with GOP composition number.On the other hand, in S3106, system control unit 20 is set at the twice that this minimum constitutes number with GOP composition number, is 30 in this embodiment.
Usually, the composition number of GOP is big more, and the I number of pictures that then has high encoding amount is more little.As a result, improved code efficiency.Because the circuit input picture often is metastable, and trend has the high correlation between the picture, can realize high efficient coding by improving GOP composition number.In addition, use to prolong logging mode, make as the code efficiency of the result's who reduces the I picture frequency of occurrences improvement and can realize further prolonging record.In addition, because storage card has higher unit capacity cost,, improve GOP composition number in order to use capacity effectively.In addition, even use disk record medium, when free space is not enough, also can improve GOP composition number.
According to above process, GOP composition number is set by system control unit shown in Figure 2 20, and is sent to recording processing unit 200, advances the setting (S3107) to finish GOP composition number.
Turn back to Fig. 9 A now, the GOP composition number that coding processing unit 200 checkings are set according to said procedure is reseted GOP internal counter (S3001), and proceeds to S3003 to import a coding target picture.Next, coding processing unit 200 checks whether the remainder (jmod m) of the modulo operation of GOP internal counter value j is 3 (S3005) when the minimal amount m of GOP composition is modulus.
If the value of j mod m is not 3, then coding processing unit 200 proceeds to S3007 with processing, and checks whether the remainder (| k-3|mod 6) of the modulo operation of coding target picture Counter Value k and modulus 6 is 0.In this embodiment, the 3rd picture of a GOP is the I picture, begins the P picture that per 6 pictures are provided for special playback from this I picture.Therefore, judge by this calculating whether this input coding target picture should be encoded as the picture that is used for special playback.
If | k-3|mod 6 is not equal to 0, and then coding processing unit 200 proceeds to S3009 with processing, and carries out encoding process based on common encoding scheme.In this case, by forward predictive coded scheme or bi-directional predictive coding scheme this coding target picture of encoding.
On the other hand, if in S3007 | k-3|mod 6=0, then coding processing unit 200 at S3011 according to second restriction encoding scheme this coding target picture of encoding.This second restriction encoding scheme is the forward predictive coded scheme with reference to restriction.More specifically, use forward predictive coded scheme (medium range forecast encoding scheme), it uses the time I picture or according to another picture of the second restriction encoding scheme coding the preceding in picture streams.Therefore, the picture group that decoding is made up of the P picture (the second restriction picture) of I picture and the use second restriction encoding scheme coding can only be used from the data in this picture group.As a result, the coded data that produces according to present embodiment comprises at per 6 decodable pictures of picture, and can realize the demonstration of 6 times of usual speed simply.
In S3005, when j mod m=3, coding processing unit 200 proceeds to S3013 with processing, and checking GOP internal counter value j.Whether coding processing unit 200 further checking j equals 3 (S3013).If j=3, perhaps in other words, if the coding target picture is the 3rd picture of GOP, then according to this embodiment, this picture is the I picture.Therefore, when j=3, coding processing unit 200 is carried out coding at S3017 according to the intraframe coding scheme.
On the other hand, if j is not equal to 3, the target picture of then encoding is (the 3+m among the GOP *N) individual picture (wherein n is a natural number), picture 3350 for example shown in Figure 10.Therefore, coding processing unit 200 uses the above-mentioned first restriction encoding scheme to carry out coding (S3015).
By this way, in S3009, S3011, S3017 or S3015 one of any, each input coding target picture is encoded.By entropy coding unit 218 will be about employed encoding scheme information combined on the coded data of each picture.
At S3019, coding processing unit 200 adds 1 with the value of GOP internal counter j and coding target picture counter k respectively.At S3021, whether coding processing unit 200 checkings will continue encoding process, if not, end process.If end process not, in step S3023, coding processing unit 200 is checked the GOP that whether has been through with.More specifically, can use the GOP composition number in S3001, verified and the value of GOP internal counter j to carry out this judgement.
If the value of j is equal to or less than GOP composition number, then GOP does not also finish.Therefore, coding processing unit 200 turns back to S3003 with processing, and imports next coding target picture.In addition, this coded picture of j value representation above GOP composition number is a picture last among the GOP.Therefore, coding processing unit 200 judgement GOP finish and processing are turned back to S3001, and verify the GOP composition number of next GOP, and reset the GOP internal counter.
By this way, by the first restriction picture is included in coding target picture group to be imported, present embodiment can suppress the variation of quick playback duration playback speed, even when GOP composition number changes.In addition, by comprising the second restriction picture, can use interframe encode to produce and make the coded data that fast speed playback is performed easily, this interframe encode have the code efficiency higher than intraframe coding.
Because can be by carrying out the playback of the encoded data stream that produces in the present embodiment, thereby have omitted explanation to it with the essentially identical program of first embodiment that describes with reference to figure 4.
As can be seen, according to present embodiment, in the situation of having sent the special playback instruction, codec processing unit 600 can only decode now the I picture or the second restriction picture, thus allow to carry out smoothly special playback.
In addition, by the picture that is arranged to each predetermined number to be encoded and by the I picture or the second restriction picture that rule is comprised at interval, can realize the special playback of predetermined speed simply.
More than Shuo Ming focus is to use the second restriction picture to handle with the playback of 6 times of usual speed.But, by carrying out decoding in conjunction with the first restriction picture, the I picture that can comprise from each GOP and the first restriction picture are carried out the fast speed playback (for example, when minimum GOP composition number is 15, resetting with 15 times of usual speed) corresponding to minimum GOP composition number.As mentioned above, in the present embodiment,, also can carry out coding by comprise the first restriction picture for the GOP composition of each minimal amount even when GOP composition number increases.As a result, even when GOP composition number changes, also can carry out fast speed playback simply with stable playback speed.
<other embodiment 〉
For each embodiment of above expression, described and used the medium range forecast scheme to apply the present invention to the situation of video camera.But, but the present invention's similar application is for example used the video projection machine or the video recorder of medium range forecast scheme in miscellaneous equipment.Application of the present invention has realized carrying out special playback in simple mode, suppresses the decline of code efficiency simultaneously.
The form that can pass through computer (or CPU, MPU etc.) executive software of system or device realizes the embodiment of above expression.
Therefore, the computer program self that is provided to computer has made computer realization function of the present invention and processing have realized the present invention simultaneously.In other words, the present invention also comprises the computer program itself of carrying out the foregoing description function.
The computer program of realizing the foregoing description can adopt any form, as long as this computer program is computer-readable.For example, this computer program can be configured to object code, interpreter exe, offer the script data of OS etc.But this computer program needn't be restricted to these configurations.
Provide the computer program of realizing the foregoing description to computer from storage medium or by wire/wireless communication.Provide the storage medium of this program for example to comprise the magnetic storage medium of floppy disk, hard disk, for example tape, light/magnetic of for example MO-optical storage media, CD or DVD or nonvolatile semiconductor memory.
Server on the computer network can be used to provide computer program by wire/wireless communication.In this case, can comprise that the data file (program file) that forms computer program of the present invention is stored in the server.Program file can be executable file or source code.
Download to described program file is provided on the client computer by visiting this server.In this case, this program file can be divided into a plurality of segmental files that distribute and arrange in different servers.
In other words, providing the server unit of the computer program of realizing the foregoing description to client computer also is realization of the present invention.
In addition, can also encode carry out the computer program of the foregoing description and with this procedure stores in storage medium, distributing to the user, in order to realize that this computer program is installed on the user's computer, the key information that is provided for decoding to the user who satisfies certain condition.Can be by for example by providing key information because of the spy downloads from homepage.
In addition, the computer program of realization the foregoing description can use the function of the OS that has carried out on computers.
In addition, can dispose the part computer program of realizing the foregoing description by the firmware of the expansion board that is provided with on the computer etc.In addition, can carry out the computer program of realizing the foregoing description by the CPU that provides on the expansion board etc.
Though reference example embodiment has described the present invention, should be appreciated that to the invention is not restricted to disclosed exemplary embodiment.The scope of following claim will meet the wideest explanation, thereby comprise all this modifications and structure and function of equal value.

Claims (8)

1. encoding device, it uses intraframe predictive coding scheme or inter prediction encoding scheme that each picture of component movement picture is encoded, and described encoding device comprises:
Control unit, its selection is applied to the encoding scheme of each picture, and extracts picture at interval every predetermined rule from motion picture; And
Coding unit, its described encoding scheme of selecting based on described control unit each picture of encoding, wherein
Described control unit carries out following selection:
For each picture that is extracted, select the described intraframe predictive coding scheme or the first restriction inter prediction encoding scheme, reference picture is restricted to intraframe predictive coding picture in the same picture group or another be extracted and the coded picture that select the picture of the above-mentioned first restriction inter prediction encoding scheme in the same picture group in this first restriction inter prediction encoding scheme, and reference picture is the time to go up the picture before this picture that is extracted; And
For other picture that is not extracted, select described intraframe predictive coding scheme or unrestricted inter prediction encoding scheme, in this unrestricted inter prediction encoding scheme, reference picture is not provided for those restrictions of the described first restriction inter prediction encoding scheme.
2. encoding device as claimed in claim 1 further comprises administrative unit, and described administrative unit comprises the described picture of management in the group of continuous pictures of predetermined number at each.
3. as encoding device one of any in the claim 1 to 2, wherein said control unit for the picture that is extracted in every n picture that picture is adjoining in time, select the described intraframe predictive coding scheme or the second restriction inter prediction encoding scheme, in this second restriction inter prediction encoding scheme, reference picture is restricted to the coded picture of intraframe predictive coding picture in the same picture group or the described first restriction inter prediction encoding scheme of the employing in the same picture group, and wherein n is a natural number.
4. encoding device as claimed in claim 3 further comprises output unit, and described output unit adds the information of the indication encoding scheme of using on the described coding unit coded data to, and exports described data.
5. decoding device, the motion picture information that its reception and decoding are encoded, wherein
Described coding motion picture information comprises: by the I picture, the coded data that the P picture of the first kind and the picture of second type are formed, wherein when coding, from motion picture, extract picture at interval every predetermined rule, for each picture that is extracted, select intraframe predictive coding scheme or restriction inter prediction encoding scheme, reference picture is restricted to intraframe predictive coding picture in the same picture group or another be extracted and the coded picture that select the picture of above-mentioned restriction inter prediction encoding scheme in the same picture group in this restriction inter prediction encoding scheme, and reference picture is restricted to last picture before this picture that is extracted of time, for other pictures that are not extracted, select described intraframe predictive coding scheme or unrestricted inter prediction encoding scheme, in this unrestricted inter prediction encoding scheme, reference picture is not provided with those restrictions that put on described restriction inter prediction encoding scheme, adopt the picture of above-mentioned intraframe predictive coding scheme coding to form described I picture, the picture that adopts above-mentioned restriction inter prediction encoding scheme to encode forms the P picture of the described first kind, and the picture that adopts above-mentioned unrestricted inter prediction encoding scheme to encode forms the picture of described second type; And indication be used to the to encode information of encoding scheme of each picture, described decoding device comprises:
Acquiring unit, it obtains the information of described indication encoding scheme from described coding motion picture information;
Decoding unit, it is decoded to the described coded data that is included in the described coding motion picture information based on the described information of the indication encoding scheme of being obtained by described acquiring unit;
Detecting unit, its detection are used for the execution command of the described coding motion picture of fast speed playback information; And
The playback control unit, control described decoding unit, make it work as described detecting unit when detecting the described execution command that is used for fast speed playback, the described I picture in the described coded data of only decoding and the P picture of the described first kind, and when described detecting unit does not detect the described execution command that is used for fast speed playback, decode the P picture of described I picture, the described first kind and the picture of described second type.
6. decoding device as claimed in claim 5 further comprises display unit, and it shows the motion picture information that described decoding unit obtains, wherein
When described detecting unit detects the described execution command that is used for fast speed playback, described playback control unit is selected the part in the P picture of the described I picture and the described first kind and is controlled the picture of the described selection of described decoding unit decodes, thereby shows a plurality of pictures of forming described motion picture information at interval with the rule corresponding to the speed of described fast speed playback.
7. coding method is used to use intraframe predictive coding scheme or inter prediction encoding scheme that each picture of component movement picture is encoded, and described coding method comprises:
Controlled step is used to select to be applied to the encoding scheme of each picture, and extracts picture at interval every predetermined rule from motion picture;
Coding step is used for based on the encoding scheme that described controlled step is selected each picture of encoding, wherein
Described controlled step is carried out following selection:
For each picture that is extracted, select described intraframe predictive coding scheme or restriction inter prediction encoding scheme, reference picture is restricted to intraframe predictive coding picture in the same picture group or another be extracted and the coded picture that select the picture of above-mentioned restriction inter prediction encoding scheme in the same picture group in this restriction inter prediction encoding scheme, and reference picture is the time to go up the picture before this picture that is extracted; With
For other picture that is not extracted, select described intraframe predictive coding scheme or unrestricted inter prediction encoding scheme, in this unrestricted inter prediction encoding scheme, reference picture is not provided for those restrictions of described restriction inter prediction encoding scheme.
8. coding/decoding method is used to the motion picture information that receives and decode and be encoded, wherein
Described coding motion picture information comprises: by the I picture, the coded data that the P picture of the first kind and the picture of second type are formed, wherein when coding, from motion picture, extract picture at interval every predetermined rule, for each picture that is extracted, select intraframe predictive coding scheme or restriction inter prediction encoding scheme, reference picture is restricted to intraframe predictive coding picture in the same picture group or another be extracted and the coded picture that select the picture of above-mentioned restriction inter prediction encoding scheme in the same picture group in this restriction inter prediction encoding scheme, and reference picture is restricted to last picture before this picture that is extracted of time, for other pictures that are not extracted, select described intraframe predictive coding scheme or unrestricted inter prediction encoding scheme, in this unrestricted inter prediction encoding scheme, reference picture is not provided with those restrictions that put on described restriction inter prediction encoding scheme, adopt the picture of above-mentioned intraframe predictive coding scheme coding to form described I picture, the picture that adopts above-mentioned restriction inter prediction encoding scheme to encode forms the P picture of the described first kind, and the picture that adopts above-mentioned unrestricted inter prediction encoding scheme to encode forms the picture of described second type; And indication be used to the to encode information of encoding scheme of each picture, described coding/decoding method comprises:
Obtaining step is used for obtaining the described information of indicating encoding scheme from described coding motion picture information;
Decoding step is used for the described information based on the indication encoding scheme of obtaining at described obtaining step, and the described coded data that is included in the described coding motion picture information is decoded;
Detect step, be used to detect the execution command that is used for the described coding motion picture of fast speed playback information; And
The playback controlled step, be used to control described decoding step, it is worked as when detecting the described execution command that is used for fast speed playback in the described detection step, the described I picture in the described coded data of only decoding and the P picture of the described first kind, and when not detecting the described execution command that is used for fast speed playback in the described detection step, decode the P picture of described I picture, the described first kind and the picture of described second type.
CN2007101011770A 2006-05-09 2007-05-09 Image encoding apparatus and encoding method, image decoding apparatus and decoding method Expired - Fee Related CN101072345B (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
JP2006130883 2006-05-09
JP2006-130883 2006-05-09
JP2006130882 2006-05-09
JP2006130882A JP4810298B2 (en) 2006-05-09 2006-05-09 Image encoding apparatus, encoding method, image decoding apparatus, and decoding method
JP2006130883A JP4974583B2 (en) 2006-05-09 2006-05-09 Image encoding apparatus and encoding method
JP2006-130882 2006-05-09

Publications (2)

Publication Number Publication Date
CN101072345A CN101072345A (en) 2007-11-14
CN101072345B true CN101072345B (en) 2010-11-10

Family

ID=38839751

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2007101011770A Expired - Fee Related CN101072345B (en) 2006-05-09 2007-05-09 Image encoding apparatus and encoding method, image decoding apparatus and decoding method

Country Status (2)

Country Link
JP (1) JP4810298B2 (en)
CN (1) CN101072345B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101789979B (en) * 2010-01-21 2012-08-08 华为终端有限公司 Wireless Internet access method and wireless Internet access data card
CN101783950B (en) * 2010-02-11 2012-06-20 深圳市茁壮网络股份有限公司 Method, system and device for displaying image
US9872019B2 (en) * 2010-07-20 2018-01-16 Sk Telecom Co., Ltd. Method and device for deblocking-filtering, and method and device for encoding and decoding using same
EP4250733A3 (en) 2011-01-14 2023-12-27 Sun Patent Trust Image coding method, image decoding method, memory managing method, image coding apparatus, image decoding apparatus, memory managing apparatus, and image coding and decoding apparatus
US9854234B2 (en) * 2012-10-25 2017-12-26 Qualcomm Incorporated Reference picture status for video coding
WO2015115644A1 (en) * 2014-02-03 2015-08-06 三菱電機株式会社 Image encoding device, image decoding device, encoded stream conversion device, image encoding method, and image decoding method
WO2015192991A1 (en) * 2014-06-18 2015-12-23 Telefonaktiebolaget L M Ericsson (Publ) Random access in a video bitstream
US10855982B2 (en) * 2016-12-12 2020-12-01 Sony Corporation Image processing apparatus and method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1230318A (en) * 1996-07-24 1999-09-29 三洋电机株式会社 Moving picture recording device and moving picture reproducing device
CN1239856A (en) * 1998-05-22 1999-12-29 索尼公司 Editing method and editing apparatus
CN1289209A (en) * 1999-09-17 2001-03-28 索尼公司 Recording apparatus, recording method and recording medium
CN1596545A (en) * 2001-11-06 2005-03-16 松下电器产业株式会社 Moving picture coding method and moving picture decoding method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004140723A (en) * 2002-10-21 2004-05-13 Funai Electric Co Ltd Method and device for reproducing digital video information
EP2348709B1 (en) * 2004-07-01 2014-01-01 Mitsubishi Electric Corporation Encoding method and recording apparatus for randomly accessible video recording medium
EP1802126A4 (en) * 2004-09-13 2010-03-31 Sharp Kk Image coding device, image decoding device, image coding program, and image decoding program.

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1230318A (en) * 1996-07-24 1999-09-29 三洋电机株式会社 Moving picture recording device and moving picture reproducing device
CN1239856A (en) * 1998-05-22 1999-12-29 索尼公司 Editing method and editing apparatus
CN1289209A (en) * 1999-09-17 2001-03-28 索尼公司 Recording apparatus, recording method and recording medium
CN1596545A (en) * 2001-11-06 2005-03-16 松下电器产业株式会社 Moving picture coding method and moving picture decoding method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
JP特开2004-328511A 2004.11.18

Also Published As

Publication number Publication date
CN101072345A (en) 2007-11-14
JP2007306160A (en) 2007-11-22
JP4810298B2 (en) 2011-11-09

Similar Documents

Publication Publication Date Title
CN101072345B (en) Image encoding apparatus and encoding method, image decoding apparatus and decoding method
US8279928B2 (en) Image encoding apparatus and encoding method, image decoding apparatus and decoding method
CN102461172B (en) Dynamic image encoding device
CN116781930A (en) Image encoding/decoding method, image data transmitting method, and storage medium
CN113453015B (en) Video processing method and device
RU2513912C2 (en) Image processing method and apparatus
JP6686541B2 (en) Information processing system
JP2008283560A (en) Information processing apparatus and method thereof
CN111182308B (en) Video decoding method, device, computer equipment and storage medium
JP2010041354A (en) Moving image coding method, coding device and coding program
JP3864098B2 (en) Moving picture encoding method, moving picture decoding method, execution program of these methods, and recording medium recording these execution programs
CN101185339B (en) Image decoding apparatus and method for decoding image data, device and method for encoding image
CN102630003A (en) Image data recorder and control method thereof
US9275081B2 (en) Data management apparatus and data management method
US20090175335A1 (en) Digital Watermarking Method
CN101946517B (en) Method and apparatus for encoding and decoding based on inter prediction using image inpainting
JP4537348B2 (en) MPEG image quality correction apparatus and MPEG image quality correction method
JP2006217076A (en) Video recorder
KR20100127237A (en) Apparatus for and a method of providing content data
US8649615B2 (en) Moving picture compression coding apparatus
JP6426648B2 (en) Moving picture predictive decoding method and moving picture predictive decoding apparatus
CN101237552B (en) Video recording and reproducing apparatus, and control method
CN107257459B (en) Moving picture prediction decoding device and moving picture prediction decoding method
CN104053017A (en) Forensics In Multi-channel Media Content
CN101146230A (en) Apparatus, method and program for encoding and/or decoding moving picture

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20101110

Termination date: 20190509

CF01 Termination of patent right due to non-payment of annual fee