CN102006480A - Method for coding and decoding binocular stereoscopic video based on inter-view prediction - Google Patents
Method for coding and decoding binocular stereoscopic video based on inter-view prediction Download PDFInfo
- Publication number
- CN102006480A CN102006480A CN2010105716838A CN201010571683A CN102006480A CN 102006480 A CN102006480 A CN 102006480A CN 2010105716838 A CN2010105716838 A CN 2010105716838A CN 201010571683 A CN201010571683 A CN 201010571683A CN 102006480 A CN102006480 A CN 102006480A
- Authority
- CN
- China
- Prior art keywords
- predictive vector
- coding
- frame
- vector
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention provides a method for coding and decoding binocular stereoscopic video based on inter-view prediction. The coding method comprises the following steps: coding a first way video by using a one-way video coding method; performing motion compensation and parallax compensation on a predictive block of each frame in a second way video, determining predictive vectors and reference frame indexes in accordance with the motion compensation and the parallax compensation, and coding predicted residuals; predicting the predictive vectors to obtain differential predictive vectors; and coding the differential predictive vectors and the reference frame indexes to finally form a second way video code stream. The decoding method is the inverse process of the coding method. The coding efficiency of the binocular stereoscopic video can be improved by using the coding method of the invention.
Description
Technical field
The present invention relates to computer, technology of video compressing encoding field, particularly a kind of coding and coding/decoding method method based on the binocular tri-dimensional video of prediction between looking.
Background technology
Along with the develop rapidly of electronics and computing technique, stereo technology has reached its maturity and has been widely applied among the different fields.Stereoscopic TV, claim three-dimensional television again, because of it can provide the more visual information and the viewing effect that has more feeling of immersion of horn of plenty, just causing increasing concern, it will bring into play enormous function in industries such as the digital home entertainment of Future in China, cultural intention, educational training.Therefore, the traditional two dimensional surface of three-dimensional television replacement shows it also is trend of the times.
Three-dimensional video-frequency is a binocular parallax principle of utilizing eye, binocular receives the left and right sides image from the specific camera point of Same Scene independently of one another, left eye is seen the image of LOOK LEFT, right eye is seen the image of LOOK RIGHT, form binocular parallax, big brain-capacity obtains the depth information of image, makes the image of enjoying that strong depth perception, sense true to nature be arranged, and spectators can enjoy very strong stereoscopic visual effect.
Binocular tri-dimensional video comprises a pair of video sequence, respectively the scene of corresponding left eye and right eye viewpoint.Can than traditional video, the data of twice need be stored and transmit to binocular tri-dimensional video, effectively be collapsed into the key that realize the 3D technology.Because what left view and right view showed is the image of Same Scene different points of view, therefore have very strong correlation, can utilize these correlations effectively to compress.
Summary of the invention
Purpose of the present invention is intended to solve at least one of above-mentioned technological deficiency.
For this reason, one object of the present invention is to propose a kind of coding method based on the binocular tri-dimensional video of prediction between looking, and a kind of coding/decoding method based on look between the binocular tri-dimensional video of prediction corresponding with above-mentioned coding method.Wherein, this coding method can effectively improve the code efficiency of binocular tri-dimensional video.
For achieving the above object, one aspect of the present invention has proposed a kind of coding method based on the binocular tri-dimensional video of prediction between looking, may further comprise the steps: according to the single channel method for video coding first via video of binocular tri-dimensional video is encoded, to obtain the code stream of described first via video; Whether the present frame of judging the second road video of described binocular tri-dimensional video is bidirectional frame; If the present frame of described the second road video is not a bidirectional frame, then go up adjacent reconstructed frame the prediction piece of the present frame of described the second road video is carried out motion compensation, and carry out parallax compensation according to looking the prediction piece of a reconstructed frame to the present frame of described the second road video according to the time; Determine first predictive vector and first reference frame index of the prediction piece of described present frame according to described motion compensation and described parallax compensation; Residual error to the reference frame of the present frame of described the second road video and respective reference frame index point is encoded, to obtain the residual error code stream; Obtain the difference predictive vector according to described first predictive vector; With according to described difference predictive vector and described first reference frame index present frame of described the second road video is encoded, and form the code stream of described the second road video present frame with described residual error code stream; If the present frame of described the second road video is a bidirectional frame, judge then whether second predictive vector and second reference frame index of the prediction piece of described bidirectional frame obtains according to Direct Model; If second predictive vector and second reference frame index of the prediction piece of described bidirectional frame obtain according to Direct Model, then the present frame of described the second road video is encoded, to form the code stream of described the second road video respective frame according to described second predictive vector and second reference frame index; If with second predictive vector and second reference frame index of the prediction piece of described bidirectional frame be not to obtain according to Direct Model, then described bidirectional frame is encoded, to obtain the code stream of present frame according to the single channel method for video coding.
In one embodiment of the invention, describedly obtain first predictive vector and the reference frame index of corresponding prediction piece, further comprise: the motion vector that obtains the prediction piece of described present frame according to motion compensation according to motion compensation and described parallax compensation; Obtain the difference vector of the prediction piece of described present frame according to parallax compensation; In described difference vector and described motion vector, select a vector as described first predictive vector according to the Optimum Matching criterion, and obtain described predictive vector corresponding reference frame index.
In one embodiment of the invention, describedly obtain the difference predictive vector according to first predictive vector, further comprise: if described first predictive vector is described motion vector, described motion vector is first reference value; If described first predictive vector is described difference vector, described difference vector is second reference value; According to described first reference value and described second reference value described predictive vector is carried out predictive coding, to obtain described difference predictive vector.
In one embodiment of the invention, according to described first reference value and described second reference value described predictive vector is carried out predictive coding, to obtain described difference predictive vector, further comprise: the corresponding reference frame of judging the described predictive vector of current block belongs to the described first via video or the second road video; If described reference frame belongs to described first via video, judge whether the predictive vector of the prediction piece adjacent with described current block belongs to the second road video; If the predictive vector of the prediction piece that described current block is adjacent does not belong to the second road video, predictive vector to the adjacent prediction piece of described current block is encoded, otherwise the predictive vector of the adjacent prediction piece of described current block is not encoded, and the adjacent prediction piece of the described current block of mark is unavailable.
In one embodiment of the invention, according to described first reference value and described second reference value described predictive vector is carried out predictive coding, to obtain described difference predictive vector, also comprise:, judge whether the predictive vector of the prediction piece adjacent with described current block belongs to first via video if described reference frame belongs to described the second road video; If the predictive vector of the prediction piece that described current block is adjacent does not belong to first via video, predictive vector to the adjacent prediction piece of described current block is encoded, otherwise the predictive vector of the adjacent prediction piece of described current block is not encoded, and the adjacent prediction piece of the described current block of mark is unavailable.
In one embodiment of the invention, if the prediction piece of described bidirectional frame obtains second predictive vector of the prediction piece of described bidirectional frame according to Direct Model, further comprise: if second predictive vector of the back prediction piece to the reference frame corresponding blocks of described bidirectional frame, belong to the first via and the second road video respectively with second predictive vector of the prediction piece of described bidirectional frame, perhaps belong to second and first via video respectively, obtain second predictive vector according to the space vector Forecasting Methodology with second predictive vector of the prediction piece of described bidirectional frame; Otherwise obtain second predictive vector according to time domain vector prediction method.
Another aspect of the present invention has proposed a kind of coding/decoding method based on the binocular tri-dimensional video of prediction between looking, may further comprise the steps: according to the single channel video encoding/decoding method first via video code flow of binocular tri-dimensional video coding is decoded, to recover described first via video; Whether the present frame coding of judging the second road video code flow of described binocular tri-dimensional video coding is the bidirectional frame coding; If the present frame of described the second road video code flow coding is not the bidirectional frame coding, then the present frame coding of described the second road video code flow is decoded with the difference predictive vector and first reference frame index that obtains described present frame; Present frame coding to described the second road video code flow is decoded with the residual coding of the reference frame coding of described first reference frame index sensing, to obtain corresponding residual error; Obtain first predictive vector according to described difference predictive vector; Vow motion vector or the difference vector that obtains described present frame coding according to described first prediction; Finish the decoding of described present frame coding according to described motion vector or difference vector and described residual error; If the present frame of described the second road video code flow is encoded to the bidirectional frame coding, judge then whether second predictive vector and second reference frame index of the prediction piece of described bidirectional frame coding obtains according to Direct Model; If second predictive vector and second reference frame index of the prediction piece of described bidirectional frame coding obtain according to Direct Model, then according to described second predictive vector and second reference frame index to the into decoding of encoding of the present frame of described the second road video code flow, to obtain the corresponding bidirectional frame of described the second road video; If second predictive vector of the prediction piece of described bidirectional frame and second reference frame index are not to obtain according to Direct Model, then described bidirectional frame coding is decoded, to recover bidirectional frame according to the single channel video encoding/decoding method.
In one embodiment of the invention, describedly obtain first predictive vector according to the difference predictive vector, further comprise: if the prediction piece of present frame uses motion compensation to predict, first predictive vector of then described prediction piece is described difference predictive vector, and the motion vector sum of the prediction piece of the use motion compensation adjacent with described prediction piece; If the prediction piece of present frame uses parallax compensation to predict that first predictive vector of then described prediction piece is described difference predictive vector, and the difference vector sum of the prediction piece of the use parallax compensation adjacent with described prediction piece.
In one embodiment of the invention, described second predictive vector that obtains the prediction piece of described bidirectional frame coding according to Direct Model, further comprise: if the reference block of the back prediction piece to the reference frame correspondence of described bidirectional frame coding points to the reference frame of described first via video code flow, obtain second predictive vector of described Direct Model piece by the space vector forecast method, if the reference block of the back prediction piece to the reference frame correspondence of described bidirectional frame coding points to the reference frame of described the second road video code flow, obtain second predictive vector of described Direct Model piece by the method for time domain vector prediction.
Code And Decode method based on the binocular tri-dimensional video of prediction between looking of the present invention, the correlation of time domain and the correlation between viewpoint have been made full use of, by the prediction piece is carried out motion compensation or parallax compensation, can effectively improve the code efficiency of binocular tri-dimensional video.In addition, the present invention asks for algorithm to second predictive vector of the piece of employing Direct Model coding in the bidirectional frame and improves, and has improved the accuracy that second predictive vector of Direct Model piece is asked in the bidirectional frame more.Simultaneously, the present invention improves the predictive coding algorithm of predictive vector, has improved the accuracy of prediction of predictive vector and the efficient of predictive vector differential coding.
Aspect that the present invention adds and advantage part in the following description provide, and part will become obviously from the following description, or recognize by practice of the present invention.
Description of drawings
Above-mentioned and/or additional aspect of the present invention and advantage are from obviously and easily understanding becoming the description of embodiment below in conjunction with accompanying drawing, wherein:
Fig. 1 is the flow chart based on the binocular tri-dimensional frequency coding method of prediction between looking of the embodiment of the invention;
Fig. 2 carries out the schematic diagram that predictive coding obtains the difference predictive vector in the coding method of the present invention to predictive vector;
The Direct Model motion vector derivation principle figure of B frame in Fig. 3 a-3b coding method of the present invention and the coding/decoding method;
Fig. 4 is IBBPBBP... predict schematic diagram among the embodiment of coding method of the present invention; With
Fig. 5 is the flow chart based on the binocular tri-dimensional video coding/decoding method of prediction between looking of the embodiment of the invention.
Embodiment
Describe whole embodiment of the present invention below in detail, the example of described embodiment is shown in the drawings, and wherein identical from start to finish or similar label is represented identical or similar elements or the element with identical or similar functions.Below by the embodiment that is described with reference to the drawings is exemplary, only is used to explain the present invention, and can not be interpreted as limitation of the present invention.
The embodiment of the invention is a kind of coding method based on the binocular tri-dimensional video of prediction between looking that propose at having now not high to the binocular tri-dimensional video code efficiency.The coding method based on the binocular tri-dimensional video of prediction between looking by the embodiment of the invention proposes can improve the code efficiency to binocular tri-dimensional video effectively.Below with reference to accompanying drawing detailed introduction is done by coding method and corresponding decoding side that the embodiment of the invention proposes.
As shown in Figure 1, show the flow chart based on the binocular tri-dimensional frequency coding method of prediction between looking of the embodiment of the invention.The coding method that proposes at binocular tri-dimensional video owing to the embodiment of the invention, so the wherein coding method of one tunnel employing single channel video to binocular tri-dimensional video is encoded, in specific embodiments of the invention, wherein one road video that the coding method of adopting the single channel video is encoded is defined as first via video, and another road video is defined as the second road video, certainly, the so-called first via video and the second road video can exchange.And, according to the correlation of binocular tri-dimensional video two-path video, the second road video of the embodiment of the invention is encoded, thereby reduced coding redundant video, improve code efficiency.Specifically may further comprise the steps:
Step S101 judges whether current prediction piece belongs to the second road video, if do not belong to the second road video, and execution in step S102 then, otherwise execution in step S103;
Step S102 utilizes the method for single channel video coding first via video is predicted and to be encoded;
Step S103, whether the present frame of judging the second road video is bidirectional frame (B frame) prediction, if present frame is a bidirectional frame, execution in step S109 then, otherwise execution in step S104;
Step S104, because the reference frame of the prediction piece of current bidirectional frame may be from the reconstructed frame of current view point or the reconstructed frame of first via viewpoint, so simultaneously this piece is carried out motion compensation and parallax compensation, and according to the Optimum Matching criterion, (as average mean square error, the average absolute value error) from the motion vector of current prediction piece and difference vector, selects according to the Optimum Matching criterion, select the predictive vector of the vector of one of them as current prediction piece, in specific embodiments of the invention, this predictive vector is defined as first predictive vector, with distinguish to adopt that distinct methods gets predictive vector, below for the description of this predictive vector, be that example describes all with first predictive vector.But those skilled in the art will appreciate that definition, also can be defined as other titles, but the implication of its expression is identical with predictive vector for first predictive vector;
Step S105 judges whether first predictive vector of current prediction piece points to the reference frame of the second road video, if point to the reference frame of the second road video, and execution in step S106 then, otherwise execution in step S107;
Step S106 points to the adjacent block of first via video with unavailable in the prediction of first predictive vector of the prediction piece of present frame.
In specific embodiments of the invention, as shown in Figure 2, show in the coding method of the embodiment of the invention predictive vector is carried out predictive coding, thereby obtain the schematic diagram of difference predictive vector, below in conjunction with specific embodiment step S106 is further explained, if current block E points to the second road video, and adjacent block A points to first via video, so current block E belongs to different videos with first predictive vector of adjacent block A, therefore can't utilize first predictive vector of adjacent block A to carry out predictive coding, so tag block A is unavailable, ignore coding to first predictive vector of adjacent block A;
Step S107 points to the adjacent block of the second road video with unavailable in the prediction of first predictive vector of the prediction piece of present frame.
In specific embodiments of the invention, equally with reference to figure 2, if current block E points to first via viewpoint, and adjacent block A points to the second tunnel viewpoint, so current block E belongs to different videos with first predictive vector of adjacent block A, therefore can't utilize first predictive vector of adjacent block A to carry out predictive coding,, ignore coding equally the predictive vector of adjacent block A so tag block A is unavailable;
Step S108 does not carry out predictive coding according to step S106 or S107 to there being disabled first predictive vector of mark prediction piece, obtains the difference predictive vector.
Particularly, if current prediction piece uses motion compensation to predict, then the motion vector of motion compensation block that will be adjacent with current prediction piece is as predicted value, if current prediction piece uses parallax compensation to predict that then the difference vector of parallax compensation piece that will be adjacent with current prediction piece is as predicted value.Thereby, according to predicted value first predictive vector of predicting piece is carried out predictive coding, obtain the difference predictive vector.According to the difference predictive vector and first reference frame index, each frame of the second road video is encoded at last, finally obtain the second road video code flow;
Step S109, because described present frame is a bidirectional frame, whether adopt Direct Model to ask for second predictive vector so judge current block, from Fig. 1, can find out, in this specific embodiment, the motion vector of this second predictive vector for adopting Direct Model to ask for is if adopt Direct Model to ask for second predictive vector, execution in step S110 then, otherwise execution in step S113;
Step S110, judge the back reference frame that whether points to first via video to second predictive vector of corresponding blocks of current prediction piece, if back second predictive vector to corresponding blocks of current prediction piece points to first via video reference frame, execution in step S111 then, otherwise execution in step S112;
Step S111 adopts the spatial domain prediction pattern that second predictive vector is predicted.
In specific embodiments of the invention, the prediction schematic diagram that adopts the spatial domain prediction pattern is the Direct Model second predictive vector derivation principle figure of bidirectional frame in coding method of the present invention and the coding/decoding method shown in Fig. 3 a;
Step S112 adopts the time domain prediction pattern that second predictive vector is predicted.
In specific embodiments of the invention, the prediction schematic diagram that adopts the time domain prediction pattern is the Direct Model second predictive vector derivation principle figure of bidirectional frame in coding method of the present invention and the coding/decoding method shown in Fig. 3 b;
Step S113 utilizes the method for single channel video coding remaining bidirectional frame is predicted and to be encoded.
In specific embodiments of the invention, coding side carries out motion compensation and parallax compensation to the second road video in the binocular tri-dimensional video, prediction between coding side is looked macroblock to be encoded as first predictive vector according to one of Optimum Matching criterion selection difference vector and motion vector.Coding side transfers to decoding end with first predictive vector first and reference frame index, makes decoding end to carry out correct decoding to the second road code stream.In a preferred embodiment of the invention, as shown in Figure 4, be IBBPBBP... predict schematic diagram.The instantiation that adopts the binocular video coding that coding method of the present invention obtains is shown.But those of ordinary skill in the art instructs, and the IBBPBBP... coding structure is just in order to illustrate the effect of the embodiment of the invention, and wherein, coding structure provided by the invention is not limited to this.These also should belong to protection scope of the present invention.
In the embodiment of the invention on the other hand, a kind of coding/decoding method based on the binocular tri-dimensional video of prediction between looking has been proposed.Be described in detail below in conjunction with the coding/decoding method of accompanying drawing the embodiment of the invention.
As shown in Figure 5, show the particular flow sheet based on the coding/decoding method of the binocular tri-dimensional video of prediction between looking of the embodiment of the invention.
Particularly, the decode procedure to binocular tri-dimensional video may further comprise the steps:
Step S201 judges whether the prediction piece of present frame belongs to the second road video.If belong to the second road video, execution in step S203 then, otherwise execution in step S202;
Step S202, present frame coding is predicted and decoded, obtain the reconstructed frame of present frame coding according to the single channel video frequency decoding method;
Step S203, judge that whether present frame is bidirectional frame (B frame) prediction, if present frame is the bidirectional frame prediction, execution in step S209 then, otherwise execution in step S204;
Step S204, from the second road video code flow, obtain the difference predictive vector of current block, and judge that according to the respective reference frame index of difference predictive vector this reference frame points to the reference frame in the former moment of the second road video, or the parallax reference frame of first via video current time;
Step S205, judge whether the difference predictive vector of current block points to the reference frame of the second road video.If the difference predictive vector of current block points to the reference frame of the second road video, execution in step S206 then, otherwise execution in step S207;
Step S206, in the recovery of predictive vector, the adjacent block that points to first via video is with unavailable.In specific embodiments of the invention, this predictive vector is corresponding to first predictive vector of the coding method of the present invention's proposition.
In a specific embodiment of the present invention, as shown in Figure 2, show in the coding method of the present invention predictive vector is carried out the schematic diagram that predictive coding obtains the difference predictive vector.By specific embodiment step S206 is done detailed explanation, if current block E points to the second road video, and adjacent block A points to first via video, because first predictive vector of current block E and adjacent block A belongs to different videos, therefore can't utilize first predictive vector of adjacent block A to carry out predictive coding, so tag block A is unavailable;
Step S207, in the recovery of predictive vector, the adjacent block that points to the second tunnel viewpoint is with unavailable.
In a specific embodiment of the present invention, as shown in Figure 2, show in the coding method of the present invention predictive vector is carried out the schematic diagram that predictive coding obtains the difference predictive vector.If step S207 current block E is pointed to first via viewpoint by specific embodiment, and adjacent block A points to the second tunnel viewpoint, because their first predictive vector belongs to different viewpoints, therefore can't utilize first predictive vector of adjacent block A to carry out predictive coding, so tag block A is unavailable;
The difference predictive vector that obtains in the predicted value of step S208, first predictive vector that obtains according to step S206 or S207 and the second road video code flow recovers original difference vector or motion vector.
Particularly, if current prediction piece uses motion compensation to predict, predict that then first predictive vector of piece reaches the vector predictor sum of the piece of the use motion compensation adjacent with current prediction piece for the difference predictive vector, if current prediction piece uses parallax compensation to predict, first predictive vector of then predicting piece carries out parallax compensation or motion compensation to current prediction piece then for the vector predictor sum of the piece of difference predictive vector and the use parallax compensation adjacent with current prediction piece.And according to the compensation result to the prediction piece, the second road video code flow is reconstructed, finish decoding to the second road video code flow;
Step S209, judge whether current block adopts Direct Model to ask for second predictive vector, ask for second predictive vector if adopt Direct Model, execution in step S210 then, otherwise execution in step S210, in specific embodiments of the invention, can find out that from Fig. 5 this second predictive vector is the motion vector during the employing Direct Model is asked for, at this, motion vector is defined as second predictive vector;
Step S210, judge current block afterwards whether point to the reference frame of first via video to second predictive vector of corresponding blocks, if execution in step S211 then, otherwise execution in step S212;
Step S211, employing spatial domain prediction pattern are predicted second predictive vector.
In specific embodiments of the invention, the prediction schematic diagram that adopts the spatial domain prediction pattern is the Direct Model second predictive vector derivation principle figure of bidirectional frame in coding method of the present invention and the coding/decoding method shown in Fig. 3 a;
Step S212, employing time domain prediction pattern are predicted second predictive vector.
In specific embodiments of the invention, the prediction schematic diagram that adopts the time domain prediction pattern is the Direct Model second predictive vector derivation principle figure of bidirectional frame in coding method of the present invention and the coding/decoding method shown in Fig. 3 b;
Step S213, utilize the single channel video encoding/decoding method to carry out bi-directional predicted and decoding, obtain remaining the reconstructed frame of bidirectional frame coding, thereby finish whole decode procedure residue bidirectional frame coding.
Need to prove, in an embodiment of the present invention, at first, the coding of binocular tri-dimensional video not only can be according to the IBBPBBP... coding structure of instantiation of the present invention, also can be according to structured codings such as IPPP..., secondly, parallax compensation of the present invention adopts the image of another video of synchronization to carry out parallax compensation as the reference image, but be not limited thereto, predictive reference frames also can be a plurality of between video, but those skilled in the art instructs, and these all can be changed according to the thought that the present invention proposes method.Though but these carry out multiple different the modification to the present invention, equally all should belong to protection scope of the present invention.
Coding method by embodiment of the invention proposition based on the binocular tri-dimensional video of prediction between looking, the correlation of time domain and the correlation between viewpoint have been made full use of, by the prediction piece is carried out motion compensation or parallax compensation, can effectively improve the code efficiency of binocular tri-dimensional video.In addition, the present invention asks for algorithm to second predictive vector of the piece of employing Direct Model coding in the bidirectional frame and improves, and has improved the accuracy that second predictive vector of Direct Model piece is asked in the bidirectional frame more.Simultaneously, the present invention improves the predictive coding algorithm of predictive vector, has improved the accuracy of prediction of predictive vector and the efficient of predictive vector differential coding.And a kind of coding/decoding method based on the binocular tri-dimensional video of prediction between looking that the present invention proposes, can think the inverse process that the present invention proposes, so this coding/decoding method has improved decoding efficiency equally to the decoding of video based on the coding method of the binocular tri-dimensional video of prediction between looking.
Although illustrated and described embodiments of the invention, for the ordinary skill in the art, be appreciated that without departing from the principles and spirit of the present invention and can carry out multiple variation, modification, replacement and modification that scope of the present invention is by claims and be equal to and limit to these embodiment.
Claims (9)
1. the coding method based on the binocular tri-dimensional video of prediction between looking is characterized in that, may further comprise the steps:
According to the single channel method for video coding first via video of binocular tri-dimensional video is encoded, to obtain the code stream of described first via video;
Whether the present frame of judging the second road video of described binocular tri-dimensional video is bidirectional frame;
If the present frame of described the second road video is not a bidirectional frame, then go up adjacent reconstructed frame the prediction piece of the present frame of described the second road video is carried out motion compensation, and carry out parallax compensation according to looking the prediction piece of a reconstructed frame to the present frame of described the second road video according to the time;
Determine first predictive vector and first reference frame index of the prediction piece of described present frame according to described motion compensation and described parallax compensation;
Residual error to the reference frame of the present frame of described the second road video and respective reference frame index point is encoded, to obtain the residual error code stream;
Obtain the difference predictive vector according to described first predictive vector; With
According to described difference predictive vector and described first reference frame index present frame of described the second road video is encoded, and form the code stream of described the second road video present frame with described residual error code stream;
If the present frame of described the second road video is a bidirectional frame, judge then whether second predictive vector and second reference frame index of the prediction piece of described bidirectional frame obtains according to Direct Model;
If second predictive vector and second reference frame index of the prediction piece of described bidirectional frame obtain according to Direct Model, then the present frame of described the second road video is encoded, to form the code stream of described the second road video respective frame according to described second predictive vector and second reference frame index; With
If second predictive vector of the prediction piece of described bidirectional frame and second reference frame index are not to obtain according to Direct Model, then described bidirectional frame is encoded, to obtain the code stream of present frame according to the single channel method for video coding.
2. the coding method based on the binocular tri-dimensional video of prediction between looking as claimed in claim 1, it is characterized in that, describedly determine further to comprise first predictive vector and first reference frame index of the prediction piece of described present frame according to motion compensation and described parallax compensation:
Obtain the motion vector of the prediction piece of described present frame according to motion compensation;
Obtain the difference vector of the prediction piece of described present frame according to parallax compensation;
In described difference vector and described motion vector, select a vector as described first predictive vector according to the Optimum Matching criterion, and obtain described first reference frame index.
3. the coding method of binocular tri-dimensional video based on prediction between looking as claimed in claim 2 is characterized in that, describedly obtains the difference predictive vector according to first predictive vector, further comprises:
If described first predictive vector is described motion vector, described motion vector is first reference value;
If described first predictive vector is described difference vector, described difference vector is second reference value;
According to described first reference value and described second reference value described predictive vector is carried out predictive coding, to obtain described difference predictive vector.
4. the coding method based on the binocular tri-dimensional video of prediction between looking as claimed in claim 3, it is characterized in that, according to described first reference value and described second reference value described first predictive vector is carried out predictive coding,, further comprises to obtain described difference predictive vector:
The corresponding reference frame of judging the described predictive vector of current block belongs to the described first via video or the second road video;
If described reference frame belongs to described first via video, judge whether the predictive vector of the prediction piece adjacent with described current block belongs to the second road video;
If the predictive vector of the prediction piece that described current block is adjacent does not belong to the second road video, predictive vector to the adjacent prediction piece of described current block is encoded, otherwise the predictive vector of the adjacent prediction piece of described current block is not encoded, and the adjacent prediction piece of the described current block of mark is unavailable.
5. the coding method based on the binocular tri-dimensional video of prediction between looking as claimed in claim 4, it is characterized in that, according to described first reference value and described second reference value described first predictive vector is carried out predictive coding,, also comprises to obtain described difference predictive vector:
If described reference frame belongs to described the second road video, judge whether the predictive vector of the prediction piece adjacent with described current block belongs to first via video;
If the predictive vector of the prediction piece that described current block is adjacent does not belong to first via video, predictive vector to the adjacent prediction piece of described current block is encoded, otherwise the predictive vector of the adjacent prediction piece of described current block is not encoded, and the adjacent prediction piece of the described current block of mark is unavailable.
6. the coding method of binocular tri-dimensional video based on prediction between looking as claimed in claim 1 is characterized in that, if the prediction piece of described bidirectional frame obtains second predictive vector of the prediction piece of described bidirectional frame according to Direct Model, further comprises:
If second predictive vector of the back prediction piece to the reference frame corresponding blocks of described bidirectional frame, belong to the first via and the second road video respectively with second predictive vector of the prediction piece of described bidirectional frame, perhaps belong to second and first via video respectively, obtain second predictive vector according to the space vector Forecasting Methodology with second predictive vector of the prediction piece of described bidirectional frame; Otherwise obtain second predictive vector according to time domain vector prediction method.
7. the coding/decoding method based on the binocular tri-dimensional video of prediction between looking is characterized in that, may further comprise the steps:
According to the single channel video encoding/decoding method first via video code flow of binocular tri-dimensional video coding is decoded, to recover described first via video;
Whether the present frame coding of judging the second road video code flow of described binocular tri-dimensional video coding is the bidirectional frame coding;
If the present frame of described the second road video code flow coding is not the bidirectional frame coding, then the present frame coding of described the second road video code flow is decoded with the difference predictive vector and first reference frame index that obtains described present frame;
Present frame coding to described the second road video code flow is decoded with the residual coding of the reference frame coding of described first reference frame index sensing, to obtain corresponding residual error;
Obtain first predictive vector according to described difference predictive vector;
Vow motion vector or the difference vector that obtains described present frame coding according to described first prediction;
Finish the decoding of described present frame coding according to described motion vector or difference vector and described residual error;
If the present frame of described the second road video code flow is encoded to the bidirectional frame coding, judge then whether second predictive vector and second reference frame index of the prediction piece of described bidirectional frame coding obtains according to Direct Model;
If second predictive vector and second reference frame index of the prediction piece of described bidirectional frame coding obtain according to Direct Model, then according to described second predictive vector and second reference frame index to the into decoding of encoding of the present frame of described the second road video code flow, to obtain the corresponding bidirectional frame of described the second road video;
If second predictive vector of the prediction piece of described bidirectional frame and second reference frame index are not to obtain according to Direct Model, then described bidirectional frame coding is decoded, to recover bidirectional frame according to the single channel video encoding/decoding method.
8. the coding method of binocular tri-dimensional video based on prediction between looking as claimed in claim 7 is characterized in that, describedly obtains first predictive vector according to the difference predictive vector, further comprises:
If the prediction piece of present frame uses motion compensation to predict that first predictive vector of then described prediction piece is described difference predictive vector, and the motion vector sum of the prediction piece of the use motion compensation adjacent with described prediction piece;
If the prediction piece of present frame uses parallax compensation to predict that first predictive vector of then described prediction piece is described difference predictive vector, and the difference vector sum of the prediction piece of the use parallax compensation adjacent with described prediction piece.
9. the coding method of binocular tri-dimensional video based on prediction between looking as claimed in claim 8 is characterized in that, describedly obtains second predictive vector of the prediction piece of described bidirectional frame coding according to Direct Model, further comprises:
If the reference block of the back prediction piece to the reference frame correspondence of described bidirectional frame coding points to the reference frame of described first via video code flow, obtain second predictive vector of described Direct Model piece by the space vector forecast method, if the reference block of the back prediction piece to the reference frame correspondence of described bidirectional frame coding points to the reference frame of described the second road video code flow, obtain second predictive vector of described Direct Model piece by the method for time domain vector prediction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010571683 CN102006480B (en) | 2010-11-29 | 2010-11-29 | Method for coding and decoding binocular stereoscopic video based on inter-view prediction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010571683 CN102006480B (en) | 2010-11-29 | 2010-11-29 | Method for coding and decoding binocular stereoscopic video based on inter-view prediction |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102006480A true CN102006480A (en) | 2011-04-06 |
| CN102006480B CN102006480B (en) | 2013-01-30 |
Family
ID=43813496
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010571683 Active CN102006480B (en) | 2010-11-29 | 2010-11-29 | Method for coding and decoding binocular stereoscopic video based on inter-view prediction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102006480B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102413342A (en) * | 2011-09-05 | 2012-04-11 | 清华大学 | Geometrical correction method and system of binocular stereoscopic video |
| CN102438141A (en) * | 2011-10-25 | 2012-05-02 | 中国科学技术大学 | Processing method of code stream of stereo video and apparatus thereof |
| CN102752615A (en) * | 2011-04-18 | 2012-10-24 | 汤姆森特许公司 | Method for coding and decoding a 3d video signal and corresponding devices |
| CN104904213A (en) * | 2012-12-07 | 2015-09-09 | 高通股份有限公司 | Advanced residual prediction in scalable and multi-view video coding |
| CN104902256A (en) * | 2015-05-21 | 2015-09-09 | 南京大学 | Binocular stereo image coding and decoding method based on motion compensation |
| CN107071385A (en) * | 2017-04-18 | 2017-08-18 | 杭州派尼澳电子科技有限公司 | A kind of method for encoding stereo video that parallax compensation is introduced based on H265 |
| CN107197272A (en) * | 2011-08-29 | 2017-09-22 | 苗太平洋控股有限公司 | In method of the merging patterns to Image Coding |
| CN107454426A (en) * | 2012-07-27 | 2017-12-08 | 寰发股份有限公司 | 3 d video encoding or coding/decoding method |
| CN108040259A (en) * | 2011-10-05 | 2018-05-15 | 太阳专利托管公司 | Method for encoding images and picture coding device |
| WO2018161942A1 (en) * | 2017-03-09 | 2018-09-13 | Mediatek Inc. | Video processing apparatus using one or both of reference frame re-rotation and content-oriented rotation selection and associated video processing method |
| US10560678B2 (en) | 2016-11-09 | 2020-02-11 | Mediatek Inc. | Method and apparatus having video encoding function with syntax element signaling of rotation information of content-oriented rotation applied to 360-degree image content or 360-degree video content represented in projection format and associated method and apparatus having video decoding function |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1525762A (en) * | 2003-09-12 | 2004-09-01 | 中国科学院计算技术研究所 | A coding/decoding end bothway prediction method for video coding |
| WO2007024072A1 (en) * | 2005-08-22 | 2007-03-01 | Samsung Electronics Co., Ltd. | Method and apparatus for encoding multiview video |
| CN101222640A (en) * | 2007-01-09 | 2008-07-16 | 华为技术有限公司 | Method an device for confirming reference frame |
| CN101534440A (en) * | 2008-03-10 | 2009-09-16 | 联发科技股份有限公司 | Video signal encoding method |
| CN101547350A (en) * | 2008-03-28 | 2009-09-30 | 陈意辉 | Efficient plane and stereo digital video coding and decoding method |
-
2010
- 2010-11-29 CN CN 201010571683 patent/CN102006480B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1525762A (en) * | 2003-09-12 | 2004-09-01 | 中国科学院计算技术研究所 | A coding/decoding end bothway prediction method for video coding |
| WO2007024072A1 (en) * | 2005-08-22 | 2007-03-01 | Samsung Electronics Co., Ltd. | Method and apparatus for encoding multiview video |
| CN101222640A (en) * | 2007-01-09 | 2008-07-16 | 华为技术有限公司 | Method an device for confirming reference frame |
| CN101534440A (en) * | 2008-03-10 | 2009-09-16 | 联发科技股份有限公司 | Video signal encoding method |
| CN101547350A (en) * | 2008-03-28 | 2009-09-30 | 陈意辉 | Efficient plane and stereo digital video coding and decoding method |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102752615A (en) * | 2011-04-18 | 2012-10-24 | 汤姆森特许公司 | Method for coding and decoding a 3d video signal and corresponding devices |
| CN107277548B (en) * | 2011-08-29 | 2019-12-06 | 苗太平洋控股有限公司 | Method for encoding image in merge mode |
| CN107197272B (en) * | 2011-08-29 | 2019-12-06 | 苗太平洋控股有限公司 | Method for encoding image in merge mode |
| CN107197272A (en) * | 2011-08-29 | 2017-09-22 | 苗太平洋控股有限公司 | In method of the merging patterns to Image Coding |
| CN107277548A (en) * | 2011-08-29 | 2017-10-20 | 苗太平洋控股有限公司 | In method of the merging patterns to Image Coding |
| CN102413342A (en) * | 2011-09-05 | 2012-04-11 | 清华大学 | Geometrical correction method and system of binocular stereoscopic video |
| CN108040259A (en) * | 2011-10-05 | 2018-05-15 | 太阳专利托管公司 | Method for encoding images and picture coding device |
| CN108040259B (en) * | 2011-10-05 | 2022-02-01 | 太阳专利托管公司 | Image encoding method and image encoding device |
| CN102438141A (en) * | 2011-10-25 | 2012-05-02 | 中国科学技术大学 | Processing method of code stream of stereo video and apparatus thereof |
| CN102438141B (en) * | 2011-10-25 | 2013-03-27 | 中国科学技术大学 | Processing method of code stream of stereo video and apparatus thereof |
| CN107454426A (en) * | 2012-07-27 | 2017-12-08 | 寰发股份有限公司 | 3 d video encoding or coding/decoding method |
| CN104969551B (en) * | 2012-12-07 | 2018-11-23 | 高通股份有限公司 | Advanced residual prediction in the decoding of scalable and multi-angle video |
| US9948939B2 (en) | 2012-12-07 | 2018-04-17 | Qualcomm Incorporated | Advanced residual prediction in scalable and multi-view video coding |
| CN104904213B (en) * | 2012-12-07 | 2018-06-01 | 高通股份有限公司 | Advanced residual prediction in the decoding of scalable and multi-angle video |
| US10334259B2 (en) | 2012-12-07 | 2019-06-25 | Qualcomm Incorporated | Advanced residual prediction in scalable and multi-view video coding |
| CN104969551A (en) * | 2012-12-07 | 2015-10-07 | 高通股份有限公司 | Advanced residual prediction in scalable and multi-view video coding |
| CN104904213A (en) * | 2012-12-07 | 2015-09-09 | 高通股份有限公司 | Advanced residual prediction in scalable and multi-view video coding |
| CN104902256A (en) * | 2015-05-21 | 2015-09-09 | 南京大学 | Binocular stereo image coding and decoding method based on motion compensation |
| US10560678B2 (en) | 2016-11-09 | 2020-02-11 | Mediatek Inc. | Method and apparatus having video encoding function with syntax element signaling of rotation information of content-oriented rotation applied to 360-degree image content or 360-degree video content represented in projection format and associated method and apparatus having video decoding function |
| US10587857B2 (en) | 2016-11-09 | 2020-03-10 | Mediatek Inc. | Method and apparatus having video decoding function with syntax element parsing for obtaining rotation information of content-oriented rotation applied to 360-degree image content or 360-degree video content represented in projection format |
| WO2018161942A1 (en) * | 2017-03-09 | 2018-09-13 | Mediatek Inc. | Video processing apparatus using one or both of reference frame re-rotation and content-oriented rotation selection and associated video processing method |
| CN107071385A (en) * | 2017-04-18 | 2017-08-18 | 杭州派尼澳电子科技有限公司 | A kind of method for encoding stereo video that parallax compensation is introduced based on H265 |
| CN107071385B (en) * | 2017-04-18 | 2019-01-25 | 杭州派尼澳电子科技有限公司 | A kind of method for encoding stereo video introducing parallax compensation based on H265 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102006480B (en) | 2013-01-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102006480B (en) | Method for coding and decoding binocular stereoscopic video based on inter-view prediction | |
| EP2721823B1 (en) | Method and apparatus of texture image compression in 3d video coding | |
| US20140002599A1 (en) | Competition-based multiview video encoding/decoding device and method thereof | |
| WO2016000538A1 (en) | Video coding motion vector list construction method and system | |
| KR101747434B1 (en) | Apparatus and method for encoding and decoding motion information and disparity information | |
| KR100738867B1 (en) | Method for Coding and Inter-view Balanced Disparity Estimation in Multiview Animation Coding/Decoding System | |
| CN104995916B (en) | Video data decoding method and video data decoding device | |
| CN103503460A (en) | Motion vector prediction in video coding | |
| CN102801995B (en) | A kind of multi-view video motion based on template matching and disparity vector prediction method | |
| CN104412597A (en) | Method and apparatus of unified disparity vector derivation for 3d video coding | |
| KR101893559B1 (en) | Apparatus and method for encoding and decoding multi-view video | |
| CN103051894B (en) | A kind of based on fractal and H.264 binocular tri-dimensional video compression & decompression method | |
| KR20080114482A (en) | Method and apparatus for illumination compensation of multi-view video coding | |
| CN104798375A (en) | Method and apparatus of constrained disparity vector derivation in 3d video coding | |
| CN104919799A (en) | Method and apparatus of depth to disparity vector conversion for three-dimensional video coding | |
| KR20110124447A (en) | Apparatus and method for 3d video coding | |
| US20150245065A1 (en) | Apparatus and method for coding/decoding multi-view image | |
| CN103220532A (en) | Joint prediction encoding method and joint predication encoding system for stereoscopic video | |
| KR20070076356A (en) | Method and apparatus for coding and decoding of video sequence | |
| CN103765895A (en) | Encoding/decoding method and apparatus using a skip mode | |
| CN102263952B (en) | Quick fractal compression and decompression method for binocular stereo video based on object | |
| KR101078525B1 (en) | Method for coding of multi-view video | |
| KR20110136014A (en) | Apparatus and method for multi-view depth image coding/decoding | |
| CN104469387A (en) | Inheritance method for motion parameters among components in multi-view video coding | |
| KR20070076391A (en) | A method and apparatus for decoding/encoding a video signal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |