CN107872670A - A kind of 3D video coding-decoding methods, device, server, client and system - Google Patents
A kind of 3D video coding-decoding methods, device, server, client and system Download PDFInfo
- Publication number
- CN107872670A CN107872670A CN201711147794.4A CN201711147794A CN107872670A CN 107872670 A CN107872670 A CN 107872670A CN 201711147794 A CN201711147794 A CN 201711147794A CN 107872670 A CN107872670 A CN 107872670A
- Authority
- CN
- China
- Prior art keywords
- video data
- video
- frame
- eye
- right eye
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
Abstract
The invention discloses a kind of 3D video coding-decoding methods, device, server, client and system, the 3D method for video coding includes：Obtain the first left-eye video data and the first right eye video data of same frame of video in the first 3D video datas, and the first frame per second of the first 3D video datas；First left-eye video data and the first right eye video data are encoded as front and rear frame using the second frame per second, obtain the second left-eye video data and the second right eye video data；Mark will be inserted in second left-eye video data and the second right eye video data respectively, obtain the 2nd 3D video datas；2nd 3D video datas are sent to client.Technical solution of the present invention, the code check of transmission of video is reduced, decrease the requirement to network bandwidth.Meanwhile subsequent decoding mistake is avoided, user will not be watched and cause very big influence, and existing codec need not be modified, scheme is easy to implement quick.
Description
Technical field
The present invention relates to technical field of video processing, especially a kind of 3D method for video coding, device and server, 3D are regarded
Frequency coding/decoding method, device and client, 3D video coding and decoding systems.
Background technology
The critically important effect of 3D videos is exactly third dimension, because the parallax between right and left eyes generates so-called 3D effect.
Parallax has a certain limit, and the contents of actually right and left eyes is much like, especially less 3D videos of some parallaxes.Existing 3D
Video coding, it would be desirable to while render right and left eyes video data and encoded as a frame, that is, in the 3D video datas after encoding,
Include right and left eyes video data simultaneously in one frame.So, the code check that 3D video datas transmit in a network is higher, to network bandwidth
Pressure it is larger.
The content of the invention
A technical problem to be solved of the embodiment of the present invention is：The code check that 3D video datas transmit in a network compared with
Height, it is larger to the pressure of network bandwidth.
A kind of 3D method for video coding, device and server of the embodiment of the present invention, 3D video encoding/decoding methods, device and client
End, 3D video coding and decoding systems.The technical scheme is as follows：
First aspect according to embodiments of the present invention, there is provided a kind of 3D method for video coding, including：
The the first left-eye video data and the first right eye video data of same frame of video in the first 3D video datas are obtained, with
And the first frame per second of the first 3D video datas；
The first left-eye video data and the first right eye video data are compiled as front and rear frame using the second frame per second
Code, obtains the second left-eye video data and the second right eye video data；
Mark will be inserted in the second left-eye video data and the second right eye video data respectively, obtain the 2nd 3D videos
Data, the mark includes current frame number and the second left-eye video data are stated in expression and the second right eye video data corresponds to left eye
Or the information of right eye, belong to former same frame of video the second left-eye video data and the second right eye video data corresponding to present frame
Number identical；
The 2nd 3D video datas are sent to client.
Optionally, described will be inserted respectively in the second left-eye video data and the second right eye video data identifies, bag
Include：
The mark is inserted into the second left-eye video data and the second right eye video counts with supplemental enhancement information SEI
In.
Optionally,
Judge the form of the first 3D video datas；
When the first 3D video datas are MP4 forms, the mark is inserted into metadata metadata or additional
Enhancement information SEI position, when the first 3D video datas are transport stream TS form, the mark is inserted into additional increasing
Strong information SEI position.
Second aspect according to embodiments of the present invention, there is provided a kind of 3D video encoding/decoding methods, including：
The front and rear two frames video data in 3D video datas is received successively；
Judge whether the two frame video datas that receive are left-eye video data and right eye corresponding to former same frame of video
Video data；
When the two frame video datas received are the left-eye video data and right eye video counts corresponding to former same frame of video
According to when, by the two frames video data be individually placed to right and left eyes position carry out and meanwhile render.
Optionally, it is described to judge whether the two frame video datas that receive are left-eye video corresponding to former same frame of video
Data and right eye video data, including：
Extract the mark per frame video data respectively from the two frames video data, the mark includes current frame number
And represent that the video data corresponds to the information of left eye or right eye, belong to the second left-eye video data and second of former same frame of video
Current frame number corresponding to right eye video data is identical；
Determine whether the two frames video data corresponds to former same frame of video according to the mark.
Optionally,
Methods described also includes：
When the two frame video datas received do not correspond to the left-eye video data and right eye video of former same frame of video
During data, the one-frame video data formerly received in the two frames video data is abandoned.
The third aspect according to embodiments of the present invention, there is provided a kind of 3D video coding apparatus, including：
Acquisition module, for obtaining the first left-eye video data of same frame of video and first right side in the first 3D video datas
Eye video data, and the first frame per second of the first 3D video datas；
Coding module, for using the first left-eye video data and the first right eye video data as front and rear frame using the
Two frame per second are encoded, and obtain the second left-eye video data and the second right eye video data；
Module being inserted, being identified for will be inserted respectively in the second left-eye video data and the second right eye video data,
The 2nd 3D video datas are obtained, the mark includes current frame number and represents the second left-eye video data or the second right eye
Video data corresponds to the information of left eye or right eye, belongs to the second left-eye video data and the second right eye video of former same frame of video
Current frame number is identical corresponding to data；
Sending module, for the 2nd 3D video datas to be sent into client.
Optionally, the insertion module includes：
First insertion submodule, for the mark to be inserted into second left-eye video with supplemental enhancement information SEI
In data and the second right eye video data；
And/or
Judging submodule, for judging the form of the first 3D video datas；
Second insertion submodule, for when the first 3D video datas are MP4 forms, the mark to be inserted into member
Data metadata or supplemental enhancement information SEI position, when the first 3D video datas are transport stream TS form, by institute
State the position that mark is inserted into supplemental enhancement information SEI.
Fourth aspect according to embodiments of the present invention, there is provided a kind of 3D video decoders, including：
Receiving module, for two frame video datas before and after receiving successively in 3D video datas；
Judge module, for judging whether the two frame video datas that receive are to be regarded corresponding to the left eye of former same frame of video
Frequency evidence and right eye video data；
Rendering module, for being the left-eye video data corresponding to former same frame of video when the two frame video datas received
During with right eye video data, the two frames video data is individually placed to the progress of right and left eyes position while rendered.
Optionally, the judge module includes：
Extracting sub-module, for extracting the mark per frame video data, the mark respectively from the two frames video data
Knowledge includes current frame number and represents that the video data corresponds to the information of left eye or right eye, and belong to former same frame of video second is left
Current frame number corresponding to eye video data and the second right eye video data is identical；
Determination sub-module, for determining whether the two frames video data corresponds to former same video according to the mark
Frame；
And/or
Described device also includes：
Module is abandoned, for not corresponding to the left-eye video number of former same frame of video when the two frame video datas received
During according to right eye video data, the one-frame video data formerly received in the two frames video data is abandoned.
5th aspect according to embodiments of the present invention, there is provided a kind of 3D Video Coding Servers, including：The various embodiments described above
3D video coding apparatus.
6th aspect according to embodiments of the present invention, there is provided a kind of 3D videos decode client, including：The various embodiments described above
3D video decoders.
7th aspect according to embodiments of the present invention, there is provided a kind of 3D video coding and decoding systems, including：3D Video codings take
Business device and 3D videos decoding client,
The 3D Video Coding Servers, by the first left-eye video data of same frame of video in the first 3D video datas and
Frame is encoded using the second frame per second before and after first right eye video data is used as, and obtains the second left-eye video data and the second right eye
Video data；Mark, will obtain second will be inserted in the second left-eye video data and the second right eye video data respectively
3D video datas are sent to 3D videos decoding client；
The 3D videos decode client, receive the front and rear two frames video data in the 2nd 3D video datas successively,
When the two frame video datas received are left-eye video data and right eye video data corresponding to former same frame of video, by institute
Two frame video datas are stated to be individually placed to the progress of right and left eyes position while render.
In the embodiment of the present invention, encoded by frame before and after the right and left eyes video data in 3D video datas is carried out, it is each
Frame only transmits left-eye video data or right eye video data when transmitting, and reduces the code check of transmission of video, decreases to network
The requirement of bandwidth.
In addition, belong to a left side for which frame for identifying by being inserted to each frame left-eye video data or right eye video data
Eye or right eye mark so that during subsequent decoding, if there is frame losing, it may be determined that what is lost is the left eye or right eye number of which frame
According to, while the left eye for belonging to same frame or right eye data can be abandoned, subsequent decoding mistake is avoided, user will not be watched and caused
Very big influence.Meanwhile existing codec need not be modified, scheme is easy to implement quick.
Below by drawings and examples, technical scheme is described in further detail.
Brief description of the drawings
The accompanying drawing of a part for constitution instruction describes embodiments of the invention, and is used to explain together with description
The principle of the present invention.
Referring to the drawings, according to following detailed description, the present invention can be more clearly understood, wherein：
Fig. 1 is the flow chart of the 3D method for video coding shown in the embodiment of the present invention；
Fig. 2 is the schematic diagram of the 3D video code models of prior art；
Fig. 3 is the schematic diagram of the 3D video code models shown in the embodiment of the present invention；
Fig. 4 is the flow chart of the 3D video encoding/decoding methods shown in the embodiment of the present invention；
Fig. 5 is the block diagram of the 3D video coding apparatus shown in the embodiment of the present invention；
Fig. 6 a are the block diagrams of the insertion module 53 shown in the embodiment of the present invention；
Fig. 6 b are the block diagrams of the insertion module 53 shown in another embodiment of the present invention；
Fig. 7 is the block diagram of the 3D video decoders shown in the embodiment of the present invention；
Fig. 8 is the block diagram of the judge module 72 shown in the embodiment of the present invention；
Fig. 9 is the block diagram of the 3D video decoders shown in another embodiment of the present invention.
Embodiment
The various exemplary embodiments of the present invention are described in detail now with reference to accompanying drawing.It should be noted that：Unless have in addition
Body illustrates that the unlimited system of part and the positioned opposite of step, numerical expression and the numerical value otherwise illustrated in these embodiments is originally
The scope of invention.
Simultaneously, it should be appreciated that for the ease of description, the size of the various pieces shown in accompanying drawing is not according to reality
Proportionate relationship draw.
The description only actually at least one exemplary embodiment is illustrative to be never used as to the present invention below
And its application or any restrictions that use.
It may be not discussed in detail for technology, method and apparatus known to person of ordinary skill in the relevant, but suitable
In the case of, the technology, method and apparatus should be considered as part for specification.
It should be noted that：Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi
It is defined, then it need not be further discussed in subsequent accompanying drawing in individual accompanying drawing.
The embodiment of the present invention can apply to computer system/server, and it can be with numerous other universal or special calculating
System environments or configuration operate together.Suitable for be used together with computer system/server well-known computing system, ring
The example of border and/or configuration includes but is not limited to：Personal computer system, server computer system, thin client, thick client
Machine, hand-held or laptop devices, the system based on microprocessor, set top box, programmable consumer electronics, NetPC Network PC,
Little types Ji calculates machine Xi Tong ﹑ large computer systems and the distributed cloud computing technology environment including any of the above described system, etc..
Computer system/server can be in computer system executable instruction (such as journey performed by computer system
Sequence module) general linguistic context under describe.Generally, program module can include routine, program, target program, component, logic, number
According to structure etc., they perform specific task or realize specific abstract data type.Computer system/server can be with
Implement in distributed cloud computing environment, in distributed cloud computing environment, task is by by the long-range of communication network links
Manage what equipment performed.In distributed cloud computing environment, program module can be located at the Local or Remote meter for including storage device
In calculation system storage medium.
Existing 3D Video codings, it would be desirable to while render right and left eyes video data and encoded as a frame, that is, after encoding
3D video datas in, in a frame simultaneously include right and left eyes video data.In order to reduce code check, while adapt to existing coding mark
Standard, the right and left eyes video data of same frame is encoded as front and rear frame in the embodiment of the present invention.
Fig. 1 is the flow chart of the 3D method for video coding shown in the embodiment of the present invention.As shown in figure 1, the 3D Video codings
Method comprises the following steps：
Step S11, obtain the first left-eye video data of same frame of video and the first right eye in the first 3D video datas and regard
Frequency evidence, and the first frame per second of the first 3D video datas.
Fig. 2 is the schematic diagram of the 3D video code models of prior art.As shown in Fig. 2 in existing 3D video datas, each
In frame of video 21,22,23,24,25 ..., respectively including left-eye video data and right eye video data.So, in transmission,
The right and left eyes video data simultaneous transmission of each frame so that the code check of transmission of video is higher, larger to network bandwidth pressure.
Step S12, the first left-eye video data and the first right eye video data are entered as front and rear frame using the second frame per second
Row coding, obtains the second left-eye video data and the second right eye video data.Wherein, the second frame per second is twice of the first frame per second.
Fig. 3 is the schematic diagram of the 3D video code models shown in the embodiment of the present invention.As shown in figure 3, after recompiling
The right and left eyes video data of 3D video datas using original each frame is transmitted as a single frame.For example, by Fig. 2
The left-eye video data of first frame 21 are as the first new frame 31, and the right eye video data of the first frame 21 is as the newly in Fig. 2
Two frames 32, the left-eye video data of the second frame 22 are as the 3rd new frame 33 in Fig. 2, the right eye video counts of the second frame 22 in Fig. 2
According to as the 4th new frame 34, by that analogy, to the right and left eyes video datas of all frames in former 3D video datas all in this way
Coding.
In the present embodiment, the left-eye video data of former same frame can be placed on before right eye video data, can also incited somebody to action
Former same frame right eye video data is placed on before the video data of left and right.
X.265 wherein, X.264 coded system can use, the coded system such as.
Step S13, identified being inserted respectively in the second left-eye video data and the second right eye video data, obtain the 2nd 3D
Video data, mark include current frame number and represent that the second left-eye video data or the second right eye video data correspond to left eye
Or the information of right eye, belong to former same frame of video the second left-eye video data and the second right eye video data corresponding to present frame
Number identical.
Due to being encoded right and left eyes video data as single frame, therefore, it is required for marking for each frame
Remember this is the left-eye video data or right eye video data of which original frame.
For example, left-eye video data are represented with 0, right eye video data is represented with 1., can ought for the first frame 31 in Fig. 3
Preceding frame number is set to 0001, then is inserted into the first frame 31 and is identified as 00010.For the second frame 32 in Fig. 3, due to itself and
One frame 31 belongs to former same frame of video, and device current frame number is still 0001, then is inserted into the second frame 32 and is identified as 00011.
For the 3rd frame 33 in Fig. 3, current frame number can be set to 0002, then be inserted into the 3rd frame 33 and be identified as 00020.For
4th frame 34 in Fig. 3, current frame number 0002, then it is inserted into the 4th frame 34 and is identified as 00021.By that analogy, can be with
Obtain the mark that every one-frame video data needs to insert.
Step S14, the 2nd 3D video datas are sent to client.
Client in the embodiment of the present invention can be the application journey with 3D video decoding functions in terminal
Sequence.
In another embodiment, in step S13, will can identify with supplemental enhancement information (Supplemental
Enhancement information, SEI) it is inserted into the second left-eye video data and the second right eye video data.
Wherein, SEI is one of major part defined in H264 standards, for aid in treatment decoding, display and other mesh
Etc..
In another embodiment, the 3D video datas of different-format can also be directed to, mark is inserted into diverse location.
Judge the form of the first 3D video datas, when the first 3D video datas are MP4 forms, mark is inserted into first number
According to (metadata) or SEI position, when the first 3D video datas are transport stream (Transport stream, TS) form,
The position for being inserted into SEI will be identified.
Wherein, metadata is also known as broker data, relaying data, to describe the data (data about data) of data,
Data attribute (property) information is mainly described, for support as instruction storage location, historical data, resource lookup,
The functions such as file record.
In the present embodiment, encoded by frame before and after the right and left eyes video data in 3D video datas is carried out, each frame passes
Left-eye video data or right eye video data are only transmitted when defeated, the code check of transmission of video is reduced, decreases to network bandwidth
Requirement.
In addition, belong to a left side for which frame for identifying by being inserted to each frame left-eye video data or right eye video data
Eye or right eye mark so that during subsequent decoding, if there is frame losing, it may be determined that what is lost is the left eye or right eye number of which frame
According to, while the left eye for belonging to same frame or right eye data can be abandoned, subsequent decoding mistake is avoided, user will not be watched and caused
Very big influence.Meanwhile existing codec need not be modified, scheme is easy to implement quick.
The present invention also provides the 3D video encoding/decoding method corresponding with 3D method for video coding.
Fig. 4 is the flow chart of the 3D video encoding/decoding methods shown in the embodiment of the present invention.As shown in figure 4, the 3D videos decode
Method includes：
Step S41, the front and rear two frames video data in 3D video datas is received successively.
Whether step S42, the two frame video datas for judging to receive are left-eye video number corresponding to former same frame of video
According to right eye video data.
Wherein it is possible to extract the mark per frame video data respectively from two frame video datas, mark includes present frame volume
Number and represent that the video data corresponds to the information of left eye or right eye, belong to the second left-eye video data and the of former same frame of video
Current frame number corresponding to two right eye video datas is identical.
Determine whether two frame video datas correspond to former same frame of video according to mark.
For example, as it is known that left-eye video data are represented with 0, right eye video data is represented with 1.The two frame video datas received
Mark be respectively 00280 and 00281, then it was determined that the two frames video data is respectively corresponding former same frame of video 0028
Right and left eyes video data.
In another example the mark of the two frame video datas received is respectively 00280 and 00290, then it was determined that two frame
Video data corresponds to former frame of video 00028 and 00029 respectively, is not belonging to former same frame of video.
Step S43, when the two frame video datas received are left-eye video data and the right side corresponding to former same frame of video
During eye video data, two frame video datas are individually placed to the progress of right and left eyes position while rendered.
In another embodiment, when the two frame video datas received do not correspond to the left-eye video of former same frame of video
When data and right eye video data, the one-frame video data formerly received in two frame video datas is abandoned.
For example, when the mark of the two frame video datas received is respectively 00280 and 00290, that is, it is identified as 00280
Video data is the left-eye video data of former frame of video 0028, lacks the right eye video data of former frame of video 0028, therefore, will mark
Know and abandoned for 00280 video data.
In the present embodiment, encoded by frame before and after the right and left eyes video data in 3D video datas is carried out, each frame passes
Left-eye video data or right eye video data are only transmitted when defeated, the code check of transmission of video is reduced, decreases to network bandwidth
Requirement.
In addition, belong to a left side for which frame for identifying by being inserted to each frame left-eye video data or right eye video data
Eye or right eye mark so that during decoding, if there is frame losing, it may be determined that what is lost is the left eye or right eye data of which frame,
The left eye for belonging to same frame or right eye data can be abandoned simultaneously, avoid subsequent decoding mistake, user will not watched and caused very
Big influence.Meanwhile existing codec need not be modified, scheme is easy to implement quick.
Following is apparatus of the present invention embodiment, can be used for performing the inventive method embodiment.
Fig. 5 is the block diagram of the 3D video coding apparatus shown in the embodiment of the present invention, the device can by software, hardware or
Both persons' is implemented in combination with as some or all of of electronic equipment.As shown in figure 5, the 3D video coding apparatus, including：
Acquisition module 51, for obtaining the first left-eye video data and first of same frame of video in the first 3D video datas
Right eye video data, and the first frame per second of the first 3D video datas.
Coding module 52, for the first left-eye video data and the first right eye video data to be used as front and rear frame
Second frame per second is encoded, and obtains the second left-eye video data and the second right eye video data.
Module 53 is inserted, for by insertion is marked respectively in the second left-eye video data and the second right eye video data
Know, obtain the 2nd 3D video datas, the mark includes current frame number and represents the second left-eye video data or the second right eye
Video data corresponds to the information of left eye or right eye, belongs to the second left-eye video data and the second right eye video of former same frame of video
Current frame number is identical corresponding to data.
Sending module 54, for the 2nd 3D video datas to be sent into client.
Fig. 6 a are the block diagrams of the insertion module 53 shown in the embodiment of the present invention, and as shown in Figure 6 a, insertion module 53 can wrap
Include：
First insertion submodule 61, is regarded for the mark to be inserted into second left eye with supplemental enhancement information SEI
In frequency evidence and the second right eye video data.
Fig. 6 b are the block diagrams of the insertion module 53 shown in another embodiment of the present invention, as shown in Figure 6 b, the insertion module 53
It can include：
Judging submodule 62, for judging the form of the first 3D video datas.
Second insertion submodule 63, for when the first 3D video datas are MP4 forms, the mark to be inserted into
Metadata or SEI position, when the first 3D video datas are TS forms, the mark is inserted into SEI position.
Fig. 7 is the block diagram of the 3D video decoders shown in the embodiment of the present invention, the device can by software, hardware or
Both persons' is implemented in combination with as some or all of of electronic equipment.As shown in fig. 7, the 3D video decoders, including：
Receiving module 71, for two frame video datas before and after receiving successively in 3D video datas.
Judge module 72, for judging whether the two frame video datas that receive are left eye corresponding to former same frame of video
Video data and right eye video data.
Rendering module 73, for being the left-eye video number corresponding to former same frame of video when the two frame video datas received
During according to right eye video data, two frame video datas are individually placed to the progress of right and left eyes position while rendered.
Fig. 8 is the block diagram of the judge module 72 shown in the embodiment of the present invention, as shown in figure 8, judge module 72 includes：
Extracting sub-module 81, for extracting the mark per frame video data respectively from two frame video datas, mark includes
Current frame number and represent that the video data corresponds to the information of left eye or right eye, belong to the second left-eye video of former same frame of video
Data are identical with current frame number corresponding to the second right eye video data.
Determination sub-module 82, for determining whether two frame video datas correspond to former same frame of video according to mark.
Fig. 9 is the block diagram of the 3D video decoders shown in another embodiment of the present invention, as shown in figure 9, the device also wraps
Include：
Module 74 is abandoned, for not corresponding to the left-eye video of former same frame of video when the two frame video datas received
When data and right eye video data, the one-frame video data formerly received in two frame video datas is abandoned.
The embodiment of the present invention also provides a kind of 3D Video Coding Servers, including：The 3D Video codings of the various embodiments described above
Device.
Also a kind of 3D videos decoding client of the embodiment of the present invention, including：The 3D video decoders of the various embodiments described above.
Also a kind of 3D video coding and decoding systems of the embodiment of the present invention, including：3D Video Coding Servers and the decoding of 3D videos
Client.
3D Video Coding Servers, by the first left-eye video data and first of same frame of video in the first 3D video datas
Frame is encoded using the second frame per second before and after right eye video data is used as, and obtains the second left-eye video data and the second right eye video
Data；Mark, the 2nd 3D video counts that will be obtained will be inserted in second left-eye video data and the second right eye video data respectively
Client is decoded according to 3D videos are sent to.
3D videos decode client, the front and rear two frames video data in the 2nd 3D video datas are received successively, when receiving
Two frame video datas when being the left-eye video data and right eye video data corresponding to former same frame of video, by two frame video counts
According to be individually placed to right and left eyes position carry out and meanwhile render.
In the embodiment of the present invention, encoded by frame before and after the right and left eyes video data in 3D video datas is carried out, it is each
Frame only transmits left-eye video data or right eye video data when transmitting, and reduces the code check of transmission of video, decreases to network
The requirement of bandwidth.
In addition, belong to a left side for which frame for identifying by being inserted to each frame left-eye video data or right eye video data
Eye or right eye mark so that during subsequent decoding, if there is frame losing, it may be determined that what is lost is the left eye or right eye number of which frame
According to, while the left eye for belonging to same frame or right eye data can be abandoned, subsequent decoding mistake is avoided, user will not be watched and caused
Very big influence.Meanwhile existing codec need not be modified, scheme is easy to implement quick.
Each embodiment is described by the way of progressive in this specification, what each embodiment stressed be and its
The difference of its embodiment, same or analogous part cross-reference between each embodiment.For system embodiment
For, because it is substantially corresponding with embodiment of the method, so description is fairly simple, referring to the portion of embodiment of the method in place of correlation
Defend oneself bright.
The method and system of the present invention may be achieved in many ways.For example, can by software, hardware, firmware or
Software, hardware, firmware any combinations come realize the present invention method and system.The said sequence of the step of for methods described
Order described in detail above is not limited to merely to illustrate, the step of method of the invention, it is special unless otherwise
Do not mentionlet alone bright.In addition, in certain embodiments, the present invention can be also embodied as recording program in the recording medium, these programs
Including the machine readable instructions for realizing the method according to the invention.Thus, the present invention also covering storage is used to perform basis
The recording medium of the program of the method for the present invention.
Description of the invention provides for the sake of example and description, and is not exhaustively or by the present invention
It is limited to disclosed form.Many modifications and variations are obvious for the ordinary skill in the art.Select and retouch
State embodiment and be to more preferably illustrate the principle and practical application of the present invention, and one of ordinary skill in the art is managed
The present invention is solved so as to design the various embodiments with various modifications suitable for special-purpose.
Claims (13)
- A kind of 1. 3D method for video coding, it is characterised in that including：Obtain the first left-eye video data and the first right eye video data of same frame of video in the first 3D video datas, Yi Jisuo State the first frame per second of the first 3D video datas；The first left-eye video data and the first right eye video data are encoded as front and rear frame using the second frame per second, obtained To the second left-eye video data and the second right eye video data；Mark will be inserted in the second left-eye video data and the second right eye video data respectively, obtain the 2nd 3D video counts According to the mark includes current frame number and represents that the second left-eye video data and the second right eye video data correspond to left eye Or the information of right eye, belong to former same frame of video the second left-eye video data and the second right eye video data corresponding to present frame Number identical；The 2nd 3D video datas are sent to client.
- 2. according to the method for claim 1, it is characterised in that described by the second left-eye video data and the second right eye Insertion identifies respectively in video data, including：The mark is inserted into the second left-eye video data and the second right eye video data with supplemental enhancement information SEI In.
- 3. method according to claim 1 or 2, it is characterised in that described by the second left-eye video data and second Insertion mark also includes respectively in right eye video data：Judge the form of the first 3D video datas；When the first 3D video datas are MP4 forms, the mark is inserted into metadata metadata or additional enhancings Information SEI position；When the first 3D video datas are transport stream TS form, the mark is inserted into supplemental enhancement information SEI position Put.
- A kind of 4. 3D video encoding/decoding methods, it is characterised in that including：The front and rear two frames video data in 3D video datas is received successively；Judge whether the two frame video datas that receive are left-eye video data and right eye video corresponding to former same frame of video Data；When the two frame video datas received are left-eye video data and right eye video data corresponding to former same frame of video, The two frames video data is individually placed to the progress of right and left eyes position while rendered.
- 5. according to the method for claim 4, it is characterised in that whether the two frame video datas for judging to receive are pair The left-eye video data and right eye video data of the same frame of video of Ying Yuyuan, including：Extract the mark per frame video data respectively from the two frames video data, the mark includes current frame number and table Show that the video data corresponds to the information of left eye or right eye, belong to the second left-eye video data and the second right eye of former same frame of video Current frame number is identical corresponding to video data；Determine whether the two frames video data corresponds to former same frame of video according to the mark.
- 6. the method according to claim 4 or 5, it is characterised in that methods described also includes：When the two frame video datas received do not correspond to the left-eye video data and right eye video data of former same frame of video When, abandon the one-frame video data formerly received in the two frames video data.
- A kind of 7. 3D video coding apparatus, it is characterised in that including：Acquisition module, regarded for obtaining the first left-eye video data of same frame of video and the first right eye in the first 3D video datas Frequency evidence, and the first frame per second of the first 3D video datas；Coding module, for the first left-eye video data and the first right eye video data to be used into the second frame as front and rear frame Rate is encoded, and obtains the second left-eye video data and the second right eye video data；Module is inserted, identifying, obtaining for will be inserted respectively in the second left-eye video data and the second right eye video data 2nd 3D video datas, the mark include current frame number and represent the second left-eye video data or the second right eye video Data correspond to the information of left eye or right eye, belong to the second left-eye video data and the second right eye video data of former same frame of video Corresponding current frame number is identical；Sending module, for the 2nd 3D video datas to be sent into client.
- 8. device according to claim 7, it is characterised in that the insertion module includes：First insertion submodule, for the mark to be inserted into the second left-eye video data with supplemental enhancement information SEI In the second right eye video data；And/orJudging submodule, for judging the form of the first 3D video datas；Second insertion submodule, for when the first 3D video datas are MP4 forms, the mark to be inserted into metadata Metadata or supplemental enhancement information SEI position, when the first 3D video datas are transport stream TS form, by the mark Know the position for being inserted into supplemental enhancement information SEI.
- A kind of 9. 3D video decoders, it is characterised in that including：Receiving module, for two frame video datas before and after receiving successively in 3D video datas；Judge module, for judging whether the two frame video datas that receive are left-eye video number corresponding to former same frame of video According to right eye video data；Rendering module, for being left-eye video data and the right side corresponding to former same frame of video when the two frame video datas received During eye video data, the two frames video data is individually placed to the progress of right and left eyes position while rendered.
- 10. device according to claim 9, it is characterised in that the judge module includes：Extracting sub-module, for extracting the mark per frame video data, the mark bag respectively from the two frames video data Include current frame number and represent that the video data corresponds to the information of left eye or right eye, the second left eye for belonging to former same frame of video regards Frequency evidence is identical with current frame number corresponding to the second right eye video data；Determination sub-module, for determining whether the two frames video data corresponds to former same frame of video according to the mark；And/orDescribed device also includes：Abandon module, for do not corresponded to when the two frame video datas that receive former same frame of video left-eye video data and During right eye video data, the one-frame video data formerly received in the two frames video data is abandoned.
- A kind of 11. 3D Video Coding Servers, it is characterised in that including：3D Video codings described in the claims 5 or 6 Device.
- 12. a kind of 3D videos decode client, it is characterised in that including：3D videos decoding described in the claims 7 or 8 Device.
- A kind of 13. 3D video coding and decoding systems, it is characterised in that including：3D Video coding services described in the claims 9 3D videos decoding client described in device and the claims 10,The 3D Video Coding Servers, by the first left-eye video data and first of same frame of video in the first 3D video datas Frame is encoded using the second frame per second before and after right eye video data is used as, and obtains the second left-eye video data and the second right eye video Data；Mark will be inserted in the second left-eye video data and the second right eye video data respectively, the 2nd obtained 3D is regarded Frequency decodes client according to 3D videos are sent to；The 3D videos decode client, receive the front and rear two frames video data in the 2nd 3D video datas successively, when connecing When the two frame video datas received are the left-eye video data and right eye video data corresponding to former same frame of video, by described two Frame video data is individually placed to right and left eyes position and carries out while render.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711147794.4A CN107872670A (en) | 2017-11-17 | 2017-11-17 | A kind of 3D video coding-decoding methods, device, server, client and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711147794.4A CN107872670A (en) | 2017-11-17 | 2017-11-17 | A kind of 3D video coding-decoding methods, device, server, client and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107872670A true CN107872670A (en) | 2018-04-03 |
Family
ID=61754061
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711147794.4A Pending CN107872670A (en) | 2017-11-17 | 2017-11-17 | A kind of 3D video coding-decoding methods, device, server, client and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107872670A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022142757A1 (en) * | 2020-12-30 | 2022-07-07 | 北京金山云网络技术有限公司 | Video processing method and apparatus, electronic device, and computer readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100165079A1 (en) * | 2008-12-26 | 2010-07-01 | Kabushiki Kaisha Toshiba | Frame processing device, television receiving apparatus and frame processing method |
| CN102210155A (en) * | 2009-06-29 | 2011-10-05 | 索尼公司 | Stereoscopic image data transmitter and method for transmitting stereoscopic image data |
| CN102215405A (en) * | 2011-06-01 | 2011-10-12 | 深圳创维－Rgb电子有限公司 | 3D (three-dimensional) video signal compression coding-decoding method, device and system |
| CN102780894A (en) * | 2012-05-31 | 2012-11-14 | 新奥特（北京）视频技术有限公司 | Method for coding/decoding three-dimensional (3D) images |
| CN104041023A (en) * | 2011-09-29 | 2014-09-10 | 杜比实验室特许公司 | Dual-layer frame-compatible full-resolution stereoscopic 3D video delivery |
-
2017
- 2017-11-17 CN CN201711147794.4A patent/CN107872670A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100165079A1 (en) * | 2008-12-26 | 2010-07-01 | Kabushiki Kaisha Toshiba | Frame processing device, television receiving apparatus and frame processing method |
| CN102210155A (en) * | 2009-06-29 | 2011-10-05 | 索尼公司 | Stereoscopic image data transmitter and method for transmitting stereoscopic image data |
| CN102215405A (en) * | 2011-06-01 | 2011-10-12 | 深圳创维－Rgb电子有限公司 | 3D (three-dimensional) video signal compression coding-decoding method, device and system |
| CN104041023A (en) * | 2011-09-29 | 2014-09-10 | 杜比实验室特许公司 | Dual-layer frame-compatible full-resolution stereoscopic 3D video delivery |
| CN102780894A (en) * | 2012-05-31 | 2012-11-14 | 新奥特（北京）视频技术有限公司 | Method for coding/decoding three-dimensional (3D) images |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022142757A1 (en) * | 2020-12-30 | 2022-07-07 | 北京金山云网络技术有限公司 | Video processing method and apparatus, electronic device, and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101273635B (en) | Apparatus and method for encoding and decoding multi-view picture using camera parameter, and recording medium storing program for executing the method | |
| CN104185998B (en) | The method and system controlled for the cryptographic acess of video | |
| CN101563925B (en) | Video processing of decoder-side region of interest | |
| CN102333201B (en) | Telepresence caption transmission method, terminal and system | |
| CA2727571A1 (en) | Machine-readable representation of geographic information | |
| CN103618911B (en) | Video streaming providing method and device based on video attribute information | |
| CN111510752B (en) | Data transmission method, device, server and storage medium | |
| US10979689B2 (en) | Adaptive stereo scaling format switch for 3D video encoding | |
| CN105554430A (en) | Video call method, system and device | |
| CN107241585B (en) | Video monitoring method and system | |
| US20080025553A1 (en) | Apparatus, method, and article of manufacture used to encode information into an image and to decode information from a captured image | |
| WO2013152784A1 (en) | Method and apparatus for providing a display position of a display object and for displaying a display object in a three-dimensional scene | |
| CN107872670A (en) | A kind of 3D video coding-decoding methods, device, server, client and system | |
| CN107396082A (en) | A kind for the treatment of method and apparatus of view data | |
| CN112488964B (en) | Image processing method, related device, equipment and medium for sliding list | |
| CN110891195B (en) | Method, device and equipment for generating screen image and storage medium | |
| Hossain et al. | A Symbiotic Digital Signage system based on display to display communication | |
| CN105677270B (en) | For the method and apparatus of the post processing of video flowing | |
| CN109644284B (en) | Transmission device, transmission method, reception device, and reception method | |
| CN110753243A (en) | Image processing method, image processing server and image processing system | |
| CN103959796B (en) | The coding/decoding method joining method and device of digital video bit stream | |
| US20160057431A1 (en) | Method and device for transmitting a sequence of pictures, and corresponding method and device for reception, computer program and recording medium | |
| CN113206888B (en) | Real-time video streaming transmission method and device based on RTSP (real time streaming protocol) | |
| CN108900928A (en) | Method and device, the 3D screen client, Streaming Media Cloud Server of naked eye 3D live streaming | |
| EP3637734B1 (en) | Video data display method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |