CN112218066A - VR video encoding and decoding method and device - Google Patents
VR video encoding and decoding method and device Download PDFInfo
- Publication number
- CN112218066A CN112218066A CN202011313825.0A CN202011313825A CN112218066A CN 112218066 A CN112218066 A CN 112218066A CN 202011313825 A CN202011313825 A CN 202011313825A CN 112218066 A CN112218066 A CN 112218066A
- Authority
- CN
- China
- Prior art keywords
- video frame
- video
- sequence
- time sequence
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 238000000605 extraction Methods 0.000 claims 1
- 230000005540 biological transmission Effects 0.000 description 7
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a VR video encoding and decoding method and a device, wherein the VR video encoding and decoding method comprises the steps of carrying out time sequence calibration on a first video frame to generate a first time sequence, and carrying out time sequence calibration on a second video frame to generate a second time sequence; comparing the video frames in the first video frame and the second video frame; matching the first time sequence value of the first video frame of the same picture and the second time sequence value of the second video to generate a combined time sequence value; encoding the combined time sequence value and the first video frame to generate a video code stream; outputting a video code stream; the method has the advantages of improving the coding efficiency, reducing the calculation consumption of coding and decoding and saving the time consumed by coding and decoding.
Description
Technical Field
The present invention relates to the field of video processing technologies, and in particular, to a VR video encoding and decoding method and apparatus.
Background
With the development of video processing technology, the requirements of video processing are higher and higher, and especially the requirements on the aspect of encoding VR (Virtual Reality) video are higher. The left eye video and the right eye video are projected to the corresponding left eye and right eye respectively, and the left eye video and the right eye video have parallax, so that a user can feel the effect of a three-dimensional picture.
In the VR video encoding technology, the left-eye video and the right-eye video need to be kept extremely high in synchronization, and if the left-eye video and the right-eye video are encoded and decoded respectively, it is difficult to ensure the synchronization during playing, and larger transmission bandwidth, calculation resources and storage space are occupied. The coded video data occupies a large storage space, which results in more transmission bandwidth and transmission time consumed in the transmission and sending process, thereby reducing the coding efficiency of the video.
Therefore, the present invention provides a VR video encoding and decoding method and apparatus to solve the above problems.
Disclosure of Invention
The invention aims to solve the technical problems that the existing VR coding efficiency is low, and the coded video data occupies larger storage space, more computing resources and larger transmission bandwidth;
provided are a video coding and decoding method and device for VR, wherein the video coding and decoding method for VR comprises the following steps:
performing time sequence calibration on the first video frame to generate a first time sequence, and performing time sequence calibration on the second video frame to generate a second time sequence;
comparing the video frames in the first video frame and the second video frame;
matching the first time sequence value of the first video frame of the same picture and the second time sequence value of the second video to generate a combined time sequence value;
encoding the combined time sequence value and the first video frame to generate a video code stream;
and outputting the video code stream.
Further, the comparing the video frames in the first video frame and the second video frame includes:
for each video frame in the first video frame sequence, moving a corresponding video frame in a second video frame sequence;
matching a second timing value of a second video frame with the same video frame as the first video frame with the first timing value;
a combined sequence value is generated.
Further, the outputting the video code stream includes:
sending the video code stream to a playing terminal;
enabling the playing terminal to extract a first video frame sequence and a combined sequence value in the video code stream;
restoring a second sequence of video frames from the extracted first sequence of video frames and the combined sequence value;
and playing the extracted first video frame sequence and the restored second video frame sequence.
In another aspect, the present invention further provides a video encoding and decoding apparatus for a VR, where the video encoding and decoding apparatus for the VR includes:
the time sequence calibration module is used for carrying out time sequence calibration on the first video frame to generate a first time sequence and carrying out time sequence calibration on the second video frame to generate a second time sequence;
the video frame comparison module is used for comparing the video frames in the first video frame and the second video frame;
the time sequence value generating module is used for matching a first time sequence value of a first video frame of the same picture and a second time sequence value of a second video to generate a combined time sequence value;
the code stream generation module is used for encoding the combined timing sequence value and the first video frame to generate a video code stream;
and the playing decoding module is used for outputting the video code stream.
Furthermore, the playing decoding module comprises a video frame and time sequence extracting unit, a video frame restoring unit and a playing unit;
a video frame and time sequence extracting unit, configured to enable the playing terminal to extract a first video frame sequence and a combined sequence value in the video code stream;
a video frame restoration unit for restoring a second video frame sequence based on the extracted first video frame sequence and the combined sequence value;
and the playing unit is used for playing the extracted first video frame sequence and the restored second video frame sequence.
The implementation of the invention has the following beneficial effects:
1. according to the invention, the first video frame sequence and the second video frame sequence used for generating the visual three-dimensional picture are obtained, and encoding processing is carried out according to the time sequences, so that excessive operation resources are avoided being consumed, the operation time is saved, and the encoding speed of the video is improved.
Drawings
FIG. 1 is a flow chart of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the accompanying drawings.
Examples
In the present embodiment, referring to fig. 1 of the specification, the technical problem to be solved by the present embodiment is: the existing VR coding efficiency is low, and the coded video data occupies a larger storage space, more computing resources and larger transmission bandwidth;
provided are a video coding and decoding method and device for VR, wherein the video coding and decoding method for VR comprises the following steps:
performing time sequence calibration on the first video frame to generate a first time sequence, and performing time sequence calibration on the second video frame to generate a second time sequence;
comparing the video frames in the first video frame and the second video frame;
matching the first time sequence value of the first video frame of the same picture and the second time sequence value of the second video to generate a combined time sequence value;
encoding the combined time sequence value and the first video frame to generate a video code stream;
and outputting the video code stream.
In a specific embodiment, the comparing the video frames in the first video frame and the second video frame includes:
for each video frame in the first video frame sequence, moving a corresponding video frame in a second video frame sequence;
matching a second timing value of a second video frame with the same video frame as the first video frame with the first timing value;
a combined sequence value is generated.
In a specific embodiment, the outputting the video bitstream includes:
sending the video code stream to a playing terminal;
enabling the playing terminal to extract a first video frame sequence and a combined sequence value in the video code stream;
restoring a second sequence of video frames from the extracted first sequence of video frames and the combined sequence value;
and playing the extracted first video frame sequence and the restored second video frame sequence.
The VR video coding and decoding method is implemented according to the principle that:
performing time sequence calibration on the first video frame to generate a first time sequence, and performing time sequence calibration on the second video frame to generate a second time sequence;
for each video frame in the first video frame sequence, moving a corresponding video frame in a second video frame sequence;
matching a second timing value of a second video frame with the same video frame as the first video frame with the first timing value;
generating a combined sequence value;
encoding the combined time sequence value and the first video frame to generate a video code stream;
sending the video code stream to a playing terminal;
enabling the playing terminal to extract a first video frame sequence and a combined sequence value in the video code stream;
restoring a second sequence of video frames from the extracted first sequence of video frames and the combined sequence value;
and playing the extracted first video frame sequence and the restored second video frame sequence.
The implementation of the invention has the following beneficial effects:
1. according to the invention, the first video frame sequence and the second video frame sequence used for generating the visual three-dimensional picture are obtained, and encoding processing is carried out according to the time sequences, so that excessive operation resources are avoided being consumed, the operation time is saved, and the encoding speed of the video is improved.
Examples
In the present embodiment, referring to fig. 1 of the specification, the technical problem to be solved by the present embodiment is: the existing VR coding efficiency is low, and the coded video data occupies a larger storage space, more computing resources and larger transmission bandwidth;
provided are a video coding and decoding method and device for VR, wherein the video coding and decoding method for VR comprises the following steps:
performing time sequence calibration on the first video frame to generate a first time sequence, and performing time sequence calibration on the second video frame to generate a second time sequence;
comparing the video frames in the first video frame and the second video frame;
matching the first time sequence value of the first video frame of the same picture and the second time sequence value of the second video to generate a combined time sequence value;
encoding the combined time sequence value and the first video frame to generate a video code stream;
and outputting the video code stream.
In a specific embodiment, the comparing the video frames in the first video frame and the second video frame includes:
for each video frame in the first video frame sequence, moving a corresponding video frame in a second video frame sequence;
matching a second timing value of a second video frame with the same video frame as the first video frame with the first timing value;
a combined sequence value is generated.
In a specific embodiment, the outputting the video bitstream includes:
sending the video code stream to a playing terminal;
enabling the playing terminal to extract a first video frame sequence and a combined sequence value in the video code stream;
restoring a second sequence of video frames from the extracted first sequence of video frames and the combined sequence value;
and playing the extracted first video frame sequence and the restored second video frame sequence.
In another aspect, the present invention further provides a video encoding and decoding apparatus for a VR, where the video encoding and decoding apparatus for the VR includes:
the time sequence calibration module is used for carrying out time sequence calibration on the first video frame to generate a first time sequence and carrying out time sequence calibration on the second video frame to generate a second time sequence;
the video frame comparison module is used for comparing the video frames in the first video frame and the second video frame;
the time sequence value generating module is used for matching a first time sequence value of a first video frame of the same picture and a second time sequence value of a second video to generate a combined time sequence value;
the code stream generation module is used for encoding the combined timing sequence value and the first video frame to generate a video code stream;
and the playing decoding module is used for outputting the video code stream.
In a specific embodiment, the playing decoding module includes a video frame and timing sequence extracting unit, a video frame restoring unit and a playing unit;
a video frame and time sequence extracting unit, configured to enable the playing terminal to extract a first video frame sequence and a combined sequence value in the video code stream;
a video frame restoration unit for restoring a second video frame sequence based on the extracted first video frame sequence and the combined sequence value;
and the playing unit is used for playing the extracted first video frame sequence and the restored second video frame sequence.
The VR video coding and decoding method is implemented according to the principle that:
performing time sequence calibration on the first video frame to generate a first time sequence, and performing time sequence calibration on the second video frame to generate a second time sequence;
for each video frame in the first video frame sequence, moving a corresponding video frame in a second video frame sequence;
matching a second timing value of a second video frame with the same video frame as the first video frame with the first timing value;
generating a combined sequence value;
encoding the combined time sequence value and the first video frame to generate a video code stream;
sending the video code stream to a playing terminal;
enabling the playing terminal to extract a first video frame sequence and a combined sequence value in the video code stream;
restoring a second sequence of video frames from the extracted first sequence of video frames and the combined sequence value;
and playing the extracted first video frame sequence and the restored second video frame sequence.
The implementation of the invention has the following beneficial effects:
1. according to the invention, the first video frame sequence and the second video frame sequence used for generating the visual three-dimensional picture are obtained, and encoding processing is carried out according to the time sequences, so that excessive operation resources are avoided being consumed, the operation time is saved, and the encoding speed of the video is improved.
The invention is not described in detail, but is well known to those skilled in the art.
Finally, it is to be noted that: although the present invention has been described in detail with reference to examples, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (5)
1. A video coding and decoding method for VR is characterized by comprising the following steps:
performing time sequence calibration on the first video frame to generate a first time sequence, and performing time sequence calibration on the second video frame to generate a second time sequence;
comparing the video frames in the first video frame and the second video frame;
matching the first time sequence value of the first video frame of the same picture and the second time sequence value of the second video to generate a combined time sequence value;
encoding the combined time sequence value and the first video frame to generate a video code stream;
and outputting the video code stream.
2. The VR video coding and decoding method of claim 1, wherein the comparing the video frames in the first video frame and the second video frame comprises:
for each video frame in the first video frame sequence, moving a corresponding video frame in a second video frame sequence;
matching a second timing value of a second video frame with the same video frame as the first video frame with the first timing value;
a combined sequence value is generated.
3. The VR video coding/decoding method of claim 2, wherein the outputting the video stream comprises:
sending the video code stream to a playing terminal;
enabling the playing terminal to extract a first video frame sequence and a combined sequence value in the video code stream;
restoring a second sequence of video frames from the extracted first sequence of video frames and the combined sequence value;
and playing the extracted first video frame sequence and the restored second video frame sequence.
4. An apparatus for video encoding and decoding of a VR, comprising:
the time sequence calibration module is used for carrying out time sequence calibration on the first video frame to generate a first time sequence and carrying out time sequence calibration on the second video frame to generate a second time sequence;
the video frame comparison module is used for comparing the video frames in the first video frame and the second video frame;
the time sequence value generating module is used for matching a first time sequence value of a first video frame of the same picture and a second time sequence value of a second video to generate a combined time sequence value;
the code stream generation module is used for encoding the combined timing sequence value and the first video frame to generate a video code stream;
and the playing decoding module is used for outputting the video code stream.
5. The VR's video encoding and decoding device of claim 4, wherein the playback decoding module includes a video frame and timing extraction unit, a video frame restoration unit, and a playback unit;
a video frame and time sequence extracting unit, configured to enable the playing terminal to extract a first video frame sequence and a combined sequence value in the video code stream;
a video frame restoration unit for restoring a second video frame sequence based on the extracted first video frame sequence and the combined sequence value;
and the playing unit is used for playing the extracted first video frame sequence and the restored second video frame sequence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011313825.0A CN112218066A (en) | 2020-11-20 | 2020-11-20 | VR video encoding and decoding method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011313825.0A CN112218066A (en) | 2020-11-20 | 2020-11-20 | VR video encoding and decoding method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112218066A true CN112218066A (en) | 2021-01-12 |
Family
ID=74068179
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011313825.0A Pending CN112218066A (en) | 2020-11-20 | 2020-11-20 | VR video encoding and decoding method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112218066A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107147889A (en) * | 2016-06-22 | 2017-09-08 | 深圳市量子视觉科技有限公司 | The coding method of VR videos and device |
| CN108737825A (en) * | 2017-04-13 | 2018-11-02 | 腾讯科技（深圳）有限公司 | Method for coding video data, device, computer equipment and storage medium |
-
2020
- 2020-11-20 CN CN202011313825.0A patent/CN112218066A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107147889A (en) * | 2016-06-22 | 2017-09-08 | 深圳市量子视觉科技有限公司 | The coding method of VR videos and device |
| CN108737825A (en) * | 2017-04-13 | 2018-11-02 | 腾讯科技（深圳）有限公司 | Method for coding video data, device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2916543B1 (en) | Method for coding/decoding depth image and coding/decoding device | |
| KR100990565B1 (en) | Systems and methods for processing multiple projections of video data in a single video file | |
| CN101156319B (en) | Methods and apparatuses for generating and recovering 3d compression data | |
| KR101636539B1 (en) | Apparatus and method for compressing three dimensional image | |
| CN101273635A (en) | Apparatus and method for encoding and decoding multi-view picture using camera parameter, and recording medium storing program for executing the method | |
| CN104837052A (en) | Playing method of multimedia data and device | |
| CN111836076B (en) | Video resolution switching method and device and electronic equipment | |
| EP3410302B1 (en) | Graphic instruction data processing method, apparatus | |
| US11451836B2 (en) | Techniques and apparatus for PCM patch creation using Morton codes | |
| CN104079950A (en) | Video output processing method, device and system and video receiving processing method, device and system | |
| CN110827380B (en) | Image rendering method and device, electronic equipment and computer readable medium | |
| WO2023246926A1 (en) | Model training method, video encoding method, and video decoding method | |
| WO2023241459A1 (en) | Data communication method and system, and electronic device and storage medium | |
| US10904579B2 (en) | Method and apparatus for annealing iterative geometry smoothing | |
| JP2012522285A (en) | System and format for encoding data and 3D rendering | |
| CN112218066A (en) | VR video encoding and decoding method and device | |
| CN112866715B (en) | Universal video compression coding system supporting man-machine hybrid intelligence | |
| CN104506926A (en) | Push method and push system | |
| CN112887730A (en) | Video coding and decoding method and device | |
| CN107147889A (en) | The coding method of VR videos and device | |
| CN115801747B (en) | Cloud server based on ARM architecture and audio/video data transmission method | |
| CN114845150B (en) | Multi-video display synchronization system of display screen | |
| US11683523B2 (en) | Group of pictures based patch packing for video based point cloud coding | |
| CN116781912B (en) | Video transmission method, device, computer equipment and computer readable storage medium | |
| US11606556B2 (en) | Fast patch generation for video based point cloud coding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210112 |
|
| RJ01 | Rejection of invention patent application after publication |