CN112243134A - Virtual reality video coding method and transmission method - Google Patents
Virtual reality video coding method and transmission method Download PDFInfo
- Publication number
- CN112243134A CN112243134A CN202011115264.3A CN202011115264A CN112243134A CN 112243134 A CN112243134 A CN 112243134A CN 202011115264 A CN202011115264 A CN 202011115264A CN 112243134 A CN112243134 A CN 112243134A
- Authority
- CN
- China
- Prior art keywords
- image block
- image blocks
- image
- video frame
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
Abstract
The invention relates to a virtual reality video coding method and a virtual reality video transmission method. The virtual reality video coding method comprises the following steps: dividing a video frame into a plurality of image block sets, wherein each image block set at least comprises an image block; coding each image block, wherein each image block forms an image block subset containing image blocks with different resolutions after being coded, the image blocks with different resolutions correspond to different priorities, and the priorities are used for sending selection rights of the image blocks under different bandwidth environments; and recording the coding information of the image blocks, wherein the coding information comprises the coding data of the image blocks and the association information among the image blocks. According to the invention, the top and bottom 25% of the video and the middle 50% of the video frames are divided, and the middle 50% of the video frames are preferentially transmitted, so that the data transmission amount is reduced compared with the original data, and smooth film watching experience can be obtained. Particularly, image blocks with definition can be automatically selected for transmission according to network bandwidth, and fluency of video transmission is facilitated.
Description
Technical Field
The invention relates to the technical field of virtual reality, in particular to a virtual reality video coding method and a virtual reality video transmission method.
Background
The virtual reality panoramic video is a dynamic video which can be dragged and watched at any angle of 360 degrees up, down, left and right. Each frame of picture of the 360-degree panoramic visual frequency is a 360-degree panoramic picture, and when the visual frequency is watched, the video can be dragged and watched at any angle of 360 degrees, so that people have a feeling of being personally on the scene in a real sense, and in addition, the people can watch the video through wearing VR glasses to have a stronger sense of immersion. The viewer can freely select the favorite angle without dead angles, and the video is reduced or amplified in an interactive and strong new film watching mode.
However, since the virtual reality panoramic video contains a large amount of data, the transmission may be relatively slow, and thus, the prior art has problems and needs to be further improved.
Disclosure of Invention
The present invention is directed to the above-mentioned problems, and provides a virtual reality video encoding method and a virtual reality video transmission method.
In order to achieve the purpose, the specific technical scheme of the invention is as follows:
a virtual reality video coding method for coding video frames comprises the following steps:
s1, dividing the video frame into a plurality of image block sets, each image block set at least comprises an image block;
s2, encoding each image block, wherein each image block forms an image block subset containing image blocks with different resolutions after being encoded, the image blocks with different resolutions correspond to different priorities, and the priorities are used for sending selection rights of the image blocks under different bandwidth environments;
and S3, recording the coding information of the image blocks, wherein the coding information comprises the coding data of the image blocks and the association information among the image blocks.
Preferably, in step S1, the video frame is divided into 3 sets of image blocks: the upper area of the video frame, the lower area of the video frame and the middle area of the video frame.
Preferably, in step S1, the video frame is divided into 3 image block sets according to the area ratio: 25% of the upper area of the video frame, 25% of the lower area of the video frame and 50% of the middle area of the video frame.
Preferably, in step S2, the sharpness is set to 4 levels: 360p, 540p, 720p and 1080p, and the image blocks with proper definition are matched according to the network bandwidth.
Preferably, in step S2, the strategy for sending the option is:
the client freely selects the definition; or the like, or, alternatively,
and acquiring the transmission speed of a certain definition image block, and if the transmission speed exceeds a preset time threshold, degrading and selecting the transmission of a next level of definition image block.
Preferably, the preset time threshold is a critical time for human eyes to perceive image video jamming.
The invention also provides a virtual reality video coding transmission method, which comprises the following steps:
s1, dividing the video frame into a plurality of image block sets, each image block set at least comprises an image block;
s2, encoding each image block, wherein each image block forms an image block subset containing image blocks with different resolutions after being encoded, the image blocks with different resolutions correspond to different priorities, and the priorities are used for sending selection rights of the image blocks under different bandwidth environments;
s3, recording coding information of the image blocks, wherein the coding information comprises the coding data of the image blocks and the association information among the image blocks;
and S4, acquiring at least one image block set according to the network bandwidth, wherein the image block set consists of image blocks with the same definition, and the image block set is packaged into a data packet and then sent to a decryptor, and the data packet carries the coding information of the image block set.
Preferably, in step S1, the video frame is divided into 3 sets of image blocks: the upper area of the video frame, the lower area of the video frame and the middle area of the video frame.
Preferably, in step S4, the video frame middle area is preferably acquired according to the network bandwidth for transmission.
By adopting the technology of the invention, the top and bottom 25% of the video and the middle 50% of the video frames are divided, and the middle 50% of the video frames are preferentially transmitted, thus reducing the transmission amount of data compared with the prior art and obtaining smooth film watching experience. Particularly, image blocks with definition can be automatically selected for transmission according to network bandwidth, and fluency of video transmission is facilitated.
Drawings
FIG. 1 is a flow chart of a virtual reality video encoding method of the present invention;
fig. 2 is a flow chart of a virtual reality video coding transmission method of the present invention.
Detailed Description
In order that those skilled in the art can understand and implement the present invention, the following embodiments of the present invention will be further described with reference to the accompanying drawings.
Referring to fig. 1, a virtual reality video encoding method provided by the present invention performs encoding processing on a video frame, and includes the steps of:
s1, dividing the video frame into a plurality of image block sets, each image block set at least comprises an image block;
wherein, a video frame is divided into 3 image block sets: the upper area of the video frame, the lower area of the video frame and the middle area of the video frame. Further, the video frame is divided into 3 sets of image blocks by area ratio: 25% of the upper area of the video frame, 25% of the lower area of the video frame and 50% of the middle area of the video frame.
S2, encoding each image block, wherein each image block forms an image block subset containing image blocks with different resolutions after being encoded, the image blocks with different resolutions correspond to different priorities, and the priorities are used for sending selection rights of the image blocks under different bandwidth environments;
in step S2, the sharpness is set to 4 levels: 360p, 540p, 720p and 1080p, and the image blocks with proper definition are matched according to the network bandwidth.
Further, in step S2, the strategy for sending the option is:
the client freely selects the definition; or the like, or, alternatively,
and acquiring the transmission speed of a certain definition image block, and if the transmission speed exceeds a preset time threshold, degrading and selecting the transmission of a next level of definition image block. The preset time threshold is the critical time for eyes to sense the video jamming of the image.
And S3, recording the coding information of the image blocks, wherein the coding information comprises the coding data of the image blocks and the association information among the image blocks.
Referring to fig. 2, the present invention further provides a virtual reality video coding transmission method, including the steps of:
s1, dividing the video frame into a plurality of image block sets, each image block set at least comprises an image block;
wherein, a video frame is divided into 3 image block sets: the upper area of the video frame, the lower area of the video frame and the middle area of the video frame.
S2, encoding each image block, wherein each image block forms an image block subset containing image blocks with different resolutions after being encoded, the image blocks with different resolutions correspond to different priorities, and the priorities are used for sending selection rights of the image blocks under different bandwidth environments;
s3, recording coding information of the image blocks, wherein the coding information comprises the coding data of the image blocks and the association information among the image blocks;
and S4, acquiring at least one image block set according to the network bandwidth, wherein the image block set consists of image blocks with the same definition, and the image block set is packaged into a data packet and then sent to a decryptor, and the data packet carries the coding information of the image block set.
In step S4, the video frame middle area is preferably acquired according to the network bandwidth for transmission.
In the invention, the top and bottom 25% of the video and the middle 50% of the video frames are divided, and the middle 50% of the video frames are preferentially transmitted, so that the transmission amount of data is reduced compared with the original transmission amount, and smooth film watching experience can be obtained. Especially, the setting of 4 levels (360p, 540p, 720p and 1080p) of definition can automatically select image block transmission of definition according to network bandwidth, which is more beneficial to the fluency of video transmission.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (9)
1. A virtual reality video coding method for coding video frames is characterized by comprising the following steps:
s1, dividing the video frame into a plurality of image block sets, each image block set at least comprises an image block;
s2, encoding each image block, wherein each image block forms an image block subset containing image blocks with different resolutions after being encoded, the image blocks with different resolutions correspond to different priorities, and the priorities are used for sending selection rights of the image blocks under different bandwidth environments;
and S3, recording the coding information of the image blocks, wherein the coding information comprises the coding data of the image blocks and the association information among the image blocks.
2. The virtual reality video coding method according to claim 1 or 2, wherein in step S1, the video frame is divided into 3 sets of image blocks: the upper area of the video frame, the lower area of the video frame and the middle area of the video frame.
3. The virtual reality video coding method according to claim 2, wherein in step S1, the video frame is divided into 3 sets of image blocks according to area ratio: 25% of the upper area of the video frame, 25% of the lower area of the video frame and 50% of the middle area of the video frame.
4. The virtual reality video coding method according to claim 1, wherein in step S2, the sharpness is set to 4 levels: 360p, 540p, 720p and 1080p, and the image blocks with proper definition are matched according to the network bandwidth.
5. The virtual reality video coding method of claim 1, wherein in step S2, the strategy of sending the option is:
the client freely selects the definition; or the like, or, alternatively,
and acquiring the transmission speed of a certain definition image block, and if the transmission speed exceeds a preset time threshold, degrading and selecting the transmission of a next level of definition image block.
6. The virtual reality video coding method of claim 1, wherein the preset time threshold is a critical time for human eyes to perceive video stuck.
7. A virtual reality video coding transmission method is characterized by comprising the following steps:
s1, dividing the video frame into a plurality of image block sets, each image block set at least comprises an image block;
s2, encoding each image block, wherein each image block forms an image block subset containing image blocks with different resolutions after being encoded, the image blocks with different resolutions correspond to different priorities, and the priorities are used for sending selection rights of the image blocks under different bandwidth environments;
s3, recording coding information of the image blocks, wherein the coding information comprises the coding data of the image blocks and the association information among the image blocks;
and S4, acquiring at least one image block set according to the network bandwidth, wherein the image block set consists of image blocks with the same definition, and the image block set is packaged into a data packet and then sent to a decryptor, and the data packet carries the coding information of the image block set.
8. The virtual reality video coding transmission method according to claim 7, wherein in step S1, the video frame is divided into 3 sets of image blocks: the upper area of the video frame, the lower area of the video frame and the middle area of the video frame.
9. The virtual reality video coding transmission method according to claim 7, wherein in step S4, the video frame middle region is preferably obtained according to the network bandwidth for transmission.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011115264.3A CN112243134A (en) | 2020-10-16 | 2020-10-16 | Virtual reality video coding method and transmission method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011115264.3A CN112243134A (en) | 2020-10-16 | 2020-10-16 | Virtual reality video coding method and transmission method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112243134A true CN112243134A (en) | 2021-01-19 |
Family
ID=74168993
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011115264.3A Pending CN112243134A (en) | 2020-10-16 | 2020-10-16 | Virtual reality video coding method and transmission method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112243134A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101938638A (en) * | 2010-09-14 | 2011-01-05 | 南京航空航天大学 | Network video monitoring system based on resolution ratio grading transmission |
| CN107040794A (en) * | 2017-04-26 | 2017-08-11 | 盯盯拍（深圳）技术股份有限公司 | Video broadcasting method, server, virtual reality device and panoramic virtual reality play system |
| CN108076345A (en) * | 2016-11-09 | 2018-05-25 | 阿里巴巴集团控股有限公司 | The coding method of multi-angle video frame, transmission method, device, computer |
-
2020
- 2020-10-16 CN CN202011115264.3A patent/CN112243134A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101938638A (en) * | 2010-09-14 | 2011-01-05 | 南京航空航天大学 | Network video monitoring system based on resolution ratio grading transmission |
| CN108076345A (en) * | 2016-11-09 | 2018-05-25 | 阿里巴巴集团控股有限公司 | The coding method of multi-angle video frame, transmission method, device, computer |
| CN107040794A (en) * | 2017-04-26 | 2017-08-11 | 盯盯拍（深圳）技术股份有限公司 | Video broadcasting method, server, virtual reality device and panoramic virtual reality play system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11924394B2 (en) | Methods and apparatus for receiving and/or using reduced resolution images | |
| CN107771395B (en) | Method and apparatus for generating and transmitting metadata for virtual reality | |
| US10390000B2 (en) | Systems and methods for providing closed captioning in three-dimensional imagery | |
| US9167226B2 (en) | Selecting viewpoints for generating additional views in 3D video | |
| US8532407B2 (en) | Pseudo 3D image generation device, image encoding device, image encoding method, image transmission method, image decoding device, and image decoding method | |
| US8570360B2 (en) | Stereoscopic parameter embedding device and stereoscopic image reproducer | |
| KR101602879B1 (en) | Media processing apparatus for multi-display system and method of operation thereof | |
| US9317957B2 (en) | Enhancement of stereoscopic effect of an image through use of modified depth information | |
| US20070162922A1 (en) | Apparatus and method for processing video data using gaze detection | |
| CN112468855B (en) | Data transmission method and device and nonvolatile storage medium | |
| CN110149555B (en) | Video processing method and video receiving device | |
| EP3059948A1 (en) | Stereoscopic video and audio recording method, stereoscopic video and audio reproducing method, stereoscopic video and audio recording apparatus, stereoscopic video and audio reproducing apparatus, and stereoscopic video and audio recording medium | |
| CN109362242A (en) | A kind of processing method and processing device of video data | |
| US10958950B2 (en) | Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices | |
| JP5941000B2 (en) | Video distribution apparatus and video distribution method | |
| US10142664B2 (en) | Method and device for determining properties of a graphical overlay for a video stream | |
| KR101686168B1 (en) | Method for constituting stereoscopic moving picture file | |
| EP2676446B1 (en) | Apparatus and method for generating a disparity map in a receiving device | |
| CN112243134A (en) | Virtual reality video coding method and transmission method | |
| CN113542799A (en) | Compression transmission method and system for VR image | |
| CN113099237A (en) | Video processing method and device | |
| CN117440209B (en) | Implementation method and system based on singing scene | |
| US8773515B2 (en) | Control method and apparatus for displaying moving pictures | |
| Shi et al. | Perceptual Impact of Facial Quality in MPEG V-PCC-encoded Volumetric Videos | |
| CN114866759A (en) | Data encoding and decoding method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210119 |
|
| RJ01 | Rejection of invention patent application after publication |