CN106060513B - A kind of code stream caching method for cylinder three-dimensional panoramic video netcast - Google Patents

A kind of code stream caching method for cylinder three-dimensional panoramic video netcast Download PDF

Info

Publication number
CN106060513B
CN106060513B CN201610496916.XA CN201610496916A CN106060513B CN 106060513 B CN106060513 B CN 106060513B CN 201610496916 A CN201610496916 A CN 201610496916A CN 106060513 B CN106060513 B CN 106060513B
Authority
CN
China
Prior art keywords
cylinder
visual angle
code stream
panoramic video
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610496916.XA
Other languages
Chinese (zh)
Other versions
CN106060513A (en
Inventor
罗文峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Youxiang Computing Technology Co Ltd
Original Assignee
Shenzhen Youxiang Computing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Youxiang Computing Technology Co Ltd filed Critical Shenzhen Youxiang Computing Technology Co Ltd
Priority to CN201610496916.XA priority Critical patent/CN106060513B/en
Publication of CN106060513A publication Critical patent/CN106060513A/en
Application granted granted Critical
Publication of CN106060513B publication Critical patent/CN106060513B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194Transmission of image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331Caching operations, e.g. of an advertisement for later insertion during playback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection

Abstract

The invention discloses a kind of code stream caching mechanism for cylinder three-dimensional panoramic video netcast, it is related to computer vision field.The present invention is big for cylinder three-dimensional panoramic video data volume, the present situation watched in real time is difficult in netcast, it is proposed cylinder three-dimensional panoramic video being divided into multiple pieces, and absolute coding is carried out to these blocks, the data block that user selects visual angle and its left and right sides visual angle is only transmitted during network transmission;Three buffering areas are established in client, the code stream of viewing visual angle bearing data block and the code stream of viewing visual angle the right and left data block is deposited respectively, allows user to remain able to watch video in real time when changing viewing visual angle.The inventive method can greatly reduce data volume of the cylinder three-dimensional panoramic video in network transmission, and can effectively solve the problems, such as delay and the interim card of cylinder three-dimensional panoramic video netcast, improve Consumer's Experience.

Description

A kind of code stream caching method for cylinder three-dimensional panoramic video netcast
Technical field
The present invention relates to computer vision field, refers in particular to a kind of code stream for cylinder three-dimensional panoramic video netcast and delays Deposit method.
Background technology
Three-dimensional video-frequency is that one kind can provide relief video technique, and usually said three-dimensional video-frequency is binocular tri-dimensional Frequently, this video bag contains left video and right video.Binocular stereo vision is the principle of parallax for imitating human eye, utilizes imaging device From the two images of different position acquisition testees, then can only be seen respectively by special equipment, the eyes of let us To the image at a visual angle, then by analysis of the brain to two width anaglyphs with merging, generation has relief image.
Panoramic video is a kind of with the video to widen the vision.Cylinder panorama video is by the sky of 360 degree of scopes of horizontal plane Between information structure image sequence composition.Cylinder panorama video can select any angle in the range of 360 degree of horizontal plane Dynamic video is watched, and the angle of viewing can be adjusted in real time.
Cylinder three-dimensional panoramic video is one that three-dimensional video-frequency technology is formed together with cylinder panorama video technological incorporation The video of kind neomorph.The cylinder panoramic image that cylinder three-dimensional panoramic video has parallax and time synchronized by two width forms.It is logical Cylinder three-dimensional panoramic video player and specific helmet are crossed, we are perceived by cylinder three-dimensional panoramic video picture Face effect.
Cylinder three-dimensional panoramic video has extensive utilization in many fields, as virtual campus, virtual tourism, online business are produced Product displaying, Military Simulation etc..Compared with conventional video, cylinder three-dimensional panoramic video is wide-field simultaneously in offer, and network passes It is defeated into a difficult problem.Common planar video only provides the user with the information of an angular field of view, and the visual field of panoramic video Scope is 5~6 times of ordinary video field range, is again in addition three-dimensional screen, if to provide the user with and ordinary video one The visual quality of sample, the data volume of that cylinder three-dimensional panoramic video are 10~12 times of ordinary video, and this quantity is surprising. According to traditional Video Transmission Scheme, cylinder three-dimensional panoramic video will be in a network environment using becoming hardly possible, client Experience can be excessively poor.
Because in synchronization, user can only see a certain partial information of cylinder three-dimensional panoramic video, we are transmitting When first can also only transmit and need this partial information for watching, using this feature, we can pass through block encoding The efficiency of transmission of cylinder three-dimensional panoramic video is improved with code stream caching method, improves Consumer's Experience.
The content of the invention
The present invention is big for cylinder three-dimensional panoramic video transmitted data amount in netcast, it is difficult to realizes what is watched in real time Situation, it is proposed that a kind of cylinder three-dimensional panoramic video code stream caching method, realize cylinder three-dimensional panoramic video in netcast Smooth viewing in real time.
The concrete technical scheme of the present invention is as follows:A kind of code stream caching side for cylinder three-dimensional panoramic video netcast Method, the code stream caching method idiographic flow comprise the following steps:
1st, by the left video of cylinder three-dimensional panoramic video and right video respectively using visual angle as 0 when as starting point, be divided into 10 pieces;
2nd, to each piece of progress absolute coding;
3rd, 3 buffer areas, a master cache area and two buffer areas are distributed in client, the master cache area storage is used The code stream of the angular field of view data block of family selection, described two secondary buffer areas deposit the left and right with the master cache area same time respectively The code stream of adjacent data blocks;
4th, user is selected the data of viewing visual angle to be prestored by network transmission described in the one section of data that will be played deposit Master cache area, and the adjacent data blocks on the viewing visual angle both sides one piece of data that synchronously prestores is stored in described two secondary buffer areas;
5th, when viewing visual angle changes, it would be desirable to which one of them time buffer area of viewing is as master cache area, simultaneously Previous master cache area is reduced to time buffer area, and replaced with the adjacent data code flow not being buffered in currently viewing visual angle another The data code flow of individual secondary buffer area.
Compared with prior art, the beneficial effects of the present invention are:
By to cylinder three-dimensional panoramic video carry out block encoding, and create 3 buffer areas cache respectively viewing visual angle with The data block on the adjacent both sides of viewing visual angle so that user either still turns to the adjacent view of the left and right sides at selection visual angle, Network is all without the viewing data for not catching up with user's needs, so as to realize real-time sight of the cylinder three-dimensional panoramic video in network-side See.
Brief description of the drawings
Fig. 1 is cylinder three-dimensional panoramic video piecemeal schematic diagram of the present invention;
Fig. 2 is cylinder three-dimensional panoramic video netcast schematic diagram of the present invention.
Embodiment
The present invention is described in further detail below in conjunction with the accompanying drawings.
First determine the piecemeal division of cylinder three-dimensional panoramic video.Research has shown that the simple eye horizontal view angle maximum of people can reach To 156 degree, the horizontal view angle maximum of eyes can reach 188 degree, and the ken of two coincidences is 124 degree, and human eye is only at 124 degree The object watched in angular field of view can just form third dimension.In fact, human eye does not use all kens in viewing Scope, generally, the vision of people is sensitizing range at 10 degree, 10:20 degree can correct identification information, 20:30 degree to dynamic thing ratio It is more sensitive, when image vertical direction visual angle is 20 degree, and the visual angle of horizontal direction is 36 degree, just has good vision and come personally Sense, eyeball will not also cause tired because of frequent rotate, and be an angular field of view as snug as a bug in a rug.Based on this principle, this hair The bright basis that piecemeal is encoded using 36 degree of angulars field of view as cylinder three-dimensional panoramic video, by 360 degree of cylindrical panoramics at left and right visual angle Video corresponds to respectively is divided into 10 pieces, obtains the three-dimensional video-frequency of 10 groups of different visual angles.Specifically the method for putting is:To left and right visual angle panorama sketch As first determining visual angle respectively as 0 degree of border, then using 0 degree of border as starting point, every 36 degree are divided into one piece, mark off 10 successively Block, finally obtain the different visual angles three-dimensional video-frequency that 10 groups of angulars field of view are 36 degree.Fig. 1 is that the piecemeal of cylinder three-dimensional panoramic video shows It is intended to.
According to above-mentioned partition strategy, to each piece of progress absolute coding, different data blocks is obtained.Because user watches When the same time only need watch an angular field of view information, so we do not have to whole cylinder stereoscopic full views information All transmitted, only need to transmit the information of user's viewing visual angle in theory, in fact, viewing cylinder stereoscopic panoramic The user of frequency can be at any time switch visual angle to the left or to the right, if user switch visual angle after video counts can not be timely provided According to Caton phenomenon just occurs in that user when solely seeing, Consumer's Experience can be excessively poor, and according to this phenomenon, the present invention is in client Devise a kind of code stream caching method of reply.
Fig. 2 is the cylinder three-dimensional panoramic video netcast schematic diagram of the present invention, and data after network transmission by preserving Arrive in the buffer area of client, next told about specific caching method of the data in buffer area.First three are hewed out in client Individual spatial cache, one is main buffer area, and two other is time buffer area, and the angular field of view number of user's selection is deposited in master cache area According to the code stream of block, two buffer areas deposit the code stream with the left and right adjacent data blocks of master cache area same time respectively.When with When family selection visual angle does not change, the code stream replacement policy to three buffer areas is:By the partial code streams after caching code stream Replace the code stream of the data block played;When user perspective changes to the left, delay the secondary of this partial code streams has been cached Deposit area and be reduced to time buffer area as master cache area, master cache area originally, it is left with current visual angle for another buffer area The code stream on side goes to replace the code stream deposited originally;When user perspective changes to the right, visual angle code stream is needed having cached For secondary buffer area as master cache area, master cache area originally is reduced to time buffer area, and is replaced with the synchronous code stream on the right of current visual angle Change the code stream of another secondary buffer area.
After determining master cache area, the three-dimensional video-frequency code stream that master cache area is stored to visual angle is decoded, and is obtained to be played The successive frame of the successive frame of left video stream and right video flowing, cylindrical view is transformed to by plan view by projective transformation, and led to Cross frame synchronization control left video and right video while play.
The cylinder three-dimensional panoramic video netcast of the present invention establishes three threads, respectively data receiver line in client Journey, decoding show thread and management thread.Data receiver thread is responsible for receiving the data for carrying out automatic network, and reception data are put into In corresponding buffer area, decoding shows that thread is responsible for controlling the decoding, projective transformation and display of code stream to be played, and management thread is born Duty completes the resource management of client, includes the management by synchronization of data cached replacement management and each cross-thread.
Above example only plays a part of explaining technical solution of the present invention, protection domain of the presently claimed invention not office It is limited to realize system and specific implementation step described in above-described embodiment.Therefore, only to specific formula in above-described embodiment and Algorithm is simply replaced, but the technical scheme that its substantive content is still consistent with the method for the invention, all should belong to this hair Bright protection domain.

Claims (1)

  1. A kind of 1. code stream caching method for cylinder three-dimensional panoramic video netcast, it is characterised in that the code stream caching Method idiographic flow comprises the following steps:
    (1) by the left video of cylinder three-dimensional panoramic video and right video respectively using visual angle as 0 when as starting point, be divided into 10 Block;
    (2) to each piece of progress absolute coding;
    (3) 3 buffer areas are distributed in client, user is deposited in a master cache area and two buffer areas, the master cache area The code stream of the angular field of view data block of selection, described two secondary buffer areas deposit the left and right phase with the master cache area same time respectively The code stream of adjacent data block;
    (4) user is selected the data of viewing visual angle to be stored in the master by prestore one section of data that will be played of network transmission and delay Deposit area, and the adjacent data blocks on the viewing visual angle both sides one piece of data that synchronously prestores is stored in described two secondary buffer areas;
    (5) when viewing visual angle changes, it would be desirable to one of them time buffer area of viewing is used as master cache area, while before general One master cache area is reduced to time buffer area, and replaces another time with the adjacent data code flow not being buffered in currently viewing visual angle The data code flow of buffer area.
CN201610496916.XA 2016-06-29 2016-06-29 A kind of code stream caching method for cylinder three-dimensional panoramic video netcast Active CN106060513B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610496916.XA CN106060513B (en) 2016-06-29 2016-06-29 A kind of code stream caching method for cylinder three-dimensional panoramic video netcast

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610496916.XA CN106060513B (en) 2016-06-29 2016-06-29 A kind of code stream caching method for cylinder three-dimensional panoramic video netcast

Publications (2)

Publication Number Publication Date
CN106060513A CN106060513A (en) 2016-10-26
CN106060513B true CN106060513B (en) 2017-11-21

Family

ID=57166181

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610496916.XA Active CN106060513B (en) 2016-06-29 2016-06-29 A kind of code stream caching method for cylinder three-dimensional panoramic video netcast

Country Status (1)

Country Link
CN (1) CN106060513B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106604041B (en) * 2016-12-01 2020-05-22 深圳市梦网视讯有限公司 Panoramic video distribution method and system based on visual continuity
CN106851212B (en) * 2017-03-03 2020-03-17 深圳市梦网百科信息技术有限公司 Panoramic video distribution method and system based on user characteristics
CN106961622B (en) * 2017-03-30 2020-09-25 联想(北京)有限公司 Display processing method and device
CN107197318A (en) * 2017-06-19 2017-09-22 深圳市望尘科技有限公司 A kind of real-time, freedom viewpoint live broadcasting method shot based on multi-cam light field
CN107529064A (en) * 2017-09-04 2017-12-29 北京理工大学 A kind of self-adaptive encoding method based on VR terminals feedback

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127911A (en) * 2007-09-29 2008-02-20 中国科学院计算技术研究所 A block size computing method and transmission method for cylinder panorama video code
CN101345843A (en) * 2008-08-28 2009-01-14 中兴通讯股份有限公司 Method and system for implementing full view video of visible mobile terminal
CN102546921A (en) * 2010-12-07 2012-07-04 中国电信股份有限公司 Method, system and mobile terminal for achieving Web panorama browsing
CN104010225A (en) * 2014-06-20 2014-08-27 合一网络技术(北京)有限公司 Method and system for displaying panoramic video

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9516225B2 (en) * 2011-12-02 2016-12-06 Amazon Technologies, Inc. Apparatus and method for panoramic video hosting

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127911A (en) * 2007-09-29 2008-02-20 中国科学院计算技术研究所 A block size computing method and transmission method for cylinder panorama video code
CN101345843A (en) * 2008-08-28 2009-01-14 中兴通讯股份有限公司 Method and system for implementing full view video of visible mobile terminal
CN102546921A (en) * 2010-12-07 2012-07-04 中国电信股份有限公司 Method, system and mobile terminal for achieving Web panorama browsing
CN104010225A (en) * 2014-06-20 2014-08-27 合一网络技术(北京)有限公司 Method and system for displaying panoramic video

Also Published As

Publication number Publication date
CN106060513A (en) 2016-10-26

Similar Documents

Publication Publication Date Title
CN106060513B (en) A kind of code stream caching method for cylinder three-dimensional panoramic video netcast
CN106464854B (en) Image encodes and display
US20170155884A1 (en) Stereo viewing
KR101095392B1 (en) System and method for rendering 3-D images on a 3-D image display screen
CN106919248A (en) It is applied to the content transmission method and equipment of virtual reality
CN102577401A (en) A method and apparatus for stereoscopic multi-users display
CN100486140C (en) Three-D vedio monitoring method and system based on internet
CN105894567A (en) Scaling pixel depth values of user-controlled virtual object in three-dimensional scene
CN107071384B (en) The binocular rendering intent and system of virtual active disparity computation compensation
CN105472308A (en) Multi-view naked eye 3D video conference system
KR101329057B1 (en) An apparatus and method for transmitting multi-view stereoscopic video
CN106303573A (en) A kind of 3D method of video image processing and server and client side
CN102917176A (en) Three-dimensional stereoscopic parallax subtitle generating method
Kara et al. The couch, the sofa, and everything in between: discussion on the use case scenarios for light field video streaming services
KR101433082B1 (en) Video conversing and reproducing method to provide medium feeling of two-dimensional video and three-dimensional video
CN106406508A (en) Information processing method and relay equipment
CN107547889B (en) A kind of method and device carrying out three-dimensional video-frequency based on instant messaging
US11010923B2 (en) Image encoding method and technical equipment for the same
Hast 3D Stereoscopic Rendering: An Overview of Implementation Issues
US9609313B2 (en) Enhanced 3D display method and system
CN106034232A (en) Display control method and apparatus
Turner et al. Distributing Stereoscopic Views on Thin Client Displays.
FR2988961A1 (en) Method for restoration of views of multiview digital video on screen of TV, involves selecting displayed view, generating obturation signal based on selection of displayed view, and restoring selected view by considering obturation signal

Legal Events

Date Code Title Description
PB01 Publication
C06 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
GR01 Patent grant
GR01 Patent grant