CN106060513A - Code stream caching mechanism for cylindrical surface stereoscopic panoramic video network playing - Google Patents

Code stream caching mechanism for cylindrical surface stereoscopic panoramic video network playing Download PDF

Info

Publication number
CN106060513A
CN106060513A CN201610496916.XA CN201610496916A CN106060513A CN 106060513 A CN106060513 A CN 106060513A CN 201610496916 A CN201610496916 A CN 201610496916A CN 106060513 A CN106060513 A CN 106060513A
Authority
CN
China
Prior art keywords
panoramic video
video
cylindrical
data
visual angle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610496916.XA
Other languages
Chinese (zh)
Other versions
CN106060513B (en
Inventor
罗文峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Youxiang Computing Technology Co Ltd
Original Assignee
Shenzhen Youxiang Computing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Youxiang Computing Technology Co Ltd filed Critical Shenzhen Youxiang Computing Technology Co Ltd
Priority to CN201610496916.XA priority Critical patent/CN106060513B/en
Publication of CN106060513A publication Critical patent/CN106060513A/en
Application granted granted Critical
Publication of CN106060513B publication Critical patent/CN106060513B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194Transmission of image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331Caching operations, e.g. of an advertisement for later insertion during playback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection

Abstract

The invention discloses a code stream caching mechanism for cylindrical surface stereoscopic panoramic video network playing, and relates to the field of computer vision. Aiming at a current situation that real-time watching of a cylindrical surface stereoscopic panoramic video is difficult to realize during network playing as the cylindrical surface stereoscopic panoramic video is large in data size, the cylindrical surface stereoscopic panoramic video is proposed to be divided into a plurality of blocks, the blocks are independently coded, and only data blocks of a view angle selected by a user and data blocks of view angles of left and right sides of the selected view angle are transmitted during network transmission; and three buffer areas are established in a client, and are used for storing code streams of the data blocks in the viewing angle direction and code streams of the data blocks at the left and right sides of the viewing angle respectively, so that the user can still watch the video in real time when a viewing angle is changed. Through adoption of the mechanism provided by the invention, the data size of the cylindrical surface stereoscopic panoramic video in network transmission can be greatly reduced, problems of delay and standstill in network playing of the cylindrical surface stereoscopic panoramic video can be effectively solved, and the user experience is improved.

Description

A kind of code stream caching mechanism for cylinder three-dimensional panoramic video netcast
Technical field
The present invention relates to computer vision field, refer in particular to a kind of code stream for cylinder three-dimensional panoramic video netcast and delay Deposit mechanism.
Background technology
Three-dimensional video-frequency is that one can provide relief video technique, usually said three-dimensional video-frequency to be binocular tri-dimensionals Frequently, this video includes left video and right video.Binocular stereo vision is the principle of parallax imitating human eye, utilizes imaging device From two width images of different position acquisition testees, then by special equipment, the eyes of let us can only be seen respectively To the image at a visual angle, then by brain to the analysis of two width anaglyphs and fusion, produce and there is relief image.
Panoramic video is a kind of video having and widening the vision.Cylinder panorama video is by the sky of 360 degree of scopes of horizontal plane Between information structure image sequence composition.Cylinder panorama video can select arbitrarily angled in the range of horizontal plane 360 degree Viewing dynamic video, it is possible to adjust the angle of viewing in real time.
Cylinder three-dimensional panoramic video is that three-dimensional video-frequency technology is formed together with cylinder panorama video technological incorporation Plant the video of neomorph.The cylinder panoramic image that cylinder three-dimensional panoramic video is had parallax and time synchronized by two width forms.Logical Crossing cylinder three-dimensional panoramic video player and specific helmet, we are perceived by cylinder three-dimensional panoramic video and draw Face effect.
Cylinder three-dimensional panoramic video all has extensively utilization in a lot of fields, as virtual campus, virtual tourism, online business are produced Product displaying, Military Simulation etc..Compared with conventional video, cylinder three-dimensional panoramic video is providing wide-field while, and network passes Defeated become a difficult problem.Common planar video only provides the user with the information of an angular field of view, and the visual field of panoramic video Scope is 5~6 times of ordinary video field range, is the most again three-dimensional screen, if to provide the user with and ordinary video one The visual quality of sample, the data volume of that cylinder three-dimensional panoramic video is 10~12 times of ordinary video, and this quantity is surprising. According to traditional Video Transmission Scheme, cylinder three-dimensional panoramic video to use in a network environment and to become hardly possible, client Experiencing can be excessively poor.
Owing at synchronization, user can only see a certain partial information of cylinder three-dimensional panoramic video, we are in transmission When can also the most only transmit need viewing this partial information, utilize this feature, we can pass through block encoding With the efficiency of transmission that code stream caching mechanism improves cylinder three-dimensional panoramic video, improve Consumer's Experience.
Summary of the invention
The present invention is directed to cylinder three-dimensional panoramic video transmitted data amount in netcast big, it is difficult to realize viewing in real time Situation, it is proposed that a kind of cylinder three-dimensional panoramic video code stream caching mechanism, it is achieved cylinder three-dimensional panoramic video is in netcast The most smooth viewing.
The concrete technical scheme of the present invention is as follows: a kind of code stream for cylinder three-dimensional panoramic video netcast caches machine System, described code stream caching mechanism idiographic flow comprises the following steps:
As starting point when being 1,0 respectively using visual angle by the left video of cylinder three-dimensional panoramic video and right video, it is divided into 10 pieces;
2, absolute coding is carried out to each piece;
3,3 buffer areas, a master cache district and two buffer areas are distributed in client;
4, user selects the data watching visual angle transmit, by network, the one section of data that will play that prestores and is stored in described Master cache district, and the one piece of data that synchronizes the adjacent data blocks on viewing both sides, visual angle to prestore is stored in said two time buffer area;
5, when watching visual angle and changing, it would be desirable to one of them of viewing time buffer area is as master cache district, simultaneously Previous master cache district is reduced to time buffer area, and replaces another with the adjacent data code flow not being buffered in currently viewing visual angle The data code flow of individual buffer area.
Compared with prior art, the beneficial effects of the present invention is:
By cylinder three-dimensional panoramic video being carried out block encoding, and create 3 buffer areas respectively cache viewing visual angle with The data block on viewing adjacent both sides, visual angle so that no matter user is to select visual angle or turning to the adjacent view of the left and right sides, Network is all without not catching up with the viewing data that user needs, thus realizes the real-time sight in network-side of the cylinder three-dimensional panoramic video See.
Accompanying drawing explanation
Fig. 1 is cylinder three-dimensional panoramic video piecemeal schematic diagram of the present invention;
Fig. 2 is cylinder three-dimensional panoramic video netcast schematic diagram of the present invention.
Detailed description of the invention
Below in conjunction with the accompanying drawings the present invention is described in further detail.
First determine that the piecemeal of cylinder three-dimensional panoramic video divides.Research proves, the simple eye horizontal view angle maximum of people can reach To 156 degree, the horizontal view angle maximum of eyes can reach 188 degree, and two kens overlapped are 124 degree, and human eye is only at 124 degree The object watched in angular field of view just can form third dimension.It is true that human eye does not use all of ken when viewing Scope, generally, the vision of people is sensitizing range at 10 degree, and 10~20 degree can correctly identify information, and 20~30 degree to dynamic thing The most sensitive, when image vertical direction visual angle is 20 degree, when the visual angle of horizontal direction is 36 degree, just have good vision when participating in the cintest Sense, eyeball also will not cause tired because of frequently rotating, be an angular field of view as snug as a bug in a rug.Based on this principle, this Bright 36 degree of angulars field of view encode the basis of piecemeal as cylinder three-dimensional panoramic video, by 360 degree of cylindrical panoramics at visual angle, left and right Video correspondence respectively is divided into 10 pieces, obtains the three-dimensional video-frequency of 10 groups of different visual angles.Specifically the method for putting is: to visual angle, left and right panorama sketch As the most first determining the border that visual angle is 0 degree, then with 0 degree of border as starting point, every 36 degree are divided into one piece, mark off 10 successively Block, finally obtains the different visual angles three-dimensional video-frequency that 10 groups of angulars field of view are 36 degree.Fig. 1 is that the piecemeal of cylinder three-dimensional panoramic video shows It is intended to.
According to above-mentioned partition strategy, carry out absolute coding to each piece, obtain different data blocks.Owing to user watches When the same time have only to watch an angular field of view information, so we need not be whole cylinder stereoscopic full views information All transmit, have only to transmit user in theory and watch the information at visual angle, it is true that viewing cylinder stereoscopic panoramic The user of frequency can switch visual angle, at any time to the left or to the right if user can not provide video counts after switching visual angle timely According to, that user arises that Caton phenomenon when solely seeing, Consumer's Experience can be excessively poor, and according to this phenomenon, the present invention is in client Devise the code stream caching mechanism of a kind of reply.
Fig. 2 is the cylinder three-dimensional panoramic video netcast schematic diagram of the present invention, and data are preserved after being transmitted by network Arrive in the buffer area of client, next told about the data concrete caching mechanism at buffer area.First hew out three in client Individual spatial cache, one is master cache district, and two other is time buffer area, and the angular field of view number that user selects is deposited in master cache district According to the code stream of block, two buffer areas deposit the code stream of the left and right adjacent data blocks of time same with master cache district respectively.When with When selection visual angle, family does not changes, to the code stream replacement policy of three buffer areas it is: by the partial code streams after caching code stream Replace the code stream of the data block play;When user perspective changes to the left, having cached the secondary slow of this partial code streams Depositing district as master cache district, master cache district originally reduces to time buffer area, for another one time buffer area, left by current visual angle The code stream on limit goes to replace the code stream originally deposited;When user perspective changes to the right, need visual angle code stream having cached Secondary buffer area is as master cache district, and master cache district originally reduces to time buffer area, and replaces with the synchronization code stream on the right of current visual angle Change the code stream of another buffer area.
After determining master cache district, the three-dimensional video-frequency code stream at storage visual angle, master cache district is decoded, obtains to be played The successive frame of left video stream and the successive frame of right video flowing, be transformed to cylindrical view plan view by projective transformation, and lead to Cross frame synchronization control left video and right video is play simultaneously.
The cylinder three-dimensional panoramic video netcast of the present invention sets up three threads, respectively data receiver line in client Journey, decoding display thread and management thread.Data receiver thread is responsible for receiving the data of automatic network, and puts into receiving data In corresponding buffer area, decoding display thread is responsible for controlling the decoding of code stream to be played, projective transformation and display, and management thread is born Blame the resource management of client, including data cached replacement management and the management by synchronization of each cross-thread.
Above example only plays the effect explaining technical solution of the present invention, protection domain of the presently claimed invention not office It is limited to the system that realizes described in above-described embodiment and is embodied as step.Therefore, only to formula concrete in above-described embodiment and Algorithm is simply replaced, but the technical scheme that its flesh and blood is still consistent with the method for the invention, all should be belonged to this Bright protection domain.

Claims (1)

1. the code stream caching mechanism for cylinder three-dimensional panoramic video netcast, it is characterised in that described code stream caches Mechanism idiographic flow comprises the steps:
(1) as starting point when being 0 respectively using visual angle by the left video of cylinder three-dimensional panoramic video and right video, it is divided into 10 Block;
(2) absolute coding is carried out to each piece;
(3) 3 buffer areas, a master cache district and two buffer areas are distributed in client;
(4) user select the data watching visual angle be stored in described master delayed by the network transmission one section of data that will play that prestores Deposit district, and the one piece of data that the adjacent data blocks synchronization on viewing both sides, visual angle prestored is stored in said two time buffer area;
(5) when watching visual angle and changing, it would be desirable to one of them of viewing time buffer area is as master cache district, simultaneously by front One master cache district reduces to time buffer area, and replaces another time with the adjacent data code flow not being buffered in currently viewing visual angle The data code flow of buffer area.
CN201610496916.XA 2016-06-29 2016-06-29 A kind of code stream caching method for cylinder three-dimensional panoramic video netcast Active CN106060513B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610496916.XA CN106060513B (en) 2016-06-29 2016-06-29 A kind of code stream caching method for cylinder three-dimensional panoramic video netcast

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610496916.XA CN106060513B (en) 2016-06-29 2016-06-29 A kind of code stream caching method for cylinder three-dimensional panoramic video netcast

Publications (2)

Publication Number Publication Date
CN106060513A true CN106060513A (en) 2016-10-26
CN106060513B CN106060513B (en) 2017-11-21

Family

ID=57166181

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610496916.XA Active CN106060513B (en) 2016-06-29 2016-06-29 A kind of code stream caching method for cylinder three-dimensional panoramic video netcast

Country Status (1)

Country Link
CN (1) CN106060513B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106604041A (en) * 2016-12-01 2017-04-26 深圳百科信息技术有限公司 Panoramic video distribution method and system based on visual continuity
CN106851212A (en) * 2017-03-03 2017-06-13 深圳百科信息技术有限公司 A kind of panoramic video distribution method and system based on user personality
CN106961622A (en) * 2017-03-30 2017-07-18 联想(北京)有限公司 A kind of display processing method and device
CN107197318A (en) * 2017-06-19 2017-09-22 深圳市望尘科技有限公司 A kind of real-time, freedom viewpoint live broadcasting method shot based on multi-cam light field
CN107529064A (en) * 2017-09-04 2017-12-29 北京理工大学 A kind of self-adaptive encoding method based on VR terminals feedback

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127911A (en) * 2007-09-29 2008-02-20 中国科学院计算技术研究所 A block size computing method and transmission method for cylinder panorama video code
CN101345843A (en) * 2008-08-28 2009-01-14 中兴通讯股份有限公司 Method and system for implementing full view video of visible mobile terminal
CN102546921A (en) * 2010-12-07 2012-07-04 中国电信股份有限公司 Method, system and mobile terminal for achieving Web panorama browsing
US20130141523A1 (en) * 2011-12-02 2013-06-06 Stealth HD Corp. Apparatus and Method for Panoramic Video Hosting
CN104010225A (en) * 2014-06-20 2014-08-27 合一网络技术(北京)有限公司 Method and system for displaying panoramic video

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127911A (en) * 2007-09-29 2008-02-20 中国科学院计算技术研究所 A block size computing method and transmission method for cylinder panorama video code
CN101345843A (en) * 2008-08-28 2009-01-14 中兴通讯股份有限公司 Method and system for implementing full view video of visible mobile terminal
CN102546921A (en) * 2010-12-07 2012-07-04 中国电信股份有限公司 Method, system and mobile terminal for achieving Web panorama browsing
US20130141523A1 (en) * 2011-12-02 2013-06-06 Stealth HD Corp. Apparatus and Method for Panoramic Video Hosting
CN104010225A (en) * 2014-06-20 2014-08-27 合一网络技术(北京)有限公司 Method and system for displaying panoramic video

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106604041A (en) * 2016-12-01 2017-04-26 深圳百科信息技术有限公司 Panoramic video distribution method and system based on visual continuity
CN106604041B (en) * 2016-12-01 2020-05-22 深圳市梦网视讯有限公司 Panoramic video distribution method and system based on visual continuity
CN106851212A (en) * 2017-03-03 2017-06-13 深圳百科信息技术有限公司 A kind of panoramic video distribution method and system based on user personality
CN106851212B (en) * 2017-03-03 2020-03-17 深圳市梦网百科信息技术有限公司 Panoramic video distribution method and system based on user characteristics
CN106961622A (en) * 2017-03-30 2017-07-18 联想(北京)有限公司 A kind of display processing method and device
CN107197318A (en) * 2017-06-19 2017-09-22 深圳市望尘科技有限公司 A kind of real-time, freedom viewpoint live broadcasting method shot based on multi-cam light field
CN107529064A (en) * 2017-09-04 2017-12-29 北京理工大学 A kind of self-adaptive encoding method based on VR terminals feedback

Also Published As

Publication number Publication date
CN106060513B (en) 2017-11-21

Similar Documents

Publication Publication Date Title
CN106060513B (en) A kind of code stream caching method for cylinder three-dimensional panoramic video netcast
CN106464854B (en) Image encodes and display
US10645369B2 (en) Stereo viewing
US10375372B2 (en) 3D system including a marker mode
KR101095392B1 (en) System and method for rendering 3-D images on a 3-D image display screen
CN104394400B (en) Draw filter antagonism project dummy emulation system and the method for display based on solid more
CA2268864A1 (en) Projection system, in particular for three-dimensional representations on a viewing device
CN102577401A (en) A method and apparatus for stereoscopic multi-users display
CN105959664B (en) The dynamic adjustment of predetermined three-dimensional video setting based on scene content
CN100486140C (en) Three-D vedio monitoring method and system based on internet
CN202801563U (en) Perception correcting and training system based on binocular stereo vision
US20210029341A1 (en) 3d system
US10122987B2 (en) 3D system including additional 2D to 3D conversion
KR20110108551A (en) An apparatus and method for transmitting/receiving multi-view stereoscopic video
US20170142401A1 (en) 3d system including rendering with three dimensional transformation
JP2011529285A (en) Synthetic structures, mechanisms and processes for the inclusion of binocular stereo information in reproducible media
CN102917176B (en) A kind of production method of three-dimensional stereoscopic parallax subtitle
US10277879B2 (en) 3D system including rendering with eye displacement
Kara et al. The couch, the sofa, and everything in between: discussion on the use case scenarios for light field video streaming services
CN105100777B (en) Three-dimensional multi-content display method and apparatuses
Braun et al. Evaluating motion and binocular parallax as depth cues for autostereoscopic displays
CN206946095U (en) A kind of 3D telescopes
Hast 3D Stereoscopic Rendering: An Overview of Implementation Issues
US9609313B2 (en) Enhanced 3D display method and system
CN109710061A (en) The dynamic feedback system of image and dynamic feedback method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant