CN109286855A - Transmission method, transmitting device and the Transmission system of panoramic video - Google Patents

Transmission method, transmitting device and the Transmission system of panoramic video Download PDF

Info

Publication number
CN109286855A
CN109286855A CN201710590143.6A CN201710590143A CN109286855A CN 109286855 A CN109286855 A CN 109286855A CN 201710590143 A CN201710590143 A CN 201710590143A CN 109286855 A CN109286855 A CN 109286855A
Authority
CN
China
Prior art keywords
video
video clip
define
value
probability
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710590143.6A
Other languages
Chinese (zh)
Other versions
CN109286855B (en
Inventor
谢澜
张行功
郭宗明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Peking University
Original Assignee
Peking University
Peking University Founder Group Co Ltd
Beijing Founder Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Peking University, Peking University Founder Group Co Ltd, Beijing Founder Electronics Co Ltd filed Critical Peking University
Priority to CN201710590143.6A priority Critical patent/CN109286855B/en
Publication of CN109286855A publication Critical patent/CN109286855A/en
Application granted granted Critical
Publication of CN109286855B publication Critical patent/CN109286855B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26208—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
    • H04N21/26216—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving the channel capacity, e.g. network bandwidth
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present invention provides a kind of transmission method of panoramic video, transmitting device and Transmission systems.Wherein, a kind of transmission method of panoramic video is used for client, comprising: media file is obtained and parsed from server end, according to media file foradownloaded video segment；In downloading process, user's head location information, the probability being viewed according to head position information prediction video clip are obtained；Video playing buffer size is calculated, the total bitrate upper limit value of video clip is calculated according to network bandwidth estimated value and video playing buffer size；Space quality variation and the expected distortion of video clip for calculating video clip establish QoE model according to the variation of the space quality of video clip, expected distortion, and selection needs the video clip downloaded.According to the technical solution of the present invention, the data volume for reducing panoramic video transmission is realized, the technical effect for improving video quality, reducing the quality fluctuation in space and the Caton of video playing.

Description

Transmission method, transmitting device and the Transmission system of panoramic video
Technical field
The present invention relates to multimedia technology fields, transmission method, a kind of panorama in particular to a kind of panoramic video The transmitting device of video, a kind of Transmission system of panoramic video, a kind of computer equipment, a kind of computer readable storage medium.
Background technique
With the development of multimedia technology, extensive concern of the virtual reality technology (VR) by industry and academia.Its In, the application of panoramic video, such as 360 degree of videos, omni-directional video is widely used in a variety of applications.
The data volume of virtual reality video is usually very big, this allows for passing the compression bit rate and network of panoramic video It is defeated to become maximum challenge.For example, resolution ratio is the panoramic video that is mapped in a manner of ERP of 4Kx2K code after compressed encoding Rate is up to 15Mbps~20Mbps.Panoramic video high-resolution, the characteristic of high code rate hinder the development of its Internet application.Separately Outside, user has actually only seen the video content in form when watching panoramic video, and there is no quilts for the content in other regions User sees.Therefore, the full content of panoramic video (content in form and outside form) is transferred to client and causes band Width waste.
The Adaptive Transmission based on form may be implemented using HTTP dynamic stream media technology, i.e., in user's form in Content transmission low quality outside appearance transmission high quality, form, to reduce total volume of transmitted data.Transmission method based on piecemeal Refer to and video is spatially cut into component block, the foradownloaded video content of the client property of can choose, such as in form Piecemeal downloads quality version, for form outside piecemeal download low-quality version or do not download.
However, the transmission based on piecemeal for providing high quality still has challenge: (1) video piecemeal obtains mistake.Due to Following video content is obtained in advance, and client needs to predict that the direction of user's viewing, prediction error will lead to client not Certain video piecemeals are downloaded, if needing this partial video content in actual play, causes the contents of the section to lack and influences to use Family experience；(2) video playing Caton.Since the prediction of user's viewing direction is there are instantaneity, i.e. prediction is following excessively prolonged User declines extreme towards result accuracy rate, so the play buffer very little (such as 3 seconds) of video, the feelings in minibuffer area It is easy to that the Caton of video playing occurs under condition；(3) mixing code rate leads to boundary effect.Since the transmission method based on piecemeal needs Video is spatially split, client may cause video in wash with watercolours when selecting video content due to code rate difference There are apparent boundary or quality inconsistent situation when dye.
Therefore, how a kind of panoramic video transmission method based on piecemeal is provided, is reached and is improved video quality, reduces space Quality fluctuation and video playing Caton purpose, become a technical problem to be solved urgently.
Summary of the invention
The present invention is directed to solve at least one of the technical problems existing in the prior art or related technologies.
For this purpose, the first aspect of the present invention is to propose a kind of transmission method of panoramic video, it to be used for server.
The second aspect of the present invention is to propose a kind of transmission method of panoramic video, for client.
The third aspect of the present invention is to propose a kind of transmitting device of panoramic video, for server.
The fourth aspect of the present invention is to propose a kind of transmitting device of panoramic video, for client.
The fifth aspect of the present invention is to propose a kind of Transmission system of panoramic video.
The sixth aspect of the present invention is to propose a kind of computer equipment.
The seventh aspect of the present invention is to propose a kind of computer readable storage medium.
In view of this, first aspect of the present invention it is proposed a kind of transmission method of panoramic video, according to preset configuration Information carries out piecemeal, coding, slicing treatment to panoramic video, obtains video clip and media description file；By video clip and Media description file stores in the server.
The transmission method of panoramic video according to the present invention, in server end, firstly for space separating number, piecemeal The parameters such as wide and height, coding parameter, video clip duration can be predefined, as the configuration file of configuration information, then Processor by executing the video piecemeal gets the panoramic video and configuration file and is handled, specifically, for complete Scape video carries out piecemeal, coding, slice and obtains video clip and media description file, the video clip and media that processing is obtained Description file be stored in it is spare in HTTP server, client when download panoramic video, understand according to video clip, media description File carries out viewpoint adaptively and code rate is adaptive, and solves the video clip for needing to download by optimal method, thus Achieve the purpose that improve video quality, reduce the quality fluctuation in space and the Caton of video playing.
In the above-mentioned technical solutions, it is preferable that the format of panoramic video includes ERP format, CMP format；Configuration information packet It includes: quantity, width, height, the playing duration of video clip, coding parameter and code rate grade.
In the technical scheme, the generation of panoramic video content is illustrated first, in June, 2016, MPEG is proposed Comprehensive media application format standard draft usually records real world with several cameras when making panoramic video Visual scene, synchronization camera output video frame (image) need by splicing, projection, mapping post package at one A two-dimensional surface data frame just can be carried out Video coding.Wherein, splicing refers to the figure for acquiring multiple camera synchronizations Picture restores real world visual field by technologies such as Feature Points Matching, fusions, and image will project to a three-dimensional after splicing On projection structure, such as a sphere or cube.Since projection structure is three-dimensional, but now widely used encoder It is encoded for two-dimensional surface video, so needing further for the image on projection structure to be mapped to a two dimension Plane just can be carried out video compression coding after the data frame after obtaining a two-dimensional map, and currently used mapping method has Equirectangular Projection (ERP), Cubemap Projection (CMP) etc. are therefore, complete for what is got The format of scape video includes but is not limited to ERP format, CMP format, execute video piecemeal processor get the ERP format or It after the panoramic video of CMP format, is handled according to preset configuration information, includes piecemeal number, piecemeal in configuration information The parameters such as wide and height, coding parameter, video clip duration, but not limited to this.
In any of the above-described technical solution, it is preferable that media description file includes the spatial positional information of video clip, compiles Code information, code rate, quality distortion value, uniform resource locator (Uniform Resource Locator, URL).
In the technical scheme, media description file includes but is not limited to the spatial positional information of video clip, coding letter Breath, code rate, quality distortion value, uniform resource locator (URL).
The second aspect of the present invention proposes a kind of transmission method of panoramic video, is used for client, and such as any of the above-described The transmission method of panoramic video in technical solution is used cooperatively, and transmission method includes: to obtain from server end and parse media File, according to media file foradownloaded video segment；In downloading process, user's head location information is obtained, according to head position The probability that information prediction video clip is viewed；Video playing buffer size is calculated, according to network bandwidth estimated value and view The total bitrate upper limit value of frequency play buffer size calculating video clip；Calculate space quality variation and the video of video clip The expected distortion of segment establishes QoE model according to the variation of the space quality of video clip, expected distortion, what selection needed to download Video clip.
The transmission method of panoramic video according to the present invention, the client user in network is when downloading panoramic video, meeting According to the uniform resource locator of media description file acquisition to panoramic video, to be downloaded.It is carried out in downloading process Viewpoint is adaptive, code rate is adaptive, and establishes an optimal model and maximize QoE to determine the segment of downloading.It is specific and Speech predicts what the following piecemeal was viewed by obtaining the history head position information of user in viewpoint adaptive process Probability；The total video clip code rate that can be transmitted is calculated according to network bandwidth, play buffer size；Finally, by most Optimization Method needs the video clip downloaded, in optimal method, it is contemplated that the overall quality of video, due to space point The desired value that the fluctuation of block bring space quality and video clip are distorted under viewing probability, by establishing optimal model, Obtain video clip to the client property of can choose, thus reduce panoramic video transmission data volume, reach improve video quality, The purpose for reducing the quality fluctuation in space and the Caton of video playing improves viewing aphorama under the network environment of Bandwidth-Constrained The user experience of frequency.
In the above-mentioned technical solutions, it is preferable that user's head location information is obtained, according to head position information prediction video The step of probability that segment is viewed, specifically include: head position information includes the Eulerian angles of user's direction, definition (α, β, γ) be user's direction Eulerian angles, wherein it is pitch angle, γ roll angle that α, which is yaw angle, β,；Define t0For current time；Definition δ is the predicting interval；DefinitionFor the point on the corresponding spherical surface of video clip, whereinFor latitude, θ is longitude；Define UiIt is i-th The quantity of point on the corresponding spherical surface of a video clip；DefinitionFor that can see a littleDirection set；According to user court To Eulerian angles (α, beta, gamma), calculate in (t0+ δ) moment user's direction predicted value With And the correct probability P of the predicted value of user's directionE(α,β,γ)；According to (t0+ δ) moment user's direction predicted value it is correct general Rate PE(α, beta, gamma) calculates the point on spherical surface corresponding to video clipThe probability being viewedIt calculates public Formula are as follows:The probability P that video clip is viewediIt is right for video clip The mean value for the probability that point on the spherical surface answered is viewed, calculation formula are as follows:
In the technical scheme, it defines in each adaptive stage, client needs to carry out adaptive specific of viewpoint Step.Specifically, the probability that the point on spherical surface is viewed first is calculated in order to calculate the probability that video piecemeal is seen, For a point on spherical surfaceDue to may all see this point by several directions of user, then this point quilt The probability seenIt is calculated as to see the direction set of this pointCorresponding mathematical expectation of probability, it may be assumed thatThe probability P that one video piecemeal is viewediIt is calculated as this video The umbilical point U of piecemealiThe mean value for the probability that point on corresponding spherical surface is viewed, it may be assumed thatIts In, PE(α, β, γ) is in (t0+ δ) moment user's direction predicted value correct probability.
In any of the above-described technical solution, it is preferable that the predicted value of user's direction Calculation formula are as follows:
Wherein, mα、mβ、mγFor linear regression parameters；The correct probability P of the predicted value of user's directionEThe calculating of (α, β, γ) Formula are as follows: PE(α, β, γ)=Pyaw(α)Ppitch(β)Proll(λ), wherein Pyaw(α), Ppitch(β), Proll(γ) is respectively inclined Navigate angle, pitch angle, roll angle predicted value correct probability, calculation formula are as follows:
Wherein, μαFor the mean value of yaw angle distribution, σαFor the standard deviation of the predicted value of yaw angle；μβFor pitch angle distribution Mean value, σβFor the standard deviation of the predicted value of pitch angle；μλFor the mean value of roll angle distribution, σλFor the standard of the predicted value of roll angle Difference.
In the technical scheme, firstly, being calculated using linear regression in (t0+ δ) moment user's direction predicted valueWherein, mα、mβ、mγFor the parameter in linear regression, these three parameters can be distinguished Using in window [t0-1,t0] yaw angle, the historical data of pitch angle, roll angle in the time, it is asked by least square method Solution.Secondly, by data statistics, in (t0+ δ) moment when user direction predicted value and its true value there are difference, they Between relationship meet Gaussian Profile, i.e. eα~N (μα,σα), eβ~N (μβ,σβ), eγ~N (μγ,σγ), Europe can be calculated as a result, Angle is drawn to predict correct probability component, i.e. Pyaw(α), Ppitch(β), Proll(γ).Due to yaw angle, pitch angle, phase between roll angle It is mutually independent, so Eulerian angles predict correct probability PE(α, β, γ) can be calculated are as follows: PE(α, β, γ)=Pyaw(α)Ppitch(β)Proll (λ)。
In any of the above-described technical solution, it is preferable that video playing buffer size is calculated, according to network bandwidth estimated value The step of calculating the total bitrate upper limit value of video clip with video playing buffer size, specifically includes: definition T is video clip Duration, each video clip duration are equal；Define bkTo have downloaded the video playing buffer area after k-th of video clip set Size；Define RkFor the total bitrate upper limit value for downloading k-th of video clip set；Define RminTo download k-th of video clip collection The total bitrate minimum value of conjunction；Define CkFor the network bandwidth estimated value in k-th of video clip aggregation process of downloading；Definition BtargetFor the target value of video playing buffer area；Video playing buffer size b after having downloaded k-th of video clip setk Calculation formula are as follows:Download the total bitrate upper limit value R of k-th of video clip setkCalculation formula Are as follows:
In the technical scheme, the rate control algorithm based on destination buffer is defined, to determine the total of video clip Code rate can be used, to avoid the Caton played under conditions of minibuffer area.Specifically, the variation of video buffer size is It is determined by the total bitrate of network bandwidth and the video clip set of downloading, when video clip set has been downloaded, screen buffer Size increases, and with the broadcasting of video, video buffer size reduces.Therefore, the view after having downloaded k-th of video clip set Frequency buffer size may be calculated:In order to avoid Caton occurs for video playing, we delay video The control of area's size is rushed in a target value, even bk=Btarget, it is possible to find out the total bitrate of k-th of video clip set Are as follows:It is R in order to avoid calculated result is negativekSet a minimum value Rmin, then RkIt can be with It calculates are as follows:
In any of the above-described technical solution, it is preferable that define the quantity that N is video clip；Define the code that M is video clip Rate grade；Define ri,jFor i-th of video clip j-th of code rate grade code rate, wherein 1≤i≤N, 1≤j≤M；Definition di,jFor i-th of video clip j-th of code rate grade quality distortion value, wherein 1≤i≤N, 1≤j≤M；Define xi,jIt is Whether i video clip is selected j-th code rate grade, xi,j=1 represents selection, xi,j=0 representative is not chosen, wherein 1 ≤ i≤N, 1≤j≤M, any i and any j constitute set X, X={ xi,j|1≤i≤N,1≤j≤M}；Define siIt is regarded for i-th The area of spherical surface corresponding to frequency segment,Define the expected distortion that Φ (X) is video clip；Defining Ψ (X) is video clip Space quality variation；Define the total bitrate upper limit value that R is the video clip；The meter of the expected distortion Φ (X) of video clip Calculate formula are as follows:
PiThe probability being viewed for video clip；
The calculation formula of space quality variation Ψ (X) of video clip are as follows:
PiThe probability being viewed for video clip；
QoE model are as follows:Wherein, η is optimization aim weight,
In the technical scheme, when selecting video clip, need to consider two QoE factors, one is expected distortion, represents Consider the desired value that video clip is distorted under viewing probability；The second is space quality changes, the quality represented in video clip is put down Slip.It therefore, is to maximize QoE to solve the video clip target of client acquisition by establishing optimal model.Specifically, The expected distortion that Φ (X) is video clip is defined, the space quality that Ψ (X) is video clip is defined and changes, define η as optimization aim power Weight, definition R are video clip total bitrate upper limit value, client when selecting video clip total bitrate no more than the value, it is each oneself Laundering period, this value are the total bitrate R of k-th of the video clip set acquired in the code rate adaptive stagek, then, optimization is asked Topic can be with is defined as:Wherein, In each adaptive stage, client is by solving above-mentioned objective function and conditional function, so as to be needed Then the video clip of acquisition sends request to server and is downloaded, next adaptive stage entered after the completion of downloading, directly Terminate to client viewing video.
The third aspect of the present invention proposes a kind of transmitting device of panoramic video, is used for server, the transmitting device Include: processing unit, for carrying out piecemeal, coding, slicing treatment to the panoramic video according to preset configuration information, obtains Video clip and media description file；Storage unit, for the video clip and the media description file to be stored in institute It states in server.
The transmitting device of panoramic video according to the present invention, in server end, firstly for space separating number, piecemeal The parameters such as wide and height, coding parameter, video clip duration can be predefined, as the configuration file of configuration information, then Processor by executing the video piecemeal gets the panoramic video and configuration file and is handled, specifically, for complete Scape video carries out piecemeal, coding, slice and obtains video clip and media description file, the video clip and media that processing is obtained Description file be stored in it is spare in HTTP server, client when download panoramic video, understand according to video clip, media description File carries out viewpoint adaptively and code rate is adaptive, and solves the video clip for needing to download by optimal method, thus Achieve the purpose that improve video quality, reduce the quality fluctuation in space and the Caton of video playing.
In the above-mentioned technical solutions, it is preferable that the format of the panoramic video includes ERP format, CMP format；It is described to match Confidence breath includes: quantity, width, height, the playing duration of the video clip, coding parameter and code rate grade.
The generation of panoramic video content is illustrated first, in June, 2016, MPEG proposes comprehensive media application Format standard draft usually records the visual scene of real world when making panoramic video with several cameras, with for the moment The video frame (image) of the camera output at quarter is needed by splicing, projection, mapping post package into a two-dimensional surface data frame It just can be carried out Video coding.Wherein, splicing refers to the image for acquiring multiple camera synchronizations, passes through characteristic point The technologies reduction real world visual field such as match, merge, image will project in tripleplane's structure after splicing, such as One sphere or cube.Since projection structure is three-dimensional, but now widely used encoder is for two-dimensional surface What video was encoded, so needing further for the image on projection structure to be mapped to a two-dimensional surface, obtain one It just can be carried out video compression coding after data frame after two-dimensional map, currently used mapping method has Equirectangular Projection (ERP), Cubemap Projection (CMP) etc., therefore, the format of the panoramic video for getting includes But it is not limited to ERP format, CMP format, the processor for executing video piecemeal gets the aphorama of the ERP format or CMP format After frequency, handled according to preset configuration information, include in configuration information piecemeal number, the width of piecemeal and height, coding parameter, The parameters such as video clip duration, but not limited to this.
In any of the above-described technical solution, it is preferable that media description file includes the spatial positional information of video clip, compiles Code information, code rate, quality distortion value, uniform resource locator (URL).
In the technical scheme, media description file includes but is not limited to the spatial positional information of video clip, coding letter Breath, code rate, quality distortion value, uniform resource locator (URL).
The fourth aspect of the present invention proposes a kind of transmitting device of panoramic video, is used for client, and such as any of the above-described The transmitting device of panoramic video in technical solution is used for server, is used cooperatively, transmitting device includes: download unit, is used for Media file is obtained and parsed from server end, according to media file foradownloaded video segment；Viewpoint adaptive unit, under During load, user's head location information, the probability being viewed according to head position information prediction video clip are obtained；Code rate Adaptive unit, for calculating video playing buffer size, according to network bandwidth estimated value and video playing buffer size Calculate the total bitrate upper limit value of video clip；Video selecting unit is optimized, the space quality for calculating video clip changes And the expected distortion of video clip establishes QoE model according to the variation of the space quality of video clip, expected distortion, selection needs The video clip to be downloaded.
The transmitting device of panoramic video according to the present invention, the client user in network is when downloading panoramic video, meeting According to the uniform resource locator of media description file acquisition to panoramic video, to be downloaded.It is carried out in downloading process Viewpoint is adaptive, code rate is adaptive, and establishes an optimal model and maximize QoE to determine the segment of downloading.It is specific and Speech predicts what the following piecemeal was viewed by obtaining the history head position information of user in viewpoint adaptive process Probability；The total video clip code rate that can be transmitted is calculated according to network bandwidth, play buffer size；Finally, by most Optimization Method needs the video clip downloaded, in optimal method, it is contemplated that the overall quality of video, due to space point The desired value that the fluctuation of block bring space quality and video clip are distorted under viewing probability, by establishing optimal model, Obtain video clip to the client property of can choose, thus reduce panoramic video transmission data volume, reach improve video quality, The purpose for reducing the quality fluctuation in space and the Caton of video playing improves viewing aphorama under the network environment of Bandwidth-Constrained The user experience of frequency.
In the above-mentioned technical solutions, it is preferable that viewpoint adaptive unit is specifically used for: head position information includes user The Eulerian angles of direction define the Eulerian angles that (α, beta, gamma) is user's direction, wherein it is pitch angle, γ rolling that α, which is yaw angle, β, Angle；Define t0For current time；Definition δ is the predicting interval；DefinitionFor the point on the corresponding spherical surface of video clip, wherein For latitude, θ is longitude；Define UiFor the quantity of the point on the corresponding spherical surface of i-th of video clip；DefinitionFor that can see PointDirection set；According to the Eulerian angles (α, beta, gamma) of user's direction, calculate in (t0+ δ) moment user's direction prediction ValueAnd the correct probability P of the predicted value of user's directionE(α,β,γ)；According to (t0+ δ) the correct probability P of the predicted value of moment user directionE(α, beta, gamma) calculates the point on spherical surface corresponding to video clip The probability being viewedCalculation formula are as follows:Video clip quilt The probability P watchediFor the mean value for the probability that the point on spherical surface corresponding to video clip is viewed, calculation formula are as follows:
In the technical scheme, it defines in each adaptive stage, client needs to carry out adaptive specific of viewpoint Step.Specifically, the probability that the point on spherical surface is viewed first is calculated in order to calculate the probability that video piecemeal is seen, For a point on spherical surfaceDue to may all see this point by several directions of user, then this point quilt The probability seenIt is calculated as to see the direction set of this pointCorresponding mathematical expectation of probability, it may be assumed thatThe probability P that one video piecemeal is viewediIt is calculated as this video The umbilical point U of piecemealiThe mean value for the probability that point on corresponding spherical surface is viewed, it may be assumed thatIts In, PE(α, β, γ) is in (t0+ δ) moment user's direction predicted value correct probability.
In any of the above-described technical solution, it is preferable that the predicted value of user's direction Calculation formula are as follows:
Wherein, mα、mβ、mγFor linear regression parameters；The correct probability P of the predicted value of user's directionEThe calculating of (α, β, γ) Formula are as follows: PE(α, β, γ)=Pyaw(α)Ppitch(β)Proll(λ), wherein Pyaw(α), Ppitch(β), Proll(γ) is respectively inclined Navigate angle, pitch angle, roll angle predicted value correct probability, calculation formula are as follows:
Wherein, μαFor the mean value of yaw angle distribution, σαFor the standard deviation of the predicted value of yaw angle；μβFor pitch angle distribution Mean value, σβFor the standard deviation of the predicted value of pitch angle；μλFor the mean value of roll angle distribution, σλFor the standard of the predicted value of roll angle Difference.
In the technical scheme, firstly, being calculated using linear regression in (t0+ δ) moment user's direction predicted valueWherein, mα、mβ、mγFor the parameter in linear regression, these three parameters can be distinguished Using in window [t0-1,t0] yaw angle, the historical data of pitch angle, roll angle in the time, it is asked by least square method Solution.Secondly, by data statistics, in (t0+ δ) moment when user direction predicted value and its true value there are difference, they Between relationship meet Gaussian Profile, i.e. eα~N (μα,σα), eβ~N (μβ,σβ), eγ~N (μγ,σγ), Europe can be calculated as a result, Angle is drawn to predict correct probability component, i.e. Pyaw(α), Ppitch(β), Proll(γ).Due to yaw angle, pitch angle, phase between roll angle It is mutually independent, so Eulerian angles predict correct probability PE(α, β, γ) can be calculated are as follows: PE(α, β, γ)=Pyaw(α)Ppitch(β)Proll (λ)。
In any of the above-described technical solution, it is preferable that code rate adaptive unit is specifically used for: when definition T is video clip Long, each video clip duration is equal；Define bkIt is big to have downloaded the video playing buffer area after k-th of video clip set It is small；Define RkFor the total bitrate upper limit value for downloading k-th of video clip set；Define RminTo download k-th of video clip set Total bitrate minimum value；Define CkFor the network bandwidth estimated value in k-th of video clip aggregation process of downloading；Define Btarget For the target value of video playing buffer area；Video playing buffer size b after having downloaded k-th of video clip setkMeter Calculate formula are as follows:Download the total bitrate upper limit value R of k-th of video clip setkCalculation formula are as follows:
In the technical scheme, the rate control algorithm based on destination buffer is defined, to determine the total of video clip Code rate can be used, to avoid the Caton played under conditions of minibuffer area.Specifically, the variation of video buffer size is It is determined by the total bitrate of network bandwidth and the video clip set of downloading, when video clip set has been downloaded, screen buffer Size increases, and with the broadcasting of video, video buffer size reduces.Therefore, the view after having downloaded k-th of video clip set Frequency buffer size may be calculated:In order to avoid Caton occurs for video playing, we delay video The control of area's size is rushed in a target value, even bk=Btarget, it is possible to find out the total bitrate of k-th of video clip set Are as follows:It is R in order to avoid calculated result is negativekSet a minimum value Rmin, then RkIt can be with It calculates are as follows:
In any of the above-described technical solution, it is preferable that optimize video selecting unit, be specifically used for: definition N is piece of video The quantity of section；Define the code rate grade that M is video clip；Define ri,jFor i-th of video clip j-th of code rate grade code Rate, wherein 1≤i≤N, 1≤j≤M；Define di,jFor i-th of video clip j-th of code rate grade quality distortion value, wherein 1≤i≤N, 1≤j≤M；Define xi,jFor i-th of video clip whether being selected in j-th code rate grade, xi,j=1 represents It chooses, xi,j=0 representative is not chosen, wherein 1≤i≤N, 1≤j≤M, any i and any j constitute set X, X={ xi,j|1≤i ≤N,1≤j≤M}；Define siFor the area of spherical surface corresponding to i-th of video clip,Defining Φ (X) is video clip Expected distortion；The space quality that Ψ (X) is video clip is defined to change；Define the total bitrate upper limit value that R is the video clip； The calculation formula of the expected distortion Φ (X) of video clip are as follows:
Wherein, PiThe probability being viewed for video clip；
The calculation formula of space quality variation Ψ (X) of video clip are as follows:
Wherein, PiThe probability being viewed for video clip；
QoE model are as follows:
Wherein, η is optimization aim weight,
In the technical scheme, when selecting video clip, need to consider two QoE factors, one is expected distortion, represents Consider the desired value that video clip is distorted under viewing probability；The second is space quality changes, the quality-smoothing in video clip is represented Property.It therefore, is to maximize QoE to solve the video clip target of client acquisition by establishing optimal model.Specifically, The expected distortion that Φ (X) is video clip is defined, the space quality that Ψ (X) is video clip is defined and changes, define η as optimization aim power Weight, definition R are video clip total bitrate upper limit value, client when selecting video clip total bitrate no more than the value, it is each oneself Laundering period, this value are the total bitrate R of k-th of the video clip set acquired in the code rate adaptive stagek, then, optimization is asked Topic can be with is defined as:Wherein, In each adaptive stage, client is by solving above-mentioned objective function and conditional function, so as to be needed Then the video clip of acquisition sends request to server and is downloaded, next adaptive stage entered after the completion of downloading, directly Terminate to client viewing video.
The fifth aspect of the present invention proposes a kind of Transmission system of panoramic video, comprising: such as any of the above-described technical solution In panoramic video transmitting device, be used for client；And the transmission dress such as the panoramic video in any of the above-described technical solution It sets, is used for server end.
The Transmission system of panoramic video according to the present invention, using as in any of the above-described technical solution for server The transmitting device for client panoramic video in the transmitting device of panoramic video, and such as any of the above-described technical solution, because And with this for server panoramic video transmitting device and this be used for the complete of the transmitting device of client panoramic video Portion's beneficial effect, details are not described herein.
The sixth aspect of the present invention, proposes a kind of computer equipment, including memory, processor and is stored in memory Computer program that is upper and can running on a processor, processor are used to execute as being used to service in any of the above-described technical solution The step of transmission method of the panoramic video of device；Or processor is used to execute as being used for client in any of the above-described technical solution The step of transmission method of panoramic video.
The seventh aspect of the present invention proposes a kind of computer readable storage medium, is stored thereon with computer program, meter Calculation machine program realizes the transmission such as the panoramic video for server in any of the above-described technical solution when being executed by processor The step of method；Or computer program realize when being executed by processor as in any of the above-described technical solution for client The step of transmission method of panoramic video.
Additional aspect and advantage of the invention will become obviously in following description section, or practice through the invention Recognize.
Detailed description of the invention
Above-mentioned and/or additional aspect of the invention and advantage will become from the description of the embodiment in conjunction with the following figures Obviously and it is readily appreciated that, in which:
Fig. 1 shows the process signal of the transmission method of the panoramic video of one embodiment according to a first aspect of the present invention Figure；
Fig. 2 shows the signals of the process of the transmission method of the panoramic video of one embodiment according to a second aspect of the present invention Figure；
Fig. 3 shows the schematic block of the transmitting device of the panoramic video of one embodiment according to a third aspect of the present invention Figure；
Fig. 4 shows the schematic block of the transmitting device of the panoramic video of one embodiment according to a fourth aspect of the present invention Figure；
Fig. 5 shows the schematic block of the Transmission system of the panoramic video of one embodiment according to a fifth aspect of the present invention Figure；
Fig. 6 shows the schematic diagram of the computer equipment of one embodiment according to a sixth aspect of the present invention；
Fig. 7 shows the panoramic video transport frame schematic diagram according to an embodiment of the invention based on piecemeal；
Fig. 8 shows the schematic diagram according to an embodiment of the invention that piecemeal processing is carried out to panoramic video；
Fig. 9 shows user according to an embodiment of the invention towards the schematic diagram indicated with Eulerian angles；
Figure 10 shows user according to an embodiment of the invention and counts towards predicted value and true value difference data Schematic diagram.
Specific embodiment
To better understand the objects, features and advantages of the present invention, with reference to the accompanying drawing and specific real Applying mode, the present invention is further described in detail.It should be noted that in the absence of conflict, the implementation of the application Feature in example and embodiment can be combined with each other.
In the following description, numerous specific details are set forth in order to facilitate a full understanding of the present invention, still, the present invention may be used also To be implemented using other than the one described here other modes, therefore, protection scope of the present invention is not by described below Specific embodiment limitation.
As shown in Figure 1, the process of the transmission method of the panoramic video of one embodiment according to a first aspect of the present invention is shown It is intended to.Wherein, which is used for server, comprising:
Step 102, piecemeal, coding, slicing treatment are carried out to panoramic video according to preset configuration information, obtains piece of video Section and media description file；
Step 104, in the server by video clip and the storage of media description file.
The transmission method of panoramic video provided by the invention, in server end, firstly for space separating number, piecemeal The parameters such as wide and height, coding parameter, video clip duration can be predefined, as the configuration file of configuration information, then Processor by executing the video piecemeal gets the panoramic video and configuration file and is handled, specifically, for complete Scape video carries out piecemeal, coding, slice and obtains video clip and media description file, the video clip and media that processing is obtained Description file be stored in it is spare in HTTP server, client when download panoramic video, understand according to video clip, media description File carries out viewpoint adaptively and code rate is adaptive, and solves the video clip for needing to download by optimal method, thus Achieve the purpose that improve video quality, reduce the quality fluctuation in space and the Caton of video playing.
In the above embodiment, it is preferable that the format of panoramic video includes ERP format, CMP format；Configuration information includes: Quantity, width, height, the playing duration of video clip, coding parameter and code rate grade.
In this embodiment, the format of the panoramic video for getting includes but is not limited to ERP format, CMP format, is held After the processor of row video piecemeal gets the panoramic video of the ERP format or CMP format, at preset configuration information It manages, includes the parameters such as piecemeal number, the width of piecemeal and height, coding parameter, video clip duration in configuration information, but be not limited to This.
In any of the above-described embodiment, it is preferable that media description file includes but is not limited to the spatial position of video clip Information, encoded information, code rate, quality distortion value, uniform resource locator (URL).
As shown in Fig. 2, the process of the transmission method of the panoramic video of one embodiment according to a second aspect of the present invention is shown It is intended to.Wherein, transmission method of the transmission method for the panoramic video in client, with such as above-mentioned any embodiment, is used for Server is used cooperatively, which includes:
Step 202, media file is obtained and parsed from server end, according to media file foradownloaded video segment；
Step 204, in downloading process, user's head location information is obtained, according to head position information prediction piece of video The probability that section is viewed；
Step 206, video playing buffer size is calculated, according to network bandwidth estimated value and video playing buffer size Calculate the total bitrate upper limit value of video clip；
Step 208, space quality variation and the expected distortion of video clip for calculating video clip, according to video clip Space quality variation, expected distortion, establish QoE model, selection needs the video clip downloaded.
In this embodiment, the client user in network can obtain when downloading panoramic video according to media description file The uniform resource locator of panoramic video is got, to be downloaded.Carry out that viewpoint is adaptive, code rate is adaptive in downloading process It answers, and establishes an optimal model and maximize QoE to determine the segment of downloading.Specifically, in viewpoint adaptive process In, the probability that the following piecemeal is viewed is predicted by obtaining the history head position information of user；According to network bandwidth, broadcast Buffer size is put to calculate the total video clip code rate that can be transmitted；Finally, needing to download by optimal method solution Video clip, in optimal method, it is contemplated that the overall quality of video, due to space separating bring space quality wave The desired value that dynamic and video clip is distorted under viewing probability, by establishing optimal model, the client property of can choose Video clip is obtained, to reduce the data volume of panoramic video transmission, reaches the quality fluctuation for improving video quality, reducing space With the purpose of the Caton of video playing, the user experience of viewing panoramic video is improved under the network environment of Bandwidth-Constrained.
In the above embodiment, it is preferable that user's head location information is obtained, according to head position information prediction piece of video The step of probability that section is viewed, specifically include: head position information includes the Eulerian angles of user's direction, is defined (α, beta, gamma) For the Eulerian angles of user's direction, wherein it is pitch angle, γ roll angle that α, which is yaw angle, β,；Define t0For current time；Defining δ is Predicting interval；DefinitionFor the point on the corresponding spherical surface of video clip, whereinFor latitude, θ is longitude；Define UiIt is i-th The quantity of point on the corresponding spherical surface of a video clip；DefinitionFor that can see a littleDirection set；According to user The Eulerian angles (α, beta, gamma) of direction are calculated in (t0+ δ) moment user's direction predicted value And the correct probability P of the predicted value of user's directionE(α,β,γ)；According to (t0+ δ) moment user's direction predicted value it is correct Probability PE(α, beta, gamma) calculates the point on spherical surface corresponding to video clipThe probability being viewedIt calculates Formula are as follows:The probability P that video clip is viewediFor video clip institute The mean value for the probability that point on corresponding spherical surface is viewed, calculation formula are as follows:
In this embodiment, it defines in each adaptive stage, client needs to carry out the adaptive specific step of viewpoint Suddenly.Specifically, the probability that the point on spherical surface is viewed first is calculated in order to calculate the probability that video piecemeal is seen, it is right In a point on spherical surfaceDue to may all see this point by several directions of user, then this point is seen The probability arrivedIt is calculated as to see the direction set of this pointCorresponding mathematical expectation of probability, it may be assumed thatThe probability P that one video piecemeal is viewediIt is calculated as this video The umbilical point U of piecemealiThe mean value for the probability that point on corresponding spherical surface is viewed, it may be assumed thatIts In, PE(α, β, γ) is in (t0+ δ) moment user's direction predicted value correct probability.
In any of the above-described embodiment, it is preferable that the predicted value of user's direction 's Calculation formula are as follows:
Wherein, mα、mβ、mγFor linear regression parameters；The correct probability P of the predicted value of user's directionEThe calculating of (α, β, γ) Formula are as follows: PE(α, β, γ)=Pyaw(α)Ppitch(β)Proll(λ), wherein Pyaw(α), Ppitch(β), Proll(γ) is respectively inclined Navigate angle, pitch angle, roll angle predicted value correct probability, calculation formula are as follows:
Wherein, μαFor the mean value of yaw angle distribution, σαFor the standard deviation of the predicted value of yaw angle；μβFor pitch angle distribution Mean value, σβFor the standard deviation of the predicted value of pitch angle；μλFor the mean value of roll angle distribution, σλFor the standard of the predicted value of roll angle Difference.
In this embodiment, firstly, being calculated using linear regression in (t0+ δ) moment user's direction predicted valueWherein, mα、mβ、mγFor the parameter in linear regression, these three parameters can be distinguished Using in window [t0-1,t0] yaw angle, the historical data of pitch angle, roll angle in the time, it is asked by least square method Solution.Secondly, by data statistics, in (t0+ δ) moment when user direction predicted value and its true value there are difference, they Between relationship meet Gaussian Profile, i.e. eα~N (μα,σα), eβ~N (μβ,σβ), eγ~N (μγ,σγ), Europe can be calculated as a result, Angle is drawn to predict correct probability component, i.e. Pyaw(α), Ppitch(β), Proll(γ).Due to yaw angle, pitch angle, phase between roll angle It is mutually independent, so Eulerian angles predict correct probability PE(α, β, γ) can be calculated are as follows: PE(α, β, γ)=Pyaw(α)Ppitch(β)Proll (λ)。
In any of the above-described embodiment, it is preferable that calculate video playing buffer size, according to network bandwidth estimated value and Video playing buffer size calculates the step of total bitrate upper limit value of video clip, specifically includes: when definition T is video clip Long, each video clip duration is equal；Define bkIt is big to have downloaded the video playing buffer area after k-th of video clip set It is small；Define RkFor the total bitrate upper limit value for downloading k-th of video clip set；Define RminTo download k-th of video clip set Total bitrate minimum value；Define CkFor the network bandwidth estimated value in k-th of video clip aggregation process of downloading；Define Btarget For the target value of video playing buffer area；Video playing buffer size b after having downloaded k-th of video clip setkMeter Calculate formula are as follows:Download the total bitrate upper limit value R of k-th of video clip setkCalculation formula are as follows:
In this embodiment, the rate control algorithm based on destination buffer is defined, to determine that the total of video clip can With code rate, to avoid the Caton played under conditions of minibuffer area.Specifically, the variation of video buffer size be by Network bandwidth and the total bitrate of the video clip set of downloading determine that, when video clip set has been downloaded, screen buffer is big Small increase, with the broadcasting of video, video buffer size reduces.Therefore, the video after having downloaded k-th of video clip set Buffer size may be calculated:In order to avoid Caton occurs for video playing, we are by video buffer Area's size is controlled in a target value, even bk=Btarget, it is possible to find out the total bitrate of k-th of video clip set Are as follows:It is R in order to avoid calculated result is negativekSet a minimum value Rmin, then RkIt can be with It calculates are as follows:
In any of the above-described embodiment, it is preferable that define the quantity that N is video clip；Define the code rate that M is video clip Grade；Define ri,jFor i-th of video clip j-th of code rate grade code rate, wherein 1≤i≤N, 1≤j≤M；Define di,j For i-th of video clip j-th of code rate grade quality distortion value, wherein 1≤i≤N, 1≤j≤M；Define xi,jIt is i-th Whether video clip is selected j-th code rate grade, xi,j=1 represents selection, xi,j=0 representative is not chosen, wherein 1≤i ≤ N, 1≤j≤M, any i and any j constitute set X, X={ xi,j|1≤i≤N,1≤j≤M}；Define siFor i-th of video The area of spherical surface corresponding to segment,Define the expected distortion that Φ (X) is video clip；Defining Ψ (X) is video clip Space quality variation；Define the total bitrate upper limit value that R is the video clip；The calculating of the expected distortion Φ (X) of video clip Formula are as follows:
PiThe probability being viewed for video clip；
The calculation formula of space quality variation Ψ (X) of video clip are as follows:
PiThe probability being viewed for video clip；
QoE model are as follows:Wherein, η is optimization aim weight,
In this embodiment, when selecting video clip, need to consider two QoE factors, one is expected distortion, represents Consider the desired value that video clip is distorted under viewing probability；The second is space quality changes, the quality represented in video clip is put down Slip.It therefore, is to maximize QoE to solve the video clip target of client acquisition by establishing optimal model.Specifically, The expected distortion that Φ (X) is video clip is defined, the space quality that Ψ (X) is video clip is defined and changes, define η as optimization aim power Weight, definition R are video clip total bitrate upper limit value, client when selecting video clip total bitrate no more than the value, it is each oneself Laundering period, this value are the total bitrate R of k-th of the video clip set acquired in the code rate adaptive stagek, then, optimization is asked Topic can be with is defined as:Wherein, In each adaptive stage, client is by solving above-mentioned objective function and conditional function, so as to be needed Then the video clip of acquisition sends request to server and is downloaded, next adaptive stage entered after the completion of downloading, directly Terminate to client viewing video.
As shown in figure 3, the schematic block of the transmitting device of the panoramic video of one embodiment according to a third aspect of the present invention Figure.Wherein, which is used for server, comprising:
Processing unit 302, for carrying out piecemeal, coding, at slice to the panoramic video according to preset configuration information Reason, obtains video clip and media description file；
Storage unit 304, for the video clip and the media description file to be stored in the server.
The transmitting device 300 of panoramic video according to the present invention firstly for space separating number, divides in server end The width and the parameters such as height, coding parameter, video clip duration of block can be predefined, as the configuration file of configuration information, Then the panoramic video and configuration file are got by the processor for executing the video piecemeal and is handled, specifically, right In panoramic video carries out piecemeal, coding, slice obtain video clip and media description file, video clip that processing is obtained and Media description file is stored in spare in HTTP server, and client, can according to video clip, media when downloading panoramic video It describes file progress viewpoint adaptively and code rate is adaptive, and the video clip for needing to download is solved by optimal method, To achieve the purpose that improve video quality, reduce the quality fluctuation in space and the Caton of video playing.
In the above embodiment, it is preferable that the format of the panoramic video includes ERP format, CMP format；The configuration Information includes: quantity, width, height, the playing duration of the video clip, coding parameter and code rate grade.
In this embodiment, the format of the panoramic video for getting includes but is not limited to ERP format, CMP format, is held After the processor of row video piecemeal gets the panoramic video of the ERP format or CMP format, at preset configuration information It manages, includes the parameters such as piecemeal number, the width of piecemeal and height, coding parameter, video clip duration in configuration information, but be not limited to This.
In any of the above-described embodiment, it is preferable that media description file includes the spatial positional information of video clip, coding Information, code rate, quality distortion value, uniform resource locator (URL).
In this embodiment, media description file include but is not limited to the spatial positional information of video clip, encoded information, Code rate, quality distortion value, uniform resource locator (URL).
As shown in figure 4, the schematic block of the transmitting device of the panoramic video of one embodiment according to a fourth aspect of the present invention Figure.Wherein, transmitting device of the transmitting device 400 for the panoramic video in client, with such as above-mentioned any embodiment, is used for Server is used cooperatively, which includes:
Download unit 402, for media file to be obtained and parsed from server end, according to media file foradownloaded video piece Section；
Viewpoint adaptive unit 404, for user's head location information being obtained, according to head position in downloading process The probability that information prediction video clip is viewed；
Code rate adaptive unit 406, for calculating video playing buffer size, according to network bandwidth estimated value and video The total bitrate upper limit value of play buffer size calculating video clip；
Video selecting unit 408 is optimized, the space quality for calculating video clip changes and the phase of video clip It hopes distortion, according to the variation of the space quality of video clip, expected distortion, establishes QoE model, selection needs the piece of video downloaded Section.
The transmitting device 400 of panoramic video according to the present invention, the client user in network when downloading panoramic video, It can be according to the uniform resource locator of media description file acquisition to panoramic video, to be downloaded.In downloading process into Row viewpoint is adaptive, code rate is adaptive, and establishes an optimal model and maximize QoE to determine the segment of downloading.Specifically For, in viewpoint adaptive process, predict that the following piecemeal is viewed by obtaining the history head position information of user Probability；The total video clip code rate that can be transmitted is calculated according to network bandwidth, play buffer size；Finally, passing through Optimal method, which solves, needs the video clip downloaded, in optimal method, it is contemplated that the overall quality of video, due to space The desired value that the fluctuation of piecemeal bring space quality and video clip are distorted under viewing probability optimizes mould by establishing Type obtains video clip to the client property of can choose, to reduce the data volume of panoramic video transmission, reaches and improves video matter It is complete to improve viewing under the network environment of Bandwidth-Constrained for the purpose of the Caton of amount, the quality fluctuation for reducing space and video playing The user experience of scape video.
In the above embodiment, it is preferable that viewpoint adaptive unit 404, is specifically used for: head position information includes user The Eulerian angles of direction define the Eulerian angles that (α, beta, gamma) is user's direction, wherein it is pitch angle, γ rolling that α, which is yaw angle, β, Angle；Define t0For current time；Definition δ is the predicting interval；DefinitionFor the point on the corresponding spherical surface of video clip, wherein For latitude, θ is longitude；Define UiFor the quantity of the point on the corresponding spherical surface of i-th of video clip；DefinitionFor that can see PointDirection set；According to the Eulerian angles (α, beta, gamma) of user's direction, calculate in (t0+ δ) moment user's direction prediction ValueAnd the correct probability P of the predicted value of user's directionE(α,β,γ)；According to (t0+ δ) the correct probability P of the predicted value of moment user directionE(α, beta, gamma) calculates the point on spherical surface corresponding to video clip The probability being viewedCalculation formula are as follows:Video clip The probability P being viewediFor the mean value for the probability that the point on spherical surface corresponding to video clip is viewed, calculation formula are as follows:
In this embodiment, it defines in each adaptive stage, client needs to carry out the adaptive specific step of viewpoint Suddenly.Specifically, the probability that the point on spherical surface is viewed first is calculated in order to calculate the probability that video piecemeal is seen, it is right In a point on spherical surfaceDue to may all see this point by several directions of user, then this point is seen The probability arrivedIt is calculated as to see the direction set of this pointCorresponding mathematical expectation of probability, it may be assumed thatThe probability P that one video piecemeal is viewediIt is calculated as this video The umbilical point U of piecemealiThe mean value for the probability that point on corresponding spherical surface is viewed, it may be assumed thatIts In, PE(α, β, γ) is in (t0+ δ) moment user's direction predicted value correct probability.
In any of the above-described embodiment, it is preferable that the predicted value of user's direction 's Calculation formula are as follows:
Wherein, mα、mβ、mγFor linear regression parameters；The correct probability P of the predicted value of user's directionEThe calculating of (α, β, γ) Formula are as follows: PE(α, β, γ)=Pyaw(α)Ppitch(β)Proll(λ), wherein Pyaw(α), Ppitch(β), Proll(γ) is respectively inclined Navigate angle, pitch angle, roll angle predicted value correct probability, calculation formula are as follows:
Wherein, μαFor the mean value of yaw angle distribution, σαFor the standard deviation of the predicted value of yaw angle；μβFor pitch angle distribution Mean value, σβFor the standard deviation of the predicted value of pitch angle；μλFor the mean value of roll angle distribution, σλFor the standard of the predicted value of roll angle Difference.
In this embodiment, firstly, being calculated using linear regression in (t0+ δ) moment user's direction predicted valueWherein, mα、mβ、mγFor the parameter in linear regression, these three parameters can be distinguished Using in window [t0-1,t0] yaw angle, the historical data of pitch angle, roll angle in the time, it is asked by least square method Solution.Secondly, by data statistics, in (t0+ δ) moment when user direction predicted value and its true value there are difference, they Between relationship meet Gaussian Profile, i.e. eα~N (μα,σα), eβ~N (μβ,σβ), eγ~N (μγ,σγ), Europe can be calculated as a result, Angle is drawn to predict correct probability component, i.e. Pyaw(α), Ppitch(β), Proll(γ).Due to yaw angle, pitch angle, phase between roll angle It is mutually independent, so Eulerian angles predict correct probability PE(α, β, γ) can be calculated are as follows: PE(α, β, γ)=Pyaw(α)Ppitch(β)Proll (λ)。
In any of the above-described embodiment, it is preferable that code rate adaptive unit 406 is specifically used for: definition T is video clip Duration, each video clip duration are equal；Define bkTo have downloaded the video playing buffer area after k-th of video clip set Size；Define RkFor the total bitrate upper limit value for downloading k-th of video clip set；Define RminTo download k-th of video clip collection The total bitrate minimum value of conjunction；Define CkFor the network bandwidth estimated value in k-th of video clip aggregation process of downloading；Define Btarget For the target value of video playing buffer area；Video playing buffer size b after having downloaded k-th of video clip setkCalculating Formula are as follows:Download the total bitrate upper limit value R of k-th of video clip setkCalculation formula are as follows:
In this embodiment, the rate control algorithm based on destination buffer is defined, to determine that the total of video clip can With code rate, to avoid the Caton played under conditions of minibuffer area.Specifically, the variation of video buffer size be by Network bandwidth and the total bitrate of the video clip set of downloading determine that, when video clip set has been downloaded, screen buffer is big Small increase, with the broadcasting of video, video buffer size reduces.Therefore, the video after having downloaded k-th of video clip set Buffer size may be calculated:In order to avoid Caton occurs for video playing, we are by video buffer Area's size is controlled in a target value, even bk=Btarget, it is possible to find out the total bitrate of k-th of video clip set Are as follows:It is R in order to avoid calculated result is negativekSet a minimum value Rmin, then RkIt can be with It calculates are as follows:
In any of the above-described embodiment, it is preferable that optimize video selecting unit 408, be specifically used for: definition N is video The quantity of segment；Define the code rate grade that M is video clip；Define ri,jIt is i-th of video clip in j-th code rate grade Code rate, wherein 1≤i≤N, 1≤j≤M；Define di,jFor i-th of video clip j-th of code rate grade quality distortion value, In 1≤i≤N, 1≤j≤M；Define xi,jFor i-th of video clip whether being selected in j-th code rate grade, xi,j=1 generation Table is chosen, xi,j=0 representative is not chosen, wherein 1≤i≤N, 1≤j≤M, any i and any j constitute set X, X={ xi,j|1≤ i≤N,1≤j≤M}；Define siFor the area of spherical surface corresponding to i-th of video clip,Defining Φ (X) is video clip Expected distortion；The space quality that Ψ (X) is video clip is defined to change；Define the total bitrate upper limit that R is the video clip Value；The calculation formula of the expected distortion Φ (X) of video clip are as follows:
Wherein, PiThe probability being viewed for video clip；
The calculation formula of space quality variation Ψ (X) of video clip are as follows:
Wherein, PiThe probability being viewed for video clip；
QoE model are as follows:
Wherein, η is optimization aim weight,
In this embodiment, when selecting video clip, need to consider two QoE factors, one is expected distortion, represents Consider the desired value that video clip is distorted under viewing probability；The second is space quality changes, the quality represented in video clip is put down Slip.It therefore, is to maximize QoE to solve the video clip target of client acquisition by establishing optimal model.Specifically, The expected distortion that Φ (X) is video clip is defined, the space quality that Ψ (X) is video clip is defined and changes, define η as optimization aim power Weight, definition R are video clip total bitrate upper limit value, client when selecting video clip total bitrate no more than the value, it is each oneself Laundering period, this value are the total bitrate R of k-th of the video clip set acquired in the code rate adaptive stagek, then, optimization is asked Topic can be with is defined as:Wherein, In each adaptive stage, client is by solving above-mentioned objective function and conditional function, so as to be needed Then the video clip of acquisition sends request to server and is downloaded, next adaptive stage entered after the completion of downloading, directly Terminate to client viewing video.
As shown in figure 5, the schematic block of the Transmission system of the panoramic video of one embodiment according to a fifth aspect of the present invention Figure.The Transmission system 500 includes: the transmitting device 502 such as the panoramic video in above-mentioned any embodiment, is used for server；With And the transmitting device 504 such as the panoramic video in above-mentioned any embodiment, it is used for client.
As shown in fig. 6, the schematic diagram of the computer equipment of one embodiment according to a sixth aspect of the present invention.Wherein, should Computer equipment 1 includes: memory 12, processor 14 and is stored in the calculating that can be run on memory 12 and on processor 14 Machine program, processor 14 are used to execute the step of the transmission method such as the panoramic video for server in above-mentioned any embodiment Suddenly；Or processor 14 is used to execute the step of transmission method for client panoramic video in such as above-mentioned any embodiment.
As shown in fig. 7, the panoramic video transport frame schematic diagram according to an embodiment of the invention based on piecemeal.
In this embodiment, firstly, for space separating number, the width of piecemeal and height, coding parameter, video clip duration Etc. parameters predefined, the configuration file as configuration information；Then, it is got by the processor for executing the video piecemeal The panoramic video and configuration file of ERP format and the processing needed.Specifically, dividing for original panoramic video Block, coding, slice obtain video clip and media description file, and the spatial position of video clip is contained in media description file Information, the encoded information of video clip, the information such as quality distortion of the data volume size of video clip, video clip；Then, will The media description file and media fragment of generation are stored in spare in HTTP server.
Client in network needs to carry out viewpoint adaptively and code rate is adaptive when downloading panoramic video.Wherein, code Rate is adaptive, and it is adaptive to carry out code rate based on the rate control algorithm of destination buffer, specifically, according to network bandwidth, Play buffer size calculates the total video clip code rate that can be transmitted；Viewpoint is adaptive, is based on a kind of viewing probability mould The probability that type prediction video piecemeal is viewed, specifically, being predicted not by the history head position information for obtaining user Carry out the probability that piecemeal is viewed.Finally, client solves the video clip for needing to download by optimal method, optimizing In method, the present invention considers the overall quality of video, since space separating bring space quality fluctuates, to reach raising The purpose of the Caton of video quality, the quality fluctuation for reducing space and video playing.
As shown in figure 8, the schematic diagram according to an embodiment of the invention for carrying out piecemeal processing to panoramic video.
In this embodiment, piecemeal, coding, slice are carried out for original panoramic video and obtains video clip and media description File.The related notion that the method wherein handled is related to is as follows: defining the width that W is panoramic video；Defining H is panoramic video It is high；Define the quantity that N is video piecemeal；Define the code rate grade that M is video；Define ri,jIt is i-th of video piecemeal at j-th The actual bit rate size of the video clip of code rate grade, wherein 1≤i≤N, 1≤j≤M；Define di,jExist for i-th of video piecemeal The distortion value of the video clip of j-th of code rate grade, wherein 1≤i≤N, 1≤j≤M.
As shown in figure 9, the schematic diagram that user's direction according to an embodiment of the invention is indicated with Eulerian angles.Its In, the head of user is indicated directed through Eulerian angles, is yaw angle, pitch angle, roll angle respectively.
As shown in Figure 10, user according to an embodiment of the invention counts towards predicted value and true value difference data Schematic diagram.
In this embodiment, pass through data statistics, it is shown that in (t0+ δ) moment when user's head direction predicted valueWith the difference of its true value, the relationship between them meets Gaussian Profile, i.e. eα~N (μα,σα), eβ~N (μβ,σβ), eγ~N (μγ,σγ), wherein μαFor the mean value of yaw angle distribution, σαFor the predicted value of yaw angle Standard deviation；μβFor the mean value of pitch angle distribution, σβFor the standard deviation of the predicted value of pitch angle；μλFor roll angle distribution mean value, σλFor the standard deviation of the predicted value of roll angle.Eulerian angles prediction correct probability component, i.e. P can be calculated as a result,yaw(α), Ppitch (β), Proll(γ).Due to yaw angle, pitch angle is mutually indepedent between roll angle, so Eulerian angles predict correct probability PE(α, β, γ) it can calculate are as follows: PE(α, β, γ)=Pyaw(α)Ppitch(β)Proll(λ)。
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field For art personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, made any to repair Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.

Claims (19)

1. a kind of transmission method of panoramic video, it to be used for server, which is characterized in that the transmission method includes:
Piecemeal, coding, slicing treatment are carried out to the panoramic video according to preset configuration information, obtain video clip and media File is described；
The video clip and the media description file are stored in the server.
2. the transmission method of panoramic video according to claim 1, which is characterized in that
The format of the panoramic video includes ERP format, CMP format；
The configuration information includes: quantity, width, height, the playing duration of the video clip, coding parameter and code rate Grade.
3. the transmission method of panoramic video according to claim 1, which is characterized in that
The media description file include the spatial positional information of the video clip, encoded information, code rate, quality distortion value, Uniform resource locator.
4. a kind of transmission method of panoramic video is used for client, with aphorama as claimed any one in claims 1 to 3 The transmission method of frequency is used for server, is used cooperatively, which is characterized in that the transmission method includes:
The media file is obtained and parsed from the server end, and the video clip is downloaded according to the media file；
In downloading process, user's head location information is obtained, according to video clip quilt described in the head position information prediction The probability watched；
Video playing buffer size is calculated, according to network bandwidth estimated value and video playing buffer size calculating The total bitrate upper limit value of video clip；
Space quality variation and the expected distortion of the video clip for calculating the video clip, according to the video clip Space quality variation, expected distortion, establish QoE model, selection needs the video clip downloaded.
5. the transmission method of panoramic video according to claim 4, which is characterized in that user's head location information is obtained, According to the step of the probability that video clip described in the head position information prediction is viewed, specifically include:
The head position information includes the Eulerian angles of user's direction, defines the Eulerian angles that (α, beta, gamma) is user's direction, Wherein, it is pitch angle, γ roll angle that α, which is yaw angle, β,；
Define t0For current time, definition δ is the predicting interval；
DefinitionFor the point on the corresponding spherical surface of the video clip, whereinFor latitude, θ is longitude；
Define UiFor the quantity of the point on the corresponding spherical surface of i-th of video clip；
DefinitionFor that can see a littleDirection set；
According to the Eulerian angles (α, beta, gamma) of user's direction, calculate in (t0+ δ) moment user's direction predicted valueAnd the correct probability P of the predicted value of user's directionE(α,β,γ)；
According to (the t0+ δ) moment user's direction predicted value correct probability PE(α, beta, gamma) calculates the video clip institute Point on corresponding spherical surfaceThe probability being viewedCalculation formula are as follows:
The probability P that the video clip is viewediThe probability being viewed for the point on spherical surface corresponding to the video clip Mean value, calculation formula are as follows:
6. the transmission method of panoramic video according to claim 5, which is characterized in that
The predicted value of user's directionCalculation formula are as follows:
Wherein, mα、mβ、mγFor linear regression parameters；
The correct probability P of the predicted value of user's directionEThe calculation formula of (α, β, γ) are as follows:
PE(α, β, γ)=Pyaw(α)Ppitch(β)Proll(λ),
Wherein, Pyaw(α), Ppitch(β), Proll(γ) is respectively the yaw angle, the pitch angle, the roll angle predicted value Correct probability, calculation formula are as follows:
Wherein,
μαFor the mean value of yaw angle distribution, σαFor the standard deviation of the predicted value of the yaw angle；
μβFor the mean value of pitch angle distribution, σβFor the standard deviation of the predicted value of the pitch angle；
μλFor the mean value of roll angle distribution, σλFor the standard deviation of the predicted value of the roll angle.
7. the transmission method of panoramic video according to claim 4, which is characterized in that the calculating video playing buffer area Size calculates the total bitrate upper limit value of the video clip according to network bandwidth estimated value and the video playing buffer size The step of, it specifically includes:
Definition T is the video clip duration, and each video clip duration is equal；
Define bkTo have downloaded the video playing buffer size after k-th of video clip set；
Define RkFor the total bitrate upper limit value for downloading k-th of video clip set；
Define RminFor the total bitrate minimum value for downloading k-th of video clip set；
Define CkFor the network bandwidth estimated value in k-th of video clip aggregation process of downloading；
Define BtargetFor the target value of the video playing buffer area；
The video playing buffer size b after having downloaded k-th of video clip setkCalculation formula are as follows:
Download the total bitrate upper limit value R of k-th of video clip setkCalculation formula are as follows:
8. the transmission method of panoramic video according to claim 4, which is characterized in that
Define the quantity that N is the video clip；
Define the code rate grade that M is the video clip；
Define ri,jFor i-th of video clip j-th of code rate grade code rate, wherein 1≤i≤N, 1≤j≤M；
Define di,jFor i-th of video clip j-th of code rate grade quality distortion value, wherein 1≤i≤N, 1≤j≤ M；
Define xi,jFor i-th of video clip whether being selected in j-th code rate grade, xi,j=1 represents selection, xi,j=0 generation Table is not chosen, wherein 1≤i≤N, 1≤j≤M, any i and any j constitute set X, X={ xi,j|1≤i≤N,1≤j≤M}；
Define siFor the area of spherical surface corresponding to i-th of video clip,
Define the expected distortion that Φ (X) is the video clip；
The space quality that Ψ (X) is video clip is defined to change；
Define the total bitrate upper limit value that R is the video clip；
The calculation formula of the expected distortion Φ (X) of the video clip are as follows:
PiThe probability being viewed for the video clip；
The calculation formula of space quality variation Ψ (X) of the video clip are as follows:
PiThe probability being viewed for the video clip；
The QoE model are as follows:Wherein, η is optimization aim weight,
9. a kind of transmitting device of panoramic video, it to be used for server, which is characterized in that the transmitting device includes:
Processing unit is obtained for carrying out piecemeal, coding, slicing treatment to the panoramic video according to preset configuration information Video clip and media description file；
Storage unit, for the video clip and the media description file to be stored in the server.
10. the transmitting device of panoramic video according to claim 9, which is characterized in that
The format of the panoramic video includes ERP format, CMP format；
The configuration information includes: quantity, width, height, the playing duration of the video clip, coding parameter and code rate Grade.
11. the transmitting device of panoramic video according to claim 9, which is characterized in that
The media description file include the spatial positional information of the video clip, encoded information, code rate, quality distortion value, Uniform resource locator.
12. a kind of transmitting device of panoramic video is used for client, with the panorama as described in any one of claim 9 to 11 The transmitting device of video is used for server, is used cooperatively, which is characterized in that the transmitting device includes:
Download unit downloads institute according to the media file for the media file to be obtained and parsed from the server end State video clip；
Viewpoint adaptive unit, for user's head location information being obtained, according to the head position information in downloading process Predict the probability that the video clip is viewed；
Code rate adaptive unit is broadcast for calculating video playing buffer size according to network bandwidth estimated value and the video Put the total bitrate upper limit value that buffer size calculates the video clip；
Video selecting unit is optimized, the space quality for calculating the video clip changes and the phase of the video clip It hopes distortion, according to the variation of the space quality of the video clip, expected distortion, establishes QoE model, selection needs to download described Video clip.
13. the transmitting device of panoramic video according to claim 12, which is characterized in that the viewpoint adaptive unit, It is specifically used for:
The head position information includes the Eulerian angles of user's direction, defines the Eulerian angles that (α, beta, gamma) is user's direction, Wherein, it is pitch angle, γ roll angle that α, which is yaw angle, β,；
Define t0For current time, definition δ is the predicting interval；
DefinitionFor the point on the corresponding spherical surface of the video clip, whereinFor latitude, θ is longitude；
Define UiFor the quantity of the point on the corresponding spherical surface of i-th of video clip；
DefinitionFor that can see a littleDirection set；
According to the Eulerian angles (α, beta, gamma) of user's direction, calculate in (t0+ δ) moment user's direction predicted valueAnd the correct probability P of the predicted value of user's directionE(α,β,γ)；
According to (the t0+ δ) moment user's direction predicted value correct probability PE(α, beta, gamma) calculates the video clip institute Point on corresponding spherical surfaceThe probability being viewedCalculation formula are as follows:
The probability P that the video clip is viewediThe probability being viewed for the point on spherical surface corresponding to the video clip Mean value, calculation formula are as follows:
14. the transmitting device of panoramic video according to claim 13, which is characterized in that
The predicted value of user's directionCalculation formula are as follows:
mα、mβ、mγFor linear regression parameters；
The correct probability P of the predicted value of user's directionEThe calculation formula of (α, β, γ) are as follows:
PE(α, β, γ)=Pyaw(α)Ppitch(β)Proll(λ),
Wherein, Pyaw(α), Ppitch(β), Proll(γ) is respectively the yaw angle, the pitch angle, the roll angle predicted value Correct probability, calculation formula are as follows:
Wherein,
μαFor the mean value of yaw angle distribution, σαFor the standard deviation of the predicted value of the yaw angle；
μβFor the mean value of pitch angle distribution, σβFor the standard deviation of the predicted value of the pitch angle；
μλFor the mean value of roll angle distribution, σλFor the standard deviation of the predicted value of the roll angle.
15. the transmitting device of panoramic video according to claim 12, which is characterized in that the code rate adaptive unit, It is specifically used for:
Definition T is the video clip duration, and each video clip duration is equal；
Define bkTo have downloaded the video playing buffer size after k-th of video clip set；
Define RkFor the total bitrate upper limit value for downloading k-th of video clip set；
Define RminFor the total bitrate minimum value for downloading k-th of video clip set；
Define CkFor the network bandwidth estimated value in k-th of video clip aggregation process of downloading；
Define BtargetFor the target value of the video playing buffer area；
The video playing buffer size b after having downloaded k-th of video clip setkCalculation formula are as follows:
Download the total bitrate upper limit value R of k-th of video clip setkCalculation formula are as follows:
16. the transmitting device of panoramic video according to claim 12, which is characterized in that the optimization video selection list Member is specifically used for:
Define the quantity that N is the video clip；
Define the code rate grade that M is the video clip；
Define ri,jFor i-th of video clip j-th of code rate grade code rate, wherein 1≤i≤N, 1≤j≤M；
Define di,jFor i-th of video clip j-th of code rate grade quality distortion value, wherein 1≤i≤N, 1≤j≤ M；
Define xi,jFor i-th of video clip whether being selected in j-th code rate grade, xi,j=1 represents selection, xi,j=0 generation Table is not chosen, wherein 1≤i≤N, 1≤j≤M, any i and any j constitute set X, X={ xi,j|1≤i≤N,1≤j≤M}；
Define siFor the area of spherical surface corresponding to i-th of video clip,
Define the expected distortion that Φ (X) is the video clip；
The space quality that Ψ (X) is video clip is defined to change；
Define the total bitrate upper limit value that R is the video clip；
The calculation formula of the expected distortion Φ (X) of the video clip are as follows:
PiThe probability being viewed for the video clip；
The calculation formula of space quality variation Ψ (X) of the video clip are as follows:
PiThe probability being viewed for the video clip；
The QoE model are as follows:Wherein, η is optimization aim weight,
17. a kind of Transmission system of panoramic video characterized by comprising complete as described in any one of claim 9 to 11 The transmitting device of scape video is used for client；And the transmission of the panoramic video as described in any one of claim 12 to 16 Device is used for server end.
18. a kind of computer equipment, including memory, processor and it is stored on the memory and can be on the processor The computer program of operation, which is characterized in that the processor is complete as claimed any one in claims 1 to 3 for executing The step of transmission method of scape video；Or the processor is used to execute the aphorama as described in any one of claim 4 to 8 The step of transmission method of frequency.
19. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program The step of transmission method of panoramic video as claimed any one in claims 1 to 3 is realized when being executed by processor；Or institute State the transmission side that the panoramic video as described in any one of claim 4 to 8 is realized when computer program is executed by processor The step of method.
CN201710590143.6A 2017-07-19 2017-07-19 Panoramic video transmission method, transmission device and transmission system Expired - Fee Related CN109286855B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710590143.6A CN109286855B (en) 2017-07-19 2017-07-19 Panoramic video transmission method, transmission device and transmission system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710590143.6A CN109286855B (en) 2017-07-19 2017-07-19 Panoramic video transmission method, transmission device and transmission system

Publications (2)

Publication Number Publication Date
CN109286855A true CN109286855A (en) 2019-01-29
CN109286855B CN109286855B (en) 2020-10-13

Family

ID=65184903

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710590143.6A Expired - Fee Related CN109286855B (en) 2017-07-19 2017-07-19 Panoramic video transmission method, transmission device and transmission system

Country Status (1)

Country Link
CN (1) CN109286855B (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109714631A (en) * 2019-02-26 2019-05-03 华南理工大学 One kind being based on HTTP video flowing dynamic self-adaptation bit-rate selection method
CN110099294A (en) * 2019-06-11 2019-08-06 山东大学 A kind of dynamic self-adapting streaming media bit rate distribution method of the holding space-time consistency for 360 degree of videos
CN110602506A (en) * 2019-09-25 2019-12-20 咪咕视讯科技有限公司 Video processing method, network device and computer readable storage medium
CN112055263A (en) * 2020-09-08 2020-12-08 西安交通大学 360-degree video streaming transmission system based on significance detection
CN112565208A (en) * 2020-11-24 2021-03-26 鹏城实验室 Multi-user panoramic video cooperative transmission method, system and storage medium
CN112584119A (en) * 2020-11-24 2021-03-30 鹏城实验室 Self-adaptive panoramic video transmission method and system based on reinforcement learning
CN112714315A (en) * 2019-10-24 2021-04-27 上海交通大学 Layered buffering method and system based on panoramic video
CN112738646A (en) * 2019-10-28 2021-04-30 阿里巴巴集团控股有限公司 Data processing method, device, system, readable storage medium and server
CN112822564A (en) * 2021-01-06 2021-05-18 鹏城实验室 Viewpoint-based panoramic video adaptive streaming media transmission method and system
CN112929691A (en) * 2021-01-29 2021-06-08 复旦大学 Multi-user panoramic video transmission method
CN113453076A (en) * 2020-03-24 2021-09-28 中国移动通信集团河北有限公司 User video service quality evaluation method and device, computing equipment and storage medium
CN114640870A (en) * 2022-03-21 2022-06-17 陕西师范大学 QoE-driven wireless VR video self-adaptive transmission optimization method and system
CN114979799A (en) * 2022-05-20 2022-08-30 北京字节跳动网络技术有限公司 Panoramic video processing method, device, equipment and storage medium
CN115278354A (en) * 2022-06-14 2022-11-01 北京大学 Method and system for evaluating and optimizing video transmission quality based on user behavior index
WO2023197811A1 (en) * 2022-04-12 2023-10-19 北京字节跳动网络技术有限公司 Video downloading method and apparatus, video transmission method and apparatus, terminal device, server and medium
CN117596376A (en) * 2024-01-18 2024-02-23 深圳大学 360-degree video intelligent edge transmission method, system, wearable device and medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105323552A (en) * 2015-10-26 2016-02-10 北京时代拓灵科技有限公司 Method and system for playing panoramic video
CN105915937A (en) * 2016-05-10 2016-08-31 上海乐相科技有限公司 Panoramic video playing method and device
US20160260196A1 (en) * 2015-03-05 2016-09-08 Nokia Technologies Oy Video streaming method
CN106060515A (en) * 2016-07-14 2016-10-26 腾讯科技（深圳）有限公司 Panoramic media file push method and apparatus
JP6058184B1 (en) * 2016-03-10 2017-01-11 株式会社コロプラ Method and program for controlling head mounted display system
CN106537894A (en) * 2014-07-14 2017-03-22 索尼互动娱乐股份有限公司 System and method for use in playing back panorama video content

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106537894A (en) * 2014-07-14 2017-03-22 索尼互动娱乐股份有限公司 System and method for use in playing back panorama video content
US20160260196A1 (en) * 2015-03-05 2016-09-08 Nokia Technologies Oy Video streaming method
CN105323552A (en) * 2015-10-26 2016-02-10 北京时代拓灵科技有限公司 Method and system for playing panoramic video
JP6058184B1 (en) * 2016-03-10 2017-01-11 株式会社コロプラ Method and program for controlling head mounted display system
CN105915937A (en) * 2016-05-10 2016-08-31 上海乐相科技有限公司 Panoramic video playing method and device
CN106060515A (en) * 2016-07-14 2016-10-26 腾讯科技（深圳）有限公司 Panoramic media file push method and apparatus

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
ARNOB GHOSH 等: "A rate adaptation algorithm for tile-based 360-degree video streaming", 《ARXIV:1704.08215 MULTIMEDIA (CS.MM); NETWORKING AND INTERNET ARCHITECTURE (CS.NI)》 *
FENG QIAN 等: "Optimizing 360 Video Delivery Over Cellular Networks", 《ALLTHINGSCELLULAR: OPERATIONS,APPLICATIONS AND CHALLENGES ACM》 *
LAN XIE,CHAO ZHOU，XINGGONG ZHANG, ZONGMING GUO: "Dynamic Threshold Based Rate Adaptation for", 《PROC. OF IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS & SYSTEMS》 *

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109714631A (en) * 2019-02-26 2019-05-03 华南理工大学 One kind being based on HTTP video flowing dynamic self-adaptation bit-rate selection method
CN110099294A (en) * 2019-06-11 2019-08-06 山东大学 A kind of dynamic self-adapting streaming media bit rate distribution method of the holding space-time consistency for 360 degree of videos
CN110099294B (en) * 2019-06-11 2021-05-07 山东大学 Dynamic self-adaptive streaming media code rate allocation method for keeping space-time consistency of 360-degree video
CN110602506A (en) * 2019-09-25 2019-12-20 咪咕视讯科技有限公司 Video processing method, network device and computer readable storage medium
CN110602506B (en) * 2019-09-25 2023-04-28 咪咕视讯科技有限公司 Video processing method, network device and computer readable storage medium
CN112714315A (en) * 2019-10-24 2021-04-27 上海交通大学 Layered buffering method and system based on panoramic video
CN112738646A (en) * 2019-10-28 2021-04-30 阿里巴巴集团控股有限公司 Data processing method, device, system, readable storage medium and server
CN113453076B (en) * 2020-03-24 2023-07-14 中国移动通信集团河北有限公司 User video service quality evaluation method, device, computing equipment and storage medium
CN113453076A (en) * 2020-03-24 2021-09-28 中国移动通信集团河北有限公司 User video service quality evaluation method and device, computing equipment and storage medium
CN112055263A (en) * 2020-09-08 2020-12-08 西安交通大学 360-degree video streaming transmission system based on significance detection
CN112584119A (en) * 2020-11-24 2021-03-30 鹏城实验室 Self-adaptive panoramic video transmission method and system based on reinforcement learning
CN112565208A (en) * 2020-11-24 2021-03-26 鹏城实验室 Multi-user panoramic video cooperative transmission method, system and storage medium
CN112822564A (en) * 2021-01-06 2021-05-18 鹏城实验室 Viewpoint-based panoramic video adaptive streaming media transmission method and system
CN112929691A (en) * 2021-01-29 2021-06-08 复旦大学 Multi-user panoramic video transmission method
CN112929691B (en) * 2021-01-29 2022-06-14 复旦大学 Multi-user panoramic video transmission method
CN114640870A (en) * 2022-03-21 2022-06-17 陕西师范大学 QoE-driven wireless VR video self-adaptive transmission optimization method and system
CN114640870B (en) * 2022-03-21 2023-10-03 陕西师范大学 QoE-driven wireless VR video self-adaptive transmission optimization method and system
WO2023197811A1 (en) * 2022-04-12 2023-10-19 北京字节跳动网络技术有限公司 Video downloading method and apparatus, video transmission method and apparatus, terminal device, server and medium
CN114979799A (en) * 2022-05-20 2022-08-30 北京字节跳动网络技术有限公司 Panoramic video processing method, device, equipment and storage medium
CN115278354A (en) * 2022-06-14 2022-11-01 北京大学 Method and system for evaluating and optimizing video transmission quality based on user behavior index
CN117596376A (en) * 2024-01-18 2024-02-23 深圳大学 360-degree video intelligent edge transmission method, system, wearable device and medium
CN117596376B (en) * 2024-01-18 2024-04-19 深圳大学 360-Degree video intelligent edge transmission method, system, wearable device and medium

Also Published As

Publication number Publication date
CN109286855B (en) 2020-10-13

Similar Documents

Publication Publication Date Title
CN109286855A (en) Transmission method, transmitting device and the Transmission system of panoramic video
US20230283653A1 (en) Methods and apparatus to reduce latency for 360-degree viewport adaptive streaming
Xie et al. 360ProbDASH: Improving QoE of 360 video streaming using tile-based HTTP adaptive streaming
US10389784B2 (en) Method and device for generating a description file, and corresponding streaming method
Gaddam et al. Tiling in interactive panoramic video: Approaches and evaluation
Chiariotti A survey on 360-degree video: Coding, quality of experience and streaming
CN110149542B (en) Transmission control method
US11095936B2 (en) Streaming media transmission method and client applied to virtual reality technology
JP2023011620A (en) Spatially unequal streaming
de la Fuente et al. Delay impact on MPEG OMAF’s tile-based viewport-dependent 360 video streaming
CN108271044A (en) A kind of processing method and processing device of information
CN108810427B (en) Viewpoint-based panoramic video content representation method and apparatus
US11159823B2 (en) Multi-viewport transcoding for volumetric video streaming
US20200404241A1 (en) Processing system for streaming volumetric video to a client device
US20230123256A1 (en) No reference realtime video quality assessment
CA3057894C (en) Video compression using down-sampling patterns in two phases
EP3637722A1 (en) Method and apparatus for processing media information
Huang et al. A cloud computing based deep compression framework for UHD video delivery
WO2023226504A1 (en) Media data processing methods and apparatuses, device, and readable storage medium
WO2022206200A1 (en) Point cloud encoding method and apparatus, point cloud decoding method and apparatus, and computer-readable medium, and electronic device
WO2018120857A1 (en) Streaming media technology-based method and apparatus for processing video data
Cho et al. 360-degree video traffic reduction using cloud streaming in mobile

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20230414

Address after: 100871 No. 5, the Summer Palace Road, Beijing, Haidian District

Patentee after: Peking University

Address before: 100871 No. 5, the Summer Palace Road, Beijing, Haidian District

Patentee before: Peking University

Patentee before: PEKING UNIVERSITY FOUNDER GROUP Co.,Ltd.

Patentee before: BEIJING FOUNDER ELECTRONICS Co.,Ltd.

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20201013