CN109218739A - View angle switch method, apparatus, equipment and the computer storage medium of video flowing - Google Patents
View angle switch method, apparatus, equipment and the computer storage medium of video flowing Download PDFInfo
- Publication number
- CN109218739A CN109218739A CN201710547015.3A CN201710547015A CN109218739A CN 109218739 A CN109218739 A CN 109218739A CN 201710547015 A CN201710547015 A CN 201710547015A CN 109218739 A CN109218739 A CN 109218739A
- Authority
- CN
- China
- Prior art keywords
- video
- video flowing
- visual angle
- fragment
- road
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The present invention provides view angle switch method, apparatus, equipment and the computer storage mediums of a kind of video flowing, wherein, video sending end generates the road N video flowing for each visual angle respectively, it is poor successively to there is preset time between the same fragment of each road video flowing, the time difference is less than fragment length, and N is the integer greater than 1.Video receiver obtains triggering video flowing from the first view angle switch to the event at the second visual angle；From the road the N video flowing at the second visual angle, determine that fragment initial time meets the fragment to impose a condition after the time of origin of the event and with the difference of the time of origin；The target video stream where the fragment is downloaded since the fragment determined；After the initial time of the video render to the fragment determined at the first visual angle, the target video stream of downloading is played.The present invention can shorten the time of video flowing view angle switch, and user is made to experience the video flowing of image clearly as early as possible.
Description
[technical field]
The present invention relates to computer application technology, in particular to the view angle switch method, apparatus of a kind of video flowing is set
Standby and computer storage medium.
[background technique]
The compress technique of panoramic video has become the research of virtual reality (VR, Virtual Reality) technical field
Emphasis, panoramic video usually in video code conversion, need panoramic video mapping to expand into flat image, can during mapping expansion
Different models, such as Equirectangular (equidistant rectangular conic projection) model, CubeMap (isometric chart throwing can be used
Shadow) model, Pyramid (pyramid projection) model, Pyramid mutation model etc..Some of models are code rate indifferences
The model of distribution, such as Equirectangular model and CubeMap model, expansion plane of these models in panoramic video
On evenly distribute code rate.And other models are the Data Rate Distribution models based on visual angle, such as Pyramid model and Pyramid
Panoramic video can be divided into multi-channel video by mutation model, these models, so that having in certain viewing angles per the video mapped all the way
There is fine definition, and reduce resolution ratio, i.e. code rate centralized distribution in certain viewing angles in the place far from this visual angle, to drop
Low every coded image area mapped all the way, also allows for code rate a sharp decline of coding.
And Pyramid model and its mutation model, due to being seen to reduce per visual angle all the way by the way of multichannel mapping
Code distinguishability when seeing will necessarily downloaded in video receiver when the visual angle that user watches panoramic video changes
It is switched between the encoding stream of each different perspectives when video flowing.The encoding stream at usual each visual angle can be with GOP
(Group ofPictures, image group) is that unit is switched over and is aligned, and GOP is the one group of coding view started with an I frame
Frequency frame.Due to the coding of I frame be without reference to rely on other any frames, the switching between the video flowing at each visual angle is just
It can be as unit of GOP.As shown in Figure 1, the encoding code stream difference cutting of three different perspectivess is the fragment as unit of GOP,
The length of each switching is consistent, such as 1 second.And need to guarantee that the GOP of different perspectives is close alignment, at visual angle 1
GOP1 occur view angle switch when, if being switched to visual angle 3, video receiver can be since the GOP2 of the video flowing at visual angle 3
Downloading, to realize the seamless play of video flowing.
For example, as shown in Fig. 2, if view angle switch occurs for user since the T1 time point of the GOP1 at visual angle 1, from
T1 time point starts to download the GOP2 at visual angle 3.It is finished Deng the GOP1 to visual angle 1, starts video receiver at T2 time point
The video flowing for playing visual angle 3 is switched to, i.e., is played since the GOP2 at visual angle 3.Switching due to playing video flowing can only be in GOP
Boundary, so even network speed of download is very fast, user is also merely able to be switched to the video at visual angle 3 at the time point of T2 earliest
It is watched on stream.And from T1 to T2 in this period, although the variation that user perspective has occurred and that, but still in viewing visual angle 1
Video flowing, image definition is poor, and user experience is bad.
[summary of the invention]
In view of this, the present invention provides the storages of a kind of view angle switch method, apparatus of video flowing, equipment and computer to be situated between
Matter makes user experience the video flowing of image clearly as early as possible in order to shorten the time of video flowing view angle switch.
Specific technical solution is as follows:
The present invention provides a kind of view angle switch methods of video flowing, this method comprises:
Triggering video flowing is obtained from the first view angle switch to the event at the second visual angle；
From the road the N video flowing at the second visual angle, determine fragment initial time after the time of origin of the event and with
The difference of the time of origin meets the fragment to impose a condition；
The target video stream where the fragment is downloaded since the fragment determined；
After the initial time of the video render to the fragment determined at the first visual angle, the mesh of downloading is played
Mark video flowing；
It is poor wherein successively to there is preset time between the same fragment of the road the N video flowing at second visual angle, the time difference
Less than fragment length, N is the integer greater than 1.
A preferred embodiment according to the present invention, the acquisition trigger video flowing from the first view angle switch to the second visual angle
Event includes:
Triggering video flowing is received from the first view angle switch to the instruction at the second visual angle；Alternatively,
Triggering video flowing is captured from the first view angle switch to the gesture at the second visual angle；Alternatively,
Detect user perspective from the first view transformation be the second visual angle.
A preferred embodiment according to the present invention, the road N video use identical code rate, and in the video of each video flowing
Appearance is aligned in time.
A preferred embodiment according to the present invention, the road N video flowing use identical fragment length.
A preferred embodiment according to the present invention, the setting condition includes: nearest apart from the time of origin.
A preferred embodiment according to the present invention, the fragment include an image group GOP.
A preferred embodiment according to the present invention, the video flowing are the video flowing of panoramic video.
The present invention also provides a kind of production methods of video flowing, this method comprises:
The road N video flowing is generated respectively for each visual angle, successively there is preset time between the same fragment of each road video flowing
Difference, the time difference are less than fragment length, and N is the integer greater than 1.
A preferred embodiment according to the present invention, the road N video use identical code rate, and in the video of each video flowing
Appearance is aligned in time.
A preferred embodiment according to the present invention, the road N video flowing use identical fragment length.
A preferred embodiment according to the present invention, this method further include:
The road the N video flowing at each visual angle is stored in preset memory space, and by the downloading of each road video flowing at each visual angle
Address is supplied to video receiver.
A preferred embodiment according to the present invention, the fragment include an image group GOP.
A preferred embodiment according to the present invention, the video flowing are the video flowing of panoramic video.
The present invention also provides a kind of view angle switch device of video flowing, which includes:
Event acquiring unit, for obtaining triggering video flowing from the first view angle switch to the event at the second visual angle；
Target determination unit, for determining fragment initial time in the event from the road the N video flowing at the second visual angle
Meet the fragment to impose a condition after time of origin and with the difference of the time of origin；
Video download unit, for where downloading the fragment since the fragment that the target determination unit is determined
Target video stream；
Video playback unit, for the video render at the first visual angle to the initial time of the fragment determined
Afterwards, the target video stream of downloading is played；
It is poor wherein successively to there is preset time between the same fragment of the road the N video flowing at second visual angle, the time difference
Less than fragment length, N is the integer greater than 1.
A preferred embodiment according to the present invention, the event acquiring unit are cut in acquisition triggering video flowing from the first visual angle
It is specific to execute when shifting to the event at the second visual angle:
Triggering video flowing is received from the first view angle switch to the instruction at the second visual angle；Alternatively,
Triggering video flowing is captured from the first view angle switch to the gesture at the second visual angle；Alternatively,
Detect user perspective from the first view transformation be the second visual angle.
A preferred embodiment according to the present invention, the road N video use identical code rate, and in the video of each video flowing
Appearance is aligned in time.
A preferred embodiment according to the present invention, the road N video flowing use identical fragment length.
A preferred embodiment according to the present invention, the setting condition includes: nearest apart from the time of origin.
A preferred embodiment according to the present invention, the fragment include an image group GOP.
A preferred embodiment according to the present invention, the video flowing are the video flowing of panoramic video.
The present invention also provides a kind of generation device of video flowing, which includes:
Video stream generation unit, for generating the road N video flowing respectively for each visual angle, the same fragment of each road video flowing it
Between successively to there is preset time poor, which is less than fragment length, and N is the integer greater than 1.
A preferred embodiment according to the present invention, the road N video use identical code rate, and in the video of each video flowing
Appearance is aligned in time.
A preferred embodiment according to the present invention, the road N video flowing use identical fragment length.
A preferred embodiment according to the present invention, the device further include:
Storage processing unit, for the road the N video flowing at each visual angle to be stored in preset memory space, and by each visual angle
The download address of each road video flowing is supplied to video receiver.
A preferred embodiment according to the present invention, the fragment include an image group GOP.
A preferred embodiment according to the present invention, the video flowing are the video flowing of panoramic video.
The present invention also provides a kind of equipment, including
Memory, including one or more program；
One or more processor is coupled to the memory, executes one or more of programs, on realizing
State the operation executed in method.
The present invention also provides a kind of equipment, including
Memory, including one or more program；
One or more processor is coupled to the memory, executes one or more of programs, on executing
State the operation executed in method.
The present invention also provides a kind of computer storage medium, the computer storage medium is encoded with computer journey
Sequence, described program by one or more computers when being executed, so that one or more of computers execute in the above method
The operation of execution.
The present invention also provides a kind of computer storage medium, the computer storage medium is encoded with computer journey
Sequence, described program by one or more computers when being executed, so that one or more of computers execute in the above method
The operation of execution.
As can be seen from the above technical solutions, each visual angle is respectively present the interlaced video flowing in the road N, i.e. N in the present invention
Successively there is the preset time difference less than fragment length between the same fragment of road video flowing.Video flowing is got from the first view
After angle switches to the event at the second visual angle, it can determine in the road the N video flowing at the second visual angle, fragment initial time is in the event
Time of origin after and with the difference of the time of origin meet impose a condition fragment so that from the fragment determined
Target video stream where fragment initial time can switch to the fragment plays out, without waiting until current slice knot
Shu Caineng plays out switching, can shorten waiting time when video flowing switches between different perspectives, makes user's body as early as possible
Test the video flowing of image clearly.
[Detailed description of the invention]
Fig. 1 is the schematic diagram of each view video stream in the prior art；
Fig. 2 is the schematic diagram that video flowing switches between different perspectives in the prior art；
Fig. 3 is the system composition schematic diagram that the embodiment of the present invention is based on；
Fig. 4 a is a schematic diagram of each view video stream provided in an embodiment of the present invention；
Fig. 4 b is another schematic diagram of each view video stream provided in an embodiment of the present invention；
Fig. 5 is view angle switch method flow diagram provided in an embodiment of the present invention；
Fig. 6 a and Fig. 6 b are respectively that there are view angle switch occurs when two-path video stream at each visual angle provided in an embodiment of the present invention
Instance graph；
Fig. 7 a and Fig. 7 b are respectively that there are view angle switch occurs when four road video flowings at each visual angle provided in an embodiment of the present invention
Instance graph；
Fig. 8 is a structure drawing of device provided in an embodiment of the present invention；
Fig. 9 is another structure drawing of device provided in an embodiment of the present invention；
Figure 10 is equipment structure chart provided in an embodiment of the present invention.
[specific embodiment]
To make the objectives, technical solutions, and advantages of the present invention clearer, right in the following with reference to the drawings and specific embodiments
The present invention is described in detail.
The term used in embodiments of the present invention is only to be not intended to be limiting merely for for the purpose of describing particular embodiments
The present invention.In the embodiment of the present invention and the "an" of singular used in the attached claims, " described " and "the"
It is also intended to including most forms, unless the context clearly indicates other meaning.
It should be appreciated that term "and/or" used herein is only a kind of incidence relation for describing affiliated partner, indicate
There may be three kinds of relationships, for example, A and/or B, can indicate: individualism A, exist simultaneously A and B, individualism B these three
Situation.In addition, character "/" herein, typicallys represent the relationship that forward-backward correlation object is a kind of "or".
Depending on context, word as used in this " if " can be construed to " ... when " or " when ...
When " or " in response to determination " or " in response to detection ".Similarly, depend on context, phrase " if it is determined that " or " if detection
(condition or event of statement) " can be construed to " when determining " or " in response to determination " or " when the detection (condition of statement
Or event) when " or " in response to detection (condition or event of statement) ".
The system that the embodiment of the present invention is based on can be as shown in Figure 3, which mainly includes video sending end and view
Frequency receiving end.Wherein video sending end on the one hand be used to generate video flowing, i.e., to video data carry out transcoding (decoding, mapping and
Coding etc. processing) after obtain video flowing.On the other hand it is downloaded for providing video flowing for video receiver.For such as aphorama
The Pyramid mapping mode or Pyramid mutation mapping mode of frequency, video sending end can carry out different views to same video data
The mapping at angle is handled, and respectively obtains the video flowing for each visual angle.Video receiver, which is responsible for downloading and play video sending end, to be mentioned
The video flowing of confession.If Pyramid mapping mode or Pyramid mutation mapping side of the video sending end using such as panoramic video
Formula, then visual angle of the video receiver according to active user, downloads and plays the video flowing at corresponding visual angle.When the visual angle of user occurs
When switching, the video flowing of respective downloaded and broadcasting is also required to that the switching at visual angle occurs.
In embodiments of the present invention, the road N video flowing is generated respectively for each visual angle in video sending end, N is whole greater than 1
Number.That is, video sending end is directed to each visual angle difference generation video flowing all the way in the prior art, and in present invention implementation
In example, then multi-path video stream is generated respectively for each visual angle.Wherein successively exist between the same fragment of each road video flowing default
Time difference, the time difference are less than fragment length.In addition, each road video flowing still maintains alignment on video content, only it is sliced
Starting point it is different.
As a kind of typical realization of panoramic video, a fragment includes a GOP, i.e., fragment is carried out as unit of GOP.
But the case where present invention is not limited to such case, includes multiple GOP for a fragment is equally applicable.In order to which aspect describes,
Subsequent embodiment is described so that a fragment includes a GOP as an example.
For example, as shown in fig. 4 a, 2 road video flowings are generated respectively for each visual angle, if each GOP length is L, then
The same GOP of each video flowing is differedVisual angle same in this way generates the staggered video flowing in 2 tunnels.But each video flowing is in video
Be still alignment in appearance, i.e., be in the video image frame of the road same time point Shang Ge video flowing it is identical, be only sliced
Initial time is no longer aligned.
By way of further example, as shown in Figure 4 b, 4 road video flowings are generated respectively for each visual angle, if each GOP length is L, that
The same GOP of each video flowing is differedVisual angle same in this way generates the staggered video flowing in 4 tunnels.
Each road video flowing at each visual angle of generation is stored in preset memory space by video sending end, then by each visual angle
The download address of each road video flowing be supplied to video receiver, so as to video receiver can be downloaded according to download address it is corresponding
Video flowing.
For video receiver, the view angle switch method of the video flowing executed can be as shown in figure 5, mainly include
Following steps:
In 501, triggering video flowing is obtained from the first view angle switch to the event at the second visual angle.
When the visual angle that user watches panoramic video changes, such as user wears VR equipment, rotation head makes VR
Visual angle change occurs for equipment (i.e. the receiving end of panoramic video), and the receiving end of panoramic video detects user perspective from first at this time
Visual angle change is the second visual angle, then gets triggering video flowing from the first view angle switch to the event at the second visual angle.
Other than above-mentioned event type, it can also be and such as receive triggering video flowing from the first view angle switch to second
The instruction at visual angle, or triggering video flowing is captured from the first view angle switch to the gesture at the second visual angle, etc..
In 502, from the road the N video flowing at the second visual angle, determine that GOP initial time is after tl and full with the difference of T1
Video flowing where the GOP to impose a condition enough, as the target video stream to be switched to.
As a preferred embodiment, above-mentioned setting condition may include distance T1 nearest.Except of course that the condition
Except, other conditions can also be used.
In 503, since the GOP determined, target video stream is downloaded.
In 504, after the initial time T2 of the video render at the first visual angle to the GOP determined, downloading is played
Target video stream.
For example, it is assumed that each visual angle is there are the staggered video flowing of two-way, and user needs to be switched to visual angle 3 from visual angle 1, such as
Shown in Fig. 6 a, if user is just in the video flowing 1 of viewing visual angle 1.If in T1 time point (GOP1 of the T1 in the video flowing 1 at visual angle 1
Front half section) switch, it is determined that in the 2 road video flowings at visual angle 3, GOP initial time after T1 time point and distance T1 most
Video flowing where close GOP can determine the initial time of GOP1 in the video flowing 2 at visual angle 3 after tl and distance T1
Recently, therefore the video flowing 2 at visual angle 3 can be regard as target video stream.
At T1 time point, download the GOP1 of the video flowing 2 at visual angle 3, then successively download GOP2, GOP3 ....Until
When the video flowing 1 at visual angle 1 is played to the initial time T2 of the GOP1 of the video flowing 2 at visual angle 3, switching is played out, that is, starts to broadcast
The target video stream for putting down load, that is, start to play the GOP1, GOP2 of video flowing 2 at visual angle 3, GOP3 ....
By way of further example, it is assumed that there are the staggered video flowing of two-way, user needs to be switched to visual angle 3 from visual angle 1 at each visual angle,
As shown in Figure 6b, if user is just in the video flowing 1 of viewing visual angle 1.If in T1 time point (video flowing 1 of the T1 at visual angle 1
The GOP1 second half section) it switches, it is determined that in the 2 road video flowings at visual angle 3, GOP initial time is after T1 time point and distance
Video flowing where T1 nearest GOP, can determine the initial time of GOP2 in the video flowing 1 at visual angle 3 after tl and away from
It is nearest from T1, therefore the video flowing 1 at visual angle 3 can be regard as target video stream.
At T1 time point, download the GOP2 of the video flowing 1 at visual angle 3, then successively download GOP3, GOP4 ....Until
When the video flowing 1 at visual angle 1 is played to the initial time T2 of the GOP2 of the video flowing 1 at visual angle 3, switching is played out, that is, starts to broadcast
The target video stream for putting down load, that is, start to play the GOP2, GOP3 of video flowing 1 at visual angle 3, GOP4 ....
Obvious this mode is compared to for switching mode more in the prior art, it is not necessary to centainly wait until currently playing
GOP, which is finished, can just be switched to visual angle 3, but by the control of switching waiting time in GOP duration
By way of further example, it is assumed that there are the staggered video flowing in four tunnels, user needs to be switched to visual angle 3 from visual angle 1 at each visual angle,
As shown in Figure 7 a, if user is just in the video flowing 1 of viewing visual angle 1.If switching at T1 time point, it is determined that the 4 of visual angle 3
In the video flowing of road, video flowing where the GOP that GOP initial time is after T1 time point and distance T1 is nearest can be determined
The initial time of GOP1 is after tl in the video flowing 3 at visual angle 3 and distance T1 is nearest, therefore the video flowing 3 at visual angle 3 can be made
For target video stream.
At T1 time point, download the GOP1 of the video flowing 3 at visual angle 3, then successively download GOP2, GOP3 ....Until
When the video flowing 1 at visual angle 1 is played to the initial time T2 of the GOP1 of the video flowing 3 at visual angle 3, switching is played out, that is, starts to broadcast
The target video stream for putting down load, that is, start to play the GOP1, GOP2 of video flowing 2 at visual angle 3, GOP3 ....
By way of further example, it is assumed that there are the staggered video flowing in four tunnels, user needs to be switched to visual angle 3 from visual angle 1 at each visual angle,
As shown in figure 7b, if user is just in the video flowing 1 of viewing visual angle 1.If switching at T1 time point, it is determined that the 4 of visual angle 3
In the video flowing of road, video flowing where the GOP that GOP initial time is after T1 time point and distance T1 is nearest can be determined
The initial time of GOP2 is after tl in the video flowing 1 at visual angle 3 and distance T1 is nearest, therefore the video flowing 1 at visual angle 3 can be made
For target video stream.
At T1 time point, download the GOP2 of the video flowing 1 at visual angle 3, then successively download GOP3, GOP4 ....Until
When the video flowing 1 at visual angle 1 is played to the initial time T2 of the GOP2 of the video flowing 1 at visual angle 3, switching is played out, that is, starts to broadcast
The target video stream for putting down load, that is, start to play the GOP2, GOP3 of video flowing 1 at visual angle 3, GOP4 ....
Obvious this mode is compared to for switching mode more in the prior art, it is not necessary to centainly wait until currently playing
GOP, which is finished, can just be switched to visual angle 3, but by the control of switching waiting time in GOP duration
Above-mentioned is only embodiment exemplifications set out, in the actual process the event of view angle switch and non-switching certain hair
In GOP1, view angle switch can occur on arbitrary GOP for life.
In download video stream, the download address according to each video flowing is downloaded video receiver.It has already mentioned above,
The download address of each road video flowing at each visual angle can be supplied to view when generating the road the N video flowing at each visual angle by video sending end
Frequency receiving end.Wherein the download address of each road video flowing at each visual angle is stored in video receiver in the form of a file, and video connects
Receiving end downloads corresponding video flowing according to the file of the storage.The part can use the prior art, and this will not be detailed here.
It is the description carried out to method provided by the present invention above, below with reference to embodiment to device provided by the present invention
It is described in detail.
Fig. 8 is a structure drawing of device provided in an embodiment of the present invention, which is set to video sending end, for realizing upper
State the function of video sending end in embodiment of the method.As shown in figure 8, the apparatus may include: video stream generation unit 01 and depositing
Store up processing unit 02.Wherein the major function of each component units is as follows:
Video stream generation unit 01 is responsible for generating the road N video flowing respectively for each visual angle, and the road N video flowing uses identical point
Leaf length, successively has that preset time is poor, which is less than fragment length, and N is big between the same fragment of each road video flowing
In 1 integer.
Preferably, the road N video uses identical code rate, and the video content of each video flowing is aligned in time.
As a kind of typical realization of panoramic video, a fragment includes a GOP, i.e., fragment is carried out as unit of GOP.
But the case where present invention is not limited to such case, includes multiple GOP for a fragment is equally applicable.
Storage processing unit 02 is responsible for the road the N video flowing at each visual angle being stored in preset memory space, and by each visual angle
The download address of each road video flowing be supplied to video receiver.Specifically, the download address of each road video flowing can be with file
Form be supplied to video receiver, so that video receiver is stored in local, and regarded according to each road at visual angle each in this document
The download address of frequency stream downloads corresponding video flowing.
Fig. 9 is another structure drawing of device provided in an embodiment of the present invention, which is set to video receiver, for realizing
The function of video receiver in above method embodiment.As shown in figure 9, the apparatus may include: event acquiring unit 11, target
Determination unit 12, video download unit 13 and video playback unit 14.The major function of each component units is as follows:
Event acquiring unit 11 is responsible for obtaining triggering video flowing from the first view angle switch to the event at the second visual angle.
If event acquiring unit 11 receives triggering video flowing from the first view angle switch to the instruction at the second visual angle；Alternatively,
Triggering video flowing is captured from the first view angle switch to the gesture at the second visual angle；Alternatively, detecting user perspective from the first visual angle
It is transformed to the second visual angle, then it is assumed that get triggering video flowing from the first view angle switch to the event at the second visual angle.
Target determination unit 12 is responsible for from the road the N video flowing at the second visual angle, determines fragment initial time in the hair of event
Meet the fragment to impose a condition after raw time T1 and with the difference of T1.
Video download unit 13 is responsible for downloading the mesh where the fragment since the fragment that target determination unit 12 is determined
Mark video flowing.Specifically, under the video flowing at each visual angle that video download unit 13 can be provided previously according to video sending end
Set address downloads corresponding video flowing.The download address of the video flowing at each visual angle that video sending end provides can be with file
Form is pre-stored within video receiver.
Video playback unit 14 be responsible for the first visual angle video render to the fragment determined fragment initial time
After T2, the target video stream of downloading is played.
Wherein the road the N video flowing at the second visual angle use identical fragment length, and between the same fragment of the road N video flowing according to
Secondary that there are preset times is poor, which is less than fragment length, and N is the integer greater than 1.Preferably, the road N video is using identical
Code rate, and the video content of each video flowing is aligned in time.
Above-mentioned fragment includes a GOP, i.e., fragment is carried out as unit of GOP.But present invention is not limited to such case, right
It is equally applicable in a fragment includes multiple GOP the case where.In addition, the present invention can be the length of GOP and without restriction
1s can be 2s, be also possible to 0.5s, generally use 1s.
Figure 10 schematically illustrates example apparatus 1000 according to various embodiments.Equipment 1000 may include one or more
A processor 1002, system control logic 1001 are coupled at least one processor 1002, nonvolatile memory (non-
Volatile memory, NMV)/memory 1004 is coupled in system control logic 1001, and network interface 1006 is coupled in system
Control logic 1001.
Processor 1002 may include one or more single core processors or multi-core processor.Processor 1002 may include any
The combination of general service processor or application specific processor (such as image processor, application processor baseband processor).
System control logic 1001 in one embodiment, it may include any interface controller appropriate, to provide everywhere
Any suitable interface of at least one of device 1002 is managed, and/or is provided any to being communicated with system control logic 1001
Any suitable interface of suitable equipment or component.
System control logic 1001 in one embodiment, it may include one or more Memory Controller Hub, to provide to being
The interface of system memory 1003.Installed System Memory 1003 is used to load and storing data and/or instruction.For example, corresponding equipment 1000,
In one embodiment, Installed System Memory 1003 may include any suitable volatile memory.
NVM/ memory 1004 may include the computer-readable medium of one or more tangible nonvolatiles, for storing number
According to and/or instruction.For example, NVM/ memory 1004 may include any suitable non-volatile memory device, it is such as one or more
Hard disk (hard disk device, HDD), one or more CDs (compact disk, CD), and/or one or more numbers
Word universal disc (digital versatile disk, DVD).
NVM/ memory 1004 may include storage resource, which is physically that the system is installed or can be with
A part of accessed equipment, but it is not necessarily a part of equipment.For example, NVM/ memory 1004 can be via network interface
1006 are accessed by network.
Installed System Memory 1003 and NVM/ memory 1004 can respectively include the copy of interim or lasting instruction 1010.
Instruction 1010 may include the method for causing equipment 1000 to realize Fig. 5 description when being executed by least one of processor 1002
Instruction.In each embodiment, instruction 1010 or hardware, firmware and/or component software can additionally/be alternatively placed on system
Control logic 1001, network interface 1006 and/or processor 1002.
Network interface 1006 may include a receiver to provide wireless interface and one or more nets for equipment 1000
Network and/or any suitable equipment are communicated.Network interface 1006 may include any suitable hardware and/or firmware.Network
Interface 1006 may include mutiple antennas to provide MIMO wireless interface.In one embodiment, network interface 1006
It may include a network adapter, a wireless network adapter, a telephone modem and/or wireless modulation-demodulation
Device.
In one embodiment, at least one of processor 1002 can be with one or more for system control logic
The logic of a controller encapsulates together.In one embodiment, at least one of processor can be patrolled with for system control
The logic for the one or more controllers collected is encapsulated together to form system in package.In one embodiment, in processor
At least one can be integrated on the same die with the logic of one or more controllers for system control logic.One
In a embodiment, at least one of processor can be with the logical set of one or more controllers for system control logic
At on the same die to form System on Chip/SoC.
Equipment 1000 can further comprise input/output device 1005.Input/output device 1005 may include user interface
It is intended to interact user with equipment 1000, it may include peripheral component interface is designed so that peripheral assembly can be with
System interaction, and/or, it may include sensor, it is intended to determine environmental condition and/or the location information in relation to equipment 1000.
Enumerate an application scenarios:
In VR live streaming or VOD system, the equipment such as VR glasses, VR helmet that user uses are in viewing panoramic video
During cephalad direction deflect, need from the first view angle switch to the second visual angle.The embodiment of the present invention can then be used
Described in mode, from the road the N video flowing at the second visual angle, determine GOP initial time the time of origin T1 of the event it
Afterwards and the video flowing where the GOP nearest apart from the T1, as the target video stream to be switched to；Since the GOP determined
Download the target video stream；After the video render at the first visual angle to the initial time T2 of the above-mentioned GOP determined, play
The target video stream of downloading.After this mode makes visual angle switch, it is not necessary to which centainly waiting until that current GOP is finished can
It is switched on the second video and plays, thus when reducing waiting of the video flowing from the first view angle switch to the second visual angle when as far as possible
Between.
In several embodiments provided by the present invention, it should be understood that disclosed system, device and method can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit
It divides, only a kind of logical function partition, there may be another division manner in actual implementation.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention
Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the present invention.
Claims (30)
1. a kind of view angle switch method of video flowing, which is characterized in that this method comprises:
Triggering video flowing is obtained from the first view angle switch to the event at the second visual angle；
From the road the N video flowing at the second visual angle, determine fragment initial time after the time of origin of the event and with it is described
The difference of time of origin meets the fragment to impose a condition；
The target video stream where the fragment is downloaded since the fragment determined；
After the initial time of the video render to the fragment determined at the first visual angle, the target view of downloading is played
Frequency flows, wherein successively existing between the same fragment of the road the N video flowing at second visual angle, preset time is poor, which is less than
Fragment length, N are the integer greater than 1.
2. the method according to claim 1, wherein the acquisition triggers video flowing from the first view angle switch to the
The event at two visual angles includes:
Triggering video flowing is received from the first view angle switch to the instruction at the second visual angle；Alternatively,
Triggering video flowing is captured from the first view angle switch to the gesture at the second visual angle；Alternatively,
Detect user perspective from the first view transformation be the second visual angle.
3. the method according to claim 1, wherein the road N video uses identical code rate, and each video flowing
Video content be aligned in time.
4. the method according to claim 1, wherein the road N video flowing uses identical fragment length.
5. the method according to claim 1, wherein it is described setting condition include: apart from the time of origin most
Closely.
6. the method according to claim 1, wherein the fragment includes an image group GOP.
7. according to claim 1 to method described in 6 any claims, which is characterized in that the video flowing is the view of panoramic video
Frequency flows.
8. a kind of production method of video flowing, which is characterized in that this method comprises:
The road N video flowing is generated respectively for each visual angle, and it is poor successively to there is preset time between the same fragment of each road video flowing, should
Time difference is less than fragment length, and N is the integer greater than 1.
9. according to the method described in claim 8, it is characterized in that, the road N video uses identical code rate, and each video flowing
Video content be aligned in time.
10. according to the method described in claim 8, it is characterized in that, the road N video flowing uses identical fragment length.
11. according to the method described in claim 8, it is characterized in that, this method further include:
The road the N video flowing at each visual angle is stored in preset memory space, and by the download address of each road video flowing at each visual angle
It is supplied to video receiver.
12. according to the method described in claim 8, it is characterized in that, the fragment includes an image group GOP.
13. according to method described in any claim of claim 8 to 12, which is characterized in that the video flowing is panoramic video
Video flowing.
14. a kind of view angle switch device of video flowing, which is characterized in that the device includes:
Event acquiring unit, for obtaining triggering video flowing from the first view angle switch to the event at the second visual angle；
Target determination unit, for determining fragment initial time in the generation of the event from the road the N video flowing at the second visual angle
Meet the fragment to impose a condition after time and with the difference of the time of origin；
Video download unit, for downloading the target where the fragment since the fragment that the target determination unit is determined
Video flowing；
Video playback unit after the initial time for the video render at the first visual angle to the fragment determined, is broadcast
Put down the target video stream of load；
Wherein successively have that preset time is poor, which is less than between the same fragment of the road the N video flowing at second visual angle
Fragment length, N are the integer greater than 1.
15. device according to claim 14, which is characterized in that the event acquiring unit obtain triggering video flowing from
It is specific to execute when the event of the first view angle switch to the second visual angle:
Triggering video flowing is received from the first view angle switch to the instruction at the second visual angle；Alternatively,
Triggering video flowing is captured from the first view angle switch to the gesture at the second visual angle；Alternatively,
Detect user perspective from the first view transformation be the second visual angle.
16. device according to claim 14, which is characterized in that the road N video uses identical code rate, and each video
The video content of stream is aligned in time.
17. device according to claim 14, which is characterized in that the road N video flowing uses identical fragment length.
18. device according to claim 14, which is characterized in that the setting condition includes: apart from the time of origin
Recently.
19. device according to claim 14, which is characterized in that the fragment includes an image group GOP.
20. device described in 4 to 19 any claims according to claim 1, which is characterized in that the video flowing is panoramic video
Video flowing.
21. a kind of generation device of video flowing, which is characterized in that the device includes:
Video stream generation unit, for generating the road N video flowing respectively for each visual angle, between the same fragment of each road video flowing according to
Secondary that there are preset times is poor, which is less than fragment length, and N is the integer greater than 1.
22. device according to claim 21, which is characterized in that the road N video uses identical code rate, and each video
The video content of stream is aligned in time.
23. device according to claim 21, which is characterized in that the road N video flowing uses identical fragment length.
24. device according to claim 21, which is characterized in that the device further include:
Storage processing unit, for the road the N video flowing at each visual angle to be stored in preset memory space, and by each road at each visual angle
The download address of video flowing is supplied to video receiver.
25. device according to claim 21, which is characterized in that the fragment includes an image group GOP.
26. according to device described in any claim of claim 21 to 25, which is characterized in that the video flowing is panoramic video
Video flowing.
27. a kind of equipment, including
Memory, including one or more program；
One or more processor is coupled to the memory, executes one or more of programs, to realize such as right
It is required that the operation executed in 1 to 6 any claim the method.
28. a kind of equipment, including
Memory, including one or more program；
One or more processor is coupled to the memory, executes one or more of programs, to realize such as right
It is required that the operation executed in 8 to 12 any claim the methods.
29. a kind of computer storage medium, the computer storage medium is encoded with computer program, and described program is by one
When a or multiple computers execute, so that one or more of computers execute the side as described in claim 1 to 6 any claim
The operation executed in method.
30. a kind of computer storage medium, the computer storage medium is encoded with computer program, and described program is by one
When a or multiple computers execute, so that one or more of computers are executed as described in any claim of claim 8 to 12
The operation executed in method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710547015.3A CN109218739B (en) | 2017-07-06 | 2017-07-06 | Method, device and equipment for switching visual angle of video stream and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710547015.3A CN109218739B (en) | 2017-07-06 | 2017-07-06 | Method, device and equipment for switching visual angle of video stream and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109218739A true CN109218739A (en) | 2019-01-15 |
| CN109218739B CN109218739B (en) | 2021-04-13 |
Family
ID=64992239
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710547015.3A Active CN109218739B (en) | 2017-07-06 | 2017-07-06 | Method, device and equipment for switching visual angle of video stream and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109218739B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112738508A (en) * | 2020-12-31 | 2021-04-30 | 咪咕文化科技有限公司 | Video coding method, video determining method, video processing method, server and VR terminal |
| CN112911315A (en) * | 2019-11-19 | 2021-06-04 | 中兴通讯股份有限公司 | Live streaming recording method, network equipment and storage medium |
| CN113691797A (en) * | 2021-08-27 | 2021-11-23 | 咪咕文化科技有限公司 | Video playing processing method, device, equipment and storage medium |
| CN114390324A (en) * | 2022-03-23 | 2022-04-22 | 阿里云计算有限公司 | Video processing method and system and cloud rebroadcasting method |
| TWI830978B (en) * | 2020-12-30 | 2024-02-01 | 光陣三維科技有限公司 | System for obtaining and displaying specific streaming media from another streaming media combined streaming medias for transmission and method thereof |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130219442A1 (en) * | 2009-03-23 | 2013-08-22 | Conviva Inc. | Switching content |
| US20140181259A1 (en) * | 2012-12-21 | 2014-06-26 | Nokia Corporation | Method, Apparatus, and Computer Program Product for Generating a Video Stream of A Mapped Route |
| CN104159164A (en) * | 2014-08-27 | 2014-11-19 | 华中师范大学 | Wireless cooperation method for reducing synchronization delay of multi-view video stream |
| US9544665B2 (en) * | 2013-05-31 | 2017-01-10 | Broadcom Corporation | Providing multiple ABR streams using a single transcoder |
| EP3142377A1 (en) * | 2015-09-09 | 2017-03-15 | Media Global Links Co., Ltd. | Video transmission system and video receiver |
-
2017
- 2017-07-06 CN CN201710547015.3A patent/CN109218739B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130219442A1 (en) * | 2009-03-23 | 2013-08-22 | Conviva Inc. | Switching content |
| US20140181259A1 (en) * | 2012-12-21 | 2014-06-26 | Nokia Corporation | Method, Apparatus, and Computer Program Product for Generating a Video Stream of A Mapped Route |
| US9544665B2 (en) * | 2013-05-31 | 2017-01-10 | Broadcom Corporation | Providing multiple ABR streams using a single transcoder |
| CN104159164A (en) * | 2014-08-27 | 2014-11-19 | 华中师范大学 | Wireless cooperation method for reducing synchronization delay of multi-view video stream |
| EP3142377A1 (en) * | 2015-09-09 | 2017-03-15 | Media Global Links Co., Ltd. | Video transmission system and video receiver |
Non-Patent Citations (2)
| Title |
|---|
| GUNTUR RAVINDRA ET AL: "On tile assignment for region-of-interest video streaming in a wireless LAN", 《PROC NOSSDAV ‘12, 22ND INT WORKSHOP NETW OPERAT SYST SUPPORT DIGIT AUDIO VIDEO, TORONTO, CANADA》 * |
| Y. SÁNCHEZ DE LA FUENTE ET AL: "Video processing for panoramic streaming using HEVC and its scalable extensions", 《MULTIMED TOOLS APPL》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112911315A (en) * | 2019-11-19 | 2021-06-04 | 中兴通讯股份有限公司 | Live streaming recording method, network equipment and storage medium |
| TWI830978B (en) * | 2020-12-30 | 2024-02-01 | 光陣三維科技有限公司 | System for obtaining and displaying specific streaming media from another streaming media combined streaming medias for transmission and method thereof |
| CN112738508A (en) * | 2020-12-31 | 2021-04-30 | 咪咕文化科技有限公司 | Video coding method, video determining method, video processing method, server and VR terminal |
| CN113691797A (en) * | 2021-08-27 | 2021-11-23 | 咪咕文化科技有限公司 | Video playing processing method, device, equipment and storage medium |
| CN114390324A (en) * | 2022-03-23 | 2022-04-22 | 阿里云计算有限公司 | Video processing method and system and cloud rebroadcasting method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109218739B (en) | 2021-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109218739A (en) | View angle switch method, apparatus, equipment and the computer storage medium of video flowing | |
| KR101500892B1 (en) | Variable bit video streams for adaptive streaming | |
| CN109218848A (en) | View angle switch method, apparatus, equipment and the computer storage medium of video flowing | |
| CN101980533A (en) | Method for implementing stunt mode function of transport stream file based on indexed file | |
| EP1982265B1 (en) | Fast switching of channels based on the automatic buffering of the previously displayed channel and predicted channels | |
| US8811797B2 (en) | Switching between time order and popularity order sending of video segments | |
| CN103596036B (en) | Intelligent buffering method for streaming media player | |
| JP2013038766A (en) | Transmitter, transmitter control method, control program, and recording medium | |
| CN108174280B (en) | Audio and video online playing method and system | |
| US10911809B2 (en) | Communication apparatus, communication method, and program | |
| CN102215429A (en) | Recording method for mobile TV | |
| US10219036B2 (en) | Dynamically adjusting video merchandising to reflect user preferences | |
| CN111095939A (en) | Identifying previously streamed portions of a media item to avoid repeated playback | |
| CN106375835B (en) | A kind of flow media playing method and equipment | |
| US8391688B2 (en) | Smooth rewind media playback | |
| WO2013188112A2 (en) | Systems and methods for adaptive streaming systems with interactive video timelines | |
| JP2022525906A (en) | Method and device for transmitting viewpoint switching ability in VR360 | |
| WO2017101311A1 (en) | Method, client and server for realising switching from live broadcasting to on-demand broadcasting | |
| JP6294527B2 (en) | Transmission device, transmission method, reproduction device, and reproduction method | |
| CN112911390B (en) | Video data playing method and terminal equipment | |
| KR20200017151A (en) | System and method for providing virtual reality contents based on iptv network | |
| CN109166165A (en) | A kind of playback method of dynamic picture, terminal and can storage medium | |
| US11134236B2 (en) | Image processing device and system | |
| CN105898590A (en) | Media content play method, device and system | |
| CN109996120A (en) | Video stream control device and its control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |