CN106331871A - Method and device for realizing fast-forward or fast-backward playback of video stream - Google Patents
Method and device for realizing fast-forward or fast-backward playback of video stream Download PDFInfo
- Publication number
- CN106331871A CN106331871A CN201510397463.0A CN201510397463A CN106331871A CN 106331871 A CN106331871 A CN 106331871A CN 201510397463 A CN201510397463 A CN 201510397463A CN 106331871 A CN106331871 A CN 106331871A
- Authority
- CN
- China
- Prior art keywords
- video
- frame
- fast
- played
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Abstract
The invention provides a method and a device for realizing fast-forward or fast-backward playback of a video stream. The method comprises steps: a fast-forward or fast-backward request triggered by a user is received, and the time stamp at the fast-forward or fast-backward request position is positioned; according to the time stamp at the current playback position and the time stamp at the fast-forward or fast-backward request position, a video metadata flow corresponding to the fast-forward or fast-backward request section is acquired; and according to a playback rate, a to-be-played video frame is selected from the video metadata flow, and the to-be-played video frame is played. The remaining video frames of the current sequence group are not ignored, influences from the I frame interval do not exist, and thus, the non-smooth problem can be avoided, and the user experience can be enhanced.
Description
Technical field
The present invention relates to multi-media processing technical field, realize video flowing F.F. or fast particularly to one
The method and device moved back.
Background technology
User, when watching video, can be operated by fast forward and fast reverse and quickly navigate to oneself feel emerging
The video playback position of interest；The fast forward and fast reverse operation that Play System triggers in response to user, is broadcasting
Putting interface and display for a user the fast forward and fast reverse picture of correspondence, during fast forward and fast reverse, picture is
No smoothness directly affects the video viewing experience of user.
In prior art, most of Play Systems use following methods to realize the F.F. of video flowing or fast
Move back.In one approach, Play System is mainly neighbouring with fast forward and fast reverse request point by obtaining
Can synchronization frame (I frame), start to decode remaining video flowing from this I frame, the video flowing of decoding carried out
Play；This method ignores the frame of video of fast forward and fast reverse request segment other sequence set interior, easily goes out
Now play unsmooth, jump phenomena.
In another approach, Play System is mainly by obtaining the I in fast forward and fast reverse request segment
Frame, is played out I frame by frequency-hopping mode；Broadcasting multiplying power and I interframe are separated with strictly by this method
Requirement, does not maybe have integer multiple relation when broadcasting multiplying power with I frame period when I frame period is not fixed isometric
Time, this method the most easily occurs playing unsmooth phenomenon, and Consumer's Experience is poor.
Summary of the invention
The technical problem to be solved is to provide a kind of side realizing video flowing fast forward and fast reverse
Method, easily occurs during in order to solve fast forward and fast reverse in prior art playing rough problem, with
Promote Consumer's Experience.
Present invention also offers a kind of device realizing video flowing fast forward and fast reverse, in order to ensure above-mentioned side
Method realization in practice and application.
On the one hand, the invention provides a kind of method realizing video flowing fast forward and fast reverse, described method
Including:
Receive user trigger fast forward and fast reverse request, position described fast forward and fast reverse request position time
Between stab；
Timestamp according to current play position and the timestamp of described fast forward and fast reverse request position, obtain
Take the video metadata stream that described fast forward and fast reverse request segment is corresponding；
From described video metadata stream, select frame of video to be played according to playing multiplying power, treat described
The frame of video play plays out.
Another aspect, the invention provides a kind of device realizing video flowing fast forward and fast reverse, described dress
Put and include:
Timestamp positioning unit, for receive user trigger fast forward and fast reverse request, position described soon
Enter or the timestamp of fast rewinding request position；
Metadata streams acquiring unit, for the timestamp according to current play position and described F.F. or fast
Move back the timestamp of request position, obtain the video metadata stream that described fast forward and fast reverse request segment is corresponding；
Broadcast unit, for selecting to be played regarding according to broadcasting multiplying power from described video metadata stream
Frequently frame, plays out described frame of video to be played.
By the invention described above embodiment it can be seen that compared with prior art, the present invention has following
Beneficial effect:
The fast forward and fast reverse request that first present invention triggers according to user, positioning described fast forward and fast reverse please
Seek the timestamp of position；Then timestamp and described fast forward and fast reverse according to current play position please
Seek the timestamp of position, obtain the video metadata stream that described fast forward and fast reverse request segment is corresponding；?
After according to play multiplying power from described video metadata stream, select frame of video to be played, treat described
The frame of video play plays out.The present invention abandoned completely prior art from close on I frame start or
The technical thought of the fast forward and fast reverse based on I frame, but focus on fast forward and fast reverse process fullness in the epigastrium and abdomen
Foot plays the frame of video of multiplying power, no matter what type is these frame of video be, will be decoded broadcasting,
Some sequence set in so the present invention both will not ignore fast forward and fast reverse request segment, also will not be by I
The impact of frame period, therefore, the present invention is it can be avoided that there is rough problem, it is possible to promotes and uses
Family is experienced.
Accompanying drawing explanation
For the technical scheme being illustrated more clearly that in the embodiment of the present invention, embodiment will be described below
The accompanying drawing used required in is briefly described, it should be apparent that, the accompanying drawing in describing below is only
It is only some embodiments of the present invention, for those of ordinary skill in the art, is not paying wound
On the premise of the property made is laborious, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the flow process of the embodiment of the method 1 realizing video flowing fast forward and fast reverse that the present invention provides
Figure；
Fig. 2 is the structure chart of the buffer area of the first in first out mode of operation that the present invention provides；
Fig. 3 is one section of video flowing structure chart with level prediction reference that the present invention provides；
Fig. 4 is a kind of frequency hopping broadcast mode schematic diagram that the present invention provides；
Fig. 5 is the stream of a kind of embodiment of the method 2 realizing video flowing fast forward and fast reverse that the present invention provides
Cheng Tu；
Fig. 6 is the knot of a kind of device embodiment 1 realizing video flowing fast forward and fast reverse that the present invention provides
Composition；
Fig. 7 is the knot of a kind of device embodiment 2 realizing video flowing fast forward and fast reverse that the present invention provides
Composition.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, to the technical scheme in the embodiment of the present invention
It is clearly and completely described, it is clear that described embodiment is only that a part of the present invention is real
Execute example rather than whole embodiments.Based on the embodiment in the present invention, ordinary skill
The every other embodiment that personnel are obtained under not making creative work premise, broadly falls into this
The scope of invention protection.
The present invention can be used in numerous general or special purpose calculating device context or configuration.Such as: individual
People's computer, server computer, handheld device or portable set, laptop device, many places
Reason device device, the distributed computing environment including any of the above device or equipment etc..
The present invention can retouch in the general context of computer executable instructions
State, such as program module.Usually, program module includes performing particular task or realizing specific taking out
The routine of image data type, program, object, assembly, data structure etc..Can also be in distribution
Formula computing environment puts into practice the present invention, in these distributed computing environment, by passing through communication network
And connected remote processing devices performs task.In a distributed computing environment, program module
May be located in the local and remote computer-readable storage medium including storage device.
It is the embodiment of the method realizing video flowing fast forward and fast reverse that the present invention provides with reference to Fig. 1, Fig. 1
The flow chart of 1, the method may comprise steps of:
S101: receive the fast forward and fast reverse request that user triggers, positions described fast forward and fast reverse request position
The timestamp put.
In actual applications, user utilize terminal viewing video time can by click on fast forward and fast reverse by
Button triggers fast forward and fast reverse request, and user can also play the page, by dragging playing progress rate
The mode of bar triggers fast forward and fast reverse request, and certainly, user can also quick by keyboard
Key triggers fast forward and fast reverse request.
For software push buttons and the triggering mode of hardware fast forward button, Play System is pre-defined clicks on F.F.
Or the operation duration of fast backward button or shortcut, such as 2s, in addition it is also necessary to pre-define and press with click
Button or single fast forward and fast reverse request duration corresponding to keyboard shortcut, such as 10s, to facilitate location to use
The timestamp of the fast forward and fast reverse request position that family is triggered.In actual applications, this operation duration and
The size of single fast forward and fast reverse request duration can make accommodation single F.F. according to demand please
Ask the duration can be identical with single fast rewinding request duration, it is also possible to differ.For dragging play into
The triggering mode of degree bar, the duration that user drags is designated as operating duration, according to user by Play System
The location positioning fast forward and fast reverse request position of video flowing when stopping dragging.
In order to meet user's demands of individuals to fast forward and fast reverse, in actual applications, Play System is also
Can provide the user single fast forward and fast reverse request duration arranges function, and user is triggering F.F.
Or before fast reverse operation, the size of single fast forward and fast reverse request duration is first set.Certainly, broadcast
Place system can provide the user one and arrange scope, user arbitrarily arrange in the range of this setting.
S102, according to timestamp and the time of described fast forward and fast reverse request position of current play position
Stamp, obtains the video metadata stream that described fast forward and fast reverse request segment is corresponding.
In actual applications, Play System can send to server and carry fast forward and fast reverse service class
The request of the timestamp of type, the timestamp of current play position and described fast forward and fast reverse request position,
Server returns corresponding video metadata stream according to this request to Play System.
But inventor finds between Play System and server the most mutual, sometimes there will be network and adds
Carrying phenomenon, can affect user and watch video, in order to avoid occurring that network loads phenomenon, the present invention carries
Having supplied another kind of implementation so that Play System quick obtaining video metadata stream, which is concrete
Including: from the buffer area of local first in first out mode of operation, obtain from described currently playing position
The timestamp put is to video element corresponding to time period of timestamp of described fast forward and fast reverse request position
Data stream；Described buffer area includes forward direction buffer area and backward buffer area, and described forward direction buffer area is used
In storing the data before current play position, described backward buffer area is used for storing currently playing position
Data after putting.
The buffer area of the first in first out mode of operation provided the present invention below by an example is carried out
Illustrate.See the buffer area that Fig. 2, Fig. 2 are the first in first out mode of operations that the present invention provides
Structure chart, as in figure 2 it is shown, this buffer area forward direction caching M second, backward caching N second；At T0
In the moment, current play position is A0；In T1 (the T1 ＞ T0) moment, T0 moment black background part
Data cached it is removed, and newly increases the data cached of T1 moment white background, the broadcasting in T1 moment
Position is A1.
Based on this buffer structure with forward and backward buffer area so that Play System is directly at this
Ground obtains corresponding video metadata stream, thus avoids sending request to service end continually, it is to avoid
Frequently occur network and load phenomenon.
S103, selects frame of video to be played according to playing multiplying power from described video metadata stream, will
Described frame of video to be played plays out.
In actual applications, Play System can be according to the fixing broadcasting multiplying power pre-set at
Reason.But this fixing broadcasting multiplying power pre-set cannot be adapted to the actual demand of each user,
In order to meet this actual demand of user, the invention provides the operation triggered according to user, from
Accommodation play multiplying power mode, which particularly as follows:
According to formula PlayMul=2^CeilLog2 (Duractual/Durrequest) calculate and play multiplying power；
PlayMul represents broadcasting multiplying power；CeilLog2(Duractual/Durrequest) formula represents right
Log2(Duractual/Durrequest) result capping integer value；DuractualRepresent fast forward and fast reverse request segment
Duration；DurrequestRepresent the operation duration of fast forward and fast reverse request.
Below by an example, which is explained.
Assume: the operation duration Dur of fast forward and fast reverse requestrequest=2 seconds, fast forward and fast reverse request segment
Duration Duractual=7 seconds；Broadcasting multiplying power PlayMul=4 is calculated according to above-mentioned formula.
Assume: the video metadata stream that fast forward and fast reverse request segment is corresponding is as it is shown on figure 3, work as and play again
When rate is 4, the frame of video to be played determined from this video metadata stream, including the 1st frame and
The frame of video corresponding at interval of 4 frame position is started, such as regarding of Tu3Zhong black triangles district mark from the 1st frame
Frequently frame.
Inventor considers to exist in actual applications the video flowing of various structures, in order to be adapted to different knot
The video flowing of structure, inventors herein proposes more specifically implementation.Video flowing structure is divided into by inventor
Two big classes, a class video flowing is the video flowing with hierarchy, and another kind of is not have hierarchy
Video flowing.Inventor considers the structure of this two big class video flowing, it is proposed that a kind of implementation is with suitable
Should be in this two classes video flowing, which specifically includes:
A1: resolve described video metadata stream and obtain the I vertical shift position of each image sets, according to often
The I vertical shift position parallel decoding image sets of individual image sets obtains the data of each image sets；And,
A2: select frame of video to be played from described video metadata stream according to playing multiplying power, from
The data selecting frame of video to be played corresponding in the data of each image sets play out.
This it is achieved in that with image sets (Group of Pictures, Gop) be elementary cell, from image
The angle of group is set out, and is not affected by interlayer structure and non-interlayer structure, first parses each image sets
I vertical shift position, lays a solid foundation for parallel decoding, uses parallel decoding image sets to ensure follow-up F.F.
Or data playback ageing during rewind, it is to avoid the phenomenons such as buffering, pause occur.
Inventor considers the video flowing with hierarchy, and the video interframe in video flowing exists with reference to depending on
The relation of relying, hierarchy comprises full frame speed, 1/2 frame speed, 1/4 frame speed etc., has interlayer for this
The video flowing of dependence, inventor also been proposed a kind of implementation, and which includes:
B1: resolve described video metadata stream and obtain the structural information of each frame of video, described structure
Information includes: sequential video frame number, load offset and reference frame；And,
B2: select frame of video to be played, root from described video metadata stream according to playing multiplying power
According to the structural information of described frame of video to be played, described frame of video to be played is decoded, will
The data that decoding obtains play out.
This reference dependence being achieved in that from frame of video, with reference dependence as base
Plinth, is no need for decoding all of frame of video, but only realizes being decoded frame of video to be played, this
Kind of processing mode can either ensure the ageing of data playback during follow-up fast forward and fast reverse, it is to avoid occurs
The phenomenons such as buffering, pause, can reduce again the data volume of decoding process so that play more smooth.
It addition, for having the video flowing of interlayer structure, inventor provide more specifically implementation,
To avoid further playing rough problem.During which implements, to be played in selection
During frame of video, the most first select the higher frame of video of level priority, when playing frame, with initial frame-skipping,
Follow-up equally spaced mode plays out.
Such as, the structure of video flowing is as it is shown on figure 3, it is left that user triggers the position of fast forward and fast reverse request
While play the 2nd frame, use initial frame-skipping, follow-up equally spaced mode, be the situation of 2 playing multiplying power
Under, the broadcasting of each frame of video is as shown in Figure 4.As shown in Figure 4, the B frame skipped need not solve again
Code processes, and be further ensured that during fast forward and fast reverse video playback is ageing.Still with Fig. 3
Video flowing structure based on, directly use equidistantly decoding output to play, at some video when playing
Frame be chosen output but its rely on reference frame not selected output time, its reference frame relied on is also required to
It is decoded output.
Furthermore, it is contemplated that above-mentioned employing initiates frame-skipping, follow-up equally spaced mode, initial frame-skipping position with
In the case of the spacing of current play position and follow-up normal equidistantly frame-skipping broadcasting spacing differ, especially
It is less in the spacing of initial frame-skipping, in the case of follow-up frame-skipping spacing is relatively big, initiateing of fast forward and fast reverse
There is unsmooth phenomenon in the broadcasting stage.For this situation, inventor further provides a kind of realization side
Formula.Which specifically utilizes between the broadcasting of initial frame-skipping spacing and follow-up frame-skipping distance computation initial period
Away from；Concrete, the broadcastings spacing of initial period is equal to initiateing the average of frame-skipping spacing and follow-up frame-skipping spacing
Value, then, after the frame of video in frame-skipping first decodes, play after postponing the time playing spacing again, this
Sample is to alleviate the rough problem of initial broadcasting.Such as, initial frame-skipping spacing a=1, follow-up frame-skipping spacing
B=4, it is determined that initial broadcasting spacing c=(a+b)/2=2.5, needs exist for explanation, applies in reality
In, in addition it is also necessary to the meansigma methods round that will calculate, the most finally determine c=3, finally according to
Initial distance computation of playing goes out to postpone waiting time t=(c-a) * s, and wherein, s represents the broadcasting of a frame of video
Duration.
Furthermore, it is contemplated that in actual applications, there is also the fast forward and fast reverse to media stream and process,
The present invention is in order to be adapted to the application scenarios of media stream, it is further provided concrete solution,
Seeing Fig. 5, Fig. 5 is that a kind of method realizing video flowing fast forward and fast reverse that the present invention provides is implemented
The flow chart of example 2, the method includes:
S501, receives the fast forward and fast reverse request that user triggers, and positions described fast forward and fast reverse request position
The timestamp put.
S502, according to timestamp and the time of described fast forward and fast reverse request position of current play position
Stamp, obtains the video metadata stream that described fast forward and fast reverse request segment is corresponding.
S503, selects frame of video to be played according to playing multiplying power from described video metadata stream.
S504, according to sequential video frame number and the timestamp of frame of video to be played, from audio metadata
Stream selects audio frame to be played, to described audio frame to be played and described video to be played
Frame is made audio-visual synchronization and is processed and play.
Method shown in Fig. 5 differs primarily in that with the method shown in Fig. 1, play frame of video it
Before, first select audio frame to be played according to the timestamp of frame of video to be played, then to be played
Frame of video and audio frame carry out synchronization process, the most respectively audio frame and frame of video are exported to the most right
The playback equipment answered plays out, and this makes it possible to realize broadcasting of the fast forward and fast reverse to media stream
Put.
Corresponding with said method, the invention provides a kind of dress realizing video flowing fast forward and fast reverse
Put.Seeing Fig. 6, Fig. 6 is a kind of device reality realizing video flowing fast forward and fast reverse that the present invention provides
Executing the structure chart of example 1, this device includes:
Timestamp positioning unit 601, for receiving the fast forward and fast reverse request that user triggers, positions institute
State the timestamp of fast forward and fast reverse request position；
Metadata streams acquiring unit 602, for the timestamp according to current play position and described F.F.
Or the timestamp of fast rewinding request position, obtain the video element number that described fast forward and fast reverse request segment is corresponding
According to stream；
Broadcast unit 603, for selecting to be played according to broadcasting multiplying power from described video metadata stream
Frame of video, described frame of video to be played is played out.
Optionally, described selection broadcast unit, including:
Structural information resolves subelement, obtains each frame of video for resolving described video metadata stream
Structural information, described structural information includes: sequential video frame number, load offset and reference frame；
Subelement is play in decoding, for selecting to wait to broadcast from described video metadata stream according to broadcasting multiplying power
The frame of video put, according to the structural information of described frame of video to be played to described video to be played
Frame is decoded, and data decoding obtained play out.
Optionally, described selection broadcast unit, including:
Parallel decoding subelement, obtains the I of each image sets for resolving described video metadata stream
Vertical shift position, obtains each figure according to the I vertical shift position parallel decoding image sets of each image sets
Data as group；
Select to play subelement, for selecting to wait to broadcast from described video metadata stream according to broadcasting multiplying power
The frame of video put, the data selecting frame of video to be played corresponding from the data of each image sets are entered
Row is play.
Optionally, described device also includes:
Play multiplying power computing unit, for according to formula PlayMul=2^CeilLog2 (Duractual/Durrequest)
Calculate and play multiplying power；PlayMul represents broadcasting multiplying power；CeilLog2(Duractual/Durrequest) formula represents right
Log2(Duractual/Durrequest) result capping integer value；DuractualRepresent fast forward and fast reverse request segment
Duration；DurrequestRepresent the operation duration of fast forward and fast reverse request；
The most described broadcast unit, for according to described broadcasting multiplying power computing unit calculated broadcasting multiplying power
From described video metadata stream, select frame of video to be played, described frame of video to be played is entered
Row is play.
Optionally, described metadata streams acquiring unit, including:
First obtains subelement, for the buffer area from local first in first out mode of operation, obtains
From the timestamp of described current play position to described fast forward and fast reverse request position timestamp time
Between video metadata stream corresponding to section；Described buffer area includes forward direction buffer area and backward buffer area,
Described forward direction buffer area is for storing the data before current play position, and described backward buffer area is used
In storing the data after current play position；Or,
Second obtains subelement, carries fast forward and fast reverse type of service, described for sending to server
The request of the timestamp of the timestamp of current play position and described fast forward and fast reverse request position, connects
Receive the video metadata stream that server returns according to described request.
Seeing Fig. 7, Fig. 7 is a kind of device reality realizing video flowing fast forward and fast reverse that the present invention provides
Executing the structure chart of example 2, this device is also to include on the basis of above-mentioned Fig. 6 structure:
Optionally, described device also includes:
Audio-visual synchronization unit 604, for according to the sequential video frame number of frame of video to be played and time
Between stab, from audio metadata stream, select audio frame to be played, to described audio frame to be played
Make audio-visual synchronization with described frame of video to be played to process and play.
The fast forward and fast reverse request that first present invention triggers according to user, positioning described fast forward and fast reverse please
Seek the timestamp of position；Then timestamp and described fast forward and fast reverse according to current play position please
Seek the timestamp of position, obtain the video metadata stream that described fast forward and fast reverse request segment is corresponding；?
After according to play multiplying power from described video metadata stream, select frame of video to be played, treat described
The frame of video play plays out.The present invention abandoned completely prior art from close on I frame start or
The technical thought of the fast forward and fast reverse based on I frame, but focus on fast forward and fast reverse process fullness in the epigastrium and abdomen
Foot plays the frame of video of multiplying power, no matter what type is these frame of video be, will be decoded broadcasting,
Some sequence set in so the present invention both will not ignore fast forward and fast reverse request segment, also will not be by I
The impact of frame period, therefore, the present invention is it can be avoided that there is rough problem, it is possible to promotes and uses
Family is experienced.
It should be noted that each embodiment in this specification all uses the mode gone forward one by one to describe,
What each embodiment stressed is the difference with other embodiments, between each embodiment
Identical similar part sees mutually.For device class embodiment, due to itself and method
Embodiment basic simlarity, so describe is fairly simple, relevant part sees the portion of embodiment of the method
Defend oneself bright.
Finally, in addition it is also necessary to explanation, in this article, the relation of such as first and second or the like
Term is used merely to separate an entity or operation with another entity or operating space, and not
Necessarily require or imply and there is the relation of any this reality or suitable between these entities or operation
Sequence.And, term " includes ", " comprising " or its any other variant are intended to non-exclusive
Comprising, so that include the process of a series of key element, method, article or equipment not only of property
Including those key elements, but also include other key elements being not expressly set out, or also include for
The key element that this process, method, article or equipment are intrinsic.In the situation not having more restriction
Under, statement " including ... " key element limited, it is not excluded that including described key element
Process, method, article or equipment there is also other identical element.
Above a kind of method and device realizing video flowing fast forward and fast reverse provided by the present invention is entered
Having gone and be discussed in detail, principle and the embodiment of the present invention are carried out by specific case used herein
Illustrating, the explanation of above example is only intended to help to understand that the method for the present invention and core thereof are thought
Think；Simultaneously for one of ordinary skill in the art, according to the thought of the present invention, concrete real
Executing and all will change in mode and range of application, in sum, this specification content should not be managed
Solve as limitation of the present invention.
Claims (12)
1. the method realizing video flowing fast forward and fast reverse, it is characterised in that described method includes:
Receive user trigger fast forward and fast reverse request, position described fast forward and fast reverse request position time
Between stab；
Timestamp according to current play position and the timestamp of described fast forward and fast reverse request position, obtain
Take the video metadata stream that described fast forward and fast reverse request segment is corresponding；
From described video metadata stream, select frame of video to be played according to playing multiplying power, treat described
The frame of video play plays out.
Method the most according to claim 1, it is characterised in that described according to play multiplying power from
Described video metadata stream selects frame of video to be played, described frame of video to be played is carried out
Play, including:
Resolve described video metadata stream and obtain the structural information of each frame of video, described structural information bag
Include: sequential video frame number, load offset and reference frame；
From described video metadata stream, frame of video to be played is selected, according to described according to playing multiplying power
Described frame of video to be played is decoded by the structural information of frame of video to be played, will decode
To data play out.
Method the most according to claim 1, it is characterised in that described according to play multiplying power from
Described video metadata stream selects frame of video to be played, described frame of video to be played is carried out
Play, including:
Resolve described video metadata stream and obtain the I vertical shift position of each image sets, according to each figure
As the I vertical shift position parallel decoding image sets of group obtains the data of each image sets；
From described video metadata stream, frame of video to be played is selected, from each figure according to playing multiplying power
Data as selecting frame of video to be played corresponding in the data of group play out.
Method the most according to claim 1, it is characterised in that calculate in the following manner and broadcast
Put multiplying power:
According to formula PlayMul=2^CeilLog2 (Duractual/Durrequest) calculate and play multiplying power；
PlayMul represents broadcasting multiplying power；CeilLog2(Duractual/Durrequest) formula represents right
Log2(Duractual/Durrequest) result capping integer value；DuractualRepresent fast forward and fast reverse request segment
Duration；DurrequestRepresent the operation duration of fast forward and fast reverse request.
Method the most according to claim 1, it is characterised in that by described to be played regarding
Frequently, before frame plays out, described method also includes:
Sequential video frame number according to frame of video to be played and timestamp, select from audio metadata stream
Select audio frame to be played, described audio frame to be played and described frame of video to be played are made sound
Audio video synchronization processes and plays.
Method the most according to claim 1, it is characterised in that described according to currently playing position
The timestamp put and the timestamp of described fast forward and fast reverse request position, obtain described fast forward and fast reverse
The video metadata stream that request segment is corresponding, including:
From the buffer area of local first in first out mode of operation, obtain from described current play position
Timestamp is to video metadata corresponding to time period of timestamp of described fast forward and fast reverse request position
Stream；Described buffer area includes that forward direction buffer area and backward buffer area, described forward direction buffer area are used for storing up
Deposit the data before current play position, described backward buffer area be used for storing current play position it
After data；Or,
Send to server and carry fast forward and fast reverse type of service, the timestamp of described current play position
With the request of the timestamp of described fast forward and fast reverse request position, receive server according to described request
The video metadata stream returned.
7. the device realizing video flowing fast forward and fast reverse, it is characterised in that described device includes:
Timestamp positioning unit, for receive user trigger fast forward and fast reverse request, position described soon
Enter or the timestamp of fast rewinding request position；
Metadata streams acquiring unit, for the timestamp according to current play position and described F.F. or fast
Move back the timestamp of request position, obtain the video metadata stream that described fast forward and fast reverse request segment is corresponding；
Broadcast unit, for selecting to be played regarding according to broadcasting multiplying power from described video metadata stream
Frequently frame, plays out described frame of video to be played.
Device the most according to claim 7, it is characterised in that described selection broadcast unit,
Including:
Structural information resolves subelement, obtains each frame of video for resolving described video metadata stream
Structural information, described structural information includes: sequential video frame number, load offset and reference frame；
Subelement is play in decoding, for selecting to wait to broadcast from described video metadata stream according to broadcasting multiplying power
The frame of video put, according to the structural information of described frame of video to be played to described video to be played
Frame is decoded, and data decoding obtained play out.
Device the most according to claim 7, it is characterised in that described selection broadcast unit,
Including:
Parallel decoding subelement, obtains the I of each image sets for resolving described video metadata stream
Vertical shift position, obtains each figure according to the I vertical shift position parallel decoding image sets of each image sets
Data as group；
Select to play subelement, for selecting to wait to broadcast from described video metadata stream according to broadcasting multiplying power
The frame of video put, the data selecting frame of video to be played corresponding from the data of each image sets are entered
Row is play.
Device the most according to claim 7, it is characterised in that described device also includes:
Play multiplying power computing unit, for according to formula PlayMul=2^CeilLog2 (Duractual/Durrequest)
Calculate and play multiplying power；PlayMul represents broadcasting multiplying power；CeilLog2(Duractual/Durrequest) formula represents right
Log2(Duractual/Durrequest) result capping integer value；DuractualRepresent fast forward and fast reverse request segment
Duration；DurrequestRepresent the operation duration of fast forward and fast reverse request；
The most described broadcast unit, for according to described broadcasting multiplying power computing unit calculated broadcasting multiplying power
From described video metadata stream, select frame of video to be played, described frame of video to be played is entered
Row is play.
11. devices according to claim 7, it is characterised in that described device also includes:
Audio-visual synchronization unit, for the sequential video frame number according to frame of video to be played and time
Stamp, selects audio frame to be played from audio metadata stream, to described audio frame to be played and
Described frame of video to be played is made audio-visual synchronization and is processed and play.
12. devices according to claim 7, it is characterised in that described metadata streams obtains single
Unit, including:
First obtains subelement, for the buffer area from local first in first out mode of operation, obtains
From the timestamp of described current play position to described fast forward and fast reverse request position timestamp time
Between video metadata stream corresponding to section；Described buffer area includes forward direction buffer area and backward buffer area,
Described forward direction buffer area is for storing the data before current play position, and described backward buffer area is used
In storing the data after current play position；Or,
Second obtains subelement, carries fast forward and fast reverse type of service, described for sending to server
The request of the timestamp of the timestamp of current play position and described fast forward and fast reverse request position, connects
Receive the video metadata stream that server returns according to described request.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510397463.0A CN106331871B (en) | 2015-07-08 | 2015-07-08 | Method and device for realizing fast forward or fast backward of video stream |
| PCT/CN2016/086874 WO2017005098A1 (en) | 2015-07-08 | 2016-06-23 | Method and device for realizing the fast-forward or fast-backward of video stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510397463.0A CN106331871B (en) | 2015-07-08 | 2015-07-08 | Method and device for realizing fast forward or fast backward of video stream |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106331871A true CN106331871A (en) | 2017-01-11 |
| CN106331871B CN106331871B (en) | 2020-01-17 |
Family
ID=57684670
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510397463.0A Active CN106331871B (en) | 2015-07-08 | 2015-07-08 | Method and device for realizing fast forward or fast backward of video stream |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106331871B (en) |
| WO (1) | WO2017005098A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107426627A (en) * | 2017-06-19 | 2017-12-01 | 环球智达科技（北京）有限公司 | Playing device |
| CN111077981A (en) * | 2019-12-30 | 2020-04-28 | 联想(北京)有限公司 | Display method, information processing method and electronic equipment |
| CN113613049A (en) * | 2021-07-22 | 2021-11-05 | 山东云缦智能科技有限公司 | Method for smoothly dragging progress bar of set top box media player |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111669627B (en) * | 2020-06-30 | 2022-02-15 | 广州市百果园信息技术有限公司 | Method, device, server and storage medium for determining video code rate |
| CN114584794B (en) * | 2020-12-01 | 2023-09-22 | 青岛海信宽带多媒体技术有限公司 | Audio and video playing method and device, intelligent set top box and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1556649A (en) * | 2003-12-31 | 2004-12-22 | 清华大学 | Method of video frequency fast in fast out and normal speed restoring based on in frame coding image searching |
| CN101321265A (en) * | 2007-06-07 | 2008-12-10 | 中兴通讯股份有限公司 | Method and system for implementing peer-to-peer network media order frame-across broadcast mode |
| US20130019273A1 (en) * | 2011-07-11 | 2013-01-17 | Azuki Systems, Inc. | Method and system for trick play in over-the-top video delivery |
| CN103763581A (en) * | 2013-05-02 | 2014-04-30 | 乐视网信息技术（北京）股份有限公司 | Method and system for achieving back view of live program |
| CN104394353A (en) * | 2014-10-14 | 2015-03-04 | 浙江宇视科技有限公司 | Video compression method and device |
| CN104602117A (en) * | 2015-01-31 | 2015-05-06 | 华为技术有限公司 | Double-speed video playing method and device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009028012A1 (en) * | 2007-08-29 | 2009-03-05 | Thomson Licensing | Method for generating video data for trick play |
| CN101540881B (en) * | 2008-03-19 | 2011-04-13 | 华为技术有限公司 | Method, device and system for realizing positioning playing of streaming media |
-
2015
- 2015-07-08 CN CN201510397463.0A patent/CN106331871B/en active Active
-
2016
- 2016-06-23 WO PCT/CN2016/086874 patent/WO2017005098A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1556649A (en) * | 2003-12-31 | 2004-12-22 | 清华大学 | Method of video frequency fast in fast out and normal speed restoring based on in frame coding image searching |
| CN101321265A (en) * | 2007-06-07 | 2008-12-10 | 中兴通讯股份有限公司 | Method and system for implementing peer-to-peer network media order frame-across broadcast mode |
| US20130019273A1 (en) * | 2011-07-11 | 2013-01-17 | Azuki Systems, Inc. | Method and system for trick play in over-the-top video delivery |
| CN103763581A (en) * | 2013-05-02 | 2014-04-30 | 乐视网信息技术（北京）股份有限公司 | Method and system for achieving back view of live program |
| CN104394353A (en) * | 2014-10-14 | 2015-03-04 | 浙江宇视科技有限公司 | Video compression method and device |
| CN104602117A (en) * | 2015-01-31 | 2015-05-06 | 华为技术有限公司 | Double-speed video playing method and device |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107426627A (en) * | 2017-06-19 | 2017-12-01 | 环球智达科技（北京）有限公司 | Playing device |
| CN111077981A (en) * | 2019-12-30 | 2020-04-28 | 联想(北京)有限公司 | Display method, information processing method and electronic equipment |
| CN111077981B (en) * | 2019-12-30 | 2022-01-18 | 联想(北京)有限公司 | Display method, information processing method and electronic equipment |
| CN113613049A (en) * | 2021-07-22 | 2021-11-05 | 山东云缦智能科技有限公司 | Method for smoothly dragging progress bar of set top box media player |
| CN113613049B (en) * | 2021-07-22 | 2023-04-07 | 山东浪潮超高清视频产业有限公司 | Method for smoothly dragging progress bar of set top box media player |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106331871B (en) | 2020-01-17 |
| WO2017005098A1 (en) | 2017-01-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11303881B2 (en) | Method and client for playing back panoramic video | |
| US8321905B1 (en) | Fast switching of media streams | |
| AU2011101152B4 (en) | System and method for displaying information related to video programs in a graphical user interface | |
| US9253533B1 (en) | Scene identification | |
| US9077956B1 (en) | Scene identification | |
| CN106331871A (en) | Method and device for realizing fast-forward or fast-backward playback of video stream | |
| JP2019054537A (en) | Generating videos with multiple viewpoints | |
| US20170171274A1 (en) | Method and electronic device for synchronously playing multiple-cameras video | |
| US8918737B2 (en) | Zoom display navigation | |
| JP6499324B2 (en) | Method, client and computer storage medium for playing video | |
| EP3913924B1 (en) | 360-degree panoramic video playing method, apparatus, and system | |
| US8739041B2 (en) | Extensible video insertion control | |
| WO2017181597A1 (en) | Method and device for video playback | |
| WO2019214371A1 (en) | Image display method and generating method, device, storage medium and electronic device | |
| WO2016074327A1 (en) | Control method, apparatus and system of media stream | |
| CN101854508B (en) | The method and apparatus of the content of multimedia of reverse playback of encoded | |
| KR101710502B1 (en) | Apparatus and method for playing contents, and apparatus and method for providing contents | |
| KR102505973B1 (en) | Image processing apparatus, control method thereof and computer readable medium having computer program recorded therefor | |
| US20170188109A1 (en) | Method and electronic device for switching video | |
| CN106331089A (en) | Video play control method and system | |
| US20170078751A1 (en) | Intelligent terminal-based tween interactive advertisement placement method and apparatus | |
| JP5887994B2 (en) | Video transmission device, terminal device, video transmission method and program | |
| CN106878807B (en) | Video switching method and device | |
| CN104219578A (en) | Video processing method and video processing device | |
| CN110213596A (en) | Switching method, device, computer equipment and storage medium is broadcast live |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1233095 Country of ref document: HK |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |