CN105959798A - Video stream frame positioning method and device, and equipment - Google Patents
Video stream frame positioning method and device, and equipment Download PDFInfo
- Publication number
- CN105959798A CN105959798A CN201610509187.7A CN201610509187A CN105959798A CN 105959798 A CN105959798 A CN 105959798A CN 201610509187 A CN201610509187 A CN 201610509187A CN 105959798 A CN105959798 A CN 105959798A
- Authority
- CN
- China
- Prior art keywords
- video data
- image
- repetition
- data
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4405—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video stream decryption
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/454—Content or additional data filtering, e.g. blocking advertisements
- H04N21/4545—Input to filtering algorithms, e.g. filtering a region of the image
- H04N21/45452—Input to filtering algorithms, e.g. filtering a region of the image applied to an object-based stream, e.g. MPEG-4 streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/654—Transmission by server directed to the client
Abstract
The invention relates to a video stream frame positioning method and device, and a piece of equipment. The method comprises the steps of receiving video data sent by a distribution server, wherein the video data comprises at least two frames of images; obtaining the image size and data value sum of each frame of image through calculation; judging whether there are repeated images in the video data or not according to the image size and data value sum of each frame of image; and screening the repeated image if there are the repeated images in the video data, and sending the other images in the video data to a decoding module for decoding according to a breakpoint mode. Through comparison of the image size of each frame of image in the received video data with the magnitude of the decoded data, whether there are the repeated frames or not is determined; if there are repeated images, the repeated images are screened and then are sent to the decoding module for decoding; the inaccurate time stamp resulting from the repeated images is avoided; and the data decoding accuracy is ensured.
Description
Technical field
It relates to computer technology, particularly relate to frame alignment method, device and the equipment of a kind of video flowing.
Background technology
Along with becoming increasingly popular of Internet, the data in transmission over networks have been no longer limited to word and figure, but by
Gradually to the multimedia form transition such as sound and video.At present when multimedia files such as transmission over networks audio/videos, substantially
Upper only download and two kinds of selections of stream transmission.If using streaming manner to carry out the transmission of audio/video, sound,
The multimedia file such as image, animation, by being responsible for user continuously by special streaming media server, sent in real time, is so used
Family can wait until that whole file is all downloaded complete, and it is the most permissible to have only to the start-up study through several seconds, when this
When a little multi-medium datas are play on a client, the remainder of file will continue to download from streaming media server, use this
During mode, the image of each frame is previously provided with timestamp, and receiving terminal uses timestamp to be decoded, but works as
The problems such as Network Abnormal or other situations cause that frame repeats, when i.e. timestamp is incorrect, easily cause decoder internal chaotic,
Cause decoding error.
Summary of the invention
For overcoming problem present in correlation technique, the disclosure provides frame alignment method, device and the equipment of a kind of video flowing.
First aspect according to disclosure embodiment, it is provided that a kind of frame alignment method of video flowing, including:
Receive the video data that Distributor sends；Described video data includes at least two two field pictures；
Calculate image size and the data value summation obtaining every two field picture；
Described image size according to every two field picture and described data value summation, it is judged that in described video data, whether there is repetition
Image；
If described video data exists the image of repetition, then the image of described repetition is screened, and with described video counts
Other images according to are sent into decoder module according to breakpoint mode and are decoded.
The technical scheme that disclosure embodiment provides, applies at mobile phone etc. for the frame receiving video flowing the terminal being decoded
Equipment side, by the contrast to the size of data after the image size of the every two field picture in the video data received and coding,
Determining whether the frame repeated, being decoded if being re-fed into decoder module after having the optical sieving of repetition, it is to avoid due to figure
Timestamp as repeating to cause is incorrect, it is ensured that the correctness of the data of decoding.
Optionally, described method also includes:
If described video data does not exist the image of repetition, then by all images in described video data according to breakpoint mode
Feeding decoder module is decoded.
The technical scheme that disclosure embodiment provides, is equally applied to the frame for receiving video flowing such as mobile phone also with such scheme
The terminal equipment side being decoded, by the number after the image size of the every two field picture in the video data received and coding
Contrast according to size, it is determined whether have the frame of repetition, without the image repeated, is the most directly decoded playing, if
It is re-fed into decoder module after having the optical sieving of repetition to be decoded playing, it is to avoid owing to image repeats the timestamp that causes not
Correctly, it is ensured that the correctness of the data of decoding, and will not be incorrect and show mosaic when video playback due to timestamp,
Raising user watches experience during video.
Optionally, the described image size of the every two field picture of described basis and described data value summation, it is judged that in described video data
The image whether existence repeats, including:
If in described video data, the image size of at least two frame the first images is the most identical with data value summation, the most described video counts
According to the middle image existing and repeating；Wherein, described at least two frame the first images are the image repeated；
Otherwise, described video data does not exist the image of repetition.
Optionally, the described image by described repetition screens, including:
Retaining the two field picture in the image of described repetition, the image other repeated abandons.
The technical scheme that disclosure embodiment provides, on the basis of aforementioned schemes, this programme provides and utilizes image size sum
According to the concrete mode that value summation contrast images is the most identical, the size of the image of the most each frame is all different big, but
It is if be detected that this video data exists the equirotal frame of image, in order to further determine whether these images weigh
Multiple, needing the data after coding are contrasted, a kind of simple mode is exactly that the view data after encoding is folded
Adding, calculate the summation of the data value of this two field picture, the size if there is image is the most identical with data value summation, it is determined that
Those images repeat, and now have only to retain a wherein frame, are abandoned by other image, then with the image of other frames
Data are decoded playing together, it is to avoid the timestamp owing to repeating to cause due to image is incorrect, it is ensured that the data of decoding
Correctness, it is possible to improve Consumer's Experience.
Optionally, before the video data that described reception Distributor sends, described method also includes:
The first video data request message is sent to server；Described first video data request message includes receiving device
Mark, described first video data request message is for video data described in server request.
Optionally, described method also includes:
If Network Abnormal being detected, then send the second video data request message to server；Described second video data request
Message is for again to video data described in described server request.
The technical scheme that disclosure embodiment provides, the terminal unit of receiving terminal receives video data two ways, Yi Zhongshi
The downlink data that server actively sends；Another kind is the downlink data received after the data application that terminal unit is initiated,
The video data either received in the case of which kind of is likely to owing to the reason of Network Abnormal re-starts acquisition, at this moment may
The situation of Data duplication occurs, i.e. gets the image of repetition, by the figure to the every two field picture in the video data received
Contrast as the size of data after size and coding, it is determined whether have the frame of repetition, if after having the optical sieving of repetition again
Feeding decoder module is decoded, it is to avoid the timestamp repeating to cause due to image is incorrect, it is ensured that the data of decoding correct
Property.
Second aspect according to disclosure embodiment, it is provided that the frame alignment device of a kind of video flowing, including:
Receiver module, is configured to receive the video data that Distributor sends；Described video data includes at least two frame figures
Picture；
First processing module, is configured to calculate image size and the data value summation obtaining every two field picture；
Second processing module, is configured to the described image size according to every two field picture and described data value summation, it is judged that described
Whether video data exists the image of repetition；
3rd processing module, if being configured to described second processing module to judge to exist in described video data the figure of repetition
Picture, then screen the image of described repetition；
First sending module, is configured to the image after being screened by the image of described repetition and its in described video data
His image is sent into decoder module according to breakpoint mode and is decoded.
Optionally, described device also includes:
Second sending module, if being configured to described second processing module to judge not exist in described video data the figure of repetition
Picture, then send into decoder module by all images in described video data according to breakpoint mode and be decoded.
Optionally, described second processing module is specifically configured to determine the figure of at least two frame the first images in described video data
As size is the most identical with data value summation, the most described video data exists the image of repetition；Wherein, described at least two frames
One image is the image repeated；
Otherwise, it determines go out the image that there is not repetition in described video data.
Optionally, described third time processing module includes:
First processes submodule, is configured to the two field picture retaining in the image of described repetition, and the image other repeated is lost
Abandon.
Optionally, described device also includes:
3rd sending module, is configured to send the first video data request message to server；Described first video data please
Receiving device identifies to ask message to include, described first video data request message is for video counts described in server request
According to.
Optionally, described device also includes:
Fourth processing module, is configured to detect network condition；
4th sending module, if being configured to described fourth processing module Network Abnormal to be detected, then sends second to server
Video data request message；Described second video data request message is for again to video counts described in described server request
According to.
The third aspect according to disclosure embodiment, it is provided that a kind of terminal unit, including: it is configured to control executable instruction
The processor that performs, it is configured to store the memorizer of processor executable and be configured to receive the reception of data
Device；
Described receptor is configured to:
Receive the video data that Distributor sends；Described video data includes at least two two field pictures；
Described processor is configured to:
Calculate image size and the data value summation obtaining every two field picture；
Described image size according to every two field picture and described data value summation, it is judged that in described video data, whether there is repetition
Image；
If described video data exists the image of repetition, then the image of described repetition is screened, and with described video counts
Other images according to are sent into decoder module according to breakpoint mode and are decoded.
Frame alignment method, device and the equipment of video flowing that the present invention provides, the terminal unit of receiving terminal is by receiving
The contrast of the size of data after the image size of the every two field picture in video data and coding, it is determined whether have the frame of repetition, as
It is re-fed into decoder module after really having the optical sieving of repetition to be decoded, then plays out, without the image repeated
The most directly it is decoded playing, it is to avoid the timestamp repeating to cause due to image is incorrect, it is ensured that the correctness of the data of decoding,
Ka Dun and mosaic can be avoided carrying out video playback when, improve Consumer's Experience.
It should be appreciated that it is only exemplary and explanatory that above general description and details hereinafter describe, can not limit
The disclosure processed.
Accompanying drawing explanation
Accompanying drawing herein is merged in description and constitutes the part of this specification, it is shown that meet embodiments of the invention,
And for explaining the principle of the present invention together with description.
Fig. 1 is the flow chart of the frame alignment embodiment of the method one according to a kind of video flowing shown in an exemplary embodiment；
Fig. 2 is the flow chart of the frame alignment embodiment of the method two according to a kind of video flowing shown in an exemplary embodiment；
Fig. 3 is the frame alignment method application scenarios schematic diagram according to a kind of video flowing shown in an exemplary embodiment；
Fig. 4 is the flow chart of the frame alignment embodiment of the method three according to a kind of video flowing shown in an exemplary embodiment；
Fig. 5 is the block diagram of the frame alignment device embodiment one according to a kind of video flowing shown in an exemplary embodiment；
Fig. 6 is the block diagram of the frame alignment device embodiment two according to a kind of video flowing shown in an exemplary embodiment；
Fig. 7 is the block diagram of the frame alignment device embodiment three according to a kind of video flowing shown in an exemplary embodiment；
Fig. 8 is the block diagram of the frame alignment device embodiment four according to a kind of video flowing shown in an exemplary embodiment；
Fig. 9 is the block diagram of the frame alignment device embodiment five according to a kind of video flowing shown in an exemplary embodiment；
Figure 10 is the block diagram of the entity according to a kind of terminal unit shown in an exemplary embodiment；
Figure 11 is the block diagram according to a kind of terminal unit 1200 shown in an exemplary embodiment.
Detailed description of the invention
Here will illustrate exemplary embodiment in detail, its example represents in the accompanying drawings.Explained below relates to accompanying drawing
Time, unless otherwise indicated, the same numbers in different accompanying drawings represents same or analogous key element.In following exemplary embodiment
Described embodiment does not represent all embodiments consistent with the present invention.On the contrary, they are only and the most appended power
The example of the apparatus and method that some aspects that described in detail in profit claim, the present invention are consistent.
Data in transmission over networks have been no longer limited to word and figure, but gradually to the multimedia lattice such as sound and video
Formula transition.At present transmission over networks audio/video (English: Audio/Video, A/V) be called for short: the multimedia file such as
Time, substantially only download and two kinds of selections of stream transmission.Typically, the memory space that A/V file occupies is the biggest,
The network environment of Bandwidth-Constrained is downloaded and may expend several minutes even a few hours, so the delay of this processing method is very
Greatly.If using stream transmission instead, the multimedia file such as sound, image, animation will be born by special streaming media server
To user continuously, send in real time, such user can wait until that whole file is all downloaded complete to duty, and have only to through
It's several seconds the pasting start-up study is the most permissible, and when these multi-medium datas are play on a client, the remainder of file will
Continue to download from streaming media server.
Stream (Streaming) is the new ideas occurred the most on internet, and its definition widely, is primarily referred to as passing through
The technology general name of network transmitting multimedia data.Streaming Media comprises broad sense and two kinds of intensions of narrow sense: sensu lato Streaming Media refers to
It is the general name making Voice & Video form stable and continuous print transmission stream and a series of technology, method and the agreement of playback stream, i.e.
Stream media technology；Sense stricto Streaming Media is for traditional download-playback mode, refer to a kind of from
The upper new method obtaining the multi-medium datas such as Voice & Video of Internet, it can support the real-time Transmission of multimedia data stream
And real-time play.By using stream media technology, server can send stable and continuous print multimedia data stream to client computer,
Client computer is put with a stable speed while receiving data, and data need not be waited to carry out back after all having downloaded again
Put.
Timestamp (timestamp) have recorded the sampling time of first character joint in load；Current video is all by connecting a sheet by a sheet
Continuous picture composition, every width picture is exactly a frame, and film typically uses the frame frequency of 24 frames；TV is according to standard
The scanning field frequency impact that different and alternating current causes, frame per second is 25 frames (pal mode) per second or 30 frame (NTSC per second
Standard).
Wherein, I frame (I frame) is also called Intra pictures (intra picture), and I frame is typically each GOP (MPEG
A kind of video compression technology used) first frame, through moderately compressing, as the reference point of random access, can
With as image.When for continuous moving picture encoding, continuous some width images are divided into P, B, I three types, P
Frame is predicted by the P frame before it or I frame, and it compares the identical information between P frame or I frame before it
Or data, namely consider that the characteristic of motion carries out interframe compression.
The receiving terminal of the video flowing provided at present mainly uses timestamp timestamp to judge whether present frame is to repeat
Frame, thus decide whether to send into decoder, if display, but timestamp itself may be owing to arranging or Network Abnormal
Reacquire video data and cause confusion or change, i.e. when timestamp timestamp is incorrect, cause decoder
Internal state is chaotic, can cause decoding error, the problem that can show mosaic on screen, provides a kind of based on this present invention
The frame alignment method of video flowing, is used for solving the problems referred to above.
Fig. 1 is the flow chart of the frame alignment embodiment of the method one according to a kind of video flowing shown in an exemplary embodiment.Such as figure
Shown in 1, the method is mainly used in mobile phone, panel computer, computer etc. for the frame receiving video flowing the end being decoded
End equipment side.The frame alignment method of this video flowing comprises the following steps:
In step S101, receive the video data that Distributor sends；Described video data includes at least two two field pictures.
In this step, the video data that terminal unit receives is to be passed through content delivery network service by video resource server
The video data that device issues, this most above-mentioned Distributor of content delivery network service device, this video data is every to video
The data that two field picture produces after encoding, in this programme, the situation of the data that terminal unit receives server transmission includes two
Kind, a kind of video data being server and actively issuing, another kind is the terminal unit video data to server application, eventually
The video data that end equipment receives can include multiple image.Implementing middle terminal unit can be by mounted thereto
Client realizes the reception of video data, such as: Tengxun's video, Sohu's video etc..
In the present embodiment, video data is equivalent to video flowing, and its implication is identical, and this programme is to the frame in video flowing really
Fixed, determine that repeating frame therein row filter of going forward side by side processes, to avoid the occurrence of mistake.
In step s 102, image size and the data value summation of the every two field picture of acquisition are calculated.
In this step, terminal unit is after receiving video data, and detection obtains the every two field picture in this video data
Size, such as: the size of image 1 is 1k, the size of image 2 is 0.8k etc., and the number to the every two field picture after coding
According to suing for peace, such as: video data or voice data can be encoded as binary data and be transmitted, here
Data value summation refers to the numerical value that all binary data summation after being encoded by this two field picture obtains, it is also possible to be that other are compiled
Code mode, without limitation.Terminal unit, after every two field picture is carried out above-mentioned processing procedure, obtains the figure of every two field picture
As size and data value summation.
In step s 103, according to described image size and the described data value summation of every two field picture, it is judged that described video counts
The image of repetition whether is there is according to.
In this step, by the data value summation of image size and image, detect in above-mentioned video data whether there is phase
Same image, generally, the size if there is two images is identical, if data value summation is the most identical, then it is assumed that
These two images are the contents repeated, otherwise it is assumed that different.Terminal unit can determine this video data to utilize this kind of mode
In the image of all of repetition, in this scenario, if video data does not exist the image of repetition, then receive all
Video data be all decoded, special decoder module be decoded, and according to user need play out.
In step S104, if described video data exists the image of repetition, then the image of described repetition is screened,
And send into decoder module with other images in described video data according to breakpoint mode and be decoded.
In this step, determined the image that whether there is repetition in above-mentioned video data by above-mentioned steps terminal unit, if
Exist, then need the data of the image that those repeat are carried out Screening Treatment, the image of repetition is only retained one of them i.e.
Can, remaining part repeated can directly abandon, and then will screen a remaining image and other unduplicated figure
As in the lump according to breakpoint, namely the mode of timestamp is sent into decoder module and is decoded, and chooses whether according to the needs of user
Play out.
The frame alignment method of the video flowing of offer is provided, applies and go forward side by side for receiving the frame of video flowing at mobile phone etc.
The terminal equipment side of row decoding, by the data after the image size of the every two field picture in the video data received and coding
The contrast of size, it is determined whether have the frame of repetition, is decoded if being re-fed into decoder module after having the optical sieving of repetition,
Avoid the timestamp repeating to cause due to image incorrect, it is ensured that the correctness of the data of decoding.
Fig. 2 is the flow chart of the frame alignment embodiment of the method two according to a kind of video flowing shown in an exemplary embodiment.Such as figure
Shown in 2, in conjunction with above-described embodiment, the method is mainly used in mobile phone, panel computer, computer etc. for receiving video flowing
Frame the terminal equipment side being decoded, can be to the image in the video data received, and its solid-state properties according to itself is true
The fixed frame that whether there is repetition, is decoded the most again.The frame alignment method of this video flowing comprises the following steps:
In step s 201, the video data that Distributor sends is received；Described video data includes at least two two field pictures.
In step S202, calculate image size and the data value summation obtaining every two field picture.
In step S203, if image size and the data value summation of at least two frame the first images are homogeneous in described video data
With, the most described video data exists the image of repetition；Wherein, described at least two frame the first images are the image repeated.
The specific implementation of aforementioned several step is similar with embodiment one, and the size of the image of the most each frame all differs
Sample is big, but if be detected that this video data exists the equirotal frame of image, in order to further determine these figures
As whether repeating, needing to contrast the data after coding, a kind of simple mode is exactly the image after encoding
Data are overlapped, and calculate the summation of the data value of this two field picture.In this step, now basis it is usually in implementing
The size of each image judges, the size if all of image is the most different, then it is assumed that those images are all different,
There is not the image of repetition in achievement；Size if there is image is the same, can not determine that those images are this time completely
Repeat, it is therefore desirable to the data value summation of the data of the image after coding is compared, if the data value summation of data
The most identical, determine that those images are identical image this time, i.e. repeat.
In step S204, if described video data exists the image of repetition, then retain in the image of described repetition
Two field picture, the image other repeated abandons, and by the two field picture retained in the image of repetition and described video data
Other images send into decoder module according to breakpoint mode and be decoded.
In this step, the multiple images that will repeat only retain one of them, can directly abandoning, then of other
By other image together with the image remained, send into decoder module according to timestamp and be decoded, permissible after decoding
Locally stored, it is also possible to select to play out according to user.
The frame alignment method of the video flowing of offer is provided, is equally applied to mobile phone etc. for receiving with such scheme
The frame of video flowing the terminal equipment side being decoded, by the image size to the every two field picture in the video data received
Contrast with the size of data after coding, it is determined whether have the frame of repetition, without the image repeated, the most directly solves
Code is play, and is decoded playing if being re-fed into decoder module after having the optical sieving of repetition, it is to avoid owing to image repeats to lead
Cause timestamp incorrect, it is ensured that the correctness of the data of decoding, and will not due to timestamp incorrect and in video playback
Time show mosaic, improve experience when user watches video.
Fig. 3 is the frame alignment method application scenarios schematic diagram according to a kind of video flowing shown in an exemplary embodiment.Fig. 4
It it is the flow chart of frame alignment embodiment of the method three according to a kind of video flowing shown in an exemplary embodiment.Reference Fig. 3, depending on
The overall distribution procedure substantially flow process of frequency stream is: source video data is uploaded on the server be correlated with protect by video distribution person
Deposit or share, in this process can to coding video data, other user side needs viewing video or under
When carrying video, send video data request message, server by the user end to server being arranged on respective terminal unit
After receiving this video data request message, according to the mark of the video data of request, obtain corresponding video data,
And send it to content distributing network (English: Content Delivery Network, the abbreviation: CDN) service of correspondence
Device forwards, and by CDN server, video data is transmitted to client, namely the terminal unit of user side.Ginseng
According to Fig. 4, in conjunction with above-mentioned scene, the specific implementation of the heavily frame alignment method of this video flowing it is described below:
In step S301, send video data request message to server.
In this step, the situation that terminal unit sends video data request message to server is divided into two kinds, and one is that user needs
Checking certain video, so operating on the terminal device, sending request, another kind of situation by client to user
It is during obtaining video data, Network Abnormal detected, need again from server pull video flowing when, to
Server sends video data request message again.
In step s 302, the video data that Distributor sends is received.
During this step performs, terminal unit detects network condition in real time, if Network Abnormal or receive certain and regard
Frequently the when of data failure, need in request data again, i.e. step S3021, if Network Abnormal being detected, the most again
Video data request message is sent to server.
In step S303, calculate image size and the data value summation obtaining every two field picture.
In step s 304, according to image size and the data value summation of every two field picture, it is judged that whether video data exists
The image repeated.
In step S305, the image of repetition is screened.
In step S306, all images in video data are sent into decoder module according to breakpoint mode and is decoded.
The data that in this step, feeding decoder module is decoded refer to not exist all images of repetition, including video own
Data the most do not exist repetition, or there are not all images of repetition after the image repeated is screened.
In the program, under complicated network environment, it is to avoid the mosaic produced due to timestamp mistake.
Optionally, it is possible to use md5, but calculating resource can be wasted to a certain extent.
In above process, the terminal unit of receiving terminal receives video data has two ways, one to be that server actively sends
Downlink data；Another kind is the downlink data received after the data application that terminal unit is initiated, either which kind of situation
The video data of lower reception is likely to, owing to the reason of Network Abnormal re-starts acquisition, at this moment be likely to occur Data duplication
Situation, i.e. gets the image of repetition, and the size of the image of the most each frame is all different big, but if detection
Go out this video data exists the equirotal frame of image, in order to further determine what whether these images repeated, need
Contrasting the data after coding, a kind of simple mode is exactly that the view data after encoding is overlapped, and calculates
The summation of the data value of this two field picture, the size if there is image is the most identical with data value summation, it is determined that those image weights
Multiple, now have only to retain a wherein frame, other image is abandoned, then enters together with the view data of other frames
Row decoding is play, it is to avoid the timestamp owing to repeating to cause due to image is incorrect, it is ensured that the correctness of the data of decoding, and
Consumer's Experience can be improved.
Fig. 5 is the block diagram of the frame alignment device embodiment one according to a kind of video flowing shown in an exemplary embodiment.With reference to figure
4, the frame alignment device 10 of this video flowing, including:
Receiver module 11, is configured to receive the video data that Distributor sends；Described video data includes at least two
Two field picture；
First processing module 12, is configured to calculate image size and the data value summation obtaining every two field picture；
Second processing module 13, is configured to the described image size according to every two field picture and described data value summation, it is judged that
Whether described video data exists the image of repetition；
3rd processing module 14, if being configured to described second processing module to judge to exist in described video data repetition
Image, then screen the image of described repetition；
First sending module 15, is configured in the image after being screened by the image of described repetition and described video data
Other images send into decoder module according to breakpoint mode and be decoded.
The frame alignment device of the video flowing that the present embodiment provides, for performing the skill of terminal unit in aforementioned either method embodiment
Art scheme, it is similar with technique effect that it realizes principle, by the image size to the every two field picture in the video data received
Contrast with the size of data after coding, it is determined whether have the frame of repetition, if being re-fed into after having the optical sieving of repetition solving
Code module is decoded, it is to avoid the timestamp repeating to cause due to image is incorrect, it is ensured that the correctness of the data of decoding.
On the basis of the embodiment shown in above-mentioned Fig. 5, Fig. 6 is according to a kind of video flowing shown in an exemplary embodiment
The block diagram of frame alignment device embodiment two.With reference to Fig. 6, the frame alignment device 10 of described video flowing also includes:
Second sending module 16, if being configured to described second processing module to judge not exist in described video data repetition
Image, then all images in described video data are sent into decoder module according to breakpoint mode and are decoded.
Optionally, described second processing module 13 is specifically configured to:
Determine that in described video data, the image size of at least two frame the first images is the most identical with data value summation, the most described video
Data exist the image of repetition；Wherein, described at least two frame the first images are the image repeated；
Otherwise, it determines go out the image that there is not repetition in described video data.
The frame alignment device of the video flowing that the present embodiment provides, for performing the skill of terminal unit in aforementioned either method embodiment
Art scheme, it is similar with technique effect that it realizes principle, and the size of the image of the most each frame is all different big, but
If be detected that this video data exists the equirotal frame of image, in order to further determine whether these images repeat
, needing the data after coding are contrasted, a kind of simple mode is exactly that the view data after encoding is overlapped,
Calculating the summation of the data value of this two field picture, the size if there is image is the most identical with data value summation, it is determined that those
Image repeats, and now has only to retain a wherein frame, is abandoned by other image, then with the view data of other frames
It is decoded together playing, it is to avoid the timestamp owing to repeating to cause due to image is incorrect, it is ensured that the data of decoding correct
Property, it is possible to improve Consumer's Experience.
On the basis of the embodiment shown in above-mentioned Fig. 5 or Fig. 6, Fig. 7 is to regard according to the one shown in an exemplary embodiment
The block diagram of the frame alignment device embodiment three of frequency stream.With reference to Fig. 7, described third time processing module 14 includes:
First processes submodule 141, is configured to the two field picture retaining in the image of described repetition, the figure other repeated
As abandoning.
The frame alignment device of the video flowing that the present embodiment provides, for performing the skill of terminal unit in aforementioned either method embodiment
Art scheme, it is similar with technique effect that it realizes principle, does not repeats them here.
On the basis of the embodiment shown in above-mentioned Fig. 5-7, Fig. 8 is according to a kind of video flowing shown in an exemplary embodiment
The block diagram of frame alignment device embodiment four.With reference to Fig. 8, the frame alignment device 10 of described video flowing also includes:
3rd sending module 17, is configured to send the first video data request message to server；Described first video counts
Including that receiving device identifies according to request message, described first video data request message is for regarding to described in server request
Frequency evidence.
On the basis of the embodiment shown in above-mentioned Fig. 5-8, Fig. 9 is according to a kind of video flowing shown in an exemplary embodiment
The block diagram of frame alignment device embodiment four.With reference to Fig. 9, the frame alignment device 10 of described video flowing also includes:
Fourth processing module 18, is configured to detect network condition；
4th sending module 19, if being configured to described fourth processing module 18 Network Abnormal to be detected, then sends out to server
Send the second video data request message；Described second video data request message is for again regarding to described in described server request
Frequency evidence.
The frame alignment device of the video flowing that the present embodiment provides, for performing the skill of terminal unit in aforementioned either method embodiment
Art scheme, it is similar with technique effect that it realizes principle, and the terminal unit of receiving terminal receives video data two ways, a kind of
It it is the downlink data of server actively transmission；Another kind is the lower line number received after the data application that terminal unit is initiated
According to, the video data either received in the case of which kind of is likely to owing to the reason of Network Abnormal re-starts acquisition, at this moment
It is likely to occur the situation of Data duplication, i.e. gets the image of repetition, by the every two field picture in the video data received
Image size and coding after the contrast of size of data, it is determined whether have the frame of repetition, if there being the optical sieving mistake of repetition
After be re-fed into decoder module and be decoded, it is to avoid the timestamp repeating to cause due to image is incorrect, it is ensured that the data of decoding
Correctness.
About the frame alignment device of the video flowing in each embodiment above-mentioned, wherein modules has performed the concrete mode of operation
Through being described in detail in about the embodiment of the method, explanation will be not set forth in detail herein.I.e. the foregoing describe end
The inner function module of end equipment and structural representation.
Figure 10 is the block diagram of the entity according to a kind of terminal unit shown in an exemplary embodiment, and with reference to Figure 10, this terminal sets
Standby can be implemented as: be configured to control processor that executable instruction performs, be configured to store processor and can perform
The memorizer instructed and the receptor being configured to receive data；
Described receptor is configured to:
Receive the video data that Distributor sends；Described video data includes at least two two field pictures；
Described processor is configured to:
Calculate image size and the data value summation obtaining every two field picture；
Described image size according to every two field picture and described data value summation, it is judged that in described video data, whether there is repetition
Image；
If described video data exists the image of repetition, then the image of described repetition is screened, and with described video counts
Other images according to are sent into decoder module according to breakpoint mode and are decoded.
In the embodiment of above-mentioned terminal unit, it should be appreciated that this processor can be that CPU is (English: Central
Processing Unit, is called for short: CPU), it is also possible to be other general processors, digital signal processor (English: Digital
Signal Processor, is called for short: DSP), special IC (English: Application Specific Integrated Circuit,
It is called for short: ASIC) etc..The processor that general processor can be microprocessor or this processor can also be any routine
Deng, and aforesaid memorizer can be read only memory (English: read-only memory, abbreviation: ROM), at random
Access memorizer (English: random access memory, RAM), flash memory, hard disk or solid-state it is called for short:
Hard disk.Hardware processor can be embodied directly in conjunction with the step of the method disclosed in the embodiment of the present invention to have performed, or
Combine execution by the hardware in processor and software module to complete.
Figure 11 is the block diagram according to a kind of terminal unit 1200 shown in an exemplary embodiment.Such as, this terminal unit can
Be the mobile phone of user, panel computer etc. can by client obtain video data equipment.
With reference to Figure 11, terminal unit 1200 can include following one or more assembly: processes assembly 1202, memorizer
1204, power supply module 1206, multimedia groupware 1208, audio-frequency assembly 1210, the interface 1212 of input/output (I/O),
Sensor cluster 1214, and communications component 1216.
Process assembly 1202 and generally control the integrated operation of terminal unit 1200, such as with display, data communication, multimedia
The operation that operation and record operation are associated.Process assembly 1202 and can include that one or more processor 1220 performs to refer to
Order, to complete all or part of step of above-mentioned method.Additionally, process assembly 1202 can include one or more mould
Block, it is simple to process between assembly 1202 and other assemblies is mutual.Such as, process assembly 1202 and can include multimedia mould
Block, with facilitate multimedia groupware 1208 and process between assembly 1202 mutual.
Memorizer 1204 is configured to store various types of data to support the operation at terminal unit 1200.These data
Example include on terminal unit 1200 operation any application program or the instruction of method, Various types of data, message,
Picture, video etc..Memorizer 1204 can be by any kind of volatibility or non-volatile memory device or their group
Close and realize, such as static RAM (SRAM), Electrically Erasable Read Only Memory (EEPROM),
Erasable Programmable Read Only Memory EPROM (EPROM), programmable read only memory (PROM), read only memory (ROM),
Magnetic memory, flash memory, disk or CD.
The various assemblies that power supply module 1206 is terminal unit 1200 provide electric power.Power supply module 1206 can include power supply
Management system, one or more power supplys, and other generate, manage and distribute what electric power was associated with for terminal unit 1200
Assembly.
The screen of one output interface of offer that multimedia groupware 1208 is included between described terminal unit 1200 and user.
In certain embodiments, screen can include liquid crystal display (LCD) and touch panel (TP).If screen includes
Touch panel, screen may be implemented as touch screen, to receive the input signal from user.Touch panel include one or
Multiple touch sensors are with the gesture on sensing touch, slip and touch panel.Described touch sensor can not only sense tactile
Touch or the border of sliding action, but also detect the persistent period relevant to described touch or slide and pressure.
Audio-frequency assembly 1210 is configured to output and/or input audio signal.Such as, audio-frequency assembly 1210 includes a wheat
Gram wind (MIC), when terminal unit 1200 is in operator scheme, such as call model, logging mode and speech recognition mode
Time, mike is configured to receive external audio signal.The audio signal received can be further stored at memorizer
1204 or send via communications component 1216.In certain embodiments, audio-frequency assembly 1210 also includes a speaker,
For exporting audio signal.
I/O interface 1212 provides interface for processing between assembly 1202 and peripheral interface module, above-mentioned peripheral interface module can
To be keyboard, put striking wheel, button etc..
Sensor cluster 1214 includes one or more sensor, for providing the state of various aspects for terminal unit 1200
Assessment.Such as, what sensor cluster 1214 can detect terminal unit 1200 opens/closed mode, assembly relative
Location, the most described assembly is display and the keypad of terminal unit 1200, and sensor cluster 1214 can also detect end
End equipment 1200 or the position change of 1,200 1 assemblies of terminal unit, existence that user contacts with terminal unit 1200 or
Do not exist, terminal unit 1200 orientation or acceleration/deceleration and the variations in temperature of terminal unit 1200.Sensor cluster 1214
Proximity transducer can be included, be configured to when there is no any physical contact object near detecting.Sensor
Assembly 1214 can also include optical sensor, such as CMOS or ccd image sensor, is used for using in imaging applications.
In certain embodiments, this sensor cluster 1214 can also include acceleration transducer, gyro sensor, and magnetic senses
Device, pressure transducer or temperature sensor.
Communications component 1216 is configured to facilitate the communication of wired or wireless mode between terminal unit 1200 and other equipment.
Terminal unit 1200 can access wireless network based on communication standard, such as WiFi, 2G or 3G, or combinations thereof.
In one exemplary embodiment, communications component 1216 receives the broadcast from external broadcasting management system via broadcast channel
Signal or broadcast related information.In one exemplary embodiment, described communications component 1216 also includes near-field communication (NFC)
Module, to promote junction service.Such as, can be based on RF identification (RFID) technology in NFC module, infrared data is assisted
Meeting (IrDA) technology, ultra broadband (UWB) technology, bluetooth (BT) technology and other technologies realize.
In the exemplary embodiment, terminal unit 1200 can by one or more application specific integrated circuits (ASIC),
Digital signal processor (DSP), digital signal processing appts (DSPD), PLD (PLD), existing
Field programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic components realize, and are used for holding
The frame alignment method of a kind of video flowing in the aforesaid embodiment of row, specifically for performing:
Receive the video data that Distributor sends；Described video data includes at least two two field pictures；
Calculate image size and the data value summation obtaining every two field picture；
Described image size according to every two field picture and described data value summation, it is judged that in described video data, whether there is repetition
Image；
If described video data exists the image of repetition, then the image of described repetition is screened, and with described video counts
Other images according to are sent into decoder module according to breakpoint mode and are decoded.
In the exemplary embodiment, additionally provide a kind of non-transitory computer-readable recording medium including instruction, such as, wrap
Including the memorizer 1204 of instruction, above-mentioned instruction can have been performed said method by the processor 1220 of terminal unit 1200.
Such as, described non-transitory computer-readable recording medium can be ROM, random access memory (RAM),
CD-ROM, tape, floppy disk and optical data storage devices etc..
Those skilled in the art, after considering description and putting into practice invention disclosed herein, will readily occur to other reality of the present invention
Execute scheme.The application is intended to any modification, purposes or the adaptations of the present invention, these modification, purposes or
Adaptations follow the present invention general principle and include the undocumented common knowledge in the art of the disclosure or
Conventional techniques means.Description and embodiments is considered only as exemplary, and true scope and spirit of the invention are by following power
Profit requires to point out.
It should be appreciated that the invention is not limited in precision architecture described above and illustrated in the accompanying drawings, and can
To carry out various modifications and changes without departing from the scope.The scope of the present invention is only limited by appended claim.
Claims (13)
1. the frame alignment method of a video flowing, it is characterised in that including:
Receive the video data that Distributor sends；Described video data includes at least two two field pictures；
Calculate image size and the data value summation obtaining every two field picture；
Described image size according to every two field picture and described data value summation, it is judged that in described video data, whether there is repetition
Image；
If described video data exists the image of repetition, then the image of described repetition is screened, and with described video counts
Other images according to are sent into decoder module according to breakpoint mode and are decoded.
Method the most according to claim 1, it is characterised in that described method also includes:
If described video data does not exist the image of repetition, then by all images in described video data according to breakpoint mode
Feeding decoder module is decoded.
Method the most according to claim 1 and 2, it is characterised in that the described image of the every two field picture of described basis is big
Little and described data value summation, it is judged that whether there is the image of repetition in described video data, including:
If in described video data, the image size of at least two frame the first images is the most identical with data value summation, the most described video counts
According to the middle image existing and repeating；Wherein, described at least two frame the first images are the image repeated；
Otherwise, described video data does not exist the image of repetition.
Method the most according to claim 3, it is characterised in that the described image by described repetition screens, bag
Include:
Retaining the two field picture in the image of described repetition, the image other repeated abandons.
Method the most according to claim 1, it is characterised in that the video data that described reception Distributor sends
Before, described method also includes:
The first video data request message is sent to server；Described first video data request message includes receiving device
Mark, described first video data request message is for video data described in server request.
Method the most according to claim 1 or 5, it is characterised in that described method also includes:
If Network Abnormal being detected, then send the second video data request message to server；Described second video data request
Message is for again to video data described in described server request.
7. the frame alignment device of a video flowing, it is characterised in that including:
Receiver module, is configured to receive the video data that Distributor sends；Described video data includes at least two frame figures
Picture；
First processing module, is configured to calculate image size and the data value summation obtaining every two field picture；
Second processing module, is configured to the described image size according to every two field picture and described data value summation, it is judged that described
Whether video data exists the image of repetition；
3rd processing module, if being configured to described second processing module to judge to exist in described video data the figure of repetition
Picture, then screen the image of described repetition；
First sending module, is configured to the image after being screened by the image of described repetition and its in described video data
His image is sent into decoder module according to breakpoint mode and is decoded.
Device the most according to claim 7, it is characterised in that described device also includes:
Second sending module, if being configured to described second processing module to judge not exist in described video data the figure of repetition
Picture, then send into decoder module by all images in described video data according to breakpoint mode and be decoded.
9. according to the device described in claim 7 or 8, it is characterised in that described second processing module is specifically configured to
Determine that in described video data, the image size of at least two frame the first images is the most identical with data value summation, the most described video data
The middle image that there is repetition；Wherein, described at least two frame the first images are the image repeated；
Otherwise, it determines go out the image that there is not repetition in described video data.
Device the most according to claim 9, it is characterised in that described third time processing module includes:
First processes submodule, is configured to the two field picture retaining in the image of described repetition, and the image other repeated is lost
Abandon.
11. devices according to claim 7, it is characterised in that described device also includes:
3rd sending module, is configured to send the first video data request message to server；Described first video data please
Receiving device identifies to ask message to include, described first video data request message is for video counts described in server request
According to.
12. according to the device described in claim 7 or 11, it is characterised in that described device also includes:
Fourth processing module, is configured to detect network condition；
4th sending module, if being configured to described fourth processing module Network Abnormal to be detected, then sends second to server
Video data request message；Described second video data request message is for again to video counts described in described server request
According to.
13. 1 kinds of terminal units, it is characterised in that including: be configured to control processor, the quilt that executable instruction performs
It is configured to store the memorizer of processor executable and be configured to receive the receptor of data；
Described receptor is configured to:
Receive the video data that Distributor sends；Described video data includes at least two two field pictures；
Described processor is configured to:
Calculate image size and the data value summation obtaining every two field picture；
Described image size according to every two field picture and described data value summation, it is judged that in described video data, whether there is repetition
Image；
If described video data exists the image of repetition, then the image of described repetition is screened, and with described video counts
Other images according to are sent into decoder module according to breakpoint mode and are decoded.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610509187.7A CN105959798B (en) | 2016-06-30 | 2016-06-30 | The frame alignment method, apparatus and equipment of video flowing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610509187.7A CN105959798B (en) | 2016-06-30 | 2016-06-30 | The frame alignment method, apparatus and equipment of video flowing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105959798A true CN105959798A (en) | 2016-09-21 |
| CN105959798B CN105959798B (en) | 2019-05-31 |
Family
ID=56903030
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610509187.7A Active CN105959798B (en) | 2016-06-30 | 2016-06-30 | The frame alignment method, apparatus and equipment of video flowing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105959798B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106454365A (en) * | 2016-11-22 | 2017-02-22 | 包磊 | Multimedia data coding and decoding method and multimedia data coding and decoding device |
| CN113590381A (en) * | 2021-06-30 | 2021-11-02 | 北京旷视科技有限公司 | Feature distribution method and device, electronic equipment and computer-readable storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011166615A (en) * | 2010-02-12 | 2011-08-25 | Nippon Telegr & Teleph Corp <Ntt> | Video synchronizing apparatus, video display device, video synchronizing method and program |
| CN102577406A (en) * | 2010-06-23 | 2012-07-11 | 松下电器产业株式会社 | Content distribution system, playback device, distribution server, playback method, and distribution method |
-
2016
- 2016-06-30 CN CN201610509187.7A patent/CN105959798B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011166615A (en) * | 2010-02-12 | 2011-08-25 | Nippon Telegr & Teleph Corp <Ntt> | Video synchronizing apparatus, video display device, video synchronizing method and program |
| CN102577406A (en) * | 2010-06-23 | 2012-07-11 | 松下电器产业株式会社 | Content distribution system, playback device, distribution server, playback method, and distribution method |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106454365A (en) * | 2016-11-22 | 2017-02-22 | 包磊 | Multimedia data coding and decoding method and multimedia data coding and decoding device |
| CN113590381A (en) * | 2021-06-30 | 2021-11-02 | 北京旷视科技有限公司 | Feature distribution method and device, electronic equipment and computer-readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105959798B (en) | 2019-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200322748A1 (en) | Method of audio-assisted field of view prediction for spherical video streaming | |
| KR101467430B1 (en) | Method and system for providing application based on cloud computing | |
| US20200285615A1 (en) | Auxiliary manifest file to provide timed metadata | |
| US20150222815A1 (en) | Aligning videos representing different viewpoints | |
| US8631143B2 (en) | Apparatus and method for providing multimedia content | |
| CN106454413B (en) | Code switching method, device and equipment is broadcast live | |
| CN109714415B (en) | Data processing method and device | |
| CN107197320B (en) | Video live broadcast method, device and system | |
| US20150189344A1 (en) | Methods, systems, and media for certifying a playback device | |
| WO2014091643A1 (en) | Device, method and computer readable medium | |
| US9769523B2 (en) | Video efficacy measurement | |
| CN106664449A (en) | Device switching for a streaming service | |
| RU2673560C1 (en) | Method and system for displaying multimedia information, standardized server and direct broadcast terminal | |
| US11539985B2 (en) | No reference realtime video quality assessment | |
| WO2018089096A1 (en) | Compressed media with still images selected from a video stream | |
| US20150325210A1 (en) | Method for real-time multimedia interface management | |
| CN105959798A (en) | Video stream frame positioning method and device, and equipment | |
| CN110996122A (en) | Video frame transmission method and device, computer equipment and storage medium | |
| CN109729438B (en) | Method and device for sending video packet and method and device for receiving video packet | |
| JP2015041822A (en) | Image communication device and control method thereof | |
| CN105656602A (en) | Data transmission method and apparatus | |
| US9916867B2 (en) | Video capture and testing of media player playback of a video | |
| JP7431514B2 (en) | Method and system for measuring quality of video call service in real time | |
| CN112055174B (en) | Video transmission method and device and computer readable storage medium | |
| KR20170118546A (en) | Image display apparatus and method for displaying image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |