CN105611309A - Video transmission method and device - Google Patents
Video transmission method and device Download PDFInfo
- Publication number
- CN105611309A CN105611309A CN201510974709.6A CN201510974709A CN105611309A CN 105611309 A CN105611309 A CN 105611309A CN 201510974709 A CN201510974709 A CN 201510974709A CN 105611309 A CN105611309 A CN 105611309A
- Authority
- CN
- China
- Prior art keywords
- frame
- gop
- video
- buffer
- buffer queue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2401—Monitoring of the client buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2407—Monitoring of transmitted content, e.g. distribution time, number of downloads
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a video transmission method and device. The method comprises following steps of receiving the video stream of a collected party; successively placing each video frame in the video stream in a cache queue; successively extracting and transmitting the video frame from the cache queue through a network; monitoring the length L of the video frame queue in the cache queue; if L is less than or equal to H, not deleting a frame, wherein the H is equal to the sum of the time length of a group of pictures GOP and a preset time offset value; if the L is more than the H and the frames of two GOPs exist in the cache queue, starting from the last P frame of the former GOP in the cache queue to delete one or multiple P frames until the L is enabled to be less than or equal to the H. Compared with the prior art, the technical solution provides a more effective method for discarding video frames; a user can fluently watch more video contents when the network condition is relatively poor; and the watching experience of the user is greatly optimized.
Description
Technical field
The present invention relates to field, video technique field, particularly a kind of video transmission method and device.
Background technology
User is when the internet viewing video, even if be presented as " watching online ", and also need to be from carryingServer end for video obtains data, downloads to this locality and just can watch, therefore at user network shapeIn the not good situation of condition, due to the underspeed of receiver, video transmission, cannot broadcast with normal speed at videoIn the time putting, get and play required video data, cause card. Now a lot of video website all canReminding user, uses definition lower, and the video resolution format that the video data volume is less is watched,Or watched video is suspended, after being buffered to abundant video data, watch again. But rear oneKind of mode is also not suitable for watching of live video, the demand that can not meet user and watch in real time video; BeforeA kind of mode can not provide good viewing effect for user in the time that user network situation is poor.
Summary of the invention
In view of the above problems, the present invention has been proposed to provide one to overcome the problems referred to above or at least part ofThe video transmission method and the device that address the above problem.
According to one aspect of the present invention, a kind of video transmission method is provided, comprising:
Receive the video flowing of collection side, the each frame of video in this video flowing put into buffer queue successively,And from buffer queue, get successively frame of video and transmit by network;
Frame of video queue length L in monitoring buffer queue;
If L is less than or equal to H, do not do the processing of delete frame; Wherein H equals a picture groupThe time span of GOP adds a Preset Time deviant;
If L is greater than H, and in buffer queue, there is the frame that belongs to two GOP, from buffer queueIn last P frame of previous GOP start to delete one or more P frames, L is less than orEqual H.
Alternatively, the method further comprises:
If L is greater than H, and in buffer queue, there is the frame that belongs to three GOP, delete buffer memory teamThe all frames of the GOP that is positioned at centre position in row.
Alternatively, the frame of video queue length L in described detection buffer queue comprises:
For the each GOP in buffer queue, calculate and belong to first of this GOP in buffer queueThe difference of the timestamp of frame and the timestamp of last frame, obtains the time of this GOP in buffer queueLength;
Time span summation by the each GOP in buffer queue in buffer queue, obtains L.
Alternatively, last P frame of described previous GOP from buffer queue starts to delete oneIndividual or multiple P frames, make L be less than or equal to H and comprise:
The timestamp of first frame of the rear GOP in buffer queue is C, the time of last frameStamp is D; The timestamp of first frame of the previous GOP in buffer queue is B;
The timestamp in the previous GOP in buffer queue is greater than to the P frame of B+H-(D-C) allDelete.
Alternatively, the method further comprises:
Calculate the poor of the entrained timestamp of I frame in adjacent two GOP in the video flowing that receivesBe worth, determine the time span of GOP.
According to another aspect of the present invention, a kind of video frequency transmitter is provided, comprising:
Receiving element, is suitable for receiving the video flowing of collection side, and the each frame of video in this video flowing is put successivelyEnter in buffer queue;
Buffer unit, is suitable for buffer queue described in buffer memory;
Transmitting element, is suitable for getting successively frame of video from buffer queue and transmits by network;
Monitoring means, is suitable for monitoring the frame of video queue length L in buffer queue;
Congested processing unit, is suitable in the time that L is less than or equal to H, does not do the processing of delete frame; Wherein HThe time span that equals a picture group GOP adds a Preset Time deviant; Be suitable for being greater than H as L,And in buffer queue, exist while belonging to the frame of two GOP, the previous GOP from buffer queueA rear P frame starts to delete one or more P frames, makes L be less than or equal to H.
Alternatively, described congested processing unit, is further adapted for and is greater than H as L, and deposit in buffer queueIn the time belonging to the frame of three GOP, delete all frames of the GOP that is positioned at centre position in buffer queue.
Alternatively, described monitoring means, is suitable for for the each GOP in buffer queue, calculates buffer memory teamThe timestamp of first frame that belongs to this GOP in row and the difference of the timestamp of last frame, obtainThe time span of this GOP in buffer queue; By the each GOP in buffer queue in buffer queueTime span summation, obtains L.
Alternatively, described congested processing unit, is suitable for when there being the frame that belongs to two GOP in buffer queue,And when L is greater than H, the timestamp in the previous GOP in buffer queue is greater than to B+H-(D-C)P frame all delete;
Wherein, the timestamp of first frame of the rear GOP in buffer queue is C, last frameTimestamp be D; The timestamp of first frame of the previous GOP in buffer queue is B.
Alternatively, this device further comprises:
GOP length computation unit, is suitable for calculating the I in adjacent two GOP in the video flowing receivingThe difference of the entrained timestamp of frame, determines the time span of GOP.
From the above, technical scheme of the present invention is got successively frame of video and passes through net from buffer queueNetwork transmits, and wherein frame of video is the video flowing receiving from the side of collection, to extract successively and put into buffer memoryTo in row, in transmitting procedure, the frame of video queue length L of monitoring in buffer queue, is less than at LOr equal H, in the situation that user can smooth watch, do not do the processing of delete frame, and be greater than H at L,And in buffer queue, have the frame that belongs to two GOP, user will start to occur smoothness watchingSituation under, last the P frame of the previous GOP from buffer queue starts to delete one or manyIndividual P frame, makes L be less than or equal to H, and the time span that wherein H equals a GOP adds onePreset Time deviant. This technical scheme compared with prior art, provides one to abandon more efficientlyThe method of frame of video, makes user in the situation that network condition is poor, can watch more gliblyMore video content, has greatly optimized user's viewing experience.
Above-mentioned explanation is only the general introduction of technical solution of the present invention, in order to better understand skill of the present inventionArt means, and can being implemented according to the content of description, and for allow of the present invention above-mentioned and otherObject, feature and advantage can become apparent, below especially exemplified by the specific embodiment of the present invention.
Brief description of the drawings
By reading below detailed description of the preferred embodiment, various other advantage and benefit for thisIt is cheer and bright that field those of ordinary skill will become. Accompanying drawing is only for the object of preferred embodiment is shown,And do not think limitation of the present invention. And in whole accompanying drawing, represent by identical reference symbolIdentical parts. In the accompanying drawings:
Fig. 1 shows a kind of schematic flow sheet of video transmission method according to an embodiment of the invention;
The frame of video queue length L that Fig. 2 shows buffer queue is greater than H, and exists and belong in buffer queueIn the schematic diagram of the frame of two GOP;
Fig. 3 shows a kind of structural representation of video frequency transmitter according to an embodiment of the invention.
Detailed description of the invention
Exemplary embodiment of the present disclosure is described below with reference to accompanying drawings in more detail. Although show in accompanying drawingExemplary embodiment of the present disclosure, but should be appreciated that and can realize the disclosure and not with various formsThe embodiment that should be set forth here limits. On the contrary, providing these embodiment is for can be more thoroughlyUnderstand the disclosure, and can be by the those skilled in the art that conveys to complete the scope of the present disclosure.
Fig. 1 shows a kind of schematic flow sheet of video transmission method according to an embodiment of the invention,As shown in Figure 1, the method comprises:
Step S110, the video flowing of reception collection side, puts into slow by the each frame of video in this video flowing successivelyDeposit in queue, and from buffer queue, get successively frame of video and transmit by network.
Wherein, collection side can be the user who carries out network direct broadcasting, and the video flowing of corresponding collection side canBe the video flowing of electric athletic game content, outdoor activities content etc., these are all to need live platformUser watches online in real time, therefore can not adopt the mode of buffering to watch. Similarly, collection sideIt can also be the video flowing that the on-the-spot broadcasting such as live party, awards ceremony gather. And push these to userWhen live content, the each frame of video in video flowing need to be sent to user, user could pass through playerWatch, and the size of frame of video and effect might not be identical, user's network transfer speeds is also logicalNormal there is fluctuation, therefore need the frame of video in video flowing to put into buffer queue, from this queue successivelyGetting frame of video transmits by network. That is to say, this buffer queue is at server side.
Video card pause occur reason be: user's network transmission speed is less than video code rate. Taking live asExample, user is provided by the video content of synchronously watching video provider to provide, for simplicity, at this notConsider video provider, as uploaded time and the video forwarding that the video content of collection will spend in the side of collectionThe time spending at server side in process. When server need to be by video flowing by Internet Transmission to userWhile watching, if user's network transmission speed is enough high, just can get as quick as thought video flowingIn full content. For example, user's network transmission speed is 12500Kbps, and video code rate is only1250kbps, user just can receive all frames in this video flowing soon like this, every to buffer memory teamIn row, put into a frame of video, can be taken away by user at once. And it is little at user's network transmission speedIn the situation of video code rate, just there will be in buffer queue and put into a frame of video, user do not have andIn time, is taken away, cause the frame of video of buffer memory in buffer queue more and more, and the length of buffer queue is limited, in the situation that buffer queue is full, just some frame of video in buffer queue need to be abandonedProcess. On user's terminal device, there will be following two kinds to watch slack experience like this: one,Because network transmission speed is less than video code rate, just there will be the frame of video having received on terminal device to broadcastDischarge, but do not receive new frame of video, so video blocks; Two, the frame of video abandoning is not due toMay be received by user, therefore originally dynamic video is being played to the frame of video part being dropped againTime, will directly skip this part content. Feelings at user's network transmission speed much smaller than video code rateUnder condition, above-mentioned two situations combination, there will be especially video to be almost a static picture and jumps to oneThe situation of picture, and picture may be also incomplete, and this situation is often called for fun " blocks into unrealLamp sheet ".
The video flowing of the side of collection is video flowing H.264 in a preferred embodiment of the invention. H.264It is the common new-generation digital after MPEG4 proposing of International Organization for standardization and International Telecommunication UnionVideo compression format, is widely applied.
Step S120, the frame of video queue length L in monitoring buffer queue.
Step S130, if L is less than or equal to H, does not do the processing of delete frame; Wherein H equalsThe time span of a GOP adds a Preset Time deviant.
GOP (GroupofPictures, picture group) refers to one group of continuous picture, for example, and H.264Frame of video in video flowing comprises I frame (intra-coded frame) and P frame (forward predicted frame), a GOPComprise an I frame and multiple P frame. Wherein I frame comprises a complete image content, at a GOPIn be positioned at position foremost; And P frame comprise be this frame with before an I frame (or P frame)Difference, need to be superimposed with the picture of buffer memory before the difference of this P frame definition when decoding, generate finally and drawFace. That is to say, P frame is difference frame, does not contain complete picture data, only has the picture with former frameThe data of face difference. Therefore can find out, if a GOP has lacked I frame, so in this GOPAll the other P frames all because lacked the difference that wherein comprises to picture frame, thereby cannot normal decoder, go outThe phenomenons such as existing Hua Ping. The video length of a GOP be exactly wherein after all frame decodings normal play requiredTime.
Therefore in step S130, consider that the frame of video in video flowing is transferred to the user who watches videoTerminal device after, for example, taking a GOP as example, all frames in this GOP are transferred to user's endAfter end equipment, user need to spend the time of the time span of this GOP and watch. Now from buffer memory teamRow side is analyzed, if L is less than or equal to H, illustrates user and watches the GOP's that transmittedIn time, still these frame of video may be transferred on user's terminal device, user is broadcasting like thisDischarge after all frames in the GOP having received, can continue to play all the other frame of video and (originally locate at onceFrame of video in frame of video queue length L in length of buffer queue), establish in user's terminal like thisThe standby upper situation that does not just exist card to pause. Therefore, this situation is not carried out the processing of delete frame. Wherein pre-If time offset value is to consider the situation that has free time in transmission of video, preferably can be establishedBe set to 1/10th of 200ms or GOP time span.
, if L is greater than H, and in buffer queue, there is the frame that belongs to two GOP, in step S140Last the P frame of previous GOP from buffer queue starts to delete one or more P frames, makesObtain L and be less than or equal to H.
Although consider that user's network may exist fluctuation, fluctuation range should be very little, therefore, slowDeposit in queue and to have the just explanation of frame that belongs to two GOP, user's terminal device play received oneIn the time of individual GOP, user can not take all frames of next GOP away from buffer queue.Therefore so only can in buffer queue, save bit by bit increasing frame, finally cause card. Therefore, at thisIn step, last the P frame of the previous GOP from buffer queue starts to delete one or more PFrame is until L is less than or equal to H. Because each P frame has only comprised and the difference of previous frame, therefore deleteExcept the viewing experience impact minimum of P frame on user.
Visible, the method shown in Fig. 1 is got successively frame of video and passes by network from buffer queueDefeated, wherein frame of video is the video flowing receiving from the side of collection, to extract successively and put into buffer memory to being listed as,In transmitting procedure, the frame of video queue length L in monitoring buffer queue, is less than or equal to H at L,Be not do the processing of delete frame in user's situation about can smooth watch, and be greater than H at L, and buffer memory teamIn row, exist and belong to the frame of two picture group GOP, user will start to occur smooth to watchIn situation, last the P frame of the previous GOP from buffer queue starts to delete one or more PFrame, makes L be less than or equal to H, the time span that wherein H equals a GOP add one defaultTime offset value. This technical scheme compared with prior art, provides one to abandon more efficiently videoThe method of frame, makes user in the situation that network condition is poor, can watch more glibly moreVideo content, greatly optimized user's viewing experience.
In one embodiment of the invention, the method shown in Fig. 1 further comprises: if L is greater than H,And in buffer queue, exist and belong to the frame of three GOP, delete the centre position that is positioned in buffer queueAll frames of GOP.
Due in the above-described embodiments, only carry out the deletion processing to P frame, may occur as conditions at the lower levelsShape: have an I frame in buffer queue, all the other P frames of the GOP that this I frame is corresponding are all deleted.And have all frames of a complete GOP in buffer queue after this I frame, and another GOPPartial frame. At this moment according to the method in Fig. 1, due to the institute in the most previous GOP in buffer queueHave P frame deleted, therefore no longer carry out any operation, and now the length of buffer queue owing to comprisingThe frame of three GOP may be very long, easily cause that more serious card pauses. Therefore need in the present embodimentTo delete all frames of the GOP in centre position, delete a complete GOP. At this momentBecause consider that I frame is owing to having comprised complete picture data, its data volume is larger, in buffer queueThe most previous I frame may transmit, by its deletion may cause user receive one incompleteI frame, the picture of watching flower to shield after being decoded, has reduced user's viewing experience, and complete by oneWhole GOP deletes, and only there will be picture to jump situation, than flower screen, experiences more better.
Particularly, in one embodiment of the invention, in said method, detect looking in buffer queueFrequently frame queue length L comprises: for the each GOP in buffer queue, calculate belonging in buffer queueThe difference of the timestamp of first frame of this GOP and the timestamp of last frame, obtains this GOP and existsTime span in buffer queue; Time span by the each GOP in buffer queue in buffer queue is askedWith, obtain L.
The method of calculating frame of video queue length L is provided in the present embodiment, and this length L is actual while beingBetween length. In this embodiment, dynamically to each GOP in buffer queue with obtain its first frame andThe mode of the timestamp of last frame calculates the time span of this GOP in buffer queue, lastTime span by each GOP in buffer queue is sued for peace and is obtained L. Wherein, timestamp can beWhile adding buffer queue, correspondence generates, but is not limited to this kind of method.
In one embodiment of the invention, in the method shown in Fig. 1, previous from buffer queueLast P frame of GOP starts to delete one or more P frames, makes L be less than or equal to H and comprises:The timestamp of first frame of the rear GOP in buffer queue is C, and the timestamp of last frame isD; The timestamp of first frame of the previous GOP in buffer queue is B; By in buffer queueTimestamp in previous GOP is greater than the P frame of B+H-(D-C) and all deletes.
The frame of video queue length L that Fig. 2 shows buffer queue is greater than H, and exists and belong in buffer queueIn the schematic diagram of the frame of two GOP. As shown in Figure 2, first frame in a rear GOP is I frame,Its timestamp is C; Last frame is P frame, and its timestamp is D. Last by buffer queueTimestamp in individual GOP is greater than the P frame of B+H-(D-C) all to be deleted, for example, and by timestamp in figureFor the P frame after X is all deleted.
In one embodiment of the invention, the method shown in Fig. 1 further comprises: calculating receivesThe difference of the entrained timestamp of I frame in adjacent two GOP in video flowing, determine GOP timeBetween length.
In the present embodiment, provide a kind of method of calculating real-time dynamicly GOP length, calculated instituteThe difference of the entrained timestamp of I frame in adjacent two GOP in the video flowing receiving. In this enforcementIn example, timestamp just cannot produce in the time adding buffer queue, can be to gather Fang Zhi at video flowingConnect and add in corresponding frame of video.
Fig. 3 shows a kind of structural representation of video frequency transmitter according to an embodiment of the invention,As shown in Figure 3, video frequency transmitter 300 comprises:
Receiving element 310, is suitable for receiving the H.264 video flowing of collection side, by respectively looking in this video flowingFrequently frame is put into buffer queue successively.
Buffer unit 320, is suitable for buffer memory buffer queue.
Transmitting element 330, is suitable for getting successively frame of video from buffer queue and transmits by network.
Monitoring means 340, is suitable for monitoring the frame of video queue length L in buffer queue.
Congested processing unit 350, is suitable in the time that L is less than or equal to H, does not do the processing of delete frame; ItsThe time span that middle H equals a GOP adds a Preset Time deviant; Be suitable for being greater than H as L,And in buffer queue, exist while belonging to the frame of two GOP, the previous GOP from buffer queueA rear P frame starts to delete one or more P frames, makes L be less than or equal to H.
Visible, the device shown in Fig. 3 by cooperatively interacting of each unit, is got successively from buffer queueFrame of video is also transmitted by network, wherein frame of video be the video flowing receiving from the side of collection successivelyExtract and put into buffer memory to what be listed as, in transmitting procedure, the frame of video queue in monitoring buffer queue is longDegree L, is less than or equal to H at L, does not do the processing of delete frame in the situation that user can smooth watch,And be greater than H at L, and in buffer queue, there is the frame that belongs to two GOP, user will startIn the situation that appearance can not smooth be watched, last the P frame of the previous GOP from buffer queueStart to delete one or more P frames, make L be less than or equal to H, wherein H equals a GOP'sTime span adds a Preset Time deviant. This technical scheme compared with prior art, provides onePlant the method that abandons more efficiently frame of video, make user in the situation that network condition is poor, canWatch more glibly more video content, greatly optimized user's viewing experience.
In one embodiment of the invention, in the device shown in Fig. 3, congested processing unit 350, entersOne step is suitable for being greater than H as L, and in buffer queue, exists while belonging to the frame of three GOP, deletes buffer memoryThe all frames of the GOP that is positioned at centre position in queue.
In one embodiment of the invention, in said apparatus, monitoring means 340, is suitable for for buffer memoryEach GOP in queue, calculate first frame that belongs to this GOP in buffer queue timestamp andThe difference of the timestamp of last frame, obtains the time span of this GOP in buffer queue; By buffer memoryThe time span summation of each GOP in queue in buffer queue, obtains L.
In one embodiment of the invention, in the device shown in Fig. 3, congested processing unit 350, suitableIn when existing and belong to the frame of two GOP in buffer queue, and L is while being greater than H, by buffer queueTimestamp in previous GOP is greater than the P frame of B+H-(D-C) and all deletes; Wherein, buffer queueIn the timestamp of first frame of a rear GOP be C, the timestamp of last frame is D; Buffer memoryThe timestamp of first frame of the previous GOP in queue is B.
In one embodiment of the invention, the device shown in Fig. 3 further comprises: GOP length computationUnit, is suitable for calculating the entrained timestamp of I frame in adjacent two GOP in the video flowing receivingDifference, determine the time span of GOP.
It should be noted that, the detailed description of the invention of above-mentioned each device embodiment and aforementioned corresponding method are implementedThe detailed description of the invention of example is identical, does not repeat them here.
In sum, technical scheme of the present invention is got successively frame of video and passes through network from buffer queueTransmit, wherein frame of video is the video flowing receiving from the side of collection, to extract successively and put into buffer memory pairIn row, in transmitting procedure, the frame of video queue length L in monitoring buffer queue, be less than at L orEqual H, in the situation that user can smooth watch, do not do the processing of delete frame, and be greater than H at L,And in buffer queue, have the frame that belongs to two GOP, user will start to occur smoothness watchingSituation under, last the P frame of the previous GOP from buffer queue starts to delete one or manyIndividual P frame, makes L be less than or equal to H, and the time span that wherein H equals a GOP adds onePreset Time deviant. This technical scheme compared with prior art, provides one to abandon more efficientlyThe method of frame of video, makes user in the situation that network condition is poor, can watch more gliblyMore video content, has greatly optimized user's viewing experience.
The foregoing is only preferred embodiment of the present invention, be not intended to limit protection model of the present inventionEnclose. All any amendments of doing within the spirit and principles in the present invention, be equal to replacement, improvement etc., allBe included in protection scope of the present invention.
It should be noted that:
The algorithm providing at this and demonstration are solid with any certain computer, virtual bench or miscellaneous equipmentHave relevant. Various fexible units also can with based on using together with this teaching. According to description above,It is apparent constructing the desired structure of this class device. In addition, the present invention is not also for any specificProgramming language. It should be understood that and can utilize various programming languages to realize content of the present invention described here,And the description of above language-specific being done is in order to disclose preferred forms of the present invention.
In the description that provided herein, a large amount of details are described. But, can understand, thisInventive embodiment can be put into practice in the situation that there is no these details. In some instances, notBe shown specifically known method, structure and technology, so that not fuzzy understanding of this description.
Similarly, should be appreciated that in order to simplify the disclosure and to help to understand in each inventive aspectOr multiple, in the above in the description of exemplary embodiment of the present invention, each feature of the present invention is sometimesBe grouped together into single embodiment, figure or in its description. But, should be by the disclosureMethod be construed to the following intention of reflection: the present invention for required protection requires than in each claimThe more feature of the middle feature of clearly recording. Or rather, as claims below reflectLike that, inventive aspect is to be less than all features of disclosed single embodiment above. Therefore, followClaims of detailed description of the invention are incorporated to this detailed description of the invention, wherein each right thus clearlyRequirement itself is all as independent embodiment of the present invention.
Those skilled in the art are appreciated that and can carry out certainly the module in the equipment in embodimentChange adaptively and they are arranged in one or more equipment different from this embodiment. CanModule in embodiment or unit or assembly are combined into a module or unit or assembly, and in addition canTo put them into multiple submodules or subelement or sub-component. Except such feature and/or process orAt least some in unit are, outside mutually repelling, can adopt any combination (to comprise companion to this descriptionWith claim, summary and accompanying drawing) in disclosed all features and so disclosed any method orAll processes or the unit of person's equipment combine. Unless clearly statement in addition, this description (comprises companionWith claim, summary and accompanying drawing) in disclosed each feature can be by providing identical, being equal to or phaseAlternative features like object replaces.
In addition, although those skilled in the art will appreciate that embodiment more described herein comprise itIncluded some feature instead of further feature in its embodiment, but the group of the feature of different embodimentClose and mean within scope of the present invention and form different embodiment. For example, power belowIn profit claim, the one of any of embodiment required for protection can make with combination arbitrarilyWith.
All parts embodiment of the present invention can realize with hardware, or with in one or more processingThe software module of moving on device realizes, or realizes with their combination. Those skilled in the art shouldUnderstand, can use in practice microprocessor or digital signal processor (DSP) to realize basisThe some or all functions of the some or all parts of the video frequency transmitter of the embodiment of the present invention. ThisInvention can also be embodied as for carry out method as described herein part or all equipment orPerson's device program (for example, computer program and computer program). Realizing is like this of the present inventionProgram can be stored on computer-readable medium, or can have the shape of one or more signalFormula. Such signal can be downloaded and obtain from internet website, or provides on carrier signal, orPerson provides with any other form.
It should be noted above-described embodiment the present invention will be described instead of limit the invention,And those skilled in the art can design and replace in fact in the case of not departing from the scope of claimsExecute example. In the claims, any reference symbol between bracket should be configured to right to wantThe restriction of asking. Word " comprises " not to be got rid of existence and is not listed as element or step in the claims. Be positioned atWord " one " before element or " one " do not get rid of and have multiple such elements. The present invention canBy means of including the hardware of some different elements and realizing by means of the computer of suitably programming. ?Enumerated in the unit claim of some devices, several in these devices can be by sameHardware branch carrys out imbody. The use of word first, second and C grade does not represent any order.Can be title by these word explanations.
Claims (10)
1. a video transmission method, wherein, the method comprises:
Receive the video flowing of collection side, the each frame of video in this video flowing put into buffer queue successively,And from buffer queue, get successively frame of video and transmit by network;
Frame of video queue length L in monitoring buffer queue;
If L is less than or equal to H, do not do the processing of delete frame; Wherein H equals a picture groupThe time span of GOP adds a Preset Time deviant;
If L is greater than H, and in buffer queue, there is the frame that belongs to two GOP, from buffer queueIn last P frame of previous GOP start to delete one or more P frames, L is less than orEqual H.
2. the method for claim 1, wherein the method further comprises:
If L is greater than H, and in buffer queue, there is the frame that belongs to three GOP, delete buffer memory teamThe all frames of the GOP that is positioned at centre position in row.
3. method as claimed in claim 1 or 2, wherein, the frame of video in described detection buffer queueQueue length L comprises:
For the each GOP in buffer queue, calculate and belong to first of this GOP in buffer queueThe difference of the timestamp of frame and the timestamp of last frame, obtains the time of this GOP in buffer queueLength;
Time span summation by the each GOP in buffer queue in buffer queue, obtains L.
4. the method for claim 1, wherein described previous GOP from buffer queueLast P frame start to delete one or more P frames, make L be less than or equal to H and comprise:
The timestamp of first frame of the rear GOP in buffer queue is C, the time of last frameStamp is D; The timestamp of first frame of the previous GOP in buffer queue is B;
The timestamp in the previous GOP in buffer queue is greater than to the P frame of B+H-(D-C) allDelete.
5. the method for claim 1, wherein the method further comprises:
Calculate the poor of the entrained timestamp of I frame in adjacent two GOP in the video flowing that receivesBe worth, determine the time span of GOP.
6. a video frequency transmitter, wherein, this device comprises:
Receiving element, is suitable for receiving the video flowing of collection side, and the each frame of video in this video flowing is put successivelyEnter in buffer queue;
Buffer unit, is suitable for buffer queue described in buffer memory;
Transmitting element, is suitable for getting successively frame of video from buffer queue and transmits by network;
Monitoring means, is suitable for monitoring the frame of video queue length L in buffer queue;
Congested processing unit, is suitable in the time that L is less than or equal to H, does not do the processing of delete frame; Wherein HThe time span that equals a picture group GOP adds a Preset Time deviant; Be suitable for being greater than H as L,And in buffer queue, exist while belonging to the frame of two GOP, the previous GOP from buffer queueA rear P frame starts to delete one or more P frames, makes L be less than or equal to H.
7. device as claimed in claim 6, wherein,
Described congested processing unit, is further adapted for and is greater than H as L, and exists and belong to three in buffer queueWhen the frame of individual GOP, delete all frames of the GOP that is positioned at centre position in buffer queue.
8. the device as described in claim 6 or 7, wherein,
Described monitoring means, is suitable for for the each GOP in buffer queue, calculates the genus in buffer queueIn the difference of the timestamp of first frame and the timestamp of last frame of this GOP, obtain this GOPTime span in buffer queue; Time span by the each GOP in buffer queue in buffer queueSummation, obtains L.
9. device as claimed in claim 6, wherein,
Described congested processing unit, is suitable for when having the frame that belongs to two GOP and L in buffer queueWhile being greater than H, the timestamp in the previous GOP in buffer queue is greater than to the P of B+H-(D-C)Frame is all deleted;
Wherein, the timestamp of first frame of the rear GOP in buffer queue is C, last frameTimestamp be D; The timestamp of first frame of the previous GOP in buffer queue is B.
10. device as claimed in claim 6, wherein, this device further comprises:
GOP length computation unit, is suitable for calculating the I in adjacent two GOP in the video flowing receivingThe difference of the entrained timestamp of frame, determines the time span of GOP.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510974709.6A CN105611309B (en) | 2015-12-22 | 2015-12-22 | A kind of video transmission method and device |
| PCT/CN2016/103343 WO2017107649A1 (en) | 2015-12-22 | 2016-10-26 | Video transmission method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510974709.6A CN105611309B (en) | 2015-12-22 | 2015-12-22 | A kind of video transmission method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105611309A true CN105611309A (en) | 2016-05-25 |
| CN105611309B CN105611309B (en) | 2019-03-05 |
Family
ID=55990802
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510974709.6A Active CN105611309B (en) | 2015-12-22 | 2015-12-22 | A kind of video transmission method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105611309B (en) |
| WO (1) | WO2017107649A1 (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106604064A (en) * | 2016-12-30 | 2017-04-26 | 北京奇艺世纪科技有限公司 | Rapid broadcasting method and device |
| CN106713947A (en) * | 2016-12-13 | 2017-05-24 | 飞狐信息技术（天津）有限公司 | Method and device for reducing live broadcasting time delay and standstill as well as live broadcasting system |
| CN106791899A (en) * | 2016-12-13 | 2017-05-31 | 飞狐信息技术（天津）有限公司 | The live middle method and device and client for reducing viewer end picture interim card |
| CN106792247A (en) * | 2016-12-13 | 2017-05-31 | 飞狐信息技术（天津）有限公司 | Reduce the live TV stream method for pushing and device, live broadcast system of time delay |
| WO2017107649A1 (en) * | 2015-12-22 | 2017-06-29 | 北京奇虎科技有限公司 | Video transmission method and device |
| CN107347065A (en) * | 2017-06-29 | 2017-11-14 | 上海鋆创信息技术有限公司 | A kind of data push method and device, a kind of terminal and storage medium |
| CN107809682A (en) * | 2017-11-14 | 2018-03-16 | 北京威速科技有限公司 | It is a kind of to adjust the video flow control method for sending amount of buffered data |
| CN108347645A (en) * | 2018-01-19 | 2018-07-31 | 浙江大华技术股份有限公司 | A kind of method and device that video frame decoding is shown |
| CN110062003A (en) * | 2019-04-30 | 2019-07-26 | 北京金山云网络技术有限公司 | Video data transmitting method, device, electronic equipment and storage medium |
| CN110312159A (en) * | 2019-05-24 | 2019-10-08 | 深圳市朗强科技有限公司 | A kind of signal receiving device, stream media transmission system and flow-medium transmission method |
| CN111491201A (en) * | 2020-04-08 | 2020-08-04 | 深圳市昊一源科技有限公司 | Method for adjusting video code stream and video frame loss processing method |
| CN112804579A (en) * | 2019-11-14 | 2021-05-14 | 上海哔哩哔哩科技有限公司 | Video playing method and device, computer equipment and readable storage medium |
| CN113068074A (en) * | 2021-03-24 | 2021-07-02 | 浙江大华技术股份有限公司 | Caching method and device, computer-readable storage medium and electronic device |
| CN113556505A (en) * | 2020-04-23 | 2021-10-26 | 杭州海康威视数字技术股份有限公司 | Data processing method and device, electronic equipment and readable storage medium |
| CN113873295A (en) * | 2021-10-26 | 2021-12-31 | 北京金山云网络技术有限公司 | Multimedia information processing method, device, equipment and storage medium |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109005447A (en) * | 2018-08-10 | 2018-12-14 | 高新兴科技集团股份有限公司 | A kind of video recording of security protection high definition falls broadcasting method and device |
| CN111556010A (en) * | 2020-03-23 | 2020-08-18 | 北京达佳互联信息技术有限公司 | Live stream caching method and device, electronic equipment and storage medium |
| CN111666195A (en) * | 2020-05-26 | 2020-09-15 | 上海连尚网络科技有限公司 | Method and apparatus for providing video information or image information |
| CN115866162A (en) * | 2021-09-26 | 2023-03-28 | 中移雄安信息通信科技有限公司 | Video stream generation method and device, electronic equipment and storage medium |
| CN116801034B (en) * | 2023-08-25 | 2023-11-03 | 海马云（天津）信息技术有限公司 | Method and device for storing audio and video data by client |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7221656B1 (en) * | 2002-06-18 | 2007-05-22 | Nortel Networks Limited | Technique for implementing an admission control scheme for data flows |
| CN101232455A (en) * | 2008-02-04 | 2008-07-30 | 中兴通讯股份有限公司 | Congestion control method and apparatus |
| CN101360058A (en) * | 2008-09-08 | 2009-02-04 | 华为技术有限公司 | Method and apparatus for cache overflow control |
| CN101699867A (en) * | 2009-10-28 | 2010-04-28 | 武汉世纪信通通信产业有限公司 | Dynamic adjustment method of video data transmission rate |
| CN102223218A (en) * | 2010-04-15 | 2011-10-19 | 华为技术有限公司 | Method and equipment for inhibiting media message retransmission |
| CN102695058A (en) * | 2012-05-30 | 2012-09-26 | 北京世纪鼎点软件有限公司 | Vast-scale buffering policy-based audio/video code stream control method |
| CN102970585A (en) * | 2012-11-30 | 2013-03-13 | 武汉市烽视威科技有限公司 | Method for quick channel switching of streaming media |
| CN104394421A (en) * | 2013-09-23 | 2015-03-04 | 贵阳朗玛信息技术股份有限公司 | Video frame processing method and device |
| CN104702972A (en) * | 2014-01-03 | 2015-06-10 | 杭州海康威视数字技术股份有限公司 | Self-adaptive image data sending method and self-adaptive image data sending device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101626507B (en) * | 2008-07-07 | 2012-07-18 | 华为技术有限公司 | Method, device and system for identifying frame type of RTP package |
| JP2013207375A (en) * | 2012-03-27 | 2013-10-07 | Kddi Technology Corp | Streaming data transmission system, transmission method and program of streaming data |
| CN104702968B (en) * | 2015-02-17 | 2019-06-11 | 华为技术有限公司 | A kind of video frame frame losing method and video transmission device |
| CN105611309B (en) * | 2015-12-22 | 2019-03-05 | 北京奇虎科技有限公司 | A kind of video transmission method and device |
-
2015
- 2015-12-22 CN CN201510974709.6A patent/CN105611309B/en active Active
-
2016
- 2016-10-26 WO PCT/CN2016/103343 patent/WO2017107649A1/en active Application Filing
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7221656B1 (en) * | 2002-06-18 | 2007-05-22 | Nortel Networks Limited | Technique for implementing an admission control scheme for data flows |
| CN101232455A (en) * | 2008-02-04 | 2008-07-30 | 中兴通讯股份有限公司 | Congestion control method and apparatus |
| CN101360058A (en) * | 2008-09-08 | 2009-02-04 | 华为技术有限公司 | Method and apparatus for cache overflow control |
| CN101699867A (en) * | 2009-10-28 | 2010-04-28 | 武汉世纪信通通信产业有限公司 | Dynamic adjustment method of video data transmission rate |
| CN102223218A (en) * | 2010-04-15 | 2011-10-19 | 华为技术有限公司 | Method and equipment for inhibiting media message retransmission |
| CN102695058A (en) * | 2012-05-30 | 2012-09-26 | 北京世纪鼎点软件有限公司 | Vast-scale buffering policy-based audio/video code stream control method |
| CN102970585A (en) * | 2012-11-30 | 2013-03-13 | 武汉市烽视威科技有限公司 | Method for quick channel switching of streaming media |
| CN104394421A (en) * | 2013-09-23 | 2015-03-04 | 贵阳朗玛信息技术股份有限公司 | Video frame processing method and device |
| CN104702972A (en) * | 2014-01-03 | 2015-06-10 | 杭州海康威视数字技术股份有限公司 | Self-adaptive image data sending method and self-adaptive image data sending device |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017107649A1 (en) * | 2015-12-22 | 2017-06-29 | 北京奇虎科技有限公司 | Video transmission method and device |
| CN106713947A (en) * | 2016-12-13 | 2017-05-24 | 飞狐信息技术（天津）有限公司 | Method and device for reducing live broadcasting time delay and standstill as well as live broadcasting system |
| CN106791899A (en) * | 2016-12-13 | 2017-05-31 | 飞狐信息技术（天津）有限公司 | The live middle method and device and client for reducing viewer end picture interim card |
| CN106792247A (en) * | 2016-12-13 | 2017-05-31 | 飞狐信息技术（天津）有限公司 | Reduce the live TV stream method for pushing and device, live broadcast system of time delay |
| CN106604064A (en) * | 2016-12-30 | 2017-04-26 | 北京奇艺世纪科技有限公司 | Rapid broadcasting method and device |
| CN107347065A (en) * | 2017-06-29 | 2017-11-14 | 上海鋆创信息技术有限公司 | A kind of data push method and device, a kind of terminal and storage medium |
| CN107809682A (en) * | 2017-11-14 | 2018-03-16 | 北京威速科技有限公司 | It is a kind of to adjust the video flow control method for sending amount of buffered data |
| CN108347645B (en) * | 2018-01-19 | 2021-02-26 | 浙江大华技术股份有限公司 | Method and device for decoding and displaying video frame |
| CN108347645A (en) * | 2018-01-19 | 2018-07-31 | 浙江大华技术股份有限公司 | A kind of method and device that video frame decoding is shown |
| CN110062003A (en) * | 2019-04-30 | 2019-07-26 | 北京金山云网络技术有限公司 | Video data transmitting method, device, electronic equipment and storage medium |
| CN110312159A (en) * | 2019-05-24 | 2019-10-08 | 深圳市朗强科技有限公司 | A kind of signal receiving device, stream media transmission system and flow-medium transmission method |
| CN110312159B (en) * | 2019-05-24 | 2022-03-11 | 深圳市朗强科技有限公司 | Signal receiving device, streaming media transmission system and streaming media transmission method |
| CN112804579A (en) * | 2019-11-14 | 2021-05-14 | 上海哔哩哔哩科技有限公司 | Video playing method and device, computer equipment and readable storage medium |
| CN111491201A (en) * | 2020-04-08 | 2020-08-04 | 深圳市昊一源科技有限公司 | Method for adjusting video code stream and video frame loss processing method |
| CN113556505A (en) * | 2020-04-23 | 2021-10-26 | 杭州海康威视数字技术股份有限公司 | Data processing method and device, electronic equipment and readable storage medium |
| CN113556505B (en) * | 2020-04-23 | 2022-11-25 | 杭州海康威视数字技术股份有限公司 | Data processing method and device, electronic equipment and readable storage medium |
| CN113068074A (en) * | 2021-03-24 | 2021-07-02 | 浙江大华技术股份有限公司 | Caching method and device, computer-readable storage medium and electronic device |
| CN113873295A (en) * | 2021-10-26 | 2021-12-31 | 北京金山云网络技术有限公司 | Multimedia information processing method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105611309B (en) | 2019-03-05 |
| WO2017107649A1 (en) | 2017-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105611309A (en) | Video transmission method and device | |
| CN102577272B (en) | The cacheable media streaming of low latency | |
| CN111866525A (en) | Multi-view video playing control method and device, electronic equipment and storage medium | |
| WO2016131223A1 (en) | Frame loss method for video frame and video sending apparatus | |
| US20100242066A1 (en) | Method of Performing Random Seek Preview for Streaming Video | |
| CA2937093C (en) | Generating visualizations for display along with video content | |
| CN108235058A (en) | Video quality processing method, storage medium and terminal | |
| CN110381326B (en) | Video system, processing method, device and computer readable medium | |
| CN110740380A (en) | Video processing method and device, storage medium and electronic device | |
| CN110519640B (en) | Video processing method, encoder, CDN server, decoder, device, and medium | |
| US20200314479A1 (en) | System and method for synchronizing content and data for customized display | |
| CN112019905A (en) | Live broadcast playback method, computer equipment and readable storage medium | |
| CN111372138A (en) | Live broadcast low-delay technical scheme of player end | |
| CN109714622A (en) | A kind of video data handling procedure, device and electronic equipment | |
| US20170171271A1 (en) | Video streaming | |
| CN108696771A (en) | A kind of video broadcasting method and device | |
| CN104219571B (en) | A kind of method and apparatus automatically providing watching focus | |
| CN108282685A (en) | A kind of method and monitoring system of audio-visual synchronization | |
| CN112423140A (en) | Video playing method and device, electronic equipment and storage medium | |
| CN112969075A (en) | Frame supplementing method and device in live broadcast process and computing equipment | |
| CN104079975A (en) | Image processing device, image processing method, and computer program | |
| CN113794942A (en) | Method, apparatus, system, device and medium for switching view angle of free view angle video | |
| CN111314350A (en) | Image storage system, storage method, calling system and calling method | |
| US20230300430A1 (en) | Method and system to highlight video segments in a video stream | |
| CN107005658A (en) | The system and method for realizing interaction special efficacy |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220720 Address after: Room 801, 8th floor, No. 104, floors 1-19, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100015 Patentee after: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Address before: 100088 room 112, block D, 28 new street, new street, Xicheng District, Beijing (Desheng Park) Patentee before: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Patentee before: Qizhi software (Beijing) Co.,Ltd. |