CN104113777A - Audio stream decoding method and device - Google Patents
Audio stream decoding method and device Download PDFInfo
- Publication number
- CN104113777A CN104113777A CN201410375254.1A CN201410375254A CN104113777A CN 104113777 A CN104113777 A CN 104113777A CN 201410375254 A CN201410375254 A CN 201410375254A CN 104113777 A CN104113777 A CN 104113777A
- Authority
- CN
- China
- Prior art keywords
- frame
- video
- audio
- buffering area
- audio stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
Abstract
The invention discloses an audio stream decoding method and device. The audio stream decoding method includes that confirming the number of the current cached audio frames in an audio stream buffer region of an electronic device; when the frame number is larger than a first number threshold and smaller than the total number of audio frames capable of being cached in the audio stream buffer region, discarding one part of the audio frames in the audio stream buffer region after a preset time; decoding the reserved audio frames in the audio stream buffer region. According to the technical scheme of the audio stream decoding method, one part of the audio frames is discarded after the preset time when the audio frame number in the audio stream buffer region is larger than the first number threshold and smaller than the total number of audio frames capable of being cached in the audio stream buffer region, and accordingly the audio frame discarding times is reduced in the audio frame decoding process, and the plosive appearance times is lowered.
Description
Technical field
The present invention relates to stream media technology field, particularly a kind of stream decoding method and device.
Background technology
For reducing the unstable impact bringing to the audio frequency result of broadcast of video file of network environment, before the audio stream of this video file is decoded, the electronic equipment with audio stream decoding function can use the internal memory of one section of queue structure as audio stream buffer district conventionally in advance, such as the AAC in Fig. 1 (Advanced Audio Coding, Advanced Audio Coding) buffering area; Because audio stream decoding consumes less CPU (Central Processing Unit, central processing unit) resource, this electronic equipment adopts CPU to carry out soft decoding to audio stream conventionally.
The Chief Web Officer time is in fluctuation status, can cause the audio stream of video file in the network equipment to continue in a large number to pour in electronic equipment, because the decode rate of this electronic equipment CPU is fixed, the buffer memory ability in this audio stream buffer district is limited, in audio stream decode procedure, too much audio stream continue to pour in the appearance that will certainly cause frame losing phenomenon.
In prior art, in the network equipment, the audio stream of video file continues to pour in electronic equipment in a large number, causes audio stream buffer district to be full of rapidly, now, abandons the audio frame of this audio stream buffer district rear of queue or queue heads.
But the sound effect that the frame losing number of times of audio frame and this video file present exists direct relation: the frame losing number of times of audio frame is more, the number of times that this video file playing process borehole blasting sound occurs is also just more; Due to existing frame losing method in audio stream buffer district during in saturation condition, just can abandon can not be by the audio frame of decoding/buffer memory immediately, while making this electronic equipment have a large amount of lasting audio streams to pour in, can not decode and buffer memory to it in time, thereby cause repeatedly frame losing, plosive phenomenon repeatedly occurs.
Summary of the invention
In order to address the above problem, the embodiment of the invention discloses a kind of stream decoding method and device, concrete technical scheme is as follows:
A kind of stream decoding method, comprising:
Determine the frame number of the audio frame of the audio stream buffer district current cache of electronic equipment;
When this frame number is greater than the first amount threshold, and while being less than the totalframes of the audio frame that described audio stream buffer district can buffer memory, after default duration, the audio frame in described audio stream buffer district is done to discard processing;
The audio frame not being dropped in described audio stream buffer district is decoded.
Preferably, also comprise:
In the time that this frame number reaches described totalframes, immediately the audio frame in described audio stream buffer district is done to discard processing.
Preferably, the audio frame in described audio stream buffer district is done after discard processing, in described audio stream buffer district, the frame number of audio frame equals described the first amount threshold; Or
Audio frame in described audio stream buffer district is done after discard processing, and in described audio stream buffer district, the frame number of audio frame equals described the second amount threshold, and described the second amount threshold is less than described the first amount threshold.
Preferably, determine the frame number of the audio frame of the audio stream buffer district current cache of electronic equipment, comprising:
According to default measurement period, periodically determine the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment.
Preferably, described measurement period is greater than described default duration.
Preferably, described audio frame in described audio stream buffer district is done to discard processing, comprising:
From the rear of queue in described audio stream buffer district, audio frame is abandoned;
Or
From the queue heads in described audio stream buffer district, audio frame is abandoned.
Preferably, described audio frame derives from video file, and described video file also comprises frame of video; Described method also comprises: the frame of video in described video file is decoded.
Preferably, described frame of video in described video file is decoded, comprising:
Whether detect digital signal processor DSP buffering area in undersaturated condition, wherein, the input block that described DSP buffering area is digital signal processor, described DSP buffering area is for buffer memory video requency frame data;
If so, in DSP buffering area, insert blank frame, the state until this DSP buffering area reaches capacity;
Frame data in DSP buffering area are decoded.
Preferably,, also comprise whether before undersaturated condition in described detection digital signal processor DSP buffering area:
Whether detect currently has video stream data to be cached to described DSP buffering area, if not, whether carry out described detection digital signal processor DSP buffering area in undersaturated condition, wherein, described video stream data is: the video requency frame data in the video data buffer of setting up in advance, the described video data buffer of setting up in advance derives from the video requency frame data of webserver side for buffer memory.
Preferably, whether described detection digital signal processor DSP buffering area, in undersaturated condition, comprising:
Whether detect in real time DSP buffering area in undersaturated condition;
Or
According to default sense cycle, whether periodically detect DSP buffering area in undersaturated condition.
Preferably, whether described detection digital signal processor DSP buffering area, in undersaturated condition, comprising:
Detect the duration of DSP buffering area in undersaturated condition and whether exceed default threshold value.
Preferably, whether described detection digital signal processor DSP buffering area, in undersaturated condition, comprising:
Detect in DSP buffering area and whether exist from the video requency frame data in the video data buffer of setting up in advance, and be not full of by video requency frame data.
Preferably, described frame data in DSP buffering area are decoded, comprising:
The frame of video that carries network identity in DSP buffering area is decoded, described in carry network identity frame of video be the frame data that derive from the video stream buffer district setting up in advance.
Preferably, the frame of video of described video file carries timestamp, and the audio frame of described video file carries timestamp; Described method also comprises:
According to the corresponding relation of the timestamp of the timestamp of described frame of video and described audio frame, the decoded result to frame of video and the decoded result of audio frame are synchronously play.
A kind of audio stream decoding device, comprising:
Frame number determination module, for determining the frame number of audio frame of audio stream buffer district current cache of electronic equipment;
Frame losing module, for being greater than the first amount threshold when this frame number, and while being less than the totalframes of the audio frame that described audio stream buffer district can buffer memory, after default duration, does discard processing to the audio frame in described audio stream buffer district;
Audio frame decoder module, decodes for the audio frame that described audio stream buffer district is not dropped.
Preferably, described frame losing module, also for:
In the time that this frame number reaches described totalframes, immediately the audio frame in described audio stream buffer district is done to discard processing.
Preferably, described frame losing module is done after discard processing the audio frame in described audio stream buffer district, and in described audio stream buffer district, the frame number of audio frame equals described the first amount threshold; Or
Described frame losing module is done after discard processing the audio frame in described audio stream buffer district, and in described audio stream buffer district, the frame number of audio frame equals described the second amount threshold, and described the second amount threshold is less than described the first amount threshold.
Preferably, described frame data determination module, specifically for:
According to default measurement period, periodically determine the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment.
Preferably, described measurement period is greater than described default duration.
Preferably, described frame losing module, specifically for:
From the rear of queue in described audio stream buffer district, audio frame is abandoned;
Or
From the queue heads in described audio stream buffer district, audio frame is abandoned.
Preferably, described audio frame derives from video file, and described video file also comprises frame of video; Described device also comprises: frame of video decoder module.
Preferably, described frame of video decoder module, comprising:
The first detection sub-module, for detection of digital signal processor DSP buffering area, whether in undersaturated condition, wherein, described DSP buffering area is for buffer memory video requency frame data;
Blank frame fill submodule, in the testing result of described detection module be, in DSP buffering area, insert blank frame EOS, the state until this DSP buffering area reaches capacity;
Frame of video decoding submodule, for decoding to the frame data in DSP buffering area.
Preferably, described frame of video decoder module, also comprises:
The second detection sub-module, whether there is video stream data to be cached to described DSP buffering area for detection of current, and in testing result be no in the situation that, trigger described first detection module and carry out work, wherein, described video stream data is: the video requency frame data in the video data buffer of setting up in advance, the described video data buffer of setting up in advance derives from the video requency frame data of webserver side for buffer memory.
Preferably, described the first detection sub-module, specifically for:
Whether detect in real time DSP buffering area in undersaturated condition;
Or
According to default sense cycle, whether periodically detect DSP buffering area in undersaturated condition.
Preferably, described the first detection sub-module, specifically for:
Detect the duration of DSP buffering area in undersaturated condition and whether exceed default threshold value.
Preferably, described the first detection sub-module, specifically for:
Detect in DSP buffering area and whether exist from the video requency frame data in the video data buffer of setting up in advance, and be not full of by video requency frame data.
Preferably, described frame of video decoding submodule, specifically for:
The frame of video that carries network identity in DSP buffering area is decoded, described in carry network identity frame of video be the frame data that derive from the video stream buffer district setting up in advance.
Preferably, the frame of video of described video file carries timestamp, and the audio frame of described video file carries timestamp; Described device also comprises:
Playing module, for according to the corresponding relation of the timestamp of the timestamp of described frame of video and described audio frame, the decoded result to frame of video and the decoded result of audio frame are synchronously play.
Application technique scheme, can determine the frame number of the audio frame of the audio stream buffer district current cache of electronic equipment, when this frame number is greater than the first amount threshold, and while being less than the totalframes of audio frame of described audio stream buffer district energy buffer memory, after default duration, audio frame in described audio stream buffer district is done to discard processing, the audio frame not being dropped in described audio stream buffer district is decoded.
Compared with prior art, the embodiment of the present invention adopts the audio frame frame number in audio stream buffer district to be greater than the first amount threshold, and while being less than the totalframes of audio frame of audio stream buffer district energy buffer memory, after default duration, audio frame is done to the method for discard processing, reduce the frame losing number of times of audio frame decode procedure sound intermediate frequency frame, reduced the number of times that plosive occurs.
Brief description of the drawings
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, to the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the exemplary process diagram of prior art sound intermediate frequency stream decoding method;
The flow chart of a kind of stream decoding method that Fig. 2 provides for the embodiment of the present invention;
Fig. 3 is the exemplary frame losing figure of prior art stream decoding method;
Fig. 4 provides the exemplary frame losing figure of stream decoding method for the embodiment of the present invention;
The flow chart of the another kind of stream decoding method that Fig. 5 provides for the embodiment of the present invention;
The flow chart of a kind of execution mode of S204 in Fig. 5 that Fig. 6 provides for the invention process;
The structural representation of a kind of audio stream decoding device that Fig. 7 provides for the embodiment of the present invention;
The structural representation of the another kind of audio stream decoding device that Fig. 8 provides for the embodiment of the present invention;
A kind of structural representation of frame of video decoder module 704 in Fig. 8 that Fig. 9 provides for the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiment.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
Along with the fast development of network multimedia technology, the network multimedia file of diversification enrich constantly people's vision and auditory perception; The appearance of Streaming Media (such as video flowing, audio stream etc.), makes user as non-stream broadcast mode, just can watch content wherein after whole multimedia file downloads to playback equipment this locality completely; And only need can on playback equipment, decode to it and play through the transmission delays of seconds or tens of seconds, it has brought new audiovisual experience for user.
In the unsettled situation of network environment, the audio stream of network server side continues to pour in large quantities in electronic equipment, and the buffer memory ability in the decoding capability of this electronic equipment and audio stream buffer district is all limited, now needs audio frame to do discard processing.Due to the result of broadcast of audio frequency and the frame losing number of times of audio frame in close relations, the frame losing number of times of audio frame is more, this audio frequency number of times that plosive occurs in the time playing is also just more.In order to make the result of broadcast of network side audio stream smoother, the embodiment of the present invention provides a kind of stream decoding method and device.
First a kind of stream decoding method embodiment of the present invention being provided is below introduced.
It should be noted that, embodiment of the present invention method is applicable in electronic equipment, and in actual applications, this electronic equipment can be notebook computer, desktop computer, panel computer, and smart mobile phone etc., the embodiment of the present invention is not construed as limiting this.
As shown in Figure 2, a kind of stream decoding method, can comprise:
S201, determines the frame number of the audio frame of the audio stream buffer district current cache of electronic equipment.
In order can normally to work in the situation of unstable networks (causing the Advanced Audio Coding AAC audio stream of the webserver side moment to pour in electronic equipment such as network shakiness); conventionally can in the central processor CPU of this electronic equipment, open up in advance an audio stream buffer district, carry out the AAC audio stream data of temporary cache from webserver side.For convenience of description, in embodiments of the present invention, by the audio stream buffer district opening up referred to as AAC buffering area, as shown in Figure 1.
Be understandable that, in the time that the speed of the AAC of network equipment side audio stream is greater than the decode rate of electronic equipment, flows into a part of audio frame in this electronic equipment because being decoded in time, and be cached in AAC buffering area temporarily.Now, can add up the frame number of the audio frame of AAC buffering area current cache, and then determine whether to need to carry out frame losing operation.
Optionally, in an embodiment of the embodiment of the present invention, can, according to default measurement period, periodically determine the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment.Such as every 6s to AAC buffering area in the frame number of audio frame of buffer memory add up.
It should be noted that, the default measurement period in the present invention can be the measurement period of electronic apparatus system acquiescence, or the measurement period set voluntarily according to the actual requirements of user, and the embodiment of the present invention is not construed as limiting this.
S202, when this frame number is greater than the first amount threshold, and while being less than the totalframes of the audio frame that described audio stream buffer district can buffer memory, after default duration, does discard processing to the audio frame in described audio stream buffer district.
It should be noted that, under normal circumstances, the totalframes of the audio frame that audio stream buffer area can buffer memory is 25 frames, the first amount threshold value in the embodiment of the present invention is 15, certainly, also can set voluntarily according to the actual requirements, the embodiment of the present invention is not construed as limiting this.
In addition, based on practical experience, the default duration in the embodiment of the present invention is generally 5s, certainly, also can set voluntarily according to the actual requirements, and the embodiment of the present invention is not construed as limiting this.Preferably, described default duration is less than described measurement period.
Optionally, in an embodiment of the invention, in the time that the audio frame in described audio stream buffer district is done to discard processing, can, from the rear of queue in described audio stream buffer district, audio frame be abandoned.
Optionally, in yet another embodiment of the present invention, in the time that the audio frame in described audio stream buffer district is done to discard processing, can, from the queue heads in described audio stream buffer district, audio frame be abandoned.
Optionally, the audio frame in described audio stream buffer district is done after discard processing, in described audio stream buffer district, the frame number of audio frame equals described the first amount threshold.Now, in conjunction with example, the inventive method and prior art are compared, as shown in Figure 3 and Figure 4, under normal circumstances,, the decoder in electronic equipment was 25 frame/seconds to the decode rate of audio frame, the memory capacity in the audio stream buffer district in electronic equipment is 25 frames, can get n
1=15, preset duration T=5 second; The speed that pours in of the audio stream of webserver side was 27 frame/seconds.
Understand for convenient, while supposing the 0th second, this audio stream buffer district is empty.As shown in Figure 3, in art methods, the 1st second time, 27 frame audio frames arrive in this electronic equipment, the decoder of this electronic equipment 25 frame audio frames of can only decoding, and 2 remaining frame buffers are in audio stream buffer district; The 2nd second time, continue to have 27 frame audio frames to arrive in this electronic equipment, the decoder of this electronic equipment 25 frame audio frames of can only decoding, now the audio frame frame number of this audio stream buffer district buffer memory is 4; The like, the 12nd second time, the audio frame frame number of this audio stream buffer district buffer memory is 24 frames; The 13rd second time, continue to have 27 frame audio frames to arrive in this electronic equipment, the decoder of this electronic equipment 25 frame audio frames of can only decoding, residue 2 frames can not be decoded, and the buffer memory ability of this audio stream buffer district buffer memory is 5 frames, and the audio frame frame number of current cache is 24 frames, buffer memory 1 frame again, now this audio stream buffer district state that reaches capacity, also has 1 frame to be buffered, again can not be decoded, can only be dropped.
The 14th second time, continue to have 27 frame audio frames to arrive in this electronic equipment, residue 2 frames can not be decoded, and this audio stream buffer district state that reached capacity in the time of the 13rd second, remaining 2 frames can not can not be buffered decoded, again, can only abandon.Hence one can see that, after the 12nd second, all can occur frame losing phenomenon each second.
As shown in Figure 4, in the methods of the invention, the 1st second time, 27 frame audio frames arrive in this electronic equipment, the decoder of this electronic equipment 25 frame audio frames of can only decoding, and 2 remaining frame buffers are in audio stream buffer district; By that analogy, the 8th second time, the audio frame frame number of this audio stream buffer district buffer memory is 16 frames, is greater than n
1continue after duration T=5 second, the frame number of the audio frame of this audio stream buffer area buffer memory is 24 frames, now the audio frame in buffering area is abandoned, until the frame number of the audio frame of this buffer area buffer memory is 15 frames, after this, only need interval audio frame to be abandoned in 5 seconds, and needn't as prior art, all want frame losing every 1 second.
In above embodiment, enumerating actual parameter is only that the embodiment of the present invention includes but not limited to above parameter for convenience of understanding.In actual conditions, for other parameter, the method for the embodiment of the present invention still can reduce the number of times of frame losing to a certain extent, reduces plosive occurrence number.
Optionally, the audio frame in described audio stream buffer district is done after discard processing, in described audio stream buffer district, the frame number of audio frame equals described the second amount threshold, and described the second amount threshold is less than described the first amount threshold.Such as, the first amount threshold is that 15, the second amount threshold can be for to be less than 15 integer value, and now, the embodiment of the present invention still can reduce the frame losing number of times of audio frame, and derivation method is as above-mentioned example, and the present invention repeats no more this.
Sometimes,, in the time not reaching default duration, in audio stream buffer, the frame number of the audio frame of buffer memory has just reached the totalframes that this audio stream buffer district can buffer memory audio frame, now, can do discard processing to the audio frame in described audio stream buffer district immediately.
S203, decodes to the audio frame not being dropped in described audio stream buffer district.
As can be seen here, embodiment of the present invention method can be determined the frame number of the audio frame of the audio stream buffer district current cache of electronic equipment, when this frame number is greater than the first amount threshold, and while being less than the totalframes of audio frame of described audio stream buffer district energy buffer memory, after default duration, audio frame in described audio stream buffer district is done to discard processing, the audio frame not being dropped in described audio stream buffer district is decoded.
Compared with prior art, the embodiment of the present invention adopts the audio frame frame number in audio stream buffer district to be greater than the first amount threshold, and while being less than the totalframes of audio frame of audio stream buffer district energy buffer memory, after default duration, audio frame is done to the method for discard processing, reduce the frame losing number of times of audio frame decode procedure sound intermediate frequency frame, reduced the number of times that plosive occurs.
Optionally, in one embodiment of the invention, described audio frame derives from video file, and described video file also comprises frame of video; As shown in Figure 5, described method also comprises:
S204, decodes to the frame of video in described video file.
Optionally, in an embodiment of the embodiment of the present invention, as shown in Figure 6, above-mentioned S204, can comprise:
Whether S204a, detect digital signal processor DSP buffering area in undersaturated condition; Wherein, the input block that described DSP buffering area is digital signal processor, described DSP buffering area is for buffer memory video requency frame data.
Under normal circumstances, DSP (Digital Signal Processor, digital signal processor) in comprise input block and output buffer, for convenience of description, in embodiments of the present invention, by the input block of digital signal processor, referred to as DSP buffering area, its Main Function is that the video requency frame data to entering DSP carries out temporary cache.
In order can normally to work in the situation of unstable networks (causing the H.264 video flowing of the webserver side moment to pour in playback equipment such as network shakiness); conventionally can be in advance in the driving of video playback apparatus or hardware, open up a video stream buffer district; carry out the H.264 video stream data of temporary cache from webserver side; for convenience of description; in embodiments of the present invention, by the video stream buffer district opening up referred to as buffering area H.264.
Be understandable that, the buffering area of opening up is less, and the time delay of video flowing arrival DSP buffering area is just less, and the broadcast time-delay of this video flowing is also just less, but may cause playing unsmooth; The buffering area of opening up is larger, plays more smoothly, but that video flowing arrives the time delay of DSP buffering area is just longer.
Optionally, in an embodiment of the invention, whether can detect in real time DSP buffering area in undersaturated condition.
Optionally, in yet another embodiment of the present invention, can be according to default sense cycle, whether periodically detect DSP buffering area in undersaturated condition; Such as every 1s, one-time detection being carried out in the buffering area of DSP.Such as every 1s, one-time detection being carried out in the buffering area of DSP.
It should be noted that, the default sense cycle in the present invention can be the sense cycle of playback equipment system default, or user according to the actual requirements voluntarily set sense cycle, the embodiment of the present invention is not construed as limiting this.
S204b inserts blank frame in DSP buffering area, the state until this DSP buffering area reaches capacity.
Blank frame in the embodiment of the present invention can be understood as transparent frame, covers in the frame of video with real screen content and can not exert an influence to the result of broadcast of this frame of video, and in coded system H.264, this blank frame is also called EOS frame.
Mention above, only have in the time that DSP buffering area is filled, DSP decoder can be decoded to the frame of video of this DSP buffering area in saturation condition; In embodiments of the present invention, in the time causing DSP buffering area in undersaturated condition due to reasons such as network congestions, can in this DSP buffering area in unsaturation state, insert blank frame, the state so that this DSP buffering area reaches capacity rapidly.
It should be noted that, when DSP buffering area is during in saturation condition, embodiment of the present invention method can not continue to insert blank frame in this DPS buffering area, with the frame losing problem of avoiding causing because of frame data overfill in DSP buffering area.
S204c, decodes to the frame data in DSP buffering area.
In the time that DSP buffering area reaches capacity state, can force the blank frame that comprises of this DSP buffering area all to overflow at interior frame data, thereby realize, residual frame data in this DSP buffering area are decoded.
As can be seen here, the in the situation that in DSP buffering area, in undersaturated condition, DSP buffering area, residual video flowing can not being decoded immediately, the embodiment of the present invention can adopt to the method for inserting the blank frame that does not affect video render effect in DSP buffering area, make this DSP buffering area state that reaches capacity fast, then the frame data that comprise above-mentioned residual video flowing are decoded, realize and not affected on the basis of this partial video stream follow-up play effect, to the decoding immediately of above-mentioned residual video stream data.
Optionally, in one embodiment of the invention, above-mentioned S204a, can comprise:
Detect the duration of DSP buffering area in undersaturated condition and whether exceed default threshold value.
Be understandable that, under normal circumstances, H.264 the H.264 video flowing in buffering area is cached to DSP buffering area and only needs the extremely short time; Sometimes, network there will be the problem of temporary transient obstruction, but can recover very soon normal, and now DSP buffering area may be of short duration in undersaturated condition, the state that can reach capacity again very soon, and can not produce larger impact to follow-up result of broadcast.
Based on above-mentioned situation, in embodiments of the present invention, a duration threshold value that does not affect overall viewing effect can be set, if DSP buffering area exceedes duration threshold value in the duration of undersaturated condition, in this DSP buffering area, insert blank frame, make this DSP buffering area state that reaches capacity rapidly; If DSP buffering area is no more than duration threshold value (such as above-mentioned situation) in the duration of undersaturated condition, can in this DSP buffering area, not insert blank frame.
Optionally, in one embodiment of the invention, above-mentioned S204a, can comprise:
Detect in DSP buffering area and whether exist from the video requency frame data in the video data buffer of setting up in advance, and be not full of by video requency frame data.
Optionally, in one embodiment of the invention, above-mentioned S204c, can comprise:
The video requency frame data that carries network identity in DSP buffering area is decoded; Wherein, the frame of video that carries network identity described in is the frame data that derive from the video stream buffer district setting up in advance.
Be understandable that, the video requency frame data that webserver side sends all carries the network identities such as timestamp, the video requency frame data that carries network identity in the embodiment of the present invention can be understood as webserver side and sends to the video requency frame data in playback equipment, H.264 first the frame data that send due to webserver side be cached in buffering area, therefore also can be understood as the video requency frame data that derives from the H.264 buffering area of setting up in advance.
In embodiments of the present invention, can only decode to the frame of video that comprises flesh and blood, thereby maintain the original presentation effect of this frame of video.
Optionally, in one embodiment of the invention, before above-mentioned S204a, can also comprise:
Whether detect currently has video stream data to be cached to described DSP buffer area.
In embodiments of the present invention, detect DSP buffering area whether before undersaturated condition, can currently whether have video stream data to be cached to this DSP buffering area by detecting, whether determining whether to detect DSP buffering area in undersaturated condition; Currently do not have video stream data to be cached to this DSP buffering area if detected, can determine that current network obstruction is more serious, if now residual fraction video stream data in this DSP buffering area, can insert blank frame to this DSP buffering area, to reach the object that above-mentioned residual video stream data is decoded as early as possible.
Optionally, in one embodiment of the invention, the frame of video of described video file carries timestamp, and the audio frame of described video file carries timestamp; Described method can also comprise:
According to the corresponding relation of the timestamp of the timestamp of described frame of video and described audio frame, the decoded result to frame of video and the decoded result of audio frame are synchronously play.
Optionally, embodiment of the present invention method also can be applied to the scene of audio frequency and video asynchronous play.
Be understandable that, at some application scenarios, such as higher scenes of requirement of real-time such as police's real-time tracking criminal, real time remote controls, more lay particular emphasis on the real-time of audio stream and video render, now, electronic equipment can directly be play decoded audio or video, and without again both synchronously being play, thereby avoided the video flowing that network reason causes to stop up, audio stream cannot be play; Or audio stream block time, the generation that video flowing also cannot be play.
Corresponding to embodiment of the method above, a kind of audio stream decoding device that the embodiment of the present invention also provides.
As shown in Figure 7, a kind of audio stream decoding device, can comprise:
Frame number determination module 701, for determining the frame number of audio frame of audio stream buffer district current cache of electronic equipment;
Frame losing module 702, for being greater than the first amount threshold when this frame number, and while being less than the totalframes of the audio frame that described audio stream buffer district can buffer memory, after default duration, does discard processing to the audio frame in described audio stream buffer district;
Audio frame decoder module 703, decodes for the audio frame that described audio stream buffer district is not dropped.
Optionally, in one embodiment of the invention, described frame losing module 702, also for:
In the time that this frame number reaches described totalframes, immediately the audio frame in described audio stream buffer district is done to discard processing.
Optionally, in one embodiment of the invention, described frame losing module 702 is done after discard processing the audio frame in described audio stream buffer district, and in described audio stream buffer district, the frame number of audio frame equals described the first amount threshold; Or
Described frame losing module 702 is done after discard processing the audio frame in described audio stream buffer district, and in described audio stream buffer district, the frame number of audio frame equals described the second amount threshold, and described the second amount threshold is less than described the first amount threshold.
Optionally, in one embodiment of the invention, described frame data determination module 703, specifically for:
According to default measurement period, periodically determine the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment.
In an execution mode of the embodiment of the present invention, described measurement period is greater than described default duration.
Optionally, in one embodiment of the invention, described frame losing module 702, specifically for:
From the rear of queue in described audio stream buffer district, audio frame is abandoned;
Or
From the queue heads in described audio stream buffer district, audio frame is abandoned.
Optionally, in one embodiment of the invention, described audio frame derives from video file, and described video file also comprises frame of video; As shown in Figure 8, described device also comprises:
Frame of video decoder module 704, decodes for the frame of video to described video file.
Optionally, in one embodiment of the invention, as shown in Figure 9, described frame of video decoder module 704, comprising:
The first detection sub-module 704a, for detection of digital signal processor DSP buffering area, whether in undersaturated condition, wherein, described DSP buffering area is for buffer memory video requency frame data;
Blank frame is filled submodule 704b, in the testing result of described first detection module 704a be, in DSP buffering area, insert blank frame EOS, the state until this DSP buffering area reaches capacity;
Frame of video decoding submodule 704c, for decoding to the frame data in DSP buffering area.
Optionally, in one embodiment of the invention, described frame of video decoder module 704, also comprises:
The second detection sub-module, whether there is video stream data to be cached to described DSP buffering area for detection of current, and in testing result be no in the situation that, trigger described first detection module and carry out work, wherein, described video stream data is: the video requency frame data in the video data buffer of setting up in advance, the described video data buffer of setting up in advance derives from the video requency frame data of webserver side for buffer memory.
Optionally, in one embodiment of the invention, described the first detection sub-module 704a, specifically for:
Whether detect in real time DSP buffering area in undersaturated condition;
Or
According to default sense cycle, whether periodically detect DSP buffering area in undersaturated condition.
Optionally, in one embodiment of the invention, described the first detection sub-module 704a, specifically for:
Detect the duration of DSP buffering area in undersaturated condition and whether exceed default threshold value.
Optionally, in one embodiment of the invention, described the first detection sub-module 704a, specifically for:
Detect in DSP buffering area and whether exist from the video requency frame data in the video data buffer of setting up in advance, and be not full of by video requency frame data.
Optionally, in one embodiment of the invention, described frame of video decoding submodule 704c, specifically for:
The frame of video that carries network identity in DSP buffering area is decoded, described in carry network identity frame of video be the frame data that derive from the video stream buffer district setting up in advance.
Optionally, in one embodiment of the invention, the frame of video of described video file carries timestamp, and the audio frame of described video file carries timestamp; Described device also comprises:
Playing module, for according to the corresponding relation of the timestamp of the timestamp of described frame of video and described audio frame, the decoded result to frame of video and the decoded result of audio frame are synchronously play.
For device embodiment, because it is substantially similar in appearance to embodiment of the method, so description is fairly simple, relevant part is referring to the part explanation of embodiment of the method.
For convenience of description, while describing above device, being divided into various modules with function describes respectively.Certainly, in the time that enforcement is of the present invention, the function of each module can be realized in same or multiple software and/or hardware.
It should be noted that, in this article, relational terms such as the first and second grades is only used for an entity or operation to separate with another entity or operating space, and not necessarily requires or imply and between these entities or operation, have the relation of any this reality or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thereby the process, method, article or the equipment that make to comprise a series of key elements not only comprise those key elements, but also comprise other key elements of clearly not listing, or be also included as the intrinsic key element of this process, method, article or equipment.The in the situation that of more restrictions not, the key element being limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment that comprises described key element and also have other identical element.
Each embodiment in this specification all adopts relevant mode to describe, between each embodiment identical similar part mutually referring to, what each embodiment stressed is and the difference of other embodiment.Especially,, for device embodiment, because it is substantially similar in appearance to embodiment of the method, so description is fairly simple, relevant part is referring to the part explanation of embodiment of the method.
One of ordinary skill in the art will appreciate that all or part of step realizing in said method execution mode is can carry out the hardware that instruction is relevant by program to complete, described program can be stored in computer read/write memory medium, here the alleged storage medium obtaining, as: ROM/RAM, magnetic disc, CD etc.
The foregoing is only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.All any amendments of doing within the spirit and principles in the present invention, be equal to replacement, improvement etc., be all included in protection scope of the present invention.
Claims (28)
1. a stream decoding method, is characterized in that, the method comprises:
Determine the frame number of the audio frame of the audio stream buffer district current cache of electronic equipment;
When this frame number is greater than the first amount threshold, and while being less than the totalframes of the audio frame that described audio stream buffer district can buffer memory, after default duration, the audio frame in described audio stream buffer district is done to discard processing;
The audio frame not being dropped in described audio stream buffer district is decoded.
2. method according to claim 1, is characterized in that, also comprises:
In the time that this frame number reaches described totalframes, immediately the audio frame in described audio stream buffer district is done to discard processing.
3. method according to claim 1 and 2, is characterized in that, the audio frame in described audio stream buffer district is done after discard processing, and in described audio stream buffer district, the frame number of audio frame equals described the first amount threshold; Or
Audio frame in described audio stream buffer district is done after discard processing, and in described audio stream buffer district, the frame number of audio frame equals described the second amount threshold, and described the second amount threshold is less than described the first amount threshold.
4. method according to claim 1 and 2, is characterized in that, determines the frame number of the audio frame of the audio stream buffer district current cache of electronic equipment, comprising:
According to default measurement period, periodically determine the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment.
5. method as claimed in claim 4, is characterized in that, described measurement period is greater than described default duration.
6. method according to claim 1 and 2, is characterized in that, described audio frame in described audio stream buffer district is done to discard processing, comprising:
From the rear of queue in described audio stream buffer district, audio frame is abandoned;
Or
From the queue heads in described audio stream buffer district, audio frame is abandoned.
7. method according to claim 1, is characterized in that, described audio frame derives from video file, and described video file also comprises frame of video; Described method also comprises: the frame of video in described video file is decoded.
8. method according to claim 7, is characterized in that, described frame of video in described video file is decoded, and comprising:
Whether detect digital signal processor DSP buffering area in undersaturated condition, wherein, the input block that described DSP buffering area is digital signal processor, described DSP buffering area is for buffer memory video requency frame data;
If so, in DSP buffering area, insert blank frame, the state until this DSP buffering area reaches capacity;
Frame data in DSP buffering area are decoded.
9. whether method according to claim 8, is characterized in that,, also comprise before undersaturated condition in described detection digital signal processor DSP buffering area:
Whether detect currently has video stream data to be cached to described DSP buffering area, if not, whether carry out described detection digital signal processor DSP buffering area in undersaturated condition, wherein, described video stream data is: the video requency frame data in the video data buffer of setting up in advance, the described video data buffer of setting up in advance derives from the video requency frame data of webserver side for buffer memory.
10. method according to claim 8, is characterized in that, whether described detection digital signal processor DSP buffering area, in undersaturated condition, comprising:
Whether detect in real time DSP buffering area in undersaturated condition;
Or
According to default sense cycle, whether periodically detect DSP buffering area in undersaturated condition.
11. methods according to claim 8, is characterized in that, whether described detection digital signal processor DSP buffering area, in undersaturated condition, comprising:
Detect the duration of DSP buffering area in undersaturated condition and whether exceed default threshold value.
12. methods according to claim 8, is characterized in that, whether described detection digital signal processor DSP buffering area, in undersaturated condition, comprising:
Detect in DSP buffering area and whether exist from the video requency frame data in the video data buffer of setting up in advance, and be not full of by video requency frame data.
13. methods according to claim 12, is characterized in that, described frame data in DSP buffering area are decoded, and comprising:
The frame of video that carries network identity in DSP buffering area is decoded, described in carry network identity frame of video be the frame data that derive from the video stream buffer district setting up in advance.
14. methods according to claim 7, is characterized in that, the frame of video of described video file carries timestamp, and the audio frame of described video file carries timestamp; Described method also comprises:
According to the corresponding relation of the timestamp of the timestamp of described frame of video and described audio frame, the decoded result to frame of video and the decoded result of audio frame are synchronously play.
15. 1 kinds of audio stream decoding devices, is characterized in that, this device comprises:
Frame number determination module, for determining the frame number of audio frame of audio stream buffer district current cache of electronic equipment;
Frame losing module, for being greater than the first amount threshold when this frame number, and while being less than the totalframes of the audio frame that described audio stream buffer district can buffer memory, after default duration, does discard processing to the audio frame in described audio stream buffer district;
Audio frame decoder module, decodes for the audio frame that described audio stream buffer district is not dropped.
16. devices according to claim 15, is characterized in that, described frame losing module, also for:
In the time that this frame number reaches described totalframes, immediately the audio frame in described audio stream buffer district is done to discard processing.
17. according to the device described in claim 15 or 16, it is characterized in that, described frame losing module is done after discard processing the audio frame in described audio stream buffer district, and in described audio stream buffer district, the frame number of audio frame equals described the first amount threshold; Or
Described frame losing module is done after discard processing the audio frame in described audio stream buffer district, and in described audio stream buffer district, the frame number of audio frame equals described the second amount threshold, and described the second amount threshold is less than described the first amount threshold.
18. according to the device described in claim 15 or 16, it is characterized in that, described frame data determination module, specifically for:
According to default measurement period, periodically determine the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment.
19. methods according to claim 18, is characterized in that, described measurement period is greater than described default duration.
20. according to the device described in claim 15 or 16, it is characterized in that, described frame losing module, specifically for:
From the rear of queue in described audio stream buffer district, audio frame is abandoned;
Or
From the queue heads in described audio stream buffer district, audio frame is abandoned.
21. devices according to claim 15, is characterized in that, described audio frame derives from video file, and described video file also comprises frame of video; Described device also comprises: frame of video decoder module.
22. devices according to claim 21, is characterized in that, described frame of video decoder module, comprising:
The first detection sub-module, for detection of digital signal processor DSP buffering area, whether in undersaturated condition, wherein, described DSP buffering area is for buffer memory video requency frame data;
Blank frame fill submodule, in the testing result of described first detection module be, in DSP buffering area, insert blank frame EOS, the state until this DSP buffering area reaches capacity;
Frame of video decoding submodule, for decoding to the frame data in DSP buffering area.
23. devices according to claim 22, is characterized in that, described frame of video decoder module, also comprises:
The second detection sub-module, whether there is video stream data to be cached to described DSP buffering area for detection of current, and in testing result be no in the situation that, trigger described first detection module and carry out work, wherein, described video stream data is: the video requency frame data in the video data buffer of setting up in advance, the described video data buffer of setting up in advance derives from the video requency frame data of webserver side for buffer memory.
24. devices according to claim 22, is characterized in that, described the first detection sub-module, specifically for:
Whether detect in real time DSP buffering area in undersaturated condition;
Or
According to default sense cycle, whether periodically detect DSP buffering area in undersaturated condition.
25. devices according to claim 22, is characterized in that, described the first detection sub-module, specifically for:
Detect the duration of DSP buffering area in undersaturated condition and whether exceed default threshold value.
26. devices according to claim 22, is characterized in that, described the first detection sub-module, specifically for:
Detect in DSP buffering area and whether exist from the video requency frame data in the video data buffer of setting up in advance, and be not full of by video requency frame data.
27. devices according to claim 26, is characterized in that, described frame of video decoding submodule, specifically for:
The frame of video that carries network identity in DSP buffering area is decoded, described in carry network identity frame of video be the frame data that derive from the video stream buffer district setting up in advance.
28. devices according to claim 15, is characterized in that, the frame of video of described video file carries timestamp, and the audio frame of described video file carries timestamp; Described device also comprises:
Playing module, for according to the corresponding relation of the timestamp of the timestamp of described frame of video and described audio frame, the decoded result to frame of video and the decoded result of audio frame are synchronously play.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410375254.1A CN104113777B (en) | 2014-08-01 | 2014-08-01 | A kind of stream decoding method and device |
| PCT/CN2015/085612 WO2016015670A1 (en) | 2014-08-01 | 2015-07-30 | Audio stream decoding method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410375254.1A CN104113777B (en) | 2014-08-01 | 2014-08-01 | A kind of stream decoding method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104113777A true CN104113777A (en) | 2014-10-22 |
| CN104113777B CN104113777B (en) | 2018-06-05 |
Family
ID=51710389
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410375254.1A Active CN104113777B (en) | 2014-08-01 | 2014-08-01 | A kind of stream decoding method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104113777B (en) |
| WO (1) | WO2016015670A1 (en) |
Cited By (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105100874A (en) * | 2015-06-29 | 2015-11-25 | 百度在线网络技术（北京）有限公司 | Multimedia play method and equipment |
| WO2016015667A1 (en) * | 2014-08-01 | 2016-02-04 | 广州金山网络科技有限公司 | Video stream decoding method and device |
| WO2016015670A1 (en) * | 2014-08-01 | 2016-02-04 | 广州金山网络科技有限公司 | Audio stream decoding method and device |
| CN105847971A (en) * | 2016-05-28 | 2016-08-10 | 刘健文 | Method for processing screen transmission video |
| CN105847946A (en) * | 2016-05-28 | 2016-08-10 | 刘健文 | Screen transmission video processing method |
| CN105872728A (en) * | 2016-05-28 | 2016-08-17 | 刘健文 | Screen transfer video processing method for multi-screen interaction |
| CN106658176A (en) * | 2016-11-07 | 2017-05-10 | 广州视源电子科技股份有限公司 | Remote video display method and system |
| CN107438197A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | A kind of display terminal |
| CN107438199A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | One kind passes screen video display terminal |
| CN107438198A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | A kind of display terminal for being used to pass screen video |
| CN108347645A (en) * | 2018-01-19 | 2018-07-31 | 浙江大华技术股份有限公司 | A kind of method and device that video frame decoding is shown |
| CN108882013A (en) * | 2017-05-09 | 2018-11-23 | 北京鸿合智能系统有限公司 | Adjust method, apparatus, electronic equipment and the storage medium of audio and video playing rate |
| CN109756789A (en) * | 2018-12-28 | 2019-05-14 | 视联动力信息技术股份有限公司 | A kind of loss treating method and system of audio, video data packet |
| CN109830243A (en) * | 2019-01-30 | 2019-05-31 | 腾讯科技（深圳）有限公司 | Sound effect treatment method, device and computer equipment |
| CN109830249A (en) * | 2018-12-29 | 2019-05-31 | 百度在线网络技术（北京）有限公司 | Data processing method, device and storage medium |
| CN109996094A (en) * | 2017-12-29 | 2019-07-09 | 杭州海康威视系统技术有限公司 | Video broadcasting method, apparatus and system |
| CN110312159A (en) * | 2019-05-24 | 2019-10-08 | 深圳市朗强科技有限公司 | A kind of signal receiving device, stream media transmission system and flow-medium transmission method |
| CN110634511A (en) * | 2019-09-27 | 2019-12-31 | 北京西山居互动娱乐科技有限公司 | Audio data processing method and device |
| CN110677715A (en) * | 2019-10-11 | 2020-01-10 | 北京达佳互联信息技术有限公司 | Decoding method, decoder, electronic device and storage medium |
| CN111355975A (en) * | 2020-03-26 | 2020-06-30 | 郑州信大捷安信息技术股份有限公司 | Live client audio and video delay adjustment playing system and method |
| CN111381973A (en) * | 2018-12-28 | 2020-07-07 | 中兴通讯股份有限公司 | Voice data processing method and device and computer readable storage medium |
| CN111901666A (en) * | 2020-07-01 | 2020-11-06 | 腾讯科技（深圳）有限公司 | Image processing method, image processing apparatus, electronic device, and storage medium |
| CN112511885A (en) * | 2020-11-20 | 2021-03-16 | 深圳乐播科技有限公司 | Audio and video synchronization method and device and storage medium |
| CN112995746A (en) * | 2019-12-18 | 2021-06-18 | 华为技术有限公司 | Video processing method and device and terminal equipment |
| CN113082710A (en) * | 2021-04-23 | 2021-07-09 | 杭州雾联科技有限公司 | Audio playing method and device, electronic equipment and storage medium |
| CN114095769A (en) * | 2020-08-24 | 2022-02-25 | 海信视像科技股份有限公司 | Live broadcast low-delay processing method of application-level player and display equipment |
| CN114512139A (en) * | 2022-04-18 | 2022-05-17 | 杭州星犀科技有限公司 | Processing method and system for multi-channel audio mixing, mixing processor and storage medium |
| WO2022183841A1 (en) * | 2021-03-02 | 2022-09-09 | 北京沃东天骏信息技术有限公司 | Decoding method and device, and computer readable storage medium |
| CN114095769B (en) * | 2020-08-24 | 2024-05-14 | 海信视像科技股份有限公司 | Live broadcast low-delay processing method of application-level player and display device |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113542795B (en) * | 2020-04-21 | 2023-04-18 | 腾讯科技（深圳）有限公司 | Video processing method and device, electronic equipment and computer readable storage medium |
| CN112511848B (en) * | 2020-11-09 | 2023-06-20 | 网宿科技股份有限公司 | Live broadcast method, server side and computer readable storage medium |
| CN113014997B (en) * | 2021-03-12 | 2023-04-07 | 上海哔哩哔哩科技有限公司 | Cache updating method and device |
| CN113301426A (en) * | 2021-04-07 | 2021-08-24 | 深圳市麦谷科技有限公司 | Previewing method and device for live video, terminal equipment and storage medium |
| CN113225617A (en) * | 2021-04-28 | 2021-08-06 | 臻迪科技股份有限公司 | Playing video processing method and device and electronic equipment |
| CN113225598B (en) * | 2021-05-07 | 2023-01-20 | 上海一谈网络科技有限公司 | Method, device and equipment for synchronizing audio and video of mobile terminal and storage medium |
| CN114268830A (en) * | 2021-12-06 | 2022-04-01 | 咪咕文化科技有限公司 | Cloud director synchronization method, device, equipment and storage medium |
| CN115103216A (en) * | 2022-07-19 | 2022-09-23 | 康键信息技术（深圳）有限公司 | Live broadcast data processing method and device, computer equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050018775A1 (en) * | 2003-07-23 | 2005-01-27 | Mk Subramanian | System and method for audio/video synchronization |
| CN1937778A (en) * | 2005-09-20 | 2007-03-28 | 腾讯科技（深圳）有限公司 | Flow media playing method, system and device |
| CN101340590A (en) * | 2008-08-14 | 2009-01-07 | 北京创毅视讯科技有限公司 | Multiplex apparatus and multiplex method |
| CN101753422A (en) * | 2008-12-12 | 2010-06-23 | Tcl集团股份有限公司 | Method for improving subjective quality of network audio |
| CN102378065A (en) * | 2011-10-19 | 2012-03-14 | 江西省南城县网信电子有限公司 | Method and system for configuring buffer area at streaming media server side based on MPEG (Moving Picture Experts Group)-4 |
| CN103780908A (en) * | 2014-02-25 | 2014-05-07 | 成都佳发安泰科技股份有限公司 | Efficient H264 decoding method |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4762052B2 (en) * | 2006-05-31 | 2011-08-31 | パナソニック株式会社 | Stream data processing apparatus and stream data processing method |
| CN102739503B (en) * | 2011-04-01 | 2014-12-03 | 华平信息技术股份有限公司 | Processing method of VoIP (voice over internet protocol) de-jitter buffer |
| CN103391415B (en) * | 2012-05-11 | 2016-12-07 | 安凯(广州)微电子技术有限公司 | A kind of Video data frame losing processing method and system |
| CN104113777B (en) * | 2014-08-01 | 2018-06-05 | 广州猎豹网络科技有限公司 | A kind of stream decoding method and device |
-
2014
- 2014-08-01 CN CN201410375254.1A patent/CN104113777B/en active Active
-
2015
- 2015-07-30 WO PCT/CN2015/085612 patent/WO2016015670A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050018775A1 (en) * | 2003-07-23 | 2005-01-27 | Mk Subramanian | System and method for audio/video synchronization |
| CN1937778A (en) * | 2005-09-20 | 2007-03-28 | 腾讯科技（深圳）有限公司 | Flow media playing method, system and device |
| CN101340590A (en) * | 2008-08-14 | 2009-01-07 | 北京创毅视讯科技有限公司 | Multiplex apparatus and multiplex method |
| CN101753422A (en) * | 2008-12-12 | 2010-06-23 | Tcl集团股份有限公司 | Method for improving subjective quality of network audio |
| CN102378065A (en) * | 2011-10-19 | 2012-03-14 | 江西省南城县网信电子有限公司 | Method and system for configuring buffer area at streaming media server side based on MPEG (Moving Picture Experts Group)-4 |
| CN103780908A (en) * | 2014-02-25 | 2014-05-07 | 成都佳发安泰科技股份有限公司 | Efficient H264 decoding method |
Cited By (39)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016015667A1 (en) * | 2014-08-01 | 2016-02-04 | 广州金山网络科技有限公司 | Video stream decoding method and device |
| WO2016015670A1 (en) * | 2014-08-01 | 2016-02-04 | 广州金山网络科技有限公司 | Audio stream decoding method and device |
| CN105100874A (en) * | 2015-06-29 | 2015-11-25 | 百度在线网络技术（北京）有限公司 | Multimedia play method and equipment |
| CN105847971A (en) * | 2016-05-28 | 2016-08-10 | 刘健文 | Method for processing screen transmission video |
| CN105847946A (en) * | 2016-05-28 | 2016-08-10 | 刘健文 | Screen transmission video processing method |
| CN105872728A (en) * | 2016-05-28 | 2016-08-17 | 刘健文 | Screen transfer video processing method for multi-screen interaction |
| CN107438199A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | One kind passes screen video display terminal |
| CN107438197A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | A kind of display terminal |
| CN107438198A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | A kind of display terminal for being used to pass screen video |
| CN106658176A (en) * | 2016-11-07 | 2017-05-10 | 广州视源电子科技股份有限公司 | Remote video display method and system |
| CN108882013A (en) * | 2017-05-09 | 2018-11-23 | 北京鸿合智能系统有限公司 | Adjust method, apparatus, electronic equipment and the storage medium of audio and video playing rate |
| CN109996094A (en) * | 2017-12-29 | 2019-07-09 | 杭州海康威视系统技术有限公司 | Video broadcasting method, apparatus and system |
| CN109996094B (en) * | 2017-12-29 | 2021-08-13 | 杭州海康威视系统技术有限公司 | Video playing method, device and system |
| CN108347645A (en) * | 2018-01-19 | 2018-07-31 | 浙江大华技术股份有限公司 | A kind of method and device that video frame decoding is shown |
| CN108347645B (en) * | 2018-01-19 | 2021-02-26 | 浙江大华技术股份有限公司 | Method and device for decoding and displaying video frame |
| CN111381973A (en) * | 2018-12-28 | 2020-07-07 | 中兴通讯股份有限公司 | Voice data processing method and device and computer readable storage medium |
| CN109756789A (en) * | 2018-12-28 | 2019-05-14 | 视联动力信息技术股份有限公司 | A kind of loss treating method and system of audio, video data packet |
| CN111381973B (en) * | 2018-12-28 | 2024-03-01 | 中兴通讯股份有限公司 | Voice data processing method and device and computer readable storage medium |
| CN109756789B (en) * | 2018-12-28 | 2021-10-19 | 视联动力信息技术股份有限公司 | Method and system for processing packet loss of audio and video data packet |
| CN109830249B (en) * | 2018-12-29 | 2021-07-06 | 百度在线网络技术（北京）有限公司 | Data processing method, device and storage medium |
| CN109830249A (en) * | 2018-12-29 | 2019-05-31 | 百度在线网络技术（北京）有限公司 | Data processing method, device and storage medium |
| CN109830243B (en) * | 2019-01-30 | 2021-01-12 | 腾讯科技（深圳）有限公司 | Sound effect processing method and device and computer equipment |
| CN109830243A (en) * | 2019-01-30 | 2019-05-31 | 腾讯科技（深圳）有限公司 | Sound effect treatment method, device and computer equipment |
| CN110312159B (en) * | 2019-05-24 | 2022-03-11 | 深圳市朗强科技有限公司 | Signal receiving device, streaming media transmission system and streaming media transmission method |
| CN110312159A (en) * | 2019-05-24 | 2019-10-08 | 深圳市朗强科技有限公司 | A kind of signal receiving device, stream media transmission system and flow-medium transmission method |
| CN110634511A (en) * | 2019-09-27 | 2019-12-31 | 北京西山居互动娱乐科技有限公司 | Audio data processing method and device |
| CN110634511B (en) * | 2019-09-27 | 2021-09-14 | 北京西山居互动娱乐科技有限公司 | Audio data processing method and device |
| CN110677715A (en) * | 2019-10-11 | 2020-01-10 | 北京达佳互联信息技术有限公司 | Decoding method, decoder, electronic device and storage medium |
| CN112995746A (en) * | 2019-12-18 | 2021-06-18 | 华为技术有限公司 | Video processing method and device and terminal equipment |
| CN111355975B (en) * | 2020-03-26 | 2021-09-07 | 郑州信大捷安信息技术股份有限公司 | Live client audio and video delay adjustment playing system and method |
| CN111355975A (en) * | 2020-03-26 | 2020-06-30 | 郑州信大捷安信息技术股份有限公司 | Live client audio and video delay adjustment playing system and method |
| CN111901666B (en) * | 2020-07-01 | 2021-05-11 | 腾讯科技（深圳）有限公司 | Image processing method, image processing apparatus, electronic device, and storage medium |
| CN111901666A (en) * | 2020-07-01 | 2020-11-06 | 腾讯科技（深圳）有限公司 | Image processing method, image processing apparatus, electronic device, and storage medium |
| CN114095769B (en) * | 2020-08-24 | 2024-05-14 | 海信视像科技股份有限公司 | Live broadcast low-delay processing method of application-level player and display device |
| CN114095769A (en) * | 2020-08-24 | 2022-02-25 | 海信视像科技股份有限公司 | Live broadcast low-delay processing method of application-level player and display equipment |
| CN112511885A (en) * | 2020-11-20 | 2021-03-16 | 深圳乐播科技有限公司 | Audio and video synchronization method and device and storage medium |
| WO2022183841A1 (en) * | 2021-03-02 | 2022-09-09 | 北京沃东天骏信息技术有限公司 | Decoding method and device, and computer readable storage medium |
| CN113082710A (en) * | 2021-04-23 | 2021-07-09 | 杭州雾联科技有限公司 | Audio playing method and device, electronic equipment and storage medium |
| CN114512139A (en) * | 2022-04-18 | 2022-05-17 | 杭州星犀科技有限公司 | Processing method and system for multi-channel audio mixing, mixing processor and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104113777B (en) | 2018-06-05 |
| WO2016015670A1 (en) | 2016-02-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104113777A (en) | Audio stream decoding method and device | |
| CN106713855B (en) | Video playing method and device | |
| CN106385620B (en) | A kind of data smoothing output method based on Streaming Media | |
| KR101008764B1 (en) | Method and system for improving interactive media response systems using visual cues | |
| US20090060458A1 (en) | Method for synchronizing data flows | |
| CN104113778B (en) | A kind of method for decoding video stream and device | |
| US10021433B1 (en) | Video-production system with social-media features | |
| CN109600676A (en) | A kind of data buffering method and device | |
| US11330349B2 (en) | Content synchronization using micro-seeking | |
| CN105791735A (en) | Method and system for dynamically adjusting video call code streams | |
| US7240013B2 (en) | Method and apparatus for controlling buffering of audio stream | |
| CN110519627A (en) | A kind of synchronous method and device of audio data | |
| CN105897759A (en) | Network dynamic self-adaptive audio and video caching method and system | |
| US10368110B1 (en) | Smooth media data switching for media players | |
| CN111352605A (en) | Audio playing and sending method and device | |
| CN106331847B (en) | Audio and video playing method and apparatus | |
| CN115484494B (en) | Digital twin video stream processing method, device and equipment | |
| US20220256215A1 (en) | Systems and methods for adaptive output | |
| US20110064391A1 (en) | Video-audio playback apparatus | |
| CN107087210B (en) | Method and terminal for judging video playing state based on cache time | |
| JP6711120B2 (en) | Video playback device, video playback method, and video playback program | |
| CN111416994B (en) | Method and device for synchronously presenting video stream and tracking information and electronic equipment | |
| US20130262293A1 (en) | Variable charging of audience member temporal viewing of a live video chat performance | |
| CN114025171A (en) | Video processing method and device, terminal equipment and storage medium | |
| CN103475906A (en) | Measuring method and measuring device for multimedia flows |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 510623 3101-31063108-3110 house, Hua Xia Road, Tianhe District, Guangzhou, Guangdong. Applicant after: Guangzhou cheetah Network Technology Co., Ltd. Address before: 510623 01-B sixth unit, Guangzhou bank building, 30 Zhujiang East Road, Tianhe District, Guangzhou, Guangdong. Applicant before: Kingsoft, Guangzhou network technology Co., Ltd |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |