CN104113777B - A kind of stream decoding method and device - Google Patents
A kind of stream decoding method and device Download PDFInfo
- Publication number
- CN104113777B CN104113777B CN201410375254.1A CN201410375254A CN104113777B CN 104113777 B CN104113777 B CN 104113777B CN 201410375254 A CN201410375254 A CN 201410375254A CN 104113777 B CN104113777 B CN 104113777B
- Authority
- CN
- China
- Prior art keywords
- frame
- audio
- video
- buffer area
- stream buffer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 64
- 239000000872 buffer Substances 0.000 claims abstract description 136
- 238000012545 processing Methods 0.000 claims abstract description 37
- 230000003139 buffering effect Effects 0.000 claims description 126
- 238000001514 detection method Methods 0.000 claims description 58
- 238000005259 measurement Methods 0.000 claims description 14
- 230000001934 delay Effects 0.000 claims description 5
- 235000013399 edible fruits Nutrition 0.000 claims description 3
- 238000012360 testing method Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 206010044565 Tremor Diseases 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000005422 blasting Methods 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention discloses a kind of stream decoding method and device, a kind of stream decoding method, including：Determine the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment；When the frame number is more than the first amount threshold, and is less than the totalframes for the audio frame that the audio stream buffer area can cache, after preset duration, discard processing is done to the audio frame in the audio stream buffer area；Non-discarded audio frame in the audio stream buffer area is decoded.Using above-mentioned technical proposal, the embodiment of the present invention is more than the first amount threshold using the audio frame frame number in audio stream buffer area, and when being less than the totalframes for the audio frame that audio stream buffer area can cache, after preset duration, the method that discard processing is done to audio frame, reduce the frame losing number of audio frame decoding process sound intermediate frequency frame, reduce the number that plosive occurs.
Description
Technical field
The present invention relates to stream media technology field, more particularly to a kind of stream decoding method and device.
Background technology
To reduce the influence that the unstable audio result of broadcast to video file of network environment is brought, to the video file
Audio stream be decoded before, the electronic equipment with audio stream would generally be in advance using one section of queue structure
Memory is as audio stream buffer area, such as AAC (Advanced Audio Coding, the Advanced Audio Coding) bufferings in Fig. 1
Area；Since audio stream consumes less CPU (Central Processing Unit, central processing unit) resource, the electronics
Equipment generally use CPU carries out soft decoding to audio stream.
Network in fluctuation status, can cause the audio stream of video file in the network equipment largely persistently to pour in electricity for a long time
Sub- equipment, due to the solution bit rate of electronic equipment CPU be it is fixed, the caching capabilities in the audio stream buffer area be it is limited,
During audio stream, excessive audio stream persistently pours in the appearance that will certainly cause frame losing phenomenon.
In the prior art, the audio stream of video file largely persistently pours in electronic equipment in the network equipment, causes audio stream
Buffering area is quickly filled with, at this point, abandoning the audio stream buffer area rear of queue or the audio frame of queue heads.
However, there are direct relations for the sound effect that is presented of the frame losing number of audio frame and the video file：Audio frame
Frame losing number it is more, the video file playing process borehole blasting sound occur number it is also more；Due to existing frame losing method
When being in saturation state in audio stream buffer area, the audio frame that cannot be immediately decoded/cache can be just abandoned so that the electronics is set
Having cannot be decoded and cache to it in time when largely lasting audio stream pours in, so as to cause multiple frame losing, plosive
Phenomenon repeatedly occurs.
The content of the invention
To solve the above-mentioned problems, the embodiment of the invention discloses a kind of stream decoding method and device, particular techniques
Scheme is as follows：
A kind of stream decoding method, including：
Determine the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment；
When the frame number is more than the first amount threshold, and the totalframes for the audio frame that can be cached less than the audio stream buffer area
When, after preset duration, discard processing is done to the audio frame in the audio stream buffer area；
Non-discarded audio frame in the audio stream buffer area is decoded.
Preferably, further include：
When the frame number reaches the totalframes, discard processing is done to the audio frame in the audio stream buffer area immediately.
Preferably, after doing discard processing to the audio frame in the audio stream buffer area, sound in the audio stream buffer area
The frame number of frequency frame is equal to first amount threshold；Or
After discard processing being done to the audio frame in the audio stream buffer area, the frame of audio frame in the audio stream buffer area
Number is equal to second amount threshold, and second amount threshold is less than first amount threshold.
Preferably, the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment is determined, including：
According to the audio frame of default measurement period, periodically the audio stream buffer area current cache of definite electronic equipment
Frame number.
Preferably, the measurement period is more than the preset duration.
Preferably, the audio frame in the audio stream buffer area does discard processing, including：
Since the rear of queue in the audio stream buffer area, audio frame is abandoned；
Or
Since the queue heads in the audio stream buffer area, audio frame is abandoned.
Preferably, the audio frame derives from video file, and the video file further includes video frame；The method is also wrapped
It includes：Video frame in the video file is decoded.
Preferably, the video frame in the video file is decoded, including：
Digital signal processor DSP buffering area is detected whether in undersaturated condition, wherein, the DSP buffering areas are number
The input block of word signal processor, the DSP buffering areas are used for buffered video frame data；
If it is, blank frame is inserted into DSP buffering areas, until the DSP buffering areas reach saturation state；
Frame data in DSP buffering areas are decoded.
Preferably, also wrapped whether before undersaturated condition in the detection digital signal processor DSP buffering area
It includes：
Whether detection currently has video stream data to be cached to the DSP buffering areas, if it is not, then performing the detection number
Whether signal processor DSP buffering areas are in undersaturated condition, wherein, the video stream data is：The video counts pre-established
According to the video requency frame data in buffering area, the video data buffer pre-established derives from network server side for caching
Video requency frame data.
Preferably, whether the detection digital signal processor DSP buffering area is in undersaturated condition, including：
Whether detection DSP buffering areas are in undersaturated condition in real time；
Or
According to default detection cycle, whether DSP buffering areas are periodically detected in undersaturated condition.
Preferably, whether the detection digital signal processor DSP buffering area is in undersaturated condition, including：
Whether the duration that detection DSP buffering areas are in undersaturated condition is more than default threshold value.
Preferably, whether the detection digital signal processor DSP buffering area is in undersaturated condition, including：
It detects with the presence or absence of the video requency frame data in the video data buffer pre-established in DSP buffering areas, and
It is not full of by video requency frame data.
Preferably, the frame data in DSP buffering areas are decoded, including：
The video frame for carrying network identity in DSP buffering areas is decoded, it is described to carry regarding for network identity
Frequency frame is the frame data from the video stream buffer area pre-established.
Preferably, the video frame of the video file carries timestamp, when the audio frame of the video file carries
Between stab；The method further includes：
According to the timestamp of the video frame and the correspondence of the timestamp of the audio frame, to the decoding knot of video frame
The decoding result of fruit and audio frame synchronizes broadcasting.
A kind of audio stream device, including：
Frame number determining module, for determining the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment；
Frame losing module, for working as the frame number more than the first amount threshold, and can be cached less than the audio stream buffer area
During the totalframes of audio frame, after preset duration, discard processing is done to the audio frame in the audio stream buffer area；
Audio frame decoder module, for being decoded to non-discarded audio frame in the audio stream buffer area.
Preferably, the frame losing module, is additionally operable to：
When the frame number reaches the totalframes, discard processing is done to the audio frame in the audio stream buffer area immediately.
Preferably, after the frame losing module does discard processing to the audio frame in the audio stream buffer area, the audio
The frame number of audio frame is equal to first amount threshold in streambuf；Or
After the frame losing module does discard processing to the audio frame in the audio stream buffer area, the audio stream buffer area
The frame number of interior audio frame is equal to second amount threshold, and second amount threshold is less than first amount threshold.
Preferably, the frame data determining module, is specifically used for：
According to the audio frame of default measurement period, periodically the audio stream buffer area current cache of definite electronic equipment
Frame number.
Preferably, the measurement period is more than the preset duration.
Preferably, the frame losing module, is specifically used for：
Since the rear of queue in the audio stream buffer area, audio frame is abandoned；
Or
Since the queue heads in the audio stream buffer area, audio frame is abandoned.
Preferably, the audio frame derives from video file, and the video file further includes video frame；Described device is also wrapped
It includes：Video frame decoder module.
Preferably, the video frame decoder module, including：
First detection sub-module, for detecting whether digital signal processor DSP buffering area is in undersaturated condition,
In, the DSP buffering areas are used for buffered video frame data；
Blank frame fills submodule, in the case of being in the testing result of the detection module, to DSP buffering areas
Middle insertion blank frame EOS, until the DSP buffering areas reach saturation state；
Video frame decoding sub-module, for being decoded to the frame data in DSP buffering areas.
Preferably, the video frame decoder module, further includes：
Whether the second detection sub-module currently has video stream data to be cached to the DSP buffering areas, and is examining for detecting
In the case that survey result is no, triggers first detection sub-module and work, wherein, the video stream data is：In advance
Video requency frame data in the video data buffer of foundation, the video data buffer pre-established derive from for caching
The video requency frame data of network server side.
Preferably, first detection sub-module, is specifically used for：
Whether detection DSP buffering areas are in undersaturated condition in real time；
Or
According to default detection cycle, whether DSP buffering areas are periodically detected in undersaturated condition.
Preferably, first detection sub-module, is specifically used for：
Whether the duration that detection DSP buffering areas are in undersaturated condition is more than default threshold value.
Preferably, first detection sub-module, is specifically used for：
It detects with the presence or absence of the video requency frame data in the video data buffer pre-established in DSP buffering areas, and
It is not full of by video requency frame data.
Preferably, the video frame decoding sub-module, is specifically used for：
The video frame for carrying network identity in DSP buffering areas is decoded, it is described to carry regarding for network identity
Frequency frame is the frame data from the video stream buffer area pre-established.
Preferably, the video frame of the video file carries timestamp, when the audio frame of the video file carries
Between stab；Described device further includes：
Playing module, it is right for the timestamp according to the video frame and the correspondence of the timestamp of the audio frame
The decoding result of video frame and the decoding result of audio frame synchronize broadcasting.
Using above-mentioned technical proposal, it may be determined that the frame of the audio frame of the audio stream buffer area current cache of electronic equipment
Number, when the frame number is more than the first amount threshold, and is less than the totalframes for the audio frame that the audio stream buffer area can cache,
After preset duration, discard processing is done to the audio frame in the audio stream buffer area, in the audio stream buffer area not
The audio frame being dropped is decoded.
Compared with prior art, the embodiment of the present invention is more than the first number using the audio frame frame number in audio stream buffer area
When measuring threshold value, and being less than the totalframes for the audio frame that audio stream buffer area can cache, after preset duration, audio frame is done
The method of discard processing reduces the frame losing number of audio frame decoding process sound intermediate frequency frame, reduces the number that plosive occurs.
Description of the drawings
It in order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention, for those of ordinary skill in the art, without creative efforts, can be with
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is the exemplary process diagram of stream decoding method in the prior art；
Fig. 2 is a kind of flow chart of stream decoding method provided in an embodiment of the present invention；
Fig. 3 is the exemplary frame losing figure of prior art stream decoding method；
Fig. 4 provides the exemplary frame losing figure of stream decoding method for the embodiment of the present invention；
Fig. 5 is the flow chart of another stream decoding method provided in an embodiment of the present invention；
Fig. 6 is a kind of flow chart of embodiment of S204 in Fig. 5 that present invention implementation provides；
Fig. 7 is a kind of structure diagram of audio stream device provided in an embodiment of the present invention；
Fig. 8 is the structure diagram of another audio stream device provided in an embodiment of the present invention；
Fig. 9 is a kind of structure diagram of video frame decoder module 704 in Fig. 8 provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other without making creative work
Embodiment belongs to the scope of protection of the invention.
With the fast development of network multimedia technology, the network multimedia file of diversification enrich constantly people's vision and
Auditory perception；The appearance of Streaming Media (such as video flowing, audio stream etc.) so that user is such not necessarily like non-stream broadcast mode,
Content therein could be watched after entire multimedia file is fully downloaded to playback equipment local；And need to only it pass through several seconds or several
The transmission delay of ten seconds can be decoded and play to it on playback equipment, it brings new audiovisual experience for user.
In the case where network environment is unstable, the audio stream of network server side continues to pour in electronic equipment in large quantities
In, the decoding capability of the electronic equipment and the caching capabilities in audio stream buffer area are all limited, need to do audio frame at this time
Discard processing.Since the result of broadcast of audio and the frame losing number of audio frame are in close relations, i.e. the frame losing number of audio frame is more,
The audio number that plosive occurs when playing is also more.In order to make the result of broadcast of network side audio stream smoother,
An embodiment of the present invention provides a kind of stream decoding method and devices.
A kind of stream decoding method provided in an embodiment of the present invention is introduced first below.
It should be noted that present invention method is suitable for electronic equipment, and in practical applications, the electronic equipment
Can be laptop, desktop computer, tablet computer and smart mobile phone etc., the embodiment of the present invention is not construed as limiting this.
As shown in Fig. 2, a kind of stream decoding method, can include：
S201 determines the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment.
In order to which in the situation of unstable networks, (for example network shakiness causes the Advanced Audio Coding of network server side
AAC audio streams can moment pour in electronic equipment) under work normally, it will usually in advance in the central processor CPU of the electronic equipment
In open up one piece of audio stream buffer area, carry out AAC audio stream data of the temporary cache from network server side.For the ease of retouching
It states, in embodiments of the present invention, the audio stream buffer area opened up is referred to as AAC buffering areas, as shown in Figure 1.
It is understood that when the rate of the AAC audio streams of network equipment side is more than the solution bit rate of electronic equipment, stream
Enter a part of audio frame in the electronic equipment because that can not be decoded in time, and by temporal cache into AAC buffering areas.This
When, the frame number of the audio frame of AAC buffering area current caches can be counted, and then decide whether to carry out frame losing behaviour
Make.
It optionally, can be according to default measurement period, cycle in a specific embodiment of the embodiment of the present invention
Determine to property the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment.Such as every 6s in AAC buffering areas
The frame number of the audio frame of caching is counted.
It should be noted that the default measurement period in the present invention can be the statistics week of electronic apparatus system acquiescence
Phase or user are not construed as limiting this according to the measurement period of actual demand sets itself, the embodiment of the present invention.
S202, when the frame number is more than the first amount threshold, and the audio frame that can be cached less than the audio stream buffer area
During totalframes, after preset duration, discard processing is done to the audio frame in the audio stream buffer area.
It should be noted that under normal conditions, the totalframes for the audio frame that audio stream buffer area can cache is 25 frames, this
The first amount threshold value in inventive embodiments is 15, it is of course also possible to which according to actual demand sets itself, the present invention is implemented
Example is not construed as limiting this.
In addition, being based on practical experience, the preset duration in the embodiment of the present invention is usually 5s, it is of course also possible to according to reality
Border demand sets itself, the embodiment of the present invention are not construed as limiting this.Preferably, the preset duration is less than the measurement period.
Optionally, in an embodiment of the invention, abandoned to the audio frame in the audio stream buffer area
During processing, audio frame can be abandoned since the rear of queue in the audio stream buffer area.
Optionally, in yet another embodiment of the present invention, lose being done to the audio frame in the audio stream buffer area
When abandoning processing, audio frame can be abandoned since the queue heads in the audio stream buffer area.
Optionally, after discard processing is done to the audio frame in the audio stream buffer area, in the audio stream buffer area
The frame number of audio frame is equal to first amount threshold.At this point, with reference to example to the method for the present invention compared with the prior art,
As shown in Figure 3 and Figure 4, it is generally the case that, decoder in electronic equipment is 25 frames/second to the solution bit rate of audio frame, electronics
The memory capacity in the audio stream buffer area in equipment is 25 frames, can take n1=15, preset duration T=5 seconds；Network server side
Audio stream pour in speed as 27 frames/second.
In order to facilitate understanding, it is assumed that at the 0th second, which is empty.As shown in figure 3, art methods
In, at the 1st second, 27 frame audio frames are reached in the electronic equipment, and the decoder of the electronic equipment can only decode 25 frame audio frames, are remained
Under 2 frame buffers into audio stream buffer area；At the 2nd second, continue there are 27 frame audio frames to reach in the electronic equipment, which sets
Standby decoder can only decode 25 frame audio frames, and the audio frame frame number of audio stream buffer area caching is 4 at this time；And so on,
At the 12nd second, the audio frame frame number of audio stream buffer area caching is 24 frames；At the 13rd second, continuing, which has 27 frame audio frames to reach, is somebody's turn to do
In electronic equipment, the decoder of the electronic equipment can only decode 25 frame audio frames, and remaining 2 frames cannot be decoded, and the audio stream
The caching capabilities of buffer cache are 5 frames, and the audio frame frame number of current cache is 24 frames, can only cache 1 frame again, at this time the sound
Frequency streambuf reaches saturation state, also has 1 frame that can neither be buffered, and cannot be decoded, and can only be dropped.
At the 14th second, continue there are 27 frame audio frames to reach in the electronic equipment, remaining 2 frames cannot be decoded, and the audio
Streambuf has reached saturation state at the 13rd second, and remaining 2 frame can neither be decoded and cannot be buffered, can only abandon.
It follows that after the 12nd second, frame losing phenomenon can all occur in each second.
As shown in figure 4, in the methods of the invention, at the 1st second, 27 frame audio frames are reached in the electronic equipment, which sets
Standby decoder can only decode 25 frame audio frames, and remaining 2 frame buffer is into audio stream buffer area；And so on, at the 8th second,
The audio frame frame number of audio stream buffer area caching is 16 frames, more than n1, after T=5 seconds, which delays duration
The frame number for the audio frame deposited is 24 frames, and the audio frame in buffering area is abandoned at this time, until the audio of the buffer cache
The frame number of frame is 15 frames, hereafter, only need to be spaced 5 seconds audio frame is abandoned, without as the prior art every 1 second all
Want frame losing.
It is only more than the embodiment of the present invention includes but not limited to for convenience of understanding that actual parameter is enumerated in above example
Parameter.In a practical situation, for other parameters, the method for the embodiment of the present invention remains to reduce frame losing to a certain extent
Number reduces the occurrence number of plosive.
Optionally, after discard processing is done to the audio frame in the audio stream buffer area, in the audio stream buffer area
The frame number of audio frame is equal to second amount threshold, and second amount threshold is less than first amount threshold.For example,
First amount threshold is 15, and the second amount threshold can be the integer value less than 15, at this point, the embodiment of the present invention still is able to reduce
The frame losing number of audio frame, derivation method such as examples detailed above, the present invention repeat no more this.
Sometimes, when being not reaching to preset duration, the frame number of the audio frame of caching has just reached the sound in audio stream buffer
Frequency streambuf is capable of the totalframes of buffered audio frame, at this point it is possible to be done immediately to the audio frame in the audio stream buffer area
Discard processing.
S203 is decoded non-discarded audio frame in the audio stream buffer area.
It can be seen that present invention method can determine the audio of the audio stream buffer area current cache of electronic equipment
The frame number of frame, when the frame number is more than the first amount threshold, and the total frame for the audio frame that can be cached less than the audio stream buffer area
During number, after preset duration, discard processing is done to the audio frame in the audio stream buffer area, to the audio stream buffer
Non-discarded audio frame is decoded in area.
Compared with prior art, the embodiment of the present invention is more than the first number using the audio frame frame number in audio stream buffer area
When measuring threshold value, and being less than the totalframes for the audio frame that audio stream buffer area can cache, after preset duration, audio frame is done
The method of discard processing reduces the frame losing number of audio frame decoding process sound intermediate frequency frame, reduces the number that plosive occurs.
Optionally, in one embodiment of the invention, the audio frame derives from video file, and the video file is also
Including video frame；As shown in figure 5, the method further includes：
S204 is decoded the video frame in the video file.
Optionally, in one embodiment of the embodiment of the present invention, as shown in fig. 6, above-mentioned S204, can include：
Whether S204a, detection digital signal processor DSP buffering area are in undersaturated condition；Wherein, the DSP bufferings
Area is the input block of digital signal processor, and the DSP buffering areas are used for buffered video frame data.
Under normal conditions, input buffering is included in DSP (Digital Signal Processor, digital signal processor)
Area and output buffer, for ease of description, in embodiments of the present invention, by the input block of digital signal processor referred to as
For DSP buffering areas, its main function is to carry out temporary cache to the video requency frame data into DSP.
In order to which in the situation of unstable networks, (for example network shakiness causes the H.264 video flowing of network server side
Can moment pour in playback equipment) under work normally, it will usually one piece is opened up in the driving of video playback apparatus or hardware in advance
Video stream buffer area carrys out H.264 video stream data of the temporary cache from network server side, for ease of description, in this hair
In bright embodiment, the video stream buffer area opened up is referred to as H.264 buffering area.
It is understood that the buffering area opened up is smaller, video flowing reaches the delay of DSP buffering areas with regard to smaller, the video
The broadcast time-delay of stream is also just smaller, but may cause to play unsmooth；The buffering area opened up is bigger, and broadcasting is then more smooth, but regards
The delay that frequency stream reaches DSP buffering areas is longer.
Optionally, in an embodiment of the invention, DSP buffering areas can be detected in real time whether in unsaturated shape
State.
Optionally, in yet another embodiment of the present invention, can be periodically detected according to default detection cycle
Whether DSP buffering areas are in undersaturated condition；For example one-time detection is carried out to the buffering area of DSP every 1s.Such as every 1s pairs
The buffering area of DSP carries out one-time detection.
It should be noted that the default detection cycle in the present invention can be the detection week of playback equipment system default
Phase or user are not construed as limiting this according to the detection cycle of actual demand sets itself, the embodiment of the present invention.
S204b is inserted into blank frame into DSP buffering areas, until the DSP buffering areas reach saturation state.
Blank frame in the embodiment of the present invention can be understood as transparent frame, be covered in the video frame with real screen content
On the result of broadcast of the video frame will not be had an impact, in H.264 coding mode, which is also designated as EOS frames.
It has been mentioned hereinbefore that only when DSP buffering areas are filled, DSP decoders can be in saturation state to this
The video frame of DSP buffering areas be decoded；In embodiments of the present invention, when due to network congestion etc. DSP being caused to buffer
When area is in undersaturated condition, it can be in this in DSP buffering areas of unsaturated state and be inserted into blank frame, so that the DSP delays
It rushes area and is rapidly reached saturation state.
It should be noted that when DSP buffering areas are in saturation state, present invention method will not continue to this
Blank frame is inserted into DPS buffering areas, to avoid the frame losing problem caused by frame data overfill in DSP buffering areas.
S204c is decoded the frame data in DSP buffering areas.
When DSP buffering areas reach saturation state, the frame data included including blank frame of the DSP buffering areas can be forced
It all overflows, is decoded so as to fulfill to remaining frame data in the DSP buffering areas.
It cannot be solved immediately it can be seen that being in residual video stream in undersaturated condition, DSP buffering areas in DSP buffering areas
In the case of code, the embodiment of the present invention can use the blank frame for being inserted into DSP buffering areas and not influencing video render effect
Method, the DSP buffering areas is made to be rapidly achieved saturation state, then the frame data comprising above-mentioned residual video stream are solved
Code, realizes on the basis of the partial video stream follow-up play effect is not influenced, to above-mentioned residual video flow data immediately
Decoding.
Optionally, in one embodiment of the invention, above-mentioned S204a can include：
Whether the duration that detection DSP buffering areas are in undersaturated condition is more than default threshold value.
It is understood that under normal circumstances, H.264 the H.264 video flowing in buffering area is cached to DSP buffering areas and only needs
The extremely short time；Sometimes, network is present with the problem of temporary block, but can recover normal quickly, and DSP buffering areas may at this time
Of short duration is in undersaturated condition, can reach saturation state again quickly, and larger shadow will not be generated to subsequent result of broadcast
It rings.
Based on the above situation, in embodiments of the present invention, a duration threshold for not influencing whole viewing effect can be set
If the duration that DSP buffering areas are in undersaturated condition is more than duration threshold value, blank frame is inserted into the DSP buffering areas for value,
The DSP buffering areas is made to be rapidly reached saturation state；If the duration that DSP buffering areas are in undersaturated condition is no more than duration threshold value
(such as the above situation) then can not be inserted into blank frame into the DSP buffering areas.
Optionally, in one embodiment of the invention, above-mentioned S204a can include：
It detects with the presence or absence of the video requency frame data in the video data buffer pre-established in DSP buffering areas, and
It is not full of by video requency frame data.
Optionally, in one embodiment of the invention, above-mentioned S204c can include：
The video requency frame data for carrying network identity in DSP buffering areas is decoded；Wherein, it is described to carry network
The video frame of mark is the frame data from the video stream buffer area pre-established.
It is understood that the video requency frame data that network server side is sent all carries the network identities such as timestamp, this
The video requency frame data for carrying network identity in inventive embodiments can be understood as network server side and be sent to playback equipment
In video requency frame data, since the frame data that network server side is sent are cached to first in H.264 buffering area, therefore can also manage
It solves as from the video requency frame data of the H.264 buffering area pre-established.
In embodiments of the present invention, only the video frame comprising substantive content can be decoded, is regarded so as to maintain this
The original presentation effect of frequency frame.
Optionally, in one embodiment of the invention, before above-mentioned S204a, can also include：
Whether detection currently has video stream data to be cached to the DSP buffering areas.
In embodiments of the present invention, in detection DSP buffering areas whether before undersaturated condition, can be worked as by detection
It is preceding whether to there is video stream data to be cached to the DSP buffering areas, whether to determine the need for detection DSP buffering areas in unsaturation
State；The DSP buffering areas are cached to currently without video stream data if detected, can determine that current network obstruction is tighter
Weight if residual fraction video stream data in the DSP buffering areas at this time, can be inserted into blank frame, to reach to the DSP buffering areas
To the purpose for being decoded above-mentioned residual video flow data as early as possible.
Optionally, in one embodiment of the invention, the video frame of the video file carries timestamp, described to regard
The audio frame of frequency file carries timestamp；The method can also include：
According to the timestamp of the video frame and the correspondence of the timestamp of the audio frame, to the decoding knot of video frame
The decoding result of fruit and audio frame synchronizes broadcasting.
Optionally, present invention method can also be applied to the scene of audio and video asynchronous play.
It is understood that in some application scenarios, such as the real-times such as police's real-time tracking criminal, real time remote control
More demanding scene is more focused on the real-time of audio stream and video render, at this point, electronic equipment can be directly to decoding
Audio or video afterwards plays out, without the two is played simultaneously again, so as to avoid video flowing caused by network reason
It blocks, audio stream can not play；Or during audio flow blocked, generation that video flowing can not also play.
Corresponding to above method embodiment, a kind of audio stream device that the embodiment of the present invention additionally provides.
As shown in fig. 7, a kind of audio stream device, can include：
Frame number determining module 701, for determining the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment；
Frame losing module 702 for working as the frame number more than the first amount threshold, and can be cached less than the audio stream buffer area
Audio frame totalframes when, after preset duration, discard processing is done to the audio frame in the audio stream buffer area；
Audio frame decoder module 703, for being decoded to non-discarded audio frame in the audio stream buffer area.
Optionally, in one embodiment of the invention, the frame losing module 702, is additionally operable to：
When the frame number reaches the totalframes, discard processing is done to the audio frame in the audio stream buffer area immediately.
Optionally, in one embodiment of the invention, the frame losing module 702 is to the sound in the audio stream buffer area
After frequency frame does discard processing, the frame number of audio frame is equal to first amount threshold in the audio stream buffer area；Or
After the frame losing module 702 does discard processing to the audio frame in the audio stream buffer area, the audio stream delays
The frame number for rushing audio frame in area is equal to second amount threshold, and second amount threshold is less than the first quantity threshold
Value.
Optionally, in one embodiment of the invention, the frame data determining module 703, is specifically used for：
According to the audio frame of default measurement period, periodically the audio stream buffer area current cache of definite electronic equipment
Frame number.
In an embodiment of the embodiment of the present invention, the measurement period is more than the preset duration.
Optionally, in one embodiment of the invention, the frame losing module 702, is specifically used for：
Since the rear of queue in the audio stream buffer area, audio frame is abandoned；
Or
Since the queue heads in the audio stream buffer area, audio frame is abandoned.
Optionally, in one embodiment of the invention, the audio frame derives from video file, and the video file is also
Including video frame；As shown in figure 8, described device further includes：
Video frame decoder module 704, for being decoded to the video frame in the video file.
Optionally, in one embodiment of the invention, as shown in figure 9, the video frame decoder module 704, including：
First detection sub-module 704a, for detecting whether digital signal processor DSP buffering area is in undersaturated condition,
Wherein, the DSP buffering areas are used for buffered video frame data；
Blank frame fills submodule 704b, for the situation for being yes in the testing result of the first detection sub-module 704a
Under, blank frame EOS is inserted into DSP buffering areas, until the DSP buffering areas reach saturation state；
Video frame decoding sub-module 704c, for being decoded to the frame data in DSP buffering areas.
Optionally, in one embodiment of the invention, the video frame decoder module 704, further includes：
Whether the second detection sub-module currently has video stream data to be cached to the DSP buffering areas, and is examining for detecting
In the case that survey result is no, triggers first detection sub-module and work, wherein, the video stream data is：In advance
Video requency frame data in the video data buffer of foundation, the video data buffer pre-established derive from for caching
The video requency frame data of network server side.
Optionally, in one embodiment of the invention, the first detection sub-module 704a, is specifically used for：
Whether detection DSP buffering areas are in undersaturated condition in real time；
Or
According to default detection cycle, whether DSP buffering areas are periodically detected in undersaturated condition.
Optionally, in one embodiment of the invention, the first detection sub-module 704a, is specifically used for：
Whether the duration that detection DSP buffering areas are in undersaturated condition is more than default threshold value.
Optionally, in one embodiment of the invention, the first detection sub-module 704a, is specifically used for：
It detects with the presence or absence of the video requency frame data in the video data buffer pre-established in DSP buffering areas, and
It is not full of by video requency frame data.
Optionally, in one embodiment of the invention, the video frame decoding sub-module 704c, is specifically used for：
The video frame for carrying network identity in DSP buffering areas is decoded, it is described to carry regarding for network identity
Frequency frame is the frame data from the video stream buffer area pre-established.
Optionally, in one embodiment of the invention, the video frame of the video file carries timestamp, described to regard
The audio frame of frequency file carries timestamp；Described device further includes：
Playing module, it is right for the timestamp according to the video frame and the correspondence of the timestamp of the audio frame
The decoding result of video frame and the decoding result of audio frame synchronize broadcasting.
For device embodiment, since it is substantially similar to embodiment of the method, so description is fairly simple, it is related
Part illustrates referring to the part of embodiment of the method.
For convenience of description, it is divided into various modules during description apparatus above with function to describe respectively.Certainly, this is being implemented
The function of each module is realized can in the same or multiple software and or hardware during invention.
It should be noted that herein, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant are intended to
Non-exclusive inclusion, so that process, method, article or equipment including a series of elements not only will including those
Element, but also including other elements that are not explicitly listed or further include as this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
Also there are other identical elements in process, method, article or equipment including the element.
Each embodiment in this specification is described using relevant mode, identical similar portion between each embodiment
Point just to refer each other, and the highlights of each of the examples are difference from other examples.It is real especially for device
For applying example, since it is substantially similar to embodiment of the method, so description is fairly simple, related part is referring to embodiment of the method
Part explanation.
One of ordinary skill in the art will appreciate that all or part of step in realization above method embodiment is can
Relevant hardware to be instructed to complete by program, the program can be stored in computer read/write memory medium,
The storage medium designated herein obtained, such as：ROM/RAM, magnetic disc, CD etc..
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modifications, equivalent replacements and improvements are made within the spirit and principles in the present invention, are all contained in protection scope of the present invention
It is interior.
Claims (22)
1. a kind of stream decoding method, which is characterized in that this method includes：
Determine the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment, wherein, the audio frame is derived from and regarded
Frequency file, the video file further include video frame；
When the frame number is more than the first amount threshold, and is less than the totalframes for the audio frame that the audio stream buffer area can cache,
After preset duration, discard processing is done to the audio frame in the audio stream buffer area, in the audio stream buffer area
Audio frame do discard processing after, in the audio stream buffer area frame number of audio frame be equal to first amount threshold；Or
After discard processing being done to the audio frame in the audio stream buffer area, frame number of audio frame etc. in the audio stream buffer area
In the second amount threshold, and second amount threshold is less than first amount threshold；
Non-discarded audio frame in the audio stream buffer area is decoded；
Video frame in the video file is decoded, wherein, the video frame in the video file solves
Code, including：
Digital signal processor DSP buffering area is detected whether in undersaturated condition, wherein, the DSP buffering areas are believed for number
The input block of number processor, the DSP buffering areas are used for buffered video frame data；
If it is, blank frame is inserted into DSP buffering areas, until the DSP buffering areas reach saturation state；
Frame data in DSP buffering areas are decoded.
2. it according to the method described in claim 1, it is characterized in that, further includes：
When the frame number reaches the totalframes, discard processing is done to the audio frame in the audio stream buffer area immediately.
3. method according to claim 1 or 2, which is characterized in that determine that the audio stream buffer area of electronic equipment currently delays
The frame number for the audio frame deposited, including：
According to the frame of default measurement period, the periodically audio frame of the audio stream buffer area current cache of definite electronic equipment
Number.
4. method as claimed in claim 3, which is characterized in that the measurement period is more than the preset duration.
5. method according to claim 1 or 2, which is characterized in that the audio frame in the audio stream buffer area
Discard processing is done, including：
Since the rear of queue in the audio stream buffer area, audio frame is abandoned；
Or
Since the queue heads in the audio stream buffer area, audio frame is abandoned.
6. according to the method described in claim 1, it is characterized in that, it is in the detection digital signal processor DSP buffering area
It is no to be in before undersaturated condition, it further includes：
Whether detection currently has video stream data to be cached to the DSP buffering areas, if it is not, then performing the detection digital signal
Whether processor DSP buffering areas are in undersaturated condition, wherein, the video stream data is：The video data pre-established delays
The video requency frame data in area is rushed, the video data buffer pre-established derives from regarding for network server side for caching
Frequency frame data.
7. according to the method described in claim 1, it is characterized in that, whether described detect digital signal processor DSP buffering area
In undersaturated condition, including：
Whether detection DSP buffering areas are in undersaturated condition in real time；
Or
According to default detection cycle, whether DSP buffering areas are periodically detected in undersaturated condition.
8. according to the method described in claim 1, it is characterized in that, whether described detect digital signal processor DSP buffering area
In undersaturated condition, including：
Whether the duration that detection DSP buffering areas are in undersaturated condition is more than default threshold value.
9. according to the method described in claim 1, it is characterized in that, whether described detect digital signal processor DSP buffering area
In undersaturated condition, including：
Detect with the presence or absence of video requency frame data in the video data buffer pre-established in DSP buffering areas, and not by
Video requency frame data is full of.
10. according to the method described in claim 9, it is characterized in that, the frame data in DSP buffering areas are decoded,
Including：
The video frame for carrying network identity in DSP buffering areas is decoded, the video frame for carrying network identity
To derive from the frame data in the video stream buffer area pre-established.
11. according to the method described in claim 1, it is characterized in that, the video frame of the video file carries timestamp, institute
The audio frame for stating video file carries timestamp；The method further includes：
According to the correspondence of the timestamp of the video frame and the timestamp of the audio frame, decoding result to video frame and
The decoding result of audio frame synchronizes broadcasting.
12. a kind of audio stream device, which is characterized in that the device includes：
Frame number determining module, for determining the frame number of the audio frame of the audio stream buffer area current cache of electronic equipment, wherein, institute
Audio frame is stated from video file, the video file further includes video frame；
Frame losing module, for working as the frame number more than the first amount threshold, and the audio that can be cached less than the audio stream buffer area
During the totalframes of frame, after preset duration, discard processing is done to the audio frame in the audio stream buffer area, to the sound
After audio frame in frequency streambuf does discard processing, the frame number of audio frame is equal to the described first number in the audio stream buffer area
Measure threshold value；Or
After discard processing being done to the audio frame in the audio stream buffer area, frame number of audio frame etc. in the audio stream buffer area
In the second amount threshold, and second amount threshold is less than first amount threshold；
Audio frame decoder module, for being decoded to non-discarded audio frame in the audio stream buffer area；
Video frame decoder module, for being decoded to the video frame in the video file, wherein, the video frame decoding mould
Block, including：
First detection sub-module, for whether detecting digital signal processor DSP buffering area in undersaturated condition, wherein, institute
DSP buffering areas are stated for buffered video frame data；
Blank frame fills submodule, in the case of being in the testing result of first detection sub-module, is buffered to DSP
Blank frame EOS is inserted into area, until the DSP buffering areas reach saturation state；
Video frame decoding sub-module, for being decoded to the frame data in DSP buffering areas.
13. device according to claim 12, which is characterized in that the frame losing module is additionally operable to：
When the frame number reaches the totalframes, discard processing is done to the audio frame in the audio stream buffer area immediately.
14. the device according to claim 12 or 13, which is characterized in that the frame number determining module is specifically used for：
According to the frame of default measurement period, the periodically audio frame of the audio stream buffer area current cache of definite electronic equipment
Number.
15. device according to claim 14, which is characterized in that the measurement period is more than the preset duration.
16. the device according to claim 12 or 13, which is characterized in that the frame losing module is specifically used for：
Since the rear of queue in the audio stream buffer area, audio frame is abandoned；
Or
Since the queue heads in the audio stream buffer area, audio frame is abandoned.
17. device according to claim 12, which is characterized in that the video frame decoder module further includes：
Whether the second detection sub-module has video stream data to be cached to the DSP buffering areas, and is tied in detection for detecting currently
In the case that fruit is no, triggers first detection sub-module and work, wherein, the video stream data is：It pre-establishes
Video data buffer in video requency frame data, the video data buffer pre-established is for caching from network
The video requency frame data of server side.
18. device according to claim 12, which is characterized in that first detection sub-module is specifically used for：
Whether detection DSP buffering areas are in undersaturated condition in real time；
Or
According to default detection cycle, whether DSP buffering areas are periodically detected in undersaturated condition.
19. device according to claim 12, which is characterized in that first detection sub-module is specifically used for：
Whether the duration that detection DSP buffering areas are in undersaturated condition is more than default threshold value.
20. device according to claim 12, which is characterized in that first detection sub-module is specifically used for：
Detect with the presence or absence of video requency frame data in the video data buffer pre-established in DSP buffering areas, and not by
Video requency frame data is full of.
21. device according to claim 20, which is characterized in that the video frame decoding sub-module is specifically used for：
The video frame for carrying network identity in DSP buffering areas is decoded, the video frame for carrying network identity
To derive from the frame data in the video stream buffer area pre-established.
22. device according to claim 12, which is characterized in that the video frame of the video file carries timestamp,
The audio frame of the video file carries timestamp；Described device further includes：
Playing module, for the timestamp according to the video frame and the correspondence of the timestamp of the audio frame, to video
The decoding result of frame and the decoding result of audio frame synchronize broadcasting.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410375254.1A CN104113777B (en) | 2014-08-01 | 2014-08-01 | A kind of stream decoding method and device |
| PCT/CN2015/085612 WO2016015670A1 (en) | 2014-08-01 | 2015-07-30 | Audio stream decoding method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410375254.1A CN104113777B (en) | 2014-08-01 | 2014-08-01 | A kind of stream decoding method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104113777A CN104113777A (en) | 2014-10-22 |
| CN104113777B true CN104113777B (en) | 2018-06-05 |
Family
ID=51710389
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410375254.1A Expired - Fee Related CN104113777B (en) | 2014-08-01 | 2014-08-01 | A kind of stream decoding method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104113777B (en) |
| WO (1) | WO2016015670A1 (en) |
Families Citing this family (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104113777B (en) * | 2014-08-01 | 2018-06-05 | 广州猎豹网络科技有限公司 | A kind of stream decoding method and device |
| CN104113778B (en) * | 2014-08-01 | 2018-04-03 | 广州猎豹网络科技有限公司 | A kind of method for decoding video stream and device |
| CN105100874A (en) * | 2015-06-29 | 2015-11-25 | 百度在线网络技术（北京）有限公司 | Multimedia play method and equipment |
| CN105847971A (en) * | 2016-05-28 | 2016-08-10 | 刘健文 | Method for processing screen transmission video |
| CN105847946A (en) * | 2016-05-28 | 2016-08-10 | 刘健文 | Screen transmission video processing method |
| CN105872728A (en) * | 2016-05-28 | 2016-08-17 | 刘健文 | Screen transfer video processing method for multi-screen interaction |
| CN107438199A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | One kind passes screen video display terminal |
| CN107438197A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | A kind of display terminal |
| CN107438198A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | A kind of display terminal for being used to pass screen video |
| CN106658176A (en) * | 2016-11-07 | 2017-05-10 | 广州视源电子科技股份有限公司 | Remote video display method and system |
| CN108882013A (en) * | 2017-05-09 | 2018-11-23 | 北京鸿合智能系统有限公司 | Adjust method, apparatus, electronic equipment and the storage medium of audio and video playing rate |
| CN109996094B (en) * | 2017-12-29 | 2021-08-13 | 杭州海康威视系统技术有限公司 | Video playing method, device and system |
| CN108347645B (en) * | 2018-01-19 | 2021-02-26 | 浙江大华技术股份有限公司 | Method and device for decoding and displaying video frame |
| CN111381973B (en) * | 2018-12-28 | 2024-03-01 | 中兴通讯股份有限公司 | Voice data processing method and device and computer readable storage medium |
| CN109756789B (en) * | 2018-12-28 | 2021-10-19 | 视联动力信息技术股份有限公司 | Method and system for processing packet loss of audio and video data packet |
| CN113380280B (en) * | 2018-12-29 | 2022-11-22 | 百度在线网络技术（北京）有限公司 | Data processing method, device and storage medium |
| CN109830243B (en) * | 2019-01-30 | 2021-01-12 | 腾讯科技（深圳）有限公司 | Sound effect processing method and device and computer equipment |
| CN110312159B (en) * | 2019-05-24 | 2022-03-11 | 深圳市朗强科技有限公司 | Signal receiving device, streaming media transmission system and streaming media transmission method |
| CN113900619A (en) * | 2019-09-27 | 2022-01-07 | 北京西山居互动娱乐科技有限公司 | Audio data processing method and device |
| CN110677715B (en) * | 2019-10-11 | 2022-04-22 | 北京达佳互联信息技术有限公司 | Decoding method, decoder, electronic device and storage medium |
| CN112995746B (en) * | 2019-12-18 | 2022-09-09 | 华为技术有限公司 | Video processing method and device and terminal equipment |
| CN111355975B (en) * | 2020-03-26 | 2021-09-07 | 郑州信大捷安信息技术股份有限公司 | Live client audio and video delay adjustment playing system and method |
| CN113542795B (en) * | 2020-04-21 | 2023-04-18 | 腾讯科技（深圳）有限公司 | Video processing method and device, electronic equipment and computer readable storage medium |
| CN111901666B (en) * | 2020-07-01 | 2021-05-11 | 腾讯科技（深圳）有限公司 | Image processing method, image processing apparatus, electronic device, and storage medium |
| CN114095769B (en) * | 2020-08-24 | 2024-05-14 | 海信视像科技股份有限公司 | Live broadcast low-delay processing method of application-level player and display device |
| CN112511848B (en) * | 2020-11-09 | 2023-06-20 | 网宿科技股份有限公司 | Live broadcast method, server side and computer readable storage medium |
| CN112511885A (en) * | 2020-11-20 | 2021-03-16 | 深圳乐播科技有限公司 | Audio and video synchronization method and device and storage medium |
| CN114093375A (en) * | 2021-03-02 | 2022-02-25 | 北京沃东天骏信息技术有限公司 | Decoding method, apparatus and computer-readable storage medium |
| CN113014997B (en) * | 2021-03-12 | 2023-04-07 | 上海哔哩哔哩科技有限公司 | Cache updating method and device |
| CN113301426A (en) * | 2021-04-07 | 2021-08-24 | 深圳市麦谷科技有限公司 | Previewing method and device for live video, terminal equipment and storage medium |
| CN113082710B (en) * | 2021-04-23 | 2024-05-28 | 杭州雾联科技有限公司 | Audio playing method and device, electronic equipment and storage medium |
| CN113225617A (en) * | 2021-04-28 | 2021-08-06 | 臻迪科技股份有限公司 | Playing video processing method and device and electronic equipment |
| CN113225598B (en) * | 2021-05-07 | 2023-01-20 | 上海一谈网络科技有限公司 | Method, device and equipment for synchronizing audio and video of mobile terminal and storage medium |
| CN114268830B (en) * | 2021-12-06 | 2024-05-24 | 咪咕文化科技有限公司 | Cloud guide synchronization method, device, equipment and storage medium |
| CN114512139B (en) * | 2022-04-18 | 2022-09-20 | 杭州星犀科技有限公司 | Processing method and system for multi-channel audio mixing, mixing processor and storage medium |
| CN115103216B (en) * | 2022-07-19 | 2024-07-05 | 康键信息技术（深圳）有限公司 | Live broadcast data processing method and device, computer equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1937778A (en) * | 2005-09-20 | 2007-03-28 | 腾讯科技（深圳）有限公司 | Flow media playing method, system and device |
| CN101753422A (en) * | 2008-12-12 | 2010-06-23 | Tcl集团股份有限公司 | Method for improving subjective quality of network audio |
| CN102378065A (en) * | 2011-10-19 | 2012-03-14 | 江西省南城县网信电子有限公司 | Method and system for configuring buffer area at streaming media server side based on MPEG (Moving Picture Experts Group)-4 |
| CN103780908A (en) * | 2014-02-25 | 2014-05-07 | 成都佳发安泰科技股份有限公司 | Efficient H264 decoding method |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8995536B2 (en) * | 2003-07-23 | 2015-03-31 | Broadcom Corporation | System and method for audio/video synchronization |
| JP4762052B2 (en) * | 2006-05-31 | 2011-08-31 | パナソニック株式会社 | Stream data processing apparatus and stream data processing method |
| CN101340590B (en) * | 2008-08-14 | 2010-07-07 | 北京创毅视讯科技有限公司 | Multiplex apparatus and multiplex method |
| CN102739503B (en) * | 2011-04-01 | 2014-12-03 | 华平信息技术股份有限公司 | Processing method of VoIP (voice over internet protocol) de-jitter buffer |
| CN103391415B (en) * | 2012-05-11 | 2016-12-07 | 安凯(广州)微电子技术有限公司 | A kind of Video data frame losing processing method and system |
| CN104113777B (en) * | 2014-08-01 | 2018-06-05 | 广州猎豹网络科技有限公司 | A kind of stream decoding method and device |
-
2014
- 2014-08-01 CN CN201410375254.1A patent/CN104113777B/en not_active Expired - Fee Related
-
2015
- 2015-07-30 WO PCT/CN2015/085612 patent/WO2016015670A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1937778A (en) * | 2005-09-20 | 2007-03-28 | 腾讯科技（深圳）有限公司 | Flow media playing method, system and device |
| CN101753422A (en) * | 2008-12-12 | 2010-06-23 | Tcl集团股份有限公司 | Method for improving subjective quality of network audio |
| CN102378065A (en) * | 2011-10-19 | 2012-03-14 | 江西省南城县网信电子有限公司 | Method and system for configuring buffer area at streaming media server side based on MPEG (Moving Picture Experts Group)-4 |
| CN103780908A (en) * | 2014-02-25 | 2014-05-07 | 成都佳发安泰科技股份有限公司 | Efficient H264 decoding method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104113777A (en) | 2014-10-22 |
| WO2016015670A1 (en) | 2016-02-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104113777B (en) | A kind of stream decoding method and device | |
| CN106713855B (en) | Video playing method and device | |
| US10097878B2 (en) | Video playback method and control terminal thereof | |
| US20230245684A1 (en) | Variable Speed Playback | |
| CN109587551B (en) | Method, device, equipment and storage medium for judging live broadcast blockage of streaming media | |
| EP2649599B1 (en) | Variable bit video streams for adaptive streaming | |
| CN106385620B (en) | A kind of data smoothing output method based on Streaming Media | |
| CN110248204A (en) | A kind of processing method, device, equipment and the storage medium of live streaming caching | |
| US20150201226A1 (en) | Variable bit video streams for adaptive streaming | |
| CN104780422B (en) | Flow media playing method and DST PLAYER | |
| CN104113778B (en) | A kind of method for decoding video stream and device | |
| US8861926B2 (en) | Audio and video streaming for media effects | |
| CN101785007A (en) | Method for synchronizing data flows | |
| US20090183197A1 (en) | Method of splicing encoded multimedia data streams | |
| CN102271280A (en) | Method and apparatus for variable speed playing of digital audio and video | |
| US10021433B1 (en) | Video-production system with social-media features | |
| CN105429984A (en) | Media play method, equipment and music teaching system | |
| CN105791735B (en) | Method and system for video calling code stream dynamic adjustment | |
| MX2011005782A (en) | Audio/video data play control method and apparatus. | |
| CN105872722A (en) | Online video start playing caching system and method | |
| CN110519627A (en) | A kind of synchronous method and device of audio data | |
| CN105915985A (en) | Method for performing watch-back in live broadcasting and device thereof | |
| US10200433B2 (en) | Client device, a method for receiving a streaming media data and a streaming media data transmission system | |
| KR100490403B1 (en) | Method for controlling buffering of audio stream and apparatus thereof | |
| CN110679153A (en) | Time placement of rebuffering events |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 510623 3101-31063108-3110 house, Hua Xia Road, Tianhe District, Guangzhou, Guangdong. Applicant after: Guangzhou cheetah Network Technology Co.,Ltd. Address before: 510623 01-B sixth unit, Guangzhou bank building, 30 Zhujiang East Road, Tianhe District, Guangzhou, Guangdong. Applicant before: GUANGZHOU KINGSOFT NETWORK TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180605 |