CN106210846A - Audio and video playing method and system - Google Patents
Audio and video playing method and system Download PDFInfo
- Publication number
- CN106210846A CN106210846A CN201610671231.4A CN201610671231A CN106210846A CN 106210846 A CN106210846 A CN 106210846A CN 201610671231 A CN201610671231 A CN 201610671231A CN 106210846 A CN106210846 A CN 106210846A
- Authority
- CN
- China
- Prior art keywords
- video
- audio
- time point
- frequency
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention discloses a kind of audio and video playing method, described audio and video playing method includes: during decoding limit, audio-video document limit is play, if detecting, the audio frequency and video being currently played are abnormal, then obtain the time point that the video of current decoding is corresponding;It is default when redirecting time point at the described time point obtained, jumps to the audio-video document position, described time point place obtained, audio file and video file are decoded;Audio frequency and video after the described time point broadcast decoder obtained.The invention also discloses a kind of audio-video frequency playing system.The present invention maintains the phonotape and videotape synchronization of audio and video playing.
Description
Technical field
The present invention relates to audio and video playing field, particularly relate to a kind of audio and video playing method and system.
Background technology
At present, audio and video playing has been the function that the equipment such as TV are indispensable, and user, when playing audio-video, sends out sometimes
Existing image and sound occur abnormal, i.e. image is asynchronous with sound, and as personage has begun to speech, but sound does not the most go out
Coming, or sound is out, personage does not also start to speech, and such user seems the most awkward.
Producing the reason that phonotape and videotape is abnormal, the instrument made mainly due to audio frequency and video is various, and the sound compiled regards
Frequency file is the most different, the most non-compliant.Consequently, it is possible to TV easily creates mistake when audio/video decoding
By mistake, some Frame is skipped, so that time shaft when image is play with sound is the most right such as image or sound when decoding
Together, result in audio-video nonsynchronous problem.
Summary of the invention
Present invention is primarily targeted at a kind of audio and video playing method and system of proposition, it is intended to solve traditional audio frequency and video
, easily there is audio-video nonsynchronous technical problem in broadcast mode.
For achieving the above object, a kind of audio and video playing method that the present invention provides, described audio and video playing method includes:
During decoding limit, audio-video document limit is play, if detecting, the audio frequency and video being currently played are abnormal, then
Obtain the time point that the video of current decoding is corresponding;
Being default when redirecting time point at the described time point obtained, the described time point place sound jumping to obtain regards
Frequency file position, is decoded audio file and video file;
Audio frequency and video after the described time point broadcast decoder obtained.
Preferably, detect described in that the step that the audio frequency and video being currently played are abnormal includes:
Judge when whether abnormal data flag bit corresponding to the described audio frequency and video that are currently played is preset value;
If abnormal data flag bit corresponding to the described audio frequency and video being currently played is preset value, it is determined that current the most
The described audio frequency and video play are abnormal.
Preferably, described in jump to obtain audio-video document position, described time point place, to audio file and video
While file is decoded, execution following steps:
The time point of audio file is adjusted according to the described time point obtained, so that described audio file and described video literary composition
The time shaft alignment of part.
Preferably, described audio and video playing method also includes:
During decoding limit, audio-video document limit is play, detect in real time decoded audio fragment and video segment
Whether time shaft aligns;
When the time shaft of audio fragment and video segment does not align, abnormal data flag bit is set to described presetting
Value, and current play time point is increased prefixed time interval, described in obtaining, redirect time point.
Preferably, after the step of described audio frequency and video after the described time point broadcast decoder obtained, described audio frequency and video
Player method also includes:
Remove the described preset value of described abnormal data flag bit, and redirect time point described in removing.
Additionally, for achieving the above object, the present invention also proposes a kind of audio-video frequency playing system, described audio-video frequency playing system
Including:
Acquisition module, during playing on audio-video document limit decoding limit, is currently played if detecting
Audio frequency and video are abnormal, then obtain the time point that the video of current decoding is corresponding;
Redirecting module, for being default when redirecting time point at the described time point obtained, jump to obtain is described
Audio-video document position, time point place;
Decoder module, for being decoded audio file and video file;
Playing module, for the audio frequency and video after the described time point broadcast decoder obtained.
Preferably, described audio-video frequency playing system includes:
Whether judge module, be pre-for judging abnormal data flag bit corresponding to the described audio frequency and video that are currently played
If during value;
Determine module, if being preset value for the abnormal data flag bit that the described audio frequency and video that are currently played are corresponding,
Then determine that the described audio frequency and video being currently played are abnormal.
Preferably, described audio-video frequency playing system also includes:
Adjusting module, for redirecting, described, the audio-video document position, described time point place that module jumps to obtain,
While audio file and video file are decoded, adjust the time point of audio file according to the described time point obtained,
So that described audio file aligns with the time shaft of described video file.
Preferably, described audio-video frequency playing system also includes:
Detection module, during playing on decoding limit, audio-video document limit, detects decoded audio frequency sheet in real time
Whether the time shaft of section and video segment aligns;
Processing module, for when the time shaft of audio fragment and video segment does not align, by abnormal data flag bit
It is set to described preset value, and current play time point is increased prefixed time interval, described in obtaining, redirect time point.
Preferably, described audio-video frequency playing system also includes:
Remove module, for removing the described preset value of described abnormal data flag bit, and redirect time point described in removing.
The audio and video playing method and system that the present invention proposes, when the audio frequency and video exception being currently played being detected,
Obtain the time point that the video of current decoding is corresponding, be then default when redirecting time point at the described time point obtained, jump
Go to the audio-video document position, described time point place obtained, audio file and video file are decoded, and from acquisition
Described time point broadcast decoder after audio frequency and video, it is achieved that in decoded audio frequency and video, audio fragment and video segment time
Between point keep consistent so that the audio frequency and video of final output also keep phonotape and videotape synchronization.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of audio and video playing method first embodiment of the present invention;
Fig. 2 is the schematic flow sheet of audio and video playing method the second embodiment of the present invention;
Fig. 3 is the schematic flow sheet of audio and video playing method the 3rd embodiment of the present invention;
Fig. 4 is the high-level schematic functional block diagram of audio-video frequency playing system first embodiment of the present invention;
Fig. 5 is the high-level schematic functional block diagram of audio-video frequency playing system the second embodiment of the present invention;
Fig. 6 is the high-level schematic functional block diagram of audio-video frequency playing system the 3rd embodiment of the present invention.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further referring to the drawings.
Detailed description of the invention
Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.
The present invention provides a kind of audio and video playing method.
With reference to the schematic flow sheet that Fig. 1, Fig. 1 are audio and video playing method first embodiment of the present invention.
In the present embodiment, described audio and video playing method includes:
Step S10, during decoding limit, audio-video document limit is play, if detecting the audio frequency and video being currently played
Abnormal, then obtain the time point that the video of current decoding is corresponding;
In the present embodiment, decoding limit, described audio-video document limit is play, and specifically terminal first decodes a part of audio frequency and video,
Then the audio frequency and video after broadcast decoder, and during audio frequency and video after broadcast decoder, continue the remainder of decoding audio-video document.
During decoding limit, audio-video document limit is play, if detecting, the audio frequency and video being currently played have exception, then obtain and work as
The time point that the front audio frequency and video just decoded are corresponding.Detect described in it should be noted that the audio frequency and video being currently played are abnormal
Mode include:
A, mode one, isolate the Voice & Video that the audio frequency and video being currently played are corresponding, determine isolated audio frequency
With video at the time point of synchronization, if Voice & Video is different at the time point of synchronization, it may be determined that currently broadcast
The audio frequency and video put are abnormal.
Wherein, synchronization represents the concrete time, such as 10 points;Time point represent that audio or video plays concrete time
Between, as play 12 points whole, or 12 points 25 seconds.
It should be noted that audio-video document becomes audio file from voice data stream encryption, become from encoding video frequency data flow
During video file, all have recorded the time point of correspondence, and, in the same frame picture of same audio-video document, image and sound
Frequency the most mutually meet, time point as corresponding in a certain two field picture be 12 points 12 seconds, the audio frequency mated with this two field picture is also
Be 12 points 12 seconds, follow-up play these audio frequency and video time, could phonotape and videotape synchronize.Although existing audio and video playing process, meeting
Audio-video nonsynchronous problem occurs, but the audio frequency of the image and another picture being also due to a picture occurs, causes simultaneously
Phonotape and videotape is asynchronous.Therefore, existing phonotape and videotape is asynchronous, and the actually time shaft of Voice & Video does not align, and time shaft goes out
Having showed deviation causes phonotape and videotape asynchronous, but, the time point not change that Voice & Video is actual.Therefore, if audio frequency and regarding
Frequency, in the same time point difference playing the moment, i.e. can determine that the audio frequency and video being currently played are abnormal.
B, mode two, judge whether abnormal data flag bit corresponding to the described audio frequency and video that are currently played is preset value
Time;
If abnormal data flag bit corresponding to the described audio frequency and video being currently played is preset value, it is determined that current the most
The described audio frequency and video play are abnormal.
In the present embodiment, terminal, during decoding limit, audio-video document limit is play, can detect in real time or regularly
The just Voice & Video in the audio frequency and video of decoding, when Voice & Video is when the time point of synchronization is inconsistent, it is believed that described
Audio frequency and video are abnormal, and abnormal data flag bit is set to preset value, and described preset value is configured, the most as the case may be
Limit, such as, be set to 1.
If terminal is the Voice & Video in the audio frequency and video of the just decoding of detection in real time, then the sound in audio frequency and video being detected
Abnormal data flag bit, when the time point of synchronization is inconsistent, can be set to preset value by frequency and video, and by described different
Regular data flag bit associates storage with these audio frequency and video, follow-up when being played to these audio frequency and video, if abnormal data flag bit being detected
For preset value, can directly determine that the described audio frequency and video being currently played are abnormal.Certainly, in this case, one has audio frequency and regards
Frequency the most inconsistent at the time point of synchronization, the time point of the follow-up Voice & Video ined succession may all can be inconsistent, therefore, also
Directly described abnormal data flag bit can be associated storage with follow-up audio frequency and video.Until the video obtaining current decoding is corresponding
Time point, and jump to the audio-video document position, described time point place obtained, audio file and video file are carried out
Decoding, just removes the preset value of above-mentioned abnormal data flag bit.
If terminal is the Voice & Video in the audio frequency and video of timing detection just decoding, then can be by described abnormal data mark
Will position associates storage with the audio frequency and video of timing detection, the Voice & Video time point at synchronization of audio frequency and video detected every time
Inconsistent, just described abnormal data flag bit is associated storage with the audio frequency and video detected.Follow-up, when being played to audio frequency and video,
If detecting, abnormal data flag bit is preset value, can directly determine that the audio frequency and video of broadcasting are abnormal.
In the present embodiment, owing to the numerical value of abnormal data flag bit is just to marked when audio/video decoding, follow-up
During audio and video playing, i.e. can determine that audio frequency and video are the most abnormal according to the value of abnormal data flag bit, and do not spend proposition audio frequency and video
Voice & Video, then go analysis time point the most identical, shorten the audio frequency and video abnormal time determined, effectively raise sound
The abnormal efficiency determined of video, and also improve the intelligent of audio and video playing, therefore, in the present embodiment, it is preferred to use side
Formula two determines that the audio frequency and video being currently played are the most abnormal.
In the present embodiment, during decoding limit, audio-video document limit is play, preferably to the sound being currently played
Video detects, and the mode of described detection can be detection in real time, it is also possible to is timing detection, is currently played with detection
Audio frequency and video whether abnormal, if detecting, the audio frequency and video play are abnormal, now, obtain the video of current decoding corresponding time
Between point, namely obtain the time point that the video of just decoding is corresponding, follow-up can according to the time point of this video, adjust audio frequency time
Between point so that the time point of video is Tong Bu at the time point of synchronization with audio frequency, as when 10:00, if video is corresponding
Time point is 25:00, and the time point that audio frequency is corresponding should also be 25:00, and the synchronization of audio frequency and video so could be kept to play, its
In, when described 25:00 represents audio frequency and video normal play to this position, need 25 minutes.
Step S20, is default when redirecting time point at the described time point obtained, jumps to the described time point obtained
Audio-video document position, place, is decoded audio file and video file;
In the present embodiment, after obtaining described time point, described time point is compared with the default time point that redirects
Right, with determine described time point with preset to redirect time point the most identical, if the described time point obtained redirects with default
Time point is identical, then jump directly to the audio-video document position, described time point place obtained, to audio file and video literary composition
Part is decoded.
If it is, of course, understood that the described time point obtained is not default to redirect time point, the most described terminal meeting
Continue decoding video, until the time point of the video of decoding is with default to redirect time point consistent.
In the present embodiment, described execution " jumps to the audio-video document position, described time point place obtained, to audio frequency
File and video file are decoded " while, execution following steps:
The time point of audio file is adjusted according to the described time point obtained, so that described audio file and described video literary composition
The time shaft alignment of part.
It is to say, be default when redirecting time point, now, according to obtaining at time point corresponding to video obtaining decoding
The described time point taken, is adjusted the time point of audio file so that described audio file and described video file time
Countershaft aligns, say, that synchronization, video correspondence 25:00, audio frequency also will be corresponding to 25:00;Video correspondence 29:00, audio frequency
Also will be corresponding to 29:00.
Step S30, the audio frequency and video after the described time point broadcast decoder obtained.
In the present embodiment, audio file and video file are decoded, are exactly from the beginning of at the same time in fact,
Being decoded audio file and video file, then in decoded audio frequency and video, the time shaft of Voice & Video is the most consistent,
Follow-up described terminal can be from the audio frequency and video after the described time point broadcast decoder obtained so that the final audio frequency and video phonotape and videotape play
Synchronize.
In the present embodiment, the audio frequency and video after broadcast decoder, display can be played out at the display screen of terminal, it is also possible to by end
End exports in other display device and plays out display.
In the present embodiment, can be in the decoding playing process of whole audio-video document, perform aforesaid operations, it is also possible to
Being in audio-video document, the audio-video document extracting part is decoded playing process, in the audio, video data solution extracted
Code success, and after having play the audio frequency and video fragment of default ratio, just continuation proceeds above-mentioned solution in audio-video document
Code play operation.
The audio and video playing method that the present embodiment proposes, when the audio frequency and video exception being currently played being detected, obtains
The time point that the video of current decoding is corresponding, is then default when redirecting time point at the described time point obtained, jumps to
The audio-video document position, described time point place obtained, is decoded audio file and video file, and from the institute obtained
State the audio frequency and video after time point broadcast decoder, it is achieved that in decoded audio frequency and video, audio fragment and the time point of video segment
Keep consistent so that the audio frequency and video of final output also keep phonotape and videotape synchronization.
Further, in order to improve the intelligent of audio and video playing, propose audio frequency and video of the present invention based on first embodiment and broadcast
Putting the second embodiment of method, in the present embodiment, with reference to Fig. 2, described audio and video playing method also includes:
Step S40, during decoding limit, audio-video document limit is play, detects decoded audio fragment in real time and regards
Frequently whether the time shaft of fragment aligns;
Step S50, when the time shaft of audio fragment and video segment does not align, is set to institute by abnormal data flag bit
State preset value, and current play time point is increased prefixed time interval, described in obtaining, redirect time point.
In the present embodiment, during decoding limit, audio-video document limit is play, after described terminal detects decoding in real time
Audio fragment and the time shaft of video segment whether align, say, that detect decoded audio fragment and video segment
Two time points corresponding in each moment are the most consistent, if the time shaft of audio fragment and video segment does not align, i.e.
Decoded audio fragment is the most consistent at two time points that some moment is corresponding with video segment.Now, it is believed that should
Audio frequency and video have abnormal, occur in that audio-video nonsynchronous problem, and described terminal can be first to abnormal audio fragment and video segment
Processing, described processing mode includes: audio fragment and video segment is sorted out, is then set by abnormal data flag bit
For described preset value.It has been noted that described preset value is configured as the case may be in first embodiment, concrete numerical value does not does
Limit, after having set abnormal data flag bit, by described abnormal data flag bit with classification after audio fragment and regard
Frequently fragment association is got up, it is simple to subsequent terminal, when playing audio-video, can quickly determine according to described abnormal data flag bit
Audio frequency and video have exception, and perform the regulation operation of corresponding time shaft.And the Voice & Video extracting in audio frequency and video need not be removed again,
Go some analysis time etc. to operate again, just can determine that audio frequency and video have an exception, thus improve the abnormal efficiency determined of audio frequency and video and
Intelligent.
Further, current play time point is increased prefixed time interval by described terminal, redirects the time described in obtaining
Point, and store and described in record, redirect time point, it is easy to equally described in follow-up jumping to redirect in time point, re-starts sound and regard
The decoding of frequency and broadcasting, increase prefixed time interval, is the equal of a bit of nonsynchronous audio frequency and video in the middle of having abandoned.Certainly,
Described prefixed time interval should be a smaller numerical value, and such as 0.5 second, these were just avoided that audio frequency and video fragment abandoned
Many.
In the present embodiment, during decoding limit, described audio-video document limit is play, detect decoded audio frequency in real time
Whether the time shaft of fragment and video segment aligns, when the time shaft of audio fragment and video segment does not align, and will be abnormal
Data Labels position is set to described preset value, and current play time point is increased prefixed time interval, during to redirect described in obtaining
Between point, it is simple to subsequent terminal is when playing audio-video, and the broadcasting quickly performing audio frequency and video adjusts so that audio frequency and video phonotape and videotape synchronizes
Efficiency improves, and the intelligent of audio and video playing is also improved.
Further, in order to improve the motility of audio and video playing, based on first or second embodiments, sound of the present invention is proposed
3rd embodiment of video broadcasting method, in the present embodiment, with reference to Fig. 3, after described step S30, described audio and video playing
Method also includes:
Step S60, removes the described preset value of described abnormal data flag bit, and redirects time point described in removing.
In the present embodiment, when terminal can with normal play audio frequency and video time, can be corresponding by described abnormal data flag bit
Described preset value be purged, it is therefore prevented that during normal play audio frequency and video, due to the described preset value of abnormal data flag bit, right
The misleading that audio and video playing causes.Meanwhile, described in removing, redirect time point, effectively release taking of memory space, improve
The motility of audio and video playing.
The present invention further provides a kind of audio-video frequency playing system.
With reference to the high-level schematic functional block diagram that Fig. 4, Fig. 4 are audio-video frequency playing system preferred embodiment of the present invention.
It is emphasized that it will be apparent to those skilled in the art that functional block diagram shown in Fig. 4 is only a preferable reality
Executing the exemplary plot of example, those skilled in the art, around the functional module of the audio-video frequency playing system shown in Fig. 4, can be carried out easily
Supplementing of new functional module;The title of each functional module is self-defined title, is only used for auxiliary and understands this audio and video playing system
Each program function block of system, is not used in restriction technical scheme, and the core of technical solution of the present invention is, each self-defined
The function that the functional module of title is to be reached.
In the present embodiment, described audio-video frequency playing system includes:
Acquisition module 10, during playing on decoding limit, audio-video document limit, if detecting and being currently played
Audio frequency and video abnormal, then obtain the time point that the video of current decoding is corresponding;
In the present embodiment, decoding limit, described audio-video document limit is play, and specifically terminal first decodes a part of audio frequency and video,
Then the audio frequency and video after broadcast decoder, and during audio frequency and video after broadcast decoder, continue the remainder of decoding audio-video document.
During decoding limit, audio-video document limit is play, if detecting, the audio frequency and video being currently played have exception, then obtain mould
Block 10 obtains the time point that the current audio frequency and video just decoded are corresponding.It should be noted that the sound that described detection is currently played
The mode of video exception includes:
A, mode one, described audio-video frequency playing system include:
Separation module, for isolating the Voice & Video that the audio frequency and video being currently played are corresponding;
Determine module, for determining the isolated Voice & Video time point at synchronization;
Described determine module, if it is different at the time point of synchronization to be additionally operable to Voice & Video, it may be determined that current the most
The audio frequency and video play are abnormal.
Wherein, synchronization represents the concrete time, such as 10 points;Time point represent that audio or video plays concrete time
Between, as play 12 points whole, or 12 points 25 seconds.
It should be noted that audio-video document becomes audio file from voice data stream encryption, become from encoding video frequency data flow
During video file, all have recorded the time point of correspondence, and, in the same frame picture of same audio-video document, image and sound
Frequency the most mutually meet, time point as corresponding in a certain two field picture be 12 points 12 seconds, the audio frequency mated with this two field picture is also
Be 12 points 12 seconds, follow-up play these audio frequency and video time, could phonotape and videotape synchronize.Although existing audio and video playing process, meeting
Audio-video nonsynchronous problem occurs, but the audio frequency of the image and another picture being also due to a picture occurs, causes simultaneously
Phonotape and videotape is asynchronous.Therefore, existing phonotape and videotape is asynchronous, and the actually time shaft of Voice & Video does not align, and time shaft goes out
Having showed deviation causes phonotape and videotape asynchronous, but, the time point not change that Voice & Video is actual.Therefore, if audio frequency and regarding
Frequency, in the same time point difference playing the moment, i.e. can determine that the audio frequency and video being currently played are abnormal.
B, mode two, described audio-video frequency playing system include:
Whether judge module, be pre-for judging abnormal data flag bit corresponding to the described audio frequency and video that are currently played
If during value;
Determine module, if being preset value for the abnormal data flag bit that the described audio frequency and video that are currently played are corresponding,
Then determine that the described audio frequency and video being currently played are abnormal.
In the present embodiment, terminal, during decoding limit, audio-video document limit is play, can detect in real time or regularly
The just Voice & Video in the audio frequency and video of decoding, when Voice & Video is when the time point of synchronization is inconsistent, it is believed that described
Audio frequency and video are abnormal, and abnormal data flag bit is set to preset value, and described preset value is configured, the most as the case may be
Limit, such as, be set to 1.
If terminal is the Voice & Video in the audio frequency and video of the just decoding of detection in real time, then the sound in audio frequency and video being detected
Abnormal data flag bit, when the time point of synchronization is inconsistent, can be set to preset value by frequency and video, and by described different
Regular data flag bit associates storage with these audio frequency and video, follow-up when being played to these audio frequency and video, if abnormal data flag bit being detected
For preset value, can directly determine that the described audio frequency and video being currently played are abnormal.Certainly, in this case, one has audio frequency and regards
Frequency the most inconsistent at the time point of synchronization, the time point of the follow-up Voice & Video ined succession may all can be inconsistent, therefore, also
Directly described abnormal data flag bit can be associated storage with follow-up audio frequency and video.Until the video obtaining current decoding is corresponding
Time point, and jump to the audio-video document position, described time point place obtained, audio file and video file are carried out
Decoding, just removes the preset value of above-mentioned abnormal data flag bit.
If terminal is the Voice & Video in the audio frequency and video of timing detection just decoding, then can be by described abnormal data mark
Will position associates storage with the audio frequency and video of timing detection, the Voice & Video time point at synchronization of audio frequency and video detected every time
Inconsistent, just described abnormal data flag bit is associated storage with the audio frequency and video detected.Follow-up, when being played to audio frequency and video,
If detecting, abnormal data flag bit is preset value, can directly determine that the audio frequency and video of broadcasting are abnormal.
In the present embodiment, owing to the numerical value of abnormal data flag bit is just to marked when audio/video decoding, follow-up
During audio and video playing, i.e. can determine that audio frequency and video are the most abnormal according to the value of abnormal data flag bit, and do not spend proposition audio frequency and video
Voice & Video, then go analysis time point the most identical, shorten the audio frequency and video abnormal time determined, effectively raise sound
The abnormal efficiency determined of video, and also improve the intelligent of audio and video playing, therefore, in the present embodiment, it is preferred to use side
Formula two determines that the audio frequency and video being currently played are the most abnormal.
In the present embodiment, during decoding limit, audio-video document limit is play, preferably to the sound being currently played
Video detects, and the mode of described detection can be detection in real time, it is also possible to is timing detection, is currently played with detection
Audio frequency and video whether abnormal, if detecting, the audio frequency and video play are abnormal, and now, acquisition module 10 obtains regarding of current decoding
The time point that frequency is corresponding, namely obtains the time point that the video of just decoding is corresponding, follow-up can adjust according to the time point of this video
The time point of whole audio frequency, so that the time point of video is Tong Bu at the time point of synchronization with audio frequency, as when 10:00, if
The time point that video is corresponding is 25:00, and the time point that audio frequency is corresponding should also be 25:00, so could keep the same of audio frequency and video
Step is play, and wherein, when described 25:00 represents audio frequency and video normal play to this position, needs 25 minutes.
Redirect module 20, for being default when redirecting time point at the described time point obtained, jump to the institute obtained
State audio-video document position, time point place;
Decoder module 30, for being decoded audio file and video file;
In the present embodiment, after acquisition module 10 obtains described time point, by described time point with preset when redirecting
Between point compare, with determine described time point with preset to redirect time point the most identical, if the described time point obtained and
Preset to redirect time point identical, then redirect the audio-video document position, described time point place that module 20 jumps directly to obtain
Putting, audio file and video file are decoded by decoder module 30.
If it is, of course, understood that the described time point that acquisition module 10 obtains is not default to redirect time point, then
Decoder module 30 may proceed to decode video, until the time point of the video of decoding is with default to redirect time point consistent.
In the present embodiment, described audio-video frequency playing system also includes:
Adjusting module, for redirecting, described, the audio-video document position, described time point place that module 20 jumps to obtain
Put, while audio file and video file are decoded, adjust the time of audio file according to the described time point obtained
Point, so that described audio file aligns with the time shaft of described video file.
It is to say, be default when redirecting time point at time point corresponding to video obtaining decoding, now, adjust mould
The time point of audio file, according to the described time point obtained, is adjusted by tuber, so that described audio file and described video
The time shaft alignment of file, say, that synchronization, video correspondence 25:00, audio frequency also will be corresponding to 25:00;Video is corresponding
During 29:00, audio frequency also will be corresponding to 29:00.
Playing module 40, for the audio frequency and video after the described time point broadcast decoder obtained.
In the present embodiment, audio file and video file are decoded by decoder module 30, are exactly from same in fact
Time point starts, and is decoded audio file and video file, then in decoded audio frequency and video, the time of Voice & Video
Axle is the most consistent, and follow-up play module 40 can be from the audio frequency and video after the described time point broadcast decoder obtained so that finally broadcast
The audio frequency and video phonotape and videotape put synchronizes.
In the present embodiment, the audio frequency and video after playing module 40 broadcast decoder, display can be played out at the display screen of terminal,
Can also export and play out display to other display device.
In the present embodiment, can be in the decoding playing process of whole audio-video document, perform aforesaid operations, it is also possible to
Being in audio-video document, the audio-video document extracting part is decoded playing process, in the audio, video data solution extracted
Code success, and after having play the audio frequency and video fragment of default ratio, just continuation proceeds above-mentioned solution in audio-video document
Code play operation.
The audio-video frequency playing system that the present embodiment proposes, when the audio frequency and video exception being currently played being detected, obtains
The time point that the video of current decoding is corresponding, is then default when redirecting time point at the described time point obtained, jumps to
The audio-video document position, described time point place obtained, is decoded audio file and video file, and from the institute obtained
State the audio frequency and video after time point broadcast decoder, it is achieved that in decoded audio frequency and video, audio fragment and the time point of video segment
Keep consistent so that the audio frequency and video of final output also keep phonotape and videotape synchronization.
Further, in order to improve the intelligent of audio and video playing, propose audio frequency and video of the present invention based on first embodiment and broadcast
Second embodiment of place system, in the present embodiment, with reference to Fig. 5, described audio-video frequency playing system also includes:
Detection module 50, during playing on decoding limit, audio-video document limit, detects decoded audio frequency in real time
Whether the time shaft of fragment and video segment aligns;
Processing module 60, for when the time shaft of audio fragment and video segment does not align, by abnormal data mark
Position is set to described preset value, and current play time point is increased prefixed time interval, redirects time point described in obtaining.
In the present embodiment, during decoding limit, audio-video document limit is play, detection module 50 detects decoding in real time
After audio fragment and the time shaft of video segment whether align, say, that detection module 50 detects decoded audio frequency sheet
Section is the most consistent at two time points that each moment is corresponding with video segment, if audio fragment and the time shaft of video segment
Alignment, the most decoded audio fragment and video segment be not the most consistent at two time points that some moment is corresponding.This
Time, it is believed that these audio frequency and video have abnormal, occur in that audio-video nonsynchronous problem, and processing module 60 can be first to abnormal audio frequency sheet
Section and video segment process, and described processing mode includes: audio fragment and video segment are sorted out, then will be abnormal
Data Labels position is set to described preset value.It has been noted that described preset value is configured as the case may be in first embodiment,
Concrete numerical value does not limits, and after having set abnormal data flag bit, processing module 60 is by described abnormal data flag bit
Associate with the audio fragment after classification and video segment, it is simple to subsequent terminal is when playing audio-video, according to described exception
Data Labels position can quickly determine that audio frequency and video have exception, and performs the regulation operation of corresponding time shaft.And need not go again to extract
Go out the Voice & Video in audio frequency and video, then go some analysis time etc. to operate, just can determine that audio frequency and video have exception, thus improve
The abnormal efficiency determined of audio frequency and video and intelligent.
Further, current play time point is increased prefixed time interval by processing module 60, during to redirect described in obtaining
Between point, and store and described in record, redirect time point, be easy to equally described in follow-up jumping to redirect in time point, re-start sound
The decoding of video and broadcasting, increase prefixed time interval, is the equal of a bit of nonsynchronous audio frequency and video in the middle of having abandoned.When
So, described prefixed time interval should be a smaller numerical value, and such as 0.5 second, these were just avoided that audio frequency and video fragment abandons
Too much.
In the present embodiment, during decoding limit, described audio-video document limit is play, detect decoded audio frequency in real time
Whether the time shaft of fragment and video segment aligns, when the time shaft of audio fragment and video segment does not align, and will be abnormal
Data Labels position is set to described preset value, and current play time point is increased prefixed time interval, during to redirect described in obtaining
Between point, it is simple to subsequent terminal is when playing audio-video, and the broadcasting quickly performing audio frequency and video adjusts so that audio frequency and video phonotape and videotape synchronizes
Efficiency improves, and the intelligent of audio and video playing is also improved.
Further, in order to improve the motility of audio and video playing, based on first or second embodiments, sound of the present invention is proposed
3rd embodiment of audio/video player system, in the present embodiment, with reference to Fig. 6, described audio-video frequency playing system also includes:
Remove module 70, for removing the described preset value of described abnormal data flag bit, and redirect the time described in removing
Point.
In the present embodiment, when terminal can with normal play audio frequency and video time, remove module 70 can be by described abnormal data
The described preset value that flag bit is corresponding is purged, it is therefore prevented that during normal play audio frequency and video, due to the institute of abnormal data flag bit
State preset value, the misleading that audio and video playing is caused.Meanwhile, remove module 70 remove described in redirect time point, effectively discharge
Taking of memory space, improves the motility of audio and video playing.
It should be noted that in this article, term " includes ", " comprising " or its other variant any are intended to non-row
Comprising of his property, so that include that the process of a series of key element, method, article or device not only include those key elements, and
And also include other key element being not expressly set out, or also include intrinsic for this process, method, article or device
Key element.In the case of there is no more restriction, statement " including ... " key element limited, it is not excluded that including this
The process of key element, method, article or device there is also other identical element.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
These are only the preferred embodiments of the present invention, not thereby limit the scope of the claims of the present invention, every utilize this
Equivalent structure or equivalence flow process that bright description and accompanying drawing content are made convert, or are directly or indirectly used in other relevant skill
Art field, is the most in like manner included in the scope of patent protection of the present invention.
Claims (10)
1. an audio and video playing method, it is characterised in that described audio and video playing method includes:
During decoding limit, audio-video document limit is play, if detecting, the audio frequency and video being currently played are abnormal, then obtain
The time point that the current video decoded is corresponding;
It is default when redirecting time point at the described time point obtained, jumps to the described time point place audio frequency and video literary composition obtained
Part position, is decoded audio file and video file;
Audio frequency and video after the described time point broadcast decoder obtained.
2. audio and video playing method as claimed in claim 1, it is characterised in that described in detect that the sound being currently played regards
The step of frequency exception includes:
Judge when whether abnormal data flag bit corresponding to the described audio frequency and video that are currently played is preset value;
If abnormal data flag bit corresponding to the described audio frequency and video being currently played is preset value, it is determined that be currently played
Described audio frequency and video abnormal.
3. audio and video playing method as claimed in claim 2, it is characterised in that described in jump to the described time point institute that obtains
In audio-video document position, while audio file and video file are decoded, execution following steps:
The time point of audio file is adjusted according to the described time point obtained, so that described audio file and described video file
Time shaft aligns.
4. audio and video playing method as claimed in claim 2, it is characterised in that described audio and video playing method also includes:
During decoding limit, audio-video document limit is play, detect decoded audio fragment and the time of video segment in real time
Whether axle aligns;
When the time shaft of audio fragment and video segment does not align, abnormal data flag bit is set to described preset value, and
Current play time point is increased prefixed time interval, described in obtaining, redirects time point.
5. the audio and video playing method as described in any one of claim 1-4, it is characterised in that described from the described time obtained
After point plays the step of decoded audio frequency and video, described audio and video playing method also includes:
Remove the described preset value of described abnormal data flag bit, and redirect time point described in removing.
6. an audio-video frequency playing system, it is characterised in that described audio-video frequency playing system includes:
Acquisition module, during playing on decoding limit, audio-video document limit, if detecting, the sound being currently played regards
Frequency is abnormal, then obtain the time point that the video of current decoding is corresponding;
Redirect module, for being default when redirecting time point at the described time point obtained, jump to the described time obtained
Point audio-video document position, place;
Decoder module, for being decoded audio file and video file;
Playing module, for the audio frequency and video after the described time point broadcast decoder obtained.
7. audio-video frequency playing system as claimed in claim 6, it is characterised in that described audio-video frequency playing system includes:
Whether judge module, be preset value for judging abnormal data flag bit corresponding to the described audio frequency and video that are currently played
Time;
Determine module, if being preset value for the abnormal data flag bit that the described audio frequency and video that are currently played are corresponding, the most really
Surely the described audio frequency and video being currently played are abnormal.
8. audio-video frequency playing system as claimed in claim 7, it is characterised in that described audio-video frequency playing system also includes:
Adjusting module, for redirecting the audio-video document position, described time point place that module jumps to obtain, to sound described
While frequency file and video file are decoded, adjust the time point of audio file according to the described time point obtained, so that
Described audio file aligns with the time shaft of described video file.
9. audio-video frequency playing system as claimed in claim 7, it is characterised in that described audio-video frequency playing system also includes:
Detection module, during playing on decoding limit, audio-video document limit, detect in real time decoded audio fragment and
Whether the time shaft of video segment aligns;
Processing module, for when the time shaft of audio fragment and video segment does not align, is set to abnormal data flag bit
Described preset value, and current play time point is increased prefixed time interval, described in obtaining, redirect time point.
10. the audio-video frequency playing system as described in any one of claim 6-9, it is characterised in that described audio-video frequency playing system
Also include:
Remove module, for removing the described preset value of described abnormal data flag bit, and redirect time point described in removing.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610671231.4A CN106210846A (en) | 2016-08-15 | 2016-08-15 | Audio and video playing method and system |
PCT/CN2016/112238 WO2018032680A1 (en) | 2016-08-15 | 2016-12-27 | Method and system for playing audio and video |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610671231.4A CN106210846A (en) | 2016-08-15 | 2016-08-15 | Audio and video playing method and system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106210846A true CN106210846A (en) | 2016-12-07 |
Family
ID=57522376
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610671231.4A Pending CN106210846A (en) | 2016-08-15 | 2016-08-15 | Audio and video playing method and system |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN106210846A (en) |
WO (1) | WO2018032680A1 (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107454471A (en) * | 2017-07-07 | 2017-12-08 | 深圳Tcl数字技术有限公司 | Method for turning on television, television set and computer-readable recording medium |
WO2018032680A1 (en) * | 2016-08-15 | 2018-02-22 | 深圳Tcl新技术有限公司 | Method and system for playing audio and video |
WO2018171567A1 (en) * | 2017-03-21 | 2018-09-27 | 华为技术有限公司 | Method, server, and terminal for playing back media stream |
CN110505476A (en) * | 2019-09-02 | 2019-11-26 | 图普科技(广州)有限公司 | Camera management-control method, device and electronic equipment |
CN111488244A (en) * | 2020-04-07 | 2020-08-04 | 广州虎牙科技有限公司 | Editing abnormity recovery method and device, electronic equipment and storage medium |
CN111526374A (en) * | 2019-02-01 | 2020-08-11 | 广州虎牙信息科技有限公司 | Live broadcast-based bullet screen processing method, stream pulling method and device |
CN112911365A (en) * | 2021-02-02 | 2021-06-04 | 卡莱特云科技股份有限公司 | Audio synchronous playing method and device |
CN113242437A (en) * | 2021-04-01 | 2021-08-10 | 联通(广东)产业互联网有限公司 | RTSP (real time streaming protocol) video plug-in-free playing method, system, device and storage medium |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116233472B (en) * | 2023-05-08 | 2023-07-18 | 湖南马栏山视频先进技术研究院有限公司 | Audio and video synchronization method and cloud processing system |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6803964B1 (en) * | 1997-03-21 | 2004-10-12 | International Business Machines Corporation | Method and apparatus for processing digital data |
CN101394469A (en) * | 2008-10-29 | 2009-03-25 | 北京创毅视讯科技有限公司 | Audio and video synchronization method, device and a digital television chip |
CN102110458A (en) * | 2009-12-24 | 2011-06-29 | Tcl集团股份有限公司 | Playing terminal as well as method and device for playing an audio/video file |
CN103338386A (en) * | 2013-07-10 | 2013-10-02 | 航天恒星科技有限公司 | Audio and video synchronization method based on simplified timestamps |
CN105612743A (en) * | 2013-08-30 | 2016-05-25 | 微软技术许可有限责任公司 | Audio video playback synchronization for encoded media |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9143820B2 (en) * | 2012-03-25 | 2015-09-22 | Mediatek Inc. | Method for performing fluent playback control in response to decoding status, and associated apparatus |
CN106210846A (en) * | 2016-08-15 | 2016-12-07 | 深圳Tcl新技术有限公司 | Audio and video playing method and system |
-
2016
- 2016-08-15 CN CN201610671231.4A patent/CN106210846A/en active Pending
- 2016-12-27 WO PCT/CN2016/112238 patent/WO2018032680A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6803964B1 (en) * | 1997-03-21 | 2004-10-12 | International Business Machines Corporation | Method and apparatus for processing digital data |
CN101394469A (en) * | 2008-10-29 | 2009-03-25 | 北京创毅视讯科技有限公司 | Audio and video synchronization method, device and a digital television chip |
CN102110458A (en) * | 2009-12-24 | 2011-06-29 | Tcl集团股份有限公司 | Playing terminal as well as method and device for playing an audio/video file |
CN103338386A (en) * | 2013-07-10 | 2013-10-02 | 航天恒星科技有限公司 | Audio and video synchronization method based on simplified timestamps |
CN105612743A (en) * | 2013-08-30 | 2016-05-25 | 微软技术许可有限责任公司 | Audio video playback synchronization for encoded media |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018032680A1 (en) * | 2016-08-15 | 2018-02-22 | 深圳Tcl新技术有限公司 | Method and system for playing audio and video |
WO2018171567A1 (en) * | 2017-03-21 | 2018-09-27 | 华为技术有限公司 | Method, server, and terminal for playing back media stream |
CN108632681A (en) * | 2017-03-21 | 2018-10-09 | 华为软件技术有限公司 | Play method, server and the terminal of Media Stream |
CN107454471A (en) * | 2017-07-07 | 2017-12-08 | 深圳Tcl数字技术有限公司 | Method for turning on television, television set and computer-readable recording medium |
CN111526374A (en) * | 2019-02-01 | 2020-08-11 | 广州虎牙信息科技有限公司 | Live broadcast-based bullet screen processing method, stream pulling method and device |
CN110505476A (en) * | 2019-09-02 | 2019-11-26 | 图普科技(广州)有限公司 | Camera management-control method, device and electronic equipment |
CN111488244A (en) * | 2020-04-07 | 2020-08-04 | 广州虎牙科技有限公司 | Editing abnormity recovery method and device, electronic equipment and storage medium |
CN112911365A (en) * | 2021-02-02 | 2021-06-04 | 卡莱特云科技股份有限公司 | Audio synchronous playing method and device |
CN112911365B (en) * | 2021-02-02 | 2024-03-29 | 卡莱特云科技股份有限公司 | Audio synchronous playing method and device |
CN113242437A (en) * | 2021-04-01 | 2021-08-10 | 联通(广东)产业互联网有限公司 | RTSP (real time streaming protocol) video plug-in-free playing method, system, device and storage medium |
Also Published As
Publication number | Publication date |
---|---|
WO2018032680A1 (en) | 2018-02-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106210846A (en) | Audio and video playing method and system | |
JP4292654B2 (en) | Recording apparatus and method, reproducing apparatus and method, and recording medium | |
JP4403432B2 (en) | Recording / reproducing apparatus and recording / reproducing method | |
CN105979347A (en) | Video play method and device | |
KR20070052554A (en) | Apparatus and method for image displaying | |
US7149365B2 (en) | Image information summary apparatus, image information summary method and image information summary processing program | |
CN102265609A (en) | Program data processing device, method, and program | |
CN102469309B (en) | Image processing method | |
US6415100B1 (en) | Apparatus and method for sub-picture encoding | |
CN103491430B (en) | Streaming medium data processing method and electronic equipment | |
KR20170067546A (en) | System and method for audio signal and a video signal synchronization | |
US20140047309A1 (en) | Apparatus and method for synchronizing content with data | |
JP2016103714A (en) | Video recording and reproducing device | |
JP2007504753A (en) | Auxiliary information processing system | |
KR100598360B1 (en) | Apparatus to reduce an image display delay time in channel conversion and method thereof | |
JP2009159483A (en) | Broadcast receiver | |
KR101294383B1 (en) | Method and apparatus to setting book mark of image display device | |
JP2005277984A (en) | Receiving terminal | |
JP2008053991A (en) | Digital broadcast receiver | |
US20060182423A1 (en) | Data processing device | |
KR101208612B1 (en) | The identifying system for filtering program except formality program in real time on television broadcasting and the method thereof | |
KR20030080984A (en) | Multimedia data decoder | |
KR100785173B1 (en) | Control apparatus and method for recording of a digital broadcasting receiver | |
JP2009065596A (en) | Summary video generating apparatus and program | |
JP2007027880A (en) | Digital broadcast storage and reproduction method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161207 |