CN106210846A - Audio and video playing method and system - Google Patents

Audio and video playing method and system Download PDF

Info

Publication number
CN106210846A
CN106210846A CN201610671231.4A CN201610671231A CN106210846A CN 106210846 A CN106210846 A CN 106210846A CN 201610671231 A CN201610671231 A CN 201610671231A CN 106210846 A CN106210846 A CN 106210846A
Authority
CN
China
Prior art keywords
video
audio
time point
frequency
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610671231.4A
Other languages
Chinese (zh)
Inventor
柯杰燕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen TCL New Technology Co Ltd
Original Assignee
Shenzhen TCL New Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen TCL New Technology Co Ltd filed Critical Shenzhen TCL New Technology Co Ltd
Priority to CN201610671231.4A priority Critical patent/CN106210846A/en
Publication of CN106210846A publication Critical patent/CN106210846A/en
Priority to PCT/CN2016/112238 priority patent/WO2018032680A1/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8547Content authoring involving timestamps for synchronizing content

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The invention discloses a kind of audio and video playing method, described audio and video playing method includes: during decoding limit, audio-video document limit is play, if detecting, the audio frequency and video being currently played are abnormal, then obtain the time point that the video of current decoding is corresponding;It is default when redirecting time point at the described time point obtained, jumps to the audio-video document position, described time point place obtained, audio file and video file are decoded;Audio frequency and video after the described time point broadcast decoder obtained.The invention also discloses a kind of audio-video frequency playing system.The present invention maintains the phonotape and videotape synchronization of audio and video playing.

Description

Audio and video playing method and system
Technical field
The present invention relates to audio and video playing field, particularly relate to a kind of audio and video playing method and system.
Background technology
At present, audio and video playing has been the function that the equipment such as TV are indispensable, and user, when playing audio-video, sends out sometimes Existing image and sound occur abnormal, i.e. image is asynchronous with sound, and as personage has begun to speech, but sound does not the most go out Coming, or sound is out, personage does not also start to speech, and such user seems the most awkward.
Producing the reason that phonotape and videotape is abnormal, the instrument made mainly due to audio frequency and video is various, and the sound compiled regards Frequency file is the most different, the most non-compliant.Consequently, it is possible to TV easily creates mistake when audio/video decoding By mistake, some Frame is skipped, so that time shaft when image is play with sound is the most right such as image or sound when decoding Together, result in audio-video nonsynchronous problem.
Summary of the invention
Present invention is primarily targeted at a kind of audio and video playing method and system of proposition, it is intended to solve traditional audio frequency and video , easily there is audio-video nonsynchronous technical problem in broadcast mode.
For achieving the above object, a kind of audio and video playing method that the present invention provides, described audio and video playing method includes:
During decoding limit, audio-video document limit is play, if detecting, the audio frequency and video being currently played are abnormal, then Obtain the time point that the video of current decoding is corresponding;
Being default when redirecting time point at the described time point obtained, the described time point place sound jumping to obtain regards Frequency file position, is decoded audio file and video file;
Audio frequency and video after the described time point broadcast decoder obtained.
Preferably, detect described in that the step that the audio frequency and video being currently played are abnormal includes:
Judge when whether abnormal data flag bit corresponding to the described audio frequency and video that are currently played is preset value;
If abnormal data flag bit corresponding to the described audio frequency and video being currently played is preset value, it is determined that current the most The described audio frequency and video play are abnormal.
Preferably, described in jump to obtain audio-video document position, described time point place, to audio file and video While file is decoded, execution following steps:
The time point of audio file is adjusted according to the described time point obtained, so that described audio file and described video literary composition The time shaft alignment of part.
Preferably, described audio and video playing method also includes:
During decoding limit, audio-video document limit is play, detect in real time decoded audio fragment and video segment Whether time shaft aligns;
When the time shaft of audio fragment and video segment does not align, abnormal data flag bit is set to described presetting Value, and current play time point is increased prefixed time interval, described in obtaining, redirect time point.
Preferably, after the step of described audio frequency and video after the described time point broadcast decoder obtained, described audio frequency and video Player method also includes:
Remove the described preset value of described abnormal data flag bit, and redirect time point described in removing.
Additionally, for achieving the above object, the present invention also proposes a kind of audio-video frequency playing system, described audio-video frequency playing system Including:
Acquisition module, during playing on audio-video document limit decoding limit, is currently played if detecting Audio frequency and video are abnormal, then obtain the time point that the video of current decoding is corresponding;
Redirecting module, for being default when redirecting time point at the described time point obtained, jump to obtain is described Audio-video document position, time point place;
Decoder module, for being decoded audio file and video file;
Playing module, for the audio frequency and video after the described time point broadcast decoder obtained.
Preferably, described audio-video frequency playing system includes:
Whether judge module, be pre-for judging abnormal data flag bit corresponding to the described audio frequency and video that are currently played If during value;
Determine module, if being preset value for the abnormal data flag bit that the described audio frequency and video that are currently played are corresponding, Then determine that the described audio frequency and video being currently played are abnormal.
Preferably, described audio-video frequency playing system also includes:
Adjusting module, for redirecting, described, the audio-video document position, described time point place that module jumps to obtain, While audio file and video file are decoded, adjust the time point of audio file according to the described time point obtained, So that described audio file aligns with the time shaft of described video file.
Preferably, described audio-video frequency playing system also includes:
Detection module, during playing on decoding limit, audio-video document limit, detects decoded audio frequency sheet in real time Whether the time shaft of section and video segment aligns;
Processing module, for when the time shaft of audio fragment and video segment does not align, by abnormal data flag bit It is set to described preset value, and current play time point is increased prefixed time interval, described in obtaining, redirect time point.
Preferably, described audio-video frequency playing system also includes:
Remove module, for removing the described preset value of described abnormal data flag bit, and redirect time point described in removing.
The audio and video playing method and system that the present invention proposes, when the audio frequency and video exception being currently played being detected, Obtain the time point that the video of current decoding is corresponding, be then default when redirecting time point at the described time point obtained, jump Go to the audio-video document position, described time point place obtained, audio file and video file are decoded, and from acquisition Described time point broadcast decoder after audio frequency and video, it is achieved that in decoded audio frequency and video, audio fragment and video segment time Between point keep consistent so that the audio frequency and video of final output also keep phonotape and videotape synchronization.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of audio and video playing method first embodiment of the present invention;
Fig. 2 is the schematic flow sheet of audio and video playing method the second embodiment of the present invention;
Fig. 3 is the schematic flow sheet of audio and video playing method the 3rd embodiment of the present invention;
Fig. 4 is the high-level schematic functional block diagram of audio-video frequency playing system first embodiment of the present invention;
Fig. 5 is the high-level schematic functional block diagram of audio-video frequency playing system the second embodiment of the present invention;
Fig. 6 is the high-level schematic functional block diagram of audio-video frequency playing system the 3rd embodiment of the present invention.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further referring to the drawings.
Detailed description of the invention
Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.
The present invention provides a kind of audio and video playing method.
With reference to the schematic flow sheet that Fig. 1, Fig. 1 are audio and video playing method first embodiment of the present invention.
In the present embodiment, described audio and video playing method includes:
Step S10, during decoding limit, audio-video document limit is play, if detecting the audio frequency and video being currently played Abnormal, then obtain the time point that the video of current decoding is corresponding;
In the present embodiment, decoding limit, described audio-video document limit is play, and specifically terminal first decodes a part of audio frequency and video, Then the audio frequency and video after broadcast decoder, and during audio frequency and video after broadcast decoder, continue the remainder of decoding audio-video document. During decoding limit, audio-video document limit is play, if detecting, the audio frequency and video being currently played have exception, then obtain and work as The time point that the front audio frequency and video just decoded are corresponding.Detect described in it should be noted that the audio frequency and video being currently played are abnormal Mode include:
A, mode one, isolate the Voice & Video that the audio frequency and video being currently played are corresponding, determine isolated audio frequency With video at the time point of synchronization, if Voice & Video is different at the time point of synchronization, it may be determined that currently broadcast The audio frequency and video put are abnormal.
Wherein, synchronization represents the concrete time, such as 10 points;Time point represent that audio or video plays concrete time Between, as play 12 points whole, or 12 points 25 seconds.
It should be noted that audio-video document becomes audio file from voice data stream encryption, become from encoding video frequency data flow During video file, all have recorded the time point of correspondence, and, in the same frame picture of same audio-video document, image and sound Frequency the most mutually meet, time point as corresponding in a certain two field picture be 12 points 12 seconds, the audio frequency mated with this two field picture is also Be 12 points 12 seconds, follow-up play these audio frequency and video time, could phonotape and videotape synchronize.Although existing audio and video playing process, meeting Audio-video nonsynchronous problem occurs, but the audio frequency of the image and another picture being also due to a picture occurs, causes simultaneously Phonotape and videotape is asynchronous.Therefore, existing phonotape and videotape is asynchronous, and the actually time shaft of Voice & Video does not align, and time shaft goes out Having showed deviation causes phonotape and videotape asynchronous, but, the time point not change that Voice & Video is actual.Therefore, if audio frequency and regarding Frequency, in the same time point difference playing the moment, i.e. can determine that the audio frequency and video being currently played are abnormal.
B, mode two, judge whether abnormal data flag bit corresponding to the described audio frequency and video that are currently played is preset value Time;
If abnormal data flag bit corresponding to the described audio frequency and video being currently played is preset value, it is determined that current the most The described audio frequency and video play are abnormal.
In the present embodiment, terminal, during decoding limit, audio-video document limit is play, can detect in real time or regularly The just Voice & Video in the audio frequency and video of decoding, when Voice & Video is when the time point of synchronization is inconsistent, it is believed that described Audio frequency and video are abnormal, and abnormal data flag bit is set to preset value, and described preset value is configured, the most as the case may be Limit, such as, be set to 1.
If terminal is the Voice & Video in the audio frequency and video of the just decoding of detection in real time, then the sound in audio frequency and video being detected Abnormal data flag bit, when the time point of synchronization is inconsistent, can be set to preset value by frequency and video, and by described different Regular data flag bit associates storage with these audio frequency and video, follow-up when being played to these audio frequency and video, if abnormal data flag bit being detected For preset value, can directly determine that the described audio frequency and video being currently played are abnormal.Certainly, in this case, one has audio frequency and regards Frequency the most inconsistent at the time point of synchronization, the time point of the follow-up Voice & Video ined succession may all can be inconsistent, therefore, also Directly described abnormal data flag bit can be associated storage with follow-up audio frequency and video.Until the video obtaining current decoding is corresponding Time point, and jump to the audio-video document position, described time point place obtained, audio file and video file are carried out Decoding, just removes the preset value of above-mentioned abnormal data flag bit.
If terminal is the Voice & Video in the audio frequency and video of timing detection just decoding, then can be by described abnormal data mark Will position associates storage with the audio frequency and video of timing detection, the Voice & Video time point at synchronization of audio frequency and video detected every time Inconsistent, just described abnormal data flag bit is associated storage with the audio frequency and video detected.Follow-up, when being played to audio frequency and video, If detecting, abnormal data flag bit is preset value, can directly determine that the audio frequency and video of broadcasting are abnormal.
In the present embodiment, owing to the numerical value of abnormal data flag bit is just to marked when audio/video decoding, follow-up During audio and video playing, i.e. can determine that audio frequency and video are the most abnormal according to the value of abnormal data flag bit, and do not spend proposition audio frequency and video Voice & Video, then go analysis time point the most identical, shorten the audio frequency and video abnormal time determined, effectively raise sound The abnormal efficiency determined of video, and also improve the intelligent of audio and video playing, therefore, in the present embodiment, it is preferred to use side Formula two determines that the audio frequency and video being currently played are the most abnormal.
In the present embodiment, during decoding limit, audio-video document limit is play, preferably to the sound being currently played Video detects, and the mode of described detection can be detection in real time, it is also possible to is timing detection, is currently played with detection Audio frequency and video whether abnormal, if detecting, the audio frequency and video play are abnormal, now, obtain the video of current decoding corresponding time Between point, namely obtain the time point that the video of just decoding is corresponding, follow-up can according to the time point of this video, adjust audio frequency time Between point so that the time point of video is Tong Bu at the time point of synchronization with audio frequency, as when 10:00, if video is corresponding Time point is 25:00, and the time point that audio frequency is corresponding should also be 25:00, and the synchronization of audio frequency and video so could be kept to play, its In, when described 25:00 represents audio frequency and video normal play to this position, need 25 minutes.
Step S20, is default when redirecting time point at the described time point obtained, jumps to the described time point obtained Audio-video document position, place, is decoded audio file and video file;
In the present embodiment, after obtaining described time point, described time point is compared with the default time point that redirects Right, with determine described time point with preset to redirect time point the most identical, if the described time point obtained redirects with default Time point is identical, then jump directly to the audio-video document position, described time point place obtained, to audio file and video literary composition Part is decoded.
If it is, of course, understood that the described time point obtained is not default to redirect time point, the most described terminal meeting Continue decoding video, until the time point of the video of decoding is with default to redirect time point consistent.
In the present embodiment, described execution " jumps to the audio-video document position, described time point place obtained, to audio frequency File and video file are decoded " while, execution following steps:
The time point of audio file is adjusted according to the described time point obtained, so that described audio file and described video literary composition The time shaft alignment of part.
It is to say, be default when redirecting time point, now, according to obtaining at time point corresponding to video obtaining decoding The described time point taken, is adjusted the time point of audio file so that described audio file and described video file time Countershaft aligns, say, that synchronization, video correspondence 25:00, audio frequency also will be corresponding to 25:00;Video correspondence 29:00, audio frequency Also will be corresponding to 29:00.
Step S30, the audio frequency and video after the described time point broadcast decoder obtained.
In the present embodiment, audio file and video file are decoded, are exactly from the beginning of at the same time in fact, Being decoded audio file and video file, then in decoded audio frequency and video, the time shaft of Voice & Video is the most consistent, Follow-up described terminal can be from the audio frequency and video after the described time point broadcast decoder obtained so that the final audio frequency and video phonotape and videotape play Synchronize.
In the present embodiment, the audio frequency and video after broadcast decoder, display can be played out at the display screen of terminal, it is also possible to by end End exports in other display device and plays out display.
In the present embodiment, can be in the decoding playing process of whole audio-video document, perform aforesaid operations, it is also possible to Being in audio-video document, the audio-video document extracting part is decoded playing process, in the audio, video data solution extracted Code success, and after having play the audio frequency and video fragment of default ratio, just continuation proceeds above-mentioned solution in audio-video document Code play operation.
The audio and video playing method that the present embodiment proposes, when the audio frequency and video exception being currently played being detected, obtains The time point that the video of current decoding is corresponding, is then default when redirecting time point at the described time point obtained, jumps to The audio-video document position, described time point place obtained, is decoded audio file and video file, and from the institute obtained State the audio frequency and video after time point broadcast decoder, it is achieved that in decoded audio frequency and video, audio fragment and the time point of video segment Keep consistent so that the audio frequency and video of final output also keep phonotape and videotape synchronization.
Further, in order to improve the intelligent of audio and video playing, propose audio frequency and video of the present invention based on first embodiment and broadcast Putting the second embodiment of method, in the present embodiment, with reference to Fig. 2, described audio and video playing method also includes:
Step S40, during decoding limit, audio-video document limit is play, detects decoded audio fragment in real time and regards Frequently whether the time shaft of fragment aligns;
Step S50, when the time shaft of audio fragment and video segment does not align, is set to institute by abnormal data flag bit State preset value, and current play time point is increased prefixed time interval, described in obtaining, redirect time point.
In the present embodiment, during decoding limit, audio-video document limit is play, after described terminal detects decoding in real time Audio fragment and the time shaft of video segment whether align, say, that detect decoded audio fragment and video segment Two time points corresponding in each moment are the most consistent, if the time shaft of audio fragment and video segment does not align, i.e. Decoded audio fragment is the most consistent at two time points that some moment is corresponding with video segment.Now, it is believed that should Audio frequency and video have abnormal, occur in that audio-video nonsynchronous problem, and described terminal can be first to abnormal audio fragment and video segment Processing, described processing mode includes: audio fragment and video segment is sorted out, is then set by abnormal data flag bit For described preset value.It has been noted that described preset value is configured as the case may be in first embodiment, concrete numerical value does not does Limit, after having set abnormal data flag bit, by described abnormal data flag bit with classification after audio fragment and regard Frequently fragment association is got up, it is simple to subsequent terminal, when playing audio-video, can quickly determine according to described abnormal data flag bit Audio frequency and video have exception, and perform the regulation operation of corresponding time shaft.And the Voice & Video extracting in audio frequency and video need not be removed again, Go some analysis time etc. to operate again, just can determine that audio frequency and video have an exception, thus improve the abnormal efficiency determined of audio frequency and video and Intelligent.
Further, current play time point is increased prefixed time interval by described terminal, redirects the time described in obtaining Point, and store and described in record, redirect time point, it is easy to equally described in follow-up jumping to redirect in time point, re-starts sound and regard The decoding of frequency and broadcasting, increase prefixed time interval, is the equal of a bit of nonsynchronous audio frequency and video in the middle of having abandoned.Certainly, Described prefixed time interval should be a smaller numerical value, and such as 0.5 second, these were just avoided that audio frequency and video fragment abandoned Many.
In the present embodiment, during decoding limit, described audio-video document limit is play, detect decoded audio frequency in real time Whether the time shaft of fragment and video segment aligns, when the time shaft of audio fragment and video segment does not align, and will be abnormal Data Labels position is set to described preset value, and current play time point is increased prefixed time interval, during to redirect described in obtaining Between point, it is simple to subsequent terminal is when playing audio-video, and the broadcasting quickly performing audio frequency and video adjusts so that audio frequency and video phonotape and videotape synchronizes Efficiency improves, and the intelligent of audio and video playing is also improved.
Further, in order to improve the motility of audio and video playing, based on first or second embodiments, sound of the present invention is proposed 3rd embodiment of video broadcasting method, in the present embodiment, with reference to Fig. 3, after described step S30, described audio and video playing Method also includes:
Step S60, removes the described preset value of described abnormal data flag bit, and redirects time point described in removing.
In the present embodiment, when terminal can with normal play audio frequency and video time, can be corresponding by described abnormal data flag bit Described preset value be purged, it is therefore prevented that during normal play audio frequency and video, due to the described preset value of abnormal data flag bit, right The misleading that audio and video playing causes.Meanwhile, described in removing, redirect time point, effectively release taking of memory space, improve The motility of audio and video playing.
The present invention further provides a kind of audio-video frequency playing system.
With reference to the high-level schematic functional block diagram that Fig. 4, Fig. 4 are audio-video frequency playing system preferred embodiment of the present invention.
It is emphasized that it will be apparent to those skilled in the art that functional block diagram shown in Fig. 4 is only a preferable reality Executing the exemplary plot of example, those skilled in the art, around the functional module of the audio-video frequency playing system shown in Fig. 4, can be carried out easily Supplementing of new functional module;The title of each functional module is self-defined title, is only used for auxiliary and understands this audio and video playing system Each program function block of system, is not used in restriction technical scheme, and the core of technical solution of the present invention is, each self-defined The function that the functional module of title is to be reached.
In the present embodiment, described audio-video frequency playing system includes:
Acquisition module 10, during playing on decoding limit, audio-video document limit, if detecting and being currently played Audio frequency and video abnormal, then obtain the time point that the video of current decoding is corresponding;
In the present embodiment, decoding limit, described audio-video document limit is play, and specifically terminal first decodes a part of audio frequency and video, Then the audio frequency and video after broadcast decoder, and during audio frequency and video after broadcast decoder, continue the remainder of decoding audio-video document. During decoding limit, audio-video document limit is play, if detecting, the audio frequency and video being currently played have exception, then obtain mould Block 10 obtains the time point that the current audio frequency and video just decoded are corresponding.It should be noted that the sound that described detection is currently played The mode of video exception includes:
A, mode one, described audio-video frequency playing system include:
Separation module, for isolating the Voice & Video that the audio frequency and video being currently played are corresponding;
Determine module, for determining the isolated Voice & Video time point at synchronization;
Described determine module, if it is different at the time point of synchronization to be additionally operable to Voice & Video, it may be determined that current the most The audio frequency and video play are abnormal.
Wherein, synchronization represents the concrete time, such as 10 points;Time point represent that audio or video plays concrete time Between, as play 12 points whole, or 12 points 25 seconds.
It should be noted that audio-video document becomes audio file from voice data stream encryption, become from encoding video frequency data flow During video file, all have recorded the time point of correspondence, and, in the same frame picture of same audio-video document, image and sound Frequency the most mutually meet, time point as corresponding in a certain two field picture be 12 points 12 seconds, the audio frequency mated with this two field picture is also Be 12 points 12 seconds, follow-up play these audio frequency and video time, could phonotape and videotape synchronize.Although existing audio and video playing process, meeting Audio-video nonsynchronous problem occurs, but the audio frequency of the image and another picture being also due to a picture occurs, causes simultaneously Phonotape and videotape is asynchronous.Therefore, existing phonotape and videotape is asynchronous, and the actually time shaft of Voice & Video does not align, and time shaft goes out Having showed deviation causes phonotape and videotape asynchronous, but, the time point not change that Voice & Video is actual.Therefore, if audio frequency and regarding Frequency, in the same time point difference playing the moment, i.e. can determine that the audio frequency and video being currently played are abnormal.
B, mode two, described audio-video frequency playing system include:
Whether judge module, be pre-for judging abnormal data flag bit corresponding to the described audio frequency and video that are currently played If during value;
Determine module, if being preset value for the abnormal data flag bit that the described audio frequency and video that are currently played are corresponding, Then determine that the described audio frequency and video being currently played are abnormal.
In the present embodiment, terminal, during decoding limit, audio-video document limit is play, can detect in real time or regularly The just Voice & Video in the audio frequency and video of decoding, when Voice & Video is when the time point of synchronization is inconsistent, it is believed that described Audio frequency and video are abnormal, and abnormal data flag bit is set to preset value, and described preset value is configured, the most as the case may be Limit, such as, be set to 1.
If terminal is the Voice & Video in the audio frequency and video of the just decoding of detection in real time, then the sound in audio frequency and video being detected Abnormal data flag bit, when the time point of synchronization is inconsistent, can be set to preset value by frequency and video, and by described different Regular data flag bit associates storage with these audio frequency and video, follow-up when being played to these audio frequency and video, if abnormal data flag bit being detected For preset value, can directly determine that the described audio frequency and video being currently played are abnormal.Certainly, in this case, one has audio frequency and regards Frequency the most inconsistent at the time point of synchronization, the time point of the follow-up Voice & Video ined succession may all can be inconsistent, therefore, also Directly described abnormal data flag bit can be associated storage with follow-up audio frequency and video.Until the video obtaining current decoding is corresponding Time point, and jump to the audio-video document position, described time point place obtained, audio file and video file are carried out Decoding, just removes the preset value of above-mentioned abnormal data flag bit.
If terminal is the Voice & Video in the audio frequency and video of timing detection just decoding, then can be by described abnormal data mark Will position associates storage with the audio frequency and video of timing detection, the Voice & Video time point at synchronization of audio frequency and video detected every time Inconsistent, just described abnormal data flag bit is associated storage with the audio frequency and video detected.Follow-up, when being played to audio frequency and video, If detecting, abnormal data flag bit is preset value, can directly determine that the audio frequency and video of broadcasting are abnormal.
In the present embodiment, owing to the numerical value of abnormal data flag bit is just to marked when audio/video decoding, follow-up During audio and video playing, i.e. can determine that audio frequency and video are the most abnormal according to the value of abnormal data flag bit, and do not spend proposition audio frequency and video Voice & Video, then go analysis time point the most identical, shorten the audio frequency and video abnormal time determined, effectively raise sound The abnormal efficiency determined of video, and also improve the intelligent of audio and video playing, therefore, in the present embodiment, it is preferred to use side Formula two determines that the audio frequency and video being currently played are the most abnormal.
In the present embodiment, during decoding limit, audio-video document limit is play, preferably to the sound being currently played Video detects, and the mode of described detection can be detection in real time, it is also possible to is timing detection, is currently played with detection Audio frequency and video whether abnormal, if detecting, the audio frequency and video play are abnormal, and now, acquisition module 10 obtains regarding of current decoding The time point that frequency is corresponding, namely obtains the time point that the video of just decoding is corresponding, follow-up can adjust according to the time point of this video The time point of whole audio frequency, so that the time point of video is Tong Bu at the time point of synchronization with audio frequency, as when 10:00, if The time point that video is corresponding is 25:00, and the time point that audio frequency is corresponding should also be 25:00, so could keep the same of audio frequency and video Step is play, and wherein, when described 25:00 represents audio frequency and video normal play to this position, needs 25 minutes.
Redirect module 20, for being default when redirecting time point at the described time point obtained, jump to the institute obtained State audio-video document position, time point place;
Decoder module 30, for being decoded audio file and video file;
In the present embodiment, after acquisition module 10 obtains described time point, by described time point with preset when redirecting Between point compare, with determine described time point with preset to redirect time point the most identical, if the described time point obtained and Preset to redirect time point identical, then redirect the audio-video document position, described time point place that module 20 jumps directly to obtain Putting, audio file and video file are decoded by decoder module 30.
If it is, of course, understood that the described time point that acquisition module 10 obtains is not default to redirect time point, then Decoder module 30 may proceed to decode video, until the time point of the video of decoding is with default to redirect time point consistent.
In the present embodiment, described audio-video frequency playing system also includes:
Adjusting module, for redirecting, described, the audio-video document position, described time point place that module 20 jumps to obtain Put, while audio file and video file are decoded, adjust the time of audio file according to the described time point obtained Point, so that described audio file aligns with the time shaft of described video file.
It is to say, be default when redirecting time point at time point corresponding to video obtaining decoding, now, adjust mould The time point of audio file, according to the described time point obtained, is adjusted by tuber, so that described audio file and described video The time shaft alignment of file, say, that synchronization, video correspondence 25:00, audio frequency also will be corresponding to 25:00;Video is corresponding During 29:00, audio frequency also will be corresponding to 29:00.
Playing module 40, for the audio frequency and video after the described time point broadcast decoder obtained.
In the present embodiment, audio file and video file are decoded by decoder module 30, are exactly from same in fact Time point starts, and is decoded audio file and video file, then in decoded audio frequency and video, the time of Voice & Video Axle is the most consistent, and follow-up play module 40 can be from the audio frequency and video after the described time point broadcast decoder obtained so that finally broadcast The audio frequency and video phonotape and videotape put synchronizes.
In the present embodiment, the audio frequency and video after playing module 40 broadcast decoder, display can be played out at the display screen of terminal, Can also export and play out display to other display device.
In the present embodiment, can be in the decoding playing process of whole audio-video document, perform aforesaid operations, it is also possible to Being in audio-video document, the audio-video document extracting part is decoded playing process, in the audio, video data solution extracted Code success, and after having play the audio frequency and video fragment of default ratio, just continuation proceeds above-mentioned solution in audio-video document Code play operation.
The audio-video frequency playing system that the present embodiment proposes, when the audio frequency and video exception being currently played being detected, obtains The time point that the video of current decoding is corresponding, is then default when redirecting time point at the described time point obtained, jumps to The audio-video document position, described time point place obtained, is decoded audio file and video file, and from the institute obtained State the audio frequency and video after time point broadcast decoder, it is achieved that in decoded audio frequency and video, audio fragment and the time point of video segment Keep consistent so that the audio frequency and video of final output also keep phonotape and videotape synchronization.
Further, in order to improve the intelligent of audio and video playing, propose audio frequency and video of the present invention based on first embodiment and broadcast Second embodiment of place system, in the present embodiment, with reference to Fig. 5, described audio-video frequency playing system also includes:
Detection module 50, during playing on decoding limit, audio-video document limit, detects decoded audio frequency in real time Whether the time shaft of fragment and video segment aligns;
Processing module 60, for when the time shaft of audio fragment and video segment does not align, by abnormal data mark Position is set to described preset value, and current play time point is increased prefixed time interval, redirects time point described in obtaining.
In the present embodiment, during decoding limit, audio-video document limit is play, detection module 50 detects decoding in real time After audio fragment and the time shaft of video segment whether align, say, that detection module 50 detects decoded audio frequency sheet Section is the most consistent at two time points that each moment is corresponding with video segment, if audio fragment and the time shaft of video segment Alignment, the most decoded audio fragment and video segment be not the most consistent at two time points that some moment is corresponding.This Time, it is believed that these audio frequency and video have abnormal, occur in that audio-video nonsynchronous problem, and processing module 60 can be first to abnormal audio frequency sheet Section and video segment process, and described processing mode includes: audio fragment and video segment are sorted out, then will be abnormal Data Labels position is set to described preset value.It has been noted that described preset value is configured as the case may be in first embodiment, Concrete numerical value does not limits, and after having set abnormal data flag bit, processing module 60 is by described abnormal data flag bit Associate with the audio fragment after classification and video segment, it is simple to subsequent terminal is when playing audio-video, according to described exception Data Labels position can quickly determine that audio frequency and video have exception, and performs the regulation operation of corresponding time shaft.And need not go again to extract Go out the Voice & Video in audio frequency and video, then go some analysis time etc. to operate, just can determine that audio frequency and video have exception, thus improve The abnormal efficiency determined of audio frequency and video and intelligent.
Further, current play time point is increased prefixed time interval by processing module 60, during to redirect described in obtaining Between point, and store and described in record, redirect time point, be easy to equally described in follow-up jumping to redirect in time point, re-start sound The decoding of video and broadcasting, increase prefixed time interval, is the equal of a bit of nonsynchronous audio frequency and video in the middle of having abandoned.When So, described prefixed time interval should be a smaller numerical value, and such as 0.5 second, these were just avoided that audio frequency and video fragment abandons Too much.
In the present embodiment, during decoding limit, described audio-video document limit is play, detect decoded audio frequency in real time Whether the time shaft of fragment and video segment aligns, when the time shaft of audio fragment and video segment does not align, and will be abnormal Data Labels position is set to described preset value, and current play time point is increased prefixed time interval, during to redirect described in obtaining Between point, it is simple to subsequent terminal is when playing audio-video, and the broadcasting quickly performing audio frequency and video adjusts so that audio frequency and video phonotape and videotape synchronizes Efficiency improves, and the intelligent of audio and video playing is also improved.
Further, in order to improve the motility of audio and video playing, based on first or second embodiments, sound of the present invention is proposed 3rd embodiment of audio/video player system, in the present embodiment, with reference to Fig. 6, described audio-video frequency playing system also includes:
Remove module 70, for removing the described preset value of described abnormal data flag bit, and redirect the time described in removing Point.
In the present embodiment, when terminal can with normal play audio frequency and video time, remove module 70 can be by described abnormal data The described preset value that flag bit is corresponding is purged, it is therefore prevented that during normal play audio frequency and video, due to the institute of abnormal data flag bit State preset value, the misleading that audio and video playing is caused.Meanwhile, remove module 70 remove described in redirect time point, effectively discharge Taking of memory space, improves the motility of audio and video playing.
It should be noted that in this article, term " includes ", " comprising " or its other variant any are intended to non-row Comprising of his property, so that include that the process of a series of key element, method, article or device not only include those key elements, and And also include other key element being not expressly set out, or also include intrinsic for this process, method, article or device Key element.In the case of there is no more restriction, statement " including ... " key element limited, it is not excluded that including this The process of key element, method, article or device there is also other identical element.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
These are only the preferred embodiments of the present invention, not thereby limit the scope of the claims of the present invention, every utilize this Equivalent structure or equivalence flow process that bright description and accompanying drawing content are made convert, or are directly or indirectly used in other relevant skill Art field, is the most in like manner included in the scope of patent protection of the present invention.

Claims (10)

1. an audio and video playing method, it is characterised in that described audio and video playing method includes:
During decoding limit, audio-video document limit is play, if detecting, the audio frequency and video being currently played are abnormal, then obtain The time point that the current video decoded is corresponding;
It is default when redirecting time point at the described time point obtained, jumps to the described time point place audio frequency and video literary composition obtained Part position, is decoded audio file and video file;
Audio frequency and video after the described time point broadcast decoder obtained.
2. audio and video playing method as claimed in claim 1, it is characterised in that described in detect that the sound being currently played regards The step of frequency exception includes:
Judge when whether abnormal data flag bit corresponding to the described audio frequency and video that are currently played is preset value;
If abnormal data flag bit corresponding to the described audio frequency and video being currently played is preset value, it is determined that be currently played Described audio frequency and video abnormal.
3. audio and video playing method as claimed in claim 2, it is characterised in that described in jump to the described time point institute that obtains In audio-video document position, while audio file and video file are decoded, execution following steps:
The time point of audio file is adjusted according to the described time point obtained, so that described audio file and described video file Time shaft aligns.
4. audio and video playing method as claimed in claim 2, it is characterised in that described audio and video playing method also includes:
During decoding limit, audio-video document limit is play, detect decoded audio fragment and the time of video segment in real time Whether axle aligns;
When the time shaft of audio fragment and video segment does not align, abnormal data flag bit is set to described preset value, and Current play time point is increased prefixed time interval, described in obtaining, redirects time point.
5. the audio and video playing method as described in any one of claim 1-4, it is characterised in that described from the described time obtained After point plays the step of decoded audio frequency and video, described audio and video playing method also includes:
Remove the described preset value of described abnormal data flag bit, and redirect time point described in removing.
6. an audio-video frequency playing system, it is characterised in that described audio-video frequency playing system includes:
Acquisition module, during playing on decoding limit, audio-video document limit, if detecting, the sound being currently played regards Frequency is abnormal, then obtain the time point that the video of current decoding is corresponding;
Redirect module, for being default when redirecting time point at the described time point obtained, jump to the described time obtained Point audio-video document position, place;
Decoder module, for being decoded audio file and video file;
Playing module, for the audio frequency and video after the described time point broadcast decoder obtained.
7. audio-video frequency playing system as claimed in claim 6, it is characterised in that described audio-video frequency playing system includes:
Whether judge module, be preset value for judging abnormal data flag bit corresponding to the described audio frequency and video that are currently played Time;
Determine module, if being preset value for the abnormal data flag bit that the described audio frequency and video that are currently played are corresponding, the most really Surely the described audio frequency and video being currently played are abnormal.
8. audio-video frequency playing system as claimed in claim 7, it is characterised in that described audio-video frequency playing system also includes:
Adjusting module, for redirecting the audio-video document position, described time point place that module jumps to obtain, to sound described While frequency file and video file are decoded, adjust the time point of audio file according to the described time point obtained, so that Described audio file aligns with the time shaft of described video file.
9. audio-video frequency playing system as claimed in claim 7, it is characterised in that described audio-video frequency playing system also includes:
Detection module, during playing on decoding limit, audio-video document limit, detect in real time decoded audio fragment and Whether the time shaft of video segment aligns;
Processing module, for when the time shaft of audio fragment and video segment does not align, is set to abnormal data flag bit Described preset value, and current play time point is increased prefixed time interval, described in obtaining, redirect time point.
10. the audio-video frequency playing system as described in any one of claim 6-9, it is characterised in that described audio-video frequency playing system Also include:
Remove module, for removing the described preset value of described abnormal data flag bit, and redirect time point described in removing.
CN201610671231.4A 2016-08-15 2016-08-15 Audio and video playing method and system Pending CN106210846A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610671231.4A CN106210846A (en) 2016-08-15 2016-08-15 Audio and video playing method and system
PCT/CN2016/112238 WO2018032680A1 (en) 2016-08-15 2016-12-27 Method and system for playing audio and video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610671231.4A CN106210846A (en) 2016-08-15 2016-08-15 Audio and video playing method and system

Publications (1)

Publication Number Publication Date
CN106210846A true CN106210846A (en) 2016-12-07

Family

ID=57522376

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610671231.4A Pending CN106210846A (en) 2016-08-15 2016-08-15 Audio and video playing method and system

Country Status (2)

Country Link
CN (1) CN106210846A (en)
WO (1) WO2018032680A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107454471A (en) * 2017-07-07 2017-12-08 深圳Tcl数字技术有限公司 Method for turning on television, television set and computer-readable recording medium
WO2018032680A1 (en) * 2016-08-15 2018-02-22 深圳Tcl新技术有限公司 Method and system for playing audio and video
WO2018171567A1 (en) * 2017-03-21 2018-09-27 华为技术有限公司 Method, server, and terminal for playing back media stream
CN110505476A (en) * 2019-09-02 2019-11-26 图普科技(广州)有限公司 Camera management-control method, device and electronic equipment
CN111488244A (en) * 2020-04-07 2020-08-04 广州虎牙科技有限公司 Editing abnormity recovery method and device, electronic equipment and storage medium
CN111526374A (en) * 2019-02-01 2020-08-11 广州虎牙信息科技有限公司 Live broadcast-based bullet screen processing method, stream pulling method and device
CN112911365A (en) * 2021-02-02 2021-06-04 卡莱特云科技股份有限公司 Audio synchronous playing method and device
CN113242437A (en) * 2021-04-01 2021-08-10 联通(广东)产业互联网有限公司 RTSP (real time streaming protocol) video plug-in-free playing method, system, device and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116233472B (en) * 2023-05-08 2023-07-18 湖南马栏山视频先进技术研究院有限公司 Audio and video synchronization method and cloud processing system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6803964B1 (en) * 1997-03-21 2004-10-12 International Business Machines Corporation Method and apparatus for processing digital data
CN101394469A (en) * 2008-10-29 2009-03-25 北京创毅视讯科技有限公司 Audio and video synchronization method, device and a digital television chip
CN102110458A (en) * 2009-12-24 2011-06-29 Tcl集团股份有限公司 Playing terminal as well as method and device for playing an audio/video file
CN103338386A (en) * 2013-07-10 2013-10-02 航天恒星科技有限公司 Audio and video synchronization method based on simplified timestamps
CN105612743A (en) * 2013-08-30 2016-05-25 微软技术许可有限责任公司 Audio video playback synchronization for encoded media

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9143820B2 (en) * 2012-03-25 2015-09-22 Mediatek Inc. Method for performing fluent playback control in response to decoding status, and associated apparatus
CN106210846A (en) * 2016-08-15 2016-12-07 深圳Tcl新技术有限公司 Audio and video playing method and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6803964B1 (en) * 1997-03-21 2004-10-12 International Business Machines Corporation Method and apparatus for processing digital data
CN101394469A (en) * 2008-10-29 2009-03-25 北京创毅视讯科技有限公司 Audio and video synchronization method, device and a digital television chip
CN102110458A (en) * 2009-12-24 2011-06-29 Tcl集团股份有限公司 Playing terminal as well as method and device for playing an audio/video file
CN103338386A (en) * 2013-07-10 2013-10-02 航天恒星科技有限公司 Audio and video synchronization method based on simplified timestamps
CN105612743A (en) * 2013-08-30 2016-05-25 微软技术许可有限责任公司 Audio video playback synchronization for encoded media

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018032680A1 (en) * 2016-08-15 2018-02-22 深圳Tcl新技术有限公司 Method and system for playing audio and video
WO2018171567A1 (en) * 2017-03-21 2018-09-27 华为技术有限公司 Method, server, and terminal for playing back media stream
CN108632681A (en) * 2017-03-21 2018-10-09 华为软件技术有限公司 Play method, server and the terminal of Media Stream
CN107454471A (en) * 2017-07-07 2017-12-08 深圳Tcl数字技术有限公司 Method for turning on television, television set and computer-readable recording medium
CN111526374A (en) * 2019-02-01 2020-08-11 广州虎牙信息科技有限公司 Live broadcast-based bullet screen processing method, stream pulling method and device
CN110505476A (en) * 2019-09-02 2019-11-26 图普科技(广州)有限公司 Camera management-control method, device and electronic equipment
CN111488244A (en) * 2020-04-07 2020-08-04 广州虎牙科技有限公司 Editing abnormity recovery method and device, electronic equipment and storage medium
CN112911365A (en) * 2021-02-02 2021-06-04 卡莱特云科技股份有限公司 Audio synchronous playing method and device
CN112911365B (en) * 2021-02-02 2024-03-29 卡莱特云科技股份有限公司 Audio synchronous playing method and device
CN113242437A (en) * 2021-04-01 2021-08-10 联通(广东)产业互联网有限公司 RTSP (real time streaming protocol) video plug-in-free playing method, system, device and storage medium

Also Published As

Publication number Publication date
WO2018032680A1 (en) 2018-02-22

Similar Documents

Publication Publication Date Title
CN106210846A (en) Audio and video playing method and system
JP4292654B2 (en) Recording apparatus and method, reproducing apparatus and method, and recording medium
JP4403432B2 (en) Recording / reproducing apparatus and recording / reproducing method
CN105979347A (en) Video play method and device
KR20070052554A (en) Apparatus and method for image displaying
US7149365B2 (en) Image information summary apparatus, image information summary method and image information summary processing program
CN102265609A (en) Program data processing device, method, and program
CN102469309B (en) Image processing method
US6415100B1 (en) Apparatus and method for sub-picture encoding
CN103491430B (en) Streaming medium data processing method and electronic equipment
KR20170067546A (en) System and method for audio signal and a video signal synchronization
US20140047309A1 (en) Apparatus and method for synchronizing content with data
JP2016103714A (en) Video recording and reproducing device
JP2007504753A (en) Auxiliary information processing system
KR100598360B1 (en) Apparatus to reduce an image display delay time in channel conversion and method thereof
JP2009159483A (en) Broadcast receiver
KR101294383B1 (en) Method and apparatus to setting book mark of image display device
JP2005277984A (en) Receiving terminal
JP2008053991A (en) Digital broadcast receiver
US20060182423A1 (en) Data processing device
KR101208612B1 (en) The identifying system for filtering program except formality program in real time on television broadcasting and the method thereof
KR20030080984A (en) Multimedia data decoder
KR100785173B1 (en) Control apparatus and method for recording of a digital broadcasting receiver
JP2009065596A (en) Summary video generating apparatus and program
JP2007027880A (en) Digital broadcast storage and reproduction method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20161207