CN102110458B - Playing terminal as well as method and device for playing an audio/video file - Google Patents

Playing terminal as well as method and device for playing an audio/video file Download PDF

Info

Publication number
CN102110458B
CN102110458B CN 200910189374 CN200910189374A CN102110458B CN 102110458 B CN102110458 B CN 102110458B CN 200910189374 CN200910189374 CN 200910189374 CN 200910189374 A CN200910189374 A CN 200910189374A CN 102110458 B CN102110458 B CN 102110458B
Authority
CN
China
Prior art keywords
video
audio
data
time
marking
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN 200910189374
Other languages
Chinese (zh)
Other versions
CN102110458A (en
Inventor
刘纹高
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TCL Corp
Original Assignee
TCL Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TCL Corp filed Critical TCL Corp
Priority to CN 200910189374 priority Critical patent/CN102110458B/en
Publication of CN102110458A publication Critical patent/CN102110458A/en
Application granted granted Critical
Publication of CN102110458B publication Critical patent/CN102110458B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a playing terminal as well as a method and device for playing an audio/video file, wherein the method comprises the following steps: obtaining an audio time identifier and a video time identifier of audio/video data, and storing the identifiers in a playing data list which is set by a system; storing the audio data and the video data in a buffer area; matching the audio time identifier and video time identifier in the playing data list; when the audio time identifier is not matched with the video time identifier, identifying an audio/video frame corresponding to the time identifier as an error, skipping the audio/video frame corresponding to the time identifier, looking for an audio/video time identifier consistent with the audio/video time identifier; when the audio time identifier is consistent with the video time identifier, respectively transmitting the audio data and video data in the buffer area to an audio decoder and a video decoder; and playing the decoded audio data and video data. According to the invention, the playing of audios and videos to be consistent, and the playing quality is improved.

Description

The playing method and device of a kind of playback terminal and audio-video document thereof
Technical field
The invention belongs to multimedia technology field, be specifically related to the playing method and device of a kind of playback terminal and audio-video document thereof.
Background technology
Along with the development of multimedia technology, the user is also more and more higher to the requirement of multimedia quality.
Take MKV as example, MKV is a kind of media file of Matroska, also claim multimedia container (Multimedia Container), be a kind of Novel multimedia encapsulation format, the caption stream of the audio frequency of the video of multiple different coding and 16 above different-formats and different language can be encapsulated in the middle of the Matroska Media file.
MKV is different from the video code models such as DivX, XviD, also is different from the audio coding forms such as MP3, Ogg.MKV just provides " combination " and " encapsulation " form of shell for above-mentioned these sounds, video.MKV can be understood as a kind of Container Format, and the XviD that only has video and only have the MP3 of audio frequency to combine, then the form with a kind of multimedia medium occurs.
MKV can use Media player Classic, BSplayer, ZoomPlayer player etc., even comprises Windows Media player.
Because MKV can hold video, audio frequency and the caption stream of number of different types coding, even if very the files in stream media such as the RealMedia of sealing and QuickTime are also included into by MKV, therefore MKV has almost become an omnipotent media container, uses constantly and popularizes.
Because MKV can encapsulate video, the audio frequency of various codings at present, so under the combination of multiple audio/video coding, general played in order according to the audio frequency and video of obtaining, because the difference of the complexity of various audio/video codings, consumption system resource, cause decoding length service time of each frame audio, video data different, if above-mentioned situation being accumulated to a certain degree gradually, the inconsistent situation of audio frequency time and video time will appear, and then cause obvious audio frequency and video asynchrony phenomenon, bring very large inconvenience for user's use.
Therefore, how keeping the synchronism of MKV sound intermediate frequency and video playback, improve play quality, is one of direction of multimedia technology field research.
Summary of the invention
The object of the present invention is to provide a kind of player method of audio-video document, be intended to keep the synchronism of audio frequency and video playback, improve play quality.
The embodiment of the invention is achieved in that a kind of player method of audio-video document, said method comprising the steps of:
Obtain audio, video data sound intermediate frequency time marking and video time sign;
The audio frequency time marking and the video time that obtain are identified the played data tabulation that is stored to default;
With described voice data and Video Data Storage to buffer area;
Audio frequency time marking in the tabulation of described played data and video time sign are mated, and the mode of coupling is: calculate the absolute value of video time and the difference of audio frequency time whether within the threshold values scope of system's setting;
When the absolute value of finding video time and the difference of audio frequency time not within the threshold values scope of system's setting, be that audio frequency time marking and video time identify when not mating, then the audio/video frames that time marking is corresponding is designated mistake, and skip, seek the consistent audio frequency and video time marking of audio frequency and video time marking;
When the absolute value of finding video time and the difference of audio frequency time is within the threshold values scope that system arranges, be audio frequency time marking and video time when marking matched, voice data corresponding in the described buffer area and video data are sent to respectively audio decoder and Video Decoder;
Decoded voice data and video data are play.
The player method of described audio-video document wherein,, also comprises to the step of buffer area at described voice data and Video Data Storage:
The voice data that is stored in buffer area is related with corresponding time marking foundation in the described played data tabulation with video data.
The player method of described audio-video document, wherein, after the step of decoded voice data and video data broadcast, described method also comprises:
Voice data and video data that deletion has been play, and described voice data and time marking corresponding to video data.
The player method of described audio-video document, wherein, before the step of obtaining audio, video data sound intermediate frequency time marking and video time sign, described method also comprises:
The tabulation of one played data is set, and this tabulation is used for depositing audio frequency time marking and video time sign.
A kind of playing device of audio-video document, wherein, described device comprises:
The time marking acquisition module is used for obtaining audio, video data sound intermediate frequency time marking and video time sign;
The time marking memory module, the audio frequency time marking and the video time that are used for obtaining identify the played data tabulation that is stored to default;
The audio, video data memory module is used for described voice data and Video Data Storage to buffer area;
The time marking matching module, be used for audio frequency time marking and the video time sign of described played data tabulation are mated, whether the absolute value that namely calculates video time and the difference of audio frequency time arranges within the threshold values scope in system, if so, then audio frequency time marking and video time are marking matched; Otherwise audio frequency time marking and video time sign are not mated;
Mark module is used for matching audio frequency time marking and video time at described time marking matching module and identifies when inconsistent, audio/video frames is designated mistake, and skips this audio/video frames;
The audio, video data sending module is used for voice data and the video data that described buffer area is corresponding and is sent to respectively audio decoder and Video Decoder; And
The audio, video data playing module is used for decoded voice data and video data are play.
The playing device of described audio-video document, wherein, described device also comprises:
Module is set up in the time marking association, sets up related with video data with corresponding time marking for the voice data that will be stored in buffer area.
The playing device of described audio-video document, wherein, described device also comprises:
The storage space processing module is used for voice data and video data that deletion has been play, and described voice data and time marking corresponding to video data.
The playing device of described audio-video document, wherein, described device also comprises:
The played data tabulation arranges module, is used for arranging played data tabulation, and this tabulation is used for depositing audio frequency time marking and video time sign.
A kind of playback terminal, wherein, described terminal comprises the playing device of above-mentioned audio-video document.
The embodiment of the invention is by being stored to the time marking of audio frequency and the time marking of video in the tabulation of one played data, simultaneously with corresponding voice data and Video Data Storage to buffer area, when the audio identification that in described played data tabulation, finds match time and video labeling, from described buffer area corresponding voice data and video data are sent to respectively audio decoder and Video Decoder, play, so that the broadcast of audio frequency and video can be consistent, improve greatly the quality of playing, be beneficial to the popularization of playback terminal.
Description of drawings
Fig. 1 shows the process flow diagram of the player method of the audio-video document that the embodiment of the invention provides;
Fig. 2 shows the structural drawing of the playing device of the audio-video document that the embodiment of the invention provides.
Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, is not intended to limit the present invention.
The embodiment of the invention is by being stored to the time marking of audio frequency and the time marking of video in the tabulation of one played data, simultaneously with corresponding voice data and Video Data Storage to buffer area, when the audio identification that in described played data tabulation, finds match time and video labeling, from described buffer area corresponding voice data and video data are sent to respectively audio decoder and Video Decoder, play.
Fig. 1 shows the flow process of the player method of the audio-video document that the embodiment of the invention provides.
In step S101, played data tabulation is set, this tabulation is used for depositing audio frequency time marking and video time sign;
For example, take the audio frequency time marking that obtains as S1, S2 ..., video time sign T1, T2 ... be example, the form that the played data tabulation can be set is as follows:
The audio frequency time marking The video time sign
S1 T1
S2 T2
…… ……
In specific implementation process, also can be not limited to the form of above table by other the mode of tabulation, do not enumerate one by one herein.
In step S102, obtain audio, video data sound intermediate frequency time marking S1, S2 ... with video time sign T1, T2
In step S103, audio frequency time marking and the video time that obtains identified the played data tabulation that is stored to default, the played data that namely above illustrates tabulation;
In step S104, with described voice data and Video Data Storage to buffer area;
Wherein, be stored to the voice data of buffer area and video data herein and be corresponding voice data and the video data of time marking in the played data tabulation.
In step S105, set up related with video data with corresponding time marking the voice data that is stored in buffer area;
In this step, by setting up association, make things convenient for the back to obtain corresponding voice data or video data according to time marking.
In step S106, the audio frequency time marking in the described played data tabulation and video time sign are mated;
For example, with the audio frequency time marking S1 during above data playback is tabulated and video time sign T1, T2 ... mate one by one.
In step S107, judge that described video time is whether within the fluctuation range of described audio frequency time;
Wherein, whether the absolute value of the difference between described calculating video time and sound apparent time is in system arranges the threshold values fluctuation range.For example, the absolute value of the difference between video time and sound apparent time is in the scope of 40ms, namely satisfy when video time sign: (audio frequency time marking-40ms)≤video time sign≤(during audio frequency time marking+40ms), i.e. expression matches the audio frequency time marking consistent with this video time sign.
If described video time is outside the fluctuation range of described audio frequency time, then the audio/video frames that time marking is corresponding is designated mistake, and skips, and seeks the consistent audio frequency and video time marking of audio frequency and video time marking.
In step S108, identify when consistent when matching audio frequency time marking and video time, according to the corresponding voice data of the associative search of setting up among the step S105 and video data.
As the audio frequency time marking and the video time that match in the played data tabulation are marking matched, namely satisfy synchronous broadcast condition, then obtain the parameter of voice data corresponding to described time marking and video data, send corresponding parameter message to data buffer area, voice data and video data in requirement the buffer area that described time marking is corresponding pass to respectively the decoding that audio decoder and Video Decoder carry out Frame.
In step S109, voice data and the video data that finds is sent to respectively audio decoder and Video Decoder;
In step S110, decoded voice data and video data are play;
In step S111, voice data and video data that deletion has been play are deleted time marking corresponding to described voice data and video data simultaneously.
Voice data, video data and corresponding time marking by timely deletion has been play save storage space for the voice data of back and coupling, decoding and the broadcast of video data.
Fig. 2 shows the structure of the playing device of the audio-video document that the embodiment of the invention provides.Described device comprises that played data tabulation arranges module 21, time marking acquisition module 22, time marking memory module 23, audio, video data memory module 24, time marking association and sets up module 25, time marking matching module 26, mark module 27, audio, video data sending module 28, audio, video data playing module 29 and storage space processing module 30.
Wherein, the played data tabulation arranges module 21 played data tabulation is set, and this tabulation is used for depositing audio frequency time marking and video time sign;
The structure of concrete data playback tabulation is above being stated, repeats no more herein.
Time marking acquisition module 22 obtains audio, video data sound intermediate frequency time marking and video time sign;
Time marking memory module 23 identifies the played data tabulation that is stored to default with audio frequency time marking and the video time that obtains;
Audio, video data memory module 24 with described voice data and Video Data Storage to buffer area;
Wherein, be stored to the voice data of buffer area and video data herein and be corresponding voice data and the video data of time marking in the played data tabulation;
The time marking association is set up the Voice ﹠ Video that module 25 will be stored in buffer area and is set up related with corresponding time marking;
Audio frequency time marking and video time sign in 26 pairs of described played data tabulations of time marking matching module are mated;
Match audio frequency time marking and video time at described time marking matching module 26 and identify when inconsistent, mark module 27 is used for audio/video frames is designated mistake, and skips this audio/video frames;
Match audio frequency time marking and video time at described time marking matching module 26 and identify when consistent, audio, video data sending module 28 is sent to respectively audio decoder and Video Decoder with voice data corresponding with described time marking in the described buffer area and video data;
Audio, video data playing module 29 is play decoded voice data and video data;
Voice data and video data that 30 deletions of storage space processing module have been play, and described voice data and time marking corresponding to video data.
The embodiment of the invention also provides a kind of playback terminal, and described terminal comprises the playing device of the audio-video document that the embodiment of the invention provides, and in view of this installs in above existing detailed description, repeats no more herein.
The embodiment of the invention is by being stored to the time marking of audio frequency and the time marking of video in the tabulation of one played data, simultaneously with corresponding voice data and Video Data Storage to buffer area, when in the tabulation of described played data, matching the consistent Voice ﹠ Video of time marking, from described buffer area corresponding voice data and video data are sent to respectively audio decoder and Video Decoder, play, so that the broadcast of audio frequency and video can be consistent, improve greatly the quality of playing, be beneficial to the popularization of playback terminal.
Should be understood that, for those of ordinary skills, can be improved according to the above description or conversion, and these improvement and conversion all should belong to the protection domain of claims of the present invention.

Claims (9)

1. the player method of an audio-video document is characterized in that, said method comprising the steps of:
Obtain audio, video data sound intermediate frequency time marking and video time sign;
The audio frequency time marking and the video time that obtain are identified the played data tabulation that is stored to default;
With described voice data and Video Data Storage to buffer area;
Audio frequency time marking in the tabulation of described played data and video time sign are mated, and the mode of coupling is: calculate the absolute value of video time and the difference of audio frequency time whether within the threshold values scope of system's setting;
When the absolute value of finding video time and the difference of audio frequency time not within the threshold values scope of system's setting, be that audio frequency time marking and video time identify when not mating, then the audio/video frames that time marking is corresponding is designated mistake, and skip, seek the consistent audio frequency and video time marking of audio frequency and video time marking;
When the absolute value of finding video time and the difference of audio frequency time is within the threshold values scope that system arranges, be audio frequency time marking and video time when marking matched, voice data corresponding in the described buffer area and video data are sent to respectively audio decoder and Video Decoder;
Decoded voice data and video data are play.
2. the player method of audio-video document as claimed in claim 1 is characterized in that,, also comprises to the step of buffer area at described voice data and Video Data Storage:
The voice data that is stored in buffer area is related with corresponding time marking foundation in the described played data tabulation with video data.
3. the player method of audio-video document as claimed in claim 1 is characterized in that, after the step of decoded voice data and video data broadcast, described method also comprises:
Voice data and video data that deletion has been play, and described voice data and time marking corresponding to video data.
4. the player method of audio-video document as claimed in claim 1 is characterized in that, before the step of obtaining audio, video data sound intermediate frequency time marking and video time sign, described method also comprises:
The tabulation of one played data is set, and this tabulation is used for depositing audio frequency time marking and video time sign.
5. the playing device of an audio-video document is characterized in that, described device comprises:
The time marking acquisition module is used for obtaining audio, video data sound intermediate frequency time marking and video time sign;
The time marking memory module, the audio frequency time marking and the video time that are used for obtaining identify the played data tabulation that is stored to default;
The audio, video data memory module is used for described voice data and Video Data Storage to buffer area;
The time marking matching module, be used for audio frequency time marking and the video time sign of described played data tabulation are mated, whether the absolute value that namely calculates video time and the difference of audio frequency time arranges within the threshold values scope in system, if so, then audio frequency time marking and video time are marking matched; Otherwise audio frequency time marking and video time sign are not mated;
Mark module is used for matching audio frequency time marking and video time at described time marking matching module and identifies when inconsistent, audio/video frames is designated mistake, and skips this audio/video frames;
The audio, video data sending module is used for voice data and the video data that described buffer area is corresponding and is sent to respectively audio decoder and Video Decoder; And
The audio, video data playing module is used for decoded voice data and video data are play.
6. the playing device of audio-video document as claimed in claim 5 is characterized in that, described device also comprises:
Module is set up in the time marking association, sets up related with video data with corresponding time marking for the voice data that will be stored in buffer area.
7. the playing device of audio-video document as claimed in claim 5 is characterized in that, described device also comprises:
The storage space processing module is used for voice data and video data that deletion has been play, and described voice data and time marking corresponding to video data.
8. the playing device of audio-video document as claimed in claim 5 is characterized in that, described device also comprises:
The played data tabulation arranges module, is used for arranging played data tabulation, and this tabulation is used for depositing audio frequency time marking and video time sign.
9. a playback terminal is characterized in that, described terminal comprises the playing device of each described audio-video document of claim 5 to 8.
CN 200910189374 2009-12-24 2009-12-24 Playing terminal as well as method and device for playing an audio/video file Active CN102110458B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200910189374 CN102110458B (en) 2009-12-24 2009-12-24 Playing terminal as well as method and device for playing an audio/video file

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200910189374 CN102110458B (en) 2009-12-24 2009-12-24 Playing terminal as well as method and device for playing an audio/video file

Publications (2)

Publication Number Publication Date
CN102110458A CN102110458A (en) 2011-06-29
CN102110458B true CN102110458B (en) 2013-02-06

Family

ID=44174588

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200910189374 Active CN102110458B (en) 2009-12-24 2009-12-24 Playing terminal as well as method and device for playing an audio/video file

Country Status (1)

Country Link
CN (1) CN102110458B (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105513619B (en) * 2014-09-26 2019-02-01 惠州市德赛西威汽车电子股份有限公司 The processing method of wrong song in a kind of vehicle entertainment system
CN104506793B (en) * 2015-01-16 2018-04-27 东北大学 A kind of security video conference system and method based on internet
CN105872699A (en) * 2016-04-28 2016-08-17 乐视控股(北京)有限公司 Video playing control method and device
CN105959774B (en) * 2016-05-05 2020-05-01 青岛海信电器股份有限公司 Sound and picture synchronization method and system and television
CN105979259A (en) * 2016-06-16 2016-09-28 乐视控股(北京)有限公司 Test method and test device
CN106210846A (en) * 2016-08-15 2016-12-07 深圳Tcl新技术有限公司 Audio and video playing method and system
CN108735239B (en) * 2018-04-08 2021-05-04 平安科技(深圳)有限公司 Audio playing control method and terminal equipment
CN109165558B (en) * 2018-07-26 2022-03-25 浙江大学 Abnormal behavior detection system in elevator based on deep learning
CN111669625A (en) * 2020-06-12 2020-09-15 北京字节跳动网络技术有限公司 Processing method, device and equipment for shot file and storage medium
CN112379857B (en) * 2020-11-24 2022-01-04 惠州Tcl移动通信有限公司 Audio data processing method and device, storage medium and mobile terminal
CN113763918A (en) * 2021-08-18 2021-12-07 单百通 Text-to-speech conversion method and device, electronic equipment and readable storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1501253A (en) * 2002-11-18 2004-06-02 英保达股份有限公司 Video and audio playing method
CN1794216A (en) * 2005-11-01 2006-06-28 无敌科技(西安)有限公司 Method of synchronous playing voice frequency document and corresponding literal data

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1501253A (en) * 2002-11-18 2004-06-02 英保达股份有限公司 Video and audio playing method
CN1794216A (en) * 2005-11-01 2006-06-28 无敌科技(西安)有限公司 Method of synchronous playing voice frequency document and corresponding literal data

Also Published As

Publication number Publication date
CN102110458A (en) 2011-06-29

Similar Documents

Publication Publication Date Title
CN102110458B (en) Playing terminal as well as method and device for playing an audio/video file
CN100388261C (en) Information storage medium including event occurrence information, apparatus and method for reproducing the same
CN103414949B (en) A kind of multimedia edit system based on intelligent television and method
CN102118539B (en) Multimedia playing terminal as well as playing method and device for dragging multimedia files
CN102025956A (en) Processing method, device and system for fast forward and fast backward playing of network stream media
CN101572778B (en) Method and system for broadcasting programs
CN101802803B (en) Method and apparatus for generating and reproducing media object-based metadata
CN102857833B (en) Audio decoding system and method adapted to android stagefright multimedia framework
CN103269450B (en) A kind of multimedia system towards Android intelligent television
CN106128460A (en) A kind of record labels method and device
CN101645967B (en) Mobile terminal for processing multimedia data in user-defined format and realization method thereof
CN105163133A (en) Program information playing method and device
CN101803378B (en) Method and apparatus for generating and accessing metadata in media file format
CN105916009B (en) A kind of method and device for recording program
CN102110459B (en) Playing terminal and multimedia file playing method and device thereof
CN101118777B (en) Playing method of multimedia container format file and indexes reading method thereof
CN103501457B (en) The method and apparatus that a kind of program is play
CN102098570A (en) Digital television information playing method and system
CN108282678A (en) A kind of playback method of multi-medium data, apparatus and system
CN105744297A (en) Method and device for code stream transmission
CN101330398B (en) Method for transmitting business data flow
CN109120966B (en) Method, device and system for intelligently judging and identifying code rate of 4K video-on-demand
CN107615768A (en) Dispensing device, sending method, reception device and method of reseptance
CN102117271B (en) Method and terminal for playing falsely-encapsulated audio/video files
CN102169708A (en) Audio and video play system, method, mobile terminal and player

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant