CN105898502B - The method and device that audio-visual synchronization plays - Google Patents
The method and device that audio-visual synchronization plays Download PDFInfo
- Publication number
- CN105898502B CN105898502B CN201610221519.1A CN201610221519A CN105898502B CN 105898502 B CN105898502 B CN 105898502B CN 201610221519 A CN201610221519 A CN 201610221519A CN 105898502 B CN105898502 B CN 105898502B
- Authority
- CN
- China
- Prior art keywords
- audio
- time
- external sound
- sound device
- initial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 33
- 238000004458 analytical method Methods 0.000 claims description 112
- 238000010835 comparative analysis Methods 0.000 claims description 23
- 230000011218 segmentation Effects 0.000 claims description 13
- 230000001960 triggered effect Effects 0.000 claims description 3
- 108010001267 Protein Subunits Proteins 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 10
- 230000005540 biological transmission Effects 0.000 description 7
- 230000003111 delayed effect Effects 0.000 description 5
- 241001062009 Indigofera Species 0.000 description 3
- 238000012790 confirmation Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000004321 preservation Methods 0.000 description 2
- 238000010187 selection method Methods 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention discloses a kind of methods that audio-visual synchronization plays to obtain the facility information of the external sound device when playing the audio of multimedia file by external sound device；Preset database is searched according to the facility information, determines that delay time when the external sound device plays audio, the preset database include the corresponding relationship between the facility information and the delay time；The video of the multimedia file is adjusted according to the delay time, so that the audio and the audio video synchronization play.The invention also discloses the devices that a kind of audio-visual synchronization plays.When the present invention realizes the audio by external sound device broadcasting multimedia file, the purpose of adjust automatically audio & video picture synchronization.
Description
Technical field
The present invention relates to the method and devices that technical field of computer multimedia more particularly to audio-visual synchronization play.
Background technique
With the development of Computer Multimedia Technology, people usually play sound in the equipment such as computer, mobile phone in life
Or the multimedia files such as video also usually play sound using external sound device, such as Baffle Box of Bluetooth, indigo plant while playing
Tooth earphone etc..But when user connects external sound device, it can usually find that sound is asynchronous with video, such as work as video
After middle personage finishes a word, external sound device just plays out the sound of personage in video, external sound device bring
Sound delay time keeps user experience poor.
Playback equipment can allow user to be adjusted according to the delay of external audio playing device in the prior art, so that broadcasting
Sound reproduction sound and audio video synchronization.In this case, user often oneself according to video and sound manually adjusts confirmation step by step,
Adjustment mode is comparatively laborious, influences user experience.
Summary of the invention
The main purpose of the present invention is to provide the method and devices that a kind of audio-visual synchronization plays, it is intended to realize by outer
When connecing the audio of sound device broadcasting multimedia file, the purpose of adjust automatically audio & video picture synchronization.
To achieve the above object, a kind of audio-visual synchronization provided by the invention plays method the following steps are included:
When playing the audio of multimedia file by external sound device, the equipment letter of the external sound device is obtained
Breath；
Preset database is searched according to the facility information, determines delay when the external sound device plays audio
Time, the preset database include the corresponding relationship between the facility information and the delay time；
The video of the multimedia file is adjusted according to the delay time, so that the audio is broadcast with the audio video synchronization
It puts.
Preferably, described when playing the audio of multimedia file by external sound device, obtain the external sound
Include: before the facility information of equipment
The first preset audio is sent to external sound device, record sends the first initial time of first audio；
After sending first audio, the second audio and reception described second that the external sound device plays are obtained
The first time parameter of audio；
By the second audio time segment mark and with the first audio comparative analysis, obtain receiving described external
Sound device plays the initial time section of first audio, according to the initial time section, first initial time and institute
State delay time when first time parameter determines the external sound device broadcasting audio；
The facility information of the delay time and the external sound device is saved in the database.
Preferably, it is described by the second audio time segment mark and with the first audio comparative analysis, connect
The initial time section that the external sound device plays first audio is received, according to the initial time section, described first
Initial time and the first time parameter determine that delay time when the external sound device plays audio includes:
By second audio according to preset time interval segmentation markers, it is divided into N sections, N is positive integer；
The i-th piecewise analysis audio after obtaining the second audio parsing label, the initial value of i are that 1, i is less than or equal to N；
By the i-th piecewise analysis audio and the first audio comparative analysis, obtain receiving the external sound device
The initial time section for playing first audio, according to the initial time section, first initial time and it is described first when
Between parameter determine delay time when the external sound device plays audio.
It preferably, include the second initial time for receiving second audio in the first time parameter, described in reception
The third initial time of i-th piecewise analysis audio described in second audio and the end time for receiving second audio；
It is then described by the i-th piecewise analysis audio and the first audio comparative analysis, it obtains receiving the external sound
The initial time section of first audio described in sound device plays, according to the initial time section, first initial time and described
First time parameter determines that delay time when the external sound device plays audio includes:
Judge whether the i-th piecewise analysis audio and the similarity of first audio are less than preset value；
If so, obtaining i-th section is the initial time section for playing first audio, the i-th piecewise analysis audio is determined
Third initial time and first initial time first time difference be the delay time；
If it is not, the second time difference of the end time Yu the second initial time are then calculated, according to second time
Difference judges whether to user feedback reminder message.
Preferably, it is described judged whether according to second time difference include: to user feedback reminder message
Judge whether second time difference is greater than the preset limitation time；
If so, confirming the reminder message of the delay time failure to user feedback；
If it is not, then enabling i=i+1, and when i is less than or equal to N, returns and execute acquisition the second audio parsing mark
The step of the i-th piecewise analysis audio after note.
In addition, to achieve the above object, the present invention also provides a kind of device that determining audio-visual synchronization plays, the sound view
The device that is played simultaneously of frequency includes:
First obtains module, described outer for obtaining when playing the audio of multimedia file by external sound device
Connect the facility information of sound device；
It searches determining module and determines that the external sound is set for searching preset database according to the facility information
Delay time when standby broadcasting audio, the preset database include pair between the facility information and the delay time
It should be related to；
Adjust module, for adjusting the video of the multimedia file according to the delay time so that the audio with
The audio video synchronization plays.
Preferably, the device that the audio-visual synchronization plays further include:
Audio sending module, for sending the first preset audio to external sound device, record sends first sound
First initial time of frequency；
Second obtains module, second played for after sending first audio, obtaining the external sound device
Audio and the first time parameter for receiving second audio；
Analyze determining module, for will the second audio time segment label and with the first audio comparative analysis,
It obtains receiving the initial time section that the external sound device plays first audio, according to the initial time section, institute
It states the first initial time and the first time parameter determines delay time when the external sound device plays audio；
Preserving module, for the facility information of the delay time and the external sound device to be stored in the data
In library.
Preferably, the analysis determining module includes:
Audio processing submodule, for second audio according to preset time interval segmentation markers, to be divided into N sections, N
For positive integer；
Acquisition submodule, for obtaining the i-th piecewise analysis audio after second audio parsing marks, the initial value of i is
1, i is less than or equal to N；
Submodule is determined, for obtaining receiving institute by the i-th piecewise analysis audio and the first audio comparative analysis
State the initial time section that external sound device plays first audio, according to the initial time section, it is described first it is initial when
Between and the first time parameter determine delay time when the external sound device plays audio.
It preferably, include the second initial time for receiving second audio in the first time parameter, described in reception
The third initial time of i-th piecewise analysis audio described in second audio and the end time for receiving second audio；
Then the determining submodule includes:
Judging unit, for judging it is default whether the similarity of the i-th piecewise analysis audio and first audio is less than
Value；
Determination unit, for obtaining when the similarity of the i-th piecewise analysis audio and first audio is less than preset value
It is the initial time section for playing first audio to i-th section, determines third initial time and the institute of the i-th piecewise analysis audio
The first time difference for stating the first initial time is the delay time；
Computing unit, for when the similarity of the i-th piecewise analysis audio and first audio is not less than preset value,
The second time difference for calculating the end time Yu the second initial time, according to second time difference judge whether to
Feed back reminder message in family.
Preferably, the computing unit includes:
Judgment sub-unit, for judging whether second time difference is greater than the preset limitation time；
Message feedback subelement, for when second time difference be greater than the preset limitation time when, to user feedback
Confirm the reminder message of the delay time failure；
Subelement is triggered, for enabling i=i+1, and work as when second time difference is not more than the preset limitation time
When i is less than or equal to N, triggers the acquisition submodule and obtain the i-th piecewise analysis audio after the second audio parsing label.
The embodiment of the present invention is by obtaining described external when playing the audio of multimedia file by external sound device
The facility information of sound device；Preset database is searched according to the facility information, determines that the external sound device plays
Delay time when audio, the preset database include the corresponding pass between the facility information and the delay time
System；The video of the multimedia file is adjusted according to the delay time, so that the audio and the audio video synchronization play.It is logical
Cross connect the facility information that the external sound device is first obtained when external sound device plays the audio of multimedia file further according to
The facility information inquiry time delay time is played simultaneously further according to the audio & video of delay time adjustment multimedia file, so that
When playing the audio of multimedia file using external sound device, is manually adjusted every time without user, realize adjust automatically sound
The frequency purpose synchronous with video pictures.
Detailed description of the invention
Fig. 1 is the flow diagram for the method first embodiment that audio-visual synchronization of the present invention plays；
Fig. 2 is the flow diagram for the method second embodiment that audio-visual synchronization of the present invention plays；
Fig. 3 is the refinement flow diagram of step S60 in embodiment illustrated in fig. 2 of the present invention；
Fig. 4 is the refinement flow diagram of step S630 in embodiment illustrated in fig. 3 of the present invention；
Fig. 5 be in embodiment illustrated in fig. 4 of the present invention in step S633 according to second time difference judge whether to
The refinement flow diagram of family feedback reminder message；
Fig. 6 is the functional module structure schematic diagram for the device first embodiment that audio-visual synchronization of the present invention plays；
Fig. 7 is the functional module structure schematic diagram for the device second embodiment that audio-visual synchronization of the present invention plays；
Fig. 8 is the refinement the functional block diagram that determining module 60 is analyzed in embodiment illustrated in fig. 7 of the present invention；
Fig. 9 is the refinement the functional block diagram that submodule 630 is determined in embodiment illustrated in fig. 8 of the present invention；
Figure 10 is the refinement the functional block diagram of computing unit 633 in embodiment illustrated in fig. 9 of the present invention.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The present invention provides a kind of method that audio-visual synchronization plays.Referring to Fig.1, in the first embodiment, the audio-video is same
Walking the method played includes:
Step S10 obtains the external sound device when playing the audio of multimedia file by external sound device
Facility information；
Step S20 searches preset database according to the facility information, determines that the external sound device plays audio
When delay time, the preset database includes corresponding relationship between the facility information and the delay time；
Step S30 adjusts the video of the multimedia file according to the delay time, so that the audio and the view
Frequency is played simultaneously.
The method that audio-visual synchronization provided by the invention plays is used to work as the case where terminal is connected with external sound device
Under, when playing the audio of multimedia file using external sound device, so that the audio that external sound device plays is broadcast with terminal
The audio video synchronization put.External sound device is commonly used in connecting with terminal or plays sound with clock synchronization, and common external sound is set
Baffle Box of Bluetooth, bluetooth headset etc. are had, terminal has notebook, desktop computer, mobile phone etc..
In the present embodiment, above-mentioned multimedia file is the file comprising audio & video, when terminal and external sound device
When connecting and playing multimedia file at the terminal, picture can play (such as mobile phone, computer terminal) at the terminal, and audio can lead to
External sound device is crossed to play.When playing the audio of multimedia file by external sound device, external sound device is obtained
Facility information, the facility information is the information for identifying external sound device, and the premise for obtaining external sound device is
It to establish a connection with the external sound device.
After getting facility information, preset database is searched according to facility information, determines that the external sound device is broadcast
Delay time when playback frequency.The corresponding relationship of facility information and delay time, therefore root are saved in above-mentioned preset database
It is searched according to the facility information of external sound device into preset database, the corresponding external sound device can be obtained
Play delay time when sound.Above-mentioned preset database is present in the terminal for connecting external sound device broadcasting audio,
It can also exist on elsewhere, specific address, which can according to need, to be selected.
After getting the delay time of external sound device, it can be adjusted automatically according to the delay time of external sound device
It is first tentative etc. to can control video pictures for the synchronization of whole audio & video picture, the method for adjusting audio & video picture synchronization
To play again, the time span for suspending waiting is equal with the time span of broadcast time-delay time.
Such as when mobile phone is connect with Baffle Box of Bluetooth, when playing one section of multimedia file on mobile phone, which can be broadcast
Put the audio of the multimedia file.Before playing multimedia file, the facility information of the Baffle Box of Bluetooth is first obtained, further according to obtaining
The facility information got searches the delay time when Baffle Box of Bluetooth plays audio into preset database, is delayed when finding
When time is 5 seconds, controls slowed-down video 5 seconds of multimedia file and play, then after 5 seconds the video of terminal plays just with the indigo plant
The audio sync that tooth speaker plays.
The present embodiment is by obtaining the external sound when playing the audio of multimedia file by external sound device
The facility information of equipment；Preset database is searched according to the facility information, determines that the external sound device plays audio
When delay time, the preset database includes corresponding relationship between the facility information and the delay time；Root
The video of the multimedia file is adjusted according to the delay time, so that the audio and the audio video synchronization play.Pass through company
It connects when external sound device plays the audio of multimedia file and first obtains the facility information of the external sound device further according to equipment
The information inquiry time delay time is played simultaneously, so that using further according to the audio & video of delay time adjustment multimedia file
When external sound device plays the audio of multimedia file, manually adjusted every time without user, realize adjust automatically audio with
The synchronous purpose of video pictures.
Further, it is obtained based on the method first embodiment that audio-visual synchronization of the present invention plays in the present invention referring to Fig. 2
In the method second embodiment for taking external sound device delay time, include: before above-mentioned steps S10
Step S40 sends the first preset audio to external sound device, and record is sent at the beginning of the first of first audio
Begin the time；
Step S50 obtains the second audio and reception that the external sound device plays after sending first audio
The first time parameter of second audio；
Step S60, by the second audio time segment mark and with the first audio comparative analysis, received
The external sound device plays the initial time section of first audio, initially according to the initial time section, described first
Time and the first time parameter determine delay time when the external sound device plays audio；
Step S70 saves the facility information of the delay time and the external sound device in the database.
The present embodiment is the method for the delay time that analysis determines external sound device, when getting external sound device
After delay time, the facility information of delay time and the external sound device is stored in preset database, is made for working as
When playing the audio of multimedia file with the external sound device, the delay time of the external sound device can be obtained automatically simultaneously
It is played simultaneously according to the audio & video that delay time adjusts multimedia file.
In the present embodiment, above-mentioned the first preset audio is a preset Duan Shengyin, for distinguishing the common sound of user,
It avoids interfering when the delay time of the external sound device of analytical calculation, sends the purpose of the first audio to external sound device
It is the delay time that analysis obtains the external sound device, can be selected as needed a kind of specific frequency specific sound length
Sound is as the first audio.The method for sending the first preset audio to external sound device can be by external sound device energy
Enough directly received modes are sent, such as are sent to Baffle Box of Bluetooth by the equipment with bluetooth module.When sending preset the
While one audio to external sound device, record saves the first initial time for sending the first audio.
After sending the first audio, the second audio that external sound device plays is obtained, when the normal work of external sound device
The first audio may be had correctly received when making to start to play the second audio later, it is also possible to be not properly received the first sound
Frequently.At this point, no matter whether external sound device has correctly received the first audio, the second sound that external sound device plays all is obtained
Frequently, and the first time parameter of the second audio of reception, above-mentioned first time parameter are the time related with the second audio is received
Parameter specifically records the time for receiving each audio data of the second audio while receiving the second audio.Therefore,
It can be received the time of each audio data of the second audio according to first time parameter.
Then by the second audio time segment mark and with the first audio comparative analysis, obtain receiving the external sound
The initial time section of first audio described in device plays.When external sound device works normally, after receiving the first audio
The first audio can be played, at this time in the second audio can include the first audio audio data, therefore by determine receive it is external
Sound device plays the initial time section of the first audio, when can determine after sending the first audio to external sound device
It gets external sound device and plays the first audio.Since first time parameter is to join the time related with the second audio is received
Number, the time of each audio data comprising receiving the second audio, therefore the initial of the first audio is received when having determined
After period, the initial time point for receiving the initial time of the first audio can be obtained according to first time parameter, then again
Delay time when the external sound device plays audio is determined according to the first initial time for sending the first audio.
After delay time when being determined that external sound device plays audio, by the delayed data of the external sound device
Delayed data corresponding with facility information to be stored in preset database, when the external sound device being enabled to play sound
It directly acquires when needed.
The embodiment of the present invention by sending the preset external sound device of the first audio, record transmission first it is initial when
Between, then the second audio of the external sound device is obtained, and receive the first time parameter of the second audio, then according to first
Audio and the second audio comparative analysis obtain receiving the initial time section that external sound device plays the first audio, further according to first
Period, the first initial time and the first time parameter of beginning determine delay time when external sound device plays sound, and will
The facility information of delay time and the external sound device saves, and realizes the delay for obtaining and saving automatically external sound device
Time, and after delay time and facility information are saved according to the facility information of preservation and can prolong when next time reconnects
When time adjust automatically connect the external sound device play when audio & video picture synchronization.
Further, it is obtained based on the method second embodiment that audio-visual synchronization of the present invention plays in the present invention referring to Fig. 3
In the method 3rd embodiment for taking external sound device delay time, above-mentioned steps S60 includes:
Step S610 is divided into N sections, N is positive integer by second audio according to preset time interval segmentation markers；
Step S620, the i-th piecewise analysis audio after obtaining the second audio parsing label, the initial value of i is that 1, i is less than
Or it is equal to N；
The i-th piecewise analysis audio and the first audio comparative analysis are obtained receiving described external by step S630
Sound device plays the initial time section of first audio, according to the initial time section, first initial time and institute
State delay time when first time parameter determines the external sound device broadcasting audio.
In the present embodiment it is above-mentioned second audio is referred to according to preset time interval segmentation the second audio is respectively classified into N
Section, wherein the value of preset time interval and N can according to need and carry out selection setting.Such as get the second audio be 3
Second when, the second audio is divided into 30 sections, i.e. N=30, every 0.1 second every section.
After the second audio has done segmentation markers processing, the first segment after obtaining the second audio parsing label is as first segment
Audio is analyzed, such as obtains the 0-0.1 second of the second section audio as the first piecewise analysis audio.Purpose is first to be segmented the second audio
It compares again with the first audio after label.
By obtaining receiving external by the i-th piecewise analysis audio and the first audio comparative analysis after the second audio indicia
Sound device plays the initial time section of the first audio, further according to initial time section, the first initial time and first time parameter
Determine delay time when external sound device plays audio.
The embodiment of the present invention is received by according to preset time interval segmentation markers and analyzing the first audio
External sound device plays the initial time section of the first audio, then according to initial time section, the first initial time and first when
Between parameter determine the delay time of external sound device so that judging without user, it will be able to obtain external sound device automatically
Delay time.
Further, it is obtained based on the method 3rd embodiment that audio-visual synchronization of the present invention plays in the present invention referring to Fig. 4
It takes in external sound device delay time fourth embodiment, includes at the beginning of receiving the second of second audio in first time parameter
Begin the time, receive the third initial time of the i-th piecewise analysis audio described in second audio and receive second audio
End time；
Then the refinement step of above-mentioned steps S630 includes:
Step S631, judges whether the i-th piecewise analysis audio and the similarity of first audio are less than preset value；If
It is to execute step S632；Otherwise, step S633 is executed；
Step S632, obtaining i-th section is the initial time section for playing first audio, determines the i-th piecewise analysis sound
The first time difference of the third initial time of frequency and first initial time is the delay time；
Step S633 calculates the second time difference of the end time Yu the second initial time, when according to described second
Between difference judge whether to user feedback reminder message.
Above-mentioned second initial time is time when receiving the second audio that external sound device plays in the present embodiment,
Above-mentioned third initial time is the initial time for receiving external sound device and playing the i-th piecewise analysis audio, and the above-mentioned end time is
External sound device plays the end time of the i-th piecewise analysis audio, since the first parameter is in the audio for receiving the second audio
The time persistently recorded when data, therefore above-mentioned third initial time and end time are also recorded.Above-mentioned judgement described i-th
The purpose whether similarity of piecewise analysis audio and first audio is less than preset value is to receive external sound device
Sound is compared with sound when sending, and judgement receives the initial time section that external sound device plays the first audio.By
Be made of in one section of voice data continuous audio data, two section audios it is similar in the voice data at some moment it is not intended that
Two section audios be same a segment of audio, therefore the judgement of audio similitude needs to carry out by multiple continuous audio datas pair
Than taking the i-th piecewise analysis audio here to compare with the first audio.Usual external sound device receives sound and plays again
When out, sound also can be lossy, therefore when the i-th piecewise analysis audio and the first audio are compared and analyzed, as long as audio
Similarity is in a certain range it is determined that the two is same section of sound, wherein preset value, which can according to need, to be set.
The method that two sections of sound compare and analyze similarity is had very much, the prior art is belonged to, which is not described herein again.It can be according to need
Selection method is wanted to analyze the i-th piecewise analysis audio with the first audio.
When the similarity of the i-th piecewise analysis audio and the first audio is less than preset value, show to broadcast in the i-th piecewise analysis audio
The first audio is put, i-th section is the initial time section for receiving external sound device and playing the first audio.At this point, obtaining from hair
Send the first audio to receive the i-th piecewise analysis audio have passed through how long, so that it may obtain external sound device and play sound
When delay time.Therefore, the first when initial time for receiving the i-th piecewise analysis audio to be subtracted to the second audio of transmission is initial
Time, it is poor at the first time to obtain, at the first time delay time when poor as external sound device broadcasting sound.
When the i-th piecewise analysis audio and the similarity of the first section audio are not less than preset value, show that the two may not be same
One Duan Shengyin calculates the knot for receiving the second audio at this time at this point, whether the second audio that judgement is got is effective sound
The second time difference between beam time and the second initial time for receiving the second audio, then the second time difference was the second audio
Time span.It is whether wrong according to the time span of the second audio analysis receive process, if wrong, directly mentioned to user feedback
Awake message, for reminding user to carry out next step operation.
The embodiment of the present invention is analyzed by comparing the similarity of the i-th piecewise analysis audio and the first audio and preset value
To the initial time section for receiving the first audio of external sound device broadcasting, the first of the initial time section for playing the first audio is calculated
The time difference of first initial time of the first audio of time and transmission that begins, i.e., when the i-th piecewise analysis audio is similar to the first audio
When degree is less than preset value, described in the time difference conduct of the third initial time and the first initial time of the i-th piecewise analysis audio of calculating
Delay time, to obtain delay time when external sound device plays sound automatically.
Further, it is obtained based on the method fourth embodiment that audio-visual synchronization of the present invention plays in the present invention referring to Fig. 5
It takes in external the 5th embodiment of sound device delay time, is judged whether in above-mentioned steps S633 according to second time difference
Refinement step to user feedback reminder message includes:
Step S301, judges whether second time difference is greater than the preset limitation time；If so, executing step
S302, it is no to then follow the steps S303；
Step S302 confirms the reminder message of the delay time failure to user feedback；
Step S303 enables i=i+1, and when i is less than or equal to N, returns and execute acquisition second audio parsing
The step of the i-th piecewise analysis audio after label.
Above-mentioned second time difference is exactly the length for the second audio that external sound device plays in the present embodiment.It is above-mentioned pre-
The limitation time set is set as needed, it is therefore an objective to which whether the length for judging the second audio got has been more than certain
Limitation.
If the similarity of the first piecewise analysis audio and the first audio has been more than preset value, the time of the second audio is more than again
The preset limitation time shows that the second audio received may be wrong, and external sound device may not worked normally, therefore
Confirmation delay time failure news is sent to user, can also send whether just message notifying user confirms external sound device
Often work, user can carry out the operation of next step according to the message received, such as send out again after adjusting external sound device
Send sound.
If the sound similarity of the first piecewise analysis audio and the first audio has been more than preset value, but the time of the second audio
It is not above the preset limitation time, shows that the second audio received is not necessarily wrong, this season i=i+1 executes acquisition
The i-th piecewise analysis audio after second audio parsing label, judges the similarity of the i-th piecewise analysis audio Yu first audio
The step of whether being less than preset value.
For example, when before obtain the second audio first period 0 to 0.1 second sound and the first audio into
After row comparative analysis, second period of the first audio, the audio in 0.1 second to 0.2 second this section, by 0.1 are obtained at this time
Audio in 0.2 this period of time is compared and analyzed with the first audio.
When the similarity of the second piecewise analysis audio and the first audio is more than preset value, can continue to obtain third piecewise analysis
Audio compares, until finding two sections of similar audios.When N sections of sound equal not phase compared with the first audio in the second audio
Meanwhile message notifying can be sent to user, it is confirmed whether that sound clip is wrong by user.
For example, 12:01 when receiving the time of audio is got when the initial time for sending the first audio is 12:00
Second audio is 3 seconds, is divided into 30 sections, every section 0.1 second, then the period of the first piecewise analysis audio is 12:01 to 12:02, second
Piecewise analysis audio is 12:02 to 12:03, is so analogized, and the period of the 5th piecewise analysis audio is 12:05 to 12:06, when the 5th
Piecewise analysis audio compared with the first audio less than preset value when, show the 5th section be play the first audio initial time section, this
When delay time be 0.5 second, that is, 12:05 subtracts the time difference of 12:00.
The present embodiment is by further judging when the similarity of the i-th piecewise analysis audio and the first audio is greater than preset value
Whether the second time difference is greater than the preset limitation time, when the second time difference is greater than the preset limitation time, to user
Reminder message is fed back, when being not more than, continues acquisition i+1 piecewise analysis audio and compares audio to i+1 section and judge that its is similar
Property, to obtain the delay time of external sound device automatically, delay time is saved after obtaining delay time, so that again
Audio-video picture synchronization can be adjusted according to delay time when secondary use.
The present invention also provides the devices that a kind of audio-visual synchronization plays to provide audio-visual synchronization of the present invention and broadcast referring to Fig. 6
The device first embodiment put, in the embodiment, the device that audio-visual synchronization plays includes:
First obtains module 10, for when through the audio of external sound device broadcasting multimedia file, described in acquisition
The facility information of external sound device；
It searches determining module 20 and determines the external sound for searching preset database according to the facility information
Delay time when device plays audio, the preset database include between the facility information and the delay time
Corresponding relationship；
Module 30 is adjusted, for adjusting the video of the multimedia file according to the delay time, so that the audio
It is played with the audio video synchronization.
The device that audio-visual synchronization provided by the invention plays is used to work as the case where terminal is connected with external sound device
Under, when playing the audio of multimedia file using external sound device, so that the audio that external sound device plays is broadcast with terminal
The audio video synchronization put.External sound device is commonly used in connecting with terminal or plays sound with clock synchronization, and common external sound is set
Baffle Box of Bluetooth, bluetooth headset etc. are had, terminal has notebook, desktop computer, mobile phone etc..
In the present embodiment, above-mentioned multimedia file is the file comprising audio & video, when terminal and external sound device
When connecting and playing multimedia file at the terminal, picture can play (such as mobile phone, computer terminal) at the terminal, and audio can lead to
External sound device is crossed to play.When playing the audio of multimedia file by external sound device, the first acquisition module 10 is obtained
The facility information of external sound device is taken, the facility information is the information for identifying external sound device, obtains external sound
The premise of sound equipment is to establish a connection with the external sound device.
It after getting facility information, searches determining module 20 and searches preset database according to facility information, determining should
External sound device plays delay time when audio.Pair of facility information and delay time is saved in above-mentioned preset database
It should be related to, therefore be searched according to the facility information of external sound device into preset database, can be obtained corresponding
The external sound device plays delay time when sound.Above-mentioned preset database is present in the external sound device of connection and plays
It in the terminal of audio, can also exist on elsewhere, specific address, which can according to need, to be selected.
After getting the delay time of external sound device, module 30 is adjusted according to the delay time of external sound device
The synchronization of adjust automatically audio & video picture, the method for adjusting audio & video picture synchronization can control video pictures elder generation
Tentative waiting plays again, and the time span for suspending waiting is equal with the time span of broadcast time-delay time.
Such as when mobile phone is connect with Baffle Box of Bluetooth, when playing one section of multimedia file on mobile phone, which can be broadcast
Put the audio of the multimedia file.Before playing multimedia file, the facility information of the Baffle Box of Bluetooth is first obtained, further according to obtaining
The facility information got searches the delay time when Baffle Box of Bluetooth plays audio into preset database, is delayed when finding
When time is 5 seconds, controls slowed-down video 5 seconds of multimedia file and play, then after 5 seconds the video of terminal plays just with the indigo plant
The audio sync that tooth speaker plays.
The present embodiment is by obtaining the external sound when playing the audio of multimedia file by external sound device
The facility information of equipment；Preset database is searched according to the facility information, determines that the external sound device plays audio
When delay time, the preset database includes corresponding relationship between the facility information and the delay time；Root
The video of the multimedia file is adjusted according to the delay time, so that the audio and the audio video synchronization play.Pass through company
It connects when external sound device plays the audio of multimedia file and first obtains the facility information of the external sound device further according to equipment
The information inquiry time delay time is played simultaneously, so that using further according to the audio & video of delay time adjustment multimedia file
When external sound device plays the audio of multimedia file, manually adjusted every time without user, realize adjust automatically audio with
The synchronous purpose of video pictures.
Further, referring to Fig. 7, based on the device first embodiment that audio-visual synchronization of the present invention plays, in sound of the present invention
In the device second embodiment that audio video synchronization plays, the device of above-mentioned audio-visual synchronization broadcasting further include:
Audio sending module 40, for sending the first preset audio to external sound device, record sends described first
First initial time of audio；
Second obtains module 50, for after sending first audio, obtaining that the external sound device plays
Two audios and the first time parameter for receiving second audio；
Determining module 60 is analyzed, for marking and with first audio the second audio time segment to score
Analysis, obtain receiving the initial time section that the external sound device plays first audio, according to the initial time section,
First initial time and the first time parameter determine delay time when the external sound device plays audio；
Preserving module 70, for the facility information of the delay time and the external sound device to be stored in the number
According in library.
The present embodiment is the method for the delay time that analysis determines external sound device, when getting external sound device
After delay time, the facility information of delay time and the external sound device is stored in preset database, is made for working as
When playing the audio of multimedia file with the external sound device, the delay time of the external sound device can be obtained automatically simultaneously
It is played simultaneously according to the audio & video that delay time adjusts multimedia file.
In the present embodiment, above-mentioned the first preset audio is a preset Duan Shengyin, for distinguishing the common sound of user,
It avoids interfering when the delay time of the external sound device of analytical calculation, audio sending module 40 sends the first audio to external
The purpose of sound device is the delay time that analysis obtains the external sound device, can be selected as needed a kind of specific frequency
The sound of specific sound length is as the first audio.The method for sending the first preset audio to external sound device can pass through
The mode that external sound device is able to receive directly is sent, such as is sent to Baffle Box of Bluetooth by the equipment with bluetooth module.
While sending preset the first audio to external sound device, record saves the first initial time for sending the first audio.
After sending the first audio, the second acquisition module 50 obtains the second audio that external sound device plays, when external
Sound device starts to play the second audio after may having had correctly received the first audio when working normally, it is also possible to without correct
Receive the first audio.At this point, no matter whether external sound device has correctly received the first audio, external sound device is all obtained
The second audio played, and the first time parameter of the second audio is received, above-mentioned first time parameter is and receives the second sound
Frequently related time parameter specifically records each audio data for receiving the second audio while receiving the second audio
Time.Therefore, it can be received the time of each audio data of the second audio according to first time parameter.
Then analysis determining module 60 by the second audio time segment mark and with the first audio comparative analysis, received
The initial time section of first audio is played to the external sound device.When external sound device works normally, connecing
The first audio can be played after receiving the first audio, can include the audio data of the first audio in the second audio at this time, therefore pass through
It determines and receives the initial time section that external sound device plays the first audio, can determine and send the first audio to external sound
After sound equipment, when gets external sound device and play the first audio.Since first time parameter is and receives the second audio
Related time parameter, the time of each audio data comprising receiving the second audio, therefore the is received when determine
After the initial time section of one audio, can be obtained according to first time parameter the initial time for receiving the first audio it is initial when
Between point, delay when the external sound device plays audio is then determined further according to the first initial time for sending the first audio
Time.
After delay time when being determined that external sound device plays audio, preserving module 70 is by the external sound device
Delayed data it is corresponding with facility information be stored in preset database so that prolonging when the external sound device plays sound
When information can directly acquire when needed.
The embodiment of the present invention by sending the preset external sound device of the first audio, record transmission first it is initial when
Between, then the second audio of the external sound device is obtained, and receive the first time parameter of the second audio, then according to first
Audio and the second audio comparative analysis obtain receiving the initial time section that external sound device plays the first audio, further according to first
Period, the first initial time and the first time parameter of beginning determine delay time when external sound device plays sound, and will
The facility information of delay time and the external sound device saves, and realizes the delay for obtaining and saving automatically external sound device
Time, and after delay time and facility information are saved according to the facility information of preservation and can prolong when next time reconnects
When time adjust automatically connect the external sound device play when audio & video picture synchronization.
Further, referring to Fig. 8, based on the device second embodiment that audio-visual synchronization of the present invention plays, in sound of the present invention
In the device 3rd embodiment that audio video synchronization plays, above-mentioned analysis determining module 60 includes:
Audio processing submodule 610, for second audio according to preset time interval segmentation markers, to be divided into N
Section, N is positive integer；
Acquisition submodule 620, for obtaining the i-th piecewise analysis audio after second audio parsing marks, the initial value of i
It is less than or equal to N for 1, i；
Submodule 630 is determined, for being received the i-th piecewise analysis audio and the first audio comparative analysis
The initial time section that first audio is played to the external sound device, according at the beginning of the initial time section, described first
Time beginning and the first time parameter determine delay time when the external sound device plays audio.
In the present embodiment above-mentioned audio processing submodule 610 by the second audio according to preset time interval segmentation refer to by
Second audio is respectively classified into N sections, wherein the value of preset time interval and N can according to need and carry out selection setting.Such as
When to get the second audio be 3 seconds, the second audio is divided into 30 sections, i.e. N=30, every 0.1 second every section.
After the second audio has done segmentation markers processing, acquisition submodule 620 obtains the after the second audio parsing label
One section is used as the first piecewise analysis audio, such as obtains the 0-0.1 second of the second section audio as the first piecewise analysis audio.Purpose be by
It compares again with the first audio after second audio elder generation segmentation markers.
Determine that submodule 630 by the i-th piecewise analysis audio and the first audio comparative analysis after the second audio indicia, is connect
The initial time section that external sound device plays the first audio is received, further according to initial time section, the first initial time and first
Time parameter determines delay time when external sound device plays audio.
The embodiment of the present invention is received by according to preset time interval segmentation markers and analyzing the first audio
External sound device plays the initial time section of the first audio, then according to initial time section, the first initial time and first when
Between parameter determine the delay time of external sound device so that judging without user, it will be able to obtain external sound device automatically
Delay time.
Further, referring to Fig. 9, based on the device 3rd embodiment that audio-visual synchronization of the present invention plays, in sound of the present invention
It include at the beginning of receiving the second of second audio in the device fourth embodiment that audio video synchronization plays, in above-mentioned first time parameter
Begin the time, receive the third initial time of the i-th piecewise analysis audio described in second audio and receive second audio
End time；
Above-mentioned determining submodule 630 includes:
Judging unit 631, for judging it is pre- whether the similarity of the i-th piecewise analysis audio and first audio is less than
If value；
Determination unit 632 is less than preset value for the similarity when the i-th piecewise analysis audio and first audio
When, obtaining i-th section is the initial time section for playing first audio, when determining that the third of the i-th piecewise analysis audio is initial
Between with the first time difference of first initial time be the delay time；
Computing unit 633 is not less than preset value for the similarity when the i-th piecewise analysis audio and first audio
When, the second time difference of the end time Yu the second initial time are calculated, is judged whether according to second time difference
To user feedback reminder message.
Above-mentioned second initial time is time when receiving the second audio that external sound device plays in the present embodiment,
Above-mentioned third initial time is the initial time for receiving external sound device and playing the i-th piecewise analysis audio, and the above-mentioned end time is
External sound device plays the end time of the i-th piecewise analysis audio, since the first parameter is in the audio for receiving the second audio
The time persistently recorded when data, therefore above-mentioned third initial time and end time are also recorded.Above-mentioned judging unit 631
The purpose for judging whether the similarity of the i-th piecewise analysis audio and first audio is less than preset value is to set external sound
Sound when the standby sound received and transmission compares, and judgement receives external sound device and plays the initial of the first audio
Period.Since one section of voice data is made of continuous audio data, voice data of two section audios at some moment
It is similar not mean that two section audios are same a segment of audio, therefore the judgement of audio similitude is needed through multiple continuous audio numbers
According to comparing, the i-th piecewise analysis audio is taken here to compare with the first audio.Usual external sound device receives sound
When sound plays back again, sound also can be lossy, therefore when the i-th piecewise analysis audio and the first audio are compared and analyzed, only
Want the similarity of audio in a certain range it is determined that the two is same section of sound, wherein preset value can according to need
It is set.The method that two sections of sound compare and analyze similarity is had very much, the prior art is belonged to, which is not described herein again.
It can according to need selection method and analyze the i-th piecewise analysis audio with the first audio.
When the similarity of the i-th piecewise analysis audio and the first audio is less than preset value, show to broadcast in the i-th piecewise analysis audio
The first audio is put, determination unit 632 determines that i-th section is the initial time for receiving external sound device and playing the first audio
Section.At this point, obtain from send the first audio to receive the i-th piecewise analysis audio have passed through how long, so that it may obtain external
Sound device plays delay time when sound.Therefore, the initial time for receiving the i-th piecewise analysis audio is subtracted into transmission second
The first initial time when audio, it is poor at the first time to obtain, and poor at the first time is prolonging when external sound device plays sound
When the time.
When the i-th piecewise analysis audio and the similarity of the first section audio are not less than preset value, show that the two may not be same
One Duan Shengyin, at this point, whether the second audio that judgement is got is effective sound, the calculating of computing unit 633 receives at this time
The second time difference between end time of second audio and the second initial time for receiving the second audio, then the second time difference be
For the time span of the second audio.It is whether wrong according to the time span of the second audio analysis receive process, if wrong, directly
To user feedback reminder message, for reminding user to carry out next step operation.
The embodiment of the present invention is analyzed by comparing the similarity of the i-th piecewise analysis audio and the first audio and preset value
To the initial time section for receiving the first audio of external sound device broadcasting, the first of the initial time section for playing the first audio is calculated
The time difference of first initial time of the first audio of time and transmission that begins, i.e., when the i-th piecewise analysis audio is similar to the first audio
When degree is less than preset value, described in the time difference conduct of the third initial time and the first initial time of the i-th piecewise analysis audio of calculating
Delay time, to obtain delay time when external sound device plays sound automatically.
Further, referring to Fig.1 0, based on the device fourth embodiment that audio-visual synchronization of the present invention plays, in sound of the present invention
In the 5th embodiment of device that audio video synchronization plays, above-mentioned computing unit 633 includes:
Judgment sub-unit 301, for judging whether second time difference is greater than the preset limitation time；
Message feedback subelement 302, for when second time difference be greater than the preset limitation time when, it is anti-to user
Feedback confirms the reminder message of the delay time failure；
Subelement 303 is triggered, for enabling i=i+1 when second time difference is not more than the preset limitation time,
And when i is less than or equal to N, triggers the acquisition submodule and obtain the i-th piecewise analysis sound after the second audio parsing label
Frequently.
Above-mentioned second time difference is exactly the length for the second audio that external sound device plays in the present embodiment.It is above-mentioned pre-
The limitation time set is set as needed, it is therefore an objective to which whether the length for judging the second audio got has been more than certain
Limitation.
If the similarity of the first piecewise analysis audio and the first audio has been more than preset value, the time of the second audio is more than again
The preset limitation time shows that the second audio received may be wrong, and external sound device may not worked normally, therefore
Confirmation delay time failure news is sent to user, can also send whether just message notifying user confirms external sound device
Often work, user can carry out the operation of next step according to the message received, such as send out again after adjusting external sound device
Send sound.
If the sound similarity of the first piecewise analysis audio and the first audio has been more than preset value, but the time of the second audio
It is not above the preset limitation time, shows that the second audio received is not necessarily wrong, it is single to trigger son by this season i=i+1
Member 303 triggers acquisition submodule 620 and obtains the i-th piecewise analysis audio after the second audio parsing label, judges i-th piecewise analysis
Whether the similarity of audio and first audio is less than preset value.
For example, when before obtain the second audio first period 0 to 0.1 second sound and the first audio into
After row comparative analysis, second period of the first audio, the audio in 0.1 second to 0.2 second this section, by 0.1 are obtained at this time
Audio in 0.2 this period of time is compared and analyzed with the first audio.
When the similarity of the second piecewise analysis audio and the first audio is more than preset value, can continue to obtain third piecewise analysis
Audio compares, until finding two sections of similar audios.When N sections of sound equal not phase compared with the first audio in the second audio
Meanwhile message notifying can be sent to user, it is confirmed whether that sound clip is wrong by user.
For example, 12:01 when receiving the time of audio is got when the initial time for sending the first audio is 12:00
Second audio is 3 seconds, is divided into 30 sections, every section 0.1 second, then the period of the first piecewise analysis audio is 12:01 to 12:02, second
Piecewise analysis audio is 12:02 to 12:03, is so analogized, and the period of the 5th piecewise analysis audio is 12:05 to 12:06, when the 5th
Piecewise analysis audio compared with the first audio less than preset value when, show the 5th section be play the first audio initial time section, this
When delay time be 0.5 second, that is, 12:05 subtracts the time difference of 12:00.
The present embodiment is by further judging when the similarity of the i-th piecewise analysis audio and the first audio is greater than preset value
Whether the second time difference is greater than the preset limitation time, when the second time difference is greater than the preset limitation time, to user
Reminder message is fed back, when being not more than, continues acquisition i+1 piecewise analysis audio and compares audio to i+1 section and judge that its is similar
Property, to obtain the delay time of external sound device automatically, delay time is saved after obtaining delay time, so that again
Audio-video picture synchronization can be adjusted according to delay time when secondary use.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (8)
1. a kind of method that audio-visual synchronization plays, which is characterized in that the described method comprises the following steps:
When playing the audio of multimedia file by external sound device, the facility information of the external sound device is obtained；
Preset database is searched according to the facility information, when determining delay when the external sound device plays audio
Between, the preset database includes the corresponding relationship between the facility information and the delay time；
The video of the multimedia file is adjusted according to the delay time, so that the audio and the audio video synchronization play；
Wherein, described when playing the audio of multimedia file by external sound device, obtain the external sound device
Include: before facility information
The first preset audio is sent to external sound device, record sends the first initial time of first audio；
After sending first audio, the second audio and receive second audio that the external sound device plays are obtained
First time parameter；
By the second audio time segment mark and with the first audio comparative analysis, obtain receiving the external sound
The initial time section of first audio described in device plays, according to the initial time section, first initial time and described
One time parameter determines delay time when the external sound device plays audio；
The facility information of the delay time and the external sound device is saved in the database.
2. the method as described in claim 1, which is characterized in that it is described by the second audio time segment mark and with it is described
First audio comparative analysis obtains receiving the initial time section that the external sound device plays first audio, according to
The initial time section, first initial time and the first time parameter determine that the external sound device plays audio
When delay time include:
By second audio according to preset time interval segmentation markers, it is divided into N sections, N is positive integer；
The i-th piecewise analysis audio after obtaining the second audio parsing label, the initial value of i are that 1, i is less than or equal to N；
By the i-th piecewise analysis audio and the first audio comparative analysis, obtain receiving the external sound device broadcasting
The initial time section of first audio is joined according to the initial time section, first initial time and the first time
Number determines delay time when the external sound device plays audio.
3. method according to claim 2, which is characterized in that include receiving second audio in the first time parameter
The second initial time, receive the third initial time of the i-th piecewise analysis audio described in second audio and receive described the
The end time of two audios；
It is then described by the i-th piecewise analysis audio and the first audio comparative analysis, it obtains receiving the external sound and sets
The standby initial time section for playing first audio, according to the initial time section, first initial time and described first
Time parameter determines that delay time when the external sound device plays audio includes:
Judge whether the i-th piecewise analysis audio and the similarity of first audio are less than preset value；
If so, obtaining i-th section is the initial time section for playing first audio, the of the i-th piecewise analysis audio is determined
The first time difference of three initial times and first initial time is the delay time；
If it is not, the second time difference of the end time Yu the second initial time are then calculated, according to second time difference
Judge whether to user feedback reminder message.
4. method as claimed in claim 3, which is characterized in that described to be judged whether according to second time difference to user
Feeding back reminder message includes:
Judge whether second time difference is greater than the preset limitation time；
If so, confirming the reminder message of the delay time failure to user feedback；
If it is not, then enabling i=i+1, and when i is less than or equal to N, return after executing the acquisition the second audio parsing label
The i-th piecewise analysis audio the step of.
5. the device that a kind of audio-visual synchronization plays, which is characterized in that the device that the audio-visual synchronization plays includes:
First obtains module, for obtaining the external sound when playing the audio of multimedia file by external sound device
The facility information of sound equipment；
It searches determining module and determines that the external sound device is broadcast for searching preset database according to the facility information
Delay time when playback frequency, the preset database include the corresponding pass between the facility information and the delay time
System；
Adjust module, for adjusting the video of the multimedia file according to the delay time so that the audio with it is described
Audio video synchronization plays；
Wherein, the device that the audio-visual synchronization plays further include:
Audio sending module, for sending the first preset audio to external sound device, record sends first audio
First initial time；
Second obtains module, the second audio played for after sending first audio, obtaining the external sound device
And receive the first time parameter of second audio；
Analyze determining module, for will the second audio time segment label and with the first audio comparative analysis, obtain
The initial time section that the external sound device plays first audio is received, according to the initial time section, described
One initial time and the first time parameter determine delay time when the external sound device plays audio；
Preserving module, for the facility information of the delay time and the external sound device to be stored in the database
In.
6. device as claimed in claim 5, which is characterized in that the analysis determining module includes:
Audio processing submodule, for second audio according to preset time interval segmentation markers, to be divided into N sections, N is positive
Integer；
Acquisition submodule, for obtaining the i-th piecewise analysis audio after second audio parsing marks, the initial value of i is that 1, i is small
In or equal to N；
Determine submodule, it is described outer for by the i-th piecewise analysis audio and the first audio comparative analysis, obtaining receiving
Connect the initial time section that sound device plays first audio, according to the initial time section, first initial time and
The first time parameter determines delay time when the external sound device plays audio.
7. device as claimed in claim 6, which is characterized in that include receiving second audio in the first time parameter
The second initial time, receive the third initial time of the i-th piecewise analysis audio described in second audio and receive described the
The end time of two audios；
Then the determining submodule includes:
Judging unit, for judging whether the i-th piecewise analysis audio and the similarity of first audio are less than preset value；
Determination unit, for when the similarity of the i-th piecewise analysis audio and first audio is less than preset value, obtaining the
I sections are the initial time section for playing first audio, determine the third initial time and described the of the i-th piecewise analysis audio
The first time difference of one initial time is the delay time；
Computing unit, for calculating when the similarity of the i-th piecewise analysis audio and first audio is not less than preset value
The second time difference of the end time and the second initial time judge whether anti-to user according to second time difference
Present reminder message.
8. device as claimed in claim 7, which is characterized in that the computing unit includes:
Judgment sub-unit, for judging whether second time difference is greater than the preset limitation time；
Message feedback subelement, for being confirmed to user feedback when second time difference is greater than the preset limitation time
The reminder message of the delay time failure；
Subelement is triggered, for when second time difference is not more than the preset limitation time, enabling i=i+1, and when i is small
When N, triggers the acquisition submodule and obtain the i-th piecewise analysis audio after the second audio parsing label.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610221519.1A CN105898502B (en) | 2016-04-11 | 2016-04-11 | The method and device that audio-visual synchronization plays |
| PCT/CN2016/084944 WO2017177524A1 (en) | 2016-04-11 | 2016-06-06 | Audio and video playing synchronization method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610221519.1A CN105898502B (en) | 2016-04-11 | 2016-04-11 | The method and device that audio-visual synchronization plays |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105898502A CN105898502A (en) | 2016-08-24 |
| CN105898502B true CN105898502B (en) | 2019-09-20 |
Family
ID=57012333
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610221519.1A Active CN105898502B (en) | 2016-04-11 | 2016-04-11 | The method and device that audio-visual synchronization plays |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105898502B (en) |
| WO (1) | WO2017177524A1 (en) |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106782598A (en) * | 2016-12-15 | 2017-05-31 | 深圳Tcl数字技术有限公司 | Television image and peripheral hardware synchronous sound control method and device |
| CN108616767B (en) * | 2018-04-28 | 2020-12-29 | 海信视像科技股份有限公司 | Audio data transmission method and device |
| US11416209B2 (en) * | 2018-10-15 | 2022-08-16 | Sonos, Inc. | Distributed synchronization |
| CN109451339B (en) * | 2018-12-28 | 2021-10-01 | 深圳Tcl新技术有限公司 | Audio transmission method, device, equipment and readable storage medium |
| CN112449278B (en) * | 2019-09-03 | 2022-04-22 | 深圳Tcl数字技术有限公司 | Method, device and equipment for automatically calibrating delay output sound and storage medium |
| CN110971783B (en) * | 2019-11-29 | 2022-08-02 | 深圳创维－Rgb电子有限公司 | Television sound and picture synchronous self-tuning method, device and storage medium |
| CN113555132A (en) * | 2020-04-24 | 2021-10-26 | 华为技术有限公司 | Multi-source data processing method, electronic device and computer-readable storage medium |
| CN112004133A (en) * | 2020-09-04 | 2020-11-27 | 成都极米科技股份有限公司 | Sound and picture synchronization method and device, projection equipment and readable storage medium |
| CN112073879B (en) * | 2020-09-11 | 2022-04-29 | 成都极米科技股份有限公司 | Audio synchronous playing method and device, video playing equipment and readable storage medium |
| CN114296667A (en) * | 2021-03-11 | 2022-04-08 | 海信视像科技股份有限公司 | Display device |
| CN113409817B (en) * | 2021-06-24 | 2022-05-13 | 浙江松会科技有限公司 | Audio signal real-time tracking comparison method based on voiceprint technology |
| CN113645544A (en) * | 2021-07-02 | 2021-11-12 | 武汉市聚芯微电子有限责任公司 | Play control method and device and electronic equipment |
| CN113825022B (en) * | 2021-09-03 | 2023-08-18 | 成都欧珀通信科技有限公司 | Method and device for detecting play control state, storage medium and electronic equipment |
| CN114040237A (en) * | 2021-09-30 | 2022-02-11 | 茂佳科技(广东)有限公司 | Audio and video synchronous playing method, terminal, multimedia playing system and medium |
| CN116368809A (en) * | 2021-10-27 | 2023-06-30 | 京东方科技集团股份有限公司 | Audio and video synchronization method and device, storage medium and electronic equipment |
| CN114070955B (en) * | 2021-11-29 | 2023-06-20 | 杭州逗酷软件科技有限公司 | Synchronization judging method and device and storage medium |
| CN115603848A (en) * | 2022-10-28 | 2023-01-13 | 惠州市德赛西威汽车电子股份有限公司（Cn） | Method for realizing vehicle prompt signal synchronization, synchronization system and vehicle |
| CN116033228A (en) * | 2022-12-20 | 2023-04-28 | 深圳市东明炬创电子股份有限公司 | Multipath audio and video integration method, device, equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101933333A (en) * | 2007-10-08 | 2010-12-29 | 摩托罗拉公司 | Remote audio and fixed video is synchronous |
| CN103905877A (en) * | 2014-03-13 | 2014-07-02 | 北京奇艺世纪科技有限公司 | Playing method of audio data and video data, smart television set and mobile equipment |
| CN103905880A (en) * | 2014-03-13 | 2014-07-02 | 北京奇艺世纪科技有限公司 | Playing method of audio data and video data, smart television set and mobile equipment |
| CN104796578A (en) * | 2015-04-29 | 2015-07-22 | 成都陌云科技有限公司 | Multi-screen synchronization method based on program audio features |
| CN105451056A (en) * | 2015-11-20 | 2016-03-30 | 小米科技有限责任公司 | Audio and video synchronization method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI501673B (en) * | 2011-02-16 | 2015-09-21 | Amtran Technology Co Ltd | Method of synchronized playing video and audio data and system thereof |
-
2016
- 2016-04-11 CN CN201610221519.1A patent/CN105898502B/en active Active
- 2016-06-06 WO PCT/CN2016/084944 patent/WO2017177524A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101933333A (en) * | 2007-10-08 | 2010-12-29 | 摩托罗拉公司 | Remote audio and fixed video is synchronous |
| CN103905877A (en) * | 2014-03-13 | 2014-07-02 | 北京奇艺世纪科技有限公司 | Playing method of audio data and video data, smart television set and mobile equipment |
| CN103905880A (en) * | 2014-03-13 | 2014-07-02 | 北京奇艺世纪科技有限公司 | Playing method of audio data and video data, smart television set and mobile equipment |
| CN104796578A (en) * | 2015-04-29 | 2015-07-22 | 成都陌云科技有限公司 | Multi-screen synchronization method based on program audio features |
| CN105451056A (en) * | 2015-11-20 | 2016-03-30 | 小米科技有限责任公司 | Audio and video synchronization method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105898502A (en) | 2016-08-24 |
| WO2017177524A1 (en) | 2017-10-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105898502B (en) | The method and device that audio-visual synchronization plays | |
| US11315535B2 (en) | Live stream processing method, apparatus, system, electronic apparatus and storage medium | |
| US20070260634A1 (en) | Apparatus, system, method, and computer program product for synchronizing the presentation of media content | |
| US10825480B2 (en) | Automatic processing of double-system recording | |
| US9786326B2 (en) | Method and device of playing multimedia and medium | |
| US20170315775A1 (en) | Synchronized Playback of Media Players | |
| TWI333380B (en) | A system and method for providing user control over repeating objects embedded in a stream | |
| US20210280172A1 (en) | Voice Response Method and Device, and Smart Device | |
| US8972262B1 (en) | Indexing and search of content in recorded group communications | |
| US20160373615A1 (en) | Cloud server, control equipment and method for audio and video synchronization | |
| US20140172961A1 (en) | System and method for providing matched multimedia video content | |
| US20140228010A1 (en) | System and method for broadcasting audio tweets | |
| US11496711B1 (en) | Systems and methods for collaborative conferencing and annotating presented assets with relevant conference contributions | |
| CN112653902B (en) | Speaker recognition method and device and electronic equipment | |
| US9055193B2 (en) | System and method of a remote conference | |
| BR102012024233A2 (en) | TIME ALIGNMENT OF RECORDED AUDIO SIGNALS | |
| EP2940644A1 (en) | Method, apparatus, device and system for inserting audio advertisement | |
| US9158435B2 (en) | Synchronizing progress between related content from different mediums | |
| JP2022095945A (en) | Ancillary data synchronization for content including audio | |
| CN105828100A (en) | Audio and video files simultaneous playing method, device and system | |
| US9813776B2 (en) | Secondary soundtrack delivery | |
| US10210545B2 (en) | Method and system for grouping devices in a same space for cross-device marketing | |
| WO2016155363A1 (en) | Method and device for maintaining playlist of multimedia file player | |
| US9066135B2 (en) | System and method for generating a second screen experience using video subtitle data | |
| US10181312B2 (en) | Acoustic system, communication device, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |