CN108377406A - A kind of adjustment sound draws the method and device of synchronization - Google Patents
A kind of adjustment sound draws the method and device of synchronization Download PDFInfo
- Publication number
- CN108377406A CN108377406A CN201810374722.1A CN201810374722A CN108377406A CN 108377406 A CN108377406 A CN 108377406A CN 201810374722 A CN201810374722 A CN 201810374722A CN 108377406 A CN108377406 A CN 108377406A
- Authority
- CN
- China
- Prior art keywords
- audio
- played
- frame
- time
- sound
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the present invention provides a kind of method and device that adjustment sound picture is synchronous, is related to video, audio play-back technology field.The embodiment of the present invention can ensure that sound is drawn when playing the video and audio of piece source file and synchronize.This method includes that sound draws synchronizing device to audio playing apparatus transmission audio frame to be played；Sound draws synchronizing device and receives the return path signal that audio sending device is sent, and wherein audio playing apparatus sends return path signal after receiving audio frame to be played；Sound draws the time that synchronizing device record receives return path signal；Sound draws synchronizing device and sends video frame to be played to video play device and record sending time, and video frame to be played is corresponding with audio frame to be played；Sound draws synchronizing device according to the time and sending time for receiving return path signal, determines the time that next audio frame is sent to audio playing apparatus.The present invention is applied to audio and video playing.
Description
Technical field
The present invention relates to video, audio signal processing technique field more particularly to a kind of adjustment sounds to draw synchronous method and device.
Background technology
When playing piece source file using electronic equipments such as TV, computers, since the master chip in electronic equipment is to film source
It is fast that the processing speed of file sound intermediate frequency data will compare video data processing speed, this results in master chip will treated audio
Data and video data are sent respectively to audio playing apparatus and when video play device play out, the output ratio of audio data
The output time of corresponding video data is early, as shown in Figure 1.And then the time of audio playing apparatus broadcasting audio can shift to an earlier date in video
The time that playing device plays corresponding video influences the use of user to generate the nonsynchronous situation of sound, picture of output
Experience.
In view of the above-mentioned problems, common solution is to be subject to one to audio data in main core bit end in currently available technology
A fixed delay achievees the purpose that it is synchronous that sound is drawn.But due to the data volume variation with audio, video, audio presentation time
Delay between corresponding video playback time can also change, therefore the above-mentioned solution effect of the prior art is not
It is ideal.In addition, as the use of the external equipments such as wireless sound box is also more and more, it is more multiple in this audio data transmission path
In the case of miscellaneous, just more it is difficult to meet information biography using the above-mentioned method for increasing constant time lag to audio data in the prior art
Defeated requirement.
Invention content
The embodiment of the present invention provides a kind of method, apparatus and equipment that adjustment sound picture is synchronous, can play piece source file
When ensure sound draw synchronize.
In order to achieve the above objectives, the embodiment of the present invention adopts the following technical scheme that：
In a first aspect, the embodiment of the present invention provides a kind of method that adjustment sound draws synchronization, including：Sound draws synchronizing device to sound
Frequency playing device sends audio frame to be played；The sound draws synchronizing device and receives the passback letter that the audio sending device is sent
Number, wherein the audio playing apparatus sends the return path signal after receiving the audio frame to be played；The sound is drawn same
Step device record receives the time of the return path signal；The sound draws synchronizing device and sends to be played regard to video play device
Frequency frame simultaneously records sending time, and the video frame to be played is corresponding with the audio frame to be played；The sound draws synchronizing device
According to the time and the sending time for receiving the return path signal, determines to audio playing apparatus and send next audio frame
Time.
Second aspect, the embodiment of the present invention provide another adjustment sound and draw synchronous method, including：Audio playing apparatus connects
The audio frame to be played that synchronizing device is sent is drawn in radio reception；The audio playing apparatus after receiving the audio frame to be played to
Sound draws synchronizing device and sends return path signal, so that the sound draws synchronizing device after receiving the return path signal, record receives
To the time of the return path signal, draws synchronizing device so as to sound and recording the hair for sending video frame to be played to video play device
After sending the time, according to the time and the sending time for receiving the return path signal, determines and sent to audio playing apparatus
The time of next audio frame, wherein the video frame to be played is corresponding with the audio frame to be played.
The third aspect, the embodiment of the present invention provide a kind of sound picture synchronizing device, including：Interface module, for being broadcast to audio
It puts device and sends audio frame to be played；The interface module is additionally operable to receive the return path signal, wherein the audio plays dress
It sets and sends the return path signal after receiving the audio frame to be played；Logging modle, for being received in the interface module
After the return path signal, record receives the time of the return path signal；The interface module is additionally operable to video play device
Video frame to be played is sent, the video frame to be played is corresponding with the audio frame to be played；The logging modle, is additionally operable to
Record the sending time that video frame to be played is sent to video play device；Computing module receives the passback for basis
The time of signal and the sending time determine the time that next audio frame is sent to audio playing apparatus.
Fourth aspect, the embodiment of the present invention provide a kind of audio playing apparatus, including：Interface module is drawn for receiving sound
The audio frame to be played that synchronizing device is sent to the audio playing apparatus；The interface module is additionally operable to described in receiving
It after audio frame to be played, draws synchronizing device to the sound and sends back rotaring signal, so that the sound draws synchronizing device receiving
After stating return path signal, record receives the time of the return path signal, draws synchronizing device so as to the sound and is broadcast to video in record
After putting the sending time that device sends video frame to be played, and according to the time and the hair for receiving the return path signal
The time is sent, the time for sending next audio frame to audio playing apparatus is determined, wherein the video frame to be played waits broadcasting with described
It is corresponding to put audio frame.
5th aspect, the embodiment of the present invention provide a kind of electronic equipment, include that the sound provided such as the above-mentioned third aspect is drawn
Synchronizing device and video play device.
6th aspect, the embodiment of the present invention provide a kind of wireless sound box equipment, include as above-mentioned fourth aspect is provided
Audio playing apparatus.
In the embodiment of the present invention, after sound picture synchronizing device sends audio frame to be played to audio playing apparatus, by audio
Playing device draws synchronizing device to sound and feeds back return path signal, and then sound draws synchronizing device and receives the return path signal by record
Time can determine that audio playing apparatus plays the time of the audio frame to be played, that is, be determined that user hears and wait broadcasting
Put the time of audio frame.Sound draws the time that synchronizing device sends video frame to be played by recording to video play device again, really
Determine the time that video play device plays the video frame to be played, that is, be exactly determine user see video frame to be played when
Between.And then by receiving the time of return path signal and sending the sending time of video frame to be played to video play device,
It can determine the length of delay between video playing and audio play.Finally further according to the delay between video playing and audio broadcasting
Value, adjusts the time that next audio frame is sent to audio playing apparatus, to ensure that being played simultaneously for audio frame and video frame.
Description of the drawings
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described.
Fig. 1 is the structural schematic diagram of the electronic equipment for playing audio, video in the prior art；
Fig. 2 is a kind of structural schematic diagram for playing audio/video that the embodiment of the present invention provides；
Fig. 3 is the structural schematic diagram for another playing audio/video that the embodiment of the present invention provides；
Fig. 4 is the flow diagram that a kind of adjustment sound that the embodiment of the present invention provides draws synchronous method；
Fig. 5 is that the sound that the embodiment of the present invention provides is drawn between synchronizing device and video play device, audio playing apparatus
The structural schematic diagram of transmitted data；
Fig. 6 is the flow diagram that another adjustment sound that the embodiment of the present invention provides draws synchronous method；
Fig. 7 is the structural schematic diagram that a kind of sound that the embodiment of the present invention provides draws synchronizing device；
Fig. 8 is the structural schematic diagram that another sound that the embodiment of the present invention provides draws synchronizing device；
Fig. 9 is the structural schematic diagram that another sound that the embodiment of the present invention provides draws synchronizing device；
Figure 10 is a kind of structural schematic diagram for audio playing apparatus that the embodiment of the present invention provides.
Specific implementation mode
Below in conjunction with the accompanying drawings, the embodiment of the present invention is described.
The present invention is applied under audio, video playing scene.Illustratively, as shown in Fig. 2, being provided for the embodiment of the present invention
A kind of playing audio/video structural schematic diagram, middle pitch draw synchronizing device 101 respectively with audio playing apparatus 102, regard
Frequency playing device 103, master chip 104 connect.Master chip 104 is used to read the piece source file in memory space, to piece source file
It the processing such as is decoded, generates video data and audio data for broadcasting, and video data and audio data are sent to
Sound draws synchronizing device 101；Sound draws synchronizing device 101 and is used to receive the audio data and video data of the transmission of master chip 104, and presses
Audio data and video data audio is respectively sent to according to the method that the adjustment sound that the embodiment of the present invention is provided draws synchronization to broadcast
It puts device 102 and video play device 103 plays out.
In addition, it is necessary to illustrate, the sound in the playing audio/video that the embodiment of the present invention is provided draws synchronizing device
101 and master chip 104 can be two individual integrated circuit, processing chips etc..Also the reading of synchronizing device 101 can be drawn by sound to deposit
It stores up the piece source file in space and processing is decoded to piece source file, to realize the function of master chip 104.People in the art
Member can carry out above-mentioned design according to actual needs, be not restricted to this present invention.
It is included each in the above-mentioned playing audio/video that the embodiment of the present invention is provided in addition, it is necessary to explanation
Cell arrangement can be multiple cell arrangements in the same product facility.Such as by taking television set as an example, master chip 104 and sound are drawn
The function of synchronizing device 101 can realize that the function of audio playing apparatus 102 can be by electricity by the corresponding control circuit of television set
Amplifier speaker unit depending on machine realizes that the function of video play device 103 can be realized by the display unit of television set.This
Outside, above-mentioned playing audio/video can also include multiple product facilities, as shown in figure 3, master chip 104 and sound draw synchronizing device
101 function equally realizes that the function of video play device 103 is also by the display of television set by the corresponding control circuit of television set
Device unit realizes that but the function of audio playing apparatus 102 can be realized by the wireless sound box equipment being connect with television set, into
Television set sends audio data by bluetooth, WIFI to wireless sound box equipment when row audio and video playing, and wireless sound box equipment is every
After the secondary audio frame for receiving television set transmission, return path signal is fed back to television set.
Embodiment one：
Based on provided in above-described embodiment playing audio/video or other have with above-mentioned playing audio/video
There are similar structures and the playing audio/video of function, the embodiment of the present invention to provide a kind of method that adjustment sound draws synchronization, stream
Journey is as shown in figure 4, include：
S201, sound draw the piece source file in synchronizing device reading memory space, are decoded to piece source file, generate audio
Data and video data.
It is completed in above-mentioned reading memory space it should be noted that in the embodiment of the present invention synchronizing device can be drawn by sound
Piece source file is simultaneously decoded piece source file, by audio number after can also being decoded to piece source file by independent master chip
Synchronizing device is drawn according to sound is sent to video data.
Wherein, audio data and video data such as are transmitted, read and play at the operations as a data frame.
S202, sound draw synchronizing device and send audio frame to be played to audio playing apparatus.
Wherein, audio frame to be played refers to piece source file is decoded after frame data in the audio data that generates.Sound
Frequency playing device, can be according to the audio frame number to be played according to the corresponding sound of output after receiving audio frame to be played.
In addition, audio playing apparatus after receiving the audio frame to be played, also draws synchronizing device to sound and sends back communication
Number.In one implementation, it is contemplated that during sound, video playing, sound, which draws synchronizing device, can continue to play to audio
Device sends audio frame, can recognize which audio frame the return path signal received corresponds to make sound draw synchronizing device, this
Inventive embodiments further include：
Audio frame to be played includes sync id, and the sync id is for determining audio frame to be played in audio data
Position, so as to audio playing apparatus according to sync id generate return path signal.
Position of the audio frame wherein to be played in audio data, refers to the audio frame in which of audio data time
Section, for example, the audio frame in audio data n-th point n-th second.Illustratively, sound draws synchronizing device and is sending audio to be played
When frame, sync id can be added at the end of each frame audio data.Wherein sync id includes that the frame audio data exists
Position in audio data.Audio playing apparatus is after receiving audio frame to be played later, from the number of the audio frame to be played
According to audio data and sync id is decomposited in packet, audio data is put into power amplifier and pushes loud speaker sounding, is marked further according to synchronous
Know to generate return path signal and return path signal is fed back to sound and draws synchronizing device.The sync id that wherein will can also directly decomposite
It is packaged and is sent as return path signal.Sound draws synchronizing device and is receiving the passback letter generated according to sync id in this way
After number, you can know the return path signal it is corresponding be which audio frame.In addition, can also include that sound draws synchronous dress in sync id
The information such as time label when sending audio frame to be played are set, the value that the time marks is that the number of minutes of present system time is multiplied by
60 add number of seconds and are converted into 32 as binary integer.
S203, sound picture synchronizing device receive the return path signal that the audio playing apparatus is sent and record receives passback letter
Number time.
Specifically, sound draws synchronizing device after receiving return path signal, determining that the return path signal is audio playing apparatus
Receive transmitted after audio frame to be played, then record receives the time of return path signal.
In the present invention in view of due to audio data decoding process and to audio playing apparatus send audio frame
All there may be delays in the process, especially when audio data is transmitted by bluetooth, WIFI network, due to transmission path
Bigger is fluctuated in delay caused by complexity, thus often received by audio playing apparatus in the present invention after an audio frame just to
Sound draws synchronizing device and sends a return path signal, draws the time that synchronizing device record receives return path signal by sound, determines user
Hear the time of the audio frame.
S204, sound draw synchronizing device and send video frame to be played to video play device and record sending time.
Wherein, video frame to be played is corresponding with above-mentioned audio frame to be played.
In the present invention by piece source file be decoded generate it is corresponding to be played with above-mentioned audio frame to be played
After video frame, sound draws synchronizing device and the video frame to be played is sent to video play device so that video play device is according to this
While presentation of video frames respective picture to be played, note recording picture synchronizing device sends video frame to be played to video play device
Time, and then determine that user sees time of the video frame to be played.
S205, sound picture synchronizing device send to be played according to the time for receiving return path signal and to video play device
The sending time of video frame determines the time that next audio frame is sent to audio playing apparatus.
Wherein, be determined that user hears the time of audio frame to be played according to the time for receiving return path signal, according to
The sending time that video play device sends video frame to be played determines that user sees the time of video frame to be played.And then it is logical
It spends the time for receiving return path signal and sends the sending time of video frame to be played to video play device, it may be determined that regard
Frequency plays the length of delay between audio broadcasting.Finally further according to video playing and audio play between length of delay, adjust to
Audio playing apparatus sends the time of next audio frame, to ensure that being played simultaneously for audio frame and video frame.
In one implementation, step S205 can specifically include：
S2051, formula △ T are utilized(N)=K × (TVS(N)-TAR(N)) calculate to the next audio frame of audio playing apparatus transmission
Delay time △ T(N), wherein TVS(N)Indicate to send the sending time of video frame to be played, T to video play deviceAR(N)Table
Show the time for receiving return path signal, 0 ＜ K ＜ 1.
Wherein the value of K can be finely adjusted according to the operational capability of CPU.
In view of sound picture synchronizing device receives time and the transmission video to be played of the return path signal of audio frame to be played
Time difference between the sending time of frame reflects the feelings of time difference of the mutual corresponding video frame with audio frame when playing
Condition.And then in the present invention by calculate the time of above-mentioned reception return path signal and send video frame to be played sending time it
Difference, then COEFFICIENT K is multiplied by calculated difference, it calculates next frame audio and needs the time postponed.
S2052, formula T is utilizedAS(N+1)=T 'AS(N+1)+△T(N)It determines to audio playing apparatus and sends next audio frame
Time, wherein T 'AS(N+1)Expression normally sends the time of next audio frame to audio playing apparatus.
Wherein, the time for next audio frame normally being sent to audio playing apparatus refers to no above-mentioned side using the present invention
Method postpones sending time when audio frame is sent.Illustratively, for example, not postponing to send out according to the above method of the present invention
In the case of sending audio frame, master chip often decodes a frame audio frame number evidence and sends the audio frame number to audio playing apparatus
According to the time is T ' at this timeAS(N+1).And then the method calculates △ T through the invention(N)Afterwards, then in T 'AS(N+1)On the basis of prolong
Slow △ T(N)Afterwards next audio frame number evidence is sent to audio playing apparatus again.For another example not prolonging according to the above method of the present invention
It is tardy send audio frame in the case of, script master chip can postpone after a certain period of time decoding a frame audio frame number after, Xiang Yin
Frequency playing device sends the audio frame number evidence, T 'AS(N+1)Then be when it is preceding send the audio frame number evidence to audio playing apparatus when
Between.And then the method calculates △ T through the invention(N)Afterwards, then in T 'AS(N+1)On the basis of delay △ T(N)Afterwards again to audio
Playing device sends next audio frame number evidence.
Specifically, assume that n-th frame audio frame and video frame is currently played, and the value of K is 0.5.Its middle pitch is drawn
System time when synchronizing device sends from n-th frame video frame to video play device be 1 point 42 seconds 12 minutes 100 milliseconds, and connect
Receive the return path signal of n-th frame audio frame time be 1 point 12 points 41 seconds 200 milliseconds, then can calculate to audio play fill
Set the delay time △ T for sending next audio frame(N)=900ms × 0.5=450ms.And then when sending next audio frame,
T’AS(N+1)On the basis of delay 0.5ms after sent again.Prolonging between video playing is played so as to reduce audio
When.
In the embodiment of the present invention, after sound picture synchronizing device sends audio frame to be played to audio playing apparatus, by audio
Playing device draws synchronizing device to sound and feeds back return path signal, and then sound draws synchronizing device and receives the return path signal by record
Time can determine that audio playing apparatus plays the time of the audio frame to be played, that is, be determined that user hears and wait broadcasting
Put the time of audio frame.Sound draws the time that synchronizing device sends video frame to be played by recording to video play device again, really
Determine the time that video play device plays the video frame to be played, that is, be exactly determine user see video frame to be played when
Between.And then by receiving the time of return path signal and sending the sending time of video frame to be played to video play device,
It can determine the length of delay between video playing and audio play.Finally further according to the delay between video playing and audio broadcasting
Value, adjusts the time that next audio frame is sent to audio playing apparatus, to ensure that being played simultaneously for audio frame and video frame.
Below in conjunction with example, synchronous method is drawn to adjustment sound provided by the present invention and is introduced：
As shown in figure 5, in the video data that sound draws that synchronizing device is sent to video play device, each video requency frame data
Including " Video Frame* " and " MVS(*)" two parts, " Video Frame* " refers to the video data of * frames, " MVS(*)" refer to *
The sync id of frame video data, wherein " MVS(*)" in may include frame number and transmission of the frame video frame in video data
The information such as the system time when frame video frame.As shown in the figure, the sound that synchronizing device is sent to audio playing apparatus is drawn in sound
For frequency in, each audio frame number evidence includes " Audio Frame* " and " MAS(*)" two parts, " Audio Frame* " refers to *
Frame audio data, " MAS(*)" refer to the sync ids of * frame audio datas, " MAS(*)" in can include the frame audio frame in audio
The information such as frame number in data and system time when sending the frame audio frame.As shown in the figure, it is connect in audio playing apparatus
After receiving audio frame Audio Frame*, synchronizing device feedback return path signal T is drawn to soundAR(*)。
For since the video frame of N-1 frames and audio frame, master chip is decoded processing to piece source file, respectively
Generate N-1 frames audio frame and N-1 frames video frame (usual audio frame can earlier be exported than video frame).Then, sound, which is drawn, synchronizes
Device to audio playing apparatus send N-1 frame audio frames, to video play device send N-1 frame video frame, record to regarding
Frequency playing device sends the time T of N-1 frame video frameVS(N-1).Audio playing apparatus is anti-after receiving N-1 frame video frame
A return path signal is presented, sound draws the time T that synchronizing device record receives return path signalAR(N-1).Wherein return path signal can be
The sync id M obtained after audio frame is decomposedAS(N-1)Afterwards, by synchronizing signal MAS(N-1)Content as return path signal.It counts later
Calculate △ T(N-1)=K × (TVS(N-1)-TAR(N-1)), determine the delay time that next audio frame is sent to audio playing apparatus.Into
And after master chip generates nth frame audio frame, sound draws synchronizing device delay △ T(N-1)Afterwards nth frame is sent to audio playing apparatus again
Audio frame.It so, can be by above-mentioned if there are sounds to draw nonsynchronous problem when playing the audio and video of N-1 frames
Method in time plays audio the delay for carrying out corresponding duration, and then ensure that and playing next frame i.e. nth frame audio and video
Sound when data, which is drawn, to be synchronized.Later, similarly according to the time T for sending nth frame video frame to video play deviceVS(N)And it receives
To the time T of the corresponding return path signal of nth frame video frameAR(N-1), determine to audio playing apparatus and send N+1 frame audio frames
Delay time △ T(N)=K × (TVS(N)-TAR(N)), sound draws synchronizing device delay △ T later(N)It is sent out again to audio playing apparatus afterwards
Send N+1 frame audio frames.
Embodiment two：
The embodiment of the present invention also provides a kind of method that adjustment sound draws synchronization, is applied in audio playing apparatus.Such as Fig. 6 institutes
Show, this method includes：
S301, audio playing apparatus receive sound and draw the audio frame to be played that synchronizing device is sent.
S302, the audio playing apparatus draw synchronizing device to sound after receiving the audio frame to be played and send passback
Signal.So that the sound draws synchronizing device after receiving the return path signal, record receives the time of the return path signal,
So that sound draws synchronizing device after record sends the sending time of video frame to be played to video play device, according to receiving
The time of the return path signal and the sending time determine the time that next audio frame is sent to audio playing apparatus,
Described in video frame to be played it is corresponding with the audio frame to be played.
Audio frame wherein to be played includes sync id, and the sync id is for determining audio frame to be played in audio number
Frame number in.And then the method can also include：Audio playing apparatus generates return path signal according to sync id.
The adjustment sound that the above embodiment of the present invention two is provided draws the side that synchronous method is provided with above-described embodiment one
It is to draw synchronous dress from sound that method has same or similar technical characteristic and effect, embodiment one from principle, embodiment
Description of the angle set to method, embodiment is second is that description from the angle of audio playing apparatus to method.Therefore embodiment two
In various realization methods and effect be referred to the description in embodiment one, details are not described herein.
Embodiment three：
The embodiment of the present invention also provides a kind of sound picture synchronizing device, and the side of information is reported for executing above-mentioned household appliance
Method.Sound provided by the present invention draws the corresponding description that synchronizing device usage scenario can refer to above-described embodiment one.The embodiment of the present invention
The division that can carry out function module to the information reporting device according to above method example, for example, each function can be corresponded to
Each function module is divided, two or more functions can also be integrated in a processing module.It is above-mentioned integrated
The form that hardware had both may be used in module is realized, can also be realized in the form of software function module.It should be noted that this
It is schematical, only a kind of division of logic function to the division of module in inventive embodiments, can has in actual implementation another
Outer dividing mode.In the case where dividing each function module using corresponding each function, if Fig. 7 is institute of the embodiment of the present invention
The sound being related to draws a kind of possible structural schematic diagram of synchronizing device.Specifically, sound picture synchronizing device 70 includes：Interface module
701, logging modle 702, computing module 703.Wherein：
Interface module 701, for sending audio frame to be played to audio playing apparatus.
Interface module 701 is additionally operable to receive return path signal.Wherein audio playing apparatus is after receiving audio frame to be played
Synchronizing device, which is drawn, to sound sends return path signal.
Logging modle 702, for after interface module receives return path signal, record to receive the time of return path signal.
Interface module 701 is additionally operable to send video frame to be played to video play device, wherein video frame to be played with it is upper
It is corresponding to state audio frame to be played.
Logging modle 702 is additionally operable to record the sending time for sending video frame to be played to video play device.
Computing module 703 receives the time of the return path signal and the sending time, true directional sound for basis
Frequency playing device sends the time of next audio frame.
In one implementation, audio frame to be played includes sync id, and the sync id is to be played for determining
Frame number of the audio frame in audio data.Wherein return path signal is generated according to sync id by audio playing apparatus.
In one implementation, computing module 703 are specifically used for：
Utilize formula △ T(N)=K × (TVS(N)-TAR(N)) calculate the delay that next audio frame is sent to audio playing apparatus
Time △ T(N), wherein TVS(N)Indicate to send the sending time of video frame to be played, T to video play deviceAR(N)It indicates to receive
To the time of return path signal, 0 ＜ K ＜ 1.
Computing module 703 is specifically additionally operable to utilize formula TAS(N+1)=T 'AS(N+1)+△T(N)It determines to audio playing apparatus
Send the time of next audio frame, wherein T 'AS(N+1)Under indicating that the sound picture synchronizing device is normally sent to audio playing apparatus
The time of one audio frame.
It is accordingly retouched it should be noted that the sound provided in the embodiment of the present invention draws corresponding other of each unit in synchronizing device
The correspondence description content that can be referred in above-described embodiment is stated, details are not described herein.
Using integrated unit, Fig. 8 shows that a kind of possible structure of above-mentioned sound picture synchronizing device is shown
It is intended to.The sound draws synchronizing device 80：Storage unit 801, processing unit 802 and interface unit 803.Processing unit 802
For carrying out control management to the action of information reporting device 80.
Wherein, using processing unit as processor, storage unit is memory, and interface unit is for transceiver.And then sound
Synchronizing device is drawn with reference to shown in Fig. 9, including transceiver 903, processor 902, memory 901 and bus 904, transceiver 903,
Processor 902 is connected by bus 904 with memory 901.
Processor 902 can be a general central processor (Central Processing Unit, CPU), microprocessor
Device, application-specific integrated circuit (Application-Specific Integrated Circuit, ASIC) or one or more
A integrated circuit for controlling the execution of the present invention program program.
Memory 901 can be read-only memory (Read-Only Memory, ROM) or can store static information and instruction
Other kinds of static storage device, random access memory (Random Access Memory, RAM) or letter can be stored
The other kinds of dynamic memory of breath and instruction, can also be Electrically Erasable Programmable Read-Only Memory (Electrically
Erasable Programmable Read-only Memory, EEPROM), CD-ROM (Compact Disc Read-
Only Memory, CD-ROM) or other optical disc storages, optical disc storage (including compression optical disc, laser disc, optical disc, digital universal
Optical disc, Blu-ray Disc etc.), magnetic disk storage medium or other magnetic storage apparatus or can be used in carrying or store to have referring to
Enable or data structure form desired program code and can by any other medium of computer access, but not limited to this.
Memory can be individually present, and be connected with processor by bus.Memory can also be integrated with processor.
Wherein, memory 901 is used to store the application code for executing the present invention program, and is controlled by processor 902
System executes.Transceiver 903 is used to receive the content of external equipment input, and processor 902 is used to execute to store in memory 901
Application code, to realize that the adjustment sound described in the embodiment of the present invention draws synchronous method.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or its arbitrary combination real
It is existing.When being realized using software program, can entirely or partly realize in the form of a computer program product.The computer
Program product includes one or more computer instructions.On computers load and execute computer program instructions when, all or
It partly generates according to the flow or function described in the embodiment of the present invention.The computer can be all-purpose computer, special meter
Calculation machine, computer network or other programmable devices.The computer instruction can be stored in computer readable storage medium
In, or from a computer readable storage medium to the transmission of another computer readable storage medium, for example, the computer
Instruction can pass through wired (such as coaxial cable, optical fiber, number from a web-site, computer, server or data center
Word user line (Digital Subscriber Line, DSL)) or wireless (such as infrared, wireless, microwave etc.) mode to another
A web-site, computer, server or data center are transmitted.The computer readable storage medium can be computer
Any usable medium that can be accessed is either comprising numbers such as one or more server, data centers that can be integrated with medium
According to storage device.The usable medium can be magnetic medium (for example, floppy disk, hard disk, tape), optical medium (for example, DVD),
Or semiconductor medium (such as solid state disk (Solid State Disk, SSD)) etc..
Example IV：
As shown in Figure 10, the present invention also provides a kind of audio playing apparatus 100, including：Interface module 1001, wherein interface
Module 1001 draws the audio frame to be played that synchronizing device is sent to the audio playing apparatus for receiving sound.
Interface module 1001 is additionally operable to after receiving the audio frame to be played, and drawing synchronizing device to the sound sends
Turn round signal.So that the sound draws synchronizing device after receiving the return path signal, record receives the return path signal
Time, so that the sound draws synchronizing device after record sends the sending time of video frame to be played to video play device,
According to the time and the sending time for receiving the return path signal, determines to audio playing apparatus and send next audio frame
Time, wherein the video frame to be played is corresponding with the audio frame to be played.
In one implementation, audio frame to be played includes sync id, and the sync id is to be played for determining
Frame number of the audio frame in audio data.
Interface module 1001 is generated specifically for obtaining sync id from audio frame to be played, and according to sync id
And send back communication number.
In one implementation, as shown in Figure 10, audio playing apparatus 10 further includes playing module 1002.Wherein play
Module 1002 is used to play the audio data in the audio frame to be played received.
Other corresponding corresponding descriptions of each unit can refer to upper in the audio playing apparatus provided in the embodiment of the present invention
The correspondence description content in embodiment is stated, details are not described herein.
In another embodiment, the present invention also provides a kind of electronic equipment, including the sound that above-described embodiment three is provided
Draw synchronizing device and video play device.
In one implementation, which further includes the audio playing apparatus that above-described embodiment four is provided.
Specifically, the electronic equipment can be any one of television set, computer, mobile phone.
In another embodiment, the present invention also provides a kind of wireless sound box equipments, including above-described embodiment four to be provided
Audio playing apparatus.
Specifically, the wireless sound box equipment can pass through the wireless communication protocols such as bluetooth, WIFI and other proprietary protocols
Synchronizing device is drawn with the sound that aforementioned present invention is provided to be communicated.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain
Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.
Claims (10)
1. a kind of adjustment sound draws synchronous method, which is characterized in that including：
Sound draws synchronizing device and sends audio frame to be played to audio playing apparatus；
The sound draws synchronizing device and receives the return path signal that the audio playing apparatus is sent, wherein the audio playing apparatus exists
The return path signal is sent after receiving the audio frame to be played；
The sound draws the time that synchronizing device record receives the return path signal；
The sound draws synchronizing device and sends video frame to be played to video play device and record sending time, described to be played to regard
Frequency frame is corresponding with the audio frame to be played；
The sound draws synchronizing device according to the time and the sending time for receiving the return path signal, determines to the sound
Frequency playing device sends the time of next audio frame.
2. adjustment sound draws synchronous method according to claim 1, which is characterized in that the audio frame to be played includes same
Step mark, the sync id is for determining position of the audio frame to be played in audio data；Wherein, the passback letter
Number it is that the audio playing apparatus is generated according to the sync id.
3. adjustment sound draws synchronous method according to claim 1, which is characterized in that the sound draws synchronizing device according to reception
Time to the return path signal and the sending time, determine to the audio playing apparatus send next audio frame when
Between, it specifically includes：
Utilize formula △ T(N)=K × (TVS(N)-TAR(N)) calculate when sending the delay of next audio frame to the audio playing apparatus
Between △ T(N), wherein TVS(N)Indicate the sending time, TAR(N)The time of the return path signal, 0 ＜ K ＜ are received described in expression
1；
Utilize formula TAS(N+1)=T 'AS(N+1)+△T(N)Determine the time that next audio frame is sent to the audio playing apparatus,
Middle T 'AS(N+1)Expression normally sends the time of next audio frame to the audio playing apparatus.
4. a kind of adjustment sound draws synchronous method, which is characterized in that including：
Audio playing apparatus receives sound and draws the audio frame to be played that synchronizing device is sent；
The audio playing apparatus draws synchronizing device to the sound after receiving the audio frame to be played and sends return path signal,
So that the sound draws synchronizing device after receiving the return path signal, record receives the time of the return path signal, so as to
Sound draws synchronizing device after record sends the sending time of video frame to be played to video play device, according to receiving described return
The time of communication number and the sending time determine the time that next audio frame is sent to the audio playing apparatus, wherein
The video frame to be played is corresponding with the audio frame to be played.
5. adjustment sound draws synchronous method according to claim 4, which is characterized in that the audio frame to be played includes same
Step mark, the sync id is for determining position of the audio frame to be played in audio data；
The audio playing apparatus generates the return path signal according to the sync id.
6. a kind of sound draws synchronizing device, which is characterized in that including：
Interface module, for sending audio frame to be played to audio playing apparatus；
The interface module is additionally operable to receive the return path signal, wherein the audio playing apparatus waits broadcasting described in receiving
The return path signal is sent after putting audio frame；
Logging modle, for after the interface module receives the return path signal, record receive the return path signal when
Between；
The interface module is additionally operable to send video frame to be played to video play device, the video frame to be played with it is described
Audio frame to be played is corresponding；
The logging modle is additionally operable to record the sending time for sending the video frame to be played to the video play device；
Computing module, for according to the time of the return path signal and the sending time is received, true directional audio to play
Device sends the time of next audio frame.
7. sound draws synchronizing device according to claim 6, which is characterized in that the audio frame to be played includes synchronous mark
Know, the sync id is for determining that frame number of the audio frame to be played in audio data, the return path signal are by institute
Audio playing apparatus is stated to be generated according to the sync id.
8. sound draws synchronizing device according to claim 6, which is characterized in that the computing module is specifically used for：
Utilize formula △ T(N)=K × (TVS(N)-TAR(N)) calculate the delay time △ that next audio frame is sent to audio playing apparatus
T(N), wherein TVS(N)Indicate the sending time, TAR(N)The time of the return path signal, 0 ＜ K ＜ 1 are received described in expression；
Utilize formula TAS(N+1)=T 'AS(N+1)+△T(N)Determine the time that next audio frame is sent to the audio playing apparatus,
Middle T 'AS(N+1)Indicate that the sound draws the time that synchronizing device normally sends next audio frame to the audio playing apparatus.
9. a kind of audio playing apparatus, which is characterized in that including：
Interface module draws the audio frame to be played that synchronizing device is sent to the audio playing apparatus for receiving sound；
The interface module is additionally operable to after receiving the audio frame to be played, and drawing synchronizing device to the sound sends revolution
Signal, so that the sound draws synchronizing device after receiving the return path signal, record receives the time of the return path signal,
So that the sound draws synchronizing device after record sends the sending time of video frame to be played to video play device, according to connecing
The time of the return path signal and the sending time are received, determines to the audio playing apparatus and sends next audio frame
Time, wherein the video frame to be played is corresponding with the audio frame to be played.
10. audio playing apparatus according to claim 9, which is characterized in that the audio frame to be played includes synchronous mark
Know, the sync id is for determining frame number of the audio frame to be played in audio data；
The interface module, specifically for obtaining the sync id from the audio frame to be played, and according to the synchronization
Mark generates and sends the return path signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810374722.1A CN108377406B (en) | 2018-04-24 | 2018-04-24 | Method and device for adjusting sound and picture synchronization |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810374722.1A CN108377406B (en) | 2018-04-24 | 2018-04-24 | Method and device for adjusting sound and picture synchronization |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108377406A true CN108377406A (en) | 2018-08-07 |
| CN108377406B CN108377406B (en) | 2020-12-22 |
Family
ID=63032744
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810374722.1A Active CN108377406B (en) | 2018-04-24 | 2018-04-24 | Method and device for adjusting sound and picture synchronization |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108377406B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109168059A (en) * | 2018-10-17 | 2019-01-08 | 上海赛连信息科技有限公司 | A kind of labial synchronization method playing audio & video respectively on different devices |
| CN109379619A (en) * | 2018-11-20 | 2019-02-22 | 青岛海信电器股份有限公司 | Sound draws synchronous method and device |
| CN109379613A (en) * | 2018-12-21 | 2019-02-22 | 深圳Tcl新技术有限公司 | Audio-visual synchronization method of adjustment, TV, computer readable storage medium and system |
| CN109819303A (en) * | 2019-03-06 | 2019-05-28 | Oppo广东移动通信有限公司 | Data output method and relevant device |
| CN110430457A (en) * | 2019-07-25 | 2019-11-08 | 北京奇艺世纪科技有限公司 | Heterodoxy audio and video playing method, apparatus and audio-video frequency playing system |
| CN110545454A (en) * | 2019-08-27 | 2019-12-06 | 北京奇艺世纪科技有限公司 | Data synchronous playing method and device |
| CN111988603A (en) * | 2020-08-12 | 2020-11-24 | 深圳创维－Rgb电子有限公司 | External power amplifier debugging method and device, electronic equipment and storage medium |
| CN114827696A (en) * | 2021-01-29 | 2022-07-29 | 华为技术有限公司 | Method for synchronously playing cross-device audio and video data and electronic device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1997003508A1 (en) * | 1995-07-13 | 1997-01-30 | Sony Corporation | Data transmission method, data transmission apparatus and data transmission system |
| JP2004193868A (en) * | 2002-12-10 | 2004-07-08 | Alps Electric Co Ltd | Wireless transmission and reception system and wireless transmission and reception method |
| CN1973536A (en) * | 2004-04-07 | 2007-05-30 | 皇家飞利浦电子股份有限公司 | Video-audio synchronization |
| US20120237184A1 (en) * | 2011-03-14 | 2012-09-20 | Yamaha Corporation | Signal Output Apparatus |
| CN104768050A (en) * | 2014-01-07 | 2015-07-08 | 三星电子株式会社 | Audio/visual device and control method thereof |
| CN104980820A (en) * | 2015-06-17 | 2015-10-14 | 小米科技有限责任公司 | Multimedia file playing method and multimedia file playing device |
| US20170115954A1 (en) * | 2015-10-23 | 2017-04-27 | Echostar Technologies L.L.C. | Apparatus, systems and methods for audio content diagnostics |
-
2018
- 2018-04-24 CN CN201810374722.1A patent/CN108377406B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1997003508A1 (en) * | 1995-07-13 | 1997-01-30 | Sony Corporation | Data transmission method, data transmission apparatus and data transmission system |
| JP2004193868A (en) * | 2002-12-10 | 2004-07-08 | Alps Electric Co Ltd | Wireless transmission and reception system and wireless transmission and reception method |
| CN1973536A (en) * | 2004-04-07 | 2007-05-30 | 皇家飞利浦电子股份有限公司 | Video-audio synchronization |
| US20120237184A1 (en) * | 2011-03-14 | 2012-09-20 | Yamaha Corporation | Signal Output Apparatus |
| CN104768050A (en) * | 2014-01-07 | 2015-07-08 | 三星电子株式会社 | Audio/visual device and control method thereof |
| CN104980820A (en) * | 2015-06-17 | 2015-10-14 | 小米科技有限责任公司 | Multimedia file playing method and multimedia file playing device |
| US20170115954A1 (en) * | 2015-10-23 | 2017-04-27 | Echostar Technologies L.L.C. | Apparatus, systems and methods for audio content diagnostics |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109168059A (en) * | 2018-10-17 | 2019-01-08 | 上海赛连信息科技有限公司 | A kind of labial synchronization method playing audio & video respectively on different devices |
| CN109168059B (en) * | 2018-10-17 | 2021-06-18 | 上海赛连信息科技有限公司 | Lip sound synchronization method for respectively playing audio and video on different devices |
| CN109379619A (en) * | 2018-11-20 | 2019-02-22 | 青岛海信电器股份有限公司 | Sound draws synchronous method and device |
| CN109379613A (en) * | 2018-12-21 | 2019-02-22 | 深圳Tcl新技术有限公司 | Audio-visual synchronization method of adjustment, TV, computer readable storage medium and system |
| CN109379613B (en) * | 2018-12-21 | 2021-11-09 | 深圳Tcl新技术有限公司 | Audio and video synchronization adjustment method, television, computer readable storage medium and system |
| CN109819303A (en) * | 2019-03-06 | 2019-05-28 | Oppo广东移动通信有限公司 | Data output method and relevant device |
| CN109819303B (en) * | 2019-03-06 | 2021-04-23 | Oppo广东移动通信有限公司 | Data output method and related equipment |
| CN110430457A (en) * | 2019-07-25 | 2019-11-08 | 北京奇艺世纪科技有限公司 | Heterodoxy audio and video playing method, apparatus and audio-video frequency playing system |
| CN110430457B (en) * | 2019-07-25 | 2021-09-10 | 北京奇艺世纪科技有限公司 | Method and device for playing different-end audio and video and audio playing system |
| CN110545454A (en) * | 2019-08-27 | 2019-12-06 | 北京奇艺世纪科技有限公司 | Data synchronous playing method and device |
| CN111988603A (en) * | 2020-08-12 | 2020-11-24 | 深圳创维－Rgb电子有限公司 | External power amplifier debugging method and device, electronic equipment and storage medium |
| CN114827696A (en) * | 2021-01-29 | 2022-07-29 | 华为技术有限公司 | Method for synchronously playing cross-device audio and video data and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108377406B (en) | 2020-12-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108377406A (en) | A kind of adjustment sound draws the method and device of synchronization | |
| US10856018B2 (en) | Clock synchronization techniques including modification of sample rate conversion | |
| JP6522014B2 (en) | Video remote commentary synchronization method and system and terminal device | |
| US9344755B2 (en) | Fast-resume audio playback | |
| KR100893741B1 (en) | Methods and systems for distributing multimedia data over heterogeneous networks | |
| CN101355500B (en) | Content reproduction apparatus, content reproduction method and program | |
| CN104902317A (en) | Audio video synchronization method and device | |
| CN107277594A (en) | A kind of video and audio and barrage synchronous method and device | |
| CN109167890A (en) | A kind of sound draws synchronous method and device and display equipment | |
| CN104937919A (en) | Common event-based multidevice media playback | |
| CN107277691B (en) | Multi-channel audio playing method and system based on cloud and audio gateway device | |
| CN107566889A (en) | Audio stream flow rate error processing method, device, computer installation and computer-readable recording medium | |
| CN110166723A (en) | It is a kind of to record the audio and video synchronization method in shielding, electronic equipment, storage medium | |
| CN101458951A (en) | Video and audio program signal processing system having multiple functions | |
| KR20230116903A (en) | Methods and Heterogeneous Computing Systems for Clock Synchronization | |
| JP7024794B2 (en) | Audio systems, audio equipment, and how to control audio equipment | |
| CN104506920A (en) | Method and device for playing omnimedia data information | |
| TWI566173B (en) | Audio playback device and method | |
| JP2010154418A (en) | Method and device for wirelessly transmitting video | |
| CN108616767B (en) | Audio data transmission method and device | |
| US10728592B2 (en) | Audio decoding and reading system | |
| CN115833984A (en) | Clock synchronization method and device, electronic equipment and readable storage medium | |
| US8503362B2 (en) | Speaker synchronization technique for wireless multichannel sound data transmission system | |
| WO2023282959A1 (en) | System and method to synchronize rendering of multi-channel audio to video presentation | |
| CN111263206B (en) | Synchronous playing method and device of multimedia information, storage medium and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Applicant after: Hisense Video Technology Co., Ltd Address before: 266100 Zhuzhou Road, Laoshan District, Shandong, No. 151, No. Applicant before: HISENSE ELECTRIC Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |