CN106210842A - Control method for playing back and device - Google Patents
Control method for playing back and device Download PDFInfo
- Publication number
- CN106210842A CN106210842A CN201610565374.7A CN201610565374A CN106210842A CN 106210842 A CN106210842 A CN 106210842A CN 201610565374 A CN201610565374 A CN 201610565374A CN 106210842 A CN106210842 A CN 106210842A
- Authority
- CN
- China
- Prior art keywords
- waveform
- video pictures
- acoustical signal
- time delay
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44204—Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the present invention provides a kind of control method for playing back and device, the method includes: the video data in terminal plays multi-medium data, and when the voice data being associated with described video data in described multi-medium data is wirelessly sent to preset wireless acoustics device plays, gather the acoustical signal of described wireless acoustics device plays；Detect described acoustical signal the most synchronize with the video pictures play in described terminal；When described acoustical signal and described video pictures are asynchronous, while described voice data transmits, the video pictures that described terminal is play is carried out time delay, so that described video pictures is Tong Bu with described acoustical signal.The method is owing to carrying out time delay to video pictures so that video pictures and acoustical signal still can keep synchronizing, thus avoids video pictures and sound is inconsistent and affect the problem that user normally watches video.
Description
Technical field
The present embodiments relate to audio frequency and video processing technology field, particularly relate to a kind of control method for playing back and device.
Background technology
When watching video, in order to improve the tonequality of video playback, it is often necessary to utilize the stereo set connected in terminal,
Compare with the audio output device in terminal for, the sound quality of stereo set of specialty is relatively high a lot, meets user couple
The demand of high quality sound.
But during realizing the present invention, if it has been found that stereo set passes through wired mode (such as: data
Line or tone frequency channel wire) it is connected with terminal, in this case, owing to wire rod transmission performance is more excellent, the delay of sound is relatively small, uses
Family often can be ignored.If but stereo set is wirelessly connected with terminal, then sound is utilizing wireless signal
During transmission, delay will increase, and time serious, when causing user to watch video, sound and picture are inconsistent, such as: currently playing
Sound and picture in captions or the shape of the mouth as one speaks show asynchronous, affect the user's normal viewing to video.
Summary of the invention
The embodiment of the present invention provides a kind of control method for playing back and device, with solve of the prior art utilize wireless
When signal transmission audio signal is to wireless acoustics equipment, acoustical signal and the nonsynchronous problem of video pictures.
The embodiment of the invention discloses following technical scheme:
First aspect, it is provided that a kind of control method for playing back, is applied to terminal, including:
Video data in terminal plays multi-medium data, and by described multi-medium data with described video data phase
When the voice data of association is wirelessly sent to preset wireless acoustics device plays, gathers described wireless acoustics equipment and broadcast
The acoustical signal put；
Detect described acoustical signal the most synchronize with the video pictures play in described terminal；
When described acoustical signal and described video pictures are asynchronous, while described voice data transmits, to described
The video pictures play in terminal carries out time delay, so that described video pictures is Tong Bu with described acoustical signal.
Alternatively, the described acoustical signal of described detection is the most synchronize with the video pictures play in described terminal, including:
Extract the real-time waveform of described acoustical signal；
Obtain the theoretical waveform of the voice data corresponding with described video pictures；
Judge described real-time waveform and the most consistent with described theoretical waveform；
When described real-time waveform and described theoretical waveform are inconsistent, determine that described acoustical signal is with described video pictures not
Synchronize.
Alternatively, the described video pictures to playing in described terminal carries out time delay, including:
Calculate the time delay duration between described video pictures and described acoustical signal；
Utilize described time delay duration that the video pictures play in described terminal is carried out time delay.
Alternatively, the time delay duration between the described video pictures of described calculating and described acoustical signal, including:
Extract the wave character in described real-time waveform, and, extract the wave character of described theoretical waveform；
The wave character of described real-time waveform and described theoretical waveform is carried out Characteristic Contrast；
According to Characteristic Contrast result, determine the time delay direction of described theoretical waveform and described real-time waveform；
Move described theoretical waveform along described time delay direction, and record described theoretical waveform consistent with described real-time waveform time
Mobile duration；
Described mobile duration on described time delay direction is defined as described time delay duration.
Alternatively, the described video pictures to playing in described terminal carries out time delay, including:
Obtain the decoded information when described multimedia decoding data obtain described video data and voice data；
Search the target video data that decoded information is identical with the decoded information of described acoustical signal；
Video data currently playing for described terminal is switched to described target video data, it is achieved broadcast in described terminal
The video pictures put carries out time delay.
Second aspect, it is provided that a kind of broadcast control device, is applied to terminal, including:
Acquisition module, for when the video data in terminal plays multi-medium data, and by described multi-medium data with
When the voice data that described video data is associated wirelessly is sent to preset wireless acoustics device plays, gather described
The acoustical signal of wireless acoustics device plays；
Synchronous detection module is the most synchronize with the video pictures play in described terminal for detecting described acoustical signal；
Time delay module, for when described acoustical signal and described video pictures are asynchronous, transmitting at described voice data
While, the video pictures that described terminal is play is carried out time delay, so that described video pictures is Tong Bu with described acoustical signal.
Alternatively, described synchronous detection module, including:
Waveform extracting submodule, for extracting the real-time waveform of described acoustical signal；
Waveform obtains submodule, for obtaining the theoretical waveform of the voice data corresponding with described video pictures；
Waveform judges submodule, is used for judging described real-time waveform and the most consistent with described theoretical waveform；
Determine submodule, for when described real-time waveform and described theoretical waveform are inconsistent, determine described acoustical signal
Asynchronous with described video pictures.
Alternatively, described time delay module, including:
Duration calculation submodule, for calculating the time delay duration between described video pictures and described acoustical signal；
Timing_delay estimation submodule, during for utilizing described time delay duration to carry out the video pictures play in described terminal
Prolong.
Alternatively, described duration calculation submodule, including:
Waveshape feature abstraction submodule, for extracting the wave character in described real-time waveform, and, extract described theory
The wave character of waveform；
Wave character contrast submodule, for carrying out feature by the wave character of described real-time waveform and described theoretical waveform
Contrast；
Time delay direction determines submodule, according to Characteristic Contrast result, determines described theoretical waveform and described real-time waveform
Time delay direction；
Mover module, for moving described theoretical waveform along described time delay direction；
Duration record sub module, for record described theoretical waveform consistent with described real-time waveform time mobile duration；
Duration determines submodule, for the described mobile duration on described time delay direction is defined as described time delay duration.
Alternatively, described time delay module, including:
Decoded information obtains submodule, obtains described video data and audio frequency for obtaining from described multimedia decoding data
Decoded information during data；
Video data searches submodule, for searching the target that decoded information is identical with the decoded information of described acoustical signal
Video data；
Video data switching submodule, for being switched to described target video by video data currently playing for described terminal
Data, it is achieved the video pictures play in described terminal is carried out time delay.
The third aspect, it is provided that a kind of terminal, including: the broadcast control device as described in any one of second aspect.
Fourth aspect, it is provided that a kind of terminal, including:
One or more processors；And,
Memorizer；Wherein,
Described memorizer storage has the instruction that can be performed by the one or more processor, and described instruction is arranged to hold
OK:
Video data in terminal plays multi-medium data, and by described multi-medium data with described video data phase
When the voice data of association is wirelessly sent to preset wireless acoustics device plays, gathers described wireless acoustics equipment and broadcast
The acoustical signal put；
Detect described acoustical signal the most synchronize with the video pictures play in described terminal；
When described acoustical signal and described video pictures are asynchronous, while described voice data transmits, to described
The video pictures play in terminal carries out time delay, so that described video pictures is Tong Bu with described acoustical signal.
The technical scheme that the embodiment of the present invention provides can include following beneficial effect:
The method that the embodiment of the present invention provides, plays the video pictures with video data in terminal local, and in nothing
When playing the acoustical signal of the voice data corresponding with video pictures on line stereo set, by gathering wireless acoustics device plays
Acoustical signal, and acoustical signal and video pictures are compared, when the two is asynchronous, by video pictures is carried out
Time delay so that video pictures can be Tong Bu with acoustical signal.
The method, even if in use, there is delay in terminal, due to same when to wireless acoustics device transmission voice data
Time also video pictures is carried out time delay so that video pictures and acoustical signal still can keep synchronize, thus avoid due to
Video pictures and sound are inconsistent and affect the problem that user normally watches video.
It should be appreciated that it is only exemplary and explanatory, not that above general description and details hereinafter describe
The present invention can be limited.
Accompanying drawing explanation
Accompanying drawing herein is merged in description and constitutes the part of this specification, it is shown that meet the enforcement of the present invention
Example, and for explaining the principle of the present invention together with description.
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
Have
In technology description, the required accompanying drawing used is briefly described, it should be apparent that, for ordinary skill
People
For Yuan, on the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
A kind of scene view that Fig. 1 provides for the embodiment of the present invention；
The schematic flow sheet of a kind of control method for playing back that Fig. 2 provides for the embodiment of the present invention；
Fig. 3 is the detailed process schematic diagram of step S102 in Fig. 2；
Fig. 4 is a kind of detailed process schematic diagram of step S103 in Fig. 2；
Fig. 5 is the detailed process schematic diagram of step S1031 in Fig. 4；
A kind of waveform diagram that Fig. 6 provides for the embodiment of the present invention；
Fig. 7 is the another kind of detailed process schematic diagram of step S103 in Fig. 2；
The structural representation of a kind of broadcast control device that Fig. 8 provides for the embodiment of the present invention；
Fig. 9 is the structural representation of synchronous detection module in Fig. 8；
Figure 10 is a kind of structural representation of time delay module in Fig. 8；
Figure 11 is the another kind of structural representation of time delay module in Fig. 8；
The module diagram of the video playing terminal that Figure 12 provides for the embodiment of the present invention.
Detailed description of the invention
Here will illustrate exemplary embodiment in detail, its example represents in the accompanying drawings.Explained below relates to
During accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represents same or analogous key element.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistent with the present invention.On the contrary, they are only with the most appended
The example of the apparatus and method that some aspects that described in detail in claims, the present invention are consistent.
A kind of scene view that Fig. 1 provides for the embodiment of the present invention.
As it is shown in figure 1, figure includes: terminal 1, wireless router 2, wireless acoustics equipment 3 and mike 4, wherein, terminal
1 is video playing terminal, and terminal 1 can directly and wireless acoustics equipment 3 carries out radio communication, such as: Bluetooth communication side
Formula, it is also possible to carry out radio communication by third party, such as: carry out wifi communication by router.In embodiments of the present invention,
Terminal 1 can be common television set, panel computer, desktop computer or portable notebook etc., in FIG as a example by television set,
Wireless acoustics equipment 3 can be Bluetooth audio device, it is also possible to for wifi sound equipment, in FIG, wireless acoustics equipment 3 is with wifi sound equipment
As a example by.
Terminal 1 can receive multi-medium data to be played by network, then carries out multi-medium data solving at coding
Reason, obtains video data and the voice data that can play, and then terminal 1 plays the video picture corresponding with video data in this locality
Face, is then wirelessly sent to wireless acoustics equipment 3 by voice data, plays sound, example on wireless acoustics equipment 3
As: in Fig. 1, acoustical signal can be transmitted to wireless acoustics equipment 3 by wireless router 2 by terminal 1.
Mike 4 in Fig. 1 can be arranged in terminal 1, for gathering the acoustical signal of wireless acoustics equipment 3；It addition,
During distant between wireless acoustics equipment 3 and terminal 1, it is outside that mike 4 can also be arranged on terminal 1, and Mike
Wind 4 is connected with terminal 1 by cable, to shorten the distance between mike 4 and wireless acoustics equipment 3.
The schematic flow sheet of a kind of control method for playing back that Fig. 2 provides for the embodiment of the present invention.This control method for playing back can
With in the terminal 1 that is applied in Fig. 1.As in figure 2 it is shown, this control method for playing back may comprise steps of.
Video data in terminal plays multi-medium data, and by described multi-medium data with described video data phase
When the voice data of association is wirelessly sent to preset wireless acoustics device plays, in step S101, gather described
The acoustical signal of wireless acoustics device plays.
Terminal can receive multi-medium data by network, and the multi-medium data typically received is all according to certain net
Network agreement obtains after encoding.When after the multi-medium data that terminal receives, heavy after needing multi-medium data is decoded
Newly encoded, the most just can obtain the video data that can play out in terminal and the audio frequency number being associated with video data
According to.
After terminal obtains video data, directly can form video pictures at local playing video data.It addition, terminal
The voice data corresponding with video data can also be sent to wireless acoustics equipment play out, form acoustical signal.
It addition, shown in Figure 1, when terminal 1 can utilize mike 4 to gather wireless acoustics device plays voice data
Acoustical signal.
In step s 102, described acoustical signal is detected the most synchronize with the video pictures play in described terminal.
After acoustical signal being detected, it can be determined that whether this acoustical signal synchronizes with the video pictures of broadcasting in terminal,
The mode judged can be, searches the voice data that video pictures is corresponding, then by the waveform harmony message to voice data
Number waveform contrast, and if then the two waveform consistent, represent that acoustical signal and video pictures synchronize.On the contrary, sound
Signal and video pictures are asynchronous.
When described acoustical signal and described video pictures are asynchronous, in step s 103, transmit at described voice data
While, the video pictures that described terminal is play is carried out time delay.
If acoustical signal is different with video pictures, both have certainly existed deviation, so, in this step, at sound
While frequency is according to transmission, directly the video pictures play in terminal is carried out time delay, wherein, if acoustical signal is in advance, can
So that video pictures is dragged forward, if acoustical signal is delayed, video pictures can be dragged backward.Delay final when carrying out
Make described video pictures Tong Bu with described acoustical signal.Under normal circumstances, due to the delay of wireless signal, acoustical signal is all
Delay, so, it is generally required to video pictures is dragged backward.When referring to the most forward play, progress bar moving direction is contrary
Reversely, the equidirectional of progress bar moving direction when referring to backward and play.
The method that the embodiment of the present invention provides, plays the video pictures with video data in terminal local, and in nothing
When playing the acoustical signal of the voice data corresponding with video pictures on line stereo set, by gathering wireless acoustics device plays
Acoustical signal, and acoustical signal and video pictures are compared, when the two is asynchronous, by video pictures is carried out
Time delay so that video pictures can be Tong Bu with acoustical signal.
The method, even if in use, there is delay in terminal, due to same when to wireless acoustics device transmission voice data
Time also video pictures is carried out time delay so that video pictures and acoustical signal still can keep synchronize, thus avoid due to
Video pictures and sound are inconsistent and affect the problem that user normally watches video.
In an alternative embodiment of the invention, as it is shown on figure 3, step S102 in Fig. 2 may comprise steps of.
In step S1021, extract the real-time waveform of described acoustical signal.
In this step, it is possible to use acoustical signal is input to digital oscilloscope, and then obtains the real-time of acoustical signal
Waveform.
In step S1022, obtain the theoretical waveform of the voice data corresponding with described video pictures.
In this step, voice data corresponding for video pictures can be input in digital loudspeaker, generate simulated sound
Tone signal, is then input to analoging sound signal in digital oscilloscope, and then can obtain the audio frequency corresponding with video pictures
The theoretical waveform of data.
In step S1023, it is judged that described real-time waveform and the most consistent with described theoretical waveform.
When contrasting waveform, when required precision is the highest, silhouette contrast can be carried out according only to the Wave crest and wave trough of waveform；When
When required precision is higher, except the profiles such as Wave crest and wave trough are contrasted, it is also possible to waveform is carried out details decomposition, then carries out
Detail contrast.
Either silhouette contrast or Detail contrast, as long as comparing result is inconsistent, all may determine that real-time waveform and reason
Opinion waveform is inconsistent.
When described real-time waveform and described theoretical waveform are inconsistent, in step S1024, determine described acoustical signal with
Described video pictures is asynchronous.Otherwise, flow process is terminated.
In an alternative embodiment of the invention, as shown in Figure 4, shown in Fig. 2, step S103 may comprise steps of:
In step S1031, calculate the time delay duration between described video pictures and described acoustical signal.
In an embodiment of the present invention, as it is shown in figure 5, this step S1031 may include that
In step s 201, extract the wave character in described real-time waveform, and, extract the waveform of described theoretical waveform
Feature.
In this step, wave character includes waveform profiles, crest and trough point, and, span of crest etc..
In step S202, the wave character of described real-time waveform and described theoretical waveform is carried out Characteristic Contrast.
When carrying out Characteristic Contrast, refer to contrast all features, rather than only some feature is contrasted, example
As: if only being contrasted by crest, real-time waveform may be consistent with the crest of theoretical waveform, but remaining feature is inconsistent, still
So it is not enough to illustrate that two waveforms are consistent, and then waveform cannot be moved.
In step S203, according to Characteristic Contrast result, determine the time delay side of described theoretical waveform and described real-time waveform
To.
In embodiments of the present invention, time delay direction refers to direction when theoretical waveform moves relative to real-time waveform, time
Prolonging direction can be in advance or to delay.Shown in Figure 6, figure shows two waveforms, wherein the waveform A of solid line represents sound
The real-time waveform of signal, the waveform B of dotted line represents the virtual waveform of audio signal, from the figure, it can be seen that wireless acoustics equipment
The acoustical signal waveform more corresponding than voice data play is delayed, namely acoustical signal conversation structure play want evening, so time
Prolong direction for delaying, namely time delay direction and progress bar moving direction contrary when playing.
In step S204, move described theoretical waveform along described time delay direction, and record described theoretical waveform and described
Mobile duration when real-time waveform is consistent.
From fig. 5, it is seen that owing to the difference between theoretical waveform and real-time waveform is △ t, so, control theory ripple
When shape is along time shaft backward directions mobile theory waveform, after mobile △ t, two waveforms can be made consistent.
In step S205, the described mobile duration on described time delay direction is defined as described time delay.
In step S1032, utilize described time delay duration that the video pictures play in described terminal is carried out time delay.
In an alternative embodiment of the invention, as it is shown in fig. 7, abovementioned steps S103 may comprise steps of:
In step S1033, obtain when described multimedia decoding data obtain described video data and voice data
Decoded information.
In embodiments of the present invention, decoded information can be time mark, namely when decoding multi-medium data, can be to boundary
The video data obtained behind face plus identical time mark, marks the video that can obtain after decoding with voice data by the time
Data and voice data are the most corresponding.
In step S1034, search the target video data that decoded information is identical with the decoded information of described acoustical signal.
Can mark according to the time of voice data and the acoustical signal collected is carried out time labelling, thus can basis
The time mark of acoustical signal searches target video data, here, the time mark of the target video data found and acoustical signal
Time mark completely the same.
In step S1035, video data currently playing for described terminal is switched to described target video data.
After finding target video data, directly currently playing video data can be switched to target video data,
Namely be equivalent to currently playing video data is directly delayed a period of time, so by this step, it is possible to achieve to described
The video pictures play in terminal carries out time delay.
Another embodiment of the present invention additionally provides a kind of broadcast control device, and this device can apply to the terminal 1 in Fig. 1
In, as shown in Figure 8, this device may include that acquisition module 11, synchronous detection module 12 and time delay module 13, wherein,
Acquisition module 11, is used for when the video data in terminal plays multi-medium data, and by described multi-medium data
When the voice data being associated with described video data is wirelessly sent to preset wireless acoustics device plays, gather institute
State the acoustical signal of wireless acoustics device plays；
Synchronous detection module 12, the most same with the video pictures of broadcasting in described terminal for detecting described acoustical signal
Step；
Time delay module 13, for when described acoustical signal and described video pictures are asynchronous, passing at described voice data
While defeated, the video pictures that described terminal is play is carried out time delay, so that described video pictures is same with described acoustical signal
Step.
In an alternative embodiment of the invention, as it is shown in figure 9, synchronous detection module 11, may include that waveform extracting submodule
111, waveform obtains submodule 112, waveform judges submodule 113 and determines submodule 114, wherein,
Waveform extracting submodule 111, for extracting the waveform of described acoustical signal；
Waveform obtains submodule 112, for obtaining the real-time waveform of the voice data corresponding with described video pictures；
Waveform judges submodule 113, for judging the waveform of described acoustical signal and the sound corresponding with described video pictures
The theoretical waveform of frequency evidence is the most consistent；
Determine submodule 114, for when described real-time waveform and described theoretical waveform are inconsistent, determine that described sound is believed
Number asynchronous with described video pictures.
In an alternative embodiment of the invention, as shown in Figure 10, time delay module 13, may include that duration calculation submodule 131
With timing_delay estimation submodule 132, wherein,
Duration calculation submodule 131, for calculating the time delay duration between described video pictures and described acoustical signal；
Timing_delay estimation submodule 132, for utilizing described time delay duration to carry out the video pictures play in described terminal
Time delay.
In an embodiment of the present invention, duration calculation submodule, including:
Waveshape feature abstraction submodule, for extracting the wave character in described real-time waveform, and, extract described theory
The wave character of waveform；Wave character contrast submodule, for by described real-time waveform and the wave character of described theoretical waveform
Carry out Characteristic Contrast；Time delay direction determines submodule, according to Characteristic Contrast result, determines described theoretical waveform and described real-time ripple
The time delay direction of shape；Mover module, for moving described theoretical waveform along described time delay direction；Duration record sub module, uses
Mobile duration in time recording described theoretical waveform and be consistent with described real-time waveform；Duration determines submodule, for by time described
Prolong the described mobile duration on direction and be defined as described time delay duration.
In an alternative embodiment of the invention, as shown in figure 11, time delay module 13, including: decoded information obtains submodule
133, video data lookup submodule 134 and video data switching submodule 135, wherein,
Decoded information obtain submodule 133, for obtain from described multimedia decoding data obtain described video data and
Decoded information during voice data；
Video data searches submodule 134, identical with the decoded information of described acoustical signal for searching decoded information
Target video data；
Video data switching submodule 135, for being switched to described target by video data currently playing for described terminal
Video data, it is achieved the video pictures play in described terminal is carried out time delay.
In an alternative embodiment of the invention, additionally providing a kind of terminal, this video playing terminal may include that such as above-mentioned figure
Broadcast control device described in any one embodiment of 8-Figure 11.
In an alternative embodiment of the invention, additionally providing a kind of terminal, as shown in figure 12, this terminal may include that
One or more processors 100；And,
Memorizer 200；Wherein,
The storage of described memorizer 200 has the instruction that can be performed by the one or more processor 100, and described instruction is set
It is set to perform:
Video data in terminal plays multi-medium data, and by described multi-medium data with described video data phase
When the voice data of association is wirelessly sent to preset wireless acoustics device plays, gathers described wireless acoustics equipment and broadcast
The acoustical signal put；
Detect described acoustical signal the most synchronize with the video pictures play in described terminal；
When described acoustical signal and described video pictures are asynchronous, while described voice data transmits, to described
The video pictures play in terminal carries out time delay, so that described video pictures is Tong Bu with described acoustical signal.
In an alternative embodiment of the invention, the described acoustical signal of described detection with the video pictures of broadcasting in described terminal is
The instruction of no synchronization is arranged to perform:
Extract the real-time waveform of described acoustical signal；
Obtain the theoretical waveform of the voice data corresponding with described video pictures；
Judge described real-time waveform and the most consistent with described theoretical waveform；
When described real-time waveform and described theoretical waveform are inconsistent, determine that described acoustical signal is with described video pictures not
Synchronize.
In an alternative embodiment of the invention, the instruction that the described video pictures to playing in described terminal carries out time delay is set
It is set to execution include:
Calculate the time delay duration between described video pictures and described acoustical signal；
Utilize described time delay duration that the video pictures play in described terminal is carried out time delay.
In an alternative embodiment of the invention, the time delay duration between the described video pictures of described calculating and described acoustical signal
Instruction be arranged to perform:
Extract the wave character in described real-time waveform, and, extract the wave character of described theoretical waveform；
The wave character of described real-time waveform and described theoretical waveform is carried out Characteristic Contrast；
According to Characteristic Contrast result, determine the time delay direction of described theoretical waveform and described real-time waveform；
Move described theoretical waveform along described time delay direction, and record described theoretical waveform consistent with described real-time waveform time
Mobile duration；
Described mobile duration on described time delay direction is defined as described time delay duration.
In an alternative embodiment of the invention, the instruction that the described video pictures to playing in described terminal carries out time delay is set
It is set to perform:
Obtain the decoded information when described multimedia decoding data obtain described video data and voice data；
Search the target video data that decoded information is identical with the decoded information of described acoustical signal；
Video data currently playing for described terminal is switched to described target video data, it is achieved broadcast in described terminal
The video pictures put carries out time delay.
The present invention can be described in the general context of computer executable instructions, such as program
Module.Usually, program module includes performing particular task or realizing the routine of particular abstract data type, program, object, group
Part, data structure etc..The present invention can also be put into practice in a distributed computing environment, in these distributed computing environment, by
The remote processing devices connected by communication network performs task.In a distributed computing environment, program module is permissible
It is positioned in the local and remote computer-readable storage medium of storage device.
It should be noted that in this article, such as the relational terms of " first " and " second " or the like is used merely to one
Individual entity or operation separate with another entity or operating space, and not necessarily require or imply these entities or operate it
Between exist any this reality relation or order.And, term " includes ", " comprising " or its any other variant are intended to
Contain comprising of nonexcludability, so that include that the process of a series of key element, method, article or equipment not only include those
Key element, but also include other key elements being not expressly set out, or also include for this process, method, article or set
Standby intrinsic key element.In the case of there is no more restriction, statement " including ... " key element limited, it is not excluded that
Other identical element is there is also in including the process of described key element, method, article or equipment.
The above is only the detailed description of the invention of the present invention, makes to skilled artisans appreciate that or realize this
Bright.Multiple amendment to these embodiments will be apparent to one skilled in the art, as defined herein
General Principle can realize without departing from the spirit or scope of the present invention in other embodiments.Therefore, the present invention
It is not intended to be limited to the embodiments shown herein, and is to fit to and principles disclosed herein and features of novelty phase one
The widest scope caused.
Claims (12)
1. a control method for playing back, is applied to terminal, it is characterised in that including:
Video data in terminal plays multi-medium data, and will described multi-medium data be associated with described video data
Voice data wirelessly be sent to preset wireless acoustics device plays time, gather described wireless acoustics device plays
Acoustical signal；
Detect described acoustical signal the most synchronize with the video pictures play in described terminal；
When described acoustical signal and described video pictures are asynchronous, while described voice data transmits, to described terminal
The video pictures of upper broadcasting carries out time delay, so that described video pictures is Tong Bu with described acoustical signal.
Method the most according to claim 1, it is characterised in that play in the described acoustical signal of described detection and described terminal
Video pictures whether synchronize, including:
Extract the real-time waveform of described acoustical signal；
Obtain the theoretical waveform of the voice data corresponding with described video pictures；
Judge described real-time waveform and the most consistent with described theoretical waveform；
When described real-time waveform and described theoretical waveform are inconsistent, determine that described acoustical signal is different from described video pictures
Step.
Method the most according to claim 2, it is characterised in that when the described video pictures to playing in described terminal is carried out
Prolong, including:
Calculate the time delay duration between described video pictures and described acoustical signal；
Utilize described time delay duration that the video pictures play in described terminal is carried out time delay.
Method the most according to claim 3, it is characterised in that the described video pictures of described calculating and described acoustical signal it
Between time delay duration, including:
Extract the wave character in described real-time waveform, and, extract the wave character of described theoretical waveform；
The wave character of described real-time waveform and described theoretical waveform is carried out Characteristic Contrast；
According to Characteristic Contrast result, determine the time delay direction of described theoretical waveform and described real-time waveform；
Move described theoretical waveform along described time delay direction, and record described theoretical waveform consistent with described real-time waveform time shifting
Dynamic duration；
Described mobile duration on described time delay direction is defined as described time delay duration.
Method the most according to claim 1, it is characterised in that when the described video pictures to playing in described terminal is carried out
Prolong, including:
Obtain the decoded information when described multimedia decoding data obtain described video data and voice data；
Search the target video data that decoded information is identical with the decoded information of described acoustical signal；
Video data currently playing for described terminal is switched to described target video data, it is achieved to play in described terminal
Video pictures carries out time delay.
6. a broadcast control device, is applied to terminal, it is characterised in that including:
Acquisition module, for when the video data in terminal plays multi-medium data, and by described multi-medium data with described
When the voice data that video data is associated wirelessly is sent to preset wireless acoustics device plays, gather described wireless
The acoustical signal that stereo set is play；
Synchronous detection module is the most synchronize with the video pictures play in described terminal for detecting described acoustical signal；
Time delay module, for when described acoustical signal and described video pictures are asynchronous, described voice data transmit same
Time, the video pictures that described terminal is play is carried out time delay, so that described video pictures is Tong Bu with described acoustical signal.
Device the most according to claim 6, it is characterised in that described synchronous detection module, including:
Waveform extracting submodule, for extracting the real-time waveform of described acoustical signal；
Waveform obtains submodule, for obtaining the theoretical waveform of the voice data corresponding with described video pictures；
Waveform judges submodule, is used for judging described real-time waveform and the most consistent with described theoretical waveform；
Determine submodule, for when described real-time waveform and described theoretical waveform are inconsistent, determine described acoustical signal and institute
State video pictures asynchronous.
Device the most according to claim 7, it is characterised in that described time delay module, including:
Duration calculation submodule, for calculating the time delay duration between described video pictures and described acoustical signal；
Timing_delay estimation submodule, for utilizing described time delay duration that the video pictures play in described terminal is carried out time delay.
Device the most according to claim 8, it is characterised in that described duration calculation submodule, including:
Waveshape feature abstraction submodule, for extracting the wave character in described real-time waveform, and, extract described theoretical waveform
Wave character；
Wave character contrast submodule, for carrying out feature pair by the wave character of described real-time waveform and described theoretical waveform
Ratio；
Time delay direction determines submodule, according to Characteristic Contrast result, determines the time delay of described theoretical waveform and described real-time waveform
Direction；
Mover module, for moving described theoretical waveform along described time delay direction；
Duration record sub module, for record described theoretical waveform consistent with described real-time waveform time mobile duration；
Duration determines submodule, for the described mobile duration on described time delay direction is defined as described time delay duration.
Device the most according to claim 6, it is characterised in that described time delay module, including:
Decoded information obtains submodule, obtains described video data and voice data for obtaining from described multimedia decoding data
Time decoded information；
Video data searches submodule, for searching the target video that decoded information is identical with the decoded information of described acoustical signal
Data；
Video data switching submodule, for being switched to described target video number by video data currently playing for described terminal
According to, it is achieved the video pictures play in described terminal is carried out time delay.
11. 1 kinds of terminals, it is characterised in that including: the broadcast control device as described in any one of claim 6-10.
12. 1 kinds of terminals, it is characterised in that including:
One or more processors；And,
Memorizer；Wherein,
Described memorizer storage has the instruction that can be performed by the one or more processor, and described instruction is arranged to perform:
Video data in terminal plays multi-medium data, and will described multi-medium data be associated with described video data
Voice data wirelessly be sent to preset wireless acoustics device plays time, gather described wireless acoustics device plays
Acoustical signal；
Detect described acoustical signal the most synchronize with the video pictures play in described terminal；
When described acoustical signal and described video pictures are asynchronous, while described voice data transmits, to described terminal
The video pictures of upper broadcasting carries out time delay, so that described video pictures is Tong Bu with described acoustical signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610565374.7A CN106210842A (en) | 2016-07-18 | 2016-07-18 | Control method for playing back and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610565374.7A CN106210842A (en) | 2016-07-18 | 2016-07-18 | Control method for playing back and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106210842A true CN106210842A (en) | 2016-12-07 |
Family
ID=57493847
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610565374.7A Pending CN106210842A (en) | 2016-07-18 | 2016-07-18 | Control method for playing back and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106210842A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106782598A (en) * | 2016-12-15 | 2017-05-31 | 深圳Tcl数字技术有限公司 | Television image and peripheral hardware synchronous sound control method and device |
| CN109451339A (en) * | 2018-12-28 | 2019-03-08 | 深圳Tcl新技术有限公司 | Audio frequency transmission method, device, equipment and readable storage medium storing program for executing |
| CN113965801A (en) * | 2021-10-11 | 2022-01-21 | Oppo广东移动通信有限公司 | Playing control method and device and electronic equipment |
| CN114520849A (en) * | 2022-02-21 | 2022-05-20 | 维沃移动通信有限公司 | Control method and control device for media playing |
| CN115412756A (en) * | 2022-08-29 | 2022-11-29 | 北京奇艺世纪科技有限公司 | Information delivery method and device, electronic equipment and storage medium |
| CN116320902A (en) * | 2023-05-19 | 2023-06-23 | 南昌航天广信科技有限责任公司 | Sound box synchronous playing method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4618890A (en) * | 1985-01-22 | 1986-10-21 | Nec Corporation | Digital audio synchronizing system with mute time switching function |
| GB2160393B (en) * | 1984-04-09 | 1987-07-22 | Nec Corp | Digital audio synchronizing system |
| CN204305260U (en) * | 2014-12-28 | 2015-04-29 | 冠捷显示科技（厦门）有限公司 | The television set of a kind of video and wireless sound box Audio Matching |
| CN105100794A (en) * | 2014-05-13 | 2015-11-25 | 深圳Tcl新技术有限公司 | Audio and video synchronization test method and apparatus |
| CN105376628A (en) * | 2014-08-27 | 2016-03-02 | 深圳Tcl新技术有限公司 | Method and device for synchronizing audio-video signals |
-
2016
- 2016-07-18 CN CN201610565374.7A patent/CN106210842A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2160393B (en) * | 1984-04-09 | 1987-07-22 | Nec Corp | Digital audio synchronizing system |
| US4618890A (en) * | 1985-01-22 | 1986-10-21 | Nec Corporation | Digital audio synchronizing system with mute time switching function |
| CN105100794A (en) * | 2014-05-13 | 2015-11-25 | 深圳Tcl新技术有限公司 | Audio and video synchronization test method and apparatus |
| CN105376628A (en) * | 2014-08-27 | 2016-03-02 | 深圳Tcl新技术有限公司 | Method and device for synchronizing audio-video signals |
| CN204305260U (en) * | 2014-12-28 | 2015-04-29 | 冠捷显示科技（厦门）有限公司 | The television set of a kind of video and wireless sound box Audio Matching |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106782598A (en) * | 2016-12-15 | 2017-05-31 | 深圳Tcl数字技术有限公司 | Television image and peripheral hardware synchronous sound control method and device |
| CN109451339A (en) * | 2018-12-28 | 2019-03-08 | 深圳Tcl新技术有限公司 | Audio frequency transmission method, device, equipment and readable storage medium storing program for executing |
| CN109451339B (en) * | 2018-12-28 | 2021-10-01 | 深圳Tcl新技术有限公司 | Audio transmission method, device, equipment and readable storage medium |
| CN113965801A (en) * | 2021-10-11 | 2022-01-21 | Oppo广东移动通信有限公司 | Playing control method and device and electronic equipment |
| CN114520849A (en) * | 2022-02-21 | 2022-05-20 | 维沃移动通信有限公司 | Control method and control device for media playing |
| CN115412756A (en) * | 2022-08-29 | 2022-11-29 | 北京奇艺世纪科技有限公司 | Information delivery method and device, electronic equipment and storage medium |
| CN116320902A (en) * | 2023-05-19 | 2023-06-23 | 南昌航天广信科技有限责任公司 | Sound box synchronous playing method and system |
| CN116320902B (en) * | 2023-05-19 | 2023-08-25 | 南昌航天广信科技有限责任公司 | Sound box synchronous playing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106210842A (en) | Control method for playing back and device | |
| US9948980B2 (en) | Synchronizing audio content to audio and video devices | |
| US8832320B2 (en) | Server for presenting interactive content synchronized to time-based media | |
| US8718805B2 (en) | Audio-based synchronization to media | |
| US9979997B2 (en) | Synchronization of live audio and video data streams | |
| WO2017166497A1 (en) | Method and apparatus for synchronously playing multimedia data | |
| US20130097190A1 (en) | Supplementing synchronization with programming metadata | |
| CA2951065A1 (en) | Synchronizing playback of segmented video content across multiple video playback devices | |
| JP2017531811A5 (en) | ||
| CN106162022B (en) | A kind of method, system and the mobile terminal of quick broadcasting video | |
| US20120102233A1 (en) | Synchronized delivery of interactive content using standardized vectors | |
| US8925019B2 (en) | Synchronous display streaming system and synchronous displaying method | |
| CN106488289B (en) | Audio sync playback method, apparatus and system | |
| WO2013048618A1 (en) | Systems and methods for synchronizing the presentation of a combined video program | |
| CN109714622A (en) | A kind of video data handling procedure, device and electronic equipment | |
| CN105898498A (en) | Video synchronization method and system | |
| CN104185040A (en) | Application synchronization method, application server and terminal | |
| US20130173749A1 (en) | Methods and devices for providing digital content | |
| CN103873919A (en) | Information processing method and electronic equipment | |
| CN106507172B (en) | Information coding method, coding/decoding method and device | |
| CN104837046A (en) | Multi-media file processing method and device | |
| CN105430449B (en) | Media file playing method, apparatus and system | |
| WO2010131105A1 (en) | Synchronization of audio or video streams | |
| CN115767158A (en) | Synchronous playing method, terminal equipment and storage medium | |
| CN105491302A (en) | Audio signal output method and device, terminal, and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20161207 |