CN103905878A - Video data and audio data synchronized playing method and device and equipment - Google Patents

Video data and audio data synchronized playing method and device and equipment Download PDF

Info

Publication number
CN103905878A
CN103905878A CN201410093301.3A CN201410093301A CN103905878A CN 103905878 A CN103905878 A CN 103905878A CN 201410093301 A CN201410093301 A CN 201410093301A CN 103905878 A CN103905878 A CN 103905878A
Authority
CN
China
Prior art keywords
time
data
display terminal
time stamp
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410093301.3A
Other languages
Chinese (zh)
Inventor
李典
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201410093301.3A priority Critical patent/CN103905878A/en
Publication of CN103905878A publication Critical patent/CN103905878A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention provides a video data and audio data synchronized playing method and device and equipment. The method includes the steps that multimedia data are received on a display terminal side; the multimedia data comprise video data and audio data; the video data carry one or more video timestamps; the audio data are sent to a mobile device side; the display terminal side is connected with the mobile device side in a wireless transmission mode; when the video data are played, playing object timestamps are generated according to currently-played video timestamps; the playing object timestamps are sent to the mobile device side; the mobile device side is used for playing the audio data corresponding to the playing object timestamps. With the video data and audio data synchronized playing method and device and the equipment, the constraint caused when wired earphones are directly connected with a display terminal can be gotten rid of by a user, operation of the user is facilitated, and synchronized playing of the audio data and the video data is achieved.

Description

Synchronous method, device and the equipment of playing of a kind of video data and voice data
Technical field
The embodiment of the present invention relates to the technical field of multi-medium data processing, particularly relates to synchronous device and a kind of equipment of playing of synchronous method, a kind of video data and the voice data of playing of a kind of video data and voice data.
Background technology
Along with supporting player universal of various media, more and more media file synchronization is play to obtain better appreciation effect and artistic effect, wherein displaying video, music appreciating, browsing pictures are the media executive modes of extensive use.
Taking intelligent television equipment as example, intelligent television comprises intelligent television, Intelligent set top box, can carry out the broadcasting of multi-medium data.Such as in the situations such as household's rest at night, for avoiding disturbing other people, ensure the viewing and admiring of multi-medium data, user may wish the sound when wearing earphone and listen to intelligent television device plays video, to substitute the device plays sound of raising one's voice of intelligent television equipment simultaneously.
Wear earphone and conventionally have two kinds of solutions: a kind of method is to connect intelligent television equipment with wired earphone; Another kind method is for supporting the equipment of bluetooth earphone, links intelligent television with bluetooth earphone.
First method, inserts wired earphone in intelligent television equipment, and because the common distance users viewing location of intelligent television equipment is distant, therefore needs the line of wired earphone very long, and plug is also inconvenient.User carries out other action, and for example pouring etc., need to drag long line, causes operation very inconvenient.
Second method needs to buy in addition bluetooth earphone, and cost is high; And, the problem that bluetooth earphone there will be sound conversation structure to postpone conventionally, it is very poor that user experiences.
Summary of the invention
Embodiment of the present invention technical problem to be solved is to provide a kind of method of video data and the synchronous broadcasting of voice data in order to solve the problem that inconvenient operation and cost are high.
Accordingly, the embodiment of the present invention also provides a kind of video data and synchronous device and a kind of equipment of playing of voice data, in order to ensure the implementation and application of said method.
In order to address the above problem, the embodiment of the invention discloses a kind of synchronous method of playing of video data and voice data, comprising:
At display terminal side receiving multimedia data; Described multi-medium data comprises video data and voice data; Described video data carries one or more video time stamp;
Described voice data is sent to mobile device side; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
In the time playing described video data, generate and play object time stamp according to the video time stamp of current broadcasting;
Described broadcasting object time stamp is sent to described mobile device side; Described mobile device side is used for playing the described broadcasting object time and stabs corresponding voice data.
Preferably, the mode of described wireless transmission comprises following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
Preferably, described broadcasting object time stamp comprises video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
Preferably, described broadcasting object time stamp comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
Preferably, described time of delay, value was for to be sent to described mobile device by preset analogue data and to record current the first system time value, receive the described analogue data that described mobile device returns and record current second system time value, and, calculate the half of the difference of described second system time value and described the first system time value, value time of delay of acquisition;
Or;
Described value time of delay that time of delay, value sent for described mobile device.
Preferably, described, in the time playing described video data, before generating according to the video time stamp of current broadcasting the step of playing object time stamp, described method also comprises:
Described video data is carried out to buffered.
The embodiment of the invention also discloses a kind of synchronous method of playing of video data and voice data, comprising:
Receive at mobile device side joint the voice data that display terminal side sends; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Receive the broadcasting object time stamp that described display terminal side sends; Described reproduction time stabs as described display terminal is in the time playing described video data, the timestamp generating according to the video time stamp of current broadcasting;
Play the described broadcasting object time and stab corresponding voice data; Described voice data and described video data are the multi-medium data that described display terminal receives.
Preferably, the mode of described wireless transmission comprises following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
Preferably, described broadcasting object time stamp comprises video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
Preferably, described broadcasting object time stamp comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
Preferably, after the step of the broadcasting object time stamp sending in the described display terminal side of described reception, described method also comprises:
Obtain value time of delay;
In the time value of described broadcasting object time stamp instruction, increase described time of delay of value.
Preferably, described time of delay, value was for by being sent to preset analogue data described display terminal and recording the 3rd current system time value, receive the described analogue data that described display terminal returns and record current Quaternary system system time value, and calculate the half of described Quaternary system system time value and the difference of described the 3rd system time value, be worth the time of delay of acquisition;
Or,
Described value time of delay that time of delay, value sent for described display terminal.
Preferably, described voice data carries one or more audio time stamp;
The step that the described broadcasting object time of described broadcasting is stabbed corresponding voice data comprises:
When the audio time stamp of current broadcasting is greater than when stamp described broadcasting object time, suspend playing audio-fequency data until the audio time stamp of current broadcasting equals described the broadcastings object time stabs;
And/or,
When the audio time stamp of current broadcasting is less than or equal to when stamp described broadcasting object time, search the audio time stamp that equals described broadcasting object time stamp;
Play voice data corresponding to described audio time stamp.
Preferably, before stabbing the step of corresponding voice data in the described broadcasting described broadcasting object time, described method also comprises:
Described voice data is carried out to buffered.
The embodiment of the invention also discloses the synchronous device of playing of a kind of video data and voice data, comprising:
Multi-medium data receiver module, at display terminal side receiving multimedia data; Described multi-medium data comprises video data and voice data; Described video data carries one or more video time stamp;
Voice data sending module, for being sent to mobile device side by described voice data; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Play object time stamp generation module, in the time playing described video data, generate and play object time stamp according to the video time stamp of current broadcasting;
Play object time stamp sending module, for described broadcasting object time stamp is sent to described mobile device side; Described mobile device side is used for playing the described broadcasting object time and stabs corresponding voice data.
Preferably, the mode of described wireless transmission comprises following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
Preferably, described broadcasting object time stamp comprises video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
Preferably, described broadcasting object time stamp comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
Preferably, described time of delay, value was for to be sent to described mobile device by preset analogue data and to record current the first system time value, receive the described analogue data that described mobile device returns and record current second system time value, and, calculate the half of the difference of described second system time value and described the first system time value, value time of delay of acquisition;
Or;
Described value time of delay that time of delay, value sent for described mobile device.
Preferably, also comprise:
The first buffer module, for carrying out buffered to described video data.
The embodiment of the invention also discloses the synchronous device of playing of a kind of video data and voice data, comprising:
Voice data receiver module, for receiving at mobile device side joint the voice data that display terminal side sends; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Play object time stamp receiver module, the broadcasting object time stamp sending for receiving described display terminal side; Described reproduction time stabs as described display terminal is in the time playing described video data, the timestamp generating according to the video time stamp of current broadcasting;
Voice data broadcasting module, stabs corresponding voice data for playing the described broadcasting object time; Described voice data and described video data are the multi-medium data that described display terminal receives.
Preferably, the mode of described wireless transmission comprises following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
Preferably, described broadcasting object time stamp comprises video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
Preferably, described broadcasting object time stamp comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
Preferably, also comprise:
Be worth acquisition module time of delay, for obtaining value time of delay;
Time of delay value increases module, for increasing described time of delay of value in the time value in the stamp instruction of described broadcasting object time.
Preferably, described time of delay, value was for by being sent to preset analogue data described display terminal and recording the 3rd current system time value, receive the described analogue data that described display terminal returns and record current Quaternary system system time value, and calculate the half of described Quaternary system system time value and the difference of described the 3rd system time value, be worth the time of delay of acquisition;
Or,
Described value time of delay that time of delay, value sent for described display terminal.
Preferably, described voice data carries one or more audio time stamp; Described voice data broadcasting module comprises:
Suspend and play submodule, for be greater than when stamp described broadcastings object time in the audio time stamp of current broadcasting, suspend playing audio-fequency data until the audio time stamp of current broadcasting equals the described broadcasting object time stabs;
And/or,
Search submodule, for being less than or equal to when stamp described broadcasting object time in the audio time stamp of current broadcasting, searching the audio time stamp that equals described broadcasting object time stamp;
The corresponding submodule of playing, for playing voice data corresponding to described audio time stamp.
Preferably, also comprise:
The second buffer module, for carrying out buffered to described voice data.
The embodiment of the invention also discloses a kind of equipment, comprising:
One or more processors;
Memory; With
One or more modules, described one or more module stores are in described memory and be configured to be carried out by described one or more processors, and wherein, described one or more modules have following function:
At display terminal side receiving multimedia data; Described multi-medium data comprises video data and voice data; Described video data carries one or more video time stamp;
Described voice data is sent to mobile device side; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
In the time playing described video data, generate and play object time stamp according to the video time stamp of current broadcasting;
Described broadcasting object time stamp is sent to described mobile device side; Described mobile device side is used for playing the described broadcasting object time and stabs corresponding voice data.
The embodiment of the invention also discloses a kind of equipment, comprising:
One or more processors;
Memory; With
One or more modules, described one or more module stores are in described memory and be configured to be carried out by described one or more processors, and wherein, described one or more modules have following function:
Receive at mobile device side joint the voice data that display terminal side sends; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Receive the broadcasting object time stamp that described display terminal side sends; Described reproduction time stabs as described display terminal is in the time playing described video data, the timestamp generating according to the video time stamp of current broadcasting;
Play the described broadcasting object time and stab corresponding voice data; Described voice data and described video data are the multi-medium data that described display terminal receives.
Compared with background technology, the embodiment of the present invention comprises following advantage:
In the embodiment of the present invention, display terminal is after receiving multimedia data, voice data is sent to mobile device, display terminal is in the time of playing video data, send and play object time stamp to mobile device, mobile device is according to playing object time stamp playing audio-fequency data, wherein display terminal is connected by the mode of wireless transmission with mobile device, make user can break away from the constraint that wired earphone directly connects display terminal, user-friendly, the fine difference of simultaneously having avoided voice data and video data to produce in the time playing is accumulated the obvious nonsynchronous problem causing, realize the synchronous broadcasting of voice data and video data.In addition, mobile device is the product that public use frequency is very high, the multiplexing mobile device of the embodiment of the present invention, and one-object-many-purposes, has avoided extra purchase bluetooth earphone, practical, greatly reduces cost.
The embodiment of the present invention is added value time of delay in broadcasting object time stamp, has eliminated the impact in the delay of transmission broadcasting object time stamp of display terminal and mobile device, has further improved the precision that voice data and video data are synchronously play.
Brief description of the drawings
Fig. 1 shows the flow example figure of the synchronous playing video data of a kind of display terminal and voice data;
Fig. 2 shows a kind of display terminal and synchronizes the flow example figure of playing video data and voice data with bluetooth earphone;
Fig. 3 shows the flow chart of steps of a kind of video data of the present invention and the synchronous embodiment of the method 1 of playing of voice data;
Fig. 4 shows the flow chart of steps of a kind of video data of the present invention and the synchronous embodiment of the method 2 of playing of voice data;
Fig. 5 shows the flow chart of steps of a kind of video data of the present invention and the synchronous embodiment of the method 3 of playing of voice data;
Fig. 6 shows the flow chart of steps of a kind of video data of the present invention and the synchronous embodiment of the method 4 of playing of voice data;
Fig. 7 shows the structured flowchart of a kind of video data of the present invention and the synchronous device embodiment 1 playing of voice data;
Fig. 8 shows the structured flowchart of a kind of video data of the present invention and the synchronous device embodiment 2 playing of voice data;
Fig. 9 has gone out the structural representation of the intelligent television that one embodiment of the invention provides;
Figure 10 shows a kind of terminal equipment structural representation that the embodiment of the present invention provides.
Embodiment
For the above-mentioned purpose, the feature and advantage that make the embodiment of the present invention can become apparent more, below in conjunction with the drawings and specific embodiments, the embodiment of the present invention is described in further detail.
With reference to Fig. 1, show the flow example figure of the synchronous playing video data of a kind of display terminal and voice data.
As shown in Figure 1, the audio, video data read module in display terminal reads multi-medium data, then decode and obtain video data and voice data, and video data and voice data band is useful on synchronous timestamp.
Then video data transmitting is delivered to video output module, voice data is sent to audio frequency output module.In the time of play multimedia data, the timestamp that is carried out video data and voice data by broadcasting time point control module is synchronous, then video output module is according to synchronous timestamp playing video data on display, voice data module is according to synchronous timestamp playing audio-fequency data on loud speaker, finally realize synchronous playing video data and voice data, realize on the whole the broadcasting of multi-medium data.
But, in some cases, for example, in household's rest at night, for avoiding disturbing other people, voice data when user may wish to listen to intelligent television device plays multi-medium data by earphone.
For addressing the above problem, can apply voice data when bluetooth earphone is long-range listens to intelligent television device plays multi-medium data.
In bluetooth applications, blue tooth products is distinguished device type and COS.
Generally speaking, device type comprises main equipment type and auxiliary equipment type, has specified that bluetooth equipment belongs to the equipment of which type, as earphone, mobile phone, printer etc.Taking mobile phone as example, by auxiliary equipment type stated be smart mobile phone or regular handset.
COS has specified the service that bluetooth equipment can provide.Taking mobile phone as example, some mobile phones are supported OPP(object storage specification, Object Push Profile) and FTP(File Transfer Protocol, file transfer protocol (FTP)) two kinds of file transfer services, some mobile phones only provide OPP service, two bluetooth equipments are wanted mutual communication, equipment class can be different, as mobile phone and earphone, but the service agreement of bluetooth equipment must be consistent, because need earphone that voice service is provided, finds earphone by mobile phone, can or to inquire what service it can provide before connection, and then carry out communication.
Mobile device, for example smart mobile phone, Intelligent flat etc., although bluetooth enable, belongs to blue tooth products, its device type is not earphone, bluetooth earphone service ability can not be provided, and the bluetooth module that therefore cannot serve as in the shown terminal of earphone connects and the use of propelling movement voice data.
Therefore, if the voice data while wanting to listen to intelligent television device plays multi-medium data by bluetooth earphone needs additionally to buy bluetooth earphone.
With reference to Fig. 2, show a kind of display terminal and synchronize the flow example figure of playing video data and voice data with bluetooth earphone.
As shown in Figure 2, display terminal is connected with bluetooth earphone by Bluetooth link.Audio, video data read module in display terminal reads multi-medium data, then decode and obtain video data and voice data, and video data and voice data band is useful on synchronous timestamp.
Then video data transmitting is delivered to video output module, voice data is sent to bluetooth earphone.
Bluetooth audio frequency receiver module in bluetooth earphone receives the voice data that display terminal sends, and is then sent to audio frequency output module, and then exports earphone speaker to and play.
Voice data and video data are play respectively on two equipment, and voice data, before being played, has passed through the data processing in Bluetooth transmission process and transmitting procedure, must postpone by generation time.
There is small difference in the clock frequency that bluetooth earphone timing is used and the clock frequency of display terminal, can make voice data and video data produce small difference in the speed of playing, this difference can constantly build up, cause the growth along with reproduction time of voice data and video data asynchrony phenomenon, more and more obvious.
Based on the demand, inventor creatively proposes one of core idea of the embodiment of the present invention, display terminal is decoded as multi-medium data after video data and voice data, by audio data transmission to mobile device, in the time that video data is play, corresponding timestamp is sent to mobile device, mobile device carries out synchronous video data according to timestamp and plays.
With reference to Fig. 3, show the flow chart of steps of the synchronous embodiment of the method 1 of playing of a kind of video data of the present invention and voice data, the embodiment of the present invention can comprise the steps:
Step 301, at display terminal side receiving multimedia data; Described multi-medium data can comprise video data and voice data; Described video data can carry one or more video time stamp;
It should be noted that, display terminal can comprise intelligent television, PC, palmtop PC, mobile device etc., and intelligent television can comprise LCD(Liquid Crystal Display, liquid crystal display) TV, LED(Light Emitting Diode, light-emitting diode) TV, 3D TV, plasm TV etc., the embodiment of the present invention is not limited this.
Multi-medium data can be digital television signal, can, for being stored in the multi-medium data on display terminal or peripheral equipment disk, can be stream medium data, etc., the embodiment of the present invention is not limited this.
In actual applications, can in the time that making, add multi-medium data the timestamp that is used to indicate time point information.
Display terminal is receiving after multi-medium data, can decode, to obtain video data and voice data.
Voice data can carry one or more audio time stamp, and video data can carry one or more video time stamp.Audio time stamp can refer to the time point data that a section audio will be played, video time stamp can refer to the time point data that a frame picture will be played, on some time points of multi-medium data, audio time stamp and video time stamp can equate, the timestamp adding when its essence can be made for multi-medium data.For example, audio time stamp can indicate a certain section audio to export broadcasting at how many milliseconds, and video time stamp can indicate a certain frame picture to export broadcasting at how many milliseconds.In actual applications, the audio time stamp of the video time stamp of the first frame picture and first paragraph audio frequency can be 0, and video time stamp below and audio time stamp can increase with identical interval time.
Step 302, is sent to mobile device side by described voice data; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Application the embodiment of the present invention, display terminal can and mobile device between set up data transmission link.
It should be noted that, mobile device can be the various mobile devices such as panel computer, personal digital assistant (Personal Digital Assistant, PDA), mobile phone, and the embodiment of the present invention is not restricted this.
In a kind of preferred exemplary of the embodiment of the present invention, the mode of described wireless transmission can comprise following one or more:
Ethernet;
In this example, the transmission link between display terminal and mobile device can be Ethernet (Ethernet) link, and display terminal side can be sent to mobile device side by described voice data by the transmission means of Ethernet.
Ethernet (Ethernet) is a kind of LAN (Local Area Network) networking technology, adopts passive medium, diffuses information by broadcast mode.It has specified physical layer and data link layer protocol, has specified the interface of physical layer and data link layer and data link layer and more high-rise interface.Its standard topology structure is bus-type topology, but current Fast Ethernet (100BASE-T, 1000BASE-T standard) in order farthest to reduce conflict, farthest improve network speed and service efficiency, use switch (Switch hub) to carry out network connection and tissue, like this, it is star-like that the topological structure of Ethernet has just become, but logically, it is csma/cd that Ethernet still uses bus-type topological sum CSMA/CD(Carrier Sense Multiple Access/Collision Detect) bus conflict technology.
In this example, application Ethernet, can be created in for mono-of WiFi(the WLAN equipment of IEEE802.11 standard), display terminal and mobile device are being connected into after same local area network (LAN), can pass through IP(Internet Protocol, the agreement interconnecting between network) TCP/IP(Transmission Control Protocol/Internet Protocol for address, transmission control protocol/Internet Interconnection agreement, has another name called network communication protocol) agreement initiation connection.
Bluetooth;
In this example, the transmission link between display terminal and mobile device can be Bluetooth link, and display terminal side can be sent to mobile device side by described voice data by the transmission means of bluetooth.
Bluetooth is the radiotechnics of a kind of support equipment short haul connection (in general 10m).Can comprise mobile phone, PDA, wireless headset, notebook computer, be correlated with and carry out wireless messages exchange between numerous equipment such as peripheral hardware.
" bluetooth " technology of utilization, can simplify the communication between mobile communication terminal device effectively, also communicating by letter between simplified apparatus and internet Internet successfully, thus transfer of data becomes more rapidly efficiently, is radio communication widening road.
Bluetooth adopts distributed network structure and fast frequency hopping and short packet technology, supports point-to-point and point-to-multipoint delivery, is operated in the i.e. industry of 2.4GHz ISM(, science, the medical science of global general-use) frequency range.Its data rate is 1Mbps.Adopt time division duplex transmission scheme to realize full duplex transmission.
In this example, the agreement corresponding according to bluetooth, mobile device can be found equipment around, then lists device id and name list, then selects to need the display terminal of connection, connects.
It should be noted that, in this example, mobile device, for example smart mobile phone, Intelligent flat etc., bluetooth enable, belong to blue tooth products, its device type can be display terminal, and blue-teeth data transmittability between display terminal can be provided, and the bluetooth module therefore can be used as in the shown terminal of voice data receiving terminal connects and the use of propelling movement voice data.
2.4G wireless network;
In this example, the transmission link between display terminal and mobile device can be 2.4G wireless network links, and display terminal side can be sent to mobile device side by described voice data by the transmission means of 2.4G wireless network.
2.4G wireless network frequency range belongs to ISM band, and it is the ultralow radiation environmental protection frequency range being widely used in global range; There are 125 communication channels, because the communication of 2.4G wireless network is more unobstructed, can phase mutual interference between multiple communication instructions; 2.4G wireless mesh bandwidth passes that speed is the highest can reach 108Mbps, and therefore its transmission speed is very fast; Its transmission range is (open field: 200m effective propagation path) far away relatively, and the not impact of the side of being transmitted, and supports two-way communication.
Infrared ray;
In this example, the transmission link between display terminal and mobile device can be infrared link, and display terminal side can be sent to mobile device side by described voice data by ultrared transmission means.
Infrared is ultrared abbreviation, is a kind of wireless communication mode, can carry out the transmission of wireless data.Infrared interface is the configuration standard of mobile phone of new generation, its supports mobile phone and computer and other digital devices to carry out data exchange. infrared communication has feature with low cost, easy to connect, to be simple and easy to use and compact conformation, therefore in small-sized mobile device, obtains a wide range of applications.By infrared interface, all kinds of mobile devices can freely carry out exchanges data.
Wireless network protocol ZigBee.
In this example, the transmission link between display terminal and mobile device can be ZigBee link, and display terminal side can be sent to mobile device side by described voice data by the transmission means of wireless network protocol ZigBee.
Zigbee is the wireless network protocol of a kind of low speed short-distance transmission based on IEEE802.15.4 standard.Agreement is respectively physical layer (PHY), MAC layer (MAC), transport layer (TL), network layer (NWK), application layer (APL) etc. from top to bottom.Wherein physical layer and MAC layer are followed the regulation of IEEE802.15.4 standard.
ZigBee-network main feature is low-power consumption, low cost, low rate, support great deal of nodes, support multiple network topology, low complex degree, quick, reliable, safety.The Three roles such as the be divided into telegon of equipment in ZigBee-network (Coordinator), aggregation node (Router), sensor node (EndDevice).
Certainly, above-mentioned transmission means, just as example, in the time implementing the embodiment of the present invention, can arrange other transmission meanss according to actual conditions, as long as can realize being connected of wireless transmission of display terminal and mobile device, the embodiment of the present invention is not limited this.In addition, except above-mentioned transmission means, those skilled in the art can also adopt other transmission means according to actual needs, and the embodiment of the present invention is not also limited this.
Step 303, in the time playing described video data, generates and plays object time stamp according to the video time stamp of current broadcasting;
In actual applications, display terminal, in the time tapping into the broadcasting of row voice data, can constantly send video playback information (playing object time stamp) to display terminal.
More or less can there is certain delay in the transfer of data between display terminal and mobile device, in a kind of situation, for improving the precision of synchronous broadcasting, the embodiment of the present invention, in the time of video data and voice data synchronous, can be considered the delay of transmission.
In embodiments of the present invention, described broadcasting object time stamp can comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
In embodiments of the present invention, video time stamp corresponding to current video data is t a, time of delay, value was Δ t, play object time stamp t a＇=t a+ Δ t.
In embodiments of the present invention, can be worth in advance or in the time of delay between pre-test display terminal and mobile device; Can be that display terminal is initiatively measured, also can obtain from mobile device, the embodiment of the present invention not be limited this.For example, when display terminal and mobile device are in the time being connected for the first time, display terminal or mobile device are initiatively initiated the measurement of value time of delay, after measurement finishes, by the mark of the mark of display terminal, mobile device, transmission means and time of delay value be stored in display terminal and/or mobile device.When display terminal with mobile device in the time being again connected, when mark, the mark of mobile device, the transmission means of display terminal are when the match is successful, can directly from display terminal and/or mobile device, obtain value time of delay of formerly measuring.
In a kind of preferred exemplary of the embodiment of the present invention, value can be for to be sent to described mobile device by preset analogue data and to record current the first system time value described time of delay, receive the described analogue data that described mobile device returns and record current second system time value, and, calculate the half of the difference of described second system time value and described the first system time value, value time of delay of acquisition;
In actual applications, analogue data can be the data of arbitrary format.And the size of the time-delay value of transfer of data and transmission data has relation, therefore time point data of the size of analogue data and actual transmission are the same.In this example, analogue data can and two audio time stamp between the size of voice data the same.
Display terminal is sent to analogue data after mobile device, mobile device need to return to analogue data immediately to display terminal, display terminal calculates analogue data from sending to the half of time difference (being the difference of the first system time and second system time) of reception, obtains value time of delay.
Be T when the first system time 1, the second system time is T 2time, time of delay Δ t=(T 2-T 1)/2.
Certainly, the embodiment of the present invention can also be calculated repeatedly analogue data from sending to the half of time difference of reception, obtains value time of delay, to reduce error.
The embodiment of the present invention is added value time of delay in broadcasting object time stamp, has eliminated the impact in the delay of transmission broadcasting object time stamp of display terminal and mobile device, has further improved the precision that voice data and video data are synchronously play.
In the another kind of preferred exemplary of the embodiment of the present invention, being worth described time of delay can be value time of delay that described mobile device sends.
In this example, described time of delay, value can be for mobile device be by being sent to preset analogue data described display terminal and recording the 3rd current system time value, receive the described analogue data that described display terminal returns and record current Quaternary system system time value, and calculate the half of described Quaternary system system time value and the difference of described the 3rd system time value, be worth the time of delay of acquisition.
People's naked eyes resolution capability is generally 1/24 second, is can obviously not feel if video data and voice data exist small difference, people in the time playing.Therefore in another kind of situation, for reducing the resource occupation of display terminal or mobile device, for example, in the time that time of delay, value was less than a predetermined threshold value (40ms), the embodiment of the present invention, in the time of video data and voice data synchronous, can not considered the delay of transmission.
In embodiments of the present invention, described broadcasting object time stamp can comprise video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
Video time stamp corresponding to current video data is t a, play object time stamp t a＇=t a.
Step 304, is sent to described mobile device side by described broadcasting object time stamp; Described mobile device side is used for playing the described broadcasting object time and stabs corresponding voice data.
With step 302 accordingly, display terminal side can be sent to mobile device side by broadcasting object time stamp by the transmission means of Ethernet, or, can broadcasting object time stamp be sent to mobile device side by the transmission means of bluetooth, or, can broadcasting object time stamp be sent to mobile device side by the transmission means of 2.4G wireless network, or, can broadcasting object time stamp be sent to mobile device side by ultrared transmission means, or, can broadcasting object time stamp be sent to mobile device side by the transmission means of wireless network protocol ZigBee.
In the embodiment of the present invention, display terminal is after receiving multimedia data, voice data is sent to mobile device, display terminal is in the time of playing video data, send and play object time stamp to mobile device, mobile device is according to playing object time stamp playing audio-fequency data, wherein display terminal is connected by the mode of wireless transmission with mobile device, user can break away from the constraint that wired earphone directly connects display terminal, user-friendly, the fine difference of simultaneously having avoided voice data and video data to produce in the time playing is accumulated the obvious nonsynchronous problem causing, realize the synchronous broadcasting of voice data and video data.In addition, mobile device is the product that public use frequency is very high, the multiplexing mobile device of the embodiment of the present invention, and one-object-many-purposes, has avoided extra purchase bluetooth earphone, practical, greatly reduces cost.
With reference to Fig. 4, show the flow chart of steps of the synchronous embodiment of the method 2 of playing of a kind of video data of the present invention and voice data, the embodiment of the present invention can comprise the steps:
Step 401, at display terminal side receiving multimedia data; Described multi-medium data can comprise video data and voice data; Described video data can carry one or more video time stamp;
Step 402, is sent to mobile device side by described voice data; Described display terminal side can be connected by the mode of wireless transmission with described mobile device side;
Step 403, carries out buffered to described video data;
In specific implementation, buffered can start playing video data or voice data again for process buffer time value.Buffer time can for example, for being set in advance as a fixed value, 5 seconds.
In display terminal, can pass through buffer time, cushion after enough video datas, then carried out the broadcasting of video data; And in mobile device, can pass through identical buffer time, cushion after enough voice datas, then carried out the broadcasting of voice data.
Step 404, in the time playing described video data, generates and plays object time stamp according to the video time stamp of current broadcasting;
In the embodiment of the present invention, described broadcasting object time stamp can comprise video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
Video time stamp corresponding to current video data is t a, play object time stamp t a＇=t a.
Step 405, is sent to described mobile device side by described broadcasting object time stamp; Described mobile device side is used for playing the described broadcasting object time and stabs corresponding voice data.
With reference to Fig. 5, show the flow chart of steps of the synchronous embodiment of the method 3 of playing of a kind of video data of the present invention and voice data, the embodiment of the present invention can comprise the steps:
Step 501, receives at mobile device side joint the voice data that display terminal side sends; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Application the embodiment of the present invention, display terminal can and mobile device between set up data transmission link.
In a kind of preferred exemplary of the embodiment of the present invention, the mode of described wireless transmission can comprise following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
In this example, the transmission link between display terminal and mobile device can be ethernet link, Bluetooth link, 2.4G wireless network links, infrared link, ZigBee link or other transmission links.
Particularly, mobile device side can receive the voice data that display terminal side sends by the transmission means of Ethernet, or, can receive the voice data that display terminal side sends by the transmission means of bluetooth, or, can receive the voice data that display terminal side sends by the transmission means of 2.4G wireless network, or, can receive the voice data that display terminal side sends by ultrared transmission means, or, can receive the voice data that display terminal side sends by the transmission means of wireless network protocol ZigBee.
Step 502, receives the broadcasting object time stamp that described display terminal side sends; Described reproduction time stabs as described display terminal is in the time playing described video data, the timestamp generating according to the video time stamp of current broadcasting;
With step 501 accordingly, mobile device side can receive the broadcasting object time stamp that described display terminal side sends by the transmission means of Ethernet, or, can receive the broadcasting object time stamp that described display terminal side sends by the transmission means of bluetooth, or, can receive the broadcasting object time stamp that described display terminal side sends by the transmission means of 2.4G wireless network, or, can receive the broadcasting object time stamp that described display terminal side sends by ultrared transmission means, or, can receive the broadcasting object time stamp that described display terminal side sends by the transmission means of wireless network protocol ZigBee.
In a preferred embodiment of the present invention, described broadcasting object time stamp can comprise video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
In embodiments of the present invention, video time stamp corresponding to current video data is t a, play object time stamp t a＇=t a.
In another kind of preferred embodiment of the present invention, described broadcasting object time stamp can comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; Be worth described time of delay can be the time of data transfer delay between described display terminal side and described mobile device side.
In embodiments of the present invention, video time stamp corresponding to current video data is t a, time of delay, value was Δ t, play object time stamp t a＇=t a+ Δ t.
Step 503, plays the described broadcasting object time and stabs corresponding voice data; Described voice data and described video data can be the multi-medium data that described display terminal receives.
Mobile device, can be according to video playback information in the time receiving video playback information (playing object time stamp), utilizes the mode such as loud speaker or access wired earphone of self to carry out the synchronous broadcasting of voice data.
In a preferred embodiment of the present invention, described voice data can carry one or more audio time stamp, and step 503 can comprise following sub-step:
Sub-step S11, when the audio time stamp of current broadcasting is greater than when stamp described broadcasting object time, suspends playing audio-fequency data until the audio time stamp of current broadcasting equals described the broadcastings object time stabs;
The audio time stamp of current broadcasting is greater than described broadcasting object time stamp, be that voice data is play the broadcasting that is ahead of voice data, for example playing object time stamp is 50000 milliseconds, and the audio time stamp of current broadcasting is 50040 milliseconds, can suspend playing audio-fequency data, the video data that for example repeat playing is current, until voice data and voice data synchronously just start normal broadcasting.
Certainly, the embodiment of the present invention also can be searched the audio time stamp that equals described broadcasting object time stamp without suspending playing audio-fequency data, play-overing, and plays voice data corresponding to described audio time stamp, and the embodiment of the present invention is not limited this.
And/or,
Sub-step S12, when the audio time stamp of current broadcasting is less than or equal to when stamp described broadcasting object time, searches the audio time stamp that equals described broadcasting object time stamp;
Sub-step S13, plays voice data corresponding to described audio time stamp.
The audio time stamp of current broadcasting is less than or equal to described broadcasting object time stamp, be that voice data is play the broadcasting that falls behind or be synchronized with voice data, for example playing object time stamp is 50000 milliseconds, and the video time stamp of current broadcasting is 49960 milliseconds, can search the audio time stamp of synchronous point, the voice data falling behind in the middle of not playing and play-over the video data of synchronous point.
It should be noted that, because embodiment of the method 3 is corresponding with embodiment of the method 1, so description is fairly simple, relevant part is referring to the part explanation of embodiment of the method 1, and the embodiment of the present invention is not described in detail at this.
With reference to Fig. 6, show the flow chart of steps of the synchronous embodiment of the method 4 of playing of a kind of video data of the present invention and voice data, the embodiment of the present invention can comprise the steps:
Step 601, receives at mobile device side joint the voice data that display terminal side sends; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Step 602, carries out buffered to described voice data;
In display terminal, can pass through buffer time, cushion after enough video datas, then carried out the broadcasting of video data; And in mobile device, can pass through identical buffer time, cushion after enough voice datas, then carried out the broadcasting of voice data.
Step 603, receives the broadcasting object time stamp that described display terminal side sends; Described reproduction time stamp can be that described display terminal is in the time playing described video data, according to the timestamp of the video time stamp generation of current broadcasting;
In a preferred embodiment of the present invention, described broadcasting object time stamp can comprise video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
In embodiments of the present invention, video time stamp corresponding to current video data is t a, play object time stamp t a＇=t a.
Step 604, obtains value time of delay;
In embodiments of the present invention, can be worth in advance or in the time of delay between pre-test display terminal and mobile device; Can be that display terminal is initiatively measured, also can obtain from mobile device, the embodiment of the present invention not be limited this.
In a kind of preferred exemplary of the embodiment of the present invention, described time of delay, value was for by being sent to preset analogue data described display terminal and recording the 3rd current system time value, receive the described analogue data that described display terminal returns and record current Quaternary system system time value, and calculate the half of described Quaternary system system time value and the difference of described the 3rd system time value, be worth the time of delay of acquisition;
Mobile device is sent to analogue data after display terminal, display terminal need to return to analogue data immediately to mobile device, mobile device calculates analogue data from sending to the half of time difference (i.e. the difference of the 3rd system time and Quaternary system system time) of reception, obtains and is worth time of delay.
When the 3rd system time is T 3, the Quaternary system system time is T 4time, time of delay Δ t=(T 4-T 3)/2.
Certainly, the embodiment of the present invention can also be calculated repeatedly analogue data from sending to the half of time difference of reception, obtains value time of delay, to reduce error.
In the another kind of preferred exemplary of the embodiment of the present invention, being worth described time of delay can be value time of delay that described display terminal sends.
In this example, value can be sent to described mobile device by preset analogue data and record current the first system time value for display terminal described time of delay, receive the described analogue data that described mobile device returns and record current second system time value, and, calculate the half of the difference of described second system time value and described the first system time value, value time of delay of acquisition.
Step 605 increases described time of delay of value in the time value of described broadcasting object time stamp instruction;
In embodiments of the present invention, play object time stamp t a＇=t a, time of delay, value was Δ t, the broadcasting object time stamp t after upgrading a＇ ＇=t a＇+Δ t=t a+ Δ t.
Step 606, plays the described broadcasting object time and stabs corresponding voice data; Described voice data and described video data can be the multi-medium data that described display terminal receives.
It should be noted that, because embodiment of the method 4 is corresponding with embodiment of the method 2, so description is fairly simple, relevant part is referring to the part explanation of embodiment of the method 2, and the embodiment of the present invention is not described in detail at this.
For embodiment of the method, for simple description, therefore it is all expressed as to a series of combination of actions, but those skilled in the art should know, the embodiment of the present invention is not subject to the restriction of described sequence of movement, because according to the embodiment of the present invention, some step can adopt other orders or carry out simultaneously.Secondly, those skilled in the art also should know, the embodiment described in specification all belongs to preferred embodiment, and related action might not be that the embodiment of the present invention is necessary.
With reference to Fig. 7, show the structured flowchart of the synchronous device embodiment 1 playing of a kind of video data of the present invention and voice data, the embodiment of the present invention can comprise as lower module:
Multi-medium data receiver module 701, at display terminal side receiving multimedia data; Described multi-medium data comprises video data and voice data; Described video data can carry one or more video time stamp;
Voice data sending module 702, for being sent to mobile device side by described voice data; Described display terminal side can be connected by the mode of wireless transmission with described mobile device side;
Play object time stamp generation module 703, in the time playing described video data, generate and play object time stamp according to the video time stamp of current broadcasting;
Play object time stamp sending module 704, for described broadcasting object time stamp is sent to described mobile device side; Described mobile device side can be stabbed corresponding voice data for playing the described broadcasting object time.
In a kind of preferred exemplary of the embodiment of the present invention, the mode of described wireless transmission can comprise following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
In a preferred embodiment of the present invention, described broadcasting object time stamp can comprise video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
In a preferred embodiment of the present invention, described broadcasting object time stamp can comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
In a preferred embodiment of the present invention, value can be for to be sent to described mobile device by preset analogue data and to record current the first system time value described time of delay, receive the described analogue data that described mobile device returns and record current second system time value, and, calculate the half of the difference of described second system time value and described the first system time value, value time of delay of acquisition;
Or;
Being worth described time of delay can be value time of delay that described mobile device sends.
In a preferred embodiment of the present invention, the embodiment of the present invention can also comprise as lower module:
The first buffer module, for carrying out buffered to described video data.
With reference to Fig. 8, show the structured flowchart of the synchronous device embodiment 2 playing of a kind of video data of the present invention and voice data, the embodiment of the present invention can comprise as lower module:
Voice data receiver module 801, for receiving at mobile device side joint the voice data that display terminal side sends; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Play object time stamp receiver module 802, the broadcasting object time stamp sending for receiving described display terminal side; Described reproduction time stabs as described display terminal is in the time playing described video data, the timestamp generating according to the video time stamp of current broadcasting;
Voice data broadcasting module 803, stabs corresponding voice data for playing the described broadcasting object time; Described voice data and described video data are the multi-medium data that described display terminal receives.
In a kind of preferred exemplary of the embodiment of the present invention, the mode of described wireless transmission can comprise following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
In a preferred embodiment of the present invention, described broadcasting object time stamp can comprise video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
In a preferred embodiment of the present invention, described broadcasting object time stamp can comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
In a preferred embodiment of the present invention, the embodiment of the present invention can also comprise as lower module:
Be worth acquisition module time of delay, for obtaining value time of delay;
Time of delay value increases module, for increasing described time of delay of value in the time value in the stamp instruction of described broadcasting object time.
In a preferred embodiment of the present invention, value can be for by being sent to preset analogue data described display terminal and recording the 3rd current system time value described time of delay, receive the described analogue data that described display terminal returns and record current Quaternary system system time value, and calculate the half of described Quaternary system system time value and the difference of described the 3rd system time value, be worth the time of delay of acquisition;
Or,
Being worth described time of delay can be value time of delay that described display terminal sends.
In a preferred embodiment of the present invention, described voice data can carry one or more audio time stamp; Described voice data broadcasting module 803 can comprise following submodule:
Suspend and play submodule, for be greater than when stamp described broadcastings object time in the audio time stamp of current broadcasting, suspend playing audio-fequency data until the audio time stamp of current broadcasting equals the described broadcasting object time stabs;
And/or,
Search submodule, for being less than or equal to when stamp described broadcasting object time in the audio time stamp of current broadcasting, searching the audio time stamp that equals described broadcasting object time stamp;
The corresponding submodule of playing, for playing voice data corresponding to described audio time stamp.
In a preferred embodiment of the present invention, the embodiment of the present invention can also comprise as lower module:
The second buffer module, for carrying out buffered to described voice data.
For device embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, the part of relevant part reference method embodiment illustrates.
The embodiment of the present invention also provides a kind of equipment, and this equipment can comprise:
One or more processors;
Memory; With
One or more modules, these one or more module stores are in memory and be configured to be carried out by one or more processors, and wherein, these one or more modules have following function:
At display terminal side receiving multimedia data; Described multi-medium data comprises video data and voice data; Described video data carries one or more video time stamp;
Described voice data is sent to mobile device side; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
In the time playing described video data, generate and play object time stamp according to the video time stamp of current broadcasting;
Described broadcasting object time stamp is sent to described mobile device side; Described mobile device side is used for playing the described broadcasting object time and stabs corresponding voice data.
Alternatively, the mode of described wireless transmission comprises following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
Alternatively, described broadcasting object time stamp comprises video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
Alternatively, described broadcasting object time stamp comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
Alternatively, described time of delay, value was for to be sent to described mobile device by preset analogue data and to record current the first system time value, receive the described analogue data that described mobile device returns and record current second system time value, and, calculate the half of the difference of described second system time value and described the first system time value, value time of delay of acquisition;
Or;
Described value time of delay that time of delay, value sent for described mobile device.
Alternatively, these one or more modules can also have following function:
Described video data is carried out to buffered.
The embodiment of the present invention also provides a kind of non-volatile readable storage medium, in this storage medium, store one or more modules (programs), when these one or more modules are used in the equipment with display, can make this equipment carry out the instruction (instructions) of following steps:
Described voice data is sent to mobile device side; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
In the time playing described video data, generate and play object time stamp according to the video time stamp of current broadcasting;
Described broadcasting object time stamp is sent to described mobile device side; Described mobile device side is used for playing the described broadcasting object time and stabs corresponding voice data.
Alternatively, the mode of described wireless transmission comprises following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
Alternatively, described broadcasting object time stamp comprises video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
Alternatively, described broadcasting object time stamp comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
Alternatively, described time of delay, value was for to be sent to described mobile device by preset analogue data and to record current the first system time value, receive the described analogue data that described mobile device returns and record current second system time value, and, calculate the half of the difference of described second system time value and described the first system time value, value time of delay of acquisition;
Or;
Described value time of delay that time of delay, value sent for described mobile device.
Alternatively, these one or more modules can also have following function:
Described video data is carried out to buffered.
Please refer to Fig. 9, it shows the structural representation of the intelligent television that one embodiment of the invention provides.This electronic equipment is for implementing the content displaying method that above-described embodiment provides, specifically:
Electronic equipment 800 can comprise RF(Radio Frequency, radio frequency) circuit 810, the memory 820 that includes one or more computer-readable recording mediums, input unit 830, display unit 840, transducer 850, voicefrequency circuit 860, short range wireless transmission module 870, include one or one parts such as processor 880 and power supply 890 of processing above core.It will be understood by those skilled in the art that the electronic devices structure shown in Fig. 9 does not form the restriction to electronic equipment, can comprise the parts more more or less than diagram, or combine some parts, or different parts are arranged.Wherein:
RF circuit 810 can be used for receiving and sending messages or communication process in, the reception of signal and transmission, especially, after the downlink information of base station is received, transfer to more than one or one processor 880 to process; In addition, send to base station by relating to up data.Conventionally, RF circuit 810 includes but not limited to antenna, at least one amplifier, tuner, one or more oscillator, transceiver, coupler, LNA(Low Noise Amplifier, low noise amplifier), duplexer etc.In addition, RF circuit 810 can also be by radio communication and network and other devices communicatings.Described radio communication can be used arbitrary communication standard or agreement, include but not limited to GSM (Global System of Mobile communication, global system for mobile communications), GPRS (General Packet Radio Service, general packet radio service), CDMA (Code Division Multiple Access, code division multiple access), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access (WCDMA)), LTE (Long Term Evolution, Long Term Evolution), Email, SMS (Short Messaging Service, Short Message Service) etc.Memory 820 can be used for storing software program and module, such as, memory 820 can arrange software program of reminding item etc. for the software program of storage of collected voice signal, the software program, the software program of realizing continuous speech recognition and the realization that realize keyword identification.Processor 880 is stored in software program and the module of memory 820 by operation, thereby carry out various function application and data processing, such as function of the function of the function of " at display terminal side receiving multimedia data " in the embodiment of the present invention, " described voice data is sent to mobile device side ", " in the time playing described video data, generate and play object time stamp according to the video time stamp of current broadcasting ", " described broadcasting object time stamp is sent to described mobile device side " etc.Memory 820 can mainly comprise storage program district and storage data field, wherein, and the application program (such as sound-playing function, image player function etc.) that storage program district can storage operation system, at least one function is required etc.; The data (such as voice data, phone directory etc.) that create according to the use of electronic equipment 800 etc. can be stored in storage data field.In addition, memory 820 can comprise high-speed random access memory, can also comprise nonvolatile memory, for example at least one disk memory, flush memory device or other volatile solid-state parts.Correspondingly, memory 820 can also comprise Memory Controller, so that processor 880 and the access of input unit 830 to memory 820 to be provided.
Input unit 830 can be used for receiving numeral or the character information of input, and generation is inputted with user arranges and function control is relevant keyboard, mouse, action bars, optics or trace ball signal.Particularly, input unit 830 can comprise touch-sensitive surperficial 831 and other input equipments 832.Touch-sensitive surperficial 831, also referred to as touch display screen or Trackpad, can collect user or near touch operation (using any applicable object or near the operations of annex on touch-sensitive surperficial 831 or touch-sensitive surperficial 831 such as finger, stylus such as user) thereon, and drive corresponding jockey according to predefined formula.Optionally, touch-sensitive surperficial 831 can comprise touch detecting apparatus and two parts of touch controller.Wherein, touch detecting apparatus detects user's touch orientation, and detects the signal that touch operation brings, and sends signal to touch controller; Touch controller receives touch information from touch detecting apparatus, and converts it to contact coordinate, then gives processor 880, and the order that energy receiving processor 880 is sent is also carried out.In addition, can adopt the polytypes such as resistance-type, condenser type, infrared ray and surface acoustic wave to realize touch-sensitive surperficial 831.Except touch-sensitive surperficial 831, input unit 830 can also comprise other input equipments 832.Particularly, other input equipments 832 can include but not limited to one or more in physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, action bars etc.
Display unit 840 can be used for showing the information inputted by user or the various graphical user interface of the information that offers user and electronic equipment 800, and these graphical user interface can be made up of figure, text, icon, video and its combination in any.Display unit 840 can comprise display floater 841, optionally, can adopt the form such as LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) to configure display floater 841.Further, touch-sensitive surperficial 831 can cover on display floater 841, when touch-sensitive surperficial 831 detect thereon or near touch operation after, send processor 880 to determine the type of touch event, corresponding vision output is provided according to the type of touch event with preprocessor 880 on display floater 841.Although in Fig. 9, touch-sensitive surperficial 831 with display floater 841 be as two independently parts realize input and input function, in certain embodiments, can by touch-sensitive surperficial 831 and display floater 841 integrated and realize input and output function.
Electronic equipment 800 also can comprise at least one transducer 850, such as optical sensor, motion sensor and other transducers.Particularly, optical sensor can comprise ambient light sensor and proximity transducer, and wherein, ambient light sensor can regulate according to the light and shade of ambient light the brightness of display floater 841, proximity transducer can, in the time that electronic equipment 800 moves in one's ear, cut out display floater 841 and/or backlight.As the one of motion sensor; Gravity accelerometer can detect the size of the acceleration that (is generally three axles) in all directions; when static, can detect size and the direction of gravity, can be used for identifying application (such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, knock) of mobile phone attitude etc.; As for also other transducers such as configurable gyroscope, barometer, hygrometer, thermometer, infrared ray sensor of electronic equipment 800, do not repeat them here.
Voicefrequency circuit 860, loud speaker 861, microphone 862 can provide the audio interface between user and electronic equipment 800.Voicefrequency circuit 860 can, by the signal of telecommunication after the voice data conversion receiving, be transferred to loud speaker 861, is converted to voice signal output by loud speaker 861; On the other hand, the voice signal of collection is converted to the signal of telecommunication by microphone 862, after being received by voicefrequency circuit 860, be converted to voice data, after again voice data output processor 880 being processed, through RF circuit 810 to send to another terminal, or export voice data to memory 820 so as further process.Voicefrequency circuit 860 also may comprise earphone jack, so that communicating by letter of peripheral hardware earphone and electronic equipment 800 to be provided.
Short range wireless transmission module 870 can be WIFI(wireless fidelity, Wireless Fidelity) module or bluetooth module etc.Electronic equipment 800 by short range wireless transmission module 870 can help that user sends and receive e-mail, browsing page and access streaming video etc., it provides wireless broadband internet access for user.Although Fig. 9 shows short range wireless transmission module 870, be understandable that, it does not belong to must forming of electronic equipment 800, completely can be as required in the essential scope that does not change invention and omit.
Processor 880 is control centres of electronic equipment 800, utilize the various piece of various interface and the whole electronic equipment of connection, by moving or carry out the software program and/or the module that are stored in memory 820, and call the data that are stored in memory 820, carry out various functions and the deal with data of electronic equipment 800, thereby electronic equipment is carried out to integral monitoring.Optionally, processor 880 can comprise one or more processing cores; Preferably, processor 880 can integrated application processor and modem processor, and wherein, application processor is mainly processed operating system, user interface and application program etc., and modem processor is mainly processed radio communication.Be understandable that, above-mentioned modem processor also can not be integrated in processor 880.
Electronic equipment 800 also comprises that the power supply 890(powering to all parts is such as battery), preferably, power supply can be connected with processor 880 logics by power-supply management system, thereby realizes the functions such as management charging, electric discharge and power managed by power-supply management system.Power supply 890 can also comprise the random component such as one or more direct current or AC power, recharging system, power failure detection circuit, power supply changeover device or inverter, power supply status indicator.
Although not shown, electronic equipment 800 can also comprise camera, bluetooth module etc., does not repeat them here.Specifically in the present embodiment, the display unit of electronic equipment 800 is touch-screen displays.
The embodiment of the present invention also provides a kind of equipment, and this equipment can comprise:
One or more processors;
Memory; With
One or more modules, these one or more module stores are in memory and be configured to be carried out by one or more processors, and wherein, these one or more modules have following function:
Receive at mobile device side joint the voice data that display terminal side sends; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Receive the broadcasting object time stamp that described display terminal side sends; Described reproduction time stabs as described display terminal is in the time playing described video data, the timestamp generating according to the video time stamp of current broadcasting;
Play the described broadcasting object time and stab corresponding voice data; Described voice data and described video data are the multi-medium data that described display terminal receives.
Alternatively, the mode of described wireless transmission comprises following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
Alternatively, described broadcasting object time stamp comprises video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
Alternatively, described broadcasting object time stamp comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
Alternatively, these one or more modules can also have following function:
Obtain value time of delay;
In the time value of described broadcasting object time stamp instruction, increase described time of delay of value.
Alternatively, described time of delay, value was for by being sent to preset analogue data described display terminal and recording the 3rd current system time value, receive the described analogue data that described display terminal returns and record current Quaternary system system time value, and calculate the half of described Quaternary system system time value and the difference of described the 3rd system time value, be worth the time of delay of acquisition;
Or,
Described value time of delay that time of delay, value sent for described display terminal.
Alternatively, described voice data carries one or more audio time stamp, and these one or more modules can have following function:
When the audio time stamp of current broadcasting is greater than when stamp described broadcasting object time, suspend playing audio-fequency data until the audio time stamp of current broadcasting equals described the broadcastings object time stabs;
And/or,
When the audio time stamp of current broadcasting is less than or equal to when stamp described broadcasting object time, search the audio time stamp that equals described broadcasting object time stamp;
Play voice data corresponding to described audio time stamp.
Alternatively, these one or more modules can also have following function:
Described voice data is carried out to buffered.
The embodiment of the present invention also provides a kind of non-volatile readable storage medium, in this storage medium, store one or more modules (programs), when these one or more modules are used in the equipment with audio playing function, can make this equipment carry out the instruction (instructions) of following steps:
Receive at mobile device side joint the voice data that display terminal side sends; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Receive the broadcasting object time stamp that described display terminal side sends; Described reproduction time stabs as described display terminal is in the time playing described video data, the timestamp generating according to the video time stamp of current broadcasting;
Play the described broadcasting object time and stab corresponding voice data; Described voice data and described video data are the multi-medium data that described display terminal receives.
Alternatively, the mode of described wireless transmission comprises following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
Alternatively, described broadcasting object time stamp comprises video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
Alternatively, described broadcasting object time stamp comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
Alternatively, these one or more modules can also have following function:
Obtain value time of delay;
In the time value of described broadcasting object time stamp instruction, increase described time of delay of value.
Alternatively, described time of delay, value was for by being sent to preset analogue data described display terminal and recording the 3rd current system time value, receive the described analogue data that described display terminal returns and record current Quaternary system system time value, and calculate the half of described Quaternary system system time value and the difference of described the 3rd system time value, be worth the time of delay of acquisition;
Or,
Described value time of delay that time of delay, value sent for described display terminal.
Alternatively, described voice data carries one or more audio time stamp, and these one or more modules can have following function:
When the audio time stamp of current broadcasting is greater than when stamp described broadcasting object time, suspend playing audio-fequency data until the audio time stamp of current broadcasting equals described the broadcastings object time stabs;
And/or,
When the audio time stamp of current broadcasting is less than or equal to when stamp described broadcasting object time, search the audio time stamp that equals described broadcasting object time stamp;
Play voice data corresponding to described audio time stamp.
Alternatively, these one or more modules can also have following function:
Described voice data is carried out to buffered.
Figure 10 is a kind of terminal equipment structural representation that the embodiment of the present invention provides.Referring to Figure 10, this terminal equipment can be for video data and the synchronous method of playing of voice data of implementing to provide in above-described embodiment.Wherein, this terminal equipment can be mobile phone, panel computer pad, Wearable mobile device (as intelligent watch) etc.
Terminal equipment 700 can comprise communication unit 110, includes the memory 120 of one or more computer-readable recording mediums, input unit 130, display unit 140, transducer 150, voicefrequency circuit 160, WiFi (wireless fidelity, Wireless Fidelity) module 170, include one or one parts such as processor 180 and power supply 190 of processing above core.It will be understood by those skilled in the art that the terminal equipment structure shown in Figure 10 does not form the restriction to terminal equipment, can comprise the parts more more or less than diagram, or combine some parts, or different parts are arranged.Wherein:
Communication unit 110 can be used for receiving and sending messages or communication process in, the reception of signal and transmission, this communication unit 110 can be RF(Radio Frequency, radio frequency) circuit, router, modulator-demodulator, etc. network communication equipment.Especially, in the time that communication unit 110 is RF circuit, after the downlink information of base station is received, transfer to more than one or one processor 180 to process; In addition, send to base station by relating to up data.Conventionally, include but not limited to antenna, at least one amplifier, tuner, one or more oscillator, subscriber identity module (SIM) card, transceiver, coupler, LNA(Low Noise Amplifier, low noise amplifier as the RF circuit of communication unit), duplexer etc.In addition, communication unit 110 can also be by radio communication and network and other devices communicatings.Described radio communication can be used arbitrary communication standard or agreement, include but not limited to GSM (Global System of Mobile communication, global system for mobile communications), GPRS (General Packet Radio Service, general packet radio service), CDMA (Code Division Multiple Access, code division multiple access), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access (WCDMA)), LTE (Long Term Evolution, Long Term Evolution), Email, SMS (Short Messaging Service, Short Message Service) etc.Memory 120 can be used for storing software program and module, and processor 180 is stored in software program and the module of memory 120 by operation, thereby carries out various function application and data processing.Memory 120 can mainly comprise storage program district and storage data field, wherein, and the application program (such as sound-playing function, image player function etc.) that storage program district can storage operation system, at least one function is required etc.; The data (such as voice data, phone directory etc.) that create according to the use of terminal equipment 700 etc. can be stored in storage data field.In addition, memory 120 can comprise high-speed random access memory, can also comprise nonvolatile memory, for example at least one disk memory, flush memory device or other volatile solid-state parts.Correspondingly, memory 120 can also comprise Memory Controller, so that processor 180 and the access of input unit 130 to memory 120 to be provided.
Input unit 130 can be used for receiving numeral or the character information of input, and generation is inputted with user arranges and function control is relevant keyboard, mouse, action bars, optics or trace ball signal.Alternatively, input unit 130 can comprise touch-sensitive surperficial 131 and other input equipments 132.Touch-sensitive surperficial 131, also referred to as touch display screen or Trackpad, can collect user or near touch operation (using any applicable object or near the operations of annex on touch-sensitive surperficial 131 or touch-sensitive surperficial 131 such as finger, stylus such as user) thereon, and drive corresponding jockey according to predefined formula.Optionally, touch-sensitive surperficial 131 can comprise touch detecting apparatus and two parts of touch controller.Wherein, touch detecting apparatus detects user's touch orientation, and detects the signal that touch operation brings, and sends signal to touch controller; Touch controller receives touch information from touch detecting apparatus, and converts it to contact coordinate, then gives processor 180, and the order that energy receiving processor 180 is sent is also carried out.In addition, can adopt the polytypes such as resistance-type, condenser type, infrared ray and surface acoustic wave to realize touch-sensitive surperficial 131.Except touch-sensitive surperficial 131, input unit 130 can also comprise other input equipments 132.Alternatively, other input equipments 132 can include but not limited to one or more in physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, action bars etc.
Display unit 140 can be used for showing the information inputted by user or the various graphical user interface of the information that offers user and terminal equipment 700, and these graphical user interface can be made up of figure, text, icon, video and its combination in any.Display unit 140 can comprise display floater 141, optionally, can adopt the form such as LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) to configure display floater 141.Further, touch-sensitive surperficial 131 can cover display floater 141, when touch-sensitive surperficial 131 detect thereon or near touch operation after, send processor 180 to determine the type of touch event, corresponding vision output is provided according to the type of touch event with preprocessor 180 on display floater 141.Although in Figure 10, touch-sensitive surperficial 131 with display floater 141 be as two independently parts realize input and input function, in certain embodiments, can by touch-sensitive surperficial 131 and display floater 141 integrated and realize input and output function.
Terminal equipment 700 also can comprise at least one transducer 150, such as optical sensor, motion sensor and other transducers.Alternatively, optical sensor can comprise ambient light sensor and proximity transducer, and wherein, ambient light sensor can regulate according to the light and shade of ambient light the brightness of display floater 141, proximity transducer can, in the time that terminal equipment 700 moves in one's ear, cut out display floater 141 and/or backlight.As the one of motion sensor; Gravity accelerometer can detect the size of the acceleration that (is generally three axles) in all directions; when static, can detect size and the direction of gravity, can be used for identifying application (such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, knock) of mobile phone attitude etc.; As for also other transducers such as configurable gyroscope, barometer, hygrometer, thermometer, infrared ray sensor of terminal equipment 700, do not repeat them here.
Voicefrequency circuit 160, loud speaker 161, microphone 162 can provide the audio interface between user and terminal equipment 700.Voicefrequency circuit 160 can, by the signal of telecommunication after the voice data conversion receiving, be transferred to loud speaker 161, is converted to voice signal output by loud speaker 161; On the other hand, the voice signal of collection is converted to the signal of telecommunication by microphone 162, after being received by voicefrequency circuit 160, be converted to voice data, after again voice data output processor 180 being processed, through RF circuit 110 to send to such as another terminal equipment, or export voice data to memory 120 so as further process.Voicefrequency circuit 160 also may comprise earphone jack, so that communicating by letter of peripheral hardware earphone and terminal equipment 700 to be provided.
In order to realize radio communication, on this terminal equipment, can dispose wireless communication unit 170, this wireless communication unit 170 can be WiFi module.WiFi belongs to short range wireless transmission technology, terminal equipment 700 by wireless communication unit 170 can help that user sends and receive e-mail, browsing page and access streaming video etc., it provides wireless broadband internet access for user.Although Figure 10 shows wireless communication unit 170, be understandable that, it does not belong to must forming of terminal equipment 700, completely can be as required in the essential scope that does not change invention and omit.
Processor 180 is control centres of terminal equipment 700, utilize the various piece of various interface and the whole mobile phone of connection, by moving or carry out the software program and/or the module that are stored in memory 120, and call the data that are stored in memory 120, carry out various functions and the deal with data of terminal equipment 700, thereby mobile phone is carried out to integral monitoring.Optionally, processor 180 can comprise one or more processing cores; Preferably, processor 180 can integrated application processor and modem processor, and wherein, application processor is mainly processed operating system, user interface and application program etc., and modem processor is mainly processed radio communication.Be understandable that, above-mentioned modem processor also can not be integrated in processor 180.
Terminal equipment 700 also comprises that the power supply 190(powering to all parts is such as battery), preferably, power supply can be connected with processor 180 logics by power-supply management system, thereby realizes the functions such as management charging, electric discharge and power managed by power-supply management system.Power supply 190 can also comprise the random component such as one or more direct current or AC power, recharging system, power failure detection circuit, power supply changeover device or inverter, power supply status indicator.
Although not shown, terminal equipment 700 can also comprise camera, bluetooth module etc., does not repeat them here.Specifically in the present embodiment, the display unit of terminal equipment is touch-screen display, terminal equipment also includes memory, and one or more than one program, one of them or more than one program are stored in memory, and are configured to carry out described more than one or one program package containing for carrying out the instruction of following operation by more than one or one processor:
Receive at mobile device side joint the voice data that display terminal side sends; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Receive the broadcasting object time stamp that described display terminal side sends; Described reproduction time stabs as described display terminal is in the time playing described video data, the timestamp generating according to the video time stamp of current broadcasting;
Play the described broadcasting object time and stab corresponding voice data; Described voice data and described video data are the multi-medium data that described display terminal receives.
Alternatively, the mode of described wireless transmission comprises following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
Alternatively, described broadcasting object time stamp comprises video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
Alternatively, described broadcasting object time stamp comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
Alternatively, these one or more modules can also have following function:
Obtain value time of delay;
In the time value of described broadcasting object time stamp instruction, increase described time of delay of value.
Alternatively, described time of delay, value was for by being sent to preset analogue data described display terminal and recording the 3rd current system time value, receive the described analogue data that described display terminal returns and record current Quaternary system system time value, and calculate the half of described Quaternary system system time value and the difference of described the 3rd system time value, be worth the time of delay of acquisition;
Or,
Described value time of delay that time of delay, value sent for described display terminal.
Alternatively, described voice data carries one or more audio time stamp, and these one or more modules can have following function:
When the audio time stamp of current broadcasting is greater than when stamp described broadcasting object time, suspend playing audio-fequency data until the audio time stamp of current broadcasting equals described the broadcastings object time stabs;
And/or,
When the audio time stamp of current broadcasting is less than or equal to when stamp described broadcasting object time, search the audio time stamp that equals described broadcasting object time stamp;
Play voice data corresponding to described audio time stamp.
Alternatively, these one or more modules can also have following function:
Described voice data is carried out to buffered.
Each embodiment in this specification all adopts the mode of going forward one by one to describe, and what each embodiment stressed is and the difference of other embodiment, between each embodiment identical similar part mutually with reference to.
Those skilled in the art should understand, the embodiment of the embodiment of the present invention can be provided as method, device or computer program.Therefore, the embodiment of the present invention can adopt complete hardware implementation example, completely implement software example or the form in conjunction with the embodiment of software and hardware aspect.And the embodiment of the present invention can adopt the form at one or more upper computer programs of implementing of computer-usable storage medium (including but not limited to magnetic disc store, CD-ROM, optical memory etc.) that wherein include computer usable program code.
The embodiment of the present invention is with reference to describing according to flow chart and/or the block diagram of the method for the embodiment of the present invention, mobile device (system) and computer program.Should understand can be by the flow process in each flow process in computer program instructions realization flow figure and/or block diagram and/or square frame and flow chart and/or block diagram and/or the combination of square frame.Can provide processor that these computer program instructions process mobile device to all-purpose computer, special-purpose computer, Embedded Processor or other programmable datas to produce a machine, make to process by computer or other programmable datas instruction that the processor of mobile device carries out and produce the device for realizing the function of specifying at flow process of flow chart or multiple flow process and/or square frame of block diagram or multiple square frame.
These computer program instructions also can be stored in energy vectoring computer or other programmable datas are processed in the computer-readable memory of mobile device with ad hoc fashion work, the instruction that makes to be stored in this computer-readable memory produces the manufacture that comprises command device, and this command device is realized the function of specifying in flow process of flow chart or multiple flow process and/or square frame of block diagram or multiple square frame.
These computer program instructions also can be loaded into computer or other programmable datas are processed on mobile device, make to carry out sequence of operations step to produce computer implemented processing on computer or other programmable movement equipment, thereby the instruction of carrying out is provided for realizing the step of the function of specifying in flow process of flow chart or multiple flow process and/or square frame of block diagram or multiple square frame on computer or other programmable movement equipment.
Although described the preferred embodiment of the embodiment of the present invention, once those skilled in the art obtain the basic creative concept of cicada, can make other change and amendment to these embodiment.So claims are intended to be interpreted as comprising preferred embodiment and fall into all changes and the amendment of embodiment of the present invention scope.
Finally, also it should be noted that, in this article, relational terms such as the first and second grades is only used for an entity or operation to separate with another entity or operating space, and not necessarily requires or imply and between these entities or operation, have the relation of any this reality or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thereby the process, method, article or the mobile device that make to comprise a series of key elements not only comprise those key elements, but also comprise other key elements of clearly not listing, or be also included as the intrinsic key element of this process, method, article or mobile device.The in the situation that of more restrictions not, the key element being limited by statement " comprising ... ", and be not precluded within process, method, article or the mobile device that comprises described key element and also have other identical element.
Synchronous device and a kind of equipment of playing of synchronous method, a kind of video data and the voice data of playing of a kind of the video data above embodiment of the present invention being provided and voice data is described in detail, applied principle and the execution mode of specific case to the embodiment of the present invention herein and set forth, the explanation of above embodiment is just for helping to understand method and the core concept thereof of the embodiment of the present invention; , for one of ordinary skill in the art, according to the thought of the embodiment of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as the restriction to the embodiment of the present invention meanwhile.

Claims (30)

1. the synchronous method of playing of video data and voice data, is characterized in that, comprising:
At display terminal side receiving multimedia data; Described multi-medium data comprises video data and voice data; Described video data carries one or more video time stamp;
Described voice data is sent to mobile device side; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
In the time playing described video data, generate and play object time stamp according to the video time stamp of current broadcasting;
Described broadcasting object time stamp is sent to described mobile device side; Described mobile device side is used for playing the described broadcasting object time and stabs corresponding voice data.
2. method according to claim 1, is characterized in that, the mode of described wireless transmission comprises following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
3. method according to claim 1, is characterized in that, described broadcasting object time stamp comprises video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
4. method according to claim 1, is characterized in that, described broadcasting object time stamp comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
5. method according to claim 4, it is characterized in that, described time of delay, value was for to be sent to described mobile device by preset analogue data and to record current the first system time value, receive the described analogue data that described mobile device returns and record current second system time value, and, calculate the half of the difference of described second system time value and described the first system time value, value time of delay of acquisition;
Or;
Described value time of delay that time of delay, value sent for described mobile device.
6. according to the method described in claim 1 to 5 any one, it is characterized in that, described, in the time playing described video data, before generating according to the video time stamp of current broadcasting the step of playing object time stamp, described method also comprises:
Described video data is carried out to buffered.
7. the synchronous method of playing of video data and voice data, is characterized in that, comprising:
Receive at mobile device side joint the voice data that display terminal side sends; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Receive the broadcasting object time stamp that described display terminal side sends; Described reproduction time stabs as described display terminal is in the time playing described video data, the timestamp generating according to the video time stamp of current broadcasting;
Play the described broadcasting object time and stab corresponding voice data; Described voice data and described video data are the multi-medium data that described display terminal receives.
8. method according to claim 7, is characterized in that, the mode of described wireless transmission comprises following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
9. method according to claim 7, is characterized in that, described broadcasting object time stamp comprises video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
10. method according to claim 7, is characterized in that, described broadcasting object time stamp comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
11. methods according to claim 9, is characterized in that, after the step of the broadcasting object time stamp sending in the described display terminal side of described reception, described method also comprises:
Obtain value time of delay;
In the time value of described broadcasting object time stamp instruction, increase described time of delay of value.
12. methods according to claim 11, it is characterized in that, described time of delay, value was for by being sent to preset analogue data described display terminal and recording the 3rd current system time value, receive the described analogue data that described display terminal returns and record current Quaternary system system time value, and calculate the half of described Quaternary system system time value and the difference of described the 3rd system time value, be worth the time of delay of acquisition;
Or,
Described value time of delay that time of delay, value sent for described display terminal.
13. according to the method described in claim 7 to 12 any one, it is characterized in that, described voice data carries one or more audio time stamp;
The step that the described broadcasting object time of described broadcasting is stabbed corresponding voice data comprises:
When the audio time stamp of current broadcasting is greater than when stamp described broadcasting object time, suspend playing audio-fequency data until the audio time stamp of current broadcasting equals described the broadcastings object time stabs;
And/or,
When the audio time stamp of current broadcasting is less than or equal to when stamp described broadcasting object time, search the audio time stamp that equals described broadcasting object time stamp;
Play voice data corresponding to described audio time stamp.
14. according to the method described in claim 7 to 12 any one, it is characterized in that, before stabbing the step of corresponding voice data in the described broadcasting described broadcasting object time, described method also comprises:
Described voice data is carried out to buffered.
The synchronous device of playing of 15. 1 kinds of video datas and voice data, is characterized in that, comprising:
Multi-medium data receiver module, at display terminal side receiving multimedia data; Described multi-medium data comprises video data and voice data; Described video data carries one or more video time stamp;
Voice data sending module, for being sent to mobile device side by described voice data; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Play object time stamp generation module, in the time playing described video data, generate and play object time stamp according to the video time stamp of current broadcasting;
Play object time stamp sending module, for described broadcasting object time stamp is sent to described mobile device side; Described mobile device side is used for playing the described broadcasting object time and stabs corresponding voice data.
16. devices according to claim 15, is characterized in that, the mode of described wireless transmission comprises following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
17. devices according to claim 15, is characterized in that, described broadcasting object time stamp comprises video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
18. devices according to claim 15, is characterized in that, described broadcasting object time stamp comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
19. devices according to claim 18, it is characterized in that, described time of delay, value was for to be sent to described mobile device by preset analogue data and to record current the first system time value, receive the described analogue data that described mobile device returns and record current second system time value, and, calculate the half of the difference of described second system time value and described the first system time value, value time of delay of acquisition;
Or;
Described value time of delay that time of delay, value sent for described mobile device.
20. according to claim 15 to the device described in 19 any one, it is characterized in that, also comprises:
The first buffer module, for carrying out buffered to described video data.
The synchronous device of playing of 21. 1 kinds of video datas and voice data, is characterized in that, comprising:
Voice data receiver module, for receiving at mobile device side joint the voice data that display terminal side sends; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Play object time stamp receiver module, the broadcasting object time stamp sending for receiving described display terminal side; Described reproduction time stabs as described display terminal is in the time playing described video data, the timestamp generating according to the video time stamp of current broadcasting;
Voice data broadcasting module, stabs corresponding voice data for playing the described broadcasting object time; Described voice data and described video data are the multi-medium data that described display terminal receives.
22. devices according to claim 21, is characterized in that, the mode of described wireless transmission comprises following one or more:
Ethernet, bluetooth, 2.4G wireless network, infrared ray and wireless network protocol ZigBee.
23. devices according to claim 21, is characterized in that, described broadcasting object time stamp comprises video time stamp corresponding to current video data that described display terminal side is extracted in the time playing described video data.
24. devices according to claim 21, is characterized in that, described broadcasting object time stamp comprise video time stamp that current video data that described display terminal side extracts in the time playing described video data is corresponding and time of delay value; The described time that time of delay, value was data transfer delay between described display terminal side and described mobile device side.
25. devices according to claim 23, is characterized in that, also comprise:
Be worth acquisition module time of delay, for obtaining value time of delay;
Time of delay value increases module, for increasing described time of delay of value in the time value in the stamp instruction of described broadcasting object time.
26. devices according to claim 25, it is characterized in that, described time of delay, value was for by being sent to preset analogue data described display terminal and recording the 3rd current system time value, receive the described analogue data that described display terminal returns and record current Quaternary system system time value, and calculate the half of described Quaternary system system time value and the difference of described the 3rd system time value, be worth the time of delay of acquisition;
Or,
Described value time of delay that time of delay, value sent for described display terminal.
27. according to the device described in claim 21 to 26 any one, it is characterized in that, described voice data carries one or more audio time stamp; Described voice data broadcasting module comprises:
Suspend and play submodule, for be greater than when stamp described broadcastings object time in the audio time stamp of current broadcasting, suspend playing audio-fequency data until the audio time stamp of current broadcasting equals the described broadcasting object time stabs;
And/or,
Search submodule, for being less than or equal to when stamp described broadcasting object time in the audio time stamp of current broadcasting, searching the audio time stamp that equals described broadcasting object time stamp;
The corresponding submodule of playing, for playing voice data corresponding to described audio time stamp.
28. according to the device described in claim 21 to 26 any one, it is characterized in that, also comprises:
The second buffer module, for carrying out buffered to described voice data.
29. 1 kinds of equipment, is characterized in that, comprising:
One or more processors;
Memory; With
One or more modules, described one or more module stores are in described memory and be configured to be carried out by described one or more processors, and wherein, described one or more modules have following function:
At display terminal side receiving multimedia data; Described multi-medium data comprises video data and voice data; Described video data carries one or more video time stamp;
Described voice data is sent to mobile device side; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
In the time playing described video data, generate and play object time stamp according to the video time stamp of current broadcasting;
Described broadcasting object time stamp is sent to described mobile device side; Described mobile device side is used for playing the described broadcasting object time and stabs corresponding voice data.
30. 1 kinds of equipment, is characterized in that, comprising:
One or more processors;
Memory; With
One or more modules, described one or more module stores are in described memory and be configured to be carried out by described one or more processors, and wherein, described one or more modules have following function:
Receive at mobile device side joint the voice data that display terminal side sends; Described display terminal side is connected by the mode of wireless transmission with described mobile device side;
Receive the broadcasting object time stamp that described display terminal side sends; Described reproduction time stabs as described display terminal is in the time playing described video data, the timestamp generating according to the video time stamp of current broadcasting;
Play the described broadcasting object time and stab corresponding voice data; Described voice data and described video data are the multi-medium data that described display terminal receives.
CN201410093301.3A 2014-03-13 2014-03-13 Video data and audio data synchronized playing method and device and equipment Pending CN103905878A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410093301.3A CN103905878A (en) 2014-03-13 2014-03-13 Video data and audio data synchronized playing method and device and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410093301.3A CN103905878A (en) 2014-03-13 2014-03-13 Video data and audio data synchronized playing method and device and equipment

Publications (1)

Publication Number Publication Date
CN103905878A true CN103905878A (en) 2014-07-02

Family

ID=50996994

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410093301.3A Pending CN103905878A (en) 2014-03-13 2014-03-13 Video data and audio data synchronized playing method and device and equipment

Country Status (1)

Country Link
CN (1) CN103905878A (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104837046A (en) * 2015-01-08 2015-08-12 腾讯科技（北京）有限公司 Multi-media file processing method and device
WO2016008131A1 (en) * 2014-07-17 2016-01-21 21 Vianet Group, Inc. Techniques for separately playing audio and video data in local networks
TWI556157B (en) * 2015-11-17 2016-11-01 九齊科技股份有限公司 Method and system for playing audio data
CN106488281A (en) * 2016-10-26 2017-03-08 Tcl集团股份有限公司 A kind of player method of television audio and control system, TV, communication system
CN107040848A (en) * 2017-03-07 2017-08-11 建荣半导体（深圳）有限公司 Synchronization parameter transmission method, device and the equipment of AVDTP agreements
CN107135413A (en) * 2017-03-20 2017-09-05 福建天泉教育科技有限公司 A kind of audio and video synchronization method and system
CN107181506A (en) * 2017-04-13 2017-09-19 深圳市金立通信设备有限公司 The method and bluetooth earphone of a kind of control terminal playing resource
CN107734378A (en) * 2017-10-31 2018-02-23 维沃移动通信有限公司 A kind of audio and video synchronization method, device and mobile terminal
CN109168059A (en) * 2018-10-17 2019-01-08 上海赛连信息科技有限公司 A kind of labial synchronization method playing audio & video respectively on different devices
CN109314631A (en) * 2016-06-24 2019-02-05 雅马哈株式会社 Synchronization settings device, conveyer system, synchronization settings method and program
CN111885555A (en) * 2020-06-08 2020-11-03 安凯(广州)微电子技术有限公司 TWS earphone based on monitoring scheme and implementation method thereof
CN112105005A (en) * 2019-08-30 2020-12-18 炬力(珠海)微电子有限公司 Method and device for controlling Bluetooth equipment to play
CN112423028A (en) * 2020-10-26 2021-02-26 深圳Tcl新技术有限公司 Multimedia file transmission method, device, multimedia terminal and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1784674A (en) * 2004-05-03 2006-06-07 微软公司 Fast startup for streaming media
EP1860866A1 (en) * 2006-05-26 2007-11-28 British Telecommunications Public Limited Company Audio-visual reception
CN103297824A (en) * 2013-05-29 2013-09-11 华为技术有限公司 Video processing method, dongle, control terminal and system
EP2672721A1 (en) * 2012-06-08 2013-12-11 LG Electronics Inc. Image display apparatus, mobile terminal and method for operating the same

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1784674A (en) * 2004-05-03 2006-06-07 微软公司 Fast startup for streaming media
EP1860866A1 (en) * 2006-05-26 2007-11-28 British Telecommunications Public Limited Company Audio-visual reception
EP2672721A1 (en) * 2012-06-08 2013-12-11 LG Electronics Inc. Image display apparatus, mobile terminal and method for operating the same
CN103297824A (en) * 2013-05-29 2013-09-11 华为技术有限公司 Video processing method, dongle, control terminal and system

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016008131A1 (en) * 2014-07-17 2016-01-21 21 Vianet Group, Inc. Techniques for separately playing audio and video data in local networks
CN104837046A (en) * 2015-01-08 2015-08-12 腾讯科技（北京）有限公司 Multi-media file processing method and device
TWI556157B (en) * 2015-11-17 2016-11-01 九齊科技股份有限公司 Method and system for playing audio data
CN109314631A (en) * 2016-06-24 2019-02-05 雅马哈株式会社 Synchronization settings device, conveyer system, synchronization settings method and program
CN106488281A (en) * 2016-10-26 2017-03-08 Tcl集团股份有限公司 A kind of player method of television audio and control system, TV, communication system
CN107040848A (en) * 2017-03-07 2017-08-11 建荣半导体（深圳）有限公司 Synchronization parameter transmission method, device and the equipment of AVDTP agreements
CN107135413A (en) * 2017-03-20 2017-09-05 福建天泉教育科技有限公司 A kind of audio and video synchronization method and system
CN107181506A (en) * 2017-04-13 2017-09-19 深圳市金立通信设备有限公司 The method and bluetooth earphone of a kind of control terminal playing resource
CN107734378B (en) * 2017-10-31 2019-11-01 维沃移动通信有限公司 A kind of audio and video synchronization method, device and mobile terminal
CN107734378A (en) * 2017-10-31 2018-02-23 维沃移动通信有限公司 A kind of audio and video synchronization method, device and mobile terminal
CN109168059A (en) * 2018-10-17 2019-01-08 上海赛连信息科技有限公司 A kind of labial synchronization method playing audio & video respectively on different devices
CN113286184A (en) * 2018-10-17 2021-08-20 上海赛连信息科技有限公司 Lip sound synchronization method for respectively playing audio and video on different devices
CN113286184B (en) * 2018-10-17 2024-01-30 上海赛连信息科技有限公司 Lip synchronization method for respectively playing audio and video on different devices
CN112105005A (en) * 2019-08-30 2020-12-18 炬力(珠海)微电子有限公司 Method and device for controlling Bluetooth equipment to play
CN112105005B (en) * 2019-08-30 2024-05-03 炬力(珠海)微电子有限公司 Method and device for controlling Bluetooth equipment to play
CN111885555A (en) * 2020-06-08 2020-11-03 安凯(广州)微电子技术有限公司 TWS earphone based on monitoring scheme and implementation method thereof
CN111885555B (en) * 2020-06-08 2022-05-20 广州安凯微电子股份有限公司 TWS earphone based on monitoring scheme and implementation method thereof
CN112423028A (en) * 2020-10-26 2021-02-26 深圳Tcl新技术有限公司 Multimedia file transmission method, device, multimedia terminal and storage medium

Similar Documents

Publication Publication Date Title
CN103905876A (en) Video data and audio data synchronized playing method and device and equipment
CN103905879B (en) The method, apparatus and equipment that a kind of video data and audio data are played simultaneously
CN103905878A (en) Video data and audio data synchronized playing method and device and equipment
CN103905881B (en) The method, apparatus and equipment that a kind of video data and audio data are played simultaneously
CN104135667B (en) Video remote explanation synchronization method, terminal equipment and system
JP5703416B2 (en) Systems and methods for implementing multicast using personal area network (PAN) wireless technology
CN106254903B (en) A kind of synchronous broadcast method of multi-medium data, apparatus and system
CN103905880A (en) Playing method of audio data and video data, smart television set and mobile equipment
CN103905877A (en) Playing method of audio data and video data, smart television set and mobile equipment
JP2021529486A (en) PUCCH collision handling method and terminal
CN104967608B (en) Play method, mobile terminal and the fixed terminal of multimedia file
CN106162236A (en) A kind of method and device of sharing video frequency
CN103559731B (en) Method and terminal for displaying lyrics under screen locking state
CN110034876A (en) PUCCH resource instruction, processing method, network side equipment, user terminal
CN103391473A (en) Methods and devices for providing and acquiring audios and videos
CN106341713B (en) A kind of multimedia synchronous plays method, apparatus, system and terminal
CN106254924B (en) A kind of player method of multi-medium data, system and relevant device
CN106448714A (en) Synchronous playing method of playing devices, apparatus and system thereof
CN110299936A (en) A kind of switching method and terminal device of transmitting antenna
CN104093053A (en) Video file playing method, devices and system
CN108810860A (en) A kind of audio frequency transmission method, terminal device and main earphone
CN106412629B (en) Processing method, device, system and the computer-readable media medium of media data transmission
CN106412625B (en) Multimedia synchronous plays method, apparatus, terminal and system
CN106205657B (en) A kind of lyric display method and device
CN103458064A (en) Method, device and terminal equipment for transmitting address information of multimedia information

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20140702

RJ01 Rejection of invention patent application after publication