CN103905879B

CN103905879B - The method, apparatus and equipment that a kind of video data and audio data are played simultaneously

Info

Publication number: CN103905879B
Application number: CN201410093950.3A
Authority: CN
Inventors: 李典
Original assignee: Beijing QIYI Century Science and Technology Co Ltd
Current assignee: Beijing QIYI Century Science and Technology Co Ltd
Priority date: 2014-03-13
Filing date: 2014-03-13
Publication date: 2018-07-06
Anticipated expiration: 2034-03-13
Also published as: CN103905879A

Abstract

An embodiment of the present invention provides the method and device that a kind of video data and audio data are played simultaneously, including：Multi-medium data playing request is received in display terminal side joint；Playing request is identified including multi-medium data；It is identified according to multi-medium data from the corresponding video data of vod server acquisition communicated with display terminal side；Multi-medium data mark is sent to mobile equipment side；The mobile equipment side is used to identify from the corresponding video data of vod server acquisition communicated with the display terminal side according to the multi-medium data, and the display terminal side is connect with the mobile equipment side by way of wireless transmission；When playing the video data, object time stamp is played according to currently playing video time stamp generation；The broadcasting object time stamp is sent to mobile equipment side；The mobile equipment side is used to play the corresponding audio data of the broadcasting object time stamp.The present invention is realizing being played simultaneously for audio data and video data.

Description

The method, apparatus and equipment that a kind of video data and audio data are played simultaneously

Technical field

The present embodiments relate to the technical field of multimedia-data procession, more particularly to a kind of video data and audio The device and a kind of equipment that method that data are played simultaneously, a kind of video data and audio data are played simultaneously.

Background technology

With popularizing for the player that can support various media, more and more media file synchronization is played to obtain It obtains and preferably appreciates effect and artistic effect, wherein it is that most widely used media are held to play video, appreciation music, browsing pictures Line mode.

By taking intelligent television equipment as an example, smart television includes smart television, Intelligent set top box, can carry out multi-medium data Broadcasting.Such as when night household rests, other people are disturbed, while ensure the sight to multi-medium data to avoid Reward, sound when user may want to listen to intelligent television equipment broadcasting video by wearing earphone, is set with substituting smart television Standby device plays sound of raising one's voice.

Wearing earphone, usually there are two types of solutions：A kind of method is to connect intelligent television equipment with wired earphone；It is another Kind method is the equipment for bluetooth headset is supported, smart television is linked with bluetooth headset.

Wired earphone is inserted into intelligent television equipment by first method, and since intelligent television equipment usually distance is used Family viewing location is distant, it is therefore desirable to which the line of wired earphone is very long, and plug is also inconvenient.User carries out other action, such as Pour etc., it needs to drag long line, causes to operate inconvenient.

Second method needs in addition purchase bluetooth headset, of high cost；It is gestured moreover, bluetooth headset usually will appear sound The problem of face postpones, user experience is very poor.

Invention content

The technical problem to be solved is that provide a kind of video data and audio data is played simultaneously to the embodiment of the present invention Method is inconvenient for operation and of high cost to solve the problems, such as.

Correspondingly, the embodiment of the present invention additionally provides device and one kind that a kind of video data and audio data are played simultaneously Equipment, to ensure the realization of the above method and application.

To solve the above-mentioned problems, the embodiment of the invention discloses the sides that a kind of video data and audio data are played simultaneously Method, including：

Multi-medium data playing request is received in display terminal side joint；The playing request is identified including multi-medium data；

It is identified according to the multi-medium data corresponding from the vod server acquisition communicated with the display terminal side Video data；

Multi-medium data mark is sent to mobile equipment side；The mobile equipment side is used for according to the multimedia Data Identification is from the corresponding video data of vod server acquisition communicated with the display terminal side, the display terminal Side is connect with the mobile equipment side by way of wireless transmission；

When playing the video data, object time stamp is played according to currently playing video time stamp generation；

The broadcasting object time stamp is sent to mobile equipment side；The mobile equipment side is used to play the broadcasting mesh Mark the audio data corresponding to timestamp.

Preferably, the mode of the wireless transmission includes following one or more：

Ethernet, bluetooth, 2.4G wireless networks, infrared ray and wireless network protocol ZigBee.

Preferably, the object time stamp that plays includes what the display equipment side was extracted when playing the video data The corresponding video time stamp of current video data.

Preferably, the broadcasting object time stamp includes what the display terminal side was extracted when playing the video data The corresponding video time stamp of current video data and delay time value；The delay time value for the display terminal side with it is described The time of data transfer delay between mobile equipment side.

Preferably, the delay time value is to be worked as by the way that preset analogue data to be sent to the mobile equipment and record Preceding the first system time value receives the analogue data that the mobile equipment returns and records the current second system time Value and the half for calculating the second system time value and the difference of the first system time value, the delay time of acquisition Value；

Alternatively,

The delay time value that the delay time value is sent for the mobile equipment.

Preferably, in the step for obtaining corresponding video data from the vod server according to multi-medium data mark After rapid, further include：

Buffered is carried out to the video data.

Preferably, multi-medium data mark include multi-medium data file name and/or, multi-medium data File address.

The embodiment of the invention also discloses a kind of method that video data and audio data are played simultaneously, including：

The multi-medium data mark of display terminal side transmission is received in mobile equipment side joint；The multi-medium data is whole from display End side receive playing request in extract, the display terminal side be used for according to the multi-medium data mark from display terminal The vod server communicated obtains video data；The display terminal side passes through wireless transmission with the mobile equipment side Mode connects；

According to the multi-medium data mark audio number is obtained from the vod server communicated with the mobile equipment According to；

Receive the broadcasting object time stamp that the display terminal side is sent；The reproduction time stamp exists for the display terminal When playing the video data, the timestamp according to currently playing video time stamp generation；

Play the corresponding audio data of the broadcasting object time stamp.

Preferably, the broadcasting object time stamp includes what the display terminal side was extracted when playing the video data The corresponding video time stamp of current video data.

Preferably, after the step of stabbing the broadcasting object time for receiving the display terminal side transmission, the side Method further includes：

Obtain delay time value；

Increase the delay time value in the time value of the broadcasting object time stamp instruction.

Preferably, the delay time value is to be worked as by the way that preset analogue data to be sent to the display terminal and record Preceding third system time value receives the analogue data that the display terminal returns and records the 4th current system time Value and calculating the 4th system time value and the half of the difference of the third system time value, the delay time of acquisition Value；

Alternatively,

The delay time value is the delay time value that the display terminal is sent.

Preferably, the audio data carries one or more audio time stamps；

The step of broadcasting broadcasting object time stabs corresponding audio data includes：

When currently playing audio time stamp is more than the broadcasting object time stamp, pause playing audio-fequency data is until work as The audio time stamp of preceding broadcasting is equal to the broadcasting object time stamp；

And/or

When currently playing audio time stamp is less than or equal to the broadcasting object time stamp, searches and be equal to the broadcasting The audio time stamp of object time stamp；

Play the corresponding audio data of the audio time stamp.

Preferably, before the step of broadcasting broadcasting object time stamp corresponding audio data, the side Method further includes：

Buffered is carried out to the audio data.

Preferably, multi-medium data mark include multi-medium data file name and/or, multi-medium data File address；

The embodiment of the invention also discloses the device that a kind of video data and audio data are played simultaneously, including：

Multi-medium data identifies receiving module, for receiving multi-medium data playing request in display terminal side joint；It is described to broadcast It puts request and includes multi-medium data mark；

Video data acquisition module, for being communicated according to multi-medium data mark from the display terminal side Vod server obtain corresponding video data；

Multi-medium data identifies sending module, for multi-medium data mark to be sent to mobile equipment side；It is described Mobile equipment side is used to identify from the vod server communicated with the display terminal side according to the multi-medium data and obtain Corresponding video data is taken, the display terminal side is connect with the mobile equipment side by way of wireless transmission；

Object time stamp generation module is played, for when playing the video data, during according to currently playing video Between stamp generation play the object time stamp；

Object time stamp sending module is played, for the broadcasting object time stamp to be sent to mobile equipment side；It is described Mobile equipment side is used to play the corresponding audio data of the broadcasting object time stamp.

Preferably, the delay time value is that preset analogue data is sent to the mobile equipment and is recorded current The first system time value receives the analogue data that the mobile equipment returns and records current second system time value, And calculate the half of the second system time value and the difference of the first system time value, the delay time value of acquisition；

Or；

Preferably, described device further includes：

First buffer module, for carrying out buffered to the video data.

Multi-medium data identifies receiving module, for receiving the multi-medium data of display terminal side transmission in mobile equipment side joint Mark；The multi-medium data is extracted from the playing request that display terminal side joint is received, and the display terminal side is used for according to institute It states multi-medium data mark and obtains video data from the vod server communicated with display terminal；The display terminal side with The mobile equipment side is connected by way of wireless transmission；

Audio data acquisition module, for according to multi-medium data mark from communicating with the mobile equipment Vod server obtains audio data；

Object time stamp receiving module is played, for receiving the broadcasting object time stamp that the display terminal side is sent；Institute It is the display terminal when playing the video data to state reproduction time stamp, according to currently playing video time stamp generation Timestamp；

Audio data playing module, for playing the corresponding audio data of the broadcasting object time stamp.

Preferably, described device further includes：

Delay time value acquisition module, for obtaining delay time value；

Delay time value increases module, for increasing the delay in the time value of the broadcasting object time stamp instruction Time value.

Alternatively,

The delay time value is the delay time value that the display terminal is sent.

Preferably, the audio data carries one or more audio time stamps；The audio data playing module packet It includes：

Pause play submodule, for currently playing audio time stamp be more than it is described broadcasting the object time stamp when, temporarily Stop playing audio-fequency data until currently playing audio time stamp is equal to the broadcasting object time stamp；

And/or

Search submodule, for currently playing audio time stamp be less than or equal to it is described broadcasting the object time stamp when, Search the audio time stamp for being equal to the broadcasting object time stamp；

It is corresponding to play submodule, for playing the corresponding audio data of the audio time stamp.

Preferably, it further includes：

Second buffer module, for carrying out buffered to the audio data.

The embodiment of the invention also discloses the system that a kind of video data and audio data are played simultaneously, including communicating Display terminal, mobile equipment and vod server；

The display terminal for receiving multi-medium data playing request, takes according to the playing request to the program request Business device sends video data and obtains request；The playing request is identified including multi-medium data；

The mobile equipment, for receiving the multi-medium data mark that the display terminal is sent, and according to more matchmakers Volume data identifies to the vod server and sends audio data acquisition request；

The vod server, for according to the video data obtain request and audio data obtain request, respectively to The display terminal and mobile equipment return to corresponding video data and audio data；

The display terminal is additionally operable to play the video data, and according to currently playing video time stamp generate when Between stab, and be sent to the mobile equipment；The mobile equipment is additionally operable to play the corresponding sound of the broadcasting object time stamp Frequency evidence.

The embodiment of the invention also discloses a kind of equipment, including：

One or more processors；

Memory；With

One or more modules, one or more of modules are stored in the memory and are configured to by described one A or multiple processors perform, wherein, one or more of modules have following function：

One or more processors；

Memory；With

Play the corresponding audio data of the broadcasting object time stamp.

Compared with background technology, the embodiment of the present invention includes advantages below：

Display terminal is after multi-medium data mark is received in the embodiment of the present invention, according to multi-medium data mark acquisition pair The video data answered, and in playing video data, send multi-medium data mark and the broadcasting object time is stabbed to mobile equipment, Mobile equipment obtains corresponding audio data, and play the audio according to object time stamp is played according to multi-medium data mark Data, wherein display terminal are connect with mobile equipment by way of wireless transmission, and it is straight to break away from wired earphone using user The constraint of display terminal is connect in succession, it is user-friendly, while avoid what audio data and video data were generated when playing Caused by fine difference is accumulated the problem of significantly different step, being played simultaneously for audio data and video data is realized.In addition, it moves Dynamic equipment is the very high product of public use frequency, and the embodiment of the present invention is multiplexed mobile equipment, and multi-purpose content avoids additional purchase Bluetooth headset is bought, it is highly practical, greatly reduce cost.

The embodiment of the present invention adds delay time value in object time stamp is played, and eliminates display terminal and mobile equipment The influence of the delay of object time stamp is played in transmission, further improves the essence of audio data and video data synchronization broadcasting Degree.

Description of the drawings

Fig. 1 shows that the flow example figure of video data and audio data is played simultaneously in a kind of display terminal；

Fig. 2 shows the flow examples that video data and audio data is played simultaneously in a kind of display terminal and bluetooth headset Figure；

Fig. 3 shows that the step of embodiment of the method 1 that a kind of video data of the present invention and audio data are played simultaneously flows Cheng Tu；

Fig. 4 shows that the step of embodiment of the method 2 that a kind of video data of the present invention and audio data are played simultaneously flows Cheng Tu；

Fig. 5 shows that the step of embodiment of the method 3 that a kind of video data of the present invention and audio data are played simultaneously flows Cheng Tu；

Fig. 6 shows that the step of embodiment of the method 4 that a kind of video data of the present invention and audio data are played simultaneously flows Cheng Tu；

Fig. 7 shows the structural frames of device embodiment 1 that a kind of video data of the present invention and audio data are played simultaneously Figure；

Fig. 8 shows the structural frames of device embodiment 2 that a kind of video data of the present invention and audio data are played simultaneously Figure；

Fig. 9 shows the structural frames of system embodiment that a kind of video data of the present invention and audio data are played simultaneously Figure；

Figure 10 shows the structure diagram of smart television provided by one embodiment of the present invention；

Figure 11 shows a kind of terminal device structure diagram provided in an embodiment of the present invention.

Specific embodiment

Above-mentioned purpose, feature and advantage to enable the embodiment of the present invention are more obvious understandable, below in conjunction with the accompanying drawings and Specific embodiment is described in further detail the embodiment of the present invention.

With reference to Fig. 1, show that the flow example figure of video data and audio data is played simultaneously in a kind of display terminal.

As shown in Figure 1, the audio, video data read module in display terminal reads multi-medium data, then it is decoded Video data and audio data are obtained, and video data is useful for synchronous timestamp with audio data band.

Then video data is sent to Video Output Modules, audio data is sent to audio output module.It is playing During multi-medium data, synchronous with the timestamp of audio data by broadcasting time point control module progress video data, then video is defeated Depanning root tuber is according to synchronous timestamp playing video data over the display, and audio data acquisition module is according to synchronous timestamp Playing audio-fequency data on a speaker, final realize are played simultaneously video data and audio data, realize multimedia on the whole The broadcasting of data.

However, in some cases, such as rest in night household, disturb other people to avoid, user may want to logical Cross audio data when earphone listens to intelligent television equipment broadcasting multi-medium data.

To solve the above problems, when intelligent television equipment broadcasting multi-medium data can be remotely listened to using bluetooth headset Audio data.

In bluetooth applications, blue tooth products distinguish device type and service type.

In general, device type includes main equipment type and ancillary equipment type, it is specified which class bluetooth equipment belongs to The equipment of type, such as earphone, mobile phone, printer.By taking mobile phone as an example, by ancillary equipment type stated be smart mobile phone or Regular handset.

Service type defines the service that bluetooth equipment can provide.By taking mobile phone as an example, some mobile phones support OPP (objects Storage specification, Object Push Profile) and two kinds of texts of FTP (File Transfer Protocol, File Transfer Protocol) Part transmission service, some mobile phones only provide OPP services, and two bluetooth equipments will be communicated mutually, and equipment class can be different, such as mobile phone And earphone, but the service agreement of bluetooth equipment must be consistent, since it is desired that earphone provides voice service, ear is found by mobile phone Machine still can will inquire what service it can provide, then be communicated again in the pre-connection.

Mobile equipment, such as smart mobile phone, Intelligent flat etc., although having Bluetooth function, belong to blue tooth products, Its device type is not earphone, it is impossible to provide bluetooth headset service ability, therefore the indigo plant that can not be shown as earphone in terminal Tooth module connects and push audio data uses.

Therefore, if want by bluetooth headset listen to intelligent television equipment play multi-medium data when audio data, need Want extra purchase bluetooth headset.

With reference to Fig. 2, show that the flow of video data and audio data is played simultaneously with bluetooth headset in a kind of display terminal Exemplary plot.

As shown in Fig. 2, display terminal is attached by Bluetooth link and bluetooth headset.Audio and video in display terminal Data read module reads multi-medium data, is then decoded and obtains video data and audio data, and video data and sound Frequency is useful for synchronous timestamp according to band.

Then video data is sent to Video Output Modules, audio data is sent to bluetooth headset.

Bluetooth audio frequency receiving module in bluetooth headset receives the audio data that display terminal is sent, and then passes to audio Then output module is exported to earphone speaker and is played out again.

Audio data and video data play out in two equipment respectively, and audio data passes through before being played Data processing in Bluetooth transmission process and transmission process, inherently generation time postpone.

There are small differences for the clock frequency of bluetooth headset timing and the clock frequency of display terminal, can cause audio Data and video data generate small difference in the speed of broadcasting, this difference can constantly be built up, and cause audio data With video data asynchrony phenomenon with the growth of reproduction time, more and more significantly.

Based on the demand, inventor creatively proposes one of the core concepts of the embodiments of the present invention, and display terminal will Multi-medium data is decoded as video data with after audio data, audio data is transmitted to mobile equipment, is played in audio data When audio broadcast information returned into display terminal, the video data that display terminal is synchronized according to timestamp plays.

With reference to Fig. 3, the step of embodiment of the method 1 that a kind of video data of the present invention and audio data are played simultaneously is shown Rapid flow chart, the embodiment of the present invention may include steps of：

Step 301, multi-medium data playing request is received in display terminal side joint；The playing request includes multi-medium data Mark；

It should be noted that display terminal can include smart television, PC, palm PC, mobile equipment etc., And smart television can include LCD (Liquid Crystal Display, liquid crystal display) TV, LED (Light Emitting Diode, light emitting diode) TV, 3D TVs, plasm TV etc., the embodiment of the present invention does not limit this System.

Multi-medium data can be digital television signal, can be to be stored on display terminal or peripheral equipment disk Multi-medium data can be stream medium data, etc., and the embodiment of the present invention does not limit this.

In the concrete realization, playing request can be generated, such as the remote control of smart television by the control device of display terminal Device, when user selects corresponding multi-medium data on a remote control, remote controler can be according to the multi-medium data of user's selection Generation carries the playing request of corresponding multi-medium data mark, and is sent to display terminal.

Step 302, it is identified according to the multi-medium data from the vod server communicated with the display terminal side Obtain corresponding video data；

In practical applications, when display terminal receives playing request, multi-medium data mark is extracted from playing request Know, corresponding video data is obtained from the vod server communicated with the display terminal.As the embodiment of the present invention A kind of example of concrete application, multi-medium data mark can include multi-medium data file name and/or, more matchmakers The file address of volume data.

Specifically, display terminal can be obtained from vod server according to the file name of multi-medium data it is corresponding Video data, alternatively, the file address according to multi-medium data, such as multi-medium data is in the URL of vod server (Uniform Resource Locator, uniform resource locator), obtains corresponding video data from vod server.

Step 303, multi-medium data mark is sent to mobile equipment side；The mobile equipment side is used for according to institute Multi-medium data mark is stated from the corresponding video data of vod server acquisition communicated with the display terminal side, it is described Display terminal side is connect with the mobile equipment side by way of wireless transmission；

Using the embodiment of the present invention, display terminal can establish data transmission link between mobile equipment.

It should be noted that mobile equipment can be tablet computer, personal digital assistant (Personal Digital Assistant, PDA), various mobile equipment, the embodiment of the present invention such as mobile phone be not restricted this.

In a kind of preferable example of the embodiment of the present invention, the mode of the wireless transmission can include following one kind or It is a variety of：

Ethernet；

In this example, the transmission link between display terminal and mobile equipment can be Ethernet (Ethernet) chain The audio data can be sent to mobile equipment side by road, display terminal side by the transmission mode of Ethernet.

Ethernet (Ethernet) is a kind of computer LAN networking technology, using passive medium, by broadcast mode Propagate information.It defines physical layer and data link layer protocol, it is specified that the interface and number of physical layer and data link layer According to link layer and the interface of higher.Its standard topologies is topological for bus-type, but current Fast Ethernet (100BASE- T, 1000BASE-T standards) in order to reduce conflict to the greatest extent, network speed and service efficiency are improved to the greatest extent, are used Interchanger (Switch hub) carries out network connection and tissue, in this way, the topological structure of Ethernet is just into star-like, but is patrolling On volume, Ethernet still uses bus-type topology and CSMA/CD (Carrier Sense Multiple Access/ Collision Detect, that is, csma/cd) bus conflict technology.

In this example, can be a WiFi (wireless local for being created in 802.11 standards of IEEE using Ethernet The network equipment), display terminal and mobile equipment can pass through IP (Internet after same LAN has been connected into Protocol, the agreement interconnected between network) address TCP/IP (Transmission Control Protocol/ Internet Protocol, transmission control protocol/Internet Protocol also known as network communication protocol) agreement initiates the connection.

Bluetooth；

In this example, the transmission link between display terminal and mobile equipment can be Bluetooth link, display terminal side Can the audio data be sent to by mobile equipment side by the transmission mode of bluetooth.

Bluetooth is the radiotechnics of holding equipment short haul connection (in general 10m) a kind of.It can be including mobile electricity Wireless messages exchange is carried out between numerous equipment such as words, PDA, wireless headset, laptop, related peripherals.

" bluetooth " technology of utilization, can effectively simplify the communication between mobile communication terminal device, also can be successfully Simplify the communication between equipment and internet Internet, so as to which data transmission becomes more rapid efficient, opened up for wireless communication Wide road.

Bluetooth uses distributed network structure and fast frequency hopping and short packet technology, supports point-to-point and point-to-multipoint delivery, It is operated in 2.4GHz ISM (i.e. industry, science, medicine) frequency range of global general-use.Its data rate is 1Mbps.It is double using the time-division Work transmission plan realizes full duplex transmission.

In this example, the equipment that can find surrounding according to the corresponding agreement of bluetooth, mobile equipment, then lists equipment ID and name list, then selection need the display terminal connected, are attached.

It should be noted that in this example, mobile equipment, such as smart mobile phone, Intelligent flat etc., have bluetooth work( Can, belong to blue tooth products, device type can be display terminal, can provide Bluetooth data transfer energy between display terminal Power, therefore the bluetooth module connection that can be shown as audio data receipt terminal in terminal and push audio data use.

2.4G wireless network；

In this example, the transmission link between display terminal and mobile equipment can be 2.4G wireless network links, show Show that the audio data can be sent to mobile equipment side by end side by the transmission mode of 2.4G wireless networks.

2.4G wireless network frequency ranges belong to ISM band, it is the ultralow radiation green ring being widely used in global range Protect frequency range；With 125 communication channels, because 2.4G wireless network communications are more unobstructed, will not mutually be done between multiple communication instructions It disturbs；2.4G wireless mesh bandwidth, which passes rate highest, can reach 108Mbps, therefore its transmission speed is quickly；Its transmission distance From relatively far away from (open field：200m effective propagation paths), and do not influenced by transmission side, support two-way communication.

Infrared ray；

In this example, the transmission link between display terminal and mobile equipment can be infrared link, display terminal side Can the audio data be sent to by mobile equipment side by the transmission mode of infrared ray.

Infrared is the abbreviation of infrared ray, is a kind of wireless communication mode, can carry out the transmission of wireless data.Infrared interface It is the configuration standard of mobile phone of new generation, it supports mobile phone to carry out data exchange infrared communications with computer and other digital devices There is the characteristics of of low cost, easy to connect, easy to use and compact-sized, therefore obtained extensively in small-sized mobile equipment General application.By infrared interface, all kinds of mobile equipment can freely carry out data exchange.

Wireless network protocol ZigBee.

In this example, the transmission link between display terminal and mobile equipment can be ZigBee links, display terminal The audio data can be sent to mobile equipment side by side by the transmission mode of wireless network protocol ZigBee.

Zigbee is a kind of wireless network protocol of low speed short-distance transmission based on IEEE802.15.4 standards.Agreement from Under to it is upper be respectively physical layer (PHY), MAC layer (MAC), transport layer (TL), network layer (NWK), application layer (APL) etc..Wherein physical layer and MAC layer follow the regulation of IEEE 802.15.4 standards.

ZigBee-network is mainly characterized by low-power consumption, low cost, low rate, supports great deal of nodes, multiple network is supported to open up It flutters, low complex degree, quick, reliable, safety.Equipment is divided into coordinator (Coordinator), convergence section in ZigBee-network The Three roles such as point (Router), sensor node (EndDevice).

Certainly, above-mentioned transmission mode is intended only as example, when implementing the embodiment of the present invention, can be set according to actual conditions Other transmission modes are put, as long as display terminal and the connection of the wireless transmission of mobile equipment, the embodiment of the present invention can be realized This is not limited.In addition, other than above-mentioned transmission mode, those skilled in the art can also use it according to actual needs Its transmission mode, the embodiment of the present invention also do not limit this.

In practical applications, it when mobile equipment receives multi-medium data mark, is mutually communicated from the mobile equipment Corresponding audio data is obtained in the vod server of letter.It is described more as a kind of example of concrete application of the embodiment of the present invention Media data mark can include multi-medium data file name and/or, the file address of multi-medium data.

Specifically, mobile equipment can be obtained from vod server according to the file name of multi-medium data it is corresponding Audio data, alternatively, the file address according to multi-medium data, such as multi-medium data is in the URL of vod server, from program request Corresponding audio data is obtained in server.

Step 304, when playing the video data, the object time is played according to currently playing video time stamp generation Stamp；

In practical applications, display terminal can constantly send video playing letter in the broadcasting for tapping into row audio data Breath (playing object time stamp) is to display terminal.

Data transmission between display terminal and mobile equipment can more or less have certain delay, in a kind of situation, To improve the precision being played simultaneously, the embodiment of the present invention is when video data is synchronous with audio data, it may be considered that transmission Delay.

Then in embodiments of the present invention, the broadcasting object time stamp can include the display terminal side described in broadcasting The corresponding video time stamp of current video data and delay time value extracted during video data；The delay time value is described The time of data transfer delay between display terminal side and the mobile equipment side.

In embodiments of the present invention, the corresponding video time stamp of current video data is t_a, delay time value is Δ t, then Play object time stamp t_a＇=t_a+Δt。

It in embodiments of the present invention, can be in advance or when currently measuring the delay between display terminal and mobile equipment Between be worth；It can be that display terminal actively measures, can also be obtained from mobile equipment, the embodiment of the present invention does not limit this. For example, when display terminal and mobile equipment are in first connection, display terminal or mobile equipment actively initiate delay time value Measurement, after measurement, the mark for identifying, moving equipment, transmission mode and delay time value of display terminal are stored In display terminal and/or mobile equipment.When display terminal and mobile equipment are when being again coupled to, mark when display terminal, When moving mark, the transmission mode successful match of equipment, then can directly it be obtained from display terminal and/or mobile equipment first The delay time value of measurement.

Then in a kind of preferable example of the embodiment of the present invention, the delay time value can be by preset analogue data It is sent to the mobile equipment and records current the first system time value, receive the simulation number that the mobile equipment returns According to and record current second system time value and, calculate the second system time value and the first system time value Difference half, the delay time value of acquisition；

In practical applications, analogue data can be the data of arbitrary format.And the time-delay value and biography of data transmission The size of transmission of data has relationship, therefore the size of analogue data is sent with practical as a time point data.Then in this example In, the size for the audio data that analogue data can be between two audio time stamps is the same.

After analogue data is sent to mobile equipment by display terminal, mobile equipment needs to return analogue data immediately to display Terminal, display terminal calculating simulation data are from time difference (i.e. the first system time and second system time for being sent to reception Difference) half, obtain delay time value.

It is T when the first system time₁, the second system time is T₂When, delay time Δ t=(T₂-T₁)/2。-

Certainly, the embodiment of the present invention can also calculate multiple analogue data from the half for the time difference for being sent to reception, obtain Delay time value is obtained, to reduce error.

In another preferable example of the embodiment of the present invention, the delay time value can be that the mobile equipment is sent Delay time value.

In this example, the delay time value can be that mobile equipment is described by the way that preset analogue data is sent to Display terminal simultaneously records current third system time value, receives the analogue data that the display terminal returns and records and works as The 4th preceding system time value and calculating the 4th system time value and the one of the difference of the third system time value Half, the delay time value of acquisition.

Human eye resolution capability is generally 1/24 second, if when playing, there are the differences of smile with audio data for video data Different, people is will not to be clearly felt that.Therefore in another situation, the resource to reduce display terminal or mobile equipment accounts for With when delay time value is less than predetermined threshold value (such as a 40ms), the embodiment of the present invention is in video data and audio data Synchronization when, can not consider transmission delay.

Then in embodiments of the present invention, the broadcasting object time stamp can include the display terminal side described in broadcasting The corresponding video time stamp of current video data extracted during video data.

The corresponding video time stamp of current video data is t_a, then object time stamp t is played_a＇=t_a。

Step 305, the broadcasting object time stamp is sent to mobile equipment side；The mobile equipment side is used to play institute It states and plays the corresponding audio data of object time stamp.

With step 303 correspondingly, display terminal side can will play the object time by the transmission mode of Ethernet and stab Mobile equipment side is sent to, alternatively, can will play object time stamp by the transmission mode of bluetooth is sent to mobile equipment side, Alternatively, can will play object time stamp by the transmission modes of 2.4G wireless networks be sent to mobile equipment side, alternatively, can be with Object time stamp will be played by the transmission mode of infrared ray and be sent to mobile equipment side, alternatively, can be assisted by wireless network Broadcasting object time stamp is sent to mobile equipment side by the transmission mode for discussing ZigBee.

Audio data is sent to mobile equipment by display terminal after multi-medium data is received in the embodiment of the present invention, is shown Show terminal in playing video data, sent to movement equipment and play object time stamp, mobile equipment is according to the broadcasting object time Playing audio-fequency data is stabbed, wherein display terminal is connect with mobile equipment by way of wireless transmission, can be broken away from using user Wired earphone is directly connected to the constraint of display terminal, user-friendly, while avoids audio data and video data and broadcasting Caused by the smile difference accumulation generated when putting the problem of significantly different step, realize audio data and video data synchronize broadcast It puts.In addition, mobile equipment is the very high product of public use frequency, the mobile equipment of multiplexing of the embodiment of the present invention, multi-purpose content is kept away Exempt from extra purchase bluetooth headset, it is highly practical, greatly reduce cost.

With reference to Fig. 4, the step of embodiment of the method 2 that a kind of video data of the present invention and audio data are played simultaneously is shown Rapid flow chart, the embodiment of the present invention may include steps of：

Step 401, multi-medium data playing request is received in display terminal side joint；The playing request includes multi-medium data Mark；

Step 402, it is identified according to the multi-medium data from the vod server communicated with the display terminal side Obtain corresponding video data；

Step 403, buffered is carried out to the video data；

In the concrete realization, buffered can be to start playing video data or audio number again by buffer time value According to.Buffer time can be to be set in advance as a fixed value, such as 5 seconds.

In display terminal, it can pass through buffer time, after having buffered enough video datas, then carry out video data It plays；And in a mobile device, identical buffer time can be passed through, after having buffered enough audio datas, then carry out audio The broadcasting of data.

Step 404, multi-medium data mark is sent to mobile equipment side；The mobile equipment side is used for according to institute Multi-medium data mark is stated from the corresponding video data of vod server acquisition communicated with the display terminal side, it is described Display terminal side is connect with the mobile equipment side by way of wireless transmission；

Step 405, when playing the video data, the object time is played according to currently playing video time stamp generation Stamp；

In the embodiment of the present invention, the broadcasting object time stamp can include the display terminal side and play the video The corresponding video time stamp of current video data extracted during data.

Step 406, the broadcasting object time stamp is sent to mobile equipment side；The mobile equipment side is used to play institute It states and plays the corresponding audio data of object time stamp.

With reference to Fig. 5, the step of embodiment of the method 3 that a kind of video data of the present invention and audio data are played simultaneously is shown Rapid flow chart, the embodiment of the present invention may include steps of：

Step 501, the multi-medium data mark of display terminal side transmission is received in mobile equipment side joint；The multi-medium data From display terminal side joint receive playing request in extract, the display terminal side be used for according to the multi-medium data mark from The vod server that display terminal communicates obtains video data；The display terminal side passes through nothing with the mobile equipment side The mode of line transmission connects；

In this example, the transmission link between display terminal and mobile equipment can be ethernet link, Bluetooth link, 2.4G wireless network links, infrared link, ZigBee links or other transmission links.

Specifically, mobile equipment side can receive the multimedia number that display terminal side is sent by the transmission mode of Ethernet According to mark, identified alternatively, the multi-medium data that display terminal side is sent can be received by the transmission mode of bluetooth, alternatively, can It is identified with the multi-medium data that the transmission of display terminal side is received by the transmission mode of 2.4G wireless networks, alternatively, can pass through The transmission mode of infrared ray receives the multi-medium data mark that display terminal side is sent, alternatively, can pass through wireless network protocol The transmission mode of ZigBee receives the multi-medium data mark that display terminal side is sent.

Step 502, it identifies from the vod server communicated with the mobile equipment and obtains according to the multi-medium data Take audio data；

Specifically, mobile equipment can be obtained from vod server according to the file name of multi-medium data it is corresponding Audio data, alternatively, the file address according to multi-medium data, such as multi-medium data is in the URL of vod server, from program request Corresponding video data is obtained in server.

Step 503, the broadcasting object time stamp that the display terminal side is sent is received；The reproduction time stamp is described aobvious Show terminal when playing the video data, the timestamp generated according to currently playing video time stamp；

With step 501 correspondingly, mobile equipment side can pass through the transmission mode of Ethernet and receive the display terminal The broadcasting object time stamp that side is sent, alternatively, broadcasting for the display terminal side transmission can be received by the transmission mode of bluetooth Object time stamp is put, alternatively, the broadcasting that the display terminal side is sent can be received by the transmission mode of 2.4G wireless networks Object time stabs, alternatively, the broadcasting object time that the display terminal side is sent can be received by the transmission mode of infrared ray Stamp, alternatively, the broadcasting target that the display terminal side is sent can be received by the transmission mode of wireless network protocol ZigBee Timestamp.

In one preferred embodiment of the invention, the broadcasting object time stamp can exist including the display terminal side Play the corresponding video time stamp of the current video data extracted during the video data.

In embodiments of the present invention, the corresponding video time stamp of current video data is t_a, then object time stamp t is played_a＇ =t_a。

In another preferred embodiment of the invention, the broadcasting object time stamp can include the display terminal side The corresponding video time stamp of current video data and delay time value extracted when playing the video data；During the delay Between value can between the display terminal side and the mobile equipment side data transfer delay time.

Step 504, the audio data played corresponding to object time stamp is played.

Mobile equipment can be believed when receiving video playing information (playing object time stamp) according to video playing Breath carries out being played simultaneously for audio data using modes such as the loud speaker of itself or access wired earphones.

In one preferred embodiment of the invention, the audio data can carry one or more audio times Stamp, step 503 can include following sub-step：

Sub-step S11, when currently playing audio time stamp is more than the broadcasting object time stamp, pause plays audio Data are until currently playing audio time stamp is equal to the broadcasting object time stamp；

Currently playing audio time stamp is more than the broadcasting object time stamp, i.e. audio data broadcasting is ahead of audio number According to broadcasting, such as play object time stamp as 50000 milliseconds, and currently playing audio time stamp is 50040 milliseconds, then may be used To suspend playing audio-fequency data, such as repeat playing current video data, just opened until audio data is synchronous with audio data Begin normally to play.

Certainly, the embodiment of the present invention can also need not suspend playing audio-fequency data, directly play and search equal to the broadcasting The audio time stamp of object time stamp, plays the corresponding audio data of the audio time stamp, the embodiment of the present invention is not added with this With limitation.

And/or

Sub-step S12, when currently playing audio time stamp is less than or equal to the broadcasting object time stamp, search etc. In the audio time stamp of the broadcasting object time stamp；

Sub-step S13 plays the corresponding audio data of the audio time stamp.

Currently playing audio time stamp be less than or equal to it is described broadcasting the object time stamp, i.e., audio data play fall behind or Person is synchronized with the broadcasting of audio data, such as it is 50000 milliseconds to play object time stamp, and currently playing video time stamp is 49960 milliseconds, then the audio time stamp of synchronous point can be searched, not play the intermediate audio data fallen behind and directly play synchronization The video data of point.

It should be noted that since embodiment of the method 3 and embodiment of the method 1 are corresponding, so the comparison of description is simple Single, related part illustrates that the embodiment of the present invention is not described in detail herein referring to the part of embodiment of the method 1.

With reference to Fig. 6, the step of embodiment of the method 4 that a kind of video data of the present invention and audio data are played simultaneously is shown Rapid flow chart, the embodiment of the present invention may include steps of：

Step 601, the multi-medium data mark of display terminal side transmission is received in mobile equipment side joint；The multi-medium data From display terminal side joint receive playing request in extract, the display terminal side be used for according to the multi-medium data mark from The vod server that display terminal communicates obtains video data；The display terminal side passes through nothing with the mobile equipment side The mode of line transmission connects；

In one preferred embodiment of the invention, the multi-medium data mark can include the file of multi-medium data Title and/or, the file address of multi-medium data.

Step 602, it identifies from the vod server communicated with the mobile equipment and obtains according to the multi-medium data Take audio data；

Step 603, buffered is carried out to the audio data；

Step 604, the broadcasting object time stamp that the display terminal side is sent is received；The reproduction time stamp is described aobvious Show terminal when playing the video data, the timestamp generated according to currently playing video time stamp；

Then in embodiments of the present invention, the corresponding video time stamp of current video data is t_a, then object time stamp is played t_a＇=t_a。

Step 605, delay time value is obtained；

It in embodiments of the present invention, can be in advance or when currently measuring the delay between display terminal and mobile equipment Between be worth；It can be that display terminal actively measures, can also be obtained from mobile equipment, the embodiment of the present invention does not limit this.

Then in a kind of preferable example of the embodiment of the present invention, the delay time value is by by preset analogue data It is sent to the display terminal and records current third system time value, receive the simulation number that the display terminal returns According to and record the 4th current system time value and calculate the 4th system time value and the third system time value The half of difference, the delay time value of acquisition；

After analogue data is sent to display terminal by mobile equipment, display terminal needs to return analogue data immediately to movement Equipment, mobile equipment calculating simulation data are from time difference (i.e. the third system time and the 4th system time for being sent to reception Difference) half, obtain delay time value.

When third system time is T₃, the 4th system time is T₄When, delay time Δ t=(T₄-T₃)/2。

In another preferable example of the embodiment of the present invention, the delay time value can be that the display terminal is sent Delay time value.

In this example, the delay time value can be that preset analogue data is sent to the movement by display terminal Equipment simultaneously records current the first system time value, receives the analogue data that the mobile equipment returns and records currently Second system time value and, calculate the half of the difference of the second system time value and the first system time value, obtain The delay time value obtained.

Step 606, increase the delay time value in the time value of the broadcasting object time stamp instruction；

In embodiments of the present invention, object time stamp t is played_a＇=t_a, delay time value be Δ t, then updated broadcasting Object time stabs t_a"=t_a＇+Δ t=t_a+Δt。

Step 607, the audio data played corresponding to object time stamp is played.

It should be noted that since embodiment of the method 4 and embodiment of the method 2 are corresponding, so the comparison of description is simple Single, related part illustrates that the embodiment of the present invention is not described in detail herein referring to the part of embodiment of the method 2.

For embodiment of the method, in order to be briefly described, therefore it is all expressed as to a series of combination of actions, but this field Technical staff should know that the embodiment of the present invention is not limited by described sequence of movement, because implementing according to the present invention Example, certain steps may be used other sequences or are carried out at the same time.Secondly, those skilled in the art should also know, specification Described in embodiment belong to preferred embodiment, necessary to the involved action not necessarily embodiment of the present invention.

With reference to Fig. 7, the knot of device embodiment 1 that a kind of video data of the present invention and audio data are played simultaneously is shown Structure block diagram, the embodiment of the present invention can include following module：

Multi-medium data identifies receiving module 701, for receiving multi-medium data playing request in display terminal side joint；It is described Playing request is identified including multi-medium data；

Video data acquisition module 702, for being identified according to the multi-medium data from mutual with the display terminal side The vod server of communication obtains corresponding video data；

Multi-medium data identifies sending module 703, for multi-medium data mark to be sent to mobile equipment side；Institute Mobile equipment side is stated for being identified according to the multi-medium data from the vod server communicated with the display terminal side Corresponding video data is obtained, the display terminal side is connect with the mobile equipment side by way of wireless transmission；

Object time stamp generation module 704 is played, for when playing the video data, according to currently playing video Timestamp generation plays object time stamp；

Object time stamp sending module 705 is played, for the broadcasting object time stamp to be sent to mobile equipment side；Institute Mobile equipment side is stated for playing the corresponding audio data of the broadcasting object time stamp.

In one preferred embodiment of the invention, the mode of the wireless transmission includes following one or more：

In one preferred embodiment of the invention, the broadcasting object time stamp includes the display terminal side and is playing The corresponding video time stamp of current video data extracted during the video data.

In one preferred embodiment of the invention, the broadcasting object time stamp includes the display terminal side and is playing The corresponding video time stamp of current video data and delay time value extracted during the video data；The delay time value is The time of data transfer delay between the display terminal side and the mobile equipment side.

In one preferred embodiment of the invention, the delay time value is described for preset analogue data is sent to Mobile equipment simultaneously records current the first system time value, receives the analogue data that the mobile equipment returns and records and works as Preceding second system time value and, calculate the one of the second system time value and the difference of the first system time value Half, the delay time value of acquisition；

Or；

In one preferred embodiment of the invention, can also include：

First buffer module, for carrying out buffered to the video data.

With reference to Fig. 8, the knot of device embodiment 2 that a kind of video data of the present invention and audio data are played simultaneously is shown Structure block diagram, the embodiment of the present invention can include following module：

Multi-medium data identifies receiving module 801, for receiving the multimedia of display terminal side transmission in mobile equipment side joint Data Identification；The multi-medium data is extracted from the playing request that display terminal side joint is received, the display terminal side be used for according to According to the multi-medium data mark video data is obtained from the vod server communicated with display terminal；The display terminal Side is connect with the mobile equipment side by way of wireless transmission；

Audio data acquisition module 802, for mutually being communicated from the mobile equipment according to multi-medium data mark The vod server of letter obtains audio data；

Object time stamp receiving module 803 is played, for receiving the broadcasting object time stamp that the display terminal side is sent； Reproduction time stamp is the display terminal when playing the video data, according to currently playing video time stamp generation Timestamp；

Audio data playing module 804, for playing the corresponding audio data of the broadcasting object time stamp.

In one preferred embodiment of the invention, the broadcasting object time stamp can exist including the display terminal side Play the corresponding video time stamp of the current video data extracted during the video data and delay time value；The delay time It is worth the time of the data transfer delay between the display terminal side and the mobile equipment side.

In one preferred embodiment of the invention, the embodiment of the present invention can also include following module：

Delay time value acquisition module, for obtaining delay time value；

In one preferred embodiment of the invention, the delay time value can be by the way that preset analogue data is sent out It send to the display terminal and records current third system time value, receive the analogue data that the display terminal returns And it records the 4th current system time value and calculates the difference of the 4th system time value and the third system time value The half of value, the delay time value of acquisition；

Alternatively,

The delay time value can be the delay time value that the display terminal is sent.

In one preferred embodiment of the invention, the audio data can carry one or more audio times Stamp；The audio data playing module 804 can include following submodule：

And/or

Second buffer module, for carrying out buffered to the audio data.

For device embodiment, since it is basicly similar to embodiment of the method, so description is fairly simple, it is related The part explanation of part reference method embodiment.

With reference to Fig. 9, the knot of system embodiment that a kind of video data of the present invention and audio data are played simultaneously is shown Structure block diagram can specifically include the display terminal communicated, mobile equipment and vod server；

For system embodiment, since it is basicly similar to embodiment of the method, so description is fairly simple, it is related The part explanation of part reference method embodiment.

The embodiment of the present invention additionally provides a kind of equipment, which can include：

One or more processors；

Memory；With

One or more modules, the one or more module are stored in memory and are configured to by one or more Device is managed to perform, wherein, which has following function：

Optionally, the mode of the wireless transmission includes following one or more：

Optionally, the broadcasting object time stamp includes what the display terminal side was extracted when playing the video data The corresponding video time stamp of current video data.

Optionally, the broadcasting object time stamp includes what the display terminal side was extracted when playing the video data The corresponding video time stamp of current video data and delay time value；The delay time value for the display terminal side with it is described The time of data transfer delay between mobile equipment side.

Optionally, the delay time value is that preset analogue data is sent to the mobile equipment and is recorded current The first system time value receives the analogue data that the mobile equipment returns and records current second system time value, And calculate the half of the second system time value and the difference of the first system time value, the delay time value of acquisition；

Or；

Optionally, which can also have following function：

Buffered is carried out to the video data.

Optionally, multi-medium data mark can include multi-medium data file name and/or, multimedia number According to file address.

The embodiment of the present invention additionally provides a kind of non-volatile readable storage medium, in the storage medium storage there are one or Multiple modules (programs), when which is used in the equipment with display, can cause the equipment Perform the instruction (instructions) of following steps：Multi-medium data playing request is received in display terminal side joint；The broadcasting Request includes multi-medium data mark；

Or；

Optionally, which can also have following function：

Buffered is carried out to the video data.

0 is please referred to Fig.1, it illustrates the structure diagrams of smart television provided by one embodiment of the present invention.The electronics Equipment is for implementing the content displaying method provided in above-described embodiment, specifically：

Electronic equipment 800 can include RF (Radio Frequency, radio frequency) circuit 810, including there are one or one with Memory 820, input unit 830, display unit 840, sensor 850, the voicefrequency circuit of upper computer readable storage medium 860th, short range wireless transmission module 870, including there are one or more than one processing core processor 880 and power supply 890 grade components.It will be understood by those skilled in the art that the electronic devices structure shown in Fig. 9 is not formed to electronic equipment It limits, can include either combining certain components or different components arrangement than illustrating more or fewer components.Wherein：

RF circuits 810 can be used for receive and send messages or communication process in, signal sends and receivees, particularly, by base station After downlink information receives, transfer to one or more than one processor 880 is handled；In addition, the data for being related to uplink are sent to Base station.In general, RF circuits 810 include but not limited to antenna, at least one amplifier, tuner, one or more oscillators, receive Sender, coupler, LNA (Low Noise Amplifier, low-noise amplifier), duplexer etc..In addition, RF circuits 810 are also It can communicate by radio communication with network and other equipment.The wireless communication can use any communication standard or agreement, Including but not limited to GSM (Global System of Mobile communication, global system for mobile communications), GPRS (General Packet Radio Service, general packet radio service), CDMA (Code Division Multiple Access, CDMA), WCDMA (Wideband Code Division Multiple Access, wideband code division multiple access), LTE (Long Term Evolution, long term evolution), Email, SMS (Short Messaging Service, short message Service) etc..Memory 820 can be used for storage software program and module, for example, memory 820 can be used for storage acquisition language The software program of sound signal, the software program for realizing keyword identification, the software program for realizing continuous speech recognition and realization Software program of item etc. is reminded in setting.Processor 880 is stored in the software program and mould of memory 820 by operation Block " receives multimedia so as to perform various functions in application and data processing, such as the embodiment of the present invention in display terminal side joint The function of data ", the function of " audio data is sent to mobile equipment side ", " when playing the video data, foundation The broadcasting object time stamp " is sent to the movement to set by currently playing video time stamp generation broadcasting object time stamp " Function of standby side " etc..Memory 820 can mainly include storing program area and storage data field, wherein, storing program area can deposit Application program (such as sound-playing function, image player function etc.) needed for storage operating system, at least one function etc.；Storage Data field can be stored uses created data (such as audio data, phone directory etc.) etc. according to electronic equipment 800.In addition, Memory 820 can include high-speed random access memory, can also include nonvolatile memory, for example, at least a disk Memory device, flush memory device or other volatile solid-state parts.Correspondingly, memory 820 can also include memory control Device processed, to provide the access of processor 880 and input unit 830 to memory 820.

Input unit 830 can be used for receiving the number inputted or character information and generate and user setting and function Control related keyboard, mouse, operating lever, optics or the input of trace ball signal.Specifically, input unit 830 may include touching Sensitive surfaces 831 and other input equipments 832.Touch sensitive surface 831, also referred to as touch display screen or Trackpad are collected and are used Family on it or neighbouring touch operation (such as user using any suitable object such as finger, stylus or attachment in touch-sensitive table Operation on face 831 or near touch sensitive surface 831), and corresponding attachment device is driven according to preset formula.It is optional , touch sensitive surface 831 may include both touch detecting apparatus and touch controller.Wherein, touch detecting apparatus detection is used The touch orientation at family, and the signal that touch operation is brought is detected, transmit a signal to touch controller；Touch controller is from touch Touch information is received in detection device, and is converted into contact coordinate, then gives processor 880, and processor 880 can be received The order sent simultaneously is performed.Furthermore, it is possible to using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves Realize touch sensitive surface 831.In addition to touch sensitive surface 831, input unit 830 can also include other input equipments 832.Specifically, Other input equipments 832 can include but is not limited to physical keyboard, function key (such as volume control button, switch key etc.), It is one or more in trace ball, mouse, operating lever etc..

Display unit 840 can be used for display by information input by user or be supplied to the information and electronic equipment of user 800 various graphical user interface, these graphical user interface can by figure, text, icon, video and its arbitrary combination Lai It forms.Display unit 840 may include display panel 841, optionally, may be used LCD (Liquid Crystal Display, Liquid crystal display), the forms such as OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) be configured display Panel 841.Further, touch sensitive surface 831 can be covered on display panel 841, when touch sensitive surface 831 detects on it Or after neighbouring touch operation, processor 880 is sent to determine the type of touch event, is followed by subsequent processing device 880 according to touch The type of event provides corresponding visual output on display panel 841.Although in fig.9, touch sensitive surface 831 and display panel 841 be the component independent as two to realize input and input function, but in some embodiments it is possible to by touch sensitive surface 831 integrate with display panel 841 and realize and output and input function.

Electronic equipment 800 may also include at least one sensor 850, for example, optical sensor, motion sensor and other Sensor.Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein, ambient light sensor can basis The light and shade of ambient light adjusts the brightness of display panel 841, proximity sensor can when electronic equipment 800 is moved in one's ear, Close display panel 841 and/or backlight.As one kind of motion sensor, gravity accelerometer can detect all directions The size of upper (generally three axis) acceleration, can detect that size and the direction of gravity, can be used to identify mobile phone posture when static Application (such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (for example pedometer, strikes Hit) etc.；Gyroscope, barometer, hygrometer, thermometer, infrared ray sensor for can also configure as electronic equipment 800 etc. other Sensor, details are not described herein.

Voicefrequency circuit 860, loud speaker 861, microphone 862 can provide the audio interface between user and electronic equipment 800. The transformed electric signal of the audio data received can be transferred to loud speaker 861, is converted by loud speaker 861 by voicefrequency circuit 860 It is exported for voice signal；On the other hand, the voice signal of collection is converted to electric signal by microphone 862, is connect by voicefrequency circuit 860 Audio data is converted to after receipts, then after audio data output processor 880 is handled, through RF circuits 810 to be sent to another end Audio data is exported to memory 820 to be further processed by end.Voicefrequency circuit 860 is also possible that earphone jack, To provide the communication of peripheral hardware earphone and electronic equipment 800.

Short range wireless transmission module 870 can be WIFI (wireless fidelity, Wireless Fidelity) modules or indigo plant Tooth module etc..Electronic equipment 800 can help user to send and receive e-mail, browse net by short range wireless transmission module 870 Page and access streaming video etc., it has provided wireless broadband internet to the user and has accessed.Although Fig. 9 shows short-distance wireless Transmission module 870, but it is understood that, and must be configured into for electronic equipment 800 is not belonging to, it completely can be as needed It is omitted in the range for the essence for not changing invention.

Processor 880 is the control centre of electronic equipment 800, utilizes various interfaces and the entire electronic equipment of connection Various pieces are stored in by running or performing the software program being stored in memory 820 and/or module and call Data in reservoir 820 perform the various functions of electronic equipment 800 and processing data, so as to carry out whole prison to electronic equipment Control.Optionally, processor 880 may include one or more processing cores；Preferably, processor 880 can integrate application processor And modem processor, wherein, the main processing operation system of application processor, user interface and application program etc., modulatedemodulate Processor is adjusted mainly to handle wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor In 880.

Electronic equipment 800 further includes the power supply 890 (such as battery) powered to all parts, it is preferred that power supply can lead to Cross power-supply management system and processor 880 be logically contiguous, so as to by power-supply management system realize management charging, electric discharge and The functions such as power managed.Power supply 890 can also include one or more direct current or AC power, recharging system, electricity The random components such as source fault detection circuit, power supply changeover device or inverter, power supply status indicator.

Although being not shown, electronic equipment 800 can also include camera, bluetooth module etc., and details are not described herein.Specifically exist In the present embodiment, the display unit of electronic equipment 800 is touch-screen display.

One or more processors；

Memory；With

Play the corresponding audio data of the broadcasting object time stamp.

Optionally, which can also have following function：

Obtain delay time value；

Optionally, the delay time value is to be worked as by the way that preset analogue data to be sent to the display terminal and record Preceding third system time value receives the analogue data that the display terminal returns and records the 4th current system time Value and calculating the 4th system time value and the half of the difference of the third system time value, the delay time of acquisition Value；

Alternatively,

The delay time value is the delay time value that the display terminal is sent.

Optionally, the audio data carries one or more audio time stamps, which can have There is following function：

And/or

Play the corresponding audio data of the audio time stamp.

Optionally, which can also have following function：

Buffered is carried out to the audio data.

The embodiment of the present invention additionally provides a kind of non-volatile readable storage medium, in the storage medium storage there are one or Multiple modules (programs), when which is used in the equipment with audio playing function, can cause The equipment performs the instruction (instructions) of following steps：

Play the corresponding audio data of the broadcasting object time stamp.

Optionally, which can also have following function：

Obtain delay time value；

Alternatively,

The delay time value is the delay time value that the display terminal is sent.

And/or

Play the corresponding audio data of the audio time stamp.

Optionally, which can also have following function：

Buffered is carried out to the audio data.

Figure 11 is a kind of terminal device structure diagram provided in an embodiment of the present invention.Referring to Figure 11, which can For implementing the method that the video data and audio data that are provided in above-described embodiment are played simultaneously.Wherein, the terminal device Can be mobile phone, tablet computer pad, wearable mobile equipment (such as smartwatch).

Terminal device 700 can include communication unit 110, include one or more computer readable storage mediums Memory 120, input unit 130, display unit 140, sensor 150, voicefrequency circuit 160, wireless communication unit 170, packet Include there are one or the processor 180 of more than one processing core and the components such as power supply 190.Those skilled in the art can be with Understand, the terminal device structure shown in Figure 11 does not form the restriction to terminal device, can include more or more than illustrating Few component either combines certain components or different components arrangement.Wherein：

Communication unit 110 can be used for receive and send messages or communication process in, signal sends and receivees, the communication unit 110 Can be RF (Radio Frequency, radio frequency) circuit, router, modem, etc. network communication equipments.Particularly, when When communication unit 110 is RF circuits, after the downlink information of base station is received, transfer at one or more than one processor 180 Reason；In addition, the data for being related to uplink are sent to base station.Usually as communication unit RF circuits include but not limited to antenna, At least one amplifier, tuner, one or more oscillator, subscriber identity module (SIM) card, transceiver, coupler, LNA (Low Noise Amplifier, low-noise amplifier), duplexer etc..In addition, communication unit 110 can also be by wireless Communication communicates with network and other equipment.The wireless communication can use any communication standard or agreement, including but not limited to GSM (Global System of Mobile communication, global system for mobile communications), GPRS (General Packet Radio Service, general packet radio service), CDMA (Code Division Multiple Access, code Point multiple access), WCDMA (Wideband Code Division Multiple Access, wideband code division multiple access), LTE (Long Term Evolution, long term evolution), Email, SMS (Short Messaging Service, short message service) etc.. Memory 120 can be used for storage software program and module, and processor 180 is stored in the software journey of memory 120 by operation Sequence and module, so as to perform various functions application and data processing.Memory 120 can mainly include storing program area and deposit Store up data field, wherein, storing program area can storage program area, the application program needed at least one function (for example broadcast by sound Playing function, image player function etc.) etc.；Storage data field can be stored uses created data (ratio according to terminal device 700 Such as audio data, phone directory) etc..In addition, memory 120 can include high-speed random access memory, can also include non- Volatile memory, for example, at least a disk memory, flush memory device or other volatile solid-state parts.Accordingly Ground, memory 120 can also include Memory Controller, to provide processor 180 and input unit 130 to memory 120 It accesses.

Input unit 130 can be used for receiving the number inputted or character information and generate and user setting and function Control related keyboard, mouse, operating lever, optics or the input of trace ball signal.Optionally, input unit 130 may include touching Sensitive surfaces 131 and other input equipments 132.Touch sensitive surface 131, also referred to as touch display screen or Trackpad are collected and are used Family on it or neighbouring touch operation (such as user using any suitable object such as finger, stylus or attachment in touch-sensitive table Operation on face 131 or near touch sensitive surface 131), and corresponding attachment device is driven according to preset formula.It is optional , touch sensitive surface 131 may include both touch detecting apparatus and touch controller.Wherein, touch detecting apparatus detection is used The touch orientation at family, and the signal that touch operation is brought is detected, transmit a signal to touch controller；Touch controller is from touch Touch information is received in detection device, and is converted into contact coordinate, then gives processor 180, and processor 180 can be received The order sent simultaneously is performed.Furthermore, it is possible to using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves Realize touch sensitive surface 131.In addition to touch sensitive surface 131, input unit 130 can also include other input equipments 132.Optionally, Other input equipments 132 can include but is not limited to physical keyboard, function key (such as volume control button, switch key etc.), It is one or more in trace ball, mouse, operating lever etc..

Display unit 140 can be used for display by information input by user or be supplied to the information and terminal device of user 700 various graphical user interface, these graphical user interface can by figure, text, icon, video and its arbitrary combination Lai It forms.Display unit 140 may include display panel 141, optionally, may be used LCD (Liquid Crystal Display, Liquid crystal display), the forms such as OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) be configured display Panel 141.Further, touch sensitive surface 131 can cover display panel 141, when touch sensitive surface 131 detect on it or near Touch operation after, send to processor 180 with determine touch event type, be followed by subsequent processing device 180 according to touch event Type provides corresponding visual output on display panel 141.Although in fig. 11, touch sensitive surface 131 is with display panel 141 The component independent as two realizes input and input function, but in some embodiments it is possible to by touch sensitive surface 131 with Display panel 141 is integrated and realizes and outputs and inputs function.

Terminal device 700 may also include at least one sensor 150, for example, optical sensor, motion sensor and other Sensor.Optionally, optical sensor may include ambient light sensor and proximity sensor, wherein, ambient light sensor can basis The light and shade of ambient light adjusts the brightness of display panel 141, proximity sensor can when terminal device 700 is moved in one's ear, Close display panel 141 and/or backlight.As one kind of motion sensor, gravity accelerometer can detect all directions The size of upper (generally three axis) acceleration, can detect that size and the direction of gravity, can be used to identify mobile phone posture when static Application (such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (for example pedometer, strikes Hit) etc.；Gyroscope, barometer, hygrometer, thermometer, infrared ray sensor for can also configure as terminal device 700 etc. other Sensor, details are not described herein.

Voicefrequency circuit 160, loud speaker 161, microphone 162 can provide the audio interface between user and terminal device 700. The transformed electric signal of the audio data received can be transferred to loud speaker 161, is converted by loud speaker 161 by voicefrequency circuit 160 It is exported for voice signal；On the other hand, the voice signal of collection is converted to electric signal by microphone 162, is connect by voicefrequency circuit 160 Audio data is converted to after receipts, then after audio data output processor 180 is handled, it is such as another to be sent to through RF circuits 110 Audio data is exported to memory 120 to be further processed by one terminal device.Voicefrequency circuit 160 is also possible that Earphone jack, to provide the communication of peripheral hardware earphone and terminal device 700.

In order to realize wireless communication, wireless communication unit 170 can be configured on the terminal device, the wireless communication unit 170 can be WiFi module.WiFi belongs to short range wireless transmission technology, and unit 170 can by radio communication for terminal device 700 User to be helped to send and receive e-mail, webpage is browsed and accesses streaming video etc., it has provided wireless broadband interconnection to the user Net accesses.Although Figure 11 shows wireless communication unit 170, but it is understood that, and it is not belonging to terminal device 700 It must be configured into, can be omitted in the range for the essence for not changing invention as needed completely.

Processor 180 is the control centre of terminal device 700, utilizes each of various interfaces and connection whole mobile phone Part is stored in memory by running or performing the software program being stored in memory 120 and/or module and call Data in 120 perform the various functions of terminal device 700 and processing data, so as to carry out integral monitoring to mobile phone.It is optional , processor 180 may include one or more processing cores；Preferably, processor 180 can integrate application processor and modulatedemodulate Processor is adjusted, wherein, the main processing operation system of application processor, user interface and application program etc., modem processor Main processing wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 180.

Terminal device 700 further includes the power supply 190 (such as battery) powered to all parts, it is preferred that power supply can lead to Cross power-supply management system and processor 180 be logically contiguous, so as to by power-supply management system realize management charging, electric discharge and The functions such as power managed.Power supply 190 can also include one or more direct current or AC power, recharging system, electricity The random components such as source fault detection circuit, power supply changeover device or inverter, power supply status indicator.

Although being not shown, terminal device 700 can also include camera, bluetooth module etc., and details are not described herein.Specifically exist In the present embodiment, the display unit of terminal device is touch-screen display, terminal device further included memory and one or The more than one program of person, one of them either more than one program be stored in memory and be configured to by one or More than one processor performs the one or more programs and includes the instruction for being operated below：

The audio data of display terminal side transmission is received in mobile equipment side joint；The display terminal side and the mobile equipment Side is connected by way of wireless transmission；

Play the corresponding audio data of the broadcasting object time stamp；The audio data and the video data are institute State the multi-medium data of display terminal reception.

Optionally, which can also have following function：

Obtain delay time value；

Alternatively,

The delay time value is the delay time value that the display terminal is sent.

And/or

Play the corresponding audio data of the audio time stamp.

Optionally, which can also have following function：

Buffered is carried out to the audio data.

Each embodiment in this specification is described by the way of progressive, the highlights of each of the examples are with The difference of other embodiment, between each embodiment identical similar part mutually with reference to.

It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can be provided as method, apparatus or calculate Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code The form of the computer program product of implementation.

The embodiment of the present invention be with reference to according to the method for the embodiment of the present invention, mobile equipment (system) and computer program The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions In each flow and/or block and flowchart and/or the block diagram in flow and/or box combination.These can be provided Computer program instructions are set to the processing movement of all-purpose computer, special purpose computer, Embedded Processor or other programmable datas Standby processor is to generate a machine so that is held by the processor of computer or the mobile equipment of other programmable datas processing Capable instruction generation is used to implement in one flow of flow chart or multiple flows and/or one box of block diagram or multiple boxes The device for the function of specifying.

These computer program instructions, which may also be stored in, can guide computer or other programmable datas to handle mobile equipment In the computer-readable memory to work in a specific way so that the instruction being stored in the computer-readable memory generates packet The manufacture of command device is included, which realizes in one flow of flow chart or multiple flows and/or one side of block diagram The function of being specified in frame or multiple boxes.

These computer program instructions can be also loaded into computer or the mobile equipment of other programmable datas processing so that Series of operation steps are performed on computer or other programmable movement equipment to generate computer implemented processing, thus The instruction offer performed on computer or other programmable movement equipment is used to implement in one flow of flow chart or multiple flows And/or specified in one box of block diagram or multiple boxes function the step of.

Although the preferred embodiment of the embodiment of the present invention has been described, those skilled in the art once know base This creative concept can then make these embodiments other change and modification.So appended claims are intended to be construed to Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.

Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation Between there are any actual relationship or orders.Moreover, term " comprising ", "comprising" or its any other variant meaning Covering non-exclusive inclusion, so that process, method, article including a series of elements or mobile equipment are not only wrapped Those elements are included, but also including other elements that are not explicitly listed or are further included as this process, method, article Or the element that movement equipment is intrinsic.In the absence of more restrictions, it is wanted by what sentence "including a ..." limited Element, it is not excluded that also there are other identical elements in the process including the element, method, article or mobile equipment.

Method, one kind that a kind of video data and audio data provided above to the embodiment of the present invention is played simultaneously regard The device and a kind of equipment that frequency evidence and audio data are played simultaneously are described in detail, specific case pair used herein The principle and embodiment of the embodiment of the present invention is expounded, and the explanation of above example is only intended to help to understand the present invention The method and its core concept of embodiment；Meanwhile for the think of of those of ordinary skill in the art, according to the present invention embodiment Think, in specific embodiments and applications there will be changes, in conclusion the content of the present specification should not be construed as pair The limitation of the embodiment of the present invention.

Claims

1. a kind of method that video data and audio data are played simultaneously, which is characterized in that including：

It identifies from the vod server acquisition communicated with the display terminal side is corresponding and regards according to the multi-medium data Frequency evidence；

Multi-medium data mark is sent to mobile equipment side；The mobile equipment side is used for according to the multi-medium data Mark from the corresponding audio data of vod server acquisitions communicated with the display terminal side, the display terminal side and The mobile equipment side is connected by way of wireless transmission；

When playing the video data, object time stamp is played according to currently playing video time stamp generation；The broadcasting Object time stamp includes the corresponding video of current video data that the display terminal side is extracted when playing the video data Timestamp and delay time value；Delay time value data transmission between the display terminal side and the mobile equipment side The time of delay；

The broadcasting object time stamp is sent to mobile equipment side；When the mobile equipment side is for playing the broadcasting target Between stab corresponding audio data.

2. according to the method described in claim 1, it is characterized in that, the mode of the wireless transmission includes following one kind or more Kind：

3. according to the method described in claim 1, it is characterized in that, the broadcasting object time stamp includes the display terminal side The corresponding video time stamp of current video data extracted when playing the video data.

4. according to the method described in claim 1, it is characterized in that, the delay time value is by by preset analogue data It is sent to the mobile equipment and records current the first system time value, receive the simulation number that the mobile equipment returns According to and record current second system time value and calculate the second system time value and the first system time value The half of difference, the delay time value of acquisition；

Alternatively,

5. method according to any one of claims 1 to 4, which is characterized in that it is described according to multi-medium data mark from After the vod server obtains the step of corresponding video data, further include：

Buffered is carried out to the video data.

6. according to the method described in claim 1, it is characterized in that, multi-medium data mark includes the text of multi-medium data Part title and/or, the file address of multi-medium data.

7. a kind of method that video data and audio data are played simultaneously, which is characterized in that including：

The multi-medium data mark of display terminal side transmission is received in mobile equipment side joint；The multi-medium data is from display terminal side It is extracted in the playing request of reception, the display terminal side is used to identify from mutual with display terminal according to the multi-medium data The vod server of communication obtains video data；The display terminal side is with the mobile equipment side by way of wireless transmission Connection；

According to the multi-medium data mark audio data is obtained from the vod server communicated with the mobile equipment；

Receive the broadcasting object time stamp that the display terminal side is sent；Reproduction time stamp is the display terminal described in broadcasting During video data, the timestamp according to currently playing video time stamp generation；The broadcasting object time stamp includes described aobvious Show the corresponding video time stamp of current video data and delay time value that end side is extracted when playing the video data；Institute State the time of delay time value data transfer delay between the display terminal side and the mobile equipment side；

Play the corresponding audio data of the broadcasting object time stamp.

8. the method according to the description of claim 7 is characterized in that the mode of the wireless transmission includes following one kind or more Kind：

9. the method according to the description of claim 7 is characterized in that the broadcasting object time stamp includes the display terminal side The corresponding video time stamp of current video data extracted when playing the video data.

10. according to the method described in claim 9, it is characterized in that, in the broadcasting for receiving the display terminal side and sending After the step of object time stabs, the method further includes：

Obtain delay time value；

11. according to the method described in claim 10, it is characterized in that, the delay time value is by by preset simulation number According to being sent to the display terminal and recording current third system time value, the simulation that the display terminal returns is received Data simultaneously record the 4th current system time value and calculate the 4th system time value and the third system time value Difference half, the delay time value of acquisition；

Alternatively,

The delay time value is the delay time value that the display terminal is sent.

12. according to claim 7 to 11 any one of them method, which is characterized in that the audio data carry there are one or Multiple audio time stamps；

When currently playing audio time stamp is more than the broadcasting object time stamp, pause playing audio-fequency data is until currently broadcast The audio time stamp put is equal to the broadcasting object time stamp；

And/or

When currently playing audio time stamp is less than or equal to the broadcasting object time stamp, searches and be equal to the broadcasting target The audio time stamp of timestamp；

Play the corresponding audio data of the audio time stamp.

13. according to claim 7 to 11 any one of them method, which is characterized in that in the broadcasting broadcasting target Between before the step of stabbing corresponding audio data, the method further includes：

Buffered is carried out to the audio data.

14. the method according to the description of claim 7 is characterized in that multi-medium data mark includes multi-medium data File name and/or, the file address of multi-medium data.

15. a kind of device that video data and audio data are played simultaneously, which is characterized in that including：

Multi-medium data identifies receiving module, for receiving multi-medium data playing request in display terminal side joint；The broadcasting please It asks and is identified including multi-medium data；

Video data acquisition module, for being identified according to the multi-medium data from the point communicated with the display terminal side It broadcasts server and obtains corresponding video data；

Multi-medium data identifies sending module, for multi-medium data mark to be sent to mobile equipment side；The movement Equipment side is used to identify from the vod server acquisition pair communicated with the display terminal side according to the multi-medium data The audio data answered, the display terminal side are connect with the mobile equipment side by way of wireless transmission；

Object time stamp generation module is played, for when playing the video data, according to currently playing video time stamp Generation plays object time stamp；The broadcasting object time stamp includes the display terminal side and is carried when playing the video data The corresponding video time stamp of current video data and delay time value taken；The delay time value for the display terminal side with The time of data transfer delay between the mobile equipment side；

Object time stamp sending module is played, for the broadcasting object time stamp to be sent to mobile equipment side；The movement Equipment side is used to play the corresponding audio data of the broadcasting object time stamp.

16. device according to claim 15, which is characterized in that the mode of the wireless transmission include following one kind or It is a variety of：

17. device according to claim 15, which is characterized in that the broadcasting object time stamp includes the display terminal The corresponding video time stamp of current video data that side is extracted when playing the video data.

18. device according to claim 15, which is characterized in that the delay time value is to send out preset analogue data It send to the mobile equipment and records current the first system time value, receive the analogue data that the mobile equipment returns And record current second system time value and, calculate the second system time value and the first system time value The half of difference, the delay time value of acquisition；

Or；

19. according to claim 15 to 18 any one of them device, which is characterized in that further include：

First buffer module, for carrying out buffered to the video data.

20. device according to claim 15, which is characterized in that the multi-medium data mark includes multi-medium data File name and/or, the file address of multi-medium data.

21. a kind of device that video data and audio data are played simultaneously, which is characterized in that including：

Multi-medium data identifies receiving module, for receiving the multi-medium data mark of display terminal side transmission in mobile equipment side joint Know；The multi-medium data is extracted from the playing request that display terminal side joint is received, and the display terminal side is used for according to described in Multi-medium data mark obtains video data from the vod server communicated with display terminal；The display terminal side and institute Mobile equipment side is stated to connect by way of wireless transmission；

Audio data acquisition module, for being identified according to the multi-medium data from the program request communicated with the mobile equipment Server obtains audio data；

Object time stamp receiving module is played, for receiving the broadcasting object time stamp that the display terminal side is sent；During broadcasting Between stamp be the display terminal when playing the video data, the timestamp according to currently playing video time stamp generation； The broadcasting object time stamp includes the current video data pair that the display terminal side is extracted when playing the video data The video time stamp and delay time value answered；The delay time value is between the display terminal side and the mobile equipment side The time of data transfer delay；

22. device according to claim 21, which is characterized in that the mode of the wireless transmission include following one kind or It is a variety of：

23. device according to claim 21, which is characterized in that the broadcasting object time stamp includes the display terminal The corresponding video time stamp of current video data that side is extracted when playing the video data.

24. device according to claim 23, which is characterized in that further include：

Delay time value acquisition module, for obtaining delay time value；

Delay time value increases module, for increasing the delay time in the time value of the broadcasting object time stamp instruction Value.

25. device according to claim 24, which is characterized in that the delay time value is by by preset simulation number According to being sent to the display terminal and recording current third system time value, the simulation that the display terminal returns is received Data simultaneously record the 4th current system time value and calculate the 4th system time value and the third system time value Difference half, the delay time value of acquisition；

Alternatively,

The delay time value is the delay time value that the display terminal is sent.

26. according to claim 21 to 24 any one of them device, which is characterized in that the audio data carry there are one or Multiple audio time stamps；The audio data playing module includes：

Pause plays submodule, for when currently playing audio time stamp is more than the broadcasting object time stamp, pause to be broadcast Audio data is put until currently playing audio time stamp is equal to the broadcasting object time stamp；

And/or

Submodule is searched, for when currently playing audio time stamp is less than or equal to the broadcasting object time stamp, searching Equal to the audio time stamp of the broadcasting object time stamp；

27. according to claim 21 to 24 any one of them device, which is characterized in that further include：

Second buffer module, for carrying out buffered to the audio data.

28. device according to claim 21, which is characterized in that the multi-medium data mark includes multi-medium data File name and/or, the file address of multi-medium data.

29. the system that a kind of video data and audio data are played simultaneously, which is characterized in that the display including communicating is whole End, mobile equipment and vod server；

The display terminal, for receiving multi-medium data playing request, according to the playing request to the vod server It sends video data and obtains request；The playing request is identified including multi-medium data；

The mobile equipment, for receiving the multi-medium data mark that the display terminal is sent, and according to the multimedia number Audio data is sent to the vod server obtain request according to mark；

The vod server, for obtaining request and audio data acquisition request according to the video data, respectively to described Display terminal and mobile equipment return to corresponding video data and audio data；

The display terminal is additionally operable to play the video data, and the time generated according to currently playing video time stamp Stamp, and it is sent to the mobile equipment；The mobile equipment is additionally operable to play the corresponding audio data of object time stamp； The broadcasting object time stamp includes the current video data pair that the display terminal side is extracted when playing the video data The video time stamp and delay time value answered；The delay time value is between the display terminal side and the mobile equipment side The time of data transfer delay.

30. a kind of equipment that video data and audio data are played simultaneously, which is characterized in that including：

One or more processors；

Memory；With

One or more modules, one or more of modules be stored in the memory and be configured to by one or Multiple processors perform, wherein, one or more of modules have following function：

31. a kind of equipment that video data and audio data are played simultaneously, which is characterized in that including：

One or more processors；

Memory；With

Play the corresponding audio data of the broadcasting object time stamp.