CN103905877A - Playing method of audio data and video data, smart television set and mobile equipment - Google Patents
Playing method of audio data and video data, smart television set and mobile equipment Download PDFInfo
- Publication number
- CN103905877A CN103905877A CN201410093272.0A CN201410093272A CN103905877A CN 103905877 A CN103905877 A CN 103905877A CN 201410093272 A CN201410093272 A CN 201410093272A CN 103905877 A CN103905877 A CN 103905877A
- Authority
- CN
- China
- Prior art keywords
- display terminal
- data
- time information
- mobile device
- reproduction time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a playing method of audio data and video data, a smart television set and mobile equipment. The method includes the steps that an audio and video file is received by a display terminal; the video data and the compressed audio data are read from the audio and video file; the compressed audio data are sent to the mobile equipment, wherein the compressed audio data are used for being decompressed and played on the mobile equipment; target playing time information sent by the mobile equipment is received, wherein the target playing time information is generated by the mobile equipment according to the current audio playing time information; the video data are played according to the target playing time information. By means of the playing method of the audio data and the video data, the smart television set and the mobile equipment, delay between the audio data and the video data is avoided, and synchronization performance of the audio data and the video data is improved.
Description
Technical field
The application relates to audio frequency and video play-back technology field, particularly relates to a kind of player method, intelligent television and mobile device of audio, video data.
Background technology
Along with supporting player universal of various media, more and more media file synchronization is play to obtain better appreciation effect and artistic effect, wherein displaying video, music appreciating, browsing pictures are the media executive modes of extensive use.
Take intelligent television equipment as example, intelligent television comprises intelligent television and Intelligent set top box, can carry out by program request the broadcasting of multi-medium data.In some cases, for example, in the situations such as household's rest at night, for avoiding disturbing other people, guarantee viewing and admiring multi-medium data simultaneously, user may wish the voice data when wearing earphone and listen to intelligent television device plays video, to substitute the device plays sound of raising one's voice of intelligent television equipment.
Wear earphone and conventionally have two kinds of solutions: a kind of method is to connect intelligent television with wired earphone; Another kind method is for supporting the equipment of bluetooth earphone, connects intelligent television with bluetooth earphone.
In first method, wired earphone to be inserted in intelligent television equipment, and because the common distance users viewing location of intelligent television equipment is distant, therefore need the line of wired earphone very long, plug is also inconvenient.In addition, user, in the time carrying out other action, may also need to drag long line, and operation is brought inconvenience.
Second method needs user to buy bluetooth earphone, and its cost is higher; And, the problem that bluetooth earphone there will be sound conversation structure to postpone conventionally, it is very poor that user experiences.
In a word, need the urgent technical problem solving of those skilled in the art how to improve the net synchronization capability of audio, video data.
Summary of the invention
The application's technical problem to be solved is to provide a kind of player method, intelligent television and mobile device of audio, video data, can improve the net synchronization capability of audio, video data.
In order to address the above problem, the application discloses a kind of player method of audio, video data, comprising: display terminal receives audio-video document; The voice data of reading video data and compression from audio-video document; The voice data of compression is sent to mobile device, and wherein, the voice data of compression is for being extracted the broadcasting of contracing at mobile device place; Receive the target reproduction time information that mobile device sends, wherein target reproduction time information is that mobile terminal is according to current audio frequency reproduction time Information generation; According to target reproduction time information, playing video data.
Preferably, target reproduction time information comprises: the audio frequency reproduction time information corresponding to voice data of current broadcasting, or the correction value in audio frequency reproduction time and propagation delay time, wherein, the propagation delay time is the propagation delay time of link between display terminal and mobile device.
Preferably, according to target reproduction time information, before playing video data, said method also comprises: the propagation delay time of measuring link between display terminal and mobile device; According to target reproduction time information, playing video data, comprising: according to target reproduction time and propagation delay time, playing audio-fequency data.
Preferably, measure the propagation delay time of link between display terminal and mobile device, comprising: send test data to mobile device, and record the current very first time; Receive the test data that mobile device sends, and record the second current time, wherein, test data after arriving mobile device immediately mobile device send it back display terminal; The difference of the second time and the very first time, divided by 2, is obtained to the propagation delay time.
Preferably, before playing video data, said method also comprises: buffering audio, video data.
Preferably, between display terminal and mobile device, one of at least carry out in the following manner the transmission of data: Ethernet, bluetooth, 2.4G network transmission technology, infrared ray and wireless network protocol ZigBee.
In order to address the above problem, the application discloses a kind of player method of audio, video data, comprise: mobile device receives the voice data of the compression of display terminal transmission, wherein, the voice data of compression is that display terminal reads out from the audio-video document receiving, and the video data in audio-video document is play at display terminal place; The voice data compressing decompresses; Play the voice data after decompressing, and record current audio frequency reproduction time information; According to audio frequency reproduction time information, generate target reproduction time information; Target reproduction time information is sent to display terminal, and wherein, target reproduction time information is for the foundation as playing video data at display terminal place.
Preferably, target reproduction time information comprises: the audio frequency reproduction time information corresponding to voice data of current broadcasting.
Preferably, according to audio frequency reproduction time information, before generating target reproduction time information, said method also comprises: the propagation delay time of measuring link between display terminal and mobile device; According to audio frequency reproduction time information, generate target reproduction time information, comprising: use the propagation delay time to revise audio frequency reproduction time information, obtain target reproduction time information.
Preferably, measure the propagation delay time of link between display terminal and mobile device, comprising: send test data to display terminal, and record the current very first time; Receive the test data that display terminal sends, and record the second current time, wherein, test data is shown immediately terminal and sends it back mobile device after arriving display terminal; The difference of the second time and the very first time, divided by 2, is obtained to the propagation delay time.
Preferably, between display terminal and mobile device, one of at least carry out in the following manner the transmission of data: Ethernet, bluetooth, 2.4G network transmission technology, infrared ray and wireless network protocol ZigBee.
In order to address the above problem, the application discloses a kind of display terminal, comprising: receiver module, for receiving audio-video document; Read module, for the voice data from audio-video document reading video data and compression; Sending module, for the voice data of compression is sent to mobile device, wherein, the voice data of compression is for being extracted the broadcasting of contracing at mobile device place; The target reproduction time information that receiver module also sends for receiving mobile device, wherein, target reproduction time information is that mobile terminal is according to current audio frequency reproduction time Information generation; Playing module, for according to target reproduction time information, playing video data.
In order to address the above problem, the application discloses a kind of mobile device, comprise: receiver module, be used for the voice data of the compression that receives display terminal transmission, wherein, the voice data of compression is that display terminal reads out from the audio-video document receiving, and the video data in audio-video document is play at display terminal place; Decompression module, for the voice data of the compression that decompresses; Playing module, for playing the voice data after decompressing, and records current audio frequency reproduction time information; Generation module, for according to audio frequency reproduction time information, generates target reproduction time information; Sending module, for target reproduction time information is sent to display terminal, wherein, target reproduction time information is for the foundation as playing video data at display terminal place.
Compared with prior art, the application has the following advantages:
In the prior art, while answering voice data by bluetooth earphone, display terminal need to decompress the voice data receiving, compress by bluetooth module again, and then be transferred to bluetooth earphone, compression and decompression action has repeatedly expended a lot of time, can make voice data compare slowed-down video.And in this application, the voice data of the compression receiving is directly sent to mobile device by display terminal, with respect to prior art, save the step that decompresses and compress by bluetooth module, save the transmission time of voice data, thereby avoid the delay between voice data and video data, improved the net synchronization capability of audio, video data.
In addition, in prior art, mobile device and display terminal can't transmit the temporal information of played data separately, like this, are easy to cause voice data and video data to play asynchronous.And in this application, the temporal information of playing audio-fequency data is sent to display terminal by mobile device, display terminal is play corresponding video data according to this information, thereby has improved the net synchronization capability of audio, video data.
Accompanying drawing explanation
Fig. 1 shows the principle schematic of the synchronous playing video data of a kind of display terminal and voice data;
Fig. 2 shows a kind of display terminal and synchronizes the principle schematic of playing video data and voice data with bluetooth earphone;
Fig. 3 shows the flow chart of the player method embodiment 1 of a kind of audio, video data of the present invention;
Fig. 4 shows the flow chart of the player method embodiment 2 of a kind of audio, video data of the present invention;
Fig. 5 shows the flow chart of the player method embodiment 3 of a kind of audio, video data of the present invention;
Fig. 6 shows the structured flowchart of a kind of display terminal embodiment of the present invention;
Fig. 7 shows the preferred structured flowchart of a kind of display terminal embodiment of the present invention;
Fig. 8 shows the structured flowchart of a kind of mobile device of the present invention;
Fig. 9 shows the preferred structured flowchart of a kind of mobile device of the present invention.
Embodiment
For the above-mentioned purpose, the feature and advantage that make the application can become apparent more, below in conjunction with the drawings and specific embodiments, the application is described in further detail.
With reference to Fig. 1, show a kind of schematic diagram of audio, video data playing principles.As shown in Figure 1, after process video request program, the audio, video data read module in display terminal reads multi-medium data, that is, audio, video data, then, decodes and obtain video data and the voice data of compression.Audio frequency and video decompression module decompresses to video data and the voice data of compression, then, the video data transmitting after decompressing is delivered to video output module, and the voice data after decompressing is sent to audio frequency output module.The Voice & Video data of order video file are transported to audio frequency output module and audio frequency display module take frame as unit, the corresponding reproduction time stamp of every frame data.Audio frequency output module and video display module contrast reproduction time stamp and the time point of playing in synchronization module, and data are pushed to loud speaker and display on time.
But, in some cases, for example, in household's rest at night, for avoiding disturbing other people, voice data when user may wish to listen to intelligent television device plays multi-medium data by earphone.
For addressing the above problem, can apply voice data when bluetooth earphone is long-range listens to intelligent television device plays multi-medium data.
In bluetooth applications, blue tooth products is distinguished device type and COS.
Generally speaking, device type comprises main equipment type and auxiliary equipment type, has stipulated that bluetooth equipment belongs to the equipment of which type, as earphone, mobile phone, printer etc.Take mobile phone as example, by auxiliary equipment type stated be smart mobile phone or regular handset.
COS has stipulated the service that bluetooth equipment can provide.Take mobile phone as example, some mobile phones are supported OPP(object storage specification, Object Push Profile) and FTP(File Transfer Protocol, file transfer protocol (FTP)) two kinds of file transfer services, some mobile phones only provide OPP service, two bluetooth equipments are wanted mutual communication, equipment class can be different, as mobile phone and earphone, but the service agreement of bluetooth equipment must be consistent, because need earphone that voice service is provided, finds earphone by mobile phone, can or to inquire what service it can provide before connection, and then carry out communication.
Mobile device, for example smart mobile phone, Intelligent flat etc., although bluetooth enable, belongs to blue tooth products, its device type is not earphone, bluetooth earphone service ability can not be provided, and the bluetooth module that therefore cannot serve as in the shown terminal of earphone connects and the use of propelling movement voice data.
Therefore, if the voice data while wanting to listen to intelligent television device plays multi-medium data by bluetooth earphone needs additionally to buy bluetooth earphone.
With reference to Fig. 2, show a kind of schematic diagram of audio, video data playing principles.Wherein use bluetooth earphone playing audio-fequency data.As shown in Figure 2, display terminal is connected with bluetooth earphone by Bluetooth link.Audio, video data read module in display terminal reads multi-medium data, , audio, video data, then, read the video data and the voice data that obtain compression, then audio, video data decompression module decompresses to video data and the voice data of compression, obtain voice data and video data after decompressing, and the video data transmitting after decompressing is delivered to video output module, to play on display, after voice data after decompressing is compressed by Bluetooth audio frequency compression module, be sent to bluetooth earphone by Bluetooth audio frequency sending module.Bluetooth audio frequency receiver module in bluetooth earphone receives the voice data that display terminal sends, and is then sent to audio frequency output module, and then exports earphone speaker to and play.
Voice data is read rear decompressed from order video file, has then re-started after compression according to the audio format of Bluetooth protocol support, then has been transferred to earphone, and this has increased time delay.
In prior art, mobile device and display terminal can't transmit the temporal information of played data separately, like this, are easy to cause voice data and video data to play asynchronous.
Based on the demand, inventor proposes one of core idea of the embodiment of the present invention, display terminal reads out after the voice data of compression, the voice data of compression is directly transferred to mobile device, without the compression process through decompression and Bluetooth audio frequency compression module, save propagation delay time, reduced the propagation delay time between voice data and video data, thereby improved the net synchronization capability of audio, video data.And the temporal information of playing audio-fequency data is sent to display terminal by mobile device, display terminal is play corresponding video data according to this information, and this has further improved the net synchronization capability of audio, video data.
With reference to Fig. 3, show the player method of a kind of audio, video data of the application, the method comprises:
It should be noted that, display terminal can comprise intelligent television, PC, palmtop PC or mobile device etc., and intelligent television can comprise LCD(Liquid Crystal Display, liquid crystal display) TV, LED(Light Emitting Diode, light-emitting diode) TV, 3D TV or plasm TV etc., the embodiment of the present invention is not limited this.
Audio-video document can be digital television signal, can, for being stored in the multi-medium data on display terminal or peripheral equipment disk, can be stream medium data, and the embodiment of the present invention is not limited this.
Display terminal, after receiving audio-video document, can be decoded, to obtain the video data of compression and the voice data of compression.Wherein, the video data of compression can decompress in display terminal side, then shows by display device.
It should be noted that, mobile device can be the various mobile devices such as panel computer, personal digital assistant (Personal Digital Assistant, PDA), mobile phone, and the embodiment of the present invention is not restricted this.
In embodiments of the present invention, display terminal can and mobile device between set up wireless data transmission link, realize the transmission of voice data and other information by this link.In a kind of preferred exemplary of the embodiment of the present invention, the connected mode of data transmission link can comprise following one or more:
Ethernet;
In this example, the transmission link between display terminal and mobile device can be Ethernet (Ethernet) link, and display terminal side can be sent to mobile device side by described voice data by the transmission means of Ethernet.
Ethernet (Ethernet) is a kind of LAN (Local Area Network) networking technology, adopts passive medium, diffuses information by broadcast mode.It has stipulated physical layer and data link layer protocol, has stipulated the interface of physical layer and data link layer and data link layer and more high-rise interface.Its standard topology structure is bus-type topology, but current Fast Ethernet (100BASE-T, 1000BASE-T standard) in order farthest to reduce conflict, farthest improve network speed and service efficiency, use switch (Switch hub) to carry out network connection and tissue, like this, it is star-like that the topological structure of Ethernet has just become, but logically, it is csma/cd that Ethernet still uses bus-type topological sum CSMA/CD(Carrier Sense Multiple Access/Collision Detect) bus conflict technology.
In this example, application Ethernet, can be created in for mono-of WiFi(the WLAN equipment of IEEE802.11 standard, also become wireless emulation), display terminal and mobile device are being connected into after same local area network (LAN), can pass through IP(Internet Protocol, the agreement interconnecting between network) TCP/IP(Transmission Control Protocol/Internet Protocol for address, transmission control protocol/Internet Interconnection agreement, has another name called network communication protocol) agreement initiation connection.
Bluetooth;
In this example, the transmission link between display terminal and mobile device can be Bluetooth link, and display terminal side can be sent to mobile device side by described voice data by the transmission means of bluetooth.
Bluetooth is the radiotechnics of a kind of support equipment short haul connection (in general 10m).Can comprise mobile phone, PDA, wireless headset, notebook computer, be correlated with and carry out wireless messages exchange between numerous equipment such as peripheral hardware.
" bluetooth " technology of utilization, can simplify the communication between mobile communication terminal device effectively, also communicating by letter between simplified apparatus and internet Internet successfully, thus transfer of data becomes more rapidly efficiently, is radio communication widening road.
Bluetooth adopts distributed network structure and fast frequency hopping and short packet technology, supports point-to-point and point-to-multipoint delivery, is operated in the i.e. industry of 2.4GHzISM(, science, the medical science of global general-use) frequency range.Its data rate is 1Mbps.Adopt time division duplex transmission scheme to realize full duplex transmission.
In this example, the agreement corresponding according to bluetooth, mobile device can be found equipment around, then lists device id and name list, then selects to need the display terminal of connection, connects.
It should be noted that, in this example, mobile device, for example smart mobile phone, Intelligent flat etc., bluetooth enable, belong to blue tooth products, its device type can be display terminal, and blue-teeth data transmittability between display terminal can be provided, and the bluetooth module therefore can be used as in the shown terminal of voice data receiving terminal connects and the use of propelling movement voice data.
2.4G wireless network;
In this example, the transmission link between display terminal and mobile device can be 2.4G wireless network links, and display terminal side can be sent to mobile device side by described voice data by the transmission means of 2.4G wireless network.
2.4G wireless network frequency range belongs to ISM band, and it is the ultralow radiation environmental protection frequency range being widely used in global range; There are 125 communication channels, because the communication of 2.4G wireless network is more unobstructed, can phase mutual interference between multiple communication instructions; 2.4G wireless mesh bandwidth passes that speed is the highest can reach 108Mbps, and therefore its transmission speed is very fast; Its transmission range is (open field: 200m effective propagation path) far away relatively, and the not impact of the side of being transmitted, and supports two-way communication.
Infrared ray;
In this example, the transmission link between display terminal and mobile device can be infrared link, and display terminal side can be sent to mobile device side by described voice data by ultrared transmission means.
Infrared is ultrared abbreviation, is a kind of wireless communication mode, can carry out the transmission of wireless data.Infrared interface is the configuration standard of mobile phone of new generation, its supports mobile phone and computer and other digital devices to carry out data exchange. infrared communication has feature with low cost, easy to connect, to be simple and easy to use and compact conformation, therefore in small-sized mobile device, obtains a wide range of applications.By infrared interface, all kinds of mobile devices can freely carry out exchanges data.
Wireless network protocol ZigBee.
In this example, the transmission link between display terminal and mobile device can be ZigBee link, and display terminal side can be sent to mobile device side by described voice data by the transmission means of wireless network protocol ZigBee.
Zigbee is the wireless network protocol of a kind of low speed short-distance transmission based on IEEE802.15.4 standard.Agreement is respectively physical layer (PHY), MAC layer (MAC), transport layer (TL), network layer (NWK), application layer (APL) etc. from top to bottom.Wherein physical layer and MAC layer are followed the regulation of IEEE802.15.4 standard.
ZigBee-network main feature is low-power consumption, low cost, low rate, support great deal of nodes, support multiple network topology, low complex degree, quick, reliable, safety.The Three roles such as the be divided into telegon of equipment in ZigBee-network (Coordinator), aggregation node (Router), sensor node (EndDevice).
Certainly, above-mentioned transmission means, just as example, in the time implementing the embodiment of the present invention, can arrange other transmission meanss according to actual conditions, as long as can realize being connected of wireless transmission of display terminal and mobile device, the embodiment of the present invention is not limited this.In addition, except above-mentioned transmission means, those skilled in the art can also adopt other transmission means according to actual needs, and the embodiment of the present invention is not also limited this.
In actual applications, can in the time that making, add audio-video document the timestamp that is used to indicate time point information.Voice data can carry one or more audio time stamp, and video data can carry one or more video time stamp.Audio time stamp can refer to the time point data that a section audio will be played, video time stamp can refer to the time point data that a frame picture will be played, on some time points of multi-medium data, audio time stamp and video time stamp can equate, the timestamp adding when its essence can be made for multi-medium data.For example, audio time stamp can indicate a certain section audio to export broadcasting at how many milliseconds, and video time stamp can indicate a certain frame picture to export broadcasting at how many milliseconds.In actual applications, the audio time stamp of the video time stamp of the first frame picture and first paragraph audio frequency can be 0, and video time stamp below and audio time stamp can increase with identical interval time.
Therefore,, in the time of mobile device playing audio-fequency data, can generate and play object time stamp according to the audio time stamp of current broadcasting.Mobile device is in the time carrying out the broadcasting of voice data, and, to display terminal, display terminal is according to this audio frequency broadcast information playing video data can constantly to send audio frequency broadcast information (for example, playing object time stamp).
More or less can there is certain delay in the transfer of data between display terminal and mobile device, for improving the precision of synchronous broadcasting, the embodiment of the present invention, in the time of video data and voice data synchronous, it is also conceivable that the delay of transmission.
For example, measure the propagation delay time of link between display terminal and mobile device; Use the propagation delay time to revise audio frequency reproduction time information, obtain target reproduction time information.The audio time stamp (audio frequency reproduction time information) that current voice data is corresponding is t
a, the propagation delay time is Δ t, plays object time stamp (target reproduction time information) t
a＇=t
a+ Δ t.
In embodiments of the present invention, can measure the propagation delay time between display terminal and mobile device in advance or in real time; Can be that display terminal is initiatively measured, also can obtain from mobile device, the embodiment of the present invention not be limited this.For example, when display terminal and mobile device are in the time being connected for the first time, display terminal or mobile device are initiatively initiated the measurement in propagation delay time, after measurement finishes, the mark of the mark of display terminal, mobile device, transmission means and propagation delay time are stored in display terminal and/or mobile device.When display terminal with mobile device in the time being again connected, when mark, the mark of mobile device, the transmission means of display terminal are when the match is successful, can directly from display terminal and/or mobile device, obtain the propagation delay time of formerly measuring.
In a kind of preferred exemplary of the embodiment of the present invention, propagation delay time by test data (for example can be, analogue data) be sent to described mobile device and record the current very first time, the test data that reception mobile device returns also records the second current time, and, calculate the second time and the described very first time difference 1/2nd, the propagation delay time of acquisition.
In actual applications, analogue data can be the data of arbitrary format.And the size of the time-delay value of transfer of data and transmission data has relation, therefore time point data of the size of analogue data and actual transmission are the same.In this example, test data can and two audio time stamp between the size of voice data the same.
Display terminal is sent to test data after mobile device, mobile device need to return to test data immediately to display terminal, display terminal calculate analogue data from send to reception time difference (being the difference of the very first time and the second time) 1/2nd, obtain the propagation delay time.
Be T when the very first time
1, the second time was T
2time, time of delay Δ t=(T
2-T
1)/2.
Certainly, the embodiment of the present invention can also be calculated repeatedly analogue data from sending to the mean value of time difference of reception, obtains delay time value, to reduce error.
The embodiment of the present invention is added the propagation delay time in broadcasting object time stamp, has eliminated the impact in the delay of transmission broadcasting object time stamp of display terminal and mobile device, has further improved the precision that voice data and video data are synchronously play.
In this example, propagation delay time can be for mobile device be by being sent to display terminal by preset test data and recording the 3rd current time, the test data that reception display terminal returns also records the 4th current time, and calculate the 4th time and the 3rd time difference 1/2nd, the delay time value of acquisition.
In addition, device interior may have propagation delay time, and these time delays also can measure in advance, and after being compensated, then carry out the broadcasting of voice data.
People's naked eyes resolution capability is generally 1/24 second, if video data and voice data exist the difference of smiling in the time playing, people can obviously not feel.Therefore in another kind of situation, for reducing the resource occupation of display terminal or mobile device, for example, in the time that the propagation delay time is less than a predetermined threshold value (40ms), the embodiment of the present invention, in the time of video data and voice data synchronous, can not considered the delay of transmission.
In embodiments of the present invention, before playing video data, display terminal can cushion audio, video data.
In the prior art, while answering voice data by bluetooth earphone, display terminal need to decompress the voice data receiving, compress by bluetooth module again, and then be transferred to bluetooth earphone, compression and decompression action has repeatedly expended a lot of time, can make voice data compare slowed-down video.And in this application, the voice data of the compression receiving is directly sent to mobile device by display terminal, with respect to prior art, save the step that decompresses and compress by bluetooth module, save the transmission time of voice data, thereby avoid the delay between voice data and video data, improved the net synchronization capability of audio, video data.In addition, mobile device is the product that public use frequency is very high, the multiplexing mobile device of the embodiment of the present invention, and one-object-many-purposes, has avoided extra purchase bluetooth earphone, practical, greatly reduces cost.
In addition, in prior art, mobile device and display terminal can't transmit the temporal information of played data separately, like this, are easy to cause voice data and video data to play asynchronous.And in this application, the temporal information of playing audio-fequency data is sent to display terminal by mobile device, display terminal is play corresponding video data according to this information, thereby has improved the net synchronization capability of audio, video data.
Referring to Fig. 4, show a kind of player method of audio, video data, the method comprises:
It should be noted that, display terminal can comprise intelligent television, PC, palmtop PC or mobile device etc., and intelligent television can comprise LCD(Liquid Crystal Display, liquid crystal display) TV, LED(Light Emitting Diode, light-emitting diode) TV, 3D TV or plasm TV etc., the embodiment of the present invention is not limited this.Mobile device can be the various mobile devices such as panel computer, personal digital assistant (Personal Digital Assistant, PDA), mobile phone, and the embodiment of the present invention is not restricted this.
Audio-video document can be digital television signal, can, for being stored in the multi-medium data on display terminal or peripheral equipment disk, can be stream medium data, and the embodiment of the present invention is not limited this.
In actual applications, can in the time that making, add audio-video document the timestamp that is used to indicate time point information.
In embodiments of the present invention, display terminal can and mobile device between set up data transmission link.In a kind of preferred exemplary of the embodiment of the present invention, the mode of described wireless transmission can comprise following one or more: Ethernet, bluetooth, 2.4G network transmission technology, infrared ray and wireless network protocol ZigBee.
Certainly, above-mentioned transmission means, just as example, in the time implementing the embodiment of the present invention, can arrange other transmission meanss according to actual conditions, as long as can realize being connected of wireless transmission of display terminal and mobile device, the embodiment of the present invention is not limited this.In addition, except above-mentioned transmission means, those skilled in the art can also adopt other transmission means according to actual needs, and the embodiment of the present invention is not also limited this.
In a preferred embodiment of the present invention, target reproduction time information can comprise audio frequency reproduction time information (audio time stamp) corresponding to current voice data that mobile device side is extracted in the time of playing audio-fequency data.
In embodiments of the present invention, the audio time stamp that current voice data is corresponding is t
a, play object time stamp (target reproduction time information) t
a＇=t
a.
In another kind of preferred embodiment of the present invention, target reproduction time information can comprise audio time stamp that current voice data that mobile device side extracts in the time of playing audio-fequency data is corresponding and the correction value in propagation delay time; Propagation delay time can be the time of data transfer delay between display terminal side and mobile device side.
In embodiments of the present invention, the audio time stamp that current voice data is corresponding is t
a, the propagation delay time is Δ t, plays object time stamp (target reproduction time information) t
a＇=t
a+ Δ t.
In embodiments of the present invention, mobile device can be by the wireless communication link transmission objectives broadcast information between mobile device and display terminal.
In embodiments of the present invention, the propagation delay time sends to mobile device after can being measured by display terminal, also can be measured by mobile device, can also measure in advance.Wherein, mobile device can measure the propagation delay time in the following manner: send test data to display terminal, and record the current very first time; Receive the test data that display terminal sends, and record the second current time, wherein, test data is shown immediately terminal and sends it back mobile device after arriving display terminal; The difference of the second time and the very first time, divided by 2, is obtained to the propagation delay time.
In the prior art, while answering voice data by bluetooth earphone, display terminal need to decompress the voice data receiving, compress by bluetooth module again, and then be transferred to bluetooth earphone, compression and decompression action has repeatedly expended a lot of time, can make voice data compare slowed-down video.And in this application, the voice data of the compression receiving is directly sent to mobile device by display terminal, with respect to prior art, save the step that decompresses and compress by bluetooth module, save the transmission time of voice data, thereby avoid the delay between voice data and video data, improved the net synchronization capability of audio, video data.In addition, mobile device is the product that public use frequency is very high, the multiplexing mobile device of the embodiment of the present invention, and one-object-many-purposes, has avoided extra purchase bluetooth earphone, practical, greatly reduces cost.
In addition, in prior art, mobile device and display terminal can't transmit the temporal information of played data separately, like this, are easy to cause voice data and video data to play asynchronous.And in this application, the temporal information of playing audio-fequency data is sent to display terminal by mobile device, display terminal is play corresponding video data according to this information, thereby has improved the net synchronization capability of audio, video data.
Fig. 5 shows a kind of player method of audio, video data, and the method comprises:
In specific implementation, buffered can start playing video data or voice data again for process buffer time value.Buffer time can for example, for being set in advance as a fixed value, 5 seconds.
In display terminal, can pass through buffer time, cushion after enough video datas, then carried out the broadcasting of video data; And in mobile device, can pass through identical buffer time, cushion after enough voice datas, then carried out the broadcasting of voice data.
In the embodiment of the present invention, play object time stamp and can comprise audio time stamp corresponding to current voice data that mobile device extracts in the time of playing audio-fequency data.
Audio time stamp corresponding to current video data is t
a, play object time stamp t
a＇=t
a.
In embodiments of the present invention, play object time stamp t
a＇=t
a, the propagation delay time is Δ t, the broadcasting object time stamp t after upgrading
a＇ ＇=t
a＇+Δ t=t
a+ Δ t.
In the prior art, while answering voice data by bluetooth earphone, display terminal need to decompress the voice data receiving, compress by bluetooth module again, and then be transferred to bluetooth earphone, compression and decompression action has repeatedly expended a lot of time, can make voice data compare slowed-down video.And in this application, the voice data of the compression receiving is directly sent to mobile device by display terminal, with respect to prior art, save the step that decompresses and compress by bluetooth module, save the transmission time of voice data, thereby avoid the delay between voice data and video data, improved the net synchronization capability of audio, video data.In addition, mobile device is the product that public use frequency is very high, the multiplexing mobile device of the embodiment of the present invention, and one-object-many-purposes, has avoided extra purchase bluetooth earphone, practical, greatly reduces cost.
In addition, in prior art, mobile device and display terminal can't transmit the temporal information of played data separately, like this, are easy to cause voice data and video data to play asynchronous.And in this application, the temporal information of playing audio-fequency data is sent to display terminal by mobile device, display terminal is play corresponding video data according to this information, thereby has improved the net synchronization capability of audio, video data.
With reference to Fig. 6, show the structured flowchart of a kind of display terminal of the present invention, this display terminal can comprise as lower module:
Receiver module 601, for receiving audio-video document;
Read module 602, for the voice data from audio-video document reading video data and compression;
Sending module 603, for the voice data of compression is sent to mobile device, wherein, the voice data of compression is for being extracted the broadcasting of contracing at mobile device place;
The target reproduction time information that receiver module 601 also sends for receiving mobile device, wherein, target reproduction time information is that mobile terminal is according to current audio frequency reproduction time Information generation;
Playing module 604, for according to target reproduction time information, playing video data.
In a preferred embodiment of the embodiment of the present invention, target reproduction time information comprises: the audio frequency reproduction time information corresponding to voice data of current broadcasting, or the correction value in audio frequency reproduction time and propagation delay time, wherein, the propagation delay time is the propagation delay time of link between display terminal and mobile device.
In a preferred embodiment of the embodiment of the present invention, as shown in Figure 7, this display terminal also comprises: measurement module 701, for measuring the propagation delay time of link between display terminal and mobile device; Playing module 604 is also for according to target reproduction time and propagation delay time, playing audio-fequency data.
In a preferred embodiment of the embodiment of the present invention, measurement module 701 also for:
Send test data to mobile device, and record the current very first time;
Receive the test data that mobile device sends, and record the second current time, wherein, test data after arriving mobile device immediately mobile device send it back display terminal;
The difference of the second time and the very first time, divided by 2, is obtained to the propagation delay time.
In a preferred embodiment of the embodiment of the present invention, as shown in Figure 7, above-mentioned display terminal also comprises: buffer module 702, and for cushioning audio, video data.
In a preferred embodiment of the embodiment of the present invention, between display terminal and mobile device, one of at least carry out in the following manner the transmission of data:
Ethernet, bluetooth, 2.4G network transmission technology, infrared ray and wireless network protocol ZigBee.
For device embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, the part of relevant part reference method embodiment illustrates.
With reference to Fig. 8, show the structured flowchart of a kind of mobile device of the present invention, this mobile device comprises:
Receiver module 801, the voice data of compression sending for receiving display terminal, wherein, the voice data of compression is that display terminal reads out from the audio-video document receiving, the video data in audio-video document is play at display terminal place;
Decompression module 802, for the voice data of the compression that decompresses;
Playing module 803, for playing the voice data after decompressing, and records current audio frequency reproduction time information;
Generation module 804, for according to audio frequency reproduction time information, generates target reproduction time information;
Sending module 805, for target reproduction time information is sent to display terminal, wherein, target reproduction time information is for the foundation as playing video data at display terminal place.
In a preferred embodiment of the embodiment of the present invention, target reproduction time information comprises: the audio frequency reproduction time information corresponding to voice data of current broadcasting.
In a preferred embodiment of the embodiment of the present invention, as shown in Figure 9, above-mentioned mobile device also comprises: measurement module 901, for measuring the propagation delay time of link between display terminal and mobile device; Generation module 804, for using the propagation delay time to revise audio frequency reproduction time information, obtains target reproduction time information.
In a preferred embodiment of the embodiment of the present invention, measurement module 901 for:
Send test data to display terminal, and record the current very first time;
Receive the test data that display terminal sends, and record the second current time, wherein, test data is shown immediately terminal and sends it back mobile device after arriving display terminal;
The difference of the second time and the very first time, divided by 2, is obtained to the propagation delay time.
In a preferred embodiment of the embodiment of the present invention, between display terminal and mobile device, one of at least carry out in the following manner the transmission of data:
Ethernet, bluetooth, 2.4G network transmission technology, infrared ray and wireless network protocol ZigBee.
For device embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, the part of relevant part reference method embodiment illustrates.
Each embodiment in this specification all adopts the mode of going forward one by one to describe, and what each embodiment stressed is and the difference of other embodiment, between each embodiment identical similar part mutually referring to.For system embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, relevant part is referring to the part explanation of embodiment of the method.
Player method, intelligent television and the mobile device of a kind of audio, video data above the application being provided, be described in detail, applied principle and the execution mode of specific case to the application herein and set forth, the explanation of above embodiment is just for helping to understand the application's method and core concept thereof; , for one of ordinary skill in the art, according to the application's thought, all will change in specific embodiments and applications, in sum, this description should not be construed as the restriction to the application meanwhile.
Claims (13)
1. a player method for audio, video data, is characterized in that, comprising:
Display terminal receives audio-video document;
The voice data of reading video data and compression from described audio-video document;
The voice data of described compression is sent to mobile device, and wherein, the voice data of described compression is for being extracted the broadcasting of contracing at described mobile device place;
Receive the target reproduction time information that described mobile device sends, wherein said target reproduction time information is described mobile terminal according to current audio frequency reproduction time Information generation;
According to described target reproduction time information, play described video data.
2. the method for claim 1, it is characterized in that, described target reproduction time information comprises: the audio frequency reproduction time information corresponding to voice data of current broadcasting, or described audio frequency reproduction time and the correction value in propagation delay time, wherein, the described propagation delay time is the propagation delay time of link between described display terminal and described mobile device.
3. the method for claim 1, is characterized in that,
According to described target reproduction time information, before playing described video data, described method also comprises: the propagation delay time of measuring link between described display terminal and described mobile device;
According to described target reproduction time information, play described video data, comprising: according to described target reproduction time and described propagation delay time, playing audio data.
4. method as claimed in claim 3, is characterized in that, measures the propagation delay time of link between described display terminal and described mobile device, comprising:
Send test data to described mobile device, and record the current very first time;
Receive the described test data that described mobile device sends, and record the second current time, wherein, described test data is sent it back described display terminal by described mobile device immediately after arriving described mobile device;
The difference of described the second time and the described very first time, divided by 2, is obtained to the described propagation delay time.
5. the method as described in any one in claim 1 to 4, is characterized in that, before playing described video data, described method also comprises:
Cushion described audio, video data.
6. the method as described in any one in claim 1 to 4, is characterized in that, one of at least carries out in the following manner the transmission of data between described display terminal and described mobile device:
Ethernet, bluetooth, 2.4G network transmission technology, infrared ray and wireless network protocol ZigBee.
7. a player method for audio, video data, is characterized in that, comprising:
Mobile device receives the voice data of the compression of display terminal transmission, wherein, the voice data of described compression is that described display terminal reads out from the audio-video document receiving, and the video data in described audio-video document is play at described display terminal place;
The voice data of described compression decompresses;
Play the voice data after decompressing, and record current audio frequency reproduction time information;
According to described audio frequency reproduction time information, generate target reproduction time information;
Described target reproduction time information is sent to described display terminal, and wherein, described target reproduction time information is used at described display terminal place as the foundation of playing described video data.
8. method as claimed in claim 7, is characterized in that, described target reproduction time information comprises: the audio frequency reproduction time information corresponding to voice data of current broadcasting.
9. method as claimed in claim 7, is characterized in that,
According to described audio frequency reproduction time information, before generating target reproduction time information, described method also comprises: the propagation delay time of measuring link between described display terminal and described mobile device;
According to described audio frequency reproduction time information, generate target reproduction time information, comprising: use the described propagation delay time to revise described audio frequency reproduction time information, obtain described target reproduction time information.
10. method as claimed in claim 9, is characterized in that, measures the propagation delay time of link between described display terminal and described mobile device, comprising:
Send test data to described display terminal, and record the current very first time;
Receive the described test data that described display terminal sends, and record the second current time, wherein, described test data is sent it back described mobile device by described display terminal immediately after arriving described display terminal;
The difference of described the second time and the described very first time, divided by 2, is obtained to the described propagation delay time.
11. methods as described in any one in claim 7 to 10, is characterized in that, one of at least carry out in the following manner the transmission of data between described display terminal and described mobile device:
Ethernet, bluetooth, 2.4G network transmission technology, infrared ray and wireless network protocol ZigBee.
12. 1 kinds of display terminals, is characterized in that, comprising:
Receiver module, for receiving audio-video document;
Read module, for the voice data from described audio-video document reading video data and compression;
Sending module, for the voice data of described compression is sent to mobile device, wherein, the voice data of described compression is for being extracted the broadcasting of contracing at described mobile device place;
The target reproduction time information that described receiver module also sends for receiving described mobile device, wherein, described target reproduction time information is described mobile terminal according to current audio frequency reproduction time Information generation;
Playing module, for according to described target reproduction time information, plays described video data.
13. 1 kinds of mobile devices, is characterized in that, comprising:
Receiver module, be used for the voice data of the compression that receives display terminal transmission, wherein, the voice data of described compression is that described display terminal reads out from the audio-video document receiving, and the video data in described audio-video document is play at described display terminal place;
Decompression module, for the voice data of the described compression that decompresses;
Playing module, for playing the voice data after decompressing, and records current audio frequency reproduction time information;
Generation module, for according to described audio frequency reproduction time information, generates target reproduction time information;
Sending module, for described target reproduction time information is sent to described display terminal, wherein, described target reproduction time information is used at described display terminal place as the foundation of playing described video data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410093272.0A CN103905877A (en) | 2014-03-13 | 2014-03-13 | Playing method of audio data and video data, smart television set and mobile equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410093272.0A CN103905877A (en) | 2014-03-13 | 2014-03-13 | Playing method of audio data and video data, smart television set and mobile equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103905877A true CN103905877A (en) | 2014-07-02 |
Family
ID=50996993
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410093272.0A Pending CN103905877A (en) | 2014-03-13 | 2014-03-13 | Playing method of audio data and video data, smart television set and mobile equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103905877A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104254007A (en) * | 2014-09-03 | 2014-12-31 | 海信集团有限公司 | Method and device for processing audio |
| CN105898502A (en) * | 2016-04-11 | 2016-08-24 | 深圳Tcl新技术有限公司 | Audio and video playing synchronization method and synchronization device |
| CN106302375A (en) * | 2015-06-29 | 2017-01-04 | 成都鼎桥通信技术有限公司 | Remove the method and device of DST PLAYER time delay accumulation |
| WO2017071073A1 (en) * | 2015-10-29 | 2017-05-04 | 小米科技有限责任公司 | Method and device for media synchronization |
| CN106782598A (en) * | 2016-12-15 | 2017-05-31 | 深圳Tcl数字技术有限公司 | Television image and peripheral hardware synchronous sound control method and device |
| CN106878384A (en) * | 2016-12-30 | 2017-06-20 | 建荣半导体（深圳）有限公司 | Data forwarding method, its device, bluetooth equipment and audio frequency transmission method |
| CN107040848A (en) * | 2017-03-07 | 2017-08-11 | 建荣半导体（深圳）有限公司 | Synchronization parameter transmission method, device and the equipment of AVDTP agreements |
| CN107592550A (en) * | 2017-09-25 | 2018-01-16 | 陕西国广数码科技有限公司 | The live synchronization transfer method of movie theatre |
| CN107734378A (en) * | 2017-10-31 | 2018-02-23 | 维沃移动通信有限公司 | A kind of audio and video synchronization method, device and mobile terminal |
| CN109144642A (en) * | 2018-08-14 | 2019-01-04 | Oppo广东移动通信有限公司 | Display control method, device, electronic equipment and storage medium |
| CN109600564A (en) * | 2018-08-01 | 2019-04-09 | 北京微播视界科技有限公司 | Method and apparatus for determining timestamp |
| JP2019532576A (en) * | 2016-09-14 | 2019-11-07 | ディーティーエス リミテッド ライアビリティ カンパニー | Multimode synchronous rendering of audio and video |
| CN114667510A (en) * | 2020-06-18 | 2022-06-24 | 索尼集团公司 | Wireless audio and video synchronization |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1484538A (en) * | 2001-02-02 | 2004-03-24 | Ip | Method and systems for controlling exercise apparatus using portable remote device |
| EP1860866A1 (en) * | 2006-05-26 | 2007-11-28 | British Telecommunications Public Limited Company | Audio-visual reception |
| CN103491445A (en) * | 2012-06-08 | 2014-01-01 | Lg电子株式会社 | Image display apparatus, mobile terminal and method for operating the same |
-
2014
- 2014-03-13 CN CN201410093272.0A patent/CN103905877A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1484538A (en) * | 2001-02-02 | 2004-03-24 | Ip | Method and systems for controlling exercise apparatus using portable remote device |
| EP1860866A1 (en) * | 2006-05-26 | 2007-11-28 | British Telecommunications Public Limited Company | Audio-visual reception |
| CN103491445A (en) * | 2012-06-08 | 2014-01-01 | Lg电子株式会社 | Image display apparatus, mobile terminal and method for operating the same |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104254007A (en) * | 2014-09-03 | 2014-12-31 | 海信集团有限公司 | Method and device for processing audio |
| CN106302375B (en) * | 2015-06-29 | 2019-07-16 | 成都鼎桥通信技术有限公司 | Remove the method and device of DST PLAYER time delay accumulation |
| CN106302375A (en) * | 2015-06-29 | 2017-01-04 | 成都鼎桥通信技术有限公司 | Remove the method and device of DST PLAYER time delay accumulation |
| WO2017071073A1 (en) * | 2015-10-29 | 2017-05-04 | 小米科技有限责任公司 | Method and device for media synchronization |
| CN105898502A (en) * | 2016-04-11 | 2016-08-24 | 深圳Tcl新技术有限公司 | Audio and video playing synchronization method and synchronization device |
| WO2017177524A1 (en) * | 2016-04-11 | 2017-10-19 | 深圳Tcl新技术有限公司 | Audio and video playing synchronization method and device |
| CN105898502B (en) * | 2016-04-11 | 2019-09-20 | 深圳Tcl新技术有限公司 | The method and device that audio-visual synchronization plays |
| JP7120997B2 (en) | 2016-09-14 | 2022-08-17 | ディーティーエス リミテッド ライアビリティ カンパニー | Multi-mode synchronous rendering of audio and video |
| JP2019532576A (en) * | 2016-09-14 | 2019-11-07 | ディーティーエス リミテッド ライアビリティ カンパニー | Multimode synchronous rendering of audio and video |
| CN106782598A (en) * | 2016-12-15 | 2017-05-31 | 深圳Tcl数字技术有限公司 | Television image and peripheral hardware synchronous sound control method and device |
| CN106878384A (en) * | 2016-12-30 | 2017-06-20 | 建荣半导体（深圳）有限公司 | Data forwarding method, its device, bluetooth equipment and audio frequency transmission method |
| CN107040848A (en) * | 2017-03-07 | 2017-08-11 | 建荣半导体（深圳）有限公司 | Synchronization parameter transmission method, device and the equipment of AVDTP agreements |
| CN107592550A (en) * | 2017-09-25 | 2018-01-16 | 陕西国广数码科技有限公司 | The live synchronization transfer method of movie theatre |
| CN107592550B (en) * | 2017-09-25 | 2021-03-30 | 陕西国广数码科技有限公司 | Cinema live broadcast synchronous transmission method |
| CN107734378A (en) * | 2017-10-31 | 2018-02-23 | 维沃移动通信有限公司 | A kind of audio and video synchronization method, device and mobile terminal |
| CN107734378B (en) * | 2017-10-31 | 2019-11-01 | 维沃移动通信有限公司 | A kind of audio and video synchronization method, device and mobile terminal |
| CN109600564A (en) * | 2018-08-01 | 2019-04-09 | 北京微播视界科技有限公司 | Method and apparatus for determining timestamp |
| CN109144642A (en) * | 2018-08-14 | 2019-01-04 | Oppo广东移动通信有限公司 | Display control method, device, electronic equipment and storage medium |
| CN109144642B (en) * | 2018-08-14 | 2022-02-18 | Oppo广东移动通信有限公司 | Display control method, display control device, electronic equipment and storage medium |
| CN114667510A (en) * | 2020-06-18 | 2022-06-24 | 索尼集团公司 | Wireless audio and video synchronization |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103905880A (en) | Playing method of audio data and video data, smart television set and mobile equipment | |
| CN103905877A (en) | Playing method of audio data and video data, smart television set and mobile equipment | |
| CN103905879B (en) | The method, apparatus and equipment that a kind of video data and audio data are played simultaneously | |
| CN101779419B (en) | Simultaneously maintaining bluetooth and 802.11 connections to increase data throughput | |
| US9712573B2 (en) | Synchronized wireless display devices | |
| US8705511B2 (en) | System and method for synchronous transmission of content | |
| US12120165B2 (en) | Adaptive audio processing method, device, computer program, and recording medium thereof in wireless communication system | |
| US9479546B2 (en) | Method, apparatus, and computer program product for media control for multiple devices | |
| CN103905881B (en) | The method, apparatus and equipment that a kind of video data and audio data are played simultaneously | |
| US10264038B2 (en) | Discovery and management of synchronous audio or video streaming service to multiple sinks in wireless display system | |
| CN103905876A (en) | Video data and audio data synchronized playing method and device and equipment | |
| CN103905878A (en) | Video data and audio data synchronized playing method and device and equipment | |
| US12120582B2 (en) | Method, apparatus and computer program for broadcast discovery service in wireless communication system, and recording medium therefor | |
| CN104320699A (en) | Method for dynamically adjusting Bluetooth sounding device | |
| US20240168703A1 (en) | Method, device, and computer program for audio routing in wireless communication system, and recording medium therefor | |
| US20220229628A1 (en) | Method, device and computer program for controlling audio data in wireless communication system, and recording medium therefor | |
| CN205305087U (en) | Audio amplifier with wifi transmit system | |
| TWI798890B (en) | Bluetooth voice communication system and related computer program product for generating stereo voice effect | |
| US9787350B2 (en) | Electronic device and system for the point-multipoint transmission of a digital signal over a radio communication network | |
| US20230080122A1 (en) | Method, device and computer program for cloud-authenticated pairing in wireless communication system, and recording medium therefor | |
| WO2019090712A1 (en) | On-line screen sharing method and main sharing terminal | |
| CN117998304A (en) | Wireless audio data transmission method and related equipment | |
| KR20240138576A (en) | A method for OUTPUTTING SINGER'S VOICE using goods and a device supporting the same | |
| CN117242758A (en) | Communication method and communication device | |
| Lansford | HomeRF: Wireless networking for the connected home |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140702 |
|
| RJ01 | Rejection of invention patent application after publication |