CN101388996B - Method and system implementing visible telephone - Google Patents

Method and system implementing visible telephone Download PDF

Info

Publication number
CN101388996B
CN101388996B CN200810168340XA CN200810168340A CN101388996B CN 101388996 B CN101388996 B CN 101388996B CN 200810168340X A CN200810168340X A CN 200810168340XA CN 200810168340 A CN200810168340 A CN 200810168340A CN 101388996 B CN101388996 B CN 101388996B
Authority
CN
China
Prior art keywords
bluetooth
module
data
video
voice data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN200810168340XA
Other languages
Chinese (zh)
Other versions
CN101388996A (en
Inventor
李斌
左雪梅
方东旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN200810168340XA priority Critical patent/CN101388996B/en
Publication of CN101388996A publication Critical patent/CN101388996A/en
Application granted granted Critical
Publication of CN101388996B publication Critical patent/CN101388996B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Telephone Function (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

A method and a system for realizing a video telephone are disclosed, which are applied to a communication procedure of the video telephone at a video telephone terminal, the method comprises the steps that: a, a decoding module decodes a wireless signal received from a network side to audio and video data; b, the decoded audio data is transmitted to a Bluetooth chip via a Bluetooth protocol stackand then transmitted to a Bluetooth earphone via the Bluetooth chip; meanwhile, the decoded video data is displayed on a screen of the terminal; c, the Bluetooth chip receives the audio data capturedby the Bluetooth earphone; the Bluetooth protocol stack transmits the audio data to a coding module from the Bluetooth chip, so as to be hybrid-encoded with the captured subscriber video data as the wireless signal; d, the wireless signal is sent back to the network side. The invention enables subscribers to handily realize sincere communication of the video television service between two parties, and is able to be applied to 3G cell phone extremely flexibly.

Description

A kind of method and system that realize video telephone
Technical field
The present invention relates to the video communication applications field, relate in particular to a kind of method and system that realize video telephone.
Background technology
Along with the communication technology and development of computer, phone has become necessary part in the people life, but present plain old telephone can only be realized speech exchange, so not only heard its, but also the dream of seeing its people when people thirst for realizing conversing.
Visual telephone service is a kind of video communication service of point-to-point, and it can utilize the image and the voice signal of the two-way real-time Transmission both call sides of telephone network, can make both call sides realize interchange excellent in voice and affection, so video telephone helps people to realize this hope.
When using video telephone, especially when using the video telephone of mobile phone, the user just can't press close to receiver to ear if camera is aimed at oneself, and thus in more noisy open air, the user just can't clearly hear the sound of phone; And the user just can't use camera if ear is pressed close to earpiece, so use very inconvenient.
Summary of the invention
Technical problem to be solved by this invention provides a kind of method and system that realize video telephone, can make the user use video telephone more easily, realizes that both call sides exchanges excellent in voice and affectionly.
In order to solve the problems of the technologies described above, the invention provides a kind of method that realizes video telephone, be used for the calling course of video telephone of radio phone terminal, comprise step:
A, decoder module will be decoded as voice data and video data from the wireless signal that network side receives;
B, the voice data that decodes is sent to Bluetooth chip by bluetooth protocol repertory, by Bluetooth chip voice data is sent to bluetooth earphone again; Simultaneously, the video data that decodes is shown on the screen of described terminal.
Further, before step a, also comprise: when conversation on video telephone begins, set up between Bluetooth chip and the bluetooth earphone synchronously towards being connected the SCO link, and initialization buffering area.
Buffering area comprises to be read buffer queue and writes buffer queue, and step b comprises:
B1, voice data is mail to bluetooth protocol repertory by serial digital audio-frequency bus agreement I2S by reading buffer queue;
B2, bluetooth protocol repertory calculate transmission rate according to audio coding; Transmission rate in UART serial ports analog constant is sent to Bluetooth chip with described data;
B3, Bluetooth chip send to described data the receiver of bluetooth earphone by the SCO link.
Further, after step b, also comprise:
C, Bluetooth chip receive by the bluetooth earphone audio data captured; Bluetooth protocol repertory is given coding module from Bluetooth chip with audio data transmission, carries out hybrid coding with the user video data of catching and becomes wireless signal;
D, wireless signal is sent to network side.
Further, step c comprises:
C1, Bluetooth chip are by the microphone audio data captured of SCO link reception by bluetooth earphone;
C2, bluetooth protocol repertory be by the transmission rate of UART serial ports analog constant, and the voice data that will read from Bluetooth chip mails to coding module and carries out hybrid coding by writing buffer queue.
In order to solve the problems of the technologies described above, the invention provides a kind of system that realizes video telephone, except comprising: wireless module, volume-decoder module, Video Capture module and the video display module, also comprise: bluetooth module and bluetooth earphone; Wherein:
Volume-decoder module, be connected with wireless module, Video Capture module, video display module and bluetooth module respectively, be used for the wireless signal that wireless module receives is decoded as voice data and video data, export to respectively that bluetooth module is handled and video display module shows;
Bluetooth module is made up of Bluetooth audio frequency data transmission unit and Bluetooth chip, is used for reading in by the Bluetooth audio frequency data transmission unit voice data of volume-decoder module decoding, by bluetooth protocol repertory audio data transmission is arrived Bluetooth chip; By Bluetooth chip voice data is sent on the bluetooth earphone;
Bluetooth earphone is used for that the voice data that bluetooth module sends is amplified the confession user and answers.
Bluetooth chip and bluetooth earphone by set up by bluetooth protocol repertory synchronously towards being connected the connection of SCO link;
The Bluetooth audio frequency data transmission unit reads in voice data by serial digital audio-frequency bus agreement I2S the buffer queue of reading of buffering area; Calculate transmission rate by bluetooth protocol repertory according to audio coding, give Bluetooth chip from read buffer queue in the audio data transmission that the transmission rate of UART serial ports analog constant will read; By the SCO link voice data is sent to bluetooth earphone by Bluetooth chip.
Volume-decoder module also is used for voice data hybrid coding that user video data that the Video Capture module is caught and bluetooth module receive and becomes wireless signal to export to wireless module to send to network side;
Bluetooth module receives the bluetooth earphone audio data captured by Bluetooth chip, receives voice data to the Bluetooth audio frequency data transmission unit by bluetooth protocol repertory, by the Bluetooth audio frequency data transmission unit voice data is exported to volume-decoder module;
With microphone, the voice data that the user who is used for catching sends sends to bluetooth module on the bluetooth earphone.
Further, Bluetooth chip reads in the bluetooth earphone audio data captured by the SCO link, the Bluetooth audio frequency data transmission unit receives the write buffer queue of voice data to buffering area by bluetooth protocol repertory in the transmission rate of UART serial ports analog constant, and the audio data transmission that will write buffer queue by I2S is carried out hybrid coding to volume-decoder module again.
The present invention mutually combines video telephone and bluetooth earphone by software mode, terminal is aimed at camera the user under the situation of oneself clearly hear the other user's sound, thereby make things convenient for the user to realize that the visual telephone service both call sides exchanges excellent in voice and affectionly by the bluetooth earphone receiver.And, because the present invention adopts software mode that bluetooth earphone is combined with video telephone, can be applied in the 3G mobile very neatly.
Description of drawings
Fig. 1 realizes the entire system structural representation of bluetooth video telephone for the present invention;
Fig. 2 is the software architecture schematic diagram of bluetooth video telephone of the present invention;
Fig. 3 realizes the method flow diagram of bluetooth video telephone for the present invention.
Embodiment
The present invention proposes a kind of system and method for realizing video telephone, by software mode bluetooth earphone is combined with video telephone, can allow the video telephone user answer the other side's speech by bluetooth earphone, be very easy to user's use, and can apply to the visual telephone service of mobile phone neatly.The present invention realizes that the method for video telephone comprises:
A, when video telephone begins to converse, set up the SCO link between Bluetooth chip and the bluetooth earphone, and the initialization buffering area;
It is voice data and video data that b, volume-decoder module will be surveyed the signal decoding that receives from the wireless module network;
C, the voice data that decodes is mail to bluetooth protocol repertory by buffering area by the bluetooth applications program; Transmit these data to Bluetooth chip by bluetooth protocol repertory in the transmission rate of UART serial ports analog constant; By Bluetooth chip these data are sent on the bluetooth earphone by the SCO link again;
By video display module the video data that decodes is shown on the display unit;
D, bluetooth protocol repertory receive the voice data of being passed back by bluetooth earphone by the transmission rate of UART serial ports analog constant from Bluetooth chip; To be transferred to volume-decoder module by writing buffer queue from these data that bluetooth protocol repertory receives by the bluetooth applications program, the user video data of catching with the Video Capture module are carried out hybrid coding and are become wireless signal;
E, this wireless signal is sent to network side by wireless module.
Below in conjunction with accompanying drawing said method of the present invention and system thereof are elaborated.
Bluetooth is a kind of short-range wireless communication technique, and electronic installation can couple together by bluetooth equipment each other, has saved traditional electric wire and has connected.By the wireless receiver on the Bluetooth chip, being furnished with the electronic product of bluetooth equipment can communicate by letter in ten meters distance each other, Bluetooth protocol supports multiple profile (promptly to refer in the Bluetooth specification the function that bluetooth provided and the classification set of application scenarios, have the profile about 20, defined different application scene and function respectively.Such as: such as bluetooth handsfree, dial up on the telephone, file transfer etc.), wherein handfree profile can output to the voice signal of mobile phone bluetooth earphone, thereby user's both hands are freed, and greatly facilitates the cellphone subscriber.Because the real-time that speech data is had relatively high expectations is used synchronously towards connecting the speed rates speech data of (SCO, Synchronous Connection-Oriented) link with constant 64kb/s so bluetooth protocol repertory is general.
Though the 2G mobile phone terminal also can be equipped with bluetooth earphone for the user at present, but because this terminal goes out audio data transmission to the Bluetooth chip the terminal from volume-decoder decode, all realize, so its very difficult cell-phone visual business that realizes that combines with the vision signal of 3G mobile by hardware mode.The present invention adopts software mode that bluetooth earphone is combined with video telephone for addressing this problem, and can apply to neatly in following 3G mobile, thereby hew out the following great market that realizes visual telephone service on mobile phone.
Fig. 1 is the system configuration schematic diagram of realization bluetooth video telephone provided by the invention, and this system comprises wireless module, volume-decoder module, bluetooth module, bluetooth earphone, Video Capture module and video display module; Wherein:
Wireless module is used for surveying reception or sending data to network side from network;
Volume-decoder module is connected with wireless module, Video Capture module, video display module and bluetooth module respectively, and the data decode that is used for wireless module is received is voice data and video data, exports to video display module and bluetooth module respectively; Perhaps the voice data hybrid coding with Video Capture module video captured data and bluetooth module reception becomes wireless signal to export to wireless module;
Bluetooth module, form by Bluetooth audio frequency data transmission unit and Bluetooth chip, the SCO link of setting up by bluetooth protocol repertory with bluetooth earphone is connected, be used for reading in the voice data of volume-decoder module decoding, this transfer of data arrived Bluetooth chip by the UART serial ports by the Bluetooth audio frequency data transmission unit; By Bluetooth chip these data are sent on the bluetooth earphone again; Perhaps, receive the voice data that the little microphone of bluetooth earphone is caught by Bluetooth chip, read this voice data to the Bluetooth audio frequency data transmission unit by the UART serial ports, carry out hybrid coding with video data thereby this voice data is exported to volume-decoder module;
Bluetooth earphone is used for the voice data that bluetooth module sends amplified for the user and answers, and attached primary school of earphone institute microphone is used to catch the voice data that the user sends and sends to bluetooth module;
The Video Capture module is used for the user video data that capture are exported to volume-decoder module;
Video display module, the other user's video data that is used for volume-decoder module is decoded is shown to display unit.
Fig. 2 realizes the software framework structure schematic diagram of bluetooth video telephone for the present invention, and this software frame comprises volume-decoder module, video relevant portion and Bluetooth audio frequency data transmission unit.Wherein, the Bluetooth audio frequency data transmission unit has been formed the bluetooth module shown in Fig. 1 with Bluetooth chip.
This Bluetooth audio frequency data transmission unit, by I2S (Inter-IC Sound Bus, serial digital audio-frequency bus agreement) FIFO (First In First Out, FIFO stack) receives the voice data of volume-decoder module decoding, and reads in the buffer queue of reading of buffering area; Calculate transmission rate by bluetooth protocol repertory according to audio coding, give Bluetooth chip from read buffer queue in the audio data transmission that this transmission rate of UART serial ports analog constant will read; By the SCO link this voice data is sent to bluetooth earphone by Bluetooth chip; Perhaps, bluetooth earphone microphone audio data captured is read in by the SCO link by Bluetooth chip, receive the write buffer queue of this voice data by bluetooth protocol repertory in the transmission rate of UART serial ports analog constant, encode to volume-decoder module this audio data transmission of writing buffer queue by I2S FIFO to buffering area.
The voice data of video telephone is sent to bluetooth earphone by the present invention's bluetooth module shown in Figure 2, not only can use bluetooth earphone to answer voice but also can realize answering of phone such as hung up at operation, the user can make things convenient for and freely enjoys joyful that video telephone brings.
Fig. 3 realizes the method flow diagram of bluetooth video telephone for the present invention, and concrete steps are as follows:
Step 301: when video phone call, comprise incoming call and exhalation, then change next step and carry out;
Step 302: judged whether bluetooth earphone, if execution in step 303, execution in step 315 then if not;
Step 303: set up bluetooth SCO passage, and the reading buffer queue and write buffer queue of initialization buffering area;
Step 304: the data decode that decoder module will receive from wireless module is voice data and video data;
Step 305: the video data demonstration that decodes is outputed to screen;
Step 306: the voice data that decodes inserted by I2S read buffer queue;
Step 307: bluetooth protocol repertory calculates transmission rate according to audio coding, and the speed voice data that will read from read buffer queue is transferred to Bluetooth chip by the UART serial ports according to this;
Step 308: Bluetooth chip sends to bluetooth earphone by the SCO passage with voice data, and the user just hears phone the other side's sound on the receiver of bluetooth earphone;
Step 309: attached little microphone captures user's voice data on the bluetooth earphone, sends it to Bluetooth chip by the SCO passage then;
Step 310: bluetooth protocol repertory will be inserted by the voice data that the UART serial ports reads from Bluetooth chip and be write buffer queue;
Step 311: coding module reads voice data by I2S from write buffer queue, adds to carry out hybrid coding from the video data of the seizure of camera;
Step 312: the data after wireless module will be encoded send to network and survey, and make the other user see this machine user's image, hear this machine user's sound;
Step 313: judge whether conversation finishes, return step 304 if not and carry out, if execution in step 314 then;
Step 314: close the SCO passage, read buffer queue and write buffer queue, process ends in the buffer release district;
Step 315: earpiece is answered speech, behind end of conversation, and process ends.
In sum, the present invention mutually combines video telephone and bluetooth earphone by software mode as can be seen, terminal is aimed at camera the user under the situation of oneself clearly hear the other user's sound, thereby make things convenient for the user to realize that the visual telephone service both call sides exchanges excellent in voice and affectionly by the bluetooth earphone receiver.And, because the present invention adopts software mode that bluetooth earphone is combined with video telephone, can be applied in the 3G mobile very neatly.
Certainly; the present invention also can have other various embodiments; under the situation that does not deviate from spirit of the present invention and essence thereof; those of ordinary skill in the art work as can make various corresponding changes and distortion according to the present invention, but these corresponding changes and change all should belong to the protection range of the appended claim of the present invention.

Claims (7)

1. method that realizes video telephone is used for the calling course of video telephone of radio phone terminal, comprises step:
A, decoder module will be decoded as voice data and video data from the wireless signal that network side receives;
B, the described voice data that will decode are sent to Bluetooth chip by bluetooth protocol repertory, by described Bluetooth chip described voice data are sent to bluetooth earphone again; Simultaneously, the video data that decodes is shown on the screen of described terminal;
Wherein, before step a, also comprise: when described conversation on video telephone begins, set up between described Bluetooth chip and the described bluetooth earphone synchronously towards being connected the SCO link, and initialization buffering area;
Described buffering area comprises to be read buffer queue and writes buffer queue, and step b comprises:
B1, described voice data is mail to described bluetooth protocol repertory by serial digital audio-frequency bus agreement I2S by the described buffer queue of reading;
B2, described bluetooth protocol repertory calculate transmission rate according to audio coding; Described transmission rate in UART serial ports analog constant is sent to described Bluetooth chip with described data;
B3, described Bluetooth chip send to described data the receiver of described bluetooth earphone by described SCO link.
2. in accordance with the method for claim 1, it is characterized in that, after step b, also comprise:
C, described Bluetooth chip receive by described bluetooth earphone audio data captured; Described bluetooth protocol repertory is given coding module from described Bluetooth chip with described audio data transmission, carries out hybrid coding with the user video data of catching and becomes wireless signal;
D, described wireless signal is sent to described network side.
3. in accordance with the method for claim 1, it is characterized in that, after step b, also comprise:
C, described Bluetooth chip receive by described bluetooth earphone audio data captured; Described bluetooth protocol repertory is given coding module from described Bluetooth chip with described audio data transmission, carries out hybrid coding with the user video data of catching and becomes wireless signal;
D, described wireless signal is sent to described network side.
4. in accordance with the method for claim 3, it is characterized in that step c comprises:
C1, described Bluetooth chip receive the described voice data of being caught by the microphone of described bluetooth earphone by described SCO link;
C2, described bluetooth protocol repertory be by the described transmission rate of UART serial ports analog constant, and the described voice data that will read from described Bluetooth chip mails to described coding module and carries out described hybrid coding by the described buffer queue of writing.
5. a system that realizes video telephone comprises: wireless module, volume-decoder module, Video Capture module and video display module; It is characterized in that described system also comprises: bluetooth module and bluetooth earphone; Wherein:
Described volume-decoder module, be connected with described wireless module, described Video Capture module, described video display module and described bluetooth module respectively, be used for the wireless signal that described wireless module receives is decoded as voice data and video data, export to respectively that described bluetooth module is handled and described video display module shows;
Described bluetooth module, form by Bluetooth audio frequency data transmission unit and Bluetooth chip, be used for reading in the voice data of described volume-decoder module decoding, described audio data transmission arrived described Bluetooth chip by bluetooth protocol repertory by described Bluetooth audio frequency data transmission unit; By described Bluetooth chip described voice data is sent on the described bluetooth earphone;
Described bluetooth earphone is used for that the voice data that bluetooth module sends is amplified the confession user and answers;
Described Bluetooth chip and bluetooth earphone by set up by described bluetooth protocol repertory synchronously towards being connected the connection of SCO link;
Described Bluetooth audio frequency data transmission unit reads in described voice data by serial digital audio-frequency bus agreement I2S the buffer queue of reading of buffering area; Calculate transmission rate by described bluetooth protocol repertory according to audio coding, will give described Bluetooth chip from the described audio data transmission of reading to read the buffer queue in the described transmission rate of UART serial ports analog constant; By described SCO link described voice data is sent to bluetooth earphone by described Bluetooth chip.
6. according to the described system of claim 5, it is characterized in that,
Described volume-decoder module also is used for voice data hybrid coding that user video data that described Video Capture module is caught and described bluetooth module receive and becomes wireless signal to export to described wireless module to send to network side;
Described bluetooth module receives described bluetooth earphone audio data captured by described Bluetooth chip, receive described voice data to described Bluetooth audio frequency data transmission unit by described bluetooth protocol repertory, described voice data is exported to described volume-decoder module by described Bluetooth audio frequency data transmission unit;
With microphone, the voice data that the user who is used for catching sends sends to described bluetooth module on the described bluetooth earphone.
7. according to claim 5 or 6 described systems, it is characterized in that, described Bluetooth chip reads in described bluetooth earphone audio data captured by described SCO link, described Bluetooth audio frequency data transmission unit receives the write buffer queue of described voice data to described buffering area by described bluetooth protocol repertory in the transmission rate of described UART serial ports analog constant, carries out described hybrid coding for described volume-decoder module the described audio data transmission of writing buffer queue by described I2S again.
CN200810168340XA 2008-09-26 2008-09-26 Method and system implementing visible telephone Expired - Fee Related CN101388996B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200810168340XA CN101388996B (en) 2008-09-26 2008-09-26 Method and system implementing visible telephone

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200810168340XA CN101388996B (en) 2008-09-26 2008-09-26 Method and system implementing visible telephone

Publications (2)

Publication Number Publication Date
CN101388996A CN101388996A (en) 2009-03-18
CN101388996B true CN101388996B (en) 2011-11-30

Family

ID=40478128

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200810168340XA Expired - Fee Related CN101388996B (en) 2008-09-26 2008-09-26 Method and system implementing visible telephone

Country Status (1)

Country Link
CN (1) CN101388996B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110444233A (en) * 2019-07-02 2019-11-12 福建新大陆通信科技股份有限公司 A kind of the audio reception playback method and system of number sound shadow amusement equipment

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101984728B (en) 2010-10-22 2013-10-02 惠州Tcl移动通信有限公司 Method and visual communication terminal for achieving visual conversation based on bluetooth earphone
CN102088593B (en) * 2011-01-18 2012-10-24 西安电子科技大学 MPEG4 (Moving Pictures Experts Group 4) compressed video transmission communication system and method based on Bluetooth 3.0 specification
CN106792466B (en) * 2016-12-26 2020-10-09 歌尔科技有限公司 Method for communication between equipment end and host end
CN110895939A (en) * 2019-11-19 2020-03-20 广东天波信息技术股份有限公司 Voice interaction method, device and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110444233A (en) * 2019-07-02 2019-11-12 福建新大陆通信科技股份有限公司 A kind of the audio reception playback method and system of number sound shadow amusement equipment

Also Published As

Publication number Publication date
CN101388996A (en) 2009-03-18

Similar Documents

Publication Publication Date Title
CN101252377B (en) Earphone equipment and method for communication terminal to realize voice intercommunication traffic using the same
CN101583009B (en) Video terminal and method thereof for realizing interface content sharing
CN101378530A (en) Method and system for transmitting and receiving short message, and short message server
CN103312906A (en) Method and device for realizing teleconference
CN102164327A (en) A headset system with microphone for ambient sounds
CN101388996B (en) Method and system implementing visible telephone
CN104025558A (en) A wireless headset and a headset system for transferring call between two telecommunication devices
CN203827453U (en) Video conference system
CN100561963C (en) A kind of system that realizes that content of multimedia is shared
CN101800801A (en) Mobile phone and method thereof for realizing multiparty call
CN101931781A (en) Method for displaying calling video and wireless communication terminal
CN106453790A (en) Communication method based on multi-Bluetooth teleconference
EP1542481A3 (en) Notification of reception of data during a voice call
US20010005684A1 (en) Video conference system
CN202276388U (en) Telephone integrating handset, fixed line telephone, and Internet phone
CN203278971U (en) Remote multimedia fusion communication conference terminal
TWI232431B (en) Method of speech transformation
CN212850667U (en) Dual-mode group dialing system with PSTN and VOIP
CN103237139B (en) multi-party communication system and method
JP2008546329A (en) Method of processing videophone call based on mobile communication network
CN202889465U (en) Mobile conference telephone
CN109660752A (en) A kind of three-dimensional visualization video conference centralized control system
CN203225839U (en) Video communication device applied to PSTN
CN2768323Y (en) Communication system for multi-person simultaneous call
CN101076110B (en) Method for disturbing cell-phone visual signal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20111130

Termination date: 20160926

CF01 Termination of patent right due to non-payment of annual fee