CN100590646C - Method of realizing hand writing instant information - Google Patents

Method of realizing hand writing instant information Download PDF

Info

Publication number
CN100590646C
CN100590646C CN200410009596A CN200410009596A CN100590646C CN 100590646 C CN100590646 C CN 100590646C CN 200410009596 A CN200410009596 A CN 200410009596A CN 200410009596 A CN200410009596 A CN 200410009596A CN 100590646 C CN100590646 C CN 100590646C
Authority
CN
China
Prior art keywords
handwriting
paper
electronic pen
message
instant message
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN200410009596A
Other languages
Chinese (zh)
Other versions
CN1752994A (en
Inventor
刘恩新
王凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING USYSTON DIGITAL TECHNOLOGY Co Ltd
Original Assignee
BEIJING USYSTON DIGITAL TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING USYSTON DIGITAL TECHNOLOGY Co Ltd filed Critical BEIJING USYSTON DIGITAL TECHNOLOGY Co Ltd
Priority to CN200410009596A priority Critical patent/CN100590646C/en
Publication of CN1752994A publication Critical patent/CN1752994A/en
Application granted granted Critical
Publication of CN100590646C publication Critical patent/CN100590646C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The present invention discloses a method for implementing hand-writing instantaneous message. Said method uses instantaneous message platform, UD pape and electronic pen as main component, and includes the following steps: adding the hand-written hardwriting message into electronic mirror image paper of UD paper, utilizing electronic mirror image paper to convert the handwriting message into picture or animation file, then utilizing instantaneous message platform to make transmission.

Description

The handwriting instant messages implementation method
Technical field
The present invention relates to a kind of implementation method of instant message, particularly a kind of use electronic pen is write on paper, with the method that transmits by the instant message platform after the information digitalization on the paper, belongs to the digital technology field by electronic pen.
Background technology
Instant message (Instant message is called for short IM) claims instant messaging again, and being meant can be by the instant communication service that sends and receive message of means of communication such as internet.It has become one of main communication mode of people's daily life, work gradually since eighties of last century birth in the latter stage nineties.From setting up new interpersonal relation to increasing work efficiency, the instant message service all has huge help to people.
Existing instant message instrument can also transmit picture, hand-written scribble except transmitting text, sound, video, satisfies the many-sided demand of people with this.But the input mode that they generally use at present adds microphone and handwriting pad at the most still based on keyboard, mouse.The degree of freedom of input mode is poor, and efficient is low, and effect is also unsatisfactory.In huge instant message user group, still there is the people of quite a few to have the input bottleneck, be bad to use input tools such as keyboard, can't make full use of the instant message instrument and exchange smoothly with others.
Existing instant message instrument also can use handwriting pad, based on the handwriting input device of audiolocation or photoelectricity location such as sound position pen etc. as input tool.Though these input tools also can be realized the handwriting input of instant message, but because their principle of work all is that handwriting trace is mapped as the Grid Track of mouse in computer, therefore there are all problems that is difficult to overcome, reuse problem etc. such as stroke orientation problem, history message.
The applicant of patent of the present invention has submitted a application for a patent for invention on August 2nd, 2004, its name is called " based on the handwritten signature electronization method of paper ", and number of patent application is 200410009396.2.The notion of UD paper has been proposed in this patented claim.So-called UD paper has the surface that can write and print, in its surface attachment coded message is arranged, described coded message is stored among the network information terminal as the electron mirror sensitive paper of UD paper, has binding relationship one to one between this coded message and the described UD paper.In addition, this patented claim has also proposed the handwritten signature electronization method based on UD paper, promptly on UD paper, write by electronic pen, and the information that the camera record on the electronic pen is write, and the electron mirror sensitive paper that will be loaded with written information is transferred among the network information terminal; Written information on the electron mirror sensitive paper can show in network information terminal; This written information generates in described electronic pen, and with UD paper on the written information that produces of pen and ink form synchronous mirror image.Up to now, still do not use the technical scheme of above-mentioned UD paper and handwritten signature electronization method thereof in the instant message field.
Summary of the invention
The objective of the invention is to propose a kind of new handwriting instant messages implementation method.This method is incorporated into the instant message field with the notion and the handwritten signature electronization method thereof of UD paper, is transmitted by the instant message platform after the information digitalization on the UD paper by electronic pen.
For realizing above-mentioned goal of the invention, the present invention adopts following technical scheme:
A kind of handwriting instant messages implementation method, this method is used the instant message platform, and realizes based on UD paper and electronic pen, it is characterized in that:
Described electronic pen is write on described UD paper, the handwriting information of writing appends among the electron mirror sensitive paper of described UD paper, described electron mirror sensitive paper is converted to picture or animation file, send by described instant message platform, the picture that wherein said electron mirror sensitive paper converts to is handled through Handwritten Digits Recognition, and the content after the identification sends by described instant message platform again.
The specific region of described UD paper has background patterns, this pattern also is mapped in the electron mirror sensitive paper of described UD paper, described electronic pen is after write described specific region, and the handwriting information of writing and the electron mirror of described background patterns look like to be synthesized together, and sends by described instant message platform.
Described UD paper is divided into different function divisions, store the relative position of each function division by network information terminal, in the process that described electronic pen is write on described UD paper, described network information terminal obtains the relative position of handwriting by the coded message of interpretation person's handwriting position, thereby determine described electronic pen is to write, and described network information terminal is carried out the pairing function of this function division thus in which function division.
Described electronic pen writes down the timestamp information of each person's handwriting sampled point, calculate up and down mistiming between two sampled points by Flame Image Process API according to the timestamp information that sampled point comprised, the GIF form animation file that is generated by Flame Image Process API by projection is realized the reproduction of writing process.
Described electronic pen has ID, and this ID and the user who uses the handwriting instant messages service set up the identity binding relation.
When described instant message platform need send the message of once sending out in the past, directly in the database of electron mirror sensitive paper, access the pairing electron mirror sensitive paper of this message, send by the instant message platform again by network information terminal.
When instant message desk is the SMS (short message service) platform, transmit leg is write instant message on UD paper, selective reception side from the contact person, after selection sends handwriting instant messages by mobile phone, electronic pen by with its prior mobile phone of binding, send to server of instant message through mobile communication, server of instant message is received handwriting instant messages, after handling handwriting instant messages is sent to the take over party of instant message.
Handwriting instant messages implementation method of the present invention can allow the user use electronic pen Free Writing instant message on UD paper, and handwriting instant messages can send to other users in the immediate news systems with forms such as picture, animations, and is convenient and swift.Utilize this method to transfer immediate news and not only can allow the other side increase the emotional affection sense, the more important thing is that can allow the other side identify by the writing feature of person's handwriting reflection confirms identity to strengthen security.
Description of drawings
The present invention is further illustrated below in conjunction with the drawings and specific embodiments.
Fig. 1 is a handwriting instant messages workflow synoptic diagram.
Fig. 2 is the hierarchical chart that is used to realize the software package of the method for the invention.
Fig. 3 is the synoptic diagram that this handwriting instant messages implementation method is applied in the session window of RTX immediate news systems.
Fig. 4 is the instant message synoptic diagram originally based on UD paper.
Fig. 5 is the process synoptic diagram of hand-written mobile instant message.
Embodiment
The method of the invention need use UD paper and electronic pen as input tool when realizing.UD paper has detailed introduction in above-mentioned application number is 200410009396.2 patent application document, just do not repeated at this.The coded message that is printed on the UD paper can have multiple encoding scheme, preferably the two-dimensional bar code coding scheme.This two-dimensional encoded coding fetch equipment by special use reads.Write needs for taking into account, actual coding fetch equipment can be a high-speed camera and the combination with actual writing function pen.We as the electronic pen of abbreviating.This high-speed camera can adopt semiconductor element such as CCD.It is installed in the nib place directly over, can read the information on the UD paper in real time, comprise a coded message and the vestige write of pen on the UD paper.The Anoto pen that Sweden Anoto company provides is exactly a kind of electronic pen that possesses above-mentioned feature.The inside of electronic pen is built-in with communication unit, and this communication unit sends the electron mirror sensitive paper that is loaded with written information that electronic pen generates to be connected with electronic pen network information terminal by wired or wireless mode.This network information terminal can be existing high-grade smart mobile phone, also can be PC.As shown in Figure 1, if the instant message platform is installed on this network information terminal, so as long as solve the data-interface problem of electronic pen and instant message platform, allow the electron mirror sensitive paper form with image in session window that is loaded with written information show, transmit by the instant message platform, and reappear at the receiving end of instant message, just can realize handwriting instant messages implementation method of the present invention.
In realizing the process of the method for the invention, maximum technological difficulties are the data that electronic pen is gathered are handled, and the data layout that can be accepted by the instant message platform of final formation.For this reason, the applicant has developed the software package that a cover can be handled electronic pen data.As shown in Figure 2, this software package has comprised following module at the actual needs of handwriting instant messages:
Access Layer at lowermost end is the bottom layer driving module of electronic pen, and this module is according to the difference of electronic pen and different, but all is that those skilled in the art can realize easily, has not just given unnecessary details at this.
Be adaptation layer on Access Layer, this layer adopts the LOS proxy module.This module has shielded the bottom layer driving module of electronic pen, guarantees independence, the reusability of upper layer module.When another kind of UD paper of conversion and electronic pen, do not need to change upper layer module.Simultaneously, utilize this module also to reduce the complexity of electronic pen bottom layer driving and application program coupling.Pipeline is adopted in the interprocess communication of LOS proxy module and application program.Extract for the data that the electronic pen bottom layer driving is sent here, work such as internal format conversion, and send to LOS control in the application space.The LOS proxy module is undertaken by the LOS control with communicating by letter of application program.
Be components layer on adaptation layer, this components layer comprises three modules: LOS client's control, Flame Image Process API, ICR API.Be introduced respectively below:
The effect of LOS client's control is: the LOS control that in the application process space, moves by the pipeline message trigger after, receive the message of sending by the LOS agency, be reduced into the internal object supply then and use with program.It can embed immediate news systems, extracts stroke information for system, and can have access to the stroke information on the paper of the different page numbers.
The effect of Flame Image Process API is to carry out settings such as stroke color, thickness, and image related services such as various pictures generate, background is synthetic are provided.When electronic pen linked to each other with network information terminal, LOS client's control was obtained the stroke relevant information by message trigger, can call Flame Image Process API these data are operated.Flame Image Process API is by calling the api function of bottom, extracts all relevant informations such as page or leaf ID, coordinate, force value and timestamp that sampled point comprises, and these sampled points are in the light of actual conditions reformulated stroke by stroke stroke.Flame Image Process API is carrying out person's handwriting when redrawing, and according to the coordinate of each sampled point, the sampled point of discretize reconnected together, forms original writing pattern and guarantee and can not be out of shape.The situation of writing originally according to the user when person's handwriting redraws is carried out relevant treatment: comprised the force value when writing in the sampled point, can adjust the thickness of stroke when API redraws according to the force value size of writing, writing physical strength is big, and stroke is chap accordingly also.Also comprised timestamp information in the sampled point, the speed speed that the API basis is write is adjusted the depth color of stroke, and the local writing of writing soon more is also just shallow more.Simultaneously API can also calculate up and down mistiming between two sampled points according to timestamp information, carries out playback in strict accordance with the time of writing, thereby can realize the true reappearance of whole writing process.This writing process reproduces and can be realized by the GIF form animation file that Flame Image Process API generates by projection.In the processing procedure that person's handwriting redraws,, also added the anti-aliasing technology of graphics for guaranteeing the attractive in appearance and continuity of writing stroke.More than all measures add the hardware performance of electronic pen, guaranteed that the physiological characteristic the when user writes has obtained keeping to greatest extent.Redrawing in the function that API provides, color and these interface parameterss of line weight of person's handwriting can be set by user oneself, greatly made things convenient for user's exploitation and use.Result after redrawing can be synthesized together with background, offers the user with picture format (as JPG or BMP) or animated format (as GIF) commonly used.
The effect of ICR API is to provide the function of handwriting on the identification UD paper.ICR is a kind of dedicated software tool that is used for discerning the writing process handwriting.Such Software tool has multiple, as prior art, has not just given unnecessary details at this.It is such using the process of ICR API: at first make the design specifications in a cover UD paper user definition district, be referred to as the GDK design specifications.Emphasized in this standard to add following attribute NeedICR for the user definition district that will discern, its value will be discerned for the Y representative, and identification is not done in the N representative; Also will add attribute ICRType in addition, the mark identification types has simplified Hanzi, unsimplified Hanzi, capitalization English letter, small letter English alphabet, numeral etc.ICR API finds all sampled points that belong to this zone by the name in the user definition district of appointment, then according to the timestamp sequencing of sampled point, sample point coordinate is sent into the ICR core debate the knowledge module, the ICR core is debated simultaneously and known the needed identification types parameter of module and import the ICR core into and debate the knowledge module according to this regional attribute.The ICR core is debated and is known module and can calculate to debate according to this input and know the text that obtains.The text is returned as the output of ICR API.
It on components layer application layer.Application layer is the instant message platform.The instant message platform belongs to the part of prior art, and has how tame service provider to provide, Tencent QQ, RTX that for example present domestic use is the most general, the Yahoo Expert that Yahoo company releases, the POPO of company of Netease etc.Fig. 3 is the synoptic diagram that this handwriting instant messages implementation method is applied in the session window of RTX immediate news systems.These instant message platforms all provide second development interface.As long as data meet the requirement of development interface, just can be discerned and send by the instant message platform.And these secondary development work on existing instant message platform only need those skilled in the art to utilize basic programming knowledge just to realize easily, so just do not describe in detail at this.
For ease of implementing the method for the invention, the inventor also provides a kind of instant message basis based on UD paper.This instant message has message and writes the district originally as shown in Figure 4, pattern district, contact person district, functional areas.Write the district and be used to write any instant message.Whether the pattern district is used to choose the stroke color, line thickness, biological characteristic etc.The contact person district is used to select message receiver.Functional areas provide the selection (as by mobile phone or computing machine) of send mode for the user, the whether selection of Chinese Character Recognition, and whether whole page or leaf message sends, and sends etc.Network information terminal that is connected with electronic pen such as computing machine or mobile phone are known this instant message in advance, and this goes up the relative position of each function division, and in the process that electronic pen is write on the message basis, coded message by the person's handwriting position, also can allow information terminal obtain the relative position that person's handwriting is write on the message basis, thereby determine electronic pen is to write in which function division.Electronic pen is write on above-mentioned UD paper of having powerful connections, and the record information of writing, transfer data to information terminal after, information terminal can get access to handwriting information and paper coded message and background image information by above-mentioned processing about module.By Flame Image Process API, person's handwriting and background picture can also be synthesized, and the image that forms is offered information terminal.Except that background picture, also can the design background animation.Here said stroke and background picture be synthetic to be achieved in that information terminal at first knows the layout and the page or leaf background picture in UD paper user definition zone, can know user definition district under it according to the coordinate of this stroke for the stroke information of receiving, from the page or leaf background picture, get the part in this corresponding user definition district again, then stroke and this user definition district background picture are carried out image and synthesize.
Utilize instant message originally can also realize reusing of instant message.This message is reused and is achieved in that because any information that electronic pen is write in the instant message basis all is retained in the electron mirror sensitive paper corresponding in the electronic pen.During the message before instant message desk need send, once sent out, needn't re-enter, can directly in the database of electron mirror sensitive paper, access the pairing electron mirror sensitive paper of this message, send again.Therefore the electron mirror sensitive paper that multi-form this correspondence of instant message is different can have different implementations.
In this handwriting instant messages implementation method,, therefore can set up the identity binding relation, thereby strengthen security with the user who uses the instant message service because electronic pen possesses ID.In addition, utilize above-mentioned ICR API, can carry out Handwritten Digits Recognition, and provide through the text after the identification to the instant message platform to the instant message of handwriting input.Certainly, do not carry out character recognition and directly provide the image file of written handwriting to be fine yet.
Above-mentioned instant message platform can be a SMS (short message service) platform commonly used at present.As shown in Figure 5, when the user uses mobile phone to send or receives handwriting instant messages, the instant message that transmit leg is write on the instant message basis, selective reception side from the contact person, after selection sends handwriting instant messages by mobile phone, electronic pen can by with its mobile phone of binding in advance, send to server of instant message through the mobile network, after server of instant message is received handwriting instant messages, carry out handwriting instant messages being sent to after a series of processing the take over party of immediate news systems.The take over party receives handwriting instant messages in immediate news systems after, promptly can reply, also can reply with handwriting instant messages with text.Immediate news systems can insert MMS gateway, with the form of multimedia message handwriting instant messages is replied to transmit leg by MMS gateway.
Though described the present invention by example, those of ordinary skills know, the present invention has many distortion and variation and do not break away from spirit of the present invention, wish that appended claim comprises these distortion and variation and do not break away from spirit of the present invention.

Claims (7)

1. handwriting instant messages implementation method, this method is used instant message platform, and realizes based on UD paper and electronic pen, it is characterized in that:
Described electronic pen is write on described UD paper, the handwriting information of writing appends among the electron mirror sensitive paper of described UD paper, described electron mirror sensitive paper is converted to picture or animation file, send by described instant message platform, the picture that wherein said electron mirror sensitive paper converts to is handled through Handwritten Digits Recognition, and the content after the identification sends by described instant message platform again.
2. handwriting instant messages implementation method as claimed in claim 1 is characterized in that:
The specific region of described UD paper has background patterns, this pattern also is mapped in the electron mirror sensitive paper of described UD paper, described electronic pen is after write described specific region, and the handwriting information of writing and the electron mirror of described background patterns look like to be synthesized together, and sends by described instant message platform.
3. handwriting instant messages implementation method as claimed in claim 1 is characterized in that:
Described UD paper is divided into different function divisions, store the relative position of each function division by network information terminal, in the process that described electronic pen is write on described UD paper, described network information terminal obtains the relative position of handwriting by the coded message of interpretation person's handwriting position, thereby determine described electronic pen is to write, and described network information terminal is carried out the pairing function of this function division thus in which function division.
4. handwriting instant messages implementation method as claimed in claim 1 is characterized in that:
Described electronic pen writes down the timestamp information of each person's handwriting sampled point, calculate up and down mistiming between two sampled points by Flame Image Process API according to the timestamp information that sampled point comprised, the GIF form animation file that is generated by Flame Image Process API by projection is realized the reproduction of writing process.
5. handwriting instant messages implementation method as claimed in claim 1 is characterized in that:
Described electronic pen has ID, and this ID and the user who uses the handwriting instant messages service set up the identity binding relation.
6. handwriting instant messages implementation method as claimed in claim 1 is characterized in that:
When described instant message platform need send the message of once sending out in the past, directly in the database of electron mirror sensitive paper, access the pairing electron mirror sensitive paper of this message, send by the instant message platform again by network information terminal.
7. handwriting instant messages implementation method as claimed in claim 1 is characterized in that:
When instant message desk is the SMS (short message service) platform, transmit leg is write instant message on UD paper, selective reception side from the contact person, after selection sends handwriting instant messages by mobile phone, electronic pen by with its prior mobile phone of binding, send to server of instant message through mobile communication, server of instant message is received handwriting instant messages, after handling handwriting instant messages is sent to the take over party of instant message.
CN200410009596A 2004-09-21 2004-09-21 Method of realizing hand writing instant information Expired - Fee Related CN100590646C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200410009596A CN100590646C (en) 2004-09-21 2004-09-21 Method of realizing hand writing instant information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200410009596A CN100590646C (en) 2004-09-21 2004-09-21 Method of realizing hand writing instant information

Publications (2)

Publication Number Publication Date
CN1752994A CN1752994A (en) 2006-03-29
CN100590646C true CN100590646C (en) 2010-02-17

Family

ID=36679833

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200410009596A Expired - Fee Related CN100590646C (en) 2004-09-21 2004-09-21 Method of realizing hand writing instant information

Country Status (1)

Country Link
CN (1) CN100590646C (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102393804A (en) * 2011-10-24 2012-03-28 上海量明科技发展有限公司 Method, client and system for realizing handwriting interaction in instant messaging
CN102663667B (en) * 2012-03-28 2014-12-24 华为技术有限公司 Storage method and display method for handwritten content on touch screen, terminal equipment
JP6026346B2 (en) 2013-03-06 2016-11-16 日東電工株式会社 Position sensor
JP5513655B1 (en) 2013-03-08 2014-06-04 日東電工株式会社 Information management system
JP5513656B1 (en) 2013-03-08 2014-06-04 日東電工株式会社 Electronic underlay
JP5513654B1 (en) 2013-03-08 2014-06-04 日東電工株式会社 Electronic underlay with wireless transmission function
CN103744558B (en) * 2013-11-28 2017-01-18 苏州长风航空电子有限公司 Intelligent dead point recognition and self-adaptation compensation method for infrared touch screen
KR102487643B1 (en) * 2014-10-17 2023-01-11 주식회사 네오랩컨버전스 Electronic pen, electronic device associated with electronic pen, method for controlling electronic device and computer-readable medium on which program for performing the method for controlling electronic device is recorded
CN105094360A (en) * 2015-06-18 2015-11-25 努比亚技术有限公司 Information transformation processing method and information transformation processing terminal
CN105512597A (en) * 2015-12-31 2016-04-20 田雪松 Dot matrix identification method
CN109391538A (en) * 2018-06-29 2019-02-26 王帅涵 A kind of efficient chat software
CN109254647A (en) * 2018-08-31 2019-01-22 北京新界教育科技有限公司 Take down notes processing method and processing device
CN113076014A (en) * 2019-12-17 2021-07-06 北京小米移动软件有限公司 Control method and control device for handwriting notebook
CN112732156A (en) * 2020-12-30 2021-04-30 维沃移动通信有限公司 Information display method and device and electronic equipment
CN117369665A (en) * 2023-10-16 2024-01-09 深圳市大我云读写科技有限公司 Electronic paper handwriting display method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN1752994A (en) 2006-03-29

Similar Documents

Publication Publication Date Title
CN100590646C (en) Method of realizing hand writing instant information
US20020056576A1 (en) Method, system and product for information management
US7121465B2 (en) Activation of products with embedded functionality in an information management system
US20060075026A1 (en) Contents and information providing service system for using a code, user terminal, communication agency platform, operating agency platform, on-line relation member module, and the method from the same
CN1691631A (en) Method for management of vcards
JP2007506185A (en) Real-time variable digital paper
US7202963B2 (en) Method for processing information
JPH10254802A (en) Communication system and its method for unitarily designating opposite party by using digital code as identifier
CN105100159A (en) Designing method for quick response code electronic business card system by employing a cellphone browser and capable of sharing business card information
CN103310329A (en) Schedule information adding system and method thereof, and mobile phone and schedule information adding method thereof
CN100533469C (en) Method for computerizing handwritten signature based on paper
CN103853488A (en) Method and device for processing strokes based on touch screen
CN103095560A (en) Instant communication providing device based on maps
KR100440045B1 (en) A method and system for chatting service providing realtime tag analysis
CN111736731A (en) Handwriting obtaining method and system
CN101071353A (en) Hand-write input processing device
CN107292136A (en) A kind of pdf document anti-counterfei waterprint embedding grammar and system based on micro services
Shirali-Shahreza et al. An anti-SMS-spam using CAPTCHA
CN1142677C (en) Pen input based portable facsimile printer
CN100380296C (en) Text entry for electronic device
Shahreza erifyin Spam SMS y Arabic CA CA
CN108664529B (en) Information processing method and system
JP2004508228A (en) Business card with position coding pattern
CN201541287U (en) Mobile communication terminal having hand-written information sending function
Steimle et al. Survey of pen-and-paper computing

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20100217

Termination date: 20130921