CN106873779A - A kind of gesture identifying device and gesture identification method - Google Patents
A kind of gesture identifying device and gesture identification method Download PDFInfo
- Publication number
- CN106873779A CN106873779A CN201710104725.9A CN201710104725A CN106873779A CN 106873779 A CN106873779 A CN 106873779A CN 201710104725 A CN201710104725 A CN 201710104725A CN 106873779 A CN106873779 A CN 106873779A
- Authority
- CN
- China
- Prior art keywords
- gesture
- data
- wire rod
- module
- rod module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
On a kind of gesture identifying device and gesture identification method, gesture identifying device includes wire rod module and gesture treatment module to the present invention.Wire rod module, wire rod module includes detecting unit, and detecting unit is used to detect the shape and movement locus of wire rod module, and wire rod module sends the first data by the data of shape and the data conversion of movement locus；Gesture treatment module coupling wire rod module simultaneously receives the first data, and the first data can be read by gesture treatment module, and gesture processes module and prestores gesture data look-up table；Wherein, when gesture identifying device judge wire rod module be wound in user on hand when, gesture identifying device enters hand gesture recognition mode, so that gesture treatment module compares the first data in gesture data look-up table to determine the gesture of currently used person.Gesture identifying device of the invention can differentiate the gesture of user according to the first data, so as to carry out man-machine interface operation, without going to carry out input operation using input units such as mouse, keyboards.
Description
Technical field
The present invention relates to a kind of gesture identifying device and gesture identification method, more particularly to a kind of hand of use wire rod module
Gesture identifying device and gesture identification method.
Background technology
As electronic technology is growing, increasing application field (for example, medical treatment, electricity competing etc.) needs more diversification
And customized man machine operation interface, conventional operative such as mouse, keyboard or contact panel be not deposited to be used, because
This, the company such as similar Microsoft has developed a kind of human-machine operation technology, and the technology analyzes user using image identification technology
The technology of limb action, has been gradually introduced a variety of application systems.
But, the hardware for catching image must be placed on specific position by this operating technology based on image identification technology
Put to continue to monitor the limb action of user, and then analyze and be converted into specific input instruction, in this way, not only have space and
Limitation in angle, but also without the haptic feedback of the existing input unit such as mouse or keyboard.
The content of the invention
To improve the problem of above-mentioned pot life system and atactilia feedback, the present invention provides a kind of gesture identifying device.
Above-mentioned gesture identifying device includes：
Wire rod module, the wire rod module include detecting unit, the detecting unit be used for detect the wire rod module shape and
Movement locus, the wire rod module is sent by the data of the shape and the first data of the data conversion of the movement locus；With
And
Gesture processes module, couples the wire rod module and receives first data, and first data can be processed by the gesture
Module is read, and gesture treatment module prestores gesture data look-up table；
Wherein, when the gesture identifying device judge the wire rod module be wound in the user on hand when, the gesture identification
Device enters hand gesture recognition mode, so that gesture treatment module compares first data in the gesture data look-up table to determine
The gesture of the current user.
Used as optional technical scheme, the detecting unit answers varitron detecting unit and multiple inertia detectings single including multiple
Unit, the plurality of to answer varitron detecting unit for detecting the shape of the wire rod module, the plurality of sub- detecting unit of inertia is for detecing
Survey the movement locus of the wire rod module.
Used as optional technical scheme, the wire rod module also includes signal conversion unit, and the signal conversion unit is used for will
The shape of the wire rod module and the data of movement locus of detecting unit detecting are converted to first data.
Used as optional technical scheme, the wire rod module also includes electrostatic film unit, is returned with providing user's sense of touch
Feedback.
Used as optional technical scheme, gesture treatment module is integrated in the wire rod module.
Used as optional technical scheme, gesture treatment module includes processing unit, memory cell, and the processing unit is used for
First data are parsed, the memory cell is used to store first data.
Used as optional technical scheme, the wire rod module is for the wire rod or stethoscopic wire rod of earphone or with general
The wire rod of serial bus interface.
The present invention also provides a kind of gesture identification method, for the gesture identification of gesture identification module,
The gesture identification module includes：
Wire rod module；And
Gesture processes module, and prestore gesture data look-up table；
The gesture identification method includes：
Step S1：Electrically connect the wire rod module and process module with the gesture；
Step S2：Detect the shape and movement locus of the wire rod module；
Step S3：The data of the data and the movement locus of changing the shape form the first data, and send first number
Module is processed according to the gesture, gesture treatment module judges whether the wire rod module twines with wire rod according to first data
Around if so, then entering step S4；If it is not, then entering step S2；
Step S4：Gesture treatment module compares first data in the gesture data look-up table, to determine that current this makes
The gesture of user.
As optional technical scheme, in step S4, if gesture treatment module is first used or the user
New gesture data need to be set up, then into step S5：
Step S5：Correct the data in the gesture data look-up table, or adjust and increase the new gesture data to should
Gesture data look-up table, after the completion of continue step S4.
Used as optional technical scheme, in step S4, the gesture processes module by being parsed in first data
The material winds information of the wire rod module, and after parsing the positional information of the section for winding, then searched with the gesture data
Comparing in table, judges the gesture of currently used person.
Used as optional technical scheme, the wire rod module answers varitron detecting unit and multiple inertia detectings single including multiple
Unit, in step S2, the plurality of shape for answering varitron detecting unit to detect the wire rod module, the plurality of inertia detecting is single
Unit detects the movement locus of the wire rod module.
Used as optional technical scheme, the wire rod module also includes electrostatic film unit, if judging to need to carry out tactile anti-
Feedback, then provide current to the electrostatic film unit to produce feedback effect power.
Compared to prior art, gesture identifying device of the invention can differentiate the gesture of user according to the first data,
So as to carry out the operation of man-machine interface, without going to carry out input operation using input units such as mouse, keyboards, it is adaptable to
The use situation of a variety of application systems.
Below in conjunction with the drawings and specific embodiments, the present invention will be described in detail, but not as a limitation of the invention.
Brief description of the drawings
Fig. 1 is the schematic diagram of gesture identifying device of the present invention；
Fig. 2 is the sectional view of wire rod module of the present invention；
Fig. 3 is the use schematic diagram of gesture identifying device of the present invention；
Fig. 4 is the flow chart of gesture identification method of the present invention.
Specific embodiment
Fig. 1 is the schematic diagram of gesture identifying device of the present invention, and Fig. 2 is the sectional view of wire rod module of the present invention.Please join in the lump
According to Fig. 1, Fig. 2, gesture identifying device 100 is used to recognize the gesture of user, including wire rod module 110 and gesture treatment module
120。
Wire rod module 110 includes detecting unit 111, shape and movement locus for detecting wire rod module 110, Yu Benshi
Example is applied, detecting unit 111 answers varitron detecting unit 1111 and the sub- detecting unit 1112 of multiple inertia including multiple, and multiple answers varitron
Detecting unit 1111 is used to detect the shape of wire rod module 110, answer varitron detecting unit 1111 can be resistance-type, condenser type,
The strain gauge element, or touch sensor of piezo-electric crystal, detecting mode are not construed as limiting, and meet the function of its shape detecting i.e.
Can；Multiple sub- detecting units 1112 of inertia are used to detecting the movement locus of wire rod module 110, and the sub- detecting unit 1112 of inertia can be with
It is accelerometer, gyroscope or electronic compass.Wire rod module 110 sends the data conversion of the data and movement locus by shape
The first data, in the present embodiment, wire rod module 110 also include signal conversion unit, signal conversion unit be used for will detect
The shape of wire rod module 110 and the data of movement locus for surveying the detecting of unit 111 are converted to the first data.
The gesture treatment coupling wire rod of module 120 module 110 simultaneously receives the first data, and the first data can process module by gesture
120 are read, and gesture treatment module 120 prestores gesture data look-up table.
Fig. 3 is the use schematic diagram of gesture identifying device of the present invention.Please with reference to Fig. 1 to Fig. 3, such as left figure institute in Fig. 3
Show, when gesture identifying device 100 judge wire rod module 110 be wound in user on hand when, gesture identifying device 100 enters to start with
Gesture recognition mode, gesture treatment module 120 compares the first data in gesture data look-up table to determine the gesture of currently used person.
After gesture treatment module 120 receives the first data, the material winds information of wire rod module 110 is parsed first, and parse and twine
Around section positional information, that is, analyze wire rod module 110 occurs winding (dotted line frame body portion institute in such as Fig. 3 in which section
The section 113 for showing), then compare with the related data in gesture data look-up table, for example simulate as shown in right in Figure 3
Simulation gesture, so as to judge the gesture of currently used person.
In this way, user is in after wire rod module 110 of the winding with detecting unit 111 on hand, gesture identifying device 100 can
The gesture of user is differentiated according to the first data, so as to carry out the operation of man-machine interface, without going to use such as mouse, key
The input units such as disk carry out input operation, can meet the use demand of a variety of application systems, improve use convenient
With efficiency.Such as doctor can also synchronously carry out other medical treatment while winding stethoscopic wire rod on hand and carrying out input operation
Behavior (for example operates dental medical apparatus, surgical device or ultrasonic equipment)；Again for example, being alternatively arranged as user's body
Part checking application system, gesture identifying device 100 according to the action difference of the operating gesture of user, so as to can determine whether user
Identity.
In the present embodiment, as shown in Figure 2 and Figure 3, wire rod module 110 also includes electrostatic film unit 112, is used with providing
Person's sense of touch feedback, electrostatic film unit 112 is by the first metal electrode, electrically charged vibration film and the second metal electrode stacking
Into, there is provided after driving current to electrostatic film unit 112, the dipole chemoattractant molecule on vibration film produces feedback effect power.When sentencing
Some sections for gesture of cutting off the hands touch dummy object, such as the section 113 shown in the right figure of Fig. 3, electrostatic film unit 112 occurs
Vibrations give user a kind of sensation for touching object to provide user haptic feedback.
In the present embodiment, gesture treatment module 120 is independently arranged with wire rod module 110, for example, gesture treatment module 120
It is intelligent apparatus (such as smart mobile phone), including processing unit, memory cell, processing unit is for parsing the first data, storage
Unit is used to store the first data, and wire rod module 110 is earphone cord, or is stethoscopic wire rod, certainly, in other realities
Apply in example, gesture treatment module 120 can also be integrated in wire rod module 110 and set.
And wire rod module 110 can be varied to the transmission means of external signal, when wire rod module 110 is earphone cord, can
Transmission is attached by entity interface, entity interface can such as USB interface, receiver interface or lightning interfaces etc.；When
Wire rod module 110 be stethoscopic wire rod when, can by way of being wirelessly transferred, the Bluetooth transmission of such as low-power consumption or
Zigbee is transmitted；When wire rod module 110 is wire rod (such as the charging wire etc.) with USB (USB) interface, line
Material module 110 also can first entity (such as USB interface etc.) be connected on smart mobile phone or wearable electronic installation, then pass through
The mode being wirelessly transferred carrys out control targe system (such as computer etc.).
Fig. 4 is the flow chart of gesture identification method of the present invention.Please with reference to Fig. 1 to Fig. 4, gesture identification method 200 is used
In the gesture identification of gesture identification module 100, gesture identification module 100 includes wire rod module 110 and gesture treatment module 120,
Prestore gesture data look-up table in gesture treatment module 120.
Gesture identification method 200 includes：
Step S1：Electrical connection wire rod module 110 processes module 120 with gesture；
Step S2：The shape and movement locus of detecting wire rod module 110；
Step S3：The data of the data and movement locus of changing shape form the first data, and send the first data to hand
Gesture processes module 120, and gesture processes module 120 and judges whether wire rod module 110 has material winds according to the first data, if
It is, then into step S4；If it is not, then entering step S2；
Step S4：Gesture processes module 120 and compares the first data in gesture data look-up table, to determine the current user
Gesture.
In step S4, if gesture treatment module 120 is first used or user need to set up new gesture data, i.e.,
Without data or without user's gesture data currently to be recognized in the gesture data look-up table for prestoring, then into step
S5：
Step S5：Data in correction gesture data look-up table, or adjust and increase new gesture data to gesture number
According to look-up table, i.e., gesture identification method 200 of the invention has learning functionality, can be according to different users, different application or behaviour
Make environment, the gesture operation definition of automatic correction wire rod module 110, such as data are right hand data in gesture data look-up table,
And the gesture of user is left hand, then the Left-hand gesture data of user can be gathered by wire rod module 110, retransmited to gesture
Treatment module 120, gesture treatment module 120 is stored and defines the left hand data of the user, so as in gesture data look-up table
In be also provided with the Left-hand gesture data of user.And continue to walk after the completion of the correction or adjustment operation of gesture data look-up table
Rapid S4.
In step S4, after gesture treatment module 120 receives the first data, the wire rod that wire rod module 110 is parsed first is twined
Around information, and the positional information of the section for winding is parsed, that is, analyze wire rod module 110 occurs winding (such as in which section
In Fig. 3 shown in dotted line frame body portion), then compare with the related data in gesture data look-up table, for example simulate such as Fig. 3
Simulation gesture shown in middle right figure, so as to judge the gesture of currently used person.
Wire rod module 110 answers varitron detecting unit 1111 and the sub- detecting unit 1112 of multiple inertia including multiple, in step
In S2, multiple answers varitron detecting unit 1111 to detect the shape of wire rod module 110, and multiple sub- detecting units 1112 of inertia are detected
The movement locus of wire rod module 110.In the present embodiment, wire rod module 110 also includes electrostatic film unit 112, if judging to need
Touch feedback is carried out, then provides current to electrostatic film unit 112 to produce feedback effect power.
In sum, gesture identifying device of the invention can differentiate the gesture of user according to the first data, so as to enter
The operation of row man-machine interface, without going to carry out input operation using the input unit such as mouse, keyboard, it is adaptable to it is various not
The use situation of same application system.
Certainly, the present invention can also have other various embodiments, ripe in the case of without departing substantially from spirit of the invention and its essence
Knowing those skilled in the art can make various corresponding changes and deformation, but these corresponding changes and deformation according to the present invention
The protection domain of appended claims of the invention should all be belonged to.
Claims (12)
1. a kind of gesture identifying device, the gesture for recognizing user, it is characterised in that the gesture identifying device includes：
Wire rod module, the wire rod module includes detecting unit, and the detecting unit is used to detect shape and the motion of the wire rod module
Track, the wire rod module is sent by the data of the shape and the first data of the data conversion of the movement locus；And
Gesture processes module, couples the wire rod module and receives first data, and first data can process module by the gesture
Read, gesture treatment module prestores gesture data look-up table；
Wherein, when the gesture identifying device judge the wire rod module be wound in the user on hand when, the gesture identifying device
Into hand gesture recognition mode, so that gesture treatment module compares first data in the gesture data look-up table to determine currently
The gesture of the user.
2. gesture identifying device as claimed in claim 1, it is characterised in that it is single that the detecting unit answers varitron to detect including multiple
Unit and the sub- detecting unit of multiple inertia, it is the plurality of to answer varitron detecting unit for detecting the shape of the wire rod module, it is the plurality of
The sub- detecting unit of inertia is used to detect the movement locus of the wire rod module.
3. gesture identifying device as claimed in claim 1, it is characterised in that the wire rod module also includes signal conversion unit,
The shape of the wire rod module and the data of movement locus that the signal conversion unit is used to detect the detecting unit are converted to this
First data.
4. gesture identifying device as claimed in claim 1, it is characterised in that the wire rod module also includes electrostatic film unit,
To provide user's sense of touch feedback.
5. gesture identifying device as claimed in claim 1, it is characterised in that gesture treatment module is integrated in the wire rod mould
Group.
6. gesture identifying device as claimed in claim 1, it is characterised in that gesture treatment module includes processing unit, deposits
Storage unit, the processing unit is used to parse first data, and the memory cell is used to store first data.
7. gesture identifying device as claimed in claim 1, it is characterised in that wire rod or auscultation of the wire rod module for earphone
The wire rod of device or the wire rod with USB.
8. a kind of gesture identification method, for the gesture identification of gesture identification module, it is characterised in that
The gesture identification module includes：
Wire rod module；And
Gesture processes module, and prestore gesture data look-up table；
The gesture identification method includes：
Step S1：Electrically connect the wire rod module and process module with the gesture；
Step S2：Detect the shape and movement locus of the wire rod module；
Step S3：The data of the data and the movement locus of changing the shape form the first data, and send first data extremely
The gesture processes module, and the gesture processes module and judges whether the wire rod module has material winds according to first data, if
It is, then into step S4；If it is not, then entering step S2；And
Step S4：Gesture treatment module compares first data in the gesture data look-up table, to determine the current user
Gesture.
9. gesture identification method as claimed in claim 8, it is characterised in that in step S4, if gesture treatment module quilt
Use first or the user need to set up new gesture data, then into step S5：
Step S5：The data in the gesture data look-up table are corrected, or is adjusted and is increased the new gesture data to the gesture
Data look-up table, after the completion of continue step S4.
10. gesture identification method as claimed in claim 8, it is characterised in that in step S4, gesture treatment module leads to
Cross in first data to parse the material winds information of the wire rod module, and parse the positional information of the section for winding
Afterwards, then with the gesture data look-up table in comparing, judge the gesture of currently used person.
11. gesture identification methods as claimed in claim 8, it is characterised in that the wire rod module answers varitron to detect including multiple
Unit and the sub- detecting unit of multiple inertia, it is the plurality of to answer varitron detecting unit to detect being somebody's turn to do for the wire rod module in step S2
Shape, the plurality of sub- detecting unit of inertia detects the movement locus of the wire rod module.
12. gesture identification methods as claimed in claim 8, it is characterised in that the wire rod module also includes electrostatic film unit,
If judgement needs to carry out touch feedback, provide current to the electrostatic film unit to produce feedback effect power.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710104725.9A CN106873779B (en) | 2017-02-24 | 2017-02-24 | Gesture recognition device and gesture recognition method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710104725.9A CN106873779B (en) | 2017-02-24 | 2017-02-24 | Gesture recognition device and gesture recognition method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106873779A true CN106873779A (en) | 2017-06-20 |
| CN106873779B CN106873779B (en) | 2020-05-08 |
Family
ID=59168492
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710104725.9A Active CN106873779B (en) | 2017-02-24 | 2017-02-24 | Gesture recognition device and gesture recognition method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106873779B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109753157A (en) * | 2019-01-11 | 2019-05-14 | 京东方科技集团股份有限公司 | The gestural control method and device of display screen |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101339451A (en) * | 2007-07-02 | 2009-01-07 | 佛山市顺德区顺达电脑厂有限公司 | Non-contact type finger operation and control system and its method |
| US20100313050A1 (en) * | 2009-06-05 | 2010-12-09 | Qualcomm Incorporated | Controlling power consumption of a mobile device based on gesture recognition |
| CN102024151A (en) * | 2010-12-02 | 2011-04-20 | 中国科学院计算技术研究所 | Training method of gesture motion recognition model and gesture motion recognition method |
| US20140149859A1 (en) * | 2012-11-27 | 2014-05-29 | Qualcomm Incorporated | Multi device pairing and sharing via gestures |
| CN204203932U (en) * | 2014-11-18 | 2015-03-11 | 华中科技大学 | A kind of human-computer interaction device based on radio-frequency (RF) identification |
| CN105677031A (en) * | 2016-01-04 | 2016-06-15 | 广州华欣电子科技有限公司 | Control method and device based on gesture track recognition |
-
2017
- 2017-02-24 CN CN201710104725.9A patent/CN106873779B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101339451A (en) * | 2007-07-02 | 2009-01-07 | 佛山市顺德区顺达电脑厂有限公司 | Non-contact type finger operation and control system and its method |
| US20100313050A1 (en) * | 2009-06-05 | 2010-12-09 | Qualcomm Incorporated | Controlling power consumption of a mobile device based on gesture recognition |
| CN102024151A (en) * | 2010-12-02 | 2011-04-20 | 中国科学院计算技术研究所 | Training method of gesture motion recognition model and gesture motion recognition method |
| US20140149859A1 (en) * | 2012-11-27 | 2014-05-29 | Qualcomm Incorporated | Multi device pairing and sharing via gestures |
| CN204203932U (en) * | 2014-11-18 | 2015-03-11 | 华中科技大学 | A kind of human-computer interaction device based on radio-frequency (RF) identification |
| CN105677031A (en) * | 2016-01-04 | 2016-06-15 | 广州华欣电子科技有限公司 | Control method and device based on gesture track recognition |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109753157A (en) * | 2019-01-11 | 2019-05-14 | 京东方科技集团股份有限公司 | The gestural control method and device of display screen |
| CN109753157B (en) * | 2019-01-11 | 2022-04-26 | 京东方科技集团股份有限公司 | Gesture control method and device of display screen |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106873779B (en) | 2020-05-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11222624B2 (en) | Server for providing voice recognition service | |
| CN114341779B (en) | Systems, methods, and interfaces for performing input based on neuromuscular control | |
| US9612661B2 (en) | Closed loop feedback interface for wearable devices | |
| CN106465006B (en) | The operating method of microphone and the electronic equipment for supporting this method | |
| KR101345755B1 (en) | Apparatus and method for controlling operation in a mobile terminal | |
| EP3109736A1 (en) | Electronic device and method for providing haptic feedback thereof | |
| CN109313519A (en) | Electronic equipment including force snesor | |
| EP3073351A1 (en) | Controlling a wearable device using gestures | |
| CN106557158A (en) | Tactile CAPTCHA | |
| CN104898825A (en) | Electronic device and method for outputting feedback | |
| KR20140147557A (en) | Mobile terminal and method for detecting a gesture to control functions | |
| CN104978023A (en) | User interface method and apparatus of electronic device for receiving user input | |
| US20140340336A1 (en) | Portable terminal and method for controlling touch screen and system thereof | |
| US11029758B2 (en) | Dynamic command remapping for human-computer interface | |
| CN103631368A (en) | Detection device, detection method and electronic equipment | |
| US20140129233A1 (en) | Apparatus and system for user interface | |
| CN106873779A (en) | A kind of gesture identifying device and gesture identification method | |
| CN107608521A (en) | Processing method, storage medium and the mobile terminal of touch-screen failure | |
| CN112542030A (en) | Intelligent wearable device, method and system for detecting gesture and storage medium | |
| CN112437956B (en) | Speech recognition system | |
| CN114756146A (en) | Capacitive touch sensor using non-intersecting conductor patterns | |
| KR101771927B1 (en) | Apparatus and Method for Contact Free Interfacing Between User and Smart Device Using Electromyogram Signal | |
| KR102353919B1 (en) | Electronic device and method for performing predefined operations in response to pressure of touch | |
| KR101723076B1 (en) | Apparatus and Method for Contact Free Interfacing Between User and Smart Device Using Electromyogram Signal | |
| CN103870041B (en) | terminal device and its user identification method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |