CN114967934A - Gesture data interpretation system and method - Google Patents
Gesture data interpretation system and method Download PDFInfo
- Publication number
- CN114967934A CN114967934A CN202210746191.0A CN202210746191A CN114967934A CN 114967934 A CN114967934 A CN 114967934A CN 202210746191 A CN202210746191 A CN 202210746191A CN 114967934 A CN114967934 A CN 114967934A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- gesture data
- gesture
- motion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
- G06V40/11—Hand-related biometrics; Hand pose recognition
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses a gesture data interpretation system and a method, wherein the system comprises: the gyroscope module is configured to acquire gyroscope movement data when the data glove moves; a bending sensor module configured to acquire finger joint bending motion data at a data glove joint; a database configured to store reference gesture data for data pairing with the acquired motion data; a sampling control module configured to define a sampling frequency of the gyroscope module and the bending sensor module on a data glove; the main control module is configured as a control part for receiving, transmitting and matching the motion data and performs data interaction with the upper computer through the communication module. The application also discloses a gesture data interpretation method. The gesture data interpretation system and method improve the recognition accuracy of the gesture data.
Description
Technical Field
The application relates to the technical field of gesture recognition, in particular to a gesture data interpretation system and method.
Background
The data glove is more and more hot in the intelligent operation field, and the data glove is an important technical breakthrough for acquiring required data. Accurately acquiring and recognizing gesture data is the basis for stable work of data gloves. The traditional gesture data recognition technology mostly adopts a mode of recognizing images by a camera, and the recognition mode has larger recognition error, so a gesture data interpretation system and a gesture data interpretation method are provided to improve the gesture data recognition precision.
Disclosure of Invention
The application aims to provide a gesture data interpretation system and method so as to improve gesture data recognition accuracy.
In order to achieve the purpose, the application discloses the following technical scheme: a gesture data interpretation system, comprising:
the gyroscope module is configured to acquire gyroscope movement data when the data glove moves;
a bending sensor module configured to acquire finger joint bending motion data at a data glove joint;
a database configured to store reference gesture data for data pairing with the acquired motion data;
a sampling control module configured to define a sampling frequency of the gyroscope module and the bending sensor module on a data glove;
the main control module is configured as a control part for receiving, transmitting and matching the motion data and performs data interaction with the upper computer through the communication module.
Preferably, the gyroscope module includes a three-axis acceleration sensing unit, a three-axis gyroscope sensing unit, and a three-axis magnetometer sensing unit.
Preferably, the main control module is further configured to analyze the matched reference gesture data to obtain a control signal corresponding to the reference gesture data, and send the analyzed and obtained control signal to the corresponding motion terminal through the communication module.
Preferably, the gesture data interpretation system further comprises a condition judgment module, wherein the condition judgment module is configured to compare an amplitude value with a preset amplitude threshold value based on the amplitude value during the action of the data glove, the amplitude value being defined as the intensity corresponding to the movement of the data glove; when the amplitude value is smaller than the amplitude threshold value, the amplitude threshold value is defined as a numerical value when the maximum motion intensity which can be accepted by the data glove exceeds the motion intensity and gesture data cannot be recognized or accessories are damaged, the motion data collected by the gyroscope module and the bending sensor module are defined as effective gesture data sent by a user, and then the effective gesture data are matched with reference gesture data in the database under the control of the main control module; when the amplitude value is larger than the amplitude threshold value, the motion data collected by the gyroscope module and the bending sensor module are defined as invalid gesture data sent by a user, the main control module abandons the matching of the invalid gesture data and the reference gesture data in the database, and abandons or temporarily stores the invalid gesture data.
Preferably, the condition judgment module is connected to an alarm module, and when the amplitude value is greater than the amplitude threshold value, the main control module receives corresponding invalid gesture data and controls the alarm module to send an alarm, and meanwhile, the communication module transmits corresponding alarm information to the upper computer.
Based on the same inventive concept, the application also discloses a gesture data interpretation method, which comprises the following steps:
establishing a database: packaging basic data corresponding to each datum gesture data, and then respectively storing the basic data to form a database, wherein the basic data comprises gyroscope data, joint bending data and action instructions;
and (3) data detection: the method comprises the following steps that a gyroscope module acquires gyroscope motion data when a data glove moves, and a bending sensor module acquires finger joint bending motion data at a data glove joint;
data pairing: the main control module controls the acquired gyroscope motion data, the finger joint bending motion data and the reference gesture data in the database to be paired;
and (3) gesture analysis: analyzing the matched reference gesture data to obtain a corresponding action instruction;
in response to performing: the main control module transmits the acquired reference gesture data to an upper computer through a communication module, and the reference gesture data comprises the gyroscope data, the joint bending data and the action instruction.
Preferably, the response execution step further includes that the main control module sends a control instruction in the paired reference gesture data to the corresponding mobile terminal through the communication module.
Preferably, the data detecting step further includes detecting an amplitude value at the time of the motion of the data glove, the amplitude value being defined to correspond to a severity of the motion of the data glove.
Preferably, the step of establishing the database further comprises presetting an amplitude threshold corresponding to the data glove, wherein the amplitude threshold is defined as a value when the maximum value of the intensity of motion which can be accepted by the data glove exceeds the intensity of motion and gesture data cannot be recognized or part damage occurs;
the data pairing also comprises a condition judgment module which compares the detected amplitude value with an amplitude threshold value in the database; when the amplitude value is smaller than the amplitude threshold value, defining the motion data acquired by the gyroscope module and the bending sensor module as effective gesture data sent by a user, and then matching the effective gesture data with reference gesture data in the database under the control of the main control module; when the amplitude value is larger than the amplitude threshold value, the motion data collected by the gyroscope module and the bending sensor module are defined as invalid gesture data sent by a user, the main control module abandons the matching of the invalid gesture data and the reference gesture data in the database, and abandons or temporarily stores the invalid gesture data.
Preferably, the response execution step further includes that when the amplitude value is greater than the amplitude threshold value, the main control module receives corresponding invalid gesture data and controls the alarm module to send an alarm, and meanwhile, the communication module transmits corresponding alarm information to the upper computer.
Has the advantages that: according to the gesture data interpretation system and method, the data acquisition frequency and the data acquisition content of the data glove are controlled through the sampling control module, the gyroscope module and the bending sensor module, meanwhile, the data content of the data glove is acquired in an all-around mode through the gyroscope module and the bending sensor module, the gesture data of the data glove is accurately acquired and recognized through the control of the main control module and the establishment of the database, and the gesture data interpretation system and method have high precision. On the other hand, through the setting of condition judging module, can carry out accurate discernment to the data type that produces on the data gloves, and is specific, and the gesture data that the violent action that the data gloves took place to drop, collide and the user unconsciously made produced can not be controlled by host system and discerned, can avoid invalid gesture data promptly to be discerned, causes corresponding motion terminal to make the condition appearance that the invalid action appears movement disorder or even moving part damages, and then improves gesture data identification's the degree of accuracy.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a block diagram of a gesture data interpretation system according to an embodiment of the present disclosure;
FIG. 2 is a block flow diagram of a gesture data interpretation method according to an embodiment of the present disclosure.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The standard parts used in the present specification are commercially available and can be customized according to the description and drawings. Unless expressly stated or limited otherwise, the terms "mounted," "connected," and "connected" are intended to be inclusive and mean, for example, that they may be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present disclosure will be understood by those of ordinary skill in the art as appropriate, and machines, parts and equipment may be of a type conventional in the art without specific limitations.
In this document, the term "comprises/comprising" is intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Examples
Referring to fig. 1, a gesture data interpretation system includes a gyroscope module, a bending sensor module, a database, a sampling control module, and a main control module. Specifically, the method comprises the following steps:
the gyroscope module is configured to acquire gyroscope movement data when the data glove moves; the gyroscope module comprises a three-axis acceleration sensing unit, a three-axis gyroscope sensing unit and a three-axis magnetometer sensing unit, and correspondingly generated signals are three-axis acceleration sensing signals, three-axis gyroscope sensing signals and three-axis magnetometer sensing signals;
a bending sensor module configured to acquire finger joint bending motion data at a data glove joint;
a database configured to store reference gesture data for data pairing with the acquired motion data;
a sampling control module configured to define a sampling frequency of the gyroscope module and the bending sensor module on a data glove;
the main control module is configured as a control part for receiving, transmitting and matching the motion data and performs data interaction with an upper computer through the communication module; the communication module is also configured to analyze the matched reference gesture data to obtain a control signal corresponding to the reference gesture data, and to send the control signal obtained by analysis to the corresponding motion terminal.
Based on the gesture data interpretation system, the data acquisition frequency and the data acquisition content of the data glove are controlled through the sampling control module, the gyroscope module and the bending sensor module, meanwhile, the data content of the data glove is acquired in an all-around mode through the gyroscope module and the bending sensor module, and the gesture data of the data glove is accurately acquired and recognized through the control of the main control module and the establishment of the database.
As a preferred implementation manner of this embodiment, the gesture data interpretation system further includes a condition judgment module, where the condition judgment module is configured to compare an amplitude value of the data glove during motion with a preset amplitude threshold value based on the amplitude value, defined as a severity corresponding to the data glove during motion; when the amplitude value is smaller than the amplitude threshold value, the amplitude threshold value is defined as a numerical value when the maximum motion intensity which can be accepted by the data glove exceeds the motion intensity and gesture data cannot be recognized or accessories are damaged, the motion data collected by the gyroscope module and the bending sensor module are defined as effective gesture data sent by a user, and then the effective gesture data are matched with reference gesture data in the database under the control of the main control module; when the amplitude value is larger than the amplitude threshold value, the motion data collected by the gyroscope module and the bending sensor module are defined as invalid gesture data sent by a user, the main control module abandons the matching of the invalid gesture data and the reference gesture data in the database, and abandons or temporarily stores the invalid gesture data. Through the setting of the condition judgment module, the amplitude value corresponding to the gesture data generated by falling, collision and violent actions made unconsciously by a user when the data gloves are dropped is data exceeding the amplitude threshold value, at the moment, the gesture data generated by the actions are judged to be invalid gesture data, so that the situation that the invalid gesture data are identified, the corresponding motion terminal makes invalid actions, the motion disorder occurs, and even the motion part is damaged can be avoided, and the accuracy of gesture data identification is further improved.
Furthermore, the condition judgment module is connected with an alarm module, the alarm module can be any one of the prior art, when the amplitude value is greater than the amplitude threshold value, the main control module receives corresponding invalid gesture data and controls the alarm module to give an alarm, and meanwhile, corresponding alarm information is transmitted to the upper computer through the communication module. Through the setting of alarm module, the backstage of host computer department can in time acquire the abnormal operation state of data gloves, can in time make the strategy of coping when data gloves take place the striking, drop the circumstances such as, ensures that subsequent steps such as intelligent control that go on based on gesture recognition go on steadily.
By means of the gesture data interpretation system, the embodiment also discloses a gesture data interpretation method, as shown in fig. 2, the method includes the following steps:
s1, establishing a database: packaging basic data corresponding to each datum gesture data, and then respectively storing the basic data to form a database, wherein the basic data comprises gyroscope data, joint bending data and action instructions; presetting an amplitude threshold corresponding to the data glove, wherein the amplitude threshold is defined as a numerical value when the maximum motion intensity which can be accepted by the data glove exceeds the motion intensity and gesture data cannot be recognized or accessories are damaged;
s2, data detection: the method comprises the following steps that a gyroscope module acquires gyroscope motion data when a data glove moves, and a bending sensor module acquires finger joint bending motion data at a data glove joint; the method also comprises the steps of detecting an amplitude value of the data glove during motion, wherein the amplitude value is defined to correspond to the intensity of the data glove during motion;
s3, data pairing: the main control module controls the acquired gyroscope motion data, the finger joint bending motion data and the reference gesture data in the database to be paired; the condition judgment module is used for comparing the detected amplitude value with an amplitude threshold value in the database; when the amplitude value is smaller than the amplitude threshold value, defining the motion data acquired by the gyroscope module and the bending sensor module as effective gesture data sent by a user, and then matching the effective gesture data with reference gesture data in the database under the control of the main control module; when the amplitude value is larger than the amplitude threshold value, defining the motion data acquired by the gyroscope module and the bending sensor module as invalid gesture data sent by a user, and abandoning the pairing of the invalid gesture data and the reference gesture data in the database by the main control module and abandoning or temporarily storing the invalid gesture data;
s4, gesture analysis: analyzing the matched reference gesture data to obtain a corresponding action instruction;
s5, in response to execution: the main control module transmits the acquired reference gesture data to an upper computer through a communication module, wherein the reference gesture data comprises the gyroscope data, the joint bending data and the action instruction; the main control module sends a control instruction in the matched reference gesture data to the corresponding motion terminal through the communication module; when the amplitude value is larger than the amplitude threshold value, the main control module receives corresponding invalid gesture data and controls the alarm module to give an alarm, and meanwhile, corresponding alarm information is transmitted to the upper computer through the communication module.
Finally, it should be noted that: although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art can still make modifications on the technical solutions described in the foregoing embodiments, or make equivalent substitutions on some technical features, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present application should be included in the protection scope of the present application.
Claims (10)
1. A gesture data interpretation system, comprising:
the gyroscope module is configured to acquire gyroscope movement data when the data glove moves;
a bending sensor module configured to acquire finger joint bending motion data at a glove joint;
a database configured to store reference gesture data for data pairing with the acquired motion data;
a sampling control module configured to define a sampling frequency of the gyroscope module and the bending sensor module on a data glove;
the main control module is configured as a control part for receiving, transmitting and matching the motion data and performs data interaction with an upper computer through the communication module.
2. The gesture data interpretation system of claim 1, wherein the gyroscope module comprises a three axis acceleration sensing unit, a three axis gyroscope sensing unit, a three axis magnetometer sensing unit.
3. The gesture data interpretation system of claim 1, wherein the main control module is further configured to parse the matched reference gesture data to obtain a control signal corresponding to the reference gesture data, and send the parsed and obtained control signal to the corresponding mobile terminal through the communication module.
4. The gesture data interpretation system according to claim 1, further comprising a condition determination module configured to compare an amplitude value of the data glove during motion with a preset amplitude threshold value based on the amplitude value, defined as a severity corresponding to the motion of the data glove; when the amplitude value is smaller than the amplitude threshold value, the amplitude threshold value is defined as a numerical value when the maximum motion intensity which can be accepted by the data glove exceeds the motion intensity and gesture data cannot be recognized or accessories are damaged, the motion data collected by the gyroscope module and the bending sensor module are defined as effective gesture data sent by a user, and then the effective gesture data are matched with reference gesture data in the database under the control of the main control module; when the amplitude value is larger than the amplitude threshold value, the motion data collected by the gyroscope module and the bending sensor module are defined as invalid gesture data sent by a user, the main control module abandons the matching of the invalid gesture data and the reference gesture data in the database, and abandons or temporarily stores the invalid gesture data.
5. The gesture data interpretation system of claim 4, wherein the condition determining module is connected to an alarm module, and when the amplitude value is greater than the amplitude threshold value, the main control module receives corresponding invalid gesture data and controls the alarm module to send an alarm, and meanwhile, transmits corresponding alarm information to the upper computer through the communication module.
6. A gesture data interpretation method of the gesture data interpretation system according to any of the claims 1-5, characterized in that the method comprises the steps of:
establishing a database: packaging basic data corresponding to each datum gesture data, and then respectively storing the basic data to form a database, wherein the basic data comprises gyroscope data, joint bending data and action instructions;
and (3) data detection: the method comprises the following steps that a gyroscope module acquires gyroscope motion data when a data glove moves, and a bending sensor module acquires finger joint bending motion data at a data glove joint;
data pairing: the main control module controls the acquired gyroscope motion data, the finger joint bending motion data and the reference gesture data in the database to be paired;
and (3) gesture analysis: analyzing the matched reference gesture data to obtain a corresponding action instruction;
in response to performing: the main control module transmits the acquired reference gesture data to an upper computer through a communication module, and the reference gesture data comprises the gyroscope data, the joint bending data and the action instruction.
7. The gesture data interpretation method according to claim 6, wherein the response execution step further includes the step of the main control module sending a control instruction in the paired reference gesture data to the corresponding mobile terminal through the communication module.
8. The method of claim 6, wherein the step of detecting data further comprises detecting an amplitude value of the data glove during motion, the amplitude value being defined to correspond to the intensity of the data glove during motion.
9. The gesture data interpretation method according to claim 8, wherein the step of establishing the database further comprises presetting an amplitude threshold corresponding to the data glove, wherein the amplitude threshold is defined as a value when the maximum value of the intensity of motion which can be accepted by the data glove is exceeded and the gesture data cannot be recognized or the accessory is damaged;
the data pairing also comprises a condition judgment module which compares the detected amplitude value with an amplitude threshold value in the database; when the amplitude value is smaller than the amplitude threshold value, defining the motion data acquired by the gyroscope module and the bending sensor module as effective gesture data sent by a user, and then matching the effective gesture data with reference gesture data in the database under the control of the main control module; when the amplitude value is larger than the amplitude threshold value, the motion data collected by the gyroscope module and the bending sensor module are defined as invalid gesture data sent by a user, the main control module abandons the matching of the invalid gesture data and the reference gesture data in the database, and abandons or temporarily stores the invalid gesture data.
10. The gesture data interpretation method of claim 9, wherein the response execution step further comprises the step of receiving corresponding invalid gesture data and controlling an alarm module to send an alarm when the amplitude value is greater than the amplitude threshold value, and transmitting corresponding alarm information to the upper computer through the communication module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210746191.0A CN114967934A (en) | 2022-06-28 | 2022-06-28 | Gesture data interpretation system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210746191.0A CN114967934A (en) | 2022-06-28 | 2022-06-28 | Gesture data interpretation system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114967934A true CN114967934A (en) | 2022-08-30 |
Family
ID=82966370
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210746191.0A Pending CN114967934A (en) | 2022-06-28 | 2022-06-28 | Gesture data interpretation system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114967934A (en) |
-
2022
- 2022-06-28 CN CN202210746191.0A patent/CN114967934A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105184325B (en) | Mobile intelligent terminal | |
| US9757861B2 (en) | User interface device of remote control system for robot device and method using the same | |
| KR101939683B1 (en) | Apparatus and method for recognizing user activity | |
| KR101531561B1 (en) | Apparatus and method for automatic call termination/origination based on pose of user in portbale terminal | |
| EP2363735B1 (en) | Photoelectric sensor and method for aiding operational checking of photoelectric sensor | |
| WO2017092224A1 (en) | Rfid-based gesture recognition method and system | |
| CN107255339B (en) | Air conditioner control method based on terminal equipment, terminal equipment and storage medium | |
| US9760808B2 (en) | Image processing system, server device, image pickup device and image evaluation method | |
| CN110012432B (en) | Positioning method, system, server and medium based on Internet of things | |
| CN106774889B (en) | Gesture recognition method and device of wearable device | |
| CN105807640A (en) | Terminal control method and terminal control system | |
| CN111785003A (en) | Voice transmission control method, voice remote controller, terminal device, and storage medium | |
| CN106598231B (en) | gesture recognition method and device | |
| CN114967934A (en) | Gesture data interpretation system and method | |
| CN117376391B (en) | Automatic sensor identification method and device applied to water quality monitor | |
| US20190041287A1 (en) | Tap Detection Device | |
| JP3678388B2 (en) | Pen-type input device and pattern recognition method for pen-type input device | |
| CN110830910B (en) | Terminal positioning state identification method and device, electronic equipment and storage medium | |
| KR101970872B1 (en) | Apparatus and method for analyzing driver's posture and condition | |
| CN106598232A (en) | Gesture recognition method and device | |
| CN110674683B (en) | Robot hand motion recognition method and system | |
| CN115476347B (en) | Communication link establishment method and device, control equipment and robot | |
| CN105703832B (en) | A kind of fiber-optic signal processing method and processing device | |
| KR20190073752A (en) | Apparatus for processing multi sensor data | |
| CN112135252B (en) | Recognition device for position and direction of moving body |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |