CN111337050A - Zero-speed judgment condition and step counting method based on multi-condition fusion - Google Patents
Zero-speed judgment condition and step counting method based on multi-condition fusion Download PDFInfo
- Publication number
- CN111337050A CN111337050A CN202010201694.0A CN202010201694A CN111337050A CN 111337050 A CN111337050 A CN 111337050A CN 202010201694 A CN202010201694 A CN 202010201694A CN 111337050 A CN111337050 A CN 111337050A
- Authority
- CN
- China
- Prior art keywords
- condition
- particle
- zero
- acceleration
- angular velocity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000004927 fusion Effects 0.000 title claims abstract description 20
- 230000001133 acceleration Effects 0.000 claims abstract description 36
- 239000002245 particle Substances 0.000 claims description 56
- 238000005457 optimization Methods 0.000 claims description 20
- 238000005070 sampling Methods 0.000 claims description 15
- 238000004364 calculation method Methods 0.000 claims description 4
- 239000011541 reaction mixture Substances 0.000 claims description 4
- 238000001914 filtration Methods 0.000 claims description 3
- 238000012804 iterative process Methods 0.000 claims description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000003068 static effect Effects 0.000 description 3
- 238000006073 displacement reaction Methods 0.000 description 2
- 238000007796 conventional method Methods 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C22/00—Measuring distance traversed on the ground by vehicles, persons, animals or other moving solid bodies, e.g. using odometers, using pedometers
- G01C22/006—Pedometers
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The invention discloses a zero-speed judgment condition and step counting method based on multi-condition fusion, which comprises the steps of firstly wearing a portable acquisition device for a sporter to acquire accelerations in three directions of x, y and z and angular velocities in three directions; then calibrating zero-speed judgment condition thresholds of different moving personnel; and finally, judging the zero speed and finishing step counting based on the zero speed judgment method of the multi-condition fusion. The zero-speed judgment method introduces different zero-speed judgment conditions to jointly judge the zero speed, so that the zero-speed judgment is more accurate; and the number of the moving steps is calculated based on the proposed accurate zero-speed judgment method, so that the step counting is more accurate.
Description
Technical Field
The invention relates to a step counting method, in particular to a step counting strategy of a portable motion acquisition device for rehabilitation motion, and belongs to the technical field of motion analysis.
Background
The portable motion parameter acquisition equipment brings new development for rehabilitation exercises. The rehabilitation population can train at home, and the physician can analyze the motion data from the internet. The key to the motion analysis of the rehabilitation population is the accurate detection of foot contact time periods during walking, i.e., zero velocity time periods.
The portable motion parameter acquisition equipment comprises an acceleration sensor and an angular velocity sensor. The speed and position of the wearer gradually diverge due to the inaccuracy of the sensor itself. The zero velocity detection method updates the velocity within a step by detecting the zero velocity of each step of the wearer, thereby reducing errors. Typically, each person has a zero speed interval of 0.2-0.4 seconds in normal walking. This interval begins with full foot contact and ends with the beginning of foot lift advancement. Zero velocity detection is critical to accurately measuring the velocity and displacement of the wearer. In the conventional method, whether the difference between the acceleration and the angular velocity is lower than a threshold value is regarded as a static condition, or whether a certain component value of the acceleration and the angular velocity is lower than the threshold value is regarded as a static condition, or whether the angular velocity modulo is lower than a certain threshold value is regarded as a static judgment condition. These quiescent conditions do not identify the zero speed interval one hundred percent.
Disclosure of Invention
The invention provides a zero-speed judgment condition with multi-condition fusion, and provides a step counting algorithm on the basis of the zero-speed judgment condition, aiming at the problem that the current portable motion acquisition equipment needs to judge the motion zero speed and the current zero-speed judgment condition cannot be used for judging the zero speed in a hundred percent.
The invention provides a zero-speed judgment condition and step counting method based on multi-condition fusion, which comprises the following steps:
step 2, calibrating zero-speed judgment condition thresholds of different sports personnel;
and 3, judging the zero speed and finishing step counting based on the proposed zero speed judgment method of multi-condition fusion.
The invention has the advantages that:
1. the zero-speed judgment condition and the step counting method based on multi-condition fusion introduce different zero-speed judgment conditions to jointly judge the zero speed, so that the zero-speed judgment is more accurate;
2. the zero-speed judging condition and the step counting method based on multi-condition fusion calculate the number of the moving steps based on the accurate zero-speed judging method, so that the step counting is more accurate.
Drawings
FIG. 1 is an overall flowchart of the zero-speed judgment condition and step counting method based on multi-condition fusion.
FIG. 2 is a flow chart of an objective function in the zero-speed judgment condition and step counting method based on multi-condition fusion according to the present invention.
FIG. 3 is a flow chart of a particle group optimization algorithm in the zero-speed judgment condition and step counting method based on multi-condition fusion.
FIG. 4 is a flow chart of the method for judging zero speed and counting steps by multi-condition fusion according to the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings.
The zero-speed judgment condition and the step counting method based on multi-condition fusion firstly realize a practical and effective zero-speed identification method, and count steps on the basis of the practical and effective zero-speed identification method, and the embodiment of the invention is described by being divided into the following three steps as shown in figure 1.
The method comprises the following steps: and acquiring acceleration and angular speed signals measured by the portable measuring equipment.
The portable measuring equipment is worn on the instep of the person to be measured, and no relative displacement exists between the portable measuring equipment and the person to be measured. Measuring the accelerations [ ax, ay, az ] of N tested personnel in three directions of space x, y and z and the angular velocities [ gx, gy and gz ] of the three directions by using measuring equipment at a certain sampling period;
step two: and (4) calibrating thresholds under different conditions.
A. The different conditions include a modulus condition of acceleration and angular velocity, a difference condition of acceleration and angular velocity, and a duration condition. Specifically, the acceleration signals acquired by the kth sampling are a (k) x, a (k) y, a (k) z, and the angular velocity signals are g (k) x, g (k) y, g (k) z; then:
a. the acceleration mode conditions are:
in the formula (1), athThe threshold value representing the acceleration mode condition is the amount to be sought.
b. The angular velocity mode conditions were:
in the formula (2), gthThe threshold value representing the angular velocity mode condition is the quantity to be sought.
c. The acceleration difference condition is:
in the formula (3), the reaction mixture is,threshold representing acceleration differential condition, a (k-1)x,a(k-1)y,a(k-1)zRepresenting acceleration signals in x, y and z directions acquired by the k-1 th sampling.
d. The angular velocity difference condition is:
in the formula (4), the reaction mixture is,threshold value representing angular velocity difference condition, g (k-1)x,g(k-1)y,g(k-1)zRepresenting the angular velocity signals of the x, y and z directions acquired by the k-1 th sampling.
e. The time length condition is as follows:
if the acquired acceleration signal and the acquired angular velocity signal start to satisfy the modulus condition and the difference condition from the sampling of the s-th time, and one of the modulus condition and the difference condition is not satisfied until the sampling of the e-th time, the time duration condition is as follows:
(e-s)Ts>tth(5)
wherein,Tsrepresenting the sampling period, tthRepresenting a time condition threshold.
The foot contact time is determined using a logical and combination of three conditions. Identification of optimal a by threshold calibrationth,gth,And tthAnd the motion data meeting the mold condition, the differential condition and the duration condition are all the data acquired when the foot touches the ground, and the unsatisfied data are all the motion data generated when the foot does not touch the ground.
B. Before the threshold value is calibrated, an objective function of the optimization algorithm needs to be defined. Specifically, as shown in fig. 2, the motion data of N persons is filtered from the data collected in step 1, and the maximum value a of the norm of all the acceleration data and angular velocity data is obtainedmaxMinimum value aminAnd maximum differential accelerationMinimum valueMaximum value of angular velocity differenceMinimum valueWhen each person walks, the longest period of the minimum touchdown period is T. The range of the mode is [ a ]min,amax],[gmin,gmax](ii) a The difference range isDuration range of [0, T]. Within these different ranges, the variable a to be optimized is giventh,gth,tth。
Starting from the first person's movement, let the initial optimization objective cost be zero. And (5) setting i to 1, and obtaining the number of time periods which satisfy the modulus condition, the duration condition and the difference condition for the motion of the ith person, namely calculating the number of touchdown times by the algorithmJudging whether the contact time of the ith individual is step according to the periodic naked eyes of walkingi. Local optimization objectives for the ith individual are derived:
and updating the optimization objective:
adding 1 to i, and repeating the calculation steps to calculate Qi; until i is greater than N. The optimization objective isThe final value of (c).
C. Carrying out threshold calibration by utilizing a particle swarm optimization algorithm, specifically, solving the optimal a by utilizing the particle swarm optimization algorithmth,gth,tthThe objective function is minimized. The particle swarm optimization algorithm has an optimization variable dimension of 5, and is shown in fig. 3, specifically as follows:
(a) setting the number of population particles as m and the particle dimension 5;
(b) randomly initializing the speed and position of each particle in the population to obtain the initial population positionThe lower corner marks the particle number umIs a five-dimensional vector representing the position of the m-th particle, isOne possible solution in the optimization process, namely ath,gth,tthThe upper corner mark "1" indicates that the 1 st iteration is currently performed; setting an initial population velocity v (1);
(c) in an iterative process, the objective function values for each possible solution are compared. Setting the optimal position (the target function value is minimum) of each particle in the iteration process as the optimal position of the particle, wherein the optimal position of the ith particle is pbest,i(ii) a The optimal positions in all the particles are obtained through comparison and are set as the optimal positions g of the particle swarmbest;
(d) And updating the particle speed and the position of each particle, taking the ith particle as an example, and expressing the following expression:
where v is the particle velocity, u is the particle position, w is the inertial weight, r1And r2Is distributed in the interval [0,1]The random number in the table, s is the current iteration number, the initial value is 1,for the individual optimal particle position of the ith particle at the s-th iteration,is the global optimum particle position at the s-th generation, c1And c2Is a constant.
(e) calculating the objective function value of each particle in the step s +1 and comparing the objective function value with the previous optimal positionThe corresponding obtained targetComparing function values, and if the current position is better (the value of the standard function is smaller), taking the current position as the optimal position of the particleThe objective function value of each particle and the optimal particle position of the particle swarm are comparedIn comparison, if the current position is better (the target function value is smaller), the optimal particle position is updated
(f) Checking the final value condition, if the precision (the size of the objective function value) meets a preset condition or the iteration number exceeds a limit, stopping iteration, and otherwise, repeating the steps (c) to (f);
Step four: using the solved optimal ath,gth,tthThe touchdown period determination is made and steps are counted, as shown in fig. 4. Specifically, for acceleration and angular velocity data acquired by a section of motion, firstly, filtering the data, then calculating an acceleration mode, an angular velocity mode, an acceleration difference and an angular velocity difference of each sampling moment in the section of motion, searching a data section which continuously meets a mode condition and a difference condition in the filtered data, and judging whether the duration of the data section meets a duration condition tthIf the time interval is satisfied, the time interval is a touchdown time interval, the absolute speed is 0, the times of the time interval satisfying the condition are counted, and the obtained times are the walking timesCounting; if not, the time period is not a touchdown period.
The threshold condition calculation method avoids complex attempts of a traditional method for searching and judging the threshold, provides a new idea for threshold condition calculation, integrates the module conditions of angular velocity and acceleration, difference conditions and duration conditions by the threshold condition and the step counting method, and can effectively reduce step counting errors.
Claims (5)
1. A zero-speed judgment condition and step counting method based on multi-condition fusion is characterized in that:
step 1: acquiring acceleration [ ax, ay, az ] in three directions of x, y and z and angular velocity [ gx, gy and gz ] in three directions by a portable acquisition device worn by a sportsman;
step 2: calibrating zero-speed judgment condition thresholds of different sports persons;
and step 3: and judging the zero speed and finishing step counting based on a zero speed judgment method of multi-condition fusion.
The method comprises the following steps: and acquiring acceleration and angular speed signals measured by the portable measuring equipment.
2. The method for zero-speed judgment and step counting based on multi-condition fusion as claimed in claim 1, wherein: the specific method of the step 2 comprises the following steps:
A. the different conditions include a modulus condition of acceleration and angular velocity, a difference condition of acceleration and angular velocity, and a duration condition. Specifically, the acceleration signals acquired by the kth sampling are a (k) x, a (k) y, a (k) z, and the angular velocity signals are g (k) x, g (k) y, g (k) z; then:
a. the acceleration mode conditions are:
in the formula (1), athA threshold value representing an acceleration mode condition is a quantity to be solved;
b. the angular velocity mode conditions were:
in the formula (2), gthA threshold value representing the angular velocity mode condition is a quantity to be solved;
c. the acceleration difference condition is:
in the formula (3), the reaction mixture is,threshold representing acceleration differential condition, a (k-1)x,a(k-1)y,a(k-1)zRepresenting acceleration signals in x, y and z directions acquired by sampling at the (k-1) th time;
d. the angular velocity difference condition is:
in the formula (4), the reaction mixture is,threshold value representing angular velocity difference condition, g (k-1)x,g(k-1)y,g(k-1)zRepresenting angular velocity signals in x, y and z directions acquired by sampling at the (k-1) th time;
e. the time length condition is as follows:
if the acquired acceleration signal and the acquired angular velocity signal start to satisfy the modulus condition and the difference condition from the sampling of the s-th time, and one of the modulus condition and the difference condition is not satisfied until the sampling of the e-th time, the time duration condition is as follows:
(e-s)Ts>tth
wherein, TsRepresenting the sampling period, tthA representative duration condition threshold;
judging the foot contact time by using the logic and combination of the three conditions; identification of optimal a by threshold calibrationth,gth,And tthThe motion data meeting the mold condition, the differential condition and the duration condition are all data acquired when the foot touches the ground, and the unsatisfied data are all motion data generated when the foot does not touch the ground;
3. The method as claimed in claim 1, wherein the method for zero-speed judgment and step counting based on multi-condition fusion is as follows: before the threshold value is calibrated, an objective function of an optimization algorithm needs to be defined; filtering the motion data of N persons from the data collected in the step 1, and then obtaining the maximum value a of the modulus of all the acceleration data and the angular velocity datamaxMinimum value aminAnd maximum differential accelerationMinimum valueMaximum value of angular velocity differenceMinimum valueWhen each person walks, the longest period of the minimum touchdown period is T. The range of the mode is [ a ]min,amax],[gmin,gmax](ii) a The difference range isDuration range of [0, T](ii) a Within these different ranges, the variable a to be optimized is giventh,gth,tth;
Starting from the first person's movement, let the initial optimization objective cost be zero. And (5) setting i to 1, and obtaining the number of time periods which satisfy the modulus condition, the duration condition and the difference condition for the motion of the ith person, namely calculating the number of touchdown times by the algorithmJudging whether the contact time of the ith individual is step according to the walking periodicityi. Local optimization objectives for the ith individual are derived:
and updating the optimization objective:
4. The method for zero-speed judgment and step counting based on multi-condition fusion as claimed in claim 2, wherein: the specific method of the step C comprises the following steps:
the particle swarm optimization algorithm optimizes the variable dimension to be 5, and the optimization algorithm is as follows:
(a) setting the number of population particles as m and the particle dimension 5;
(b) randomly initializing the speed and position of each particle in the population to obtain the initial population positionThe lower corner marks the particle number umIs a five-dimensional vector representing the position of the m-th particle, which is a possible solution in the optimization process, namely ath,gth,tthThe upper corner mark "1" indicates that the 1 st iteration is currently performed; setting an initial population velocity v (1);
(c) in an iterative process, the objective function values for each possible solution are compared. Setting the optimal position (the objective function value is minimum) of each particle in the iterative process as the optimal position of the particle, wherein the optimal position of the ith particle is pbest,i(ii) a The optimal positions in all the particles are obtained through comparison and are set as the optimal positions g of the particle swarmbest;
(d) And updating the particle speed and the position of each particle, taking the ith particle as an example, and expressing the following expression:
where v is the particle velocity, u is the particle position, w is the inertial weight, r1And r2Is distributed in the interval [0,1]The random number in the table, s is the current iteration number, the initial value is 1,for the individual optimal particle position of the ith particle at the s-th iteration,is the global optimum particle position at the s-th generation, c1And c2Is a constant;
(e) calculating the objective function value of each particle in the step s +1 and comparing the objective function value with the previous optimal positionComparing the obtained objective function values, and if the current position is better (the value of the standard function is smaller), taking the current position as the optimal position of the particleThe objective function value of each particle and the optimal particle position of the particle swarm are comparedIn comparison, if the current position is better (the objective function value is smaller), the optimal particle position is updated
(f) Checking the final value condition, if the precision (the size of the objective function value) meets a preset condition or the iteration number exceeds a limit, stopping iteration, and otherwise, repeating the steps (c) to (f);
5. The method as claimed in claim 1, wherein the method for zero-speed judgment and step counting based on multi-condition fusion comprises: the specific method of the step 3 comprises the following steps: for acceleration and angular velocity data acquired by a section of motion, firstly filtering the data, then calculating an acceleration module, an angular velocity module, an acceleration difference and an angular velocity difference of each sampling moment in the section of motion, searching a data section which continuously meets a module condition and a difference condition in the filtered data, judging whether the duration of the data section meets the duration condition, if so, determining the time section is a touchdown time section and the absolute velocity is 0, counting the times of the time section meeting the condition, and obtaining the times which are walking steps; if not, the time period is not a touchdown period.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010201694.0A CN111337050B (en) | 2020-03-20 | 2020-03-20 | Zero-speed judgment condition and step counting method based on multi-condition fusion |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010201694.0A CN111337050B (en) | 2020-03-20 | 2020-03-20 | Zero-speed judgment condition and step counting method based on multi-condition fusion |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111337050A true CN111337050A (en) | 2020-06-26 |
CN111337050B CN111337050B (en) | 2023-03-28 |
Family
ID=71180367
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010201694.0A Active CN111337050B (en) | 2020-03-20 | 2020-03-20 | Zero-speed judgment condition and step counting method based on multi-condition fusion |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111337050B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114019182A (en) * | 2021-11-04 | 2022-02-08 | 苏州挚途科技有限公司 | Zero-speed state detection method and device and electronic equipment |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106225786A (en) * | 2016-08-15 | 2016-12-14 | 北京理工大学 | A kind of adaptive pedestrian navigation system zero-speed section detecting method |
WO2017124809A1 (en) * | 2016-01-21 | 2017-07-27 | 上海斐讯数据通信技术有限公司 | Particle swarm optimization method and system based on gpu operation of mobile terminal |
WO2019109757A1 (en) * | 2017-12-06 | 2019-06-13 | 华南理工大学 | Method for using particle swarm algorithm to optimize power electronic circuit |
CN110274592A (en) * | 2019-07-18 | 2019-09-24 | 北京航空航天大学 | A kind of zero-speed section of waist foot Inertial Measurement Unit information fusion determines method |
CN110553643A (en) * | 2019-09-17 | 2019-12-10 | 电子科技大学 | pedestrian self-adaptive zero-speed updating point selection method based on neural network |
CN110715659A (en) * | 2019-10-25 | 2020-01-21 | 高新兴物联科技有限公司 | Zero-speed detection method, pedestrian inertial navigation method, device and storage medium |
-
2020
- 2020-03-20 CN CN202010201694.0A patent/CN111337050B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017124809A1 (en) * | 2016-01-21 | 2017-07-27 | 上海斐讯数据通信技术有限公司 | Particle swarm optimization method and system based on gpu operation of mobile terminal |
CN106225786A (en) * | 2016-08-15 | 2016-12-14 | 北京理工大学 | A kind of adaptive pedestrian navigation system zero-speed section detecting method |
WO2019109757A1 (en) * | 2017-12-06 | 2019-06-13 | 华南理工大学 | Method for using particle swarm algorithm to optimize power electronic circuit |
CN110274592A (en) * | 2019-07-18 | 2019-09-24 | 北京航空航天大学 | A kind of zero-speed section of waist foot Inertial Measurement Unit information fusion determines method |
CN110553643A (en) * | 2019-09-17 | 2019-12-10 | 电子科技大学 | pedestrian self-adaptive zero-speed updating point selection method based on neural network |
CN110715659A (en) * | 2019-10-25 | 2020-01-21 | 高新兴物联科技有限公司 | Zero-speed detection method, pedestrian inertial navigation method, device and storage medium |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114019182A (en) * | 2021-11-04 | 2022-02-08 | 苏州挚途科技有限公司 | Zero-speed state detection method and device and electronic equipment |
CN114019182B (en) * | 2021-11-04 | 2024-02-02 | 苏州挚途科技有限公司 | Zero-speed state detection method and device and electronic equipment |
Also Published As
Publication number | Publication date |
---|---|
CN111337050B (en) | 2023-03-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104061934B (en) | Pedestrian indoor position tracking method based on inertial sensor | |
CN104075730B (en) | Gait counting method and gait counter | |
AU781848B2 (en) | Pedestrian navigation method and apparatus operative in a dead reckoning mode | |
EP2165203B1 (en) | Method and device for measuring the progress of a moving person | |
CN107048570B (en) | A kind of data analysis processing method of Intelligent insole | |
EP2137493B1 (en) | Method and device for measuring the progress of a moving person | |
WO2015113915A1 (en) | Improvements in the detection of walking in measurements of the movement of a user | |
CN108537101B (en) | Pedestrian positioning method based on state recognition | |
CN107219924A (en) | A kind of aerial gesture identification method based on inertial sensor | |
Ryu et al. | Adaptive step detection algorithm for wireless smart step counter | |
CN103630147B (en) | A kind of individual autonomy navigation system zero-speed detection method based on HMM | |
CN106422274A (en) | Multi-sensor-based assessment system for yoga | |
US12109453B2 (en) | Detecting outdoor walking workouts on a wearable device | |
Groh et al. | Wearable trick classification in freestyle snowboarding | |
CN111337050B (en) | Zero-speed judgment condition and step counting method based on multi-condition fusion | |
CN109998551A (en) | A kind of gait phase analysis method of segmented local peak detection | |
CN110313918A (en) | A kind of gait phase recognition methods and system based on plantar pressure | |
CN206121113U (en) | Yoga evaluation system based on multisensor | |
CN109540133A (en) | Adaptive gait division methods, system based on micro- inertial technology | |
US20220042801A1 (en) | Methods and systems for adaptive pedestrian inertial navigation | |
CN105953794B (en) | A kind of meter step air navigation aid based on MEMS sensor | |
KR20160020915A (en) | Apparatus and method for counting step in smartphone | |
Chen et al. | Pedestrian positioning with physical activity classification for indoors | |
CN109084765B (en) | Indoor walking positioning method and device for pedestrian and storage medium | |
CN116049158A (en) | Soil information acquisition method based on multi-sensor data fusion algorithm |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |