CN112861562A - Detection method and system for detecting sitting posture abnormality - Google Patents
Detection method and system for detecting sitting posture abnormality Download PDFInfo
- Publication number
- CN112861562A CN112861562A CN201911097793.2A CN201911097793A CN112861562A CN 112861562 A CN112861562 A CN 112861562A CN 201911097793 A CN201911097793 A CN 201911097793A CN 112861562 A CN112861562 A CN 112861562A
- Authority
- CN
- China
- Prior art keywords
- sitting posture
- data
- information
- module
- deviation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The invention provides a detection method for detecting sitting posture abnormality, which comprises the following steps: s1, presetting standard sitting posture data; s2, a sitting posture processing calculation module is used for acquiring sitting posture information data; s3, comparing the real-time sitting posture information data with the standard sitting posture data; s4, determine if the deviation exceeds a threshold If not, re-enter step S2; if yes, carrying out the next step; s5, determine whether the state duration exceeding the threshold in step 2 exceeds a specified period If not, the step S2 is re-entered, and if yes, the next step is carried out; and S6, alarming for abnormal sitting posture.
Description
Technical Field
The invention relates to the field of human head detection, in particular to a detection method and a detection system for detecting sitting posture abnormality.
Background
With the continuous development of science and technology, particularly the development of computer vision technology, human head detection technology is widely applied to various fields of information security, electronic authentication and the like, and the image feature extraction method has good identification performance. Among them, sitting posture detection is also an important content in the field of recognition. In the prior art, the method comprises the steps of 1, measuring the distance between a person and a sensor based on ultrasonic waves, laser lines and the like, and judging whether the sitting posture is standard or not according to the distance. 2. Based on the depth sensor, the sitting posture information of people is collected, key data is extracted to establish a sitting posture model, and the sitting posture model is used for detecting and judging the actual sitting posture. 3. Based on the image sensor, the angle of the human face, the state of human eyes and the like are collected and compared with a preset threshold value to judge the standard sitting posture.
However, in the prior art, the following disadvantages exist:
1. the method has the advantages that the distance between a person and the detection device is detected based on laser rays and ultrasonic waves, whether the sitting posture of the person is correct or not is judged according to the detection result, the method has a good detection effect on large-amplitude posture change, but the method cannot accurately judge local unhealthy sitting postures such as a side face and a head bending position, and the ultrasonic waves and the laser rays used by the methods are harmful to the health of the person in the radioactive environments for a long time.
2. The patent CN102096801A discloses that the sitting posture is abnormal by acquiring the inclination angle of the face, the area difference of the eye area, and the head-shoulder curve difference, and making the difference with the initially acquired standard data to exceed the preset threshold value based on the information of the image. The method only uses the inclination angle of the face, and can only judge the abnormal sitting posture when the face inclines, but cannot judge the abnormal sitting posture when the face is on the side. In addition, because the method is easily influenced by illumination, the sitting posture standards of different people are different, and thus errors are easily caused when different people are detected.
3. The CN107169453A patent is based on sitting posture detection of a depth sensor, which needs to use the depth sensor to acquire a depth image, and the cost of the depth sensor is higher than that of a common image sensor.
Furthermore, common terms in the art include:
1) the human head detection module: inputting an image containing a complete head, and returning the bounding box coordinate of the head in the image by the head detection module.
2) The human head space angle: the human head three-angle rotating device consists of a pitch, a yaw and a roll of the human head, wherein the pitch rotates around a y axis; yaw is rotation about the z-axis; the roll is rotated about the x-axis. For the pitch, yaw, roll explanation see fig. 4.
3) The human head angle detection module: inputting a gray image of ROI (Region of Interest) data of a human head to acquire a spatial angle of the human head.
4) And sitting posture information: there is spatial angle of the head and spatial position information of the head.
5) Standard sitting posture information: a person has one or more sets of sitting posture information collected by the present invention while sitting at a table or other location in a standard posture.
6) And an IOU: the IOU is called Intersection over Union (Intersection over Union), and the IOU calculates the ratio of the Intersection and Union of two bounding boxes: for the IOU, the interpretation is shown in FIG. 5.
7) And head space position offset value: and calculating the IOU of the bounding box as the head position deviation value according to the bounding box detected in the head detection module.
Disclosure of Invention
In order to solve the above problems, the present invention is directed to:
1. the novel sitting posture detection method is provided, the sitting posture detection can be carried out by using a common image sensor, the abnormal sitting posture alarm can be realized, the influence on the human health caused by similar ultrasonic waves, laser lines and the like can be avoided, and the product cost can be reduced.
2. According to the invention, after the image data is obtained, the sitting posture information is obtained, and various unhealthy sitting postures such as head-down, side face, head-bending, face-bending, body-leaning and the like of the target can be detected through the sitting posture information.
Specifically, the invention provides a detection method for detecting sitting posture abnormality, which comprises the following steps:
s1, presetting standard sitting posture data;
s2, a sitting posture processing calculation module is used for acquiring sitting posture information data;
s3, comparing the real-time sitting posture information data with the standard sitting posture data;
s4, determine if the deviation exceeds a threshold? If not, re-enter step S2; if yes, carrying out the next step;
s5, determine whether the state duration exceeding the threshold in step 2 exceeds a specified period? If not, the step S2 is re-entered, and if yes, the next step is carried out;
and S6, alarming for abnormal sitting posture.
The sitting posture calculating module in step S2 is configured to obtain sitting posture information, and includes: the device comprises a human head detection module, a human head angle detection module and a sitting posture calculation information.
The processing sitting posture calculating module of the step S2 further includes:
a, the human head detection module obtains data of a boundary frame of the human head from image data;
b, acquiring human head ROI data according to the human head boundary frame and transmitting the human head ROI data to the human head angle detection module to acquire data of a human head space angle;
c, the calculation of the sitting posture information is to integrate the obtained data information of the head boundary frame and the head space angle together for other modules to calculate.
The comparing the real-time sitting posture information data with the standard sitting posture data in the step S3 further includes:
A. in the detection, acquiring sitting posture information of the current frame and performing deviation calculation on the preset sitting posture information;
B. and calculating the head space angle deviation value and the head space position deviation value.
In step S4, the determining whether the deviation exceeds a threshold value further includes: if the two deviation values of the head space angle deviation value and the head space position deviation value obtained by calculation do not exceed the preset threshold value, the currently collected sitting posture is considered to be normal, and the sitting posture information is continuously monitored; and if one or both of the calculated head space angle deviation value and the calculated head space position deviation value exceed a preset threshold, determining that the current sitting posture is abnormal, and performing the next step.
The threshold corresponding to the head space angle deviation value in the step S4 is a first threshold; and the threshold value corresponding to the human head space position deviation value is a second threshold value.
In step S5, the determining whether the exceeding threshold state duration exceeds a specified period further includes: when the deviation exceeds a threshold value, starting to accumulate the number of the abnormal sitting posture frames and simultaneously starting to time when the sitting posture is abnormal, and when the abnormal sitting posture count exceeds a preset number in the specified period, confirming that the abnormal sitting posture is established, and performing step S6 to give an alarm signal; otherwise, the information is regarded as false information, and the sitting posture information is continuously monitored.
The preset number is a positive integer greater than 1, such as 3 times or 4,5 times, 10 times, etc.
The application still relates to a detecting system who detects sitting posture anomaly, includes: a standard sitting posture module, a sitting posture calculating module and a comparing and judging module are preset, wherein,
the preset standard sitting posture data module is used for presetting standard sitting posture information data;
the sitting posture calculation module is used for acquiring sitting posture information;
the comparison and judgment module is used for comparing the deviation between the real-time sitting posture and the standard sitting posture, judging whether the deviation exceeds a threshold value or not and judging whether the state lasts for a period or not;
the system applies the method described above.
Thus, the present application has the advantages that: the sitting posture detection can be carried out by using a common image sensor, the abnormal sitting posture alarm can be realized, the influence on human health caused by similar ultrasonic waves, laser lines and the like can be avoided, and meanwhile, the product cost can also be reduced. After the image data is acquired through the method and the system, the sitting posture information is acquired, various unhealthy sitting postures such as target head-lowering, side-facing, head-bending, lying down, body inclination and the like can be detected through the sitting posture information, and the method is simple and has a good effect.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the principles of the invention.
Fig. 1 is a schematic block diagram of a flow chart of a method to which the present invention relates.
FIG. 2 is a schematic block diagram of a sitting posture calculation module in steps of the method of the present invention.
Fig. 3 is a schematic block diagram of a specific system of the present invention.
FIG. 4 is a schematic diagram of the sitting posture detection of the present invention.
FIG. 5 is a graphical illustration of the IOU ratio involved in the present invention.
Detailed Description
In order that the technical contents and advantages of the present invention can be more clearly understood, the present invention will now be described in further detail with reference to the accompanying drawings.
As shown in fig. 1, the invention relates to a sitting posture detection method, comprising the following steps:
s1, presetting standard sitting posture data;
s2, a processing sitting posture calculation module is used for acquiring sitting posture information;
s3, comparing the real-time coordinates with the standard sitting posture data;
s4, determine if the deviation exceeds a threshold? If not, re-enter step S4; if yes, carrying out the next step;
s5, determine whether the state duration exceeding the threshold in step 2 exceeds a specified period? If not, the step S2 is re-entered, and if yes, the next step is carried out;
and S6, alarming for abnormal sitting posture, and assigning Alarm to 1.
The sitting posture calculating module in step S2, as shown in fig. 2, is configured to obtain sitting posture information, and includes: the device comprises a human head detection module, a human head angle detection module and a sitting posture calculation information.
The processing seating posture calculation module of step S2 further includes:
a, the human head detection module obtains data of a bounding box (bounding box) of the human head from image data;
b, according to a human head boundary frame (bounding box), deducting human head ROI data and transmitting the human head ROI data to the human head angle detection module to obtain data of a human head space angle;
c, the calculation of the sitting posture information is to integrate the obtained data information of the head bounding box (bounding box) and the head space angle together for other modules to calculate.
Comparing the real-time sitting posture with the standard sitting posture deviation in the step S3, further comprising:
A. in the detection, acquiring sitting posture information of the current frame and performing deviation calculation on the preset sitting posture information;
B. and calculating the head space angle deviation value and the head space position deviation value.
In step S4, whether the deviation exceeds a threshold value further includes:
if the two deviation values of the head space angle deviation value and the head space position deviation value obtained by calculation do not exceed the preset threshold value, the currently collected sitting posture is considered to be normal, and the sitting posture information is continuously monitored;
and if one or both of the calculated head space angle deviation value and the calculated head space position deviation value exceed a preset threshold, determining that the current sitting posture is abnormal, and performing the next step.
In step S5, the determining whether the duration exceeding the threshold value exceeds a predetermined period further includes:
when the deviation exceeds a threshold value, starting to accumulate the number of the abnormal sitting posture frames when the sitting posture is abnormal and starting to time, and when the abnormal sitting posture count exceeds a preset third threshold value in the specified period, confirming that the abnormal sitting posture is established, wherein Alarm is 1, and giving an Alarm signal; otherwise, the information is considered as false information, and the sitting posture calculation module is continuously processed.
The deviation in step S6 is a head space angle deviation value or a head space position deviation value, and the threshold is a corresponding first threshold or a second threshold.
As shown in fig. 3, the present application also relates to a system for detecting a sitting posture abnormality, comprising: a standard sitting posture module, a sitting posture calculating module and a comparing and judging module are preset, wherein,
the preset standard sitting posture data module is used for presetting standard sitting posture information data;
the sitting posture calculation module is used for acquiring sitting posture information;
the comparison and judgment module is used for comparing the deviation between the real-time sitting posture and the standard sitting posture, judging whether the deviation exceeds a threshold value or not and judging whether the state lasts for a period or not;
the system applies the method described above.
The specified period is a preset time period, such as 1 minute, 3 minutes, 5 minutes, etc., and is preset according to the needs of the customer.
The preset times, such as 3 times, 4 times, 5 times, 10 times and the like, are set according to the needs of the customers.
Among them, methods for calculating the head space angle deviation value, the head space position deviation value and the preset threshold are already well known in the art, for example, refer to the schemes in patents CN102096801A and CN107169453A, and will not be described herein again.
In addition, the technical solutions specifically referred to in the present application can be further explained as follows:
1. a sitting posture calculation module:
the sitting posture calculation module comprises: the device comprises a human head detection module, a human head angle detection module and a sitting posture calculation information.
The head detection module obtains a bounding box of the head from the image data, deduces the ROI data of the head according to the bounding box of the head and transmits the data to the head angle detection module, obtains the head space angle, and calculates the data information of the head bounding box and the head space angle to be obtained by the sitting posture information and integrates the data information together for other modules to calculate.
2. Registering a standard sitting posture:
the sitting posture information is acquired through the sitting posture detection module 1, the sitting posture information acquired by one frame of data is used as a result, and the preset number of sitting posture results are continuously acquired. The condition for successfully verifying the sitting posture registration comprises 1) that the maximum value of three angle deviations in the sitting posture result is smaller than a preset threshold value and 2) that the spatial position deviation value meets the preset threshold value. The two conditions are simultaneously met, namely the standard sitting posture registration is successful.
3. Comparing the real-time sitting posture with the standard sitting posture deviation:
and in the detection, the sitting posture information of the current frame and the registered sitting posture information are obtained to carry out deviation calculation, and a head space angle deviation value and a head space position deviation value are calculated.
4. Deviation exceeds a threshold value:
if the two deviation values obtained by comparing the real-time sitting posture with the standard sitting posture deviation in the step 3 do not exceed the preset threshold value, the currently collected sitting posture is considered to be normal, the sitting posture information is continuously monitored, and if one or both of the two deviation values exceed the preset threshold value, the currently collected sitting posture is considered to be abnormal, and the next judgment is carried out.
5. The state duration period:
when the deviation of the 4 points exceeds the threshold value, the number of the abnormal sitting posture frames starts to be accumulated and timing is started at the same time when the sitting posture is judged to be abnormal, when the abnormal sitting posture count exceeds the preset threshold value in a preset time period, the abnormal sitting posture is confirmed to be established, Alarm is 1, an Alarm signal is given, otherwise, the abnormal sitting posture count is considered to be false information, and the calculation of the sitting posture calculation module is continued.
6. Whether the sitting posture is standard or not:
and when the Alarm signal of Alarm is triggered to be 1 in the step 5, starting the steps 1, 3 and 4, and if the step 4 judges that the sitting posture is normal, canceling the Alarm signal of Alarm to be 1 and resetting the Alarm signal of Alarm to be 0. And continuing the steps 1, 3 and 4 to monitor the sitting posture information.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes may be made to the embodiment of the present invention by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (9)
1. A detection method for detecting sitting posture abnormality is characterized by comprising the following steps:
s1, presetting standard sitting posture data;
s2, a sitting posture processing calculation module is used for acquiring sitting posture information data;
s3, comparing the real-time sitting posture information data with the standard sitting posture data;
s4, determine if the deviation exceeds a threshold? If not, re-enter step S2; if yes, carrying out the next step;
s5, determine whether the state duration exceeding the threshold in step 2 exceeds a specified period? If not, the step S2 is re-entered, and if yes, the next step is carried out;
and S6, alarming for abnormal sitting posture.
2. The method as claimed in claim 1, wherein the sitting posture calculating module in step S2 is used for obtaining sitting posture information, and comprises: the device comprises a human head detection module, a human head angle detection module and a sitting posture calculation information.
3. The method as claimed in claim 2, wherein the processing sitting posture calculating module of step S2 further comprises:
a, the human head detection module obtains data of a boundary frame of the human head from image data;
b, acquiring human head ROI data according to the human head boundary frame and transmitting the human head ROI data to the human head angle detection module to acquire data of a human head space angle;
c, the calculation of the sitting posture information is to integrate the obtained data information of the head boundary frame and the head space angle together for other modules to calculate.
4. The method as claimed in claim 1, wherein the comparing of the real-time sitting posture information data and the standard sitting posture data in step S3 further comprises:
A. in the detection, acquiring sitting posture information of the current frame and performing deviation calculation on the preset sitting posture information;
B. and calculating the head space angle deviation value and the head space position deviation value.
5. The method as claimed in claim 1, wherein the step S4 of determining whether the deviation exceeds a threshold value further comprises:
if the two deviation values of the head space angle deviation value and the head space position deviation value obtained by calculation do not exceed the preset threshold value, the currently collected sitting posture is considered to be normal, and the sitting posture information is continuously monitored;
and if one or both of the calculated head space angle deviation value and the calculated head space position deviation value exceed a preset threshold, determining that the current sitting posture is abnormal, and performing the next step.
6. The method as claimed in claim 5, wherein the threshold corresponding to the head space angle deviation value in step S4 is a first threshold; and the threshold value corresponding to the human head space position deviation value is a second threshold value.
7. The method as claimed in claim 1, wherein the step S5 of determining whether the state duration exceeding the threshold exceeds a specified period further comprises: when the deviation exceeds a threshold value, starting to accumulate the number of the abnormal sitting posture frames and simultaneously starting to time when the sitting posture is abnormal, and when the abnormal sitting posture count exceeds a preset number in the specified period, confirming that the abnormal sitting posture is established, and performing step S6 to give an alarm signal; otherwise, the information is regarded as false information, and the sitting posture information is continuously monitored.
8. The method as claimed in claim 1, wherein the predetermined number is a positive integer greater than 1.
9. A system for detecting a sitting posture abnormality, comprising: a standard sitting posture module, a sitting posture calculating module and a comparing and judging module are preset, wherein,
the preset standard sitting posture data module is used for presetting standard sitting posture information data;
the sitting posture calculation module is used for acquiring sitting posture information;
the comparison and judgment module is used for comparing the deviation between the real-time sitting posture and the standard sitting posture, judging whether the deviation exceeds a threshold value or not and judging whether the state lasts for a period or not;
the system applies the method of the preceding claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911097793.2A CN112861562A (en) | 2019-11-12 | 2019-11-12 | Detection method and system for detecting sitting posture abnormality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911097793.2A CN112861562A (en) | 2019-11-12 | 2019-11-12 | Detection method and system for detecting sitting posture abnormality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112861562A true CN112861562A (en) | 2021-05-28 |
Family
ID=75984450
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911097793.2A Pending CN112861562A (en) | 2019-11-12 | 2019-11-12 | Detection method and system for detecting sitting posture abnormality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112861562A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113484024A (en) * | 2021-07-26 | 2021-10-08 | 合肥康尔信电力系统有限公司 | Big data-based diesel generator fault prediction detection system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102096801A (en) * | 2009-12-14 | 2011-06-15 | 北京中星微电子有限公司 | Sitting posture detecting method and device |
| CN103810478A (en) * | 2014-02-21 | 2014-05-21 | 广东小天才科技有限公司 | Sitting posture detection method and device |
| CN105938540A (en) * | 2015-03-03 | 2016-09-14 | 富士通株式会社 | Behavior detection method and behavior detection apparatus |
| CN107153829A (en) * | 2017-06-09 | 2017-09-12 | 南昌大学 | Incorrect sitting-pose based reminding method and device based on depth image |
| CN109523755A (en) * | 2018-12-17 | 2019-03-26 | 石家庄爱赛科技有限公司 | Stereoscopic vision sitting posture reminder and based reminding method |
| CN110415497A (en) * | 2019-08-09 | 2019-11-05 | 四川长虹电器股份有限公司 | Sitting posture alarm method and system |
-
2019
- 2019-11-12 CN CN201911097793.2A patent/CN112861562A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102096801A (en) * | 2009-12-14 | 2011-06-15 | 北京中星微电子有限公司 | Sitting posture detecting method and device |
| CN103810478A (en) * | 2014-02-21 | 2014-05-21 | 广东小天才科技有限公司 | Sitting posture detection method and device |
| CN105938540A (en) * | 2015-03-03 | 2016-09-14 | 富士通株式会社 | Behavior detection method and behavior detection apparatus |
| CN107153829A (en) * | 2017-06-09 | 2017-09-12 | 南昌大学 | Incorrect sitting-pose based reminding method and device based on depth image |
| CN109523755A (en) * | 2018-12-17 | 2019-03-26 | 石家庄爱赛科技有限公司 | Stereoscopic vision sitting posture reminder and based reminding method |
| CN110415497A (en) * | 2019-08-09 | 2019-11-05 | 四川长虹电器股份有限公司 | Sitting posture alarm method and system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113484024A (en) * | 2021-07-26 | 2021-10-08 | 合肥康尔信电力系统有限公司 | Big data-based diesel generator fault prediction detection system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106598221B (en) | 3D direction of visual lines estimation method based on eye critical point detection | |
| CN108629946B (en) | Human body falling detection method based on RGBD sensor | |
| KR102021999B1 (en) | Apparatus for alarming thermal heat detection results obtained by monitoring heat from human using thermal scanner | |
| EP3308356B1 (en) | System and method for detecting a dissimilar object in undercarriage of a vehicle | |
| EP1526477B1 (en) | Image processing apparatus | |
| US10528802B2 (en) | Head pose and distraction estimation | |
| US20100322507A1 (en) | System and method for detecting drowsy facial expressions of vehicle drivers under changing illumination conditions | |
| CN112861564A (en) | Realization device for sitting posture detection | |
| JP4865517B2 (en) | Head position / posture detection device | |
| EP2457499B1 (en) | Line-of-sight estimation device | |
| CN106919254B (en) | Head-mounted virtual reality equipment and safety protection method | |
| US20150142378A1 (en) | 3-d scanning and positioning interface | |
| CN106937532B (en) | System and method for detecting actual user | |
| KR20140110484A (en) | Risk behavior detection method using image information | |
| CN110251070A (en) | It is a kind of to use eye health condition monitoring method and system | |
| CN114894337B (en) | Temperature measurement method and device for outdoor face recognition | |
| US8503737B2 (en) | Visual line estimating apparatus | |
| CN112861562A (en) | Detection method and system for detecting sitting posture abnormality | |
| US20220095959A1 (en) | Feigned Injury Detection Systems And Methods | |
| JP2004042777A (en) | Obstacle detector | |
| WO2015145438A1 (en) | System and method for identifying fraud attempt of an entrance control system | |
| CN117593792A (en) | Abnormal gesture detection method and device based on video frame | |
| CN112861563A (en) | Sitting posture detection method and system | |
| CN113313917B (en) | Method for solving false alarm generated when no target exists in front of detector in sitting posture detection | |
| CN115050102A (en) | Mobile equipment standard sitting posture analysis processing method and system and storage medium thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |