CN113818773B - Safety window control method based on image processing - Google Patents
Safety window control method based on image processing Download PDFInfo
- Publication number
- CN113818773B CN113818773B CN202111101301.XA CN202111101301A CN113818773B CN 113818773 B CN113818773 B CN 113818773B CN 202111101301 A CN202111101301 A CN 202111101301A CN 113818773 B CN113818773 B CN 113818773B
- Authority
- CN
- China
- Prior art keywords
- potential signal
- template
- potential
- camera
- stop
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- E—FIXED CONSTRUCTIONS
- E05—LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
- E05F—DEVICES FOR MOVING WINGS INTO OPEN OR CLOSED POSITION; CHECKS FOR WINGS; WING FITTINGS NOT OTHERWISE PROVIDED FOR, CONCERNED WITH THE FUNCTIONING OF THE WING
- E05F15/00—Power-operated mechanisms for wings
- E05F15/70—Power-operated mechanisms for wings with automatic actuation
- E05F15/73—Power-operated mechanisms for wings with automatic actuation responsive to movement or presence of persons or objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- E—FIXED CONSTRUCTIONS
- E05—LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
- E05F—DEVICES FOR MOVING WINGS INTO OPEN OR CLOSED POSITION; CHECKS FOR WINGS; WING FITTINGS NOT OTHERWISE PROVIDED FOR, CONCERNED WITH THE FUNCTIONING OF THE WING
- E05F15/00—Power-operated mechanisms for wings
- E05F15/70—Power-operated mechanisms for wings with automatic actuation
- E05F15/73—Power-operated mechanisms for wings with automatic actuation responsive to movement or presence of persons or objects
- E05F2015/767—Power-operated mechanisms for wings with automatic actuation responsive to movement or presence of persons or objects using cameras
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention provides a safety window control method based on image processing, which is a method for controlling the opening and closing of a safety window based on the comparison between a first potential signal which is shot by a camera through a standard scene in a first period and is output by a camera tube and a monitoring scene shot in real time, and comprises the following steps: providing a filter matrix, and setting a filtering scheme of a filter, wherein the filtering scheme takes the frequency corresponding to the standard template as a filtering frequency; providing a camera; a photosensitive element in the camera receives an input image in a monitoring scene of the security window in real time to obtain a second potential signal with a frame as a period, the second potential signal is input to a filter matrix according to a time sequence, the filter matrix filters the second potential signal by a set filtering scheme, and the potential signal is output to a blank template after filtering is finished; the detection module detects potential signals on the blank template to acquire control signals for controlling the opening and closing of the safety window.
Description
Technical Field
The invention provides a security window control method, and particularly relates to a security window control method based on image processing.
Background
Along with the popularization of smart homes, the safety consciousness of modern people is also converted from traditional passive consciousness to active consciousness, and particularly along with the maturity of a monitoring system, the smart doors and windows also become a main means for monitoring the safety of private property.
In the prior art, for example, publication numbers are: the patent of CN106968552A discloses a method for detecting human body subimages, which includes acquiring image information in a monitored scene by a video acquisition device, obtaining human body subimages through continuity processing of an edge enhancement technique, a wavelet filtering technique, a background segmentation technique, a target identification technique and a suspicious person identification detection technique, and detecting from the human body subimages to determine whether suspicious persons are included in the human body subimages. The technical means has very complex processing process and high processing difficulty, not only requires a large amount of processing equipment to be configured, but also needs to construct a human body image analysis model, and has no popularization.
Disclosure of Invention
In view of the above, the present invention provides a security window control method based on image processing.
The technical scheme adopted by the invention is as follows:
a safety window control method based on image processing is a method for controlling the opening and closing of a safety window based on the comparison between a first potential signal which is shot by a camera through a standard scene in a first period and is output by a camera tube and a monitoring scene shot in real time, and comprises the following steps:
providing a filter matrix, and setting a filtering scheme of a filter, wherein the filtering scheme takes the frequency corresponding to the standard template as a filtering frequency;
providing a camera;
a photosensitive element in the camera receives an input image in a monitoring scene of the security window in real time, performs photoelectric conversion on the irradiation of the input image, transmits the converted image to the camera tube,
acquiring a second potential signal with a frame as a period in the camera tube, inputting the second potential signal into a filter matrix according to a time sequence, filtering the second potential signal by the filter matrix according to a set filtering scheme, and outputting the potential signal to a blank template after filtering is finished;
and providing a detection module, wherein the detection module detects the potential signal on the blank template so as to acquire a control signal for controlling the opening and closing of the safety window.
Preferably, a memory is disposed in the camera tube, the memory having at least one set of transistors, one of the transistors being configured to couple with the filter matrix at any node in the second period, the filter matrix being configured to attenuate the interference frequency with a set filtering scheme after the transistors are coupled with the filter matrix.
Preferably, the standard template is obtained by the following method:
in a set first period, a photosensitive element in the camera receives an input image in a standard scene of the security window in real time, performs photoelectric conversion on the irradiation of the input image, transmits the converted input image to a camera tube,
the method comprises the steps of obtaining a first potential signal taking a frame as a period in a camera tube, inputting the first potential signal into a memory, coupling a transistor in the memory to a sampling circuit, obtaining a plurality of groups of first potential signals by the sampling circuit, inputting the first potential signals into a set reference template respectively, and comparing and selecting the reference templates to obtain a standard template.
Preferably, the filter matrix comprises
A control end;
a plurality of band stop filters with continuous stop band ranges; and
a plurality of selection switches configured to correspond one-to-one with band stop filters that are continuous with a plurality of stop band ranges;
the control terminal is configured to control the connection of the selection switch and the stop filter according to a set filtering scheme so as to form a band stop filter series connection with one or more continuous stop band ranges, so that the second potential signal can be filtered according to the set filtering scheme.
Preferably, the plurality of band stop filters having consecutive stop band ranges are arranged from large stop band ranges to small stop band ranges or arranged from small stop band ranges to large stop band ranges.
Preferably, the detection module detects the potential signal on the blank template, and is used for detecting the distribution concentration of the potential signal on the blank template.
Preferably, the concentration detection of the potential signal distribution on the blank template comprises the following results:
the potential signal distribution on the blank template has no continuity of any position; or
The distribution of the potential signals on the blank template has discontinuous continuity at least one position; or
There is continuity in the potential signal distribution on the blank template.
Preferably, if there is no continuity of the potential signal distribution at any position on the blank template, no control signal is generated at this time.
Preferably, if there is at least one discontinuous continuity in the distribution of the potential signals on the blank template, the second potential signal in the memory is output to the client, and the client performs an inspection to determine whether to form the control signal.
Preferably, if there is continuity in the distribution of the potential signal on the blank template, the control signal is directly generated to drive the opening and closing device of the security window to operate.
According to the method, a set first period is used for acquiring a potential signal of a standard scene as a standard template, then frequency distribution corresponding to the first potential signal is separated out on the standard template, the frequency distribution forms a filtering scheme, a control end controls connection of a selection switch and a blocking filter according to the set filtering scheme so as to form a series connection of the blocking filters with one or more continuous stop band ranges, a second potential signal can be filtered according to the set filtering scheme, and the potential signal is output to a blank template after filtering is finished; the detection module carries out centralized detection on potential signals on the blank template and controls the opening and closing of the safety window according to the detection result. Compared with the traditional technical means, a large amount of processing equipment does not need to be configured, the processing process can be obtained only by the filtering result, the whole configuration cost is reduced, and the method has popularization.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a block diagram of the framework of the present invention;
fig. 2 is a flow chart of the method of the present invention.
Detailed Description
The invention will be described in detail with reference to the drawings and specific embodiments, which are provided herein for the purpose of illustrating the invention and are not to be construed as limiting the invention.
Standard scenario: there is no intruding object (e.g., people, birds, vehicles, large debris, etc.) within the monitoring range of the camera.
A band stop filter in which a plurality of stop band ranges are continuous can be understood by the following example.
Band elimination filter 1: the stopband range is 5HZ-6HZ (including 5HZ but not including 6 HZ);
the band elimination filter 2: the stopband range is 6HZ-7HZ (including 6HZ but not including 7 HZ);
the band elimination filter 3: the stopband range is 7HZ-8HZ (including 7HZ but not 8 HZ);
referring to fig. 1, the present invention provides a security window control method based on image processing, which is a method for controlling the opening and closing of a security window based on a comparison between a monitoring scene captured in real time and a first potential signal captured by a camera through a standard scene in a first period and output by a camera tube, wherein the method comprises:
providing a filter matrix, and setting a filtering scheme of a filter, wherein the filtering scheme takes the frequency corresponding to the standard template as a filtering frequency;
the filter matrix comprises:
a control end;
a plurality of band stop filters with continuous stop band ranges; and
a plurality of selection switches configured to correspond one-to-one with band stop filters that are continuous with a plurality of stop band ranges;
the band stop filters with continuous stop band ranges are arranged from large stop band ranges to small stop band ranges or arranged from small stop band ranges to large stop band ranges.
The control end is configured to control the connection of the selection switch and the rejection filter according to a set filtering scheme so as to form a series connection of the rejection filters with one or more continuous rejection band ranges, so that the second potential signal can be filtered according to the set filtering scheme;
providing a camera;
a photosensitive element in the camera receives an input image in a monitoring scene of the security window in real time, performs photoelectric conversion on the irradiation of the input image, transmits the converted image to the camera tube,
a memory is disposed within the camera tube, the memory having at least one set of transistors, one of the transistors being configured to couple to the filter matrix at any node during the second period, the filter matrix being configured to attenuate interference frequencies with a set filtering scheme after the transistors are coupled to the filter matrix.
Specifically, a second potential signal with a frame as a period in the camera tube is obtained, the second potential signal is input into a filter matrix according to a time sequence, the filter matrix filters the second potential signal by a set filtering scheme, and the potential signal is output to a blank template after filtering is finished;
providing a detection module, wherein the detection module detects potential signals on the blank template to acquire control signals for controlling the opening and closing of the safety window;
in the above, the detection of the concentration of the potential signal distribution on the blank template includes the following results:
the potential signal distribution on the blank template has no continuity of any position; the second potential signal of the monitored scene after filtering is the same as the first potential signal in distribution answer, and at this time, no intruding object exists. No control action is required.
At least one position of the potential signal distribution on the blank template has discontinuous continuity, if the continuity is not strong, the situation that a small intruder such as a bird exists in the monitored scene is indicated, at the moment, the second potential signal in the memory is output to the client, and the client is used for checking to determine whether a control signal is formed or not.
The distribution of the potential signals on the blank template has continuity, which indicates that a large intruder, such as a person, exists at the moment, and the continuity is strong, indicates that a long time exists in a monitoring scene, and directly generates a control signal at the moment to drive an opening and closing device of the safety window to act.
Referring to fig. 2, in the above, the standard template is obtained by the following method:
in a set first period, a photosensitive element in the camera receives an input image in a standard scene of the security window in real time, performs photoelectric conversion on the irradiation of the input image, transmits the converted input image to a camera tube,
the method comprises the steps of obtaining a first potential signal with a frame as a period in a camera tube, inputting the first potential signal into a memory, coupling a transistor in the memory to a sampling circuit, obtaining multiple groups of first potential signals by the sampling circuit, inputting the first potential signals into a set reference template respectively, and comparing and selecting the reference templates to obtain a standard template.
Example 1
This embodiment assumes a band-stop filter matrix consisting of 10 consecutive band-stop filters.
Band elimination filter 1: the stopband range is 1HZ-2HZ (including 1HZ but not including 2 HZ);
the band elimination filter 2: the stopband range is 2HZ-3HZ (including 2HZ but not including 3 HZ);
the band elimination filter 3: the stopband range is 3HZ-4HZ (including 3HZ but not including 4 HZ);
the band elimination filter 4: the stopband range is 4HZ-5HZ (including 4HZ but not including 5 HZ);
the band elimination filter 5: the stopband range is 5HZ-6HZ (including 5HZ but not including 6 HZ);
the band elimination filter 6: the stopband range is 6HZ-7HZ (including 6HZ but not including 7 HZ);
the band elimination filter 7: the stopband range is 7HZ-8HZ (including 7HZ but not 8 HZ);
band elimination filter 8: the stopband range is 8HZ-9HZ (including 8HZ but not including 9 HZ);
the band elimination filter 9: the stopband range is 9HZ-10HZ (including 9HZ but not including 10 HZ);
the band elimination filter 10: the stopband range is 10HZ-11HZ (including 10HZ but not including 11 HZ);
10 selection switches, each selection switch and the band elimination filter 1-10 form one-to-one correspondence;
setting a filtering scheme corresponding to the standard template to be 2.5HZ-4.9HZ, wherein the control end is configured to control the connection of the selection switch and the rejection filter by taking 2.5HZ-4.9HZ as a filtering range so as to form a series connection of the rejection filters with one or more continuous stop band ranges, so that the second potential signal can be filtered according to the set filtering scheme; specifically, the band elimination filter 2, the band elimination filter 3 and the band elimination filter 4 are connected in series.
Of course, the above combination is only one shown in the embodiment, and it may be a combination of less and more, and may also be a combination of smaller frequency intervals.
The method takes a set first period for acquiring the potential signal of the standard scene as a standard template, and the first period can be one day or one month. The specific setting can be according to the change of monitoring scene. Then, frequency distribution corresponding to the first potential signal is separated out on the standard template, the frequency distribution forms a filtering scheme, the control end controls the connection of the selection switch and the rejection filter according to the set filtering scheme to form a series connection of the rejection filters with one or more continuous stop band ranges, so that the second potential signal can be filtered according to the set filtering scheme, and the potential signal is output to the blank template after the filtering is finished; the detection module carries out centralized detection on potential signals on the blank template and controls the opening and closing of the safety window according to the detection result. Compared with the traditional technical means, a large amount of processing equipment does not need to be configured, the processing process can be obtained only by the filtering result, the whole configuration cost is reduced, and the method has popularization.
The principle of the invention is to actually eliminate the standard scene in the monitoring scene so as to check whether other intrusions exist besides the standard scene.
Of course, in addition to the above, the present invention may also be combined with analysis of objects, such as identification of suspicious persons, to form new solutions, thereby facilitating extension of the present solution.
The technical solutions disclosed in the embodiments of the present invention are described in detail above, and the principles and embodiments of the present invention are explained in the present document by using specific embodiments, and the descriptions of the embodiments are only used to help understanding the principles of the embodiments of the present invention; meanwhile, for a person skilled in the art, according to the embodiments of the present invention, there may be variations in the specific implementation manners and application ranges, and in summary, the content of the present description should not be construed as a limitation to the present invention.
Claims (4)
1. The safety window control method based on image processing is characterized in that the method for controlling the opening and closing of a safety window is obtained by comparing a monitoring scene which is shot in real time and is shot by a camera through a standard scene in a first period by taking a first potential signal output by a camera tube as a standard template, and the method comprises the following steps:
providing a filter matrix, and setting a filtering scheme of a filter, wherein the filtering scheme takes the frequency corresponding to the standard template as a filtering frequency;
providing a camera;
a photosensitive element in the camera receives an input image in a monitoring scene of the security window in real time, performs photoelectric conversion on the irradiation of the input image, transmits the converted image to the camera tube,
acquiring a second potential signal with a frame as a period in the camera tube, inputting the second potential signal into a filter matrix according to a time sequence, filtering the second potential signal by the filter matrix according to a set filtering scheme, and outputting the potential signal to a blank template after filtering is finished;
providing a detection module, wherein the detection module detects potential signals on the blank template to acquire control signals for controlling the opening and closing of the safety window;
the standard template is obtained by the following method:
in a set first period, a photosensitive element in the camera receives an input image in a standard scene of the security window in real time, performs photoelectric conversion on the irradiation of the input image, transmits the converted input image to a camera tube,
acquiring a first potential signal with a frame as a period in a camera tube, inputting the first potential signal into a memory, coupling a transistor in the memory to a sampling circuit, acquiring multiple groups of first potential signals by the sampling circuit, respectively inputting the first potential signals into a set reference template, and comparing and selecting the multiple reference templates to acquire a standard template;
the detection module detects the potential signals on the blank template, namely the centralized detection of the distribution of the potential signals on the blank template;
the centralized detection of the potential signal distribution on the blank template comprises the following results:
the potential signal distribution on the blank template has no continuity of any position; or
The distribution of the potential signals on the blank template has discontinuous continuity at least one position; or
Continuity exists in the distribution of the potential signals on the blank template;
if the potential signal distribution on the blank template has no continuity of any position, no control signal is generated at the moment;
if at least one position of the electric potential signal distribution on the blank template has discontinuous continuity, outputting a second electric potential signal in the memory to the client, and checking through the client to determine whether a control signal is formed;
if the potential signal distribution on the blank template has continuity, a control signal is directly generated to drive the opening and closing device of the safety window to act.
2. An image processing based security window control method according to claim 1, wherein a memory is provided within the camera tube, the memory having at least one set of transistors, one of the transistors being configured to couple to the filter matrix at any node within the second period, the filter matrix being configured to attenuate interference frequencies with a set filtering scheme after the transistors are coupled to the filter matrix.
3. An image processing based security window control method according to claim 1, wherein the filter matrix comprises
A control end;
a plurality of band stop filters with continuous stop band ranges; and
a plurality of selection switches configured to correspond one-to-one with band stop filters having a plurality of continuous stop band ranges;
the control terminal is configured to control the connection of the selection switch and the stop filter according to a set filtering scheme so as to form a band stop filter series connection with one or more continuous stop band ranges, so that the second potential signal can be filtered according to the set filtering scheme.
4. The image-processing-based security window control method of claim 3, wherein the plurality of band-stop filters having consecutive stop-band ranges are arranged with the stop-band ranges from large to small or with the stop-band ranges from small to large.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111101301.XA CN113818773B (en) | 2021-09-18 | 2021-09-18 | Safety window control method based on image processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111101301.XA CN113818773B (en) | 2021-09-18 | 2021-09-18 | Safety window control method based on image processing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113818773A CN113818773A (en) | 2021-12-21 |
| CN113818773B true CN113818773B (en) | 2022-11-15 |
Family
ID=78922562
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111101301.XA Active CN113818773B (en) | 2021-09-18 | 2021-09-18 | Safety window control method based on image processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113818773B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105869185A (en) * | 2016-04-15 | 2016-08-17 | 张志华 | Automatic door |
| KR101674053B1 (en) * | 2016-06-27 | 2016-11-08 | 주식회사 에버정보기술 | Apparatus and method for security entrance |
| CN106382090A (en) * | 2016-08-31 | 2017-02-08 | 宁波优而雅电器有限公司 | Combined control system for inner and outer windows |
| CN106406164A (en) * | 2016-08-31 | 2017-02-15 | 宁波优而雅电器有限公司 | Intelligent window framework control method |
| CN106968552A (en) * | 2017-05-23 | 2017-07-21 | 孙霞 | Security window control method based on image procossing |
| CN109409395A (en) * | 2018-07-29 | 2019-03-01 | 国网上海市电力公司 | Using the method for template matching method identification target object region electrical symbol in power monitoring |
| CN111447363A (en) * | 2020-04-14 | 2020-07-24 | 中原工学院 | Tunnel wireless panoramic video monitoring system |
| US11072966B1 (en) * | 2017-08-25 | 2021-07-27 | Objectvideo Labs, Llc | Video analytic enhanced pet door |
-
2021
- 2021-09-18 CN CN202111101301.XA patent/CN113818773B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105869185A (en) * | 2016-04-15 | 2016-08-17 | 张志华 | Automatic door |
| KR101674053B1 (en) * | 2016-06-27 | 2016-11-08 | 주식회사 에버정보기술 | Apparatus and method for security entrance |
| CN106382090A (en) * | 2016-08-31 | 2017-02-08 | 宁波优而雅电器有限公司 | Combined control system for inner and outer windows |
| CN106406164A (en) * | 2016-08-31 | 2017-02-15 | 宁波优而雅电器有限公司 | Intelligent window framework control method |
| CN106968552A (en) * | 2017-05-23 | 2017-07-21 | 孙霞 | Security window control method based on image procossing |
| US11072966B1 (en) * | 2017-08-25 | 2021-07-27 | Objectvideo Labs, Llc | Video analytic enhanced pet door |
| CN109409395A (en) * | 2018-07-29 | 2019-03-01 | 国网上海市电力公司 | Using the method for template matching method identification target object region electrical symbol in power monitoring |
| CN111447363A (en) * | 2020-04-14 | 2020-07-24 | 中原工学院 | Tunnel wireless panoramic video monitoring system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113818773A (en) | 2021-12-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE60132622T2 (en) | METHOD AND DEVICE FOR SELECTING THE BEST VIDEO IMAGE FOR TRANSMISSION TO A REMOTE SITE WITHIN A CLOSED TELEVISION SYSTEM FOR RESIDENTIAL AREA SAFETY MONITORING | |
| US7504942B2 (en) | Local verification systems and methods for security monitoring | |
| EP0939387B1 (en) | Room supervision device | |
| CN106803943A (en) | Video monitoring system and equipment | |
| US20090195382A1 (en) | Video sensor and alarm system and method with object and event classification | |
| CN104966375A (en) | Security monitoring system and monitoring method | |
| CN103258191A (en) | Community access control system based on face recognition | |
| DE102005045077A1 (en) | A method and apparatus for distributed analysis of images | |
| CN111800617A (en) | Intelligent security system based on Internet of things | |
| CN111601011A (en) | Automatic alarm method and system based on video stream image | |
| EP1496483B1 (en) | Method and apparatus for the detection of flames | |
| CN113818773B (en) | Safety window control method based on image processing | |
| CN111917967A (en) | Door monitoring system and control method thereof | |
| KR101375186B1 (en) | Method for detecting disturbance of monitoring camera | |
| DE102005004278A1 (en) | Human vision system | |
| EP1376502A1 (en) | Surveillance system | |
| CN110188617A (en) | A kind of machine room intelligent monitoring method and system | |
| AU2021103548A4 (en) | Smart home surveillance system using iot application with warning of intruder activities | |
| CN112601054B (en) | Pickup picture acquisition method and device, storage medium and electronic equipment | |
| Casagrande et al. | Action recognition in real homes using low resolution depth video data | |
| CN113158888A (en) | Elevator abnormal video identification method | |
| CN111311786A (en) | Intelligent door lock system and intelligent door lock control method thereof | |
| Hesse | The transition from video motion detection to intelligent scene discrimination and target tracking in automated video surveillance systems | |
| DE102017207939A1 (en) | System for evaluating a situation and method for evaluating a situation | |
| CN117274045A (en) | Object detection method using cropped image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |