CN113156829A - Equipment starting method and system - Google Patents
Equipment starting method and system Download PDFInfo
- Publication number
- CN113156829A CN113156829A CN202110443499.3A CN202110443499A CN113156829A CN 113156829 A CN113156829 A CN 113156829A CN 202110443499 A CN202110443499 A CN 202110443499A CN 113156829 A CN113156829 A CN 113156829A
- Authority
- CN
- China
- Prior art keywords
- user
- area
- determining
- monitoring video
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Abstract
The embodiment of the invention provides a method and a system for starting equipment. The method comprises the following steps: the method comprises the steps of collecting a monitoring video, determining the advancing direction of a user according to the monitoring video, predicting an area to be entered by the user by adopting the advancing direction, calculating the remaining time of the user to reach the area according to the monitoring video, and starting equipment in the area when the remaining time is less than a preset threshold value, so that the equipment in the area is automatically started in advance when the user enters a certain area, the user does not need to perform extra control operation, and the user experience is greatly improved.
Description
Technical Field
The present invention relates to the field of device control technologies, and in particular, to a method and a system for starting a device.
Background
At present, smart homes have gradually gone into the public vision. In the application scene of smart home, various electric appliances such as electric lamps, air conditioners and the like in the home are generally applied in a mobile phone application or voice control mode. The former control mode of mobile phone application requires the user to hold the mobile phone each time, and opens the relevant application of the mobile phone to perform specific control operation, which is complicated in steps and inconvenient. The voice control method is characterized in that a voice control mode is adopted in the intelligent sound box, a user needs to speak control voice to the intelligent sound box, the intelligent sound box generates a control command through voice recognition to control related electric appliances, the current voice recognition success rate is not high, the control voice can be recognized and controlled only by the user who speaks the control voice for multiple times, the user experience is not friendly, meanwhile, the voice control mode has certain delay, and the control equipment cannot be controlled in a low-delay mode.
Disclosure of Invention
In view of the above problems, embodiments of the present invention are proposed to provide an opening method of a device and a corresponding opening system of a device that overcome or at least partially solve the above problems.
In order to solve the above problem, an embodiment of the present invention discloses a method for starting a device, where the method includes:
collecting a monitoring video;
determining the advancing direction of a user according to the monitoring video;
predicting an area to be entered by the user using the forward direction;
calculating the residual time of the user reaching the area according to the monitoring video;
and when the remaining time is less than a preset threshold value, starting the equipment in the area.
Optionally, the step of determining the forward direction of the user according to the monitoring video includes:
determining a walking track of a user from the monitoring video;
determining a body orientation of a user from the surveillance video;
and determining the advancing direction of the user by adopting the walking track and the body orientation.
Optionally, the step of calculating the remaining time for the user to reach the area according to the surveillance video includes:
acquiring the forward speed of a user according to the monitoring video;
acquiring the real-time distance between a user and an entrance of the area;
and calculating the remaining time by adopting the advancing speed and the real-time distance.
Optionally, when the remaining time is less than a preset threshold, after the step of turning on the device in the area, the method further includes:
judging whether the user leaves the area or not by adopting the monitoring video;
and if so, closing the equipment.
The embodiment of the invention also discloses a system for starting the equipment, which comprises:
the monitoring module is used for collecting monitoring videos;
the forward direction determining module is used for determining the forward direction of the user according to the monitoring video;
the region prediction module is used for predicting a region which the user is going to enter by adopting the advancing direction;
the residual time calculation module is used for calculating the residual time of the user reaching the area according to the monitoring video;
and the equipment starting module is used for starting the equipment in the area when the remaining time is less than a preset threshold value.
Optionally, the forward direction determining module includes:
the walking track determining submodule is used for determining the walking track of the user from the monitoring video;
a body orientation determination submodule for determining a body orientation of a user from the surveillance video;
and the advancing direction determining submodule is used for determining the advancing direction of the user by adopting the walking track and the body orientation.
Optionally, the remaining time calculating module includes:
the forward speed obtaining submodule is used for obtaining the forward speed of the user according to the monitoring video;
the real-time distance acquisition submodule is used for acquiring the real-time distance between a user and an entrance of the area;
and the residual time calculating submodule is used for calculating the residual time by adopting the advancing speed and the real-time distance.
Optionally, the system further comprises:
the user leaving judging module is used for judging whether the user leaves the area or not by adopting the monitoring video;
and the equipment closing module is used for closing the equipment if the equipment is in the normal state.
The embodiment of the invention has the following advantages: in the embodiment of the invention, a monitoring video is collected, the advancing direction of a user is determined according to the monitoring video, the advancing direction is adopted to predict the area which the user is going to enter, the residual time of the user reaching the area is calculated according to the monitoring video, and when the residual time is less than a preset threshold value, the equipment in the area is started, so that when the user enters a certain area, the equipment in the area is automatically started in advance, no additional control operation is required by the user, and the user experience is greatly improved.
Drawings
Fig. 1 is a flowchart illustrating a first method for opening a device according to an embodiment of the present invention.
Fig. 2 is a block diagram of a first embodiment of an opening system of a device according to the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
Referring to fig. 1, a flowchart illustrating steps of a first embodiment of a method for opening a device according to the present invention is shown, which may specifically include the following steps:
in an alternative embodiment of the present invention, a plurality of camera devices may be disposed in a plurality of areas for collecting surveillance videos, for example, a house may generally include a plurality of areas such as a living room, a dining room, and a room, and one camera device may be disposed in each of the plurality of areas such as the living room, the dining room, and the room, so as to collect the surveillance videos.
if the user moves among a plurality of areas, the forward direction of the user can be determined in real time according to the monitoring video, for example, the user moves in a plurality of areas such as a living room, a dining room, a kitchen and the like, and the forward direction of the user can be determined according to the monitoring video, and the forward direction can be in all directions of south, east, west and north, or an angle in a plane angle coordinate system.
Specifically, the step of determining the forward direction of the user according to the monitoring video comprises the following steps:
a substep 1021, determining the walking track of the user from the monitoring video;
a substep 1022 of determining a body orientation of the user from the surveillance video;
and a substep 1023 of determining the advancing direction of the user using said walking trajectory and the body orientation.
specifically, the area pointed by the forward direction may be predicted as the area to be entered by the user, for example, if the area pointed by the forward direction is a kitchen, the area to be entered by the user may be predicted as the kitchen.
in the embodiment of the present invention, the remaining time of the user arriving at a certain area may be calculated according to the monitoring video, for example, the user is currently moving in a living room, the forward direction of the user points to the kitchen, the remaining time of the user arriving at the kitchen may be calculated according to the monitoring video, and if the remaining time is 5 seconds, it means that the user arrives at the kitchen after 5 seconds.
Specifically, the step of calculating the remaining time for the user to reach the area according to the monitoring video includes:
a substep 1041 of obtaining a forward speed of the user according to the monitoring video;
analyzing the relative distance between the current video frame of the monitoring video and the previous video frame user, calculating the time difference between the current video frame and the previous video frame, and dividing the relative distance by the time difference to obtain the forward speed of the user, for example, the relative distance between the current video frame and the previous video frame user is 0.5 meter, the time difference between the current video frame and the previous video frame is 0.5 second, and the forward speed of the user is 1 meter per second.
Substep 1042, obtaining the real-time distance between the user and the entrance of the region;
the real-time distance of the user from the entrance of the area in the monitoring video is measured, for example, the real-time distance of the user from the doorway of the kitchen may be measured to be 5 meters.
Substep 1043, calculating said remaining time using said forward speed and said real time distance.
For example, if the real-time distance between the user and the doorway of the kitchen is 5 meters and the user's forward speed is 1 meter per second, then the remaining time can be calculated as 5 seconds, that is, the user is expected to arrive at the doorway of the kitchen 5 seconds later.
And 105, when the remaining time is less than a preset threshold value, starting the equipment in the area.
For example, assuming that the preset threshold is two seconds, when the remaining time for the user to reach the doorway of the kitchen is less than two seconds, the device of the kitchen is turned on. The devices in the area may include devices such as electric lights, air conditioners, air fresheners, motorized shades, and the like, and embodiments of the present invention are not limited thereto.
When the remaining time is less than the preset threshold, after the step of turning on the devices in the area, the method further includes:
judging whether the user leaves the area or not by adopting the monitoring video;
and if so, closing the equipment.
In the embodiment of the invention, a monitoring video is collected, the advancing direction of a user is determined according to the monitoring video, the advancing direction is adopted to predict the area which the user is going to enter, the residual time of the user reaching the area is calculated according to the monitoring video, and when the residual time is less than a preset threshold value, the equipment in the area is started, so that when the user enters a certain area, the equipment in the area is automatically started in advance, no additional control operation is required by the user, and the user experience is greatly improved.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 2, a block diagram of a first embodiment of an opening system of a device according to the present invention is shown, which may specifically include the following modules:
the monitoring module is used for collecting monitoring videos;
the forward direction determining module is used for determining the forward direction of the user according to the monitoring video;
the region prediction module is used for predicting a region which the user is going to enter by adopting the advancing direction;
the residual time calculation module is used for calculating the residual time of the user reaching the area according to the monitoring video;
and the equipment starting module is used for starting the equipment in the area when the remaining time is less than a preset threshold value.
In an embodiment of the present invention, the forward direction determining module includes:
the walking track determining submodule is used for determining the walking track of the user from the monitoring video;
a body orientation determination submodule for determining a body orientation of a user from the surveillance video;
and the advancing direction determining submodule is used for determining the advancing direction of the user by adopting the walking track and the body orientation.
In an embodiment of the present invention, the remaining time calculating module includes:
the forward speed obtaining submodule is used for obtaining the forward speed of the user according to the monitoring video;
the real-time distance acquisition submodule is used for acquiring the real-time distance between a user and an entrance of the area;
and the residual time calculating submodule is used for calculating the residual time by adopting the advancing speed and the real-time distance.
In an embodiment of the present invention, the system further includes:
the user leaving judging module is used for judging whether the user leaves the area or not by adopting the monitoring video;
and the equipment closing module is used for closing the equipment if the equipment is in the normal state.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
An embodiment of the present invention further provides an apparatus, including:
the device starting method comprises a processor, a memory and a computer program which is stored on the memory and can run on the processor, wherein when the computer program is executed by the processor, each process of the device starting method embodiment is realized, the same technical effect can be achieved, and the details are not repeated here to avoid repetition.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when being executed by a processor, the computer program implements each process of the above-mentioned device starting method embodiment, and can achieve the same technical effect, and is not described herein again to avoid repetition.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The above detailed description is provided for the device opening method and the device opening system provided by the present invention, and the principle and the implementation of the present invention are explained by applying specific examples, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (9)
1. A method for starting up a device, the method comprising:
collecting a monitoring video;
determining the advancing direction of a user according to the monitoring video;
predicting an area to be entered by the user using the forward direction;
calculating the residual time of the user reaching the area according to the monitoring video;
and when the remaining time is less than a preset threshold value, starting the equipment in the area.
2. The method of claim 1, wherein the step of determining the heading of the user from the surveillance video comprises:
determining a walking track of a user from the monitoring video;
determining a body orientation of a user from the surveillance video;
and determining the advancing direction of the user by adopting the walking track and the body orientation.
3. The method of claim 1, wherein the step of calculating the remaining time for the user to reach the area based on the surveillance video comprises:
acquiring the forward speed of a user according to the monitoring video;
acquiring the real-time distance between a user and an entrance of the area;
and calculating the remaining time by adopting the advancing speed and the real-time distance.
4. The method of claim 1, wherein when the remaining time is less than a preset threshold, the step of turning on the devices of the area is followed by further comprising:
judging whether the user leaves the area or not by adopting the monitoring video;
and if so, closing the equipment.
5. An opening system for a device, the system comprising:
the monitoring module is used for collecting monitoring videos;
the forward direction determining module is used for determining the forward direction of the user according to the monitoring video;
the region prediction module is used for predicting a region which the user is going to enter by adopting the advancing direction;
the residual time calculation module is used for calculating the residual time of the user reaching the area according to the monitoring video;
and the equipment starting module is used for starting the equipment in the area when the remaining time is less than a preset threshold value.
6. The system of claim 5, wherein the heading determination module comprises:
the walking track determining submodule is used for determining the walking track of the user from the monitoring video;
a body orientation determination submodule for determining a body orientation of a user from the surveillance video;
and the advancing direction determining submodule is used for determining the advancing direction of the user by adopting the walking track and the body orientation.
7. The system of claim 5, wherein the remaining time calculation module comprises:
the forward speed obtaining submodule is used for obtaining the forward speed of the user according to the monitoring video;
the real-time distance acquisition submodule is used for acquiring the real-time distance between a user and an entrance of the area;
and the residual time calculating submodule is used for calculating the residual time by adopting the advancing speed and the real-time distance.
8. The system of claim 5, further comprising:
the user leaving judging module is used for judging whether the user leaves the area or not by adopting the monitoring video;
and the equipment closing module is used for closing the equipment if the equipment is in the normal state.
9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of a method for turning on a device according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110443499.3A CN113156829A (en) | 2021-04-23 | 2021-04-23 | Equipment starting method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110443499.3A CN113156829A (en) | 2021-04-23 | 2021-04-23 | Equipment starting method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113156829A true CN113156829A (en) | 2021-07-23 |
Family
ID=76870107
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110443499.3A Withdrawn CN113156829A (en) | 2021-04-23 | 2021-04-23 | Equipment starting method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113156829A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114415527A (en) * | 2021-12-07 | 2022-04-29 | 珠海格力电器股份有限公司 | Smart home pre-starting method and device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100127854A1 (en) * | 2008-11-21 | 2010-05-27 | Richard Eric Helvick | Method and system for controlling home appliances based on estimated time of arrival |
| CN103994544A (en) * | 2014-05-07 | 2014-08-20 | 美的集团股份有限公司 | Air-conditioner control method, intelligent terminal and air-conditioner control system |
| CN104290681A (en) * | 2013-07-15 | 2015-01-21 | 鸿富锦精密工业（深圳）有限公司 | Vehicle door opening control system and method |
| CN104536346A (en) * | 2014-12-18 | 2015-04-22 | 珠海格力电器股份有限公司 | Intelligent device control method and system |
| CN106976768A (en) * | 2017-05-25 | 2017-07-25 | 广州日滨科技发展有限公司 | A kind of apparatus for controlling elevator and method |
| CN108168042A (en) * | 2017-11-17 | 2018-06-15 | 珠海格力电器股份有限公司 | Air-conditioning and its control method, device and system |
| CN110543102A (en) * | 2018-05-29 | 2019-12-06 | 珠海格力电器股份有限公司 | method and device for controlling intelligent household equipment and computer storage medium |
| CN110543861A (en) * | 2019-09-05 | 2019-12-06 | 深圳前海达闼云端智能科技有限公司 | early warning method, server and early warning system |
-
2021
- 2021-04-23 CN CN202110443499.3A patent/CN113156829A/en not_active Withdrawn
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100127854A1 (en) * | 2008-11-21 | 2010-05-27 | Richard Eric Helvick | Method and system for controlling home appliances based on estimated time of arrival |
| CN104290681A (en) * | 2013-07-15 | 2015-01-21 | 鸿富锦精密工业（深圳）有限公司 | Vehicle door opening control system and method |
| CN103994544A (en) * | 2014-05-07 | 2014-08-20 | 美的集团股份有限公司 | Air-conditioner control method, intelligent terminal and air-conditioner control system |
| CN104536346A (en) * | 2014-12-18 | 2015-04-22 | 珠海格力电器股份有限公司 | Intelligent device control method and system |
| CN106976768A (en) * | 2017-05-25 | 2017-07-25 | 广州日滨科技发展有限公司 | A kind of apparatus for controlling elevator and method |
| CN108168042A (en) * | 2017-11-17 | 2018-06-15 | 珠海格力电器股份有限公司 | Air-conditioning and its control method, device and system |
| CN110543102A (en) * | 2018-05-29 | 2019-12-06 | 珠海格力电器股份有限公司 | method and device for controlling intelligent household equipment and computer storage medium |
| CN110543861A (en) * | 2019-09-05 | 2019-12-06 | 深圳前海达闼云端智能科技有限公司 | early warning method, server and early warning system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114415527A (en) * | 2021-12-07 | 2022-04-29 | 珠海格力电器股份有限公司 | Smart home pre-starting method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10677486B1 (en) | HVAC workload and cost logic | |
| US20140195233A1 (en) | Distributed Speech Recognition System | |
| CN105700389B (en) | Intelligent home natural language control method | |
| US10203665B2 (en) | Managing home automation system based on behavior and user input | |
| CN110223690A (en) | The man-machine interaction method and device merged based on image with voice | |
| US20150309484A1 (en) | Managing home automation system based on behavior | |
| CN105182776A (en) | Intelligent furniture controlling method and apparatus | |
| WO2014190496A1 (en) | Method and system for identifying location associated with voice command to control home appliance | |
| CN109377995B (en) | Method and device for controlling equipment | |
| US11328518B2 (en) | Method and apparatus for outputting information | |
| CN106548231A (en) | Mobile controller, mobile robot and the method for moving to optimal interaction point | |
| CN112558491A (en) | Home scene linkage intelligent home system based on voice recognition and control method and control device thereof | |
| CN105825848A (en) | Method, device and terminal for voice recognition | |
| CN111965985B (en) | Smart home equipment control method and device, electronic equipment and storage medium | |
| US20200257254A1 (en) | Progressive profiling in an automation system | |
| CN113791557A (en) | Control method and device of intelligent equipment | |
| CN113156829A (en) | Equipment starting method and system | |
| JPWO2018087971A1 (en) | MOBILE BODY CONTROL DEVICE AND MOBILE BODY CONTROL PROGRAM | |
| WO2018208365A1 (en) | Methods and systems for presenting image data for detected regions of interest | |
| CN112558575A (en) | Equipment linkage control method and device, storage medium and equipment | |
| CN110762799A (en) | Storage medium, intelligent panel and air conditioner control method based on intelligent panel | |
| CN109343481B (en) | Method and device for controlling device | |
| CN104932555A (en) | Control method and electronic device | |
| CN104243894A (en) | Audio and video fused monitoring method | |
| CN108415572B (en) | Module control method and device applied to mobile terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20210723 |
|
| WW01 | Invention patent application withdrawn after publication |