CN113116319A - Intelligent home control system for converting scene change by sensing emotion - Google Patents
Intelligent home control system for converting scene change by sensing emotion Download PDFInfo
- Publication number
- CN113116319A CN113116319A CN202110437315.2A CN202110437315A CN113116319A CN 113116319 A CN113116319 A CN 113116319A CN 202110437315 A CN202110437315 A CN 202110437315A CN 113116319 A CN113116319 A CN 113116319A
- Authority
- CN
- China
- Prior art keywords
- emotion
- sensing
- control system
- model
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000008451 emotion Effects 0.000 title claims abstract description 51
- 230000008859 change Effects 0.000 title claims abstract description 10
- 230000036651 mood Effects 0.000 claims description 8
- 208000027418 Wounds and injury Diseases 0.000 claims description 3
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000007405 data analysis Methods 0.000 claims description 3
- 238000013135 deep learning Methods 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 3
- 230000006378 damage Effects 0.000 claims description 2
- 208000014674 injury Diseases 0.000 claims description 2
- 230000008447 perception Effects 0.000 claims 1
- 230000035943 smell Effects 0.000 abstract description 5
- 230000004936 stimulating effect Effects 0.000 abstract 1
- 241001122767 Theaceae Species 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 238000004378 air conditioning Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000005281 excited state Effects 0.000 description 2
- 230000008921 facial expression Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 210000000697 sensory organ Anatomy 0.000 description 2
- 206010012374 Depressed mood Diseases 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000001914 calming effect Effects 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 230000000994 depressogenic effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000035622 drinking Effects 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000029058 respiratory gaseous exchange Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4803—Speech analysis specially adapted for diagnostic purposes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61M21/02—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
- A61M2021/0016—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the smell sense
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
- A61M2021/0027—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the hearing sense
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
- A61M2021/0044—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense
Abstract
The invention discloses an intelligent home control system for sensing emotion to convert scene change, which comprises: the sensing system is used for identifying human emotion; the sensing system comprises a picture recognition sensor, a sound recognition sensor and a laser radar sensor, and uploads recognized information to the edge computing host; the computing platform is used for analyzing and comparing the information of the sensing system, identifying and analyzing the psychological emotion of the human through the picture recognition sensor and the sound recognition sensor, adjusting several aspects of background music, light color tone and space smell according to the analyzed result, stimulating the human sense from three aspects of vision, hearing and smell, and achieving the purpose of relieving the emotion.
Description
Technical Field
The invention relates to the technical field of intelligent interaction, in particular to an intelligent home control system for sensing emotion to convert scene change.
Background
At present, an intelligent home control system can only provide simple home assistance such as a light switch, air conditioner temperature adjustment and the opening ratio of a curtain for a user, cannot sense the emotion of the user, and can convert indoor scenes through sensed data to further relieve the emotion of the user.
An intelligent home control system (SCS for short) is characterized in that an intelligent home system is used as a platform, home appliances and household appliances are used as main control objects, facilities related to home life are efficiently integrated by utilizing an integrated wiring technology, a network communication technology, a safety precaution technology, an automatic control technology and an audio and video technology, an efficient control management system for residential facilities and home schedule transactions is constructed, home intelligence, safety, convenience and comfort are improved, and an environment-friendly control system platform is realized. The intelligent home control system is an intelligent home core, is a basis for realizing the control function of the intelligent home, and is flexible in system composition. In general, the intelligent home control system is formed by combining subsystems through a network communication system. You can reduce or increase subsystems as required to meet the demand; the operation and management are convenient. All devices controlled by the smart home can be operated through a mobile phone, a tablet personal computer, a touch screen and other human-computer interfaces, so that the operation is very convenient; the scene control function is abundant. Various control modes can be set, such as a leaving mode, a returning mode, a raining mode, a birthday mode, a party mode, an energy-saving mode and the like, so that the requirements on life quality are greatly met; and sharing information resources. The temperature, humidity and dryness of the home can be published on the network to form a whole regional environment monitoring point, so that effective and valuable information is provided for environment monitoring; the installation and debugging are convenient. Plug and play, especially in a wireless manner, allows for rapid deployment of the system.
Disclosure of Invention
In order to solve the technical problems in the background art, the invention provides an intelligent home control system for sensing emotion to convert scene change, and solves the problems that the intelligent home control system in the market can only provide simple home assistance such as light switch, air conditioner temperature adjustment, curtain opening proportion and the like for a user, cannot sense the emotion of the user, and converts an indoor scene through sensed data to relieve the emotion of the user.
Therefore, the invention provides an intelligent home control system for sensing emotion to convert scene change, which comprises:
the sensing system is used for identifying human emotion; the sensing system comprises a picture recognition sensor, a sound recognition sensor and a laser radar sensor, and uploads recognized information to the edge computing host;
the edge calculation host computer is used for receiving the information identified by the sensing system and making a response according to the information; the edge computing host sends information of the sensing system to a computing platform through a network, matches the feedback with a local intelligent emotion EI model to obtain a corresponding local intelligent emotion EI model, and controls the local intelligent emotion linkage model to perform linkage operation;
the computing platform is used for analyzing and comparing the information of the sensing system; the computing platform analyzes and compares the information of the sensing system with the emotion model library, and feeds back an analysis result to the edge computing AI host through a network.
As a preferred technical scheme of the invention, the local intelligent emotion EI model comprises joy, wound, depression, excitement, joy, 24774, center and tension.
As a preferred technical scheme of the invention, the local intelligent emotion linkage model comprises an intelligent lighting system and an intelligent audio-visual system.
As a preferred technical solution of the present invention, the network includes an ethernet module and a wifi module.
As a preferred technical scheme of the invention, the computing platform is an AI and cloud computing platform.
As a preferred technical scheme of the invention, the emotion model library comprises deep learning and training and historical and real-time data analysis.
The invention provides an intelligent home control system for sensing emotion to convert scene change, which recognizes and analyzes the psychological emotion of a person through a picture recognition sensor, a sound recognition sensor, an odor recognition sensor, an environment recognition sensor and a health recognition sensor, adjusts several aspects of background music, light color tone and spatial odor according to the analyzed result, stimulates the sense organs of the human body from three aspects of vision, hearing and smell, and achieves the purpose of relieving emotion, and if the situation that the human body is in a continuously excited state is detected, the effect of restoring the mood can be achieved through changing spatial scene arrangement.
Drawings
FIG. 1 is a flow diagram of an embodiment of the present invention.
Detailed Description
The technical solution of the present invention will be described in detail below with reference to specific examples.
Referring to fig. 1, the invention provides an intelligent home control system for sensing emotion to convert scene change, comprising:
the sensing system is used for identifying human emotion; the sensing system comprises a picture recognition sensor, a sound recognition sensor and a laser radar sensor, and uploads recognized information to the edge computing host;
the edge calculation host computer is used for receiving the information identified by the sensing system and making a response according to the information; the edge computing host sends the information of the sensing system to a computing platform through a network, matches the feedback with the local intelligent emotion EI model to obtain a corresponding local intelligent emotion EI model, and controls the local intelligent emotion linkage model to perform linkage operation;
the computing platform is used for analyzing and comparing the information of the sensing system; and the computing platform analyzes and compares the information of the sensing system with the emotion model library, and feeds back the analysis result to the edge computing AI host through the network.
Preferably, the local intelligent emotion EI model comprises joy, injury, depression, excitement, joy, 24774, center, tension and other negative emotions.
Preferably, the local intelligent emotion linkage model comprises an intelligent lighting system and an intelligent audio-visual system.
Preferably, the network comprises an ethernet module and a wifi module.
Preferably, the computing platform is an AI and cloud computing platform.
Preferably, the emotional model library comprises deep learning and training and historical and real-time data analysis
Example 1:
when a user is in a tea art scene, facial expressions and speaking tone of the user are identified and analyzed through a picture identification sensor and a sound identification sensor in a sensing system, a radar sensor is used for identifying body actions of the user, for example, when the user makes sitting gestures, and the user takes tea in gestures and language and is involved in drinking tea, an odor identification sensor, an environment identification sensor and a health identification sensor can be used for detecting air parameters such as temperature, humidity, PM2.5, odor and the like of the same-space environment and data such as heart rate, breathing rate and the like of a human body, and then uploading the data to an edge computing AI host, the edge computing AI host automatically matches an existing data model, and the behavior track data and schedule transaction data of the user are fed back by combining the AI and a cloud computing platform, so that the user can be analyzed and judged to be in the tea art scene, for example: when a user is tired, the intelligent lighting system is controlled to adopt dim light to enable the user to feel comfortable, relaxed, peaceful and quiet, the intelligent audio and video system is controlled to adopt low-volume pure music to enable the user to have quiet and comfortable mood and further relieve pressure, the intelligent curtain system is used for controlling the curtain to be opened by one fifth to inject dim light into a room, so that quiet tea art atmosphere is created, and the intelligent air-conditioning system is used for controlling the air-conditioning temperature to be 24 ℃ and working at low wind speed to match the current tea art atmosphere;
example 2:
when a user is in a scene of going home, the facial expression and the speaking voice of the user are identified and analyzed through a picture identification sensor and a sound identification sensor in a sensing system, a radar sensor is used for identifying the limb actions of the user, the data of the historical working environment of an AI and a cloud computing platform are combined and transmitted to a local intelligent emotion EI model together, and then the mood index of the owner is calculated, for example: when the mood of the user is inferred to be depressed, the local intelligent emotion linkage model can control the intelligent lighting system to relieve the depressed mood of the user by adopting warm light according to the result of the local intelligent emotion EI model, control the intelligent audio and video system to make the mood of the user quiet and comfortable by adopting the relaxed R & B, and control the curtain to be opened by three quarters through the intelligent curtain system to enable the room to be full of light, so that the user can watch a long distance conveniently, and control the air-conditioning temperature to be 19 ℃ and work at medium speed through the intelligent air-conditioning system to match the mood of the current user when the user goes home.
The intelligent control system is characterized in that the intelligent control system identifies and analyzes the psychological emotion of a person through the picture identification sensor and the sound identification sensor, adjusts several aspects of background music, light color tone and space smell according to the analyzed result, stimulates the sense organs of the person from three aspects of vision, hearing and smell, achieves the purpose of relieving emotion, and can achieve the effect of calming the mood by changing the spatial scene arrangement if the person is detected to be in a continuously excited state.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (6)
1. The utility model provides a perception mood is used for converting intelligent house control system of scene change which characterized in that includes:
the sensing system is used for identifying human emotion; the sensing system comprises a picture recognition sensor, a sound recognition sensor and a laser radar sensor, and uploads recognized information to the edge computing host;
the edge calculation host computer is used for receiving the information identified by the sensing system and making a response according to the information; the edge computing host sends information of the sensing system to a computing platform through a network, matches the feedback with a local intelligent emotion EI model to obtain a corresponding local intelligent emotion EI model, and controls the local intelligent emotion linkage model to perform linkage operation;
the computing platform is used for analyzing and comparing the information of the sensing system; the computing platform analyzes and compares the information of the sensing system with the emotion model library, and feeds back an analysis result to the edge computing AI host through a network.
2. The smart home control system for sensing emotion to translate a scene change as recited in claim 1, wherein the local smart emotion EI model comprises joy, injury, stasis, excitement, joy, 24774, center and tension.
3. The smart home control system for sensing emotion to convert scene changes as claimed in claim 1, wherein said local smart emotion linkage model includes a smart light system and a smart audio/video system.
4. The smart home control system for sensing emotion to translate scene changes as recited in claim 1, wherein said network comprises an ethernet module and a wifi module.
5. The smart home control system for sensing emotion to translate scene changes as recited in claim 1, wherein said computing platform is an AI and cloud computing platform.
6. The smart home control system for sensing emotion to translate scene changes as recited in claim 1, wherein said emotion model library includes deep learning and training and historical and real-time data analysis.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110437315.2A CN113116319A (en) | 2021-04-22 | 2021-04-22 | Intelligent home control system for converting scene change by sensing emotion |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110437315.2A CN113116319A (en) | 2021-04-22 | 2021-04-22 | Intelligent home control system for converting scene change by sensing emotion |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113116319A true CN113116319A (en) | 2021-07-16 |
Family
ID=76779484
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110437315.2A Pending CN113116319A (en) | 2021-04-22 | 2021-04-22 | Intelligent home control system for converting scene change by sensing emotion |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113116319A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110184900A1 (en) * | 2010-01-22 | 2011-07-28 | Samsung Electronics Co., Ltd. | Affective model device and method for deciding the behavior of an affective model device |
| CN105559804A (en) * | 2015-12-23 | 2016-05-11 | 上海矽昌通信技术有限公司 | Mood manager system based on multiple monitoring |
| CN106773766A (en) * | 2016-12-31 | 2017-05-31 | 广东博意建筑设计院有限公司 | Smart home house keeper central control system and its control method with learning functionality |
| CN107272607A (en) * | 2017-05-11 | 2017-10-20 | 上海斐讯数据通信技术有限公司 | A kind of intelligent home control system and method |
| CN108577866A (en) * | 2018-04-03 | 2018-09-28 | 中国地质大学（武汉） | A kind of system and method for multidimensional emotion recognition and alleviation |
| WO2020085537A1 (en) * | 2018-10-25 | 2020-04-30 | (주)리얼감 | Motion recognition device and motion recognition method using same |
| CN111770609A (en) * | 2020-07-03 | 2020-10-13 | 深圳市明学光电股份有限公司 | Intelligent lamp belt control system and method |
| CN111901943A (en) * | 2020-08-06 | 2020-11-06 | 复旦大学 | Emotion interaction lighting system |
-
2021
- 2021-04-22 CN CN202110437315.2A patent/CN113116319A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110184900A1 (en) * | 2010-01-22 | 2011-07-28 | Samsung Electronics Co., Ltd. | Affective model device and method for deciding the behavior of an affective model device |
| CN105559804A (en) * | 2015-12-23 | 2016-05-11 | 上海矽昌通信技术有限公司 | Mood manager system based on multiple monitoring |
| CN106773766A (en) * | 2016-12-31 | 2017-05-31 | 广东博意建筑设计院有限公司 | Smart home house keeper central control system and its control method with learning functionality |
| CN107272607A (en) * | 2017-05-11 | 2017-10-20 | 上海斐讯数据通信技术有限公司 | A kind of intelligent home control system and method |
| CN108577866A (en) * | 2018-04-03 | 2018-09-28 | 中国地质大学（武汉） | A kind of system and method for multidimensional emotion recognition and alleviation |
| WO2020085537A1 (en) * | 2018-10-25 | 2020-04-30 | (주)리얼감 | Motion recognition device and motion recognition method using same |
| CN111770609A (en) * | 2020-07-03 | 2020-10-13 | 深圳市明学光电股份有限公司 | Intelligent lamp belt control system and method |
| CN111901943A (en) * | 2020-08-06 | 2020-11-06 | 复旦大学 | Emotion interaction lighting system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106773766A (en) | Smart home house keeper central control system and its control method with learning functionality | |
| TW494308B (en) | Control method | |
| CN107272607A (en) | A kind of intelligent home control system and method | |
| CN108111948A (en) | The visual output that server at speech interface equipment provides | |
| WO2019134473A1 (en) | Speech recognition system, method and apparatus | |
| Castillo et al. | A framework for recognizing and regulating emotions in the elderly | |
| WO2018006372A1 (en) | Method and system for controlling household appliance on basis of intent recognition, and robot | |
| CN104991464B (en) | A kind of information processing method and control system | |
| Ramadan et al. | The intelligent classroom: towards an educational ambient intelligence testbed | |
| CN110822648B (en) | Air conditioner, control method thereof, and computer-readable storage medium | |
| CN110958750B (en) | Lighting equipment control method and device | |
| CN111578465A (en) | Intelligent adjusting method and system for indoor environment | |
| CN111901943B (en) | Emotion interaction lighting system | |
| JP2016532355A (en) | Intelligent housing system and operation method | |
| CN111123851A (en) | Method, device and system for controlling electric equipment according to user emotion | |
| CN102128382A (en) | Sound-control intelligent table lamp capable of telling stories | |
| CN109429415A (en) | Illumination control method, apparatus and system | |
| CN206671790U (en) | Smart home house keeper's central control system with learning functionality | |
| CN111897234A (en) | Intelligent home control system based on 5G network | |
| CN111770609A (en) | Intelligent lamp belt control system and method | |
| CN117156635A (en) | Intelligent interaction energy-saving lamp control platform | |
| CN111760159A (en) | Intelligent healthy sleep-aiding method | |
| CN204795771U (en) | Multi -functional intelligent lamps and lanterns | |
| CN206743628U (en) | A kind of intelligentized Furniture lamp light control system based on speech recognition | |
| CN113116319A (en) | Intelligent home control system for converting scene change by sensing emotion |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210716 |