CN106950844A - A kind of smart home monitoring method and device - Google Patents
A kind of smart home monitoring method and device Download PDFInfo
- Publication number
- CN106950844A CN106950844A CN201710216625.5A CN201710216625A CN106950844A CN 106950844 A CN106950844 A CN 106950844A CN 201710216625 A CN201710216625 A CN 201710216625A CN 106950844 A CN106950844 A CN 106950844A
- Authority
- CN
- China
- Prior art keywords
- user
- thermal imaging
- real
- smart home
- imaging data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0861—Network architectures or network communication protocols for network security for authentication of entities using biometrical features, e.g. fingerprint, retina-scan
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Abstract
The present invention is applied to electronic technology field, and there is provided a kind of smart home monitoring method and device, it is intended to which the monitor mode solved in the prior art to intelligent appliance is cumbersome, the problem of intelligent level is not high.Methods described includes：Obtain the real-time thermal imaging data of user；Identification is carried out to user according to real-time thermal imaging data, the identity information of user is determined；Real-time thermal imaging data are analyzed, the current state of user is judged；According to the habits and customs information prestored, corresponding manipulation instruction is determined by identity information and state；Perform manipulation instruction.Technical scheme is by way of the real-time thermal imaging data for monitoring user, judge the state of user, and then corresponding manipulation instruction is determined according to state, realize the automatic manipulation to home equipment, the control to different home equipments is manually completed without the various applications for relying on intelligent terminal, intelligent level is improved, and strengthens Consumer's Experience.
Description
Technical field
The present invention relates to electronic technology field, more particularly to a kind of smart home monitoring method and device.
Background technology
With developing rapidly for Internet of Things, intelligent domestic system emerges in an endless stream, and the life of people increasingly tends to be convenient, soon
It is prompt.
But, in current intelligent domestic system, intelligent appliance mostly takes the mode linked with intelligent terminal,
And different intelligent household appliances are substantially to do things in his own way, user needs to download various different intelligent household electrical appliances correspondences in intelligent terminal
Application APP realize control to intelligent appliance, it is clear that this mode trivial operations, also, intelligent appliance is controlled by APP
There is still a need for being accomplished manually, intelligent level is relatively low.
The content of the invention
The embodiment of the present invention provides a kind of smart home monitoring method and device, it is intended to solve in the prior art to intelligent family
The monitor mode of electricity is cumbersome, the problem of intelligent level is not high.
In a first aspect, the embodiments of the invention provide a kind of smart home monitoring method, the smart home monitoring method bag
Include：
Obtain the real-time thermal imaging data of user；
Identification is carried out to the user according to the real-time thermal imaging data, the identity information of the user is determined；
The real-time thermal imaging data are analyzed, the current state of the user is judged；
According to the habits and customs information prestored, corresponding manipulation instruction is determined by the identity information and the state,
Wherein, the first correspondence that the habits and customs information is included between the identity information, the state and the manipulation instruction is closed
System；
Perform the manipulation instruction.
On the other hand, the embodiments of the invention provide a kind of smart home supervising device, the smart home supervising device bag
Include:
Acquisition module, the real-time thermal imaging data for obtaining user；
Identification module, for carrying out identification to the user according to the real-time thermal imaging data, determines institute
State the identity information of user；
Behavioural analysis module, for analyzing the real-time thermal imaging data, judges the current state of the user；
Matching module, it is corresponding by the identity information and the state for according to the habits and customs information prestored
Manipulation instruction, wherein, the habits and customs information includes the between the identity information, the state and the manipulation instruction
One corresponding relation；
Sending module, for performing the manipulation instruction.
The present invention implements to obtain the real-time thermal imaging data of user, and carries out identity to user according to real-time thermal imaging data
Identification, determines the identity information of user, analyzes the real-time thermal imaging data of user, judges the current state of user, according to prestoring
Habits and customs information, determined by the identity information and state of user after corresponding manipulation instruction, perform the manipulation instruction.It is logical
The mode of the real-time thermal imaging data of monitoring user is crossed, the state of user is judged, and then determine that corresponding manipulation refers to according to state
Order, realizes the automatic manipulation to home equipment, is manually completed without the various applications for relying on intelligent terminal to not consanguinity
The control of equipment is occupied, intelligent level is improved, and strengthen Consumer's Experience.
Brief description of the drawings
Fig. 1 is a kind of flow chart for smart home monitoring method that the embodiment of the present invention one is provided；
Fig. 2 is a kind of flow chart for smart home monitoring method that the embodiment of the present invention two is provided；
Fig. 3 is a kind of structural representation for smart home supervising device that the embodiment of the present invention three is provided；
Fig. 4 is a kind of structural representation for smart home supervising device that the embodiment of the present invention four is provided.
Embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, it is right below in conjunction with drawings and Examples
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
The realization of the present invention is described in detail below in conjunction with specific accompanying drawing.
Embodiment one：
Fig. 1 is a kind of flow chart for smart home monitoring method that the embodiment of the present invention one is provided, the embodiment of the present invention
Executive agent is smart home monitoring device, and it can be specifically computer equipment, the smart home monitoring method tool of Fig. 1 examples
Body can include step S101 to step S105, and details are as follows：
S101, the real-time thermal imaging data for obtaining user.
Specifically, thermal imaging data can be collected by infrared thermal imaging equipment, and smart home monitoring device is obtained
The real-time thermal imaging data that infrared thermal imaging equipment is collected in real time.
Because body surface temperature can give off electromagnetic wave when more than absolute zero, with temperature change, electromagnetic wave
Radiation intensity also changes therewith with wavelength diffusion properties, and electromagnetic wave of the wavelength between 0.75 μm to 1 μm is referred to as infrared ray.It is red
Outer thermal imaging apparatus is the infrared ray specific band signal with photoelectric technology detection object heat radiation, and is converted the signal into
It is available for the image of visual discrimination, it is possible to further calculate temperature value.Infrared thermal imaging equipment use it is this it is infrared heat into
As technology has surmounted dysopia, the temperature distribution state of body surface can be shown, and not by light and barrier etc.
Influence.
S102, according to the real-time thermal imaging data of user identification is carried out to the user, determine the identity letter of the user
Breath.
Specifically, smart home monitoring device extracts the real-time thermal imaging by analyzing real-time thermal imaging data
Characteristics of image in data, characteristics of image can include picture altitude, image area of thermal imaging of thermal imaging etc..Due to difference
Characteristics of image between user has differences, and therefore, it can complete by the analysis of the characteristics of image to real-time thermal imaging data
Identification to user, confirms the identity information of user.Preferably, can be in advance by the identity information of user with the user's
Characteristics of image correspondence is preserved, after the characteristics of image in extracting real-time thermal imaging data, according to the identity information pre-saved
And characteristics of image, the identity information of the corresponding user of characteristics of image in real-time thermal imaging data is matched, the body to user is completed
Part identification.
S103, the real-time thermal imaging data for analyzing user, judge the current state of the user.
Specifically, smart home monitoring device is by analyzing the real-time thermal imaging data of user, according to real-time thermal imaging number
According to information such as the figure of corresponding thermal imaging, the temperature of thermal imaging, and the time of thermal imaging and positions, determine that the user is current
State.If for example, judging the position of the thermal imaging of user according to real-time thermal imaging data in bedroom, the image of thermal imaging is flat
Lie state, and the temperature subnormal temperature of thermal imaging, then it is abnormal sleep state that can determine the current state of user, i.e.,
Come into sleep state and cause the state of catching a cold of temperature decline due to not warming in time.
If energy Household monitor equipment judges the temperature of the thermal imaging of user beyond the user according to real-time thermal imaging data
Normal body temperature range, then it is body abnormality state to confirm the current state of the user, and can be according to the temperature to thermal imaging
Degree further judge to exceed the specific body part of normal body temperature range by analysis, and by the body part information record in body
In abnormality.
The habits and customs information that S104, basis prestore, determines that corresponding manipulation refers to by the identity information and state of user
Order, wherein, the habits and customs information prestored includes the first corresponding relation between identity information, state and manipulation instruction.
Specifically, smart home monitoring device can preselect the habits and customs information of storage user, the habits and customs information
Contain the corresponding relation between the identity information of user, the state of user and manipulation instruction.
Manipulation instruction can include the control instruction to home equipment, can also include smart home monitoring device direct
The instruction of execution.
Home equipment needs to complete registration in smart home monitoring device in advance so that smart home monitoring device can
Communicated with the home equipment of registration.
The user that smart home monitoring device is determined according to the identity information and step S103 of the step S102 users determined
State, the manipulation instruction corresponding with identity information and state can be determined from the habits and customs information prestored.
For example, if user current state is abnormal sleep state, smart home monitoring device can be according to prestoring
Habits and customs information determines that the user corresponding manipulation instruction under abnormal sleep state is regulation air-conditioner temperature.
For body abnormality state, the corresponding manipulation instruction of body abnormality state can be with the habits and customs information prestored
To provide a user corresponding medical advice according to the body part information included in body abnormality state.If the current shape of user
State is body abnormality state, and smart home monitoring device determines corresponding manipulation under body abnormality state according to habits and customs information
Instruct directly to provide a user medical advice, then smart home monitoring device determines exception occur according to body part information
Body part, and the actual temp of the thermal imaging of combination user provides specifically taken medicine for the body part suggestion or medical treatment
It is recommended that.Habits and customs information can targetedly be set according to the habits and customs of particular user.If for example, the blood of user
Sugar is higher, then the state for the user that can be prestored in habits and customs information is that its corresponding manipulation instruction is when cooking state
The menu of few sugared scheme is provided to the user；If user has the custom for eating food, this can be prestored in habits and customs information
When the state of user is food state, its corresponding manipulation instruction is automatically performed food manufacturing process for control machine people.
It should be noted that smart home monitoring device is during daily monitoring, can be by constantly recording user's
The operation of the open and close of state and home equipment, and home equipment temperature change and user thermal imaging temperature change
Change etc., life habits information is updated, so as to improve the precision of Based Intelligent Control.The body of user in habits and customs information
Part information and state can be that the user of one-to-many relation, i.e., one correspondingly can preserve multiple states, state and manipulation instruction
Can be that man-to-man relation can also be the manipulation that the state of one-to-many relation, i.e., one can be to one home equipment of reply
Instruction, can also be to tackling the manipulation instructions of multiple home equipments.
S105, execution manipulation instruction.
Specifically, the manipulation instruction that smart home monitoring device is determined according to step S104, directly performs the manipulation instruction
Or corresponding control instruction is sent to corresponding home equipment, the home equipment enable performs the manipulation instruction automatically, from
And realize and home equipment is automatically controlled, without artificial participation, smart home truly is realized, intelligence is improved
Change level, and enhance Consumer's Experience.
In the present embodiment, the real-time thermal imaging data of user are obtained, and body is carried out to user according to real-time thermal imaging data
Part identification, determines the identity information of user, analyzes the real-time thermal imaging data of user, the current state of user is judged, according to pre-
The habits and customs information deposited, is determined after corresponding manipulation instruction by the identity information and state of user, performs the manipulation instruction.
By way of the real-time thermal imaging data for monitoring user, the state of user is judged, and then corresponding manipulation is determined according to state
Instruction, realizes the automatic manipulation to home equipment, is manually completed without the various applications for relying on intelligent terminal to difference
The control of home equipment, improves intelligent level, and strengthen Consumer's Experience.
Embodiment two：
Fig. 2 is a kind of flow chart for smart home monitoring method that the embodiment of the present invention two is provided, the embodiment of the present invention
Executive agent is smart home monitoring device, and it can be specifically computer equipment, the smart home monitoring method tool of Fig. 2 examples
Body can include step S201 to step S214, and details are as follows：
If S201, the operation for detecting user's triggering unlocked by fingerprint, obtain finger print data and the collection of the user input
The initial thermal imaging data of the user.
Specifically, if smart home monitoring device detects the operation that user triggers unlocked by fingerprint, user input is obtained
Finger print data, while gathering the initial thermal imaging data of the user by infrared thermal imaging equipment.
Because body surface temperature can give off electromagnetic wave when more than absolute zero, with temperature change, electromagnetic wave
Radiation intensity also changes therewith with wavelength diffusion properties, and electromagnetic wave of the wavelength between 0.75 μm to 1 μm is referred to as infrared ray.It is red
Outer thermal imaging apparatus is the infrared ray specific band signal with photoelectric technology detection object heat radiation, and is converted the signal into
It is available for the image of visual discrimination, it is possible to further calculate temperature value.Infrared thermal imaging equipment use it is this it is infrared heat into
As technology has surmounted dysopia, the temperature distribution state of body surface can be shown, and not by light and barrier etc.
Influence.
S202, the identity information for determining according to the finger print data of user the user.
Specifically, smart home monitoring device determines the identity information of the user according to the finger print data of user input.
It is understood that validated user needs advance typing finger print data, smart home monitoring device is recorded according to user
The finger print data entered pre-saves the corresponding identity information of the finger print data.
S203, the thermal imaging feature for determining according to the initial thermal imaging data of user the user.
Specifically, smart home monitoring device determines that the thermal imaging of the user is special according to the initial thermal imaging data collected
Levy.Thermal imaging feature can include picture altitude, image area of thermal imaging of thermal imaging collected etc.
S204, by the corresponding preservation of the second corresponding relation progress between the identity information of user and thermal imaging feature.
Specifically, smart home monitoring device determines the identity information of the step S202 users determined and step S203
The thermal imaging information of the user carries out correspondence preservation.
S205, within the default period user is tracked, record the thermal imaging data of the user.
Specifically, smart home monitoring device persistently tracks the user within the default period, records the heat of the user
Imaging data.
The default period can be 10 days, but be not limited to this, can specifically be set according to the need for practical application
Put, be not limited herein.
S206, using artificial neural network algorithm the thermal imaging data of user are learnt and recognized, update second pair
It should be related to.
Specifically, using the e-learning ability of artificial neural network algorithm, obtained user's is tracked to step S205
Thermal imaging data are constantly learnt, and according to learning outcome update identity information with it is second corresponding between thermal imaging feature
Relation.
S207, the real-time thermal imaging data for obtaining user.
Specifically, smart home monitoring device obtains the real-time thermal imaging data that infrared thermal imaging equipment is collected in real time.
Real-time thermal imaging feature in S208, the real-time thermal imaging data of extraction user.
Specifically, smart home monitoring device extracts the real-time thermal imaging by analyzing real-time thermal imaging data
Real-time thermal imaging feature in data, real-time thermal imaging feature can include picture altitude, the image surface of thermal imaging of thermal imaging
Product etc..
S209, according to the second corresponding relation, determine the identity information of the corresponding user of real-time thermal imaging feature of user.
Specifically, smart home monitoring device is closed according to second between the identity information and thermal imaging feature of user is corresponding
System, matches the corresponding identity information of real-time thermal imaging feature, completes the identification to user, confirm the identity information of user.
S210, the real-time thermal imaging data for analyzing user, judge the current state of the user.
Specifically, smart home monitoring device is by analyzing the real-time thermal imaging data of user, according to real-time thermal imaging number
According to information such as the figure of corresponding thermal imaging, the temperature of thermal imaging, and the time of thermal imaging and positions, determine that the user is current
State.
If for example, judging the position of the thermal imaging of user according to real-time thermal imaging data in bedroom, the image of thermal imaging is
Lying status, and the temperature subnormal temperature of thermal imaging, then it is abnormal sleep state that can determine the current state of user,
Come into sleep state and cause the state of catching a cold of temperature decline due to not warming in time.
If energy Household monitor equipment judges the temperature of the thermal imaging of user beyond the user according to real-time thermal imaging data
Normal body temperature range, then it is body abnormality state to confirm the current state of the user, and can be according to the temperature to thermal imaging
Degree further judge to exceed the specific body part of normal body temperature range by analysis, and by the body part information record in body
In abnormality.
The habits and customs information that S211, basis prestore, determines that corresponding manipulation refers to by the identity information and state of user
Order, wherein, the habits and customs information prestored includes the first corresponding relation between identity information, state and manipulation instruction.
Specifically, smart home monitoring device can preselect the habits and customs information of storage user, the habits and customs information
Contain the corresponding relation between the identity information of user, the state of user and manipulation instruction.
Manipulation instruction can be the control instruction for including control to home equipment, can also include smart home monitoring device
The instruction directly performed.
Home equipment needs to complete registration in smart home monitoring device in advance so that smart home monitoring device can
Communicated with the home equipment of registration.
The user that smart home monitoring device is determined according to the identity information and step S210 of the step S209 users determined
State, the manipulation instruction corresponding with identity information and state can be determined from the habits and customs information prestored.
For example, if user current state is abnormal sleep state, smart home monitoring device can be according to prestoring
Habits and customs information determines that the user corresponding manipulation instruction under abnormal sleep state is regulation air-conditioner temperature.
For body abnormality state, the corresponding manipulation instruction of body abnormality state can be with the habits and customs information prestored
To provide a user corresponding medical advice according to the body part information included in body abnormality state.If the current shape of user
State is body abnormality state, and smart home monitoring device determines corresponding manipulation under body abnormality state according to habits and customs information
Instruct directly to provide a user medical advice, then smart home monitoring device determines exception occur according to body part information
Body part, and the actual temp of the thermal imaging of combination user provides specifically taken medicine for the body part suggestion or medical treatment
It is recommended that.
Habits and customs information can targetedly be set according to the habits and customs of particular user.If for example, user
Blood glucose it is higher, then the state of the user that can be prestored in habits and customs information for cook state when, its corresponding manipulation refers to
Make providing the menu of few sugared scheme to the user；, can be pre- in habits and customs information if user has the custom for eating food
When the state for depositing the user is food state, its corresponding manipulation instruction is automatically performed food manufacturing process for control machine people.
It should be noted that smart home monitoring device is during daily monitoring, can be by constantly recording user's
The operation of the open and close of state and home equipment, and home equipment temperature change and user thermal imaging temperature change
Change etc., life habits information is updated, so as to improve the precision of Based Intelligent Control.The body of user in habits and customs information
Part information and state can be that the user of one-to-many relation, i.e., one correspondingly can preserve multiple states, state and manipulation instruction
Can be that man-to-man relation can also be the manipulation that the state of one-to-many relation, i.e., one can be to one home equipment of reply
Instruction, can also be to tackling the manipulation instructions of multiple home equipments.
S212, execution manipulation instruction.
Specifically, the manipulation instruction that smart home monitoring device is determined according to step S211, directly performs the manipulation instruction
Or corresponding control instruction is sent to corresponding home equipment, the home equipment enable performs the manipulation instruction automatically, from
And realize and home equipment is automatically controlled, without artificial participation, smart home truly is realized, intelligence is improved
Change level, and enhance Consumer's Experience.
S213, the hot heat transfer agent for monitoring home equipment.
Specifically, smart home monitoring device monitors the hot heat transfer agent of chartered home equipment at any time.Heat sensing
Information can be gathered by infrared heat sensor on home equipment, hot heat transfer agent can including temperature etc. information.
S214, the hot heat transfer agent according to home equipment, the first control instruction is sent to the home equipment.
Specifically, the hot heat transfer agent of home equipment of the smart home monitoring device to getting is analyzed, and judges heat
Whether heat transfer agent is normal, and sends the first control instruction to the home equipment according to judged result.
For example, the illuminating lamp in corridor or garage at home installs infrared heat sensor, it is red when there is user to pass through
The infrared signal that outer heat sensor is collected changes, the heat that smart home monitoring device is collected according to infrared heat sensor
Heat transfer agent, the instruction turned on light or turned off the light is sent to illuminating lamp.
Further, according to the hot heat transfer agent of home equipment, sending the first control instruction to the home equipment can be with
Realized, described in detail as follows by step S2141 to step S2143：
If the hot heat transfer agent of S2141, home equipment exceedes default normality threshold scope, sent to the home equipment
The control instruction of abnormality processing, and send warning message to user.
Specifically, smart home monitoring device judge the hot heat transfer agent of home equipment that gets whether it is default just
In normal threshold range, if the hot heat transfer agent of home equipment exceedes default normality threshold scope, sent to the home equipment
The control instruction of abnormality processing, and warning message is sent to user, the warning message can include home equipment and exception occurs
Prompt message, and send to the home equipment control instruction content etc. of abnormality processing.
Warning message can be sent to user by smart home monitoring device by short message or other instant communication messages
Intelligent terminal, so that user can understand warning message in time, but be not limited to this, the specific transmitting-receiving mode of warning message can
According to being selected the need for practical application, not to be limited herein.
S2142, the response message for receiving user's return.
Specifically, user is received after warning message, and the control instruction determination performed according to smart home monitoring device is
It is no to need further to control home equipment, if user thinks to need further to control home equipment,
Response message is returned to smart home monitoring device, the response message is used for indicating intelligent Household monitor equipment and completes to set household
Standby further manipulation.
S2143, according to response message to home equipment send the second control instruction.
Specifically, the finger of the further control included in the response message that smart home monitoring device is sent according to user
Show, the second control instruction is sent to home equipment.
For example, smart home monitoring device is not in the case where collecting the thermal imaging of user, detects micro-wave oven and dash forward
So it is activated and its temperature has exceeded default normality threshold scope, then smart home monitoring device sends to micro-wave oven and closed
Instruction, directly closes micro-wave oven, while sending the abnormal conditions warning message to user.If it is micro- that user is provided with remote activation
Ripple stove, then user receives can return to the instruction for reopening micro-wave oven to smart home monitoring device after the warning message.
It should be noted that step S213 to step S214 and step S207 is between step S212 in the embodiment of the present invention
Without inevitable sequencing, it can be the relation performed side by side.
In the present embodiment, first by when detecting the operation of user's triggering unlocked by fingerprint, obtaining the user input
Finger print data and the initial thermal imaging data for gathering the user, the identity information of the user is determined according to the finger print data of user,
And the thermal imaging feature of the user is determined according to the initial thermal imaging data of user, by the identity information of user and thermal imaging feature
Between the second corresponding relation carry out correspondence preservation, and track user within the default period, record the thermal imaging of the user
The thermal imaging data of user are learnt and recognized using artificial neural network algorithm by data, update the second corresponding relation, are led to
The identification to user identity can effectively be realized by crossing thermal imaging and the combination of artificial neural network；Then the real-time of user is obtained
Thermal imaging data, extract the real-time thermal imaging feature in the real-time thermal imaging data of user, and determine according to the second corresponding relation
The identity information of the corresponding user of real-time thermal imaging feature of user, analyzes the real-time thermal imaging data of user, judges user
Current state, according to the habits and customs information prestored, corresponding manipulation instruction is determined by the identity information and state of user
Afterwards, the manipulation instruction is performed.By way of the real-time thermal imaging data for monitoring user, the state of user is judged, and then according to
State determines corresponding manipulation instruction, realizes the automatic manipulation to home equipment, without relying on the various of intelligent terminal
Using the control to different home equipments is manually completed, intelligent level is improved, and strengthen Consumer's Experience.Meanwhile, monitor house
The hot heat transfer agent of equipment is occupied, according to the hot heat transfer agent of home equipment, the first control instruction is sent to the home equipment, so that
Realize in smart home environment, to user by the way of monitoring infrared thermal imaging data, to home equipment using monitoring
The mode of infrared heat sensor, thermal imaging and heat sensing is effectively combined, it is further provided intelligent level, and
Avoid all using high cost caused by thermal imaging mode, reduce the cost of smart home.
Embodiment three：
Fig. 3 is a kind of structural representation for smart home supervising device that the embodiment of the present invention three is provided, for the ease of saying
It is bright, it illustrate only the part related to the embodiment of the present invention.A kind of smart home supervising device of Fig. 3 examples can be foregoing reality
The executive agent of the smart home monitoring method of the offer of example one is provided.A kind of smart home supervising device of Fig. 3 examples includes：Obtain
Module 31, identification module 32, state analyzing module 33, matching module 34 and performing module 35, each functional module is specifically
It is bright as follows：
Acquisition module 31, the real-time thermal imaging data for obtaining user；
Identification module 32, identity knowledge is carried out for the real-time thermal imaging data that are obtained according to acquisition module 31 to user
Not, the identity information of the user is determined；
State analyzing module 33, for analyze acquisition module 31 acquisition real-time thermal imaging data, judge user currently
State；
Matching module 34, for according to the habits and customs information prestored, corresponding behaviour to be determined by identity information and state
Control instruction, wherein, habits and customs information includes the first correspondence between identity information, the state of user and the manipulation instruction of user
Relation；
Performing module 35, the manipulation instruction for performing the determination of matching module 34.
Each module realizes the process of respective function in a kind of smart home supervising device that the present embodiment is provided, and can specifically join
The description of embodiment illustrated in fig. 1 is stated before examination, and here is omitted.
Knowable to a kind of smart home supervising device of above-mentioned Fig. 3 examples, in the present embodiment, obtain user it is real-time heat into
Identification is carried out to user as data, and according to real-time thermal imaging data, the identity information of user is determined, analyzes the reality of user
When thermal imaging data, judge the current state of user, according to the habits and customs information prestored, pass through the identity information and shape of user
State is determined after corresponding manipulation instruction, performs the manipulation instruction.By way of the real-time thermal imaging data for monitoring user, judge
The state of user, and then corresponding manipulation instruction is determined according to state, the automatic manipulation to home equipment is realized, without
The various applications for relying on intelligent terminal manually complete the control to different home equipments, improve intelligent level, and strengthen use
Experience at family.
Example IV：
Fig. 4 is a kind of structural representation for smart home supervising device that the embodiment of the present invention four is provided, for the ease of saying
It is bright, it illustrate only the part related to the embodiment of the present invention.A kind of smart home supervising device of Fig. 4 examples can be foregoing reality
The executive agent of the smart home monitoring method of the offer of example two is provided.A kind of smart home supervising device of Fig. 4 examples includes：Obtain
Module 41, identification module 42, state analyzing module 43, matching module 44 and performing module 45, each functional module is specifically
It is bright as follows：
Acquisition module 41, the real-time thermal imaging data for obtaining user；
Identification module 42, identity knowledge is carried out for the real-time thermal imaging data that are obtained according to acquisition module 41 to user
Not, the identity information of the user is determined；
State analyzing module 43, for analyze acquisition module 41 acquisition real-time thermal imaging data, judge user currently
State；
Matching module 44, for according to the habits and customs information prestored, corresponding behaviour to be determined by identity information and state
Control instruction, wherein, habits and customs information includes the first correspondence between identity information, the state of user and the manipulation instruction of user
Relation；
Performing module 45, the manipulation instruction for performing the determination of matching module 44.
Further, the smart home supervising device also includes：
Acquisition module 46, if triggering the operation of unlocked by fingerprint for detecting user, obtains the fingerprint of the user input
Data and the initial thermal imaging data for gathering the user；
Identity determining module 47, the finger print data for being obtained according to acquisition module 46 determines the identity information of user；
Characteristic determination module 48, the initial thermal imaging data for being gathered according to acquisition module 46 determine the thermal imaging of user
Feature；
Preserving module 49, for by the corresponding preservation of the second corresponding relation progress between identity information and thermal imaging feature；
Tracking module 50, for tracking user within the default period, records the thermal imaging data of the user；
Study module 51, for the thermal imaging data recorded using artificial neural network algorithm to tracking module 50
Practise and recognize, update the second corresponding relation.
Further, identification module 42 includes：
Extracting sub-module 421, the real-time thermal imaging in real-time thermal imaging data for extracting the acquisition of acquisition module 41 is special
Levy；
Submodule 422 is recognized, for according to the second corresponding relation, determining the real-time thermal imaging that extracting sub-module 421 is extracted
The identity information of the corresponding user of feature.
Further, the smart home supervising device also includes：
Monitoring module 52, the hot heat transfer agent for monitoring home equipment；
Control module 53, for the hot heat transfer agent obtained according to monitoring module 52, sends first to home equipment and controls
Instruction.
Further, control module 53 includes：
Alarm submodule 531, if exceeding default normality threshold scope for the hot heat transfer agent that monitoring module 52 is obtained,
The control instruction of abnormality processing is then sent to home equipment, and warning message is sent to user；
Receiving submodule 532, the response message for receiving user's return；
Submodule 533 is responded, the response message for being received according to receiving submodule 532 sends second to home equipment and controlled
System instruction.
Each module realizes the process of respective function in a kind of smart home supervising device that the present embodiment is provided, and can specifically join
The description of embodiment illustrated in fig. 2 is stated before examination, and here is omitted.
Knowable to a kind of smart home supervising device of above-mentioned Fig. 4 examples, in the present embodiment, first by detecting use
When the operation of unlocked by fingerprint is triggered at family, obtain the finger print data of the user input and gather the initial thermal imaging data of the user,
The identity information of the user is determined according to the finger print data of user, and determines the user's according to the initial thermal imaging data of user
Thermal imaging feature, by the corresponding preservation of the second corresponding relation progress between the identity information of user and thermal imaging feature, and pre-
If period in tracking user, record the thermal imaging data of the user, using artificial neural network algorithm to user heat into
As data are learnt and are recognized, the second corresponding relation is updated, can be effective by thermal imaging and the combination of artificial neural network
Identification of the realization to user identity；Then the real-time thermal imaging data of user are obtained, the real-time thermal imaging data of user are extracted
In real-time thermal imaging feature, and determine according to the second corresponding relation the body of the corresponding user of real-time thermal imaging feature of user
Part information, analyzes the real-time thermal imaging data of user, judges the current state of user, according to the habits and customs information prestored, leads to
The identity information and state for crossing user are determined after corresponding manipulation instruction, perform the manipulation instruction.By monitoring the real-time of user
The mode of thermal imaging data, judges the state of user, and then determines corresponding manipulation instruction according to state, realizes to home equipment
Automatic manipulation, without rely on intelligent terminal various applications manually complete the control to different home equipments, improve
Intelligent level, and strengthen Consumer's Experience.Meanwhile, the hot heat transfer agent of home equipment is monitored, is passed according to the heat of home equipment
Feel information, the first control instruction is sent to the home equipment, it is achieved thereby that in smart home environment, to user using monitoring
The mode of infrared thermal imaging data, to home equipment using monitoring infrared heat sensor by the way of, by thermal imaging and heat sense into
Row is effectively combined, it is further provided intelligent level, and is avoided all using high cost caused by thermal imaging mode,
Reduce the cost of smart home.
It should be noted that each embodiment in this specification is described by the way of progressive, each embodiment
What is stressed is all the difference with other embodiment, between each embodiment same or similar part mutually referring to
.For device class embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, it is related
Part illustrates referring to the part of embodiment of the method.
It is worth noting that, in said apparatus embodiment, included modules are simply drawn according to function logic
Point, but above-mentioned division is not limited to, as long as corresponding function can be realized；In addition, each functional module is specific
Title is also only to facilitate mutually distinguish, the protection domain being not intended to limit the invention.
Can it will appreciated by the skilled person that realizing that all or part of step in the various embodiments described above method is
To instruct the hardware of correlation to complete by program, corresponding program can be stored in a computer read/write memory medium
In, described storage medium, such as ROM/RAM, disk or CD.
Presently preferred embodiments of the present invention is the foregoing is only, is not intended to limit the invention, all essences in the present invention
Any modification, equivalent and improvement made within refreshing and principle etc., should be included within the scope of the present invention.
Claims (10)
1. a kind of smart home monitoring method, it is characterised in that the smart home monitoring method includes：
Obtain the real-time thermal imaging data of user；
Identification is carried out to the user according to the real-time thermal imaging data, the identity information of the user is determined；
The real-time thermal imaging data are analyzed, the current state of the user is judged；
According to the habits and customs information prestored, corresponding manipulation instruction is determined by the identity information and the state, wherein,
The habits and customs information includes the first corresponding relation between the identity information, the state and the manipulation instruction；
Perform the manipulation instruction.
2. smart home monitoring method according to claim 1, it is characterised in that the real-time thermal imaging of the acquisition user
Before data, the smart home monitoring method also includes：
If detecting the operation that the user triggers unlocked by fingerprint, obtain the finger print data of the user input and gather described
The initial thermal imaging data of user；
The identity information of the user is determined according to the finger print data；
The thermal imaging feature of the user is determined according to the initial thermal imaging data；
By the corresponding preservation of the second corresponding relation progress between the identity information and the thermal imaging feature；
The user is tracked within the default period, the thermal imaging data of the user are recorded；
The thermal imaging data are learnt and recognized using artificial neural network algorithm, second corresponding relation is updated.
3. smart home monitoring method according to claim 2, it is characterised in that described according to the real-time thermal imaging number
Identification is carried out according to the user, determining the identity information of the user includes：
Extract the real-time thermal imaging feature in the real-time thermal imaging data；
According to second corresponding relation, the identity information of the corresponding user of the real-time thermal imaging feature is determined.
4. the smart home monitoring method according to any one of claims 1 to 3, it is characterised in that the smart home prison
Prosecutor method also includes：
Monitor the hot heat transfer agent of home equipment；
According to the hot heat transfer agent, the first control instruction is sent to the home equipment.
5. smart home monitoring method according to claim 4, it is characterised in that described according to the hot heat transfer agent,
Sending the first control instruction to the home equipment includes：
If the hot heat transfer agent exceedes default normality threshold scope, the control of abnormality processing is sent to the home equipment
Instruction, and send warning message to the user；
Receive the response message that the user returns；
Second control instruction is sent to the home equipment according to the response message.
6. a kind of smart home supervising device, it is characterised in that the smart home supervising device includes：
Acquisition module, the real-time thermal imaging data for obtaining user；
Identification module, for carrying out identification to the user according to the real-time thermal imaging data, determines the use
The identity information at family；
State analyzing module, for analyzing the real-time thermal imaging data, judges the current state of the user；
Matching module, for according to the habits and customs information prestored, being determined by the identity information and the state corresponding
Manipulation instruction, wherein, the habits and customs information includes the between the identity information, the state and the manipulation instruction
One corresponding relation；
Sending module, for performing the manipulation instruction.
7. smart home supervising device according to claim 6, it is characterised in that the smart home supervising device is also wrapped
Include：
Acquisition module, if triggering the operation of unlocked by fingerprint for detecting the user, obtains the fingerprint of the user input
Data and the initial thermal imaging data for gathering the user；
Identity determining module, the identity information for determining the user according to the finger print data；
Characteristic determination module, the thermal imaging feature for determining the user according to the initial thermal imaging data；
Preserving module, for by the corresponding guarantor of the second corresponding relation progress between the identity information and the thermal imaging feature
Deposit；
Tracking module, for tracking the user within the default period, records the thermal imaging data of the user；
Study module, for the thermal imaging data to be learnt and recognized using artificial neural network algorithm, updates described
Second corresponding relation.
8. smart home supervising device according to claim 7, it is characterised in that the identification module includes：
Extracting sub-module, for extracting the real-time thermal imaging feature in the real-time thermal imaging data；
Submodule is recognized, for according to second corresponding relation, determining the corresponding user of the real-time thermal imaging feature
Identity information.
9. the smart home supervising device according to any one of claim 6 to 8, it is characterised in that the smart home prison
Control device also includes：
Monitoring module, the hot heat transfer agent for monitoring home equipment；
Control module, for according to the hot heat transfer agent, the first control instruction to be sent to the home equipment.
10. smart home supervising device according to claim 9, it is characterised in that the control module includes：
Alarm submodule, if exceeding default normality threshold scope for the hot heat transfer agent, sends out to the home equipment
The control instruction of abnormality processing is sent, and warning message is sent to the user；
Receiving submodule, for receiving the response message that the user returns；
Submodule is responded, for sending the second control instruction to the home equipment according to the response message.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710216625.5A CN106950844A (en) | 2017-04-01 | 2017-04-01 | A kind of smart home monitoring method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710216625.5A CN106950844A (en) | 2017-04-01 | 2017-04-01 | A kind of smart home monitoring method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106950844A true CN106950844A (en) | 2017-07-14 |
Family
ID=59475286
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710216625.5A Pending CN106950844A (en) | 2017-04-01 | 2017-04-01 | A kind of smart home monitoring method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106950844A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108181819A (en) * | 2017-11-28 | 2018-06-19 | 珠海格力电器股份有限公司 | Inter-linked controlling method, device, system and the home appliance of home appliance |
| CN108881595A (en) * | 2018-06-01 | 2018-11-23 | 珠海格力电器股份有限公司 | A method of mobile phone user's identity is identified using fingerprint and thermal imaging |
| CN109522836A (en) * | 2018-11-13 | 2019-03-26 | 北京物灵智能科技有限公司 | A kind of user behavior recognition method and device |
| CN110543103A (en) * | 2019-08-02 | 2019-12-06 | 安徽泛米科技有限公司 | Automatic control method for smart home |
| CN110941189A (en) * | 2018-09-21 | 2020-03-31 | 上海小蚁科技有限公司 | Intelligent household system and control method thereof and readable storage medium |
| CN111240221A (en) * | 2020-01-21 | 2020-06-05 | 星络智能科技有限公司 | Storage medium, intelligent panel and equipment control method based on intelligent panel |
| CN111273556A (en) * | 2020-01-19 | 2020-06-12 | 珠海格力电器股份有限公司 | Household control method and device and door lock |
| CN112327655A (en) * | 2020-11-16 | 2021-02-05 | 四川爱联科技股份有限公司 | Intelligent household system based on resource sharing technology |
| CN112399144A (en) * | 2020-11-05 | 2021-02-23 | 上海明略人工智能(集团)有限公司 | Thermal imaging monitoring early warning method and device and thermal imaging monitoring management system |
| CN112711233A (en) * | 2020-12-25 | 2021-04-27 | 珠海格力电器股份有限公司 | Intelligent household control method and device, processor, storage medium and electronic equipment |
| CN112884502A (en) * | 2020-03-26 | 2021-06-01 | 上海爱奇尔贸易有限公司 | Commodity selection method and system based on monopoly rate and freshness rate of e-commerce platform |
| CN112907554A (en) * | 2021-03-10 | 2021-06-04 | 珠海格力电器股份有限公司 | Automatic air conditioner adjusting method and device based on thermal infrared image recognition |
| CN113375312A (en) * | 2021-05-18 | 2021-09-10 | 青岛海尔空调器有限总公司 | Method, device and equipment for air conditioner control |
| CN114546236A (en) * | 2021-12-31 | 2022-05-27 | 广州视声智能股份有限公司 | False triggering prevention control method and system for smart home |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101807245A (en) * | 2010-03-02 | 2010-08-18 | 天津大学 | Artificial neural network-based multi-source gait feature extraction and identification method |
| CN102739478A (en) * | 2011-12-29 | 2012-10-17 | 上海理滋芯片设计有限公司 | Intelligent home system with intelligent home health care function, terminal and method |
| CN102867173A (en) * | 2012-08-28 | 2013-01-09 | 华南理工大学 | Human face recognition method and system thereof |
| CN102984039A (en) * | 2012-11-06 | 2013-03-20 | 鸿富锦精密工业（深圳）有限公司 | Intelligent gateway system and intelligent housing system and intelligent control method of household appliances |
| CN104933336A (en) * | 2015-05-06 | 2015-09-23 | 丰唐物联技术（深圳）有限公司 | Method and system for controlling smart home device |
| CN105180380A (en) * | 2015-10-21 | 2015-12-23 | 珠海格力电器股份有限公司 | Intelligent air conditioning system |
| CN106019967A (en) * | 2016-07-01 | 2016-10-12 | 袁子涵 | Smart home system |
-
2017
- 2017-04-01 CN CN201710216625.5A patent/CN106950844A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101807245A (en) * | 2010-03-02 | 2010-08-18 | 天津大学 | Artificial neural network-based multi-source gait feature extraction and identification method |
| CN102739478A (en) * | 2011-12-29 | 2012-10-17 | 上海理滋芯片设计有限公司 | Intelligent home system with intelligent home health care function, terminal and method |
| CN102867173A (en) * | 2012-08-28 | 2013-01-09 | 华南理工大学 | Human face recognition method and system thereof |
| CN102984039A (en) * | 2012-11-06 | 2013-03-20 | 鸿富锦精密工业（深圳）有限公司 | Intelligent gateway system and intelligent housing system and intelligent control method of household appliances |
| CN104933336A (en) * | 2015-05-06 | 2015-09-23 | 丰唐物联技术（深圳）有限公司 | Method and system for controlling smart home device |
| CN105180380A (en) * | 2015-10-21 | 2015-12-23 | 珠海格力电器股份有限公司 | Intelligent air conditioning system |
| CN106019967A (en) * | 2016-07-01 | 2016-10-12 | 袁子涵 | Smart home system |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108181819A (en) * | 2017-11-28 | 2018-06-19 | 珠海格力电器股份有限公司 | Inter-linked controlling method, device, system and the home appliance of home appliance |
| CN108881595A (en) * | 2018-06-01 | 2018-11-23 | 珠海格力电器股份有限公司 | A method of mobile phone user's identity is identified using fingerprint and thermal imaging |
| CN110941189A (en) * | 2018-09-21 | 2020-03-31 | 上海小蚁科技有限公司 | Intelligent household system and control method thereof and readable storage medium |
| CN109522836A (en) * | 2018-11-13 | 2019-03-26 | 北京物灵智能科技有限公司 | A kind of user behavior recognition method and device |
| CN110543103A (en) * | 2019-08-02 | 2019-12-06 | 安徽泛米科技有限公司 | Automatic control method for smart home |
| CN111273556A (en) * | 2020-01-19 | 2020-06-12 | 珠海格力电器股份有限公司 | Household control method and device and door lock |
| CN111273556B (en) * | 2020-01-19 | 2024-03-26 | 珠海格力电器股份有限公司 | Household control method and device and door lock |
| CN111240221A (en) * | 2020-01-21 | 2020-06-05 | 星络智能科技有限公司 | Storage medium, intelligent panel and equipment control method based on intelligent panel |
| CN112884502A (en) * | 2020-03-26 | 2021-06-01 | 上海爱奇尔贸易有限公司 | Commodity selection method and system based on monopoly rate and freshness rate of e-commerce platform |
| CN112399144A (en) * | 2020-11-05 | 2021-02-23 | 上海明略人工智能(集团)有限公司 | Thermal imaging monitoring early warning method and device and thermal imaging monitoring management system |
| CN112327655A (en) * | 2020-11-16 | 2021-02-05 | 四川爱联科技股份有限公司 | Intelligent household system based on resource sharing technology |
| CN112711233A (en) * | 2020-12-25 | 2021-04-27 | 珠海格力电器股份有限公司 | Intelligent household control method and device, processor, storage medium and electronic equipment |
| CN112907554A (en) * | 2021-03-10 | 2021-06-04 | 珠海格力电器股份有限公司 | Automatic air conditioner adjusting method and device based on thermal infrared image recognition |
| CN113375312A (en) * | 2021-05-18 | 2021-09-10 | 青岛海尔空调器有限总公司 | Method, device and equipment for air conditioner control |
| CN114546236A (en) * | 2021-12-31 | 2022-05-27 | 广州视声智能股份有限公司 | False triggering prevention control method and system for smart home |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106950844A (en) | A kind of smart home monitoring method and device | |
| CN108181819B (en) | Linkage control method, device and system for household electrical appliance and household electrical appliance | |
| US11715360B2 (en) | Property control and configuration based on thermal imaging | |
| JP7463102B2 (en) | Systems and methods for monitoring a person's activities of daily living - Patents.com | |
| Suryadevara et al. | Intelligent sensing systems for measuring wellness indices of the daily activities for the elderly | |
| Ghaffarianhoseini et al. | The essence of smart homes: Application of intelligent technologies towards smarter urban future | |
| WO2020253162A1 (en) | Robot and control method therefor, and intelligent home control system | |
| CN112005268B (en) | Refrigerator, method of displaying user interface on refrigerator, user terminal, and method of performing function in user terminal | |
| CN107450329A (en) | The control method and its device of home appliance | |
| US20140370469A1 (en) | Utilizing appliance operating patterns to detect cognitive impairment | |
| Nakagawa et al. | Toward real-time in-home activity recognition using indoor positioning sensor and power meters | |
| CN110362049A (en) | A kind of comfort type smart home system based on cloud platform | |
| Li et al. | IDAct: Towards unobtrusive recognition of user presence and daily activities | |
| Suryadevara et al. | Wellness determination of inhabitant based on daily activity behaviour in real-time monitoring using sensor networks | |
| Arrotta et al. | MICAR: multi-inhabitant context-aware activity recognition in home environments | |
| CN104850731A (en) | Intelligence system for guiding living habit of user | |
| EP3811252B1 (en) | Network activity validation | |
| CN110547606A (en) | Intelligent clothes management system, wardrobe with intelligent clothes management system and working method of intelligent clothes management system | |
| CN114190823B (en) | Intelligent household robot and control method | |
| CN109124301A (en) | A kind of unmanned intelligent kitchen system and its operating method | |
| KR102646691B1 (en) | Personalized method and apparatus for diagnosis dementia | |
| Ishizu et al. | Home Activity Pattern Estimation Using Aggregated Electricity Consumption Data. | |
| Uhrikova et al. | The use of computer vision techniques to augment home based sensorised environments | |
| KR102552172B1 (en) | Personalized method and apparatus for diagnosis dementia | |
| Kang et al. | Sensor Fusion and Device Collaboration based Smart Plug Hub Architecture for Precise Identification of ADL in Real-Time |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170714 |
|
| RJ01 | Rejection of invention patent application after publication |