CN113566395A - Air conditioner, control method and device thereof and computer readable storage medium - Google Patents
Air conditioner, control method and device thereof and computer readable storage medium Download PDFInfo
- Publication number
- CN113566395A CN113566395A CN202110882359.6A CN202110882359A CN113566395A CN 113566395 A CN113566395 A CN 113566395A CN 202110882359 A CN202110882359 A CN 202110882359A CN 113566395 A CN113566395 A CN 113566395A
- Authority
- CN
- China
- Prior art keywords
- image
- air conditioner
- target object
- voice
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000012549 training Methods 0.000 claims description 37
- 238000012545 processing Methods 0.000 claims description 36
- 230000001954 sterilising effect Effects 0.000 claims description 27
- 238000004659 sterilization and disinfection Methods 0.000 claims description 25
- 230000006870 function Effects 0.000 claims description 23
- 238000004590 computer program Methods 0.000 claims description 12
- 238000010801 machine learning Methods 0.000 claims description 10
- 238000004458 analytical method Methods 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 5
- 238000005516 engineering process Methods 0.000 abstract description 7
- 206010011224 Cough Diseases 0.000 description 35
- 230000036541 health Effects 0.000 description 9
- 238000013528 artificial neural network Methods 0.000 description 8
- 230000036760 body temperature Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000005070 sampling Methods 0.000 description 5
- 238000013527 convolutional neural network Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000011176 pooling Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000003058 natural language processing Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000004378 air conditioning Methods 0.000 description 2
- 238000005034 decoration Methods 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000010438 heat treatment Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000306 recurrent effect Effects 0.000 description 2
- 238000005057 refrigeration Methods 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 210000001015 abdomen Anatomy 0.000 description 1
- 244000052616 bacterial pathogen Species 0.000 description 1
- 238000013145 classification model Methods 0.000 description 1
- 230000003749 cleanliness Effects 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000017525 heat dissipation Effects 0.000 description 1
- 208000015181 infectious disease Diseases 0.000 description 1
- 230000002458 infectious effect Effects 0.000 description 1
- 150000002500 ions Chemical class 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000015654 memory Effects 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 210000002569 neuron Anatomy 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 230000006403 short-term memory Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000009423 ventilation Methods 0.000 description 1
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
- F24F11/00—Control or safety arrangements
- F24F11/62—Control or safety arrangements characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values
- F24F11/63—Electronic processing
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
- F24F11/00—Control or safety arrangements
- F24F11/50—Control or safety arrangements characterised by user interfaces or communication
- F24F11/52—Indication arrangements, e.g. displays
- F24F11/526—Indication arrangements, e.g. displays giving audible indications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
- F24F11/00—Control or safety arrangements
- F24F11/50—Control or safety arrangements characterised by user interfaces or communication
- F24F11/56—Remote control
- F24F11/58—Remote control using Internet communication
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
- F24F11/00—Control or safety arrangements
- F24F11/62—Control or safety arrangements characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values
- F24F11/63—Electronic processing
- F24F11/64—Electronic processing using pre-stored data
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
- F24F11/00—Control or safety arrangements
- F24F11/62—Control or safety arrangements characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values
- F24F11/63—Electronic processing
- F24F11/65—Electronic processing for selecting an operating mode
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2415—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4007—Scaling of whole images or parts thereof, e.g. expanding or contracting based on interpolation, e.g. bilinear interpolation
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/02—Feature extraction for speech recognition; Selection of recognition unit
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/06—Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
- G10L15/063—Training
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/16—Speech classification or search using artificial neural networks
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
- F24F2120/00—Control inputs relating to users or occupants
- F24F2120/10—Occupancy
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- Artificial Intelligence (AREA)
- Computational Linguistics (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- Mechanical Engineering (AREA)
- Combustion & Propulsion (AREA)
- Evolutionary Computation (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Chemical & Material Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Acoustics & Sound (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Fuzzy Systems (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Probability & Statistics with Applications (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Air Conditioning Control Device (AREA)
Abstract
The invention discloses an air conditioner, a control method and a control device of the air conditioner and a computer readable storage medium. Wherein, the method comprises the following steps: acquiring voice information and an image of a target object; analyzing the voice information and the image of the target object to obtain the state information of the target object; and generating a control instruction based on the state information, and controlling the operation mode of the air conditioner by using the control instruction. The invention solves the technical problem of low intelligent degree of the air conditioner in the related technology.
Description
Technical Field
The invention relates to the field of intelligent household appliance control, in particular to an air conditioner, a control method and a control device of the air conditioner and a computer readable storage medium.
Background
An air conditioner is an air conditioner which is used for providing a unit for processing air for a space area (generally closed), and can adjust parameters such as temperature, humidity, cleanliness and air flow rate of air in a room (or a closed space or an area) so as to meet the requirements of human comfort or technological processes.
However, the air conditioner in the related art cannot acquire data capable of determining the body state information of the user due to a low degree of intelligence, and thus cannot automatically determine whether the sterilization function of the air conditioner needs to be turned on. When the sterilization function of the air conditioner needs to be started, the sterilization function can be started only manually by a user.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the invention provides an air conditioner, a control method and a control device of the air conditioner and a computer readable storage medium, and at least solves the technical problem that the intelligence degree of the air conditioner is low in the related technology.
According to an aspect of an embodiment of the present invention, there is provided an air conditioner including: the voice acquisition module is used for acquiring voice information of the target object; the image acquisition module is used for acquiring an image of the target object; the processing module is respectively connected with the voice acquisition module and the image acquisition module and is used for analyzing the voice information and the image to obtain state information of the target object and generating a control instruction based on the state information; and the controller is connected with the processing module and used for controlling the air conditioner to operate based on the control instruction when the control instruction is received.
Optionally, the air conditioner further comprises: the image identification module is respectively connected with the image acquisition module and the processing module and is used for identifying the image so as to obtain the physical sign information of the target object; and the voice recognition module is respectively connected with the voice acquisition module and the processing module and is used for recognizing the voice information to obtain the voice characteristics of the target object.
Optionally, the air conditioner further comprises: and the sterilization module is used for sterilizing the area where the air conditioner is located when the air conditioner runs in a sterilization mode.
Optionally, the air conditioner further comprises: and the communication module is used for communicating with preset terminal equipment so as to send the state information of the target object to the preset terminal equipment.
According to another aspect of the embodiments of the present invention, there is provided a control method of an air conditioner, applied to any one of the air conditioners, including: acquiring voice information and an image of a target object; analyzing the voice information and the image of the target object to obtain the state information of the target object; and generating a control instruction based on the state information, and controlling the operation mode of the air conditioner by using the control instruction.
Optionally, acquiring the voice information and the image of the target object includes: collecting voice information of the target object through a voice collecting module, wherein the voice collecting module comprises: a microphone; acquiring an image of the target object by an image acquisition device, wherein the image acquisition device comprises at least one of: infrared camera, thermopile.
Optionally, analyzing the voice information and the image of the target object to obtain the state information of the target object, including: performing natural voice processing on the voice information to obtain voice characteristics of the target object; and carrying out image recognition on the image to obtain the sign information of the target object.
Optionally, performing natural speech processing on the speech information to obtain a speech feature of the target object, including: inputting the voice information into a voice recognition model, wherein the voice recognition model is obtained by using a plurality of groups of training data in advance through machine learning training, and the plurality of groups of training data comprise: voice information and voice characteristics corresponding to the voice information; acquiring the output of the voice recognition model; the speech features are derived based on the output of the speech recognition model.
Optionally, the sign information is temperature information of the target object, and performing image recognition on the image to obtain the sign information of the target object includes: inputting the image into an image recognition model, wherein the image recognition model is obtained by using a plurality of groups of training data in advance through machine learning training, and the plurality of groups of training data comprise: an image and temperature information corresponding to the image; acquiring the output of the image recognition model; the temperature information is derived based on an output of the image recognition model.
Optionally, the temperature information includes temperature values of respective portions of the target object.
Optionally, the control method of the air conditioner further includes: and sending the state information of the target object to a preset terminal device.
Optionally, generating a control instruction based on the state information, and controlling an operation mode of the air conditioner using the control instruction includes: and controlling the air conditioner to operate in a sterilization mode based on the control instruction, and controlling the air conditioner to start a fresh air function.
According to another aspect of the embodiments of the present invention, there is also provided a control apparatus of an air conditioner, applied to the control method of the air conditioner, including: the acquisition module is used for acquiring voice information and images of the target object; the analysis module is used for analyzing the voice information and the image of the target object to obtain the state information of the target object; and the generating module is used for generating a control instruction based on the state information and controlling the operation mode of the air conditioner by using the control instruction.
Optionally, the obtaining module includes: the first acquisition unit is used for acquiring the voice information of the target object through a voice acquisition module, wherein the voice acquisition module comprises: a microphone; a second acquisition unit configured to acquire an image of the target object by an image acquisition device, wherein the image acquisition device includes at least one of: infrared camera, thermopile.
Optionally, the analysis module comprises: the processing unit is used for carrying out natural voice processing on the voice information to obtain the voice characteristics of the target object; and the identification unit is used for carrying out image identification on the image to obtain the sign information of the target object.
Optionally, the processing unit includes: an input subunit, configured to input the speech information to a speech recognition model, where the speech recognition model is obtained through machine learning training using multiple sets of training data in advance, and the multiple sets of training data each include: voice information and voice characteristics corresponding to the voice information; a first obtaining subunit, configured to obtain an output of the speech recognition model; and the second acquisition subunit is used for acquiring the voice characteristics based on the output of the voice recognition model.
Optionally, the sign information is temperature information of the target object, and performing image recognition on the image to obtain the sign information of the target object includes: an input unit, configured to input the image to an image recognition model, where the image recognition model is obtained through machine learning training using a plurality of sets of training data in advance, and each of the plurality of sets of training data includes: an image and temperature information corresponding to the image; a first acquisition unit configured to acquire an output of the image recognition model; and the second acquisition unit is used for obtaining the temperature information based on the output of the image recognition model.
Optionally, the temperature information includes temperature values of respective portions of the target object.
Optionally, the control device of the air conditioner further includes: and the sending module is used for sending the state information of the target object to a preset terminal device.
Optionally, the generating module includes: and the control unit is used for controlling the air conditioner to operate in a sterilization mode based on the control instruction and controlling the air conditioner to start a fresh air function.
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium including a stored computer program, wherein when the computer program is executed by a processor, the apparatus on which the computer storage medium is located is controlled to execute the control device of the air conditioner according to any one of the above.
According to another aspect of the embodiments of the present invention, there is provided a processor for executing a computer program, wherein the computer program executes the control device of the air conditioner according to any one of the above aspects.
In the embodiment of the invention, voice information and an image of a target object are acquired; analyzing the voice information and the image of the target object to obtain the state information of the target object; and generating a control instruction based on the state information, and controlling the operation mode of the air conditioner by using the control instruction. According to the control method of the air conditioner, the purpose that the state information of the target object is obtained through analysis based on the obtained voice information and the obtained image of the target object and the corresponding control instruction is generated to control the operation mode of the air conditioner is achieved, so that the technical effects of improving the intelligent degree and the reliability of the air conditioner are achieved, and the technical problem that the intelligent degree of the air conditioner is low in the related technology is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a schematic diagram of an air conditioner according to an embodiment of the present invention;
fig. 2 is a flowchart of a control method of an air conditioner according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a user cough recognition model according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of an infrared image recognition architecture and extraction of different site temperatures according to an embodiment of the present invention;
FIG. 5 is a flow chart of the infrared image model and the voice model for recognizing cough and determining illness of the user for air conditioning control according to the embodiment of the invention;
fig. 6 is a schematic diagram of a control apparatus of an air conditioner according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
For convenience of description, some nouns or terms appearing in the embodiments of the present invention are explained below.
RNN (current Neural Network, Recurrent Neural Network): is a recurrent neural network, and the RNN is well suited for application in the processing of sequence data.
CNN (feedforward neural network): is a feed-forward neural network, typically consisting of one or more convolutional layers and fully-connected layers, which will also include pooling layers.
LSTM (Long Short Term Memory): the LSTM is a more complex cyclic neural network of neurons, and the LSTM performs well when the processing time sequence interval and delay are long.
A pooling layer: the method is a training layer in the neural network and has the function that when the image size is overlarge in deep learning, a pooling layer is introduced to reduce the size of a parameter matrix, so that the number of parameters in the last full-connection layer is reduced, and overfitting is reduced.
And (3) rolling layers: the method is a training layer in a convolutional neural network, which consists of a plurality of convolution units and aims to extract different input features.
Full connection layer: the method is a training layer which plays a role of a classifier in the convolutional neural network and is used for mapping the learned distributed feature representation to a sample mark space.
ResNet 50: the method is a brand new network aiming at the problem that the accuracy of a training set is reduced, is called as a deep residual error network, and allows the network to be deepened as far as possible.
YOLOv5(You Only Look one): the target detection model is used for identifying and detecting the target.
Aiming at the problems, in order to reduce the contact of a user with foreign people or effectively judge, the intelligent health air conditioner based on the cough voice recognition and the infrared image module fusion is mainly used for judging the body state of indoor people by cough sound of the indoor people and determining whether to start the sterilization function of the air conditioner through body state information. The body temperature of the user can be identified through an infrared camera or a thermopile, and the body temperature detection in a non-contact mode is very useful. The cough event classification model is combined with an infrared camera, and a cough voice recognition system and an infrared system can detect the approximate physical state of indoor personnel.
The following describes an air conditioner, a control method and device thereof, and a computer-readable storage medium according to embodiments of the present invention in detail.
Example 1
According to an aspect of an embodiment of the present invention, there is provided an air conditioner, and fig. 1 is a schematic view of an air conditioner according to an embodiment of the present invention, as shown in fig. 1, including: a voice acquisition module 11, an image acquisition module 13, a processing module 15, and a controller 17. The following explains the air conditioner.
And the voice acquisition module 11 is used for acquiring voice information of the target object.
Optionally, the voice collecting module may include but is not limited to: microphone (CN)
And the image acquisition module 13 is used for acquiring an image of the target object.
Optionally, the image recognition module may include, but is not limited to: infrared camera, thermopile. And the processing module 15 is connected with the voice acquisition module 11 and the image acquisition module 13 respectively, and is used for analyzing the voice information and the image to obtain the state information of the target object and generating a control instruction based on the state information.
And the controller 17 is connected with the processing module 15 and is used for controlling the air conditioner to operate based on the control instruction when receiving the control instruction.
As can be seen from the above, the air conditioner provided in the embodiment of the present invention may utilize the voice collecting module 11 to collect the voice information of the target object; and acquiring an image of the target object by using the image acquisition module 13; the processing module 15 is respectively connected with the voice acquisition module 11 and the image acquisition module 13, and is used for analyzing the voice information and the image to obtain the state information of the target object and generating a control instruction based on the state information; and a controller 17 connected to the processing module 15 for controlling the air conditioner to operate based on the control instruction when receiving the control instruction. By the air conditioner provided by the embodiment of the invention, the aim of analyzing the acquired voice information and the acquired image of the target object to obtain the state information of the target object and generating the corresponding control instruction to control the operation mode of the air conditioner is fulfilled, so that the technical effects of improving the intelligent degree and the reliability of the air conditioner are achieved.
Therefore, the air conditioner of the embodiment of the invention solves the technical problem that the intelligence degree of the air conditioner is lower in the related art.
In an alternative embodiment, the air conditioner further comprises: the image identification module is respectively connected with the image acquisition module and the processing module and is used for identifying the image so as to obtain the physical sign information of the target object; and the voice recognition module is respectively connected with the voice acquisition module and the processing module and is used for recognizing the voice information to obtain the voice characteristics of the target object.
In the above embodiment, the voice information is identified, and natural language processing is generally adopted to obtain the voice feature information of the target object.
In an alternative embodiment, the air conditioner further comprises: and the sterilization module is used for sterilizing the area where the air conditioner is located when the air conditioner runs in a sterilization mode.
In the above alternative embodiment, when the air conditioner operates in the sterilization mode, the indoor may be sterilized by releasing negative ions.
In an alternative embodiment, the air conditioner further comprises: and the communication module is used for communicating with the preset terminal equipment so as to send the state information of the target object to the preset terminal equipment.
Example 2
According to another aspect of the embodiments of the present invention, there is provided a method embodiment of a control method of an air conditioner, it should be noted that the steps shown in the flowchart of the drawings may be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in an order different from that here.
Fig. 2 is a flowchart of a control method of an air conditioner according to an embodiment of the present invention, as shown in fig. 2, the method including the steps of:
in step S202, voice information and an image of the target object are acquired.
In the above steps, the target object may be a user who is frequently moving indoors or a foreign user who enters indoors for the first time, and may be distinguished, recorded and marked by a face recognition technology.
Step S204, analyzing the voice information and the image of the target object to obtain the state information of the target object.
In the above steps, the collected data are matched through natural language processing and a neural network model to obtain results of the two, the results of the two are matched to obtain a data weight value, the current health state of the user is judged according to the weight value, and a corresponding prompt is made or a corresponding operation is executed.
And step S206, generating a control instruction based on the state information, and controlling the operation mode of the air conditioner by using the control instruction.
As can be seen from the above, in the embodiment of the present invention, the voice information and the image of the target object may be obtained first; analyzing the voice information and the image of the target object to obtain the state information of the target object; and finally, generating a control instruction based on the state information, and controlling the operation mode of the air conditioner by using the control instruction. By the control method of the air conditioner, the aim of analyzing the acquired voice information and the acquired image of the target object to obtain the state information of the target object and generating the corresponding control instruction to control the operation mode of the air conditioner is fulfilled, so that the technical effects of improving the intelligent degree and the reliability of the air conditioner are achieved, and the technical problem that the intelligent degree of the air conditioner is low in the related technology is solved.
As an alternative embodiment, in step S202, acquiring the voice information and the image of the target object includes: gather the speech information of target object through the pronunciation collection module, wherein, the pronunciation collection module includes: a microphone; acquiring an image of a target object by an image acquisition device, wherein the image acquisition device comprises at least one of: infrared camera, thermopile.
It should be noted that, in the above alternative embodiment, the thermopile is a pyroelectric infrared sensor, which is a device composed of a thermocouple.
As an alternative embodiment, in step S204, analyzing the voice information and the image of the target object to obtain the state information of the target object includes: carrying out natural voice processing on the voice information to obtain the voice characteristics of the target object; and carrying out image recognition on the image to obtain the physical sign information of the target object.
In the above alternative embodiments, the collected voice includes but is not limited to: the cough sound and the frequency thereof of the user, the sneeze sound and the frequency thereof of the user, etc. can reflect the parameters of the physical health condition of the user.
As an alternative embodiment, performing natural speech processing on the speech information to obtain the speech feature of the target object includes: inputting voice information into a voice recognition model, wherein the voice recognition model is obtained by using a plurality of groups of training data in advance through machine learning training, and the plurality of groups of training data comprise: voice information and voice characteristics corresponding to the voice information; acquiring the output of a voice recognition model; speech features are derived based on the output of the speech recognition model.
Fig. 3 is a schematic diagram of a user cough recognition model according to an embodiment of the present invention, and as shown in fig. 3, first, the training model generation database is labeled according to different cough samples and the entered physical state information, gender and emotion data. The method comprises the steps of reading cough voice of a user in real time through a microphone, converting the cough sound of the user into sequence audio in real time through a cough voice recognition module of the user, importing the sequence audio into a circulating neural network module based on LSTM through a text, extracting an audio sequence and a relationship text of the upper and lower audio sequences of the cough sound through the LSTM module, importing the audio sequence and the relationship text into a ResNet50 classification module, mainly classifying recognized audio sequences and related features into specific categories, processing cough sound data, labeling corresponding illness states of different cough sounds in advance, generating a database, importing the database into a cough voice recognition model, and training.
As an optional embodiment, the sign information is temperature information of the target object, and the image recognition is performed on the image to obtain the sign information of the target object, including: inputting images into an image recognition model, wherein the image recognition model is obtained by using a plurality of groups of training data in advance through machine learning training, and the plurality of groups of training data comprise: an image and temperature information corresponding to the image; acquiring the output of the image recognition model; temperature information is derived based on the output of the image recognition model.
As an alternative embodiment, the temperature information includes temperature values of respective portions of the target object.
In the above alternative embodiment, the target object mainly includes a head, a chest, an abdomen, and other human body parts with high heat dissipation.
Fig. 4 is a schematic diagram of an infrared image recognition architecture and extraction of temperatures of different parts according to an embodiment of the present invention, and as shown in fig. 4, in a thermal infrared image recognition module, a structure of a thermal infrared model is that a residual layer in a YOLOv5 network is replaced by a dense convolution block, a feature pyramid containing 5 convolution layers of different scales is constructed, the feature pyramid and a depth dense network are fused, and a Softmax function is used to classify the fused features, so as to form a depth-fused fast object detection model. Firstly, dimension and scale adjustment is carried out, an 8 × 8 characteristic image with a single channel in scale size is obtained through processing of a convolution layer and a pooling layer, down-sampling operation is carried out on the 8 × 8 characteristic image through a 3 × 3 convolution layer according to two unit scale steps, 8 × 8 characteristic image information is fused, infrared image information loss caused by image down-sampling is reduced, then a 4 × 4 characteristic image with the scale size is obtained, and the same down-sampling processing is carried out on the obtained 4 × 4 characteristic image until a 1 × 1 characteristic image with the scale size is obtained. Directly performing 8 times of upsampling operation on the 1 multiplied by 1 characteristic image by using a bilinear interpolation method, and performing Softmax classification function prediction on each pixel of the obtained upsampled image, namely obtaining the score of each segmentation region; and simultaneously, sequentially obtaining the feature points by up-sampling, performing feature point-by-point addition on the obtained up-sampled image and the same-scale 8 x 8 feature image obtained by down-sampling, and performing Softmax classification function prediction on each pixel of the obtained image to obtain the score of each segmentation region. And finally, comprehensively analyzing the prediction scores of the Softmax classification functions of the four characteristic graphs, and evaluating the user identification and the temperature value to obtain a judgment result.
For example, in this embodiment, when the microphone collects the cough sound of the user and guides the sound to the cough voice module, the body state of the user is obtained, then whether the body surface temperature of the user exceeds the predetermined temperature is collected through the infrared camera, the body state of the user is further judged and the conclusion obtained by the system is sent to the user, when the cough system judges the body state of the user and judges whether the body state of the user is abnormal through the infrared camera, the user does not cough and has overhigh body temperature, the air conditioner with the built-in cough voice recognition system and the infrared image recognition system jointly judges which user in the room has overhigh body temperature, the air conditioner with the built-in cough voice recognition system only recognizes the cough sound of the illness state trained during training, the real-time body state of the user is judged through similar cough sound, the infrared module judges whether the body surface temperature value of the user exceeds 37.3 degrees, and reminding the user when the temperature exceeds 37.3 degrees.
As an optional embodiment, the control method of the air conditioner further includes: and sending the state information of the target object to a preset terminal device.
In the above optional embodiment, after the state information of the target object is sent to the terminal, the state information can be viewed through applications in other terminals such as an APP or a webpage. Wherein, the terminal includes but is not limited to: cell-phone, panel, PC, intelligent wrist-watch etc. make the user can know the health condition of oneself in real time.
As an alternative embodiment, in the step S206, generating a control command based on the state information, and controlling the operation mode of the air conditioner by using the control command includes: and controlling the air conditioner to operate in a sterilization mode based on the control instruction, and controlling the air conditioner to start a fresh air function.
In the above optional embodiment, the sterilization mode mainly uses the ventilation function of the air conditioner and the internal sterilization function of the air conditioner to sterilize and disinfect the air; or the air conditioner is used for releasing substances which can achieve the purpose of disinfection and sterilization to disinfect and sterilize the indoor air.
It should be noted that the fresh air function in the above alternative embodiment is a function of controlling the indoor temperature and updating and ventilating the indoor air according to the health condition of the indoor user.
For example, when the air conditioner with the built-in cough voice recognition system judges that the body of the indoor user is abnormal, the air conditioner automatically starts the corresponding sterilization function and the fresh air function, meanwhile, the user is reminded to take corresponding measures, when the thermal infrared recognition system judges whether the temperature value of the indoor personnel exceeds 37.3 ℃, when the body temperature of the user exceeds 37.3 ℃, the intelligent air conditioner reminds the user to go to a professional institution and a hospital for detection, when the temperature exceeds 37.3 degrees and corresponding results are obtained by combining cough recognition, corresponding control information is generated and sent to the air conditioner main control, and the corresponding air supply mode and the corresponding sterilization function are started, the 26-degree refrigeration mode is automatically started along with the air conditioner (the refrigeration mode is started when the body temperature is too high, the body temperature of a user is favorably reduced), and then corresponding prompt information is sent to the user and the user is reminded to take corresponding precautionary measures, so that the health of the user is well guaranteed.
Fig. 5 is a flowchart illustrating an air conditioning control process by recognizing a cough and determining an illness state of a user through an infrared image model and a voice model according to an embodiment of the present invention, as shown in fig. 5, in an embodiment of the present invention, on one hand, image feature information of an indoor user may be collected through an infrared camera or a thermopile, and then sent to an infrared image recognition module for processing, and then the user is recognized and temperature values of various parts of the user are detected; on the other hand, sound characteristic information of the indoor user is collected through the microphone, the sound characteristic information is sent to the voice and natural language processing module for processing, then, audio characteristic information reflecting body health states such as cough sound of the user is identified and judged, then, the characteristic information of the two aspects is summarized, the cough sound source user or body heating conditions of external people are shot through the infrared camera and combined with the cough sound AI diagnosis module, and finally, results are obtained through the cough sound AI judgment module and the infrared camera processing module to control an air conditioner air supply mode and a corresponding sterilization function.
As can be seen from the above, in the embodiment of the present invention, supervised learning is performed by building a cough recognition model and using a convolutional neural network. According to the model, binary classification is executed by inputting one-second sound profile characteristics, generated output is either a cough event or other information and is subjected to classification judgment to obtain an accurate body condition, a cough sound user or external personnel body heating condition is further shot through an infrared camera and is combined with cough sound AI diagnosis to obtain a final judgment result, an air supply mode of an air conditioner and a sterilization mode for starting corresponding infectious germs are controlled through the judgment result, meanwhile, precautionary measures are fed back to indoor personnel to be made, the purpose of detecting the approximate health condition of the indoor personnel is achieved, the air conditioner starts a corresponding sterilization function and reminds the indoor other personnel to make precautionary measures, and the indoor personnel have a certain health safety guarantee.
Example 3
According to another aspect of the embodiment of the present invention, there is also provided a control apparatus of an air conditioner, fig. 6 is a schematic view of the control apparatus of the air conditioner according to the embodiment of the present invention, as shown in fig. 6, the control apparatus of the air conditioner including: an acquisition module 61, an analysis module 63 and a generation module 65. The following describes the control device of the air conditioner in detail.
And the acquisition module 61 is used for acquiring the voice information and the image of the target object.
And the analysis module 63 is configured to analyze the voice information and the image of the target object to obtain state information of the target object.
And a generating module 65 for generating a control command based on the state information and controlling the operation mode of the air conditioner using the control command.
It should be noted here that the above-mentioned obtaining module 61, analyzing module 63 and generating module 65 correspond to steps S202 to S206 in embodiment 2, and the above-mentioned units are the same as the examples and application scenarios realized by the corresponding steps, but are not limited to the disclosure of embodiment 2. It should be noted that the above-described elements as part of an apparatus may be implemented in a computer system, such as a set of computer-executable instructions.
As can be seen from the above, in the embodiment of the present invention, the obtaining module 61 may first obtain the voice information and the image of the target object; analyzing the voice information and the image of the target object by using an analysis module 63 to obtain the state information of the target object; finally, the generating module 65 generates a control command based on the state information, and controls the operation mode of the air conditioner using the control command. By the control device of the air conditioner, the aim of analyzing the acquired voice information and the acquired image of the target object to obtain the state information of the target object and generating the corresponding control instruction to control the operation mode of the air conditioner is fulfilled, so that the technical effects of improving the intelligent degree and the reliability of the air conditioner are achieved, and the technical problem that the intelligent degree of the air conditioner is low in the related technology is solved.
Optionally, the control device of the air conditioner further includes: first collection unit for gather the speech information of target object through the pronunciation collection module, wherein, the pronunciation collection module includes: a microphone; a second acquisition unit for acquiring an image of the target object by an image acquisition device, wherein the image acquisition device comprises at least one of: infrared camera, thermopile.
Optionally, the control device of the air conditioner further includes: the processing unit is used for carrying out natural voice processing on the voice information to obtain the voice characteristics of the target object; and the identification unit is used for carrying out image identification on the image to obtain the physical sign information of the target object.
Optionally, the control device of the air conditioner further includes: the input subunit is used for inputting voice information into the voice recognition model, wherein the voice recognition model is obtained by using a plurality of groups of training data in advance through machine learning training, and the plurality of groups of training data comprise: voice information and voice characteristics corresponding to the voice information; a first obtaining subunit, configured to obtain an output of the speech recognition model; and the second acquisition subunit is used for acquiring the voice characteristics based on the output of the voice recognition model.
Optionally, the control device of the air conditioner further includes: an input unit for inputting images to an image recognition model, wherein the image recognition model is obtained by machine learning training using a plurality of sets of training data in advance, and the plurality of sets of training data each include: an image and temperature information corresponding to the image; a first acquisition unit configured to acquire an output of the image recognition model; and the second acquisition unit is used for obtaining temperature information based on the output of the image recognition model.
Optionally, the temperature information includes temperature values of respective portions of the target object.
Optionally, the control device of the air conditioner further includes: and the sending module is used for sending the state information of the target object to the preset terminal equipment.
Optionally, the control device of the air conditioner further includes: and the control unit is used for controlling the air conditioner to operate in a sterilization mode based on the control instruction and controlling the air conditioner to start a fresh air function.
Example 4
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium including a stored computer program, wherein when the computer program is executed by a processor, the apparatus in which the computer storage medium is located is controlled to execute the control device of the air conditioner according to any one of the above.
Example 5
According to another aspect of the embodiments of the present invention, there is also provided a processor for executing a computer program, wherein the computer program executes the control device of the air conditioner according to any one of the above.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (15)
1. An air conditioner, comprising:
the voice acquisition module is used for acquiring voice information of the target object;
the image acquisition module is used for acquiring an image of the target object;
the processing module is respectively connected with the voice acquisition module and the image acquisition module and is used for analyzing the voice information and the image to obtain state information of the target object and generating a control instruction based on the state information;
and the controller is connected with the processing module and used for controlling the air conditioner to operate based on the control instruction when the control instruction is received.
2. The air conditioner according to claim 1, further comprising:
the image identification module is respectively connected with the image acquisition module and the processing module and is used for identifying the image so as to obtain the physical sign information of the target object;
and the voice recognition module is respectively connected with the voice acquisition module and the processing module and is used for recognizing the voice information to obtain the voice characteristics of the target object.
3. The air conditioner according to claim 1, further comprising: and the sterilization module is used for sterilizing the area where the air conditioner is located when the air conditioner runs in a sterilization mode.
4. The air conditioner according to claim 1, further comprising: and the communication module is used for communicating with preset terminal equipment so as to send the state information of the target object to the preset terminal equipment.
5. A control method of an air conditioner, applied to the air conditioner of any one of claims 1 to 4, comprising:
acquiring voice information and an image of a target object;
analyzing the voice information and the image of the target object to obtain the state information of the target object;
and generating a control instruction based on the state information, and controlling the operation mode of the air conditioner by using the control instruction.
6. The method of claim 5, wherein obtaining the voice information and the image of the target object comprises:
collecting voice information of the target object through a voice collecting module, wherein the voice collecting module comprises: a microphone;
acquiring an image of the target object by an image acquisition device, wherein the image acquisition device comprises at least one of: infrared camera, thermopile.
7. The method of claim 5, wherein analyzing the voice information and the image of the target object to obtain the state information of the target object comprises:
performing natural voice processing on the voice information to obtain voice characteristics of the target object;
and carrying out image recognition on the image to obtain the sign information of the target object.
8. The method of claim 7, wherein performing natural speech processing on the speech information to obtain the speech feature of the target object comprises:
inputting the voice information into a voice recognition model, wherein the voice recognition model is obtained by using a plurality of groups of training data in advance through machine learning training, and the plurality of groups of training data comprise: voice information and voice characteristics corresponding to the voice information;
acquiring the output of the voice recognition model;
the speech features are derived based on the output of the speech recognition model.
9. The method according to claim 7, wherein the sign information is temperature information of the target subject, and performing image recognition on the image to obtain the sign information of the target subject includes:
inputting the image into an image recognition model, wherein the image recognition model is obtained by using a plurality of groups of training data in advance through machine learning training, and the plurality of groups of training data comprise: an image and temperature information corresponding to the image;
acquiring the output of the image recognition model;
the temperature information is derived based on an output of the image recognition model.
10. The method of claim 9, wherein the temperature information comprises temperature values for various portions of the target object.
11. The method of claim 5, further comprising:
and sending the state information of the target object to a preset terminal device.
12. The method according to any one of claims 5 to 11, wherein generating a control command based on the state information and controlling an operation mode of the air conditioner using the control command comprises:
and controlling the air conditioner to operate in a sterilization mode based on the control instruction, and controlling the air conditioner to start a fresh air function.
13. A control apparatus of an air conditioner, characterized in that, a control method applied to the air conditioner of any one of the above claims 5 to 12, comprises:
the acquisition module is used for acquiring voice information and images of the target object;
the analysis module is used for analyzing the voice information and the image of the target object to obtain the state information of the target object;
and the generating module is used for generating a control instruction based on the state information and controlling the operation mode of the air conditioner by using the control instruction.
14. A computer-readable storage medium, comprising a stored computer program, wherein when the computer program is executed by a processor, the computer-readable storage medium controls an apparatus to perform the method of controlling an air conditioner according to any one of claims 5 to 11.
15. A processor, characterized in that the processor is configured to run a computer program, wherein the computer program is run to execute the control method of the air conditioner according to any one of the above claims 5 to 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110882359.6A CN113566395B (en) | 2021-08-02 | 2021-08-02 | Air conditioner, control method and device thereof and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110882359.6A CN113566395B (en) | 2021-08-02 | 2021-08-02 | Air conditioner, control method and device thereof and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113566395A true CN113566395A (en) | 2021-10-29 |
| CN113566395B CN113566395B (en) | 2022-08-02 |
Family
ID=78169997
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110882359.6A Active CN113566395B (en) | 2021-08-02 | 2021-08-02 | Air conditioner, control method and device thereof and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113566395B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024066375A1 (en) * | 2022-09-29 | 2024-04-04 | 青岛海尔空调器有限总公司 | Method and apparatus used by air conditioner for monitoring, and air conditioner and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110726222A (en) * | 2019-10-29 | 2020-01-24 | 珠海格力电器股份有限公司 | Air conditioner control method and device, storage medium and processor |
| CN110749055A (en) * | 2019-10-29 | 2020-02-04 | 珠海格力电器股份有限公司 | Method, device and system for controlling air conditioner |
| CN111380189A (en) * | 2020-03-27 | 2020-07-07 | 四川虹美智能科技有限公司 | Intelligent air conditioner control method and intelligent air conditioner |
| CN112325460A (en) * | 2020-10-15 | 2021-02-05 | 珠海格力电器股份有限公司 | Control method and control system of air conditioner and air conditioner |
| US20210164677A1 (en) * | 2018-04-13 | 2021-06-03 | Samsung Electronics Co., Ltd. | Air conditioner and method for controlling air conditioner |
-
2021
- 2021-08-02 CN CN202110882359.6A patent/CN113566395B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20210164677A1 (en) * | 2018-04-13 | 2021-06-03 | Samsung Electronics Co., Ltd. | Air conditioner and method for controlling air conditioner |
| CN110726222A (en) * | 2019-10-29 | 2020-01-24 | 珠海格力电器股份有限公司 | Air conditioner control method and device, storage medium and processor |
| CN110749055A (en) * | 2019-10-29 | 2020-02-04 | 珠海格力电器股份有限公司 | Method, device and system for controlling air conditioner |
| CN111380189A (en) * | 2020-03-27 | 2020-07-07 | 四川虹美智能科技有限公司 | Intelligent air conditioner control method and intelligent air conditioner |
| CN112325460A (en) * | 2020-10-15 | 2021-02-05 | 珠海格力电器股份有限公司 | Control method and control system of air conditioner and air conditioner |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024066375A1 (en) * | 2022-09-29 | 2024-04-04 | 青岛海尔空调器有限总公司 | Method and apparatus used by air conditioner for monitoring, and air conditioner and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113566395B (en) | 2022-08-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20190216333A1 (en) | Thermal face image use for health estimation | |
| CN109492595B (en) | Behavior prediction method and system suitable for fixed group | |
| CN106295313B (en) | Object identity management method and device and electronic equipment | |
| WO2019144658A1 (en) | Smart toilet and electric appliance system | |
| WO2019085585A1 (en) | Device control processing method and apparatus | |
| CN110291489A (en) | The efficient mankind identify intelligent assistant's computer in calculating | |
| CN109765991A (en) | Social interaction system is used to help system and non-transitory computer-readable storage media that user carries out social interaction | |
| US10610109B2 (en) | Emotion representative image to derive health rating | |
| WO2003025859A1 (en) | Interface apparatus | |
| CN110197235B (en) | Human body activity recognition method based on unique attention mechanism | |
| JP7338886B2 (en) | Area-based environmental management system, method and program | |
| CN110726222B (en) | Air conditioner control method and device, storage medium and processor | |
| CN115797868A (en) | Behavior early warning method, system, device and medium for monitoring object | |
| CN113566395B (en) | Air conditioner, control method and device thereof and computer readable storage medium | |
| CN110749055A (en) | Method, device and system for controlling air conditioner | |
| CN111768863B (en) | Infant development monitoring system and method based on artificial intelligence | |
| US20210231336A1 (en) | Air conditioner and control method thereof | |
| CN114830257A (en) | Cough detection system and method | |
| JP7306152B2 (en) | Emotion estimation device, emotion estimation method, program, information presentation device, information presentation method, and emotion estimation system | |
| CN111202534A (en) | Emotion prediction method based on group temperature monitoring | |
| CN115100560A (en) | Method, device and equipment for monitoring bad state of user and computer storage medium | |
| CN110427848B (en) | Mental analysis system | |
| Mithil et al. | An interactive voice controlled humanoid smart home prototype using concepts of natural language processing and machine learning | |
| CN112086193A (en) | Face recognition health prediction system and method based on Internet of things | |
| CN112487980A (en) | Micro-expression-based treatment method, device, system and computer-readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |