JP2014229097A - Air conditioner equipped with monitoring function - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain an air conditioner equipped with a monitoring function to which the monitoring function (or a crime prevention function inclusive) having higher reliability than that of a conventional technique is added.SOLUTION: An air conditioner 11 equipped with a monitoring function includes: an image sensor 15 acquiring image information on a monitoring target region; a heat sensor 16 acquiring temperature distribution information on the monitoring target region whose image information has been acquired; an image analyzer 18 forming image analysis information on the basis of the image information and the temperature distribution information; a microphone 17 acquiring sound information on the monitoring target region; a sound analyzer 19 forming sound analysis information on the basis of the sound information; and a determination device 20 determining whether abnormality occurs to the monitoring target region on the basis of the image analysis information and the sound analysis information.

Description

  The present invention relates to an air conditioner with a monitoring function.

  Conventionally, in order to provide environmental comfort or energy saving, an air conditioner that is equipped with an image sensor or heat sensor in an air conditioner, acquires and processes information on human movement and temperature, and performs optimal control. Proposed.

  Development is also progressing on technologies for providing monitoring functions to air conditioners. For example, Patent Literature 1 discloses a technique of an air conditioner to which a function of detecting an intruder of a suspicious person using an image sensor or a thermal sensor and watching over a child or a pet is added.

JP 2010-71595 A

  As in the prior art described above, in the monitoring function (or including a crime prevention function) using an image sensor or a thermal sensor, it is automatically determined whether or not there is an abnormal situation based on information obtained from each sensor. It is. Therefore, in order to increase the reliability of the monitoring function, determination accuracy is important. For example, as an example of an abnormal situation, intrusion of a suspicious person during absence or at night can be mentioned. In such a monitoring system, it is effective to detect a moving object with an image sensor and determine whether the moving object is a living body from the temperature distribution acquired by the thermal sensor.

  However, according to the conventional technique, it is possible to determine whether or not the moving body is a living body, but only the image sensor and the thermal sensor are used. Therefore, there is a possibility that a person who is not a suspicious person may be recognized as a suspicious person, and the reliability of the monitoring function (or including a crime prevention function) is low.

  This invention is made | formed in view of the above, Comprising: It aims at obtaining the air conditioner with a monitoring function to which the monitoring function (or including a crime prevention function) more reliable than before was provided.

  In order to solve the above-described problems and achieve the object, an air conditioner with a monitoring function of the present invention includes an image sensor that acquires image information of a monitoring target area, and a temperature of the monitoring target area that acquires the image information. A thermal sensor that acquires distribution information; an image analysis device that generates image analysis information from the image information and the temperature distribution information; a microphone that acquires sound information of the monitored region; and sound analysis information from the sound information. A sound analysis device to be created; and a determination device that determines whether there is an abnormality in the monitoring target region based on the image analysis information and the sound analysis information.

  Advantageous Effects of Invention According to the present invention, there is an effect that it is possible to obtain an air conditioner with a monitoring function to which a monitoring function (or including a crime prevention function) with higher reliability than before is provided.

1-1 is a block diagram illustrating a configuration of an air conditioner according to Embodiment 1. FIG. FIG. 1-2 is a flowchart for explaining the operation of the abnormality detection unit according to the first embodiment. FIG. 2-1 is a block diagram illustrating a configuration of an air conditioner according to the second embodiment. FIG. 2-2 is a flowchart for explaining the operation of the abnormality detection unit according to the second embodiment. FIG. 3 is a block diagram illustrating a configuration of an air conditioner according to Embodiment 3. FIG. 4-1 is a block diagram illustrating a configuration of the air conditioner according to the fourth embodiment. FIG. 4B is a flowchart for explaining the operation of the abnormality detection unit according to the fourth embodiment.

  Embodiments of an air conditioner with a monitoring function according to the present invention will be described below in detail with reference to the drawings. Note that the present invention is not limited to the embodiments.

Embodiment 1 FIG.
FIG. 1-1 is a block diagram showing a configuration of Embodiment 1 of an air conditioner according to the present invention. The air conditioner 11 illustrated in FIG. 1-1 includes a functional unit 12, a control unit 13, and an abnormality detection unit 14.

  The function unit 12 includes an air conditioning function unit 120 that performs air conditioning and a monitoring function unit 121 that monitors the surroundings of the installation location of the air conditioner 11. The control unit 13 controls the function unit 12. The abnormality detection unit 14 detects an abnormality by grasping the situation around the installation location of the air conditioner 11.

  Based on the abnormality information detected by the abnormality detection unit 14, the monitoring function unit 121 reports to a manager or a security company, warns an intruder, or issues an alarm to the surroundings.

  The abnormality detection unit 14 includes an image sensor 15, a thermal sensor 16, a microphone 17, an image analysis device 18, a sound analysis device 19, and a determination device 20. The image sensor 15 acquires an image around the place where the air conditioner 11 is installed. The heat sensor 16 acquires the temperature distribution around the place where the air conditioner 11 is installed. The microphone 17 acquires sound around the installation location of the air conditioner 11. The image analysis device 18 creates image analysis information based on the image acquired by the image sensor 15 and the temperature distribution acquired by the thermal sensor 16. The sound analysis device 19 creates sound analysis information based on the sound acquired by the microphone 17. The determination device 20 determines whether or not the surrounding area of the air conditioner 11 is in an abnormal state based on the information created from the image analysis information and the sound analysis information, and notifies the control unit 13 of the determination result.

  FIG. 1-2 is a flowchart for explaining the operation of the abnormality detection unit 14.

  First, the image sensor 15 continuously acquires images around the installation location of the air conditioner 11, and sends the acquired image information to the image analysis device 18 (step S1).

  The thermal sensor 16 continuously acquires a temperature distribution in a range including the image area acquired by the image sensor 15, and sends the acquired temperature distribution information to the image analysis device 18 (step S2).

  The image analysis device 18 detects a moving object from the difference between successive images and extracts the difference between successive temperature distribution information (step S3).

  Then, the image analysis device 18 compares the position and size of the moving object detected from the image information with the temperature distribution difference of the temperature distribution information, creates image analysis information, and sends it to the determination device 20 (step S4). . The image analysis information includes information such as the size of the moving object, the number of moving objects, the moving direction of the moving object, and the like.

  The image analysis device 18 can also determine whether or not the moving object is a living body from the temperature distribution information.

  The microphone 17 continuously acquires sounds around the installation location of the air conditioner 11, and sends the acquired sound information to the sound analysis device 19 (step S5).

  The sound analysis device 19 analyzes the volume and frequency of the sound sent from the microphone 17, creates sound analysis information, and sends it to the determination device 20 (step S6). The sound analysis information includes information such as a sudden change in volume and frequency distribution, for example.

  Then, the determination device 20 determines whether or not there is an abnormality around the installation location of the air conditioner 11 based on the information sent from the image analysis device 18 and the sound analysis device 19, and sends the determination result to the control unit 13 ( Step S7).

  As an example, a case where a suspicious person breaks a window and enters an answering house where the air conditioner 11 is installed will be described. At this time, it is impossible to determine whether a suspicious person has entered, a pet has moved, or a householder has returned home only by detecting a moving object, as in the past. However, according to the present invention, first, it is determined that the moving object is a living body from the image information and the temperature distribution information, and second, it is determined that the moving object is a human based on the size of the moving object in the image information. Third, it is possible to determine the intrusion route from the starting point of the moving direction of the moving object in the image information, and fourth, it can be determined that the window is broken from a sudden change in volume in the sound analysis information. The determination device 20 determines the intrusion of the suspicious person in consideration of the first to fourth determination results.

  As described in the present embodiment, by using image analysis information and sound analysis information based on image information and temperature distribution information, it is possible to determine an abnormal situation with higher accuracy than in the past. Therefore, the monitoring function is improved and the reliability of the crime prevention function can be improved.

Embodiment 2. FIG.
In the first embodiment, the determination device 20 has been described as determining the abnormality from the image analysis information based on the image information and the temperature distribution information and the sound analysis information. However, in the present embodiment, the characteristics of the abnormal sound (volume, frequency, etc.) ) Will be stored in advance, and this feature will be described in comparison with the acquired sound analysis information. In the present embodiment, the same components as those in the first embodiment are denoted by the same reference numerals.

  FIG. 2-1 is a block diagram showing a configuration of Embodiment 2 of the air conditioner according to the present invention. In the abnormality detection unit 14a of the air conditioner 11a illustrated in FIG. 2A, the sound analysis device 19a includes a storage device 190 and a comparison device 191. The storage device 190 stores a plurality of abnormal sound feature data. As a memory element used for the memory device 190, a mask ROM can be exemplified. The comparison device 191 compares the sound acquired by the microphone 17 with the characteristics of the abnormal sound stored in the storage device 190, and creates sound analysis information.

  The operation of the abnormality detection unit 14a of the present embodiment will be described with reference to FIG. FIG. 2-2 is a flowchart for explaining the operation of the abnormality detection unit 14a. Note that the steps (steps S1 to S4) for acquiring image analysis information are the same as those in the first embodiment.

  The microphone 17 continuously acquires sounds around the installation location of the air conditioner 11a, and sends the acquired sound information to the comparison device 191 of the sound analysis device 19a (step S5a).

  The comparison device 191 extracts the characteristics of the sound sent from the microphone 17 and sequentially compares it with the characteristics of a plurality of abnormal sounds held in advance in the storage device 190, and the sound analysis including the content of the abnormality that best matches. Information is created and sent to the determination device 20 (step S6a).

  As in the first embodiment, the determination device 20 determines whether or not there is an abnormality around the installation location of the air conditioner 11a from the information sent from the image analysis device 18 and the sound analysis device 19a. The result is sent to the control unit 13 (step S7).

  Here, a specific example of the present embodiment will be described. As an example, immediately after detecting a sound of 120 decibels or more, if there is a moving body of 35 ° C. or more and less than 40 ° C. that moves toward the room, this is an abnormal situation. It is assumed that “present” is stored in the storage device 190.

  When an intruder (for example, body temperature 36 ° C.) breaks into the glass and enters the room, first, a loud sound (for example, 130 decibels) is generated.

  The sound that breaks the glass acquired by the microphone 17 is sent to the sound analysis device 19a, extracted that it is 120 decibels or more, and sent to the determination device 20.

  On the other hand, the image sensor 15 acquires images of a continuous moving body, and the thermal sensor 16 detects that the moving body is 36 ° C. and sends it to the image analysis device 18. The image analysis device 18 detects that the moving body moves from the window position toward the room, and extracts the temperature (36 ° C.) of the moving body. Then, the image analysis device 18 compares the position and size of the moving object detected from the image information with the temperature distribution difference of the temperature distribution information, creates image analysis information, and sends the image analysis information to the determination device 20. The determination device 20 sequentially compares with the characteristics of the abnormal situation stored in advance in the storage device 190, creates sound analysis information including the content of the abnormality that best matches, and sends it to the determination device 20, so that It is determined that there is an intruder. The control unit 13 instructs the monitoring function unit 121 according to the determination result. The monitoring function unit 121 reports to a manager or a security company, warns an intruder, or issues a warning to the surroundings.

  As described above, according to the present invention, it is possible to determine not only the detection of an abnormal situation but also the type of the abnormal situation by linking visual information and auditory information. It is possible to give an appropriate command according to

  As described in the present embodiment, when sound analysis information is used, an abnormal situation can be determined with higher accuracy than in the first embodiment. Therefore, the monitoring function can be further improved, and the reliability of the crime prevention function can be further improved.

Embodiment 3 FIG.
In the second embodiment, the feature data of the abnormal sound is stored in advance, and the feature is compared with the acquired sound analysis information. However, in the present embodiment, the feature of the abnormal sound is stored in the air. The form which can be updated even after installation of a harmony machine is demonstrated. Also in the present embodiment, the same reference numerals are given to the same configurations as those in the first and second embodiments.

  FIG. 3 is a block diagram showing a configuration of Embodiment 3 of the air conditioner according to the present invention. The control unit 13a of the air conditioner 11b illustrated in FIG.

  The receiving device 130 receives data of abnormal sound characteristics sent from the outside. The receiving device 130 may be configured to be able to receive data by wire or may be configured to be able to receive data wirelessly.

  In the abnormality detection unit 14b of the air conditioner 11b shown in FIG. 3, the sound analysis device 19b includes a storage device 190a and a comparison device 191.

  The storage device 190a holds a plurality of abnormal sound feature data, and the contents can be updated (added or overwritten) by the receiving device 130. Therefore, a rewritable memory element is used for the memory device 190a. As a rewritable storage element, a PROM (Programmable ROM) typified by a flash memory can be exemplified. In addition, when the air conditioner 11b is activated, the nonvolatile memory may be used when the latest abnormal sound characteristic data is received from the receiving device 130 and used.

  The comparison device 191 compares the sound acquired by the microphone 17 with the characteristics of the abnormal sound held in the storage device 190a, and creates sound analysis information.

  As described in the present embodiment, the storage device 190a holds a plurality of abnormal sound feature data and can be updated (added or overwritten) by the receiving device 130, whereby the air conditioner 11b is installed. Even after this, it is possible to sequentially update the abnormal sound feature data held in the storage device 190a. For this reason, it is possible to change the standard of abnormality to one suitable for the installation environment at any time, and the accuracy of determination can be improved.

Embodiment 4 FIG.
In the first to third embodiments, the form in which the abnormality is determined by using the acquired sound information acquired by the determination device 20 as it is has been described, but the sound for operating the air conditioner is not considered. In the present embodiment, a description will be given of a mode in which sound information can be acquired with higher accuracy by removing the characteristics of the operation sound generated by the air conditioner itself from the characteristics of the sound acquired from the microphone. Also in the present embodiment, the same reference numerals are given to the same configurations as in the first to third embodiments.

  FIG. 4-1 is a block diagram showing a configuration of Embodiment 4 of the air conditioner according to the present invention. The configuration of the fourth embodiment can be applied by modifying the configuration of the second and third embodiments, but here, the configuration modified by applying the configuration of the second embodiment is shown. However, the configuration of the present embodiment can also be applied to the third embodiment (dotted line arrow in FIG. 4A).

  The abnormality detection unit 14c of the air conditioner 11c illustrated in FIG. 4A includes a sound analysis device 19c, and the sound analysis device 19c includes a storage device 190b, a comparison device 191a, and a subtraction device 192.

  The subtracting device 192 removes the feature of the operating sound of the air conditioner 11c itself from the feature extracted from the sound acquired by the microphone 17.

  The storage device 190b not only stores data of a plurality of abnormal sound features used by the comparison device 191a, but the subtraction device 192 removes the operating sound features of the air conditioner 11c itself so that the air conditioner 11c own data Stores data of characteristics of operation sound.

  The operation of the abnormality detection unit 14c will be described with reference to FIG. FIG. 4B is a flowchart for explaining the operation of the abnormality detection unit 14c. Note that the steps (steps S1 to S4) for acquiring image analysis information are the same as those in the first embodiment.

  The microphone 17 continuously acquires sound information around the place where the air conditioner 11c is installed, and sends it to the subtracting device 192 of the sound analyzing device 19c (step S5b).

  In addition, the storage device 190b stores information on operation sound according to the operation of the air conditioner 11c, and refers to a command sent from the control unit 13 to the air conditioning function unit 120, and corresponds to the current operation. The sound information is sent to the subtractor 192 (step S8).

  The subtracting device 192 subtracts the characteristics of the operation sound from the storage device 190b from the sound information acquired by the microphone 17 and sends the result to the comparing device 191a (step S9).

  The comparison device 191a extracts the feature of the sound sent from the subtraction device 192, sequentially compares it with the features of a plurality of abnormal sounds held in advance in the storage device 190b, and the sound including the content of the abnormality that best matches. Analysis information is created and sent to the determination device 20 (step S6b).

  Since the operation sound of the air conditioner 11c is removed from the sound sent to the comparison device 191a by the subtraction device 192, sound information can be acquired with higher accuracy.

  As in the first embodiment, the determination device 20 determines whether or not there is an abnormality around the installation location of the air conditioner 11c from the information sent from the image analysis device 18 and the sound analysis device 19c. The result is sent to the control unit 13 (step S7).

  As described in the present embodiment, when the information on the operation sound generated by the air conditioner 11c itself is removed, the characteristics of the sound around the place where the air conditioner 11c is installed become clearer and abnormal with higher accuracy. It becomes possible to determine the situation. Therefore, the monitoring function can be further improved, and the reliability of the crime prevention function can be further improved.

  In the present invention, the air conditioners 11, 11a, 11b, and 11c include a remote controller having a display unit, and have a configuration capable of displaying image information of the image sensor 15 on the display unit when there is an abnormality. May be. Alternatively, the air conditioners 11, 11a, 11b, and 11c have a configuration capable of communicating with a mobile terminal (for example, a smartphone) having a display unit, and display the image information of the image sensor 15 on the display unit when there is an abnormality. May have a configuration capable of.

  As described above, the air conditioner with a monitoring function according to the present invention is useful when monitoring a monitoring target region with high reliability.

  11, 11a, 11b, 11c Air conditioner, 12 functional units, 13, 13a control unit, 14, 14a, 14b, 14c abnormality detection unit, 15 image sensor, 16 thermal sensor, 17 microphone, 18 image analysis device, 19, 19a, 19b, 19c Sound analysis device, 20 determination device, 120 air conditioning function unit, 121 monitoring function unit, 130 reception device, 190, 190a storage device, 191, 191a comparison device, 192 subtraction device, S1 to S9, S5a, S5b , S6a, S6b steps.

Claims (4)

An image sensor for acquiring image information of a monitoring target area;
A thermal sensor that acquires temperature distribution information of the monitoring target area from which the image information has been acquired;
An image analysis device for creating image analysis information from the image information and the temperature distribution information;
A microphone for obtaining sound information of the monitored area;
A sound analysis device for creating sound analysis information from the sound information;
An air conditioner with a monitoring function, comprising: a determination device that determines whether there is an abnormality in the monitoring target region based on the image analysis information and the sound analysis information. The determination device includes:
A storage device for storing sound information at the time of abnormality;
2. The air conditioner with a monitoring function according to claim 1, further comprising: a comparison device that compares and stores the sound information at the time of abnormality of the storage device and the sound analysis information. The storage device includes a rewritable storage element,
The air conditioner with a monitoring function according to claim 2, wherein the sound analysis device further includes a reception device capable of sending information on the sound at the time of abnormality to the storage device. The sound analyzer is
The subtractor which subtracts the operation sound of the said air conditioner memorize | stored in the said memory | storage device from the said sound information is further provided between the said microphone and the said comparison apparatus. Air conditioner with monitoring function.

Images